2024-09-10T09:49:22.655 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T09:49:22.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T09:49:22.775 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899012 branch: wip-rishabh-testing-20240909.165402-squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/iozone}} email: null first_in_suite: false job_id: '7899012' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240909.165402-squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt dry_run: true install: ceph: flavor: default sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240909.165402-squid sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9893 sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b sleep_before_teardown: 0 subset: 197/1024 suite: fs suite_branch: wip-rishabh-testing-20240909.165402-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH2bOjehjJ4LW8lVs6gdn/zEKmvroQX03FHOIzr5cy/DBNWqCTScZWC5HkLCAVvsYXo+M7YdICjnL70JAjNTtNo= smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOdidWwXjjRfeAJOntWl07hpP38MyymSeoAFCbk8D49QYLM9GSMBJsp7PPvDU64iwDci4pOm10rlCRjmAZjSx1Q= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXeyfln90k3BIdAP5z4haU6QwlCjlX6yG79J8GNLKQOTeJ6iCgKKhgJEXXMpUZeW5V4ushsem2jywMqX+n+Fdg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - quiescer: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_06:58:10 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T09:49:22.775 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa; will attempt to use it 2024-09-10T09:49:22.776 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks 2024-09-10T09:49:22.776 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T09:49:22.777 INFO:teuthology.task.internal:Checking packages... 2024-09-10T09:49:22.799 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1cf819b7212a6048e92fc78c4eff963344f6d56b' 2024-09-10T09:49:22.799 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T09:49:22.799 INFO:teuthology.packaging:ref: None 2024-09-10T09:49:22.799 INFO:teuthology.packaging:tag: None 2024-09-10T09:49:22.799 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240909.165402-squid 2024-09-10T09:49:22.799 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:49:22.800 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240909.165402-squid 2024-09-10T09:49:22.939 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-305.g1cf819b7 2024-09-10T09:49:22.941 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T09:49:22.965 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T09:49:22.965 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T09:49:22.974 INFO:teuthology.task.internal:Saving configuration 2024-09-10T09:49:22.993 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T09:49:23.000 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T09:49:23.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899012', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 09:44:09.490194', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH2bOjehjJ4LW8lVs6gdn/zEKmvroQX03FHOIzr5cy/DBNWqCTScZWC5HkLCAVvsYXo+M7YdICjnL70JAjNTtNo='} 2024-09-10T09:49:23.045 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899012', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 09:44:09.491415', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOdidWwXjjRfeAJOntWl07hpP38MyymSeoAFCbk8D49QYLM9GSMBJsp7PPvDU64iwDci4pOm10rlCRjmAZjSx1Q='} 2024-09-10T09:49:23.066 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899012', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 09:44:09.488786', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXeyfln90k3BIdAP5z4haU6QwlCjlX6yG79J8GNLKQOTeJ6iCgKKhgJEXXMpUZeW5V4ushsem2jywMqX+n+Fdg='} 2024-09-10T09:49:23.066 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T09:49:23.074 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T09:49:23.074 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T09:49:23.074 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T09:49:23.075 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T09:49:23.266 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc81330fbe0>, signals=[15]) 2024-09-10T09:49:23.267 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T09:49:23.273 INFO:teuthology.task.internal:Opening connections... 2024-09-10T09:49:23.273 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-09-10T09:49:23.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:49:23.353 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-09-10T09:49:23.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:49:23.427 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T09:49:23.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:49:23.501 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T09:49:23.509 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-09-10T09:49:23.527 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-09-10T09:49:23.527 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-09-10T09:49:23.585 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2024-09-10T09:49:23.585 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2024-09-10T09:49:23.585 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2024-09-10T09:49:23.585 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2024-09-10T09:49:23.585 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2024-09-10T09:49:23.585 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2024-09-10T09:49:23.585 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T09:49:23.585 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-09-10T09:49:23.585 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2024-09-10T09:49:23.585 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T09:49:23.586 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2024-09-10T09:49:23.586 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T09:49:23.586 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T09:49:23.586 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T09:49:23.586 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-09-10T09:49:23.609 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-09-10T09:49:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-09-10T09:49:23.628 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-09-10T09:49:23.686 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-09-10T09:49:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-09-10T09:49:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-09-10T09:49:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-09-10T09:49:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-09-10T09:49:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-09-10T09:49:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T09:49:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-09-10T09:49:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-09-10T09:49:23.687 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T09:49:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-09-10T09:49:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T09:49:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T09:49:23.688 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T09:49:23.688 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-09-10T09:49:23.713 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-09-10T09:49:23.732 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-09-10T09:49:23.732 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-09-10T09:49:23.790 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-09-10T09:49:23.790 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-09-10T09:49:23.790 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-09-10T09:49:23.790 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-09-10T09:49:23.790 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-09-10T09:49:23.790 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-09-10T09:49:23.790 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T09:49:23.790 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-09-10T09:49:23.790 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-09-10T09:49:23.791 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T09:49:23.791 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-09-10T09:49:23.791 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T09:49:23.791 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T09:49:23.791 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T09:49:23.791 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-09-10T09:49:23.810 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T09:49:23.820 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T09:49:23.827 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T09:49:23.828 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-09-10T09:49:23.830 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-09-10T09:49:23.833 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-09-10T09:49:23.849 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T09:49:23.859 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T09:49:23.859 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-09-10T09:49:23.888 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-09-10T09:49:23.890 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-09-10T09:49:24.001 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T09:49:24.080 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T09:49:24.098 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-10T09:49:24.099 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-10T09:49:24.099 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-10T09:49:24.099 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T09:49:24.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:49:24.116 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-10T09:49:24.363 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T09:49:24.363 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T09:49:24.363 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-10T09:49:24.382 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-503.el9.x86_64 2024-09-10T09:49:24.382 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T09:49:24.382 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T09:49:24.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum upgrade -y linux-firmware 2024-09-10T09:49:28.602 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.2 MB 00:02 2024-09-10T09:49:30.561 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-10T09:49:35.070 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-10T09:49:36.581 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 19 kB 00:00 2024-09-10T09:49:37.359 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-10T09:49:42.981 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-09-10T09:49:45.128 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-09-10T09:49:45.129 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2024-09-10T09:49:45.129 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-09-10T09:49:45.261 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-10T09:49:45.261 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T09:49:45.415 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T09:49:45.415 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T09:49:45.418 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi050.front.sepia.ceph.com to complete... 2024-09-10T09:49:51.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10 09:49:51 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T09:49:51.738 INFO:teuthology.orchestra.run.smithi050.stderr:FINISHED --2024-09-10 09:49:51-- 2024-09-10T09:49:51.738 INFO:teuthology.orchestra.run.smithi050.stderr:Total wall clock time: 6.3s 2024-09-10T09:49:51.738 INFO:teuthology.orchestra.run.smithi050.stderr:Downloaded: 1 files, 343M in 6.0s (57.0 MB/s) 2024-09-10T09:49:51.741 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-10T09:49:51.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T09:49:53.948 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying... ######################################## 2024-09-10T09:49:54.164 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing... ######################################## 2024-09-10T09:49:54.279 INFO:teuthology.orchestra.run.smithi050.stdout:Updating / installing... 2024-09-10T09:50:02.600 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T09:50:43.184 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T09:50:43.185 DEBUG:teuthology.orchestra.run.smithi050:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T09:50:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T09:50:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T09:50:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T09:50:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T09:50:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T09:50:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T09:50:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T09:50:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T09:50:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T09:50:43.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T09:50:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T09:50:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T09:50:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T09:50:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T09:50:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T09:50:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T09:50:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T09:50:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T09:50:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T09:50:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T09:50:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T09:50:43.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T09:50:43.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T09:50:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T09:50:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T09:50:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T09:50:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T09:50:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T09:50:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T09:50:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T09:50:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T09:50:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T09:50:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T09:50:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T09:50:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T09:50:43.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T09:50:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T09:50:43.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T09:50:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T09:50:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T09:50:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T09:50:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T09:50:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T09:50:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T09:50:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T09:50:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T09:50:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T09:50:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T09:50:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T09:50:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T09:50:43.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T09:50:43.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T09:50:43.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T09:50:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T09:50:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T09:50:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T09:50:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T09:50:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T09:50:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T09:50:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T09:50:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T09:50:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T09:50:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T09:50:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T09:50:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T09:50:43.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T09:50:43.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T09:50:43.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T09:50:43.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T09:50:43.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T09:50:43.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T09:50:43.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T09:50:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T09:50:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T09:50:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T09:50:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T09:50:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T09:50:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T09:50:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T09:50:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T09:50:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T09:50:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T09:50:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T09:50:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T09:50:43.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T09:50:43.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T09:50:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T09:50:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T09:50:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T09:50:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T09:50:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T09:50:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T09:50:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T09:50:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T09:50:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T09:50:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T09:50:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T09:50:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T09:50:43.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T09:50:43.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T09:50:43.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T09:50:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T09:50:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T09:50:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T09:50:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T09:50:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T09:50:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T09:50:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T09:50:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T09:50:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T09:50:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T09:50:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T09:50:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T09:50:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T09:50:43.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T09:50:43.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T09:50:43.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T09:50:43.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T09:50:43.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T09:50:43.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T09:50:43.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T09:50:43.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T09:50:43.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T09:50:43.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T09:50:43.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T09:50:43.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T09:50:43.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T09:50:43.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T09:50:43.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T09:50:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T09:50:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T09:50:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T09:50:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T09:50:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T09:50:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T09:50:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T09:50:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T09:50:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T09:50:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T09:50:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T09:50:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T09:50:43.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T09:50:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T09:50:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T09:50:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T09:50:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T09:50:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T09:50:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T09:50:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T09:50:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T09:50:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T09:50:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T09:50:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T09:50:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T09:50:43.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T09:50:43.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T09:50:43.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T09:50:43.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T09:50:43.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T09:50:43.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T09:50:43.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T09:50:43.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T09:50:43.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T09:50:43.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T09:50:43.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T09:50:43.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T09:50:43.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T09:50:43.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T09:50:43.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T09:50:43.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T09:50:43.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T09:50:43.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T09:50:43.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T09:50:43.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T09:50:43.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T09:50:43.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T09:50:43.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T09:50:43.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T09:50:43.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T09:50:43.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T09:50:43.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T09:50:43.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T09:50:43.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T09:50:43.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T09:50:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T09:50:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T09:50:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T09:50:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T09:50:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T09:50:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T09:50:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T09:50:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T09:50:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T09:50:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T09:50:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T09:50:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T09:50:43.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T09:50:43.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T09:50:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T09:50:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T09:50:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T09:50:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T09:50:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T09:50:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T09:50:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T09:50:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T09:50:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T09:50:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T09:50:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T09:50:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T09:50:43.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T09:50:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T09:50:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T09:50:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T09:50:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T09:50:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T09:50:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T09:50:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T09:50:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T09:50:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T09:50:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T09:50:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T09:50:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T09:50:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T09:50:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T09:50:43.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T09:50:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T09:50:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T09:50:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T09:50:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T09:50:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T09:50:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T09:50:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T09:50:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T09:50:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T09:50:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T09:50:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T09:50:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T09:50:43.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T09:50:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T09:50:43.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T09:50:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T09:50:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T09:50:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T09:50:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T09:50:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T09:50:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T09:50:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T09:50:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T09:50:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T09:50:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T09:50:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T09:50:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T09:50:43.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T09:50:43.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T09:50:43.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T09:50:43.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T09:50:43.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T09:50:43.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T09:50:43.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T09:50:43.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T09:50:43.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T09:50:43.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T09:50:43.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T09:50:43.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T09:50:43.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T09:50:43.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T09:50:43.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T09:50:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T09:50:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T09:50:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T09:50:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T09:50:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T09:50:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T09:50:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T09:50:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T09:50:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T09:50:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T09:50:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T09:50:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T09:50:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T09:50:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T09:50:43.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T09:50:43.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T09:50:43.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T09:50:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T09:50:43.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T09:50:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T09:50:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T09:50:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T09:50:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T09:50:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T09:50:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T09:50:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T09:50:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T09:50:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T09:50:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T09:50:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T09:50:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T09:50:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T09:50:43.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T09:50:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T09:50:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T09:50:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T09:50:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T09:50:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T09:50:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T09:50:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T09:50:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T09:50:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T09:50:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T09:50:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T09:50:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T09:50:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T09:50:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T09:50:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T09:50:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T09:50:43.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T09:50:43.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T09:50:43.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T09:50:43.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T09:50:43.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T09:50:43.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T09:50:43.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T09:50:43.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T09:50:43.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T09:50:43.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T09:50:43.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T09:50:43.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T09:50:43.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T09:50:43.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T09:50:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T09:50:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T09:50:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T09:50:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T09:50:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T09:50:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T09:50:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T09:50:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T09:50:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T09:50:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T09:50:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T09:50:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T09:50:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T09:50:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T09:50:43.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T09:50:43.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T09:50:43.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T09:50:43.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T09:50:43.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T09:50:43.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T09:50:43.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T09:50:43.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T09:50:43.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T09:50:43.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T09:50:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T09:50:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T09:50:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T09:50:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T09:50:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T09:50:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T09:50:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T09:50:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T09:50:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T09:50:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T09:50:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T09:50:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T09:50:43.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T09:50:43.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T09:50:43.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T09:50:43.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T09:50:43.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T09:50:43.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T09:50:43.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T09:50:43.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T09:50:43.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T09:50:43.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T09:50:43.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T09:50:43.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T09:50:43.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T09:50:43.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T09:50:43.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T09:50:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T09:50:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T09:50:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T09:50:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T09:50:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T09:50:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T09:50:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T09:50:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T09:50:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T09:50:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T09:50:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T09:50:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T09:50:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T09:50:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T09:50:43.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T09:50:43.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T09:50:43.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T09:50:43.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T09:50:43.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T09:50:43.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T09:50:43.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T09:50:43.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T09:50:43.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T09:50:43.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T09:50:43.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T09:50:43.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T09:50:43.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T09:50:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T09:50:43.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T09:50:43.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T09:50:43.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T09:50:43.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T09:50:43.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T09:50:43.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T09:50:43.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T09:50:43.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T09:50:43.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T09:50:43.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T09:50:43.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T09:50:43.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T09:50:43.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T09:50:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T09:50:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T09:50:43.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T09:50:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T09:50:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T09:50:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T09:50:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T09:50:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T09:50:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T09:50:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T09:50:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T09:50:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T09:50:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T09:50:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T09:50:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T09:50:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T09:50:43.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T09:50:43.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T09:50:43.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T09:50:43.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T09:50:43.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T09:50:43.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T09:50:43.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T09:50:43.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T09:50:43.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T09:50:43.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T09:50:43.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T09:50:43.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T09:50:43.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T09:50:43.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T09:50:43.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T09:50:43.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T09:50:43.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T09:50:43.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T09:50:43.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T09:50:43.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T09:50:43.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T09:50:43.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T09:50:43.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T09:50:43.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T09:50:43.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T09:50:43.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T09:50:43.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T09:50:43.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T09:50:43.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T09:50:43.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T09:50:43.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T09:50:43.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T09:50:43.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T09:50:43.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T09:50:43.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T09:50:43.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T09:50:43.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T09:50:43.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T09:50:43.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T09:50:43.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T09:50:43.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T09:50:43.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T09:50:43.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T09:50:43.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T09:50:43.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T09:50:43.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T09:50:43.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T09:50:43.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T09:50:43.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T09:50:43.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T09:50:43.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T09:50:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T09:50:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T09:50:43.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T09:50:43.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T09:50:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T09:50:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T09:50:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T09:50:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T09:50:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T09:50:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T09:50:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T09:50:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T09:50:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T09:50:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T09:50:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T09:50:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T09:50:43.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T09:50:43.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T09:50:43.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T09:50:43.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T09:50:43.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T09:50:43.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T09:50:43.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T09:50:43.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T09:50:43.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T09:50:43.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T09:50:43.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T09:50:43.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T09:50:43.381 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T09:50:43.381 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T09:50:43.381 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T09:50:43.381 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T09:50:43.381 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T09:50:43.384 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T09:50:43.384 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T09:50:43.384 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T09:50:43.384 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T09:50:43.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T09:50:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T09:50:43.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T09:50:43.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T09:50:43.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T09:50:43.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T09:50:43.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T09:50:43.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T09:50:43.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T09:50:43.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T09:50:43.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T09:50:43.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T09:50:43.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T09:50:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T09:50:43.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T09:50:43.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T09:50:43.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T09:50:43.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T09:50:43.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T09:50:43.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T09:50:43.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T09:50:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T09:50:43.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T09:50:43.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T09:50:43.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T09:50:43.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T09:50:43.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T09:50:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T09:50:43.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T09:50:43.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T09:50:43.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T09:50:43.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T09:50:43.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T09:50:43.419 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T09:50:43.419 DEBUG:teuthology.orchestra.run.smithi050:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T09:50:43.444 INFO:teuthology.orchestra.run.smithi050.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T09:50:43.444 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T09:50:43.444 INFO:teuthology.orchestra.run.smithi050.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T09:50:43.445 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2024-09-10T09:50:43.445 INFO:teuthology.orchestra.run.smithi050.stdout:for file in vmlinuz System.map config; do 2024-09-10T09:50:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T09:50:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T09:50:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: fi 2024-09-10T09:50:43.445 INFO:teuthology.orchestra.run.smithi050.stdout:done 2024-09-10T09:50:43.445 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T09:50:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T09:50:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T09:50:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T09:50:43.445 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2024-09-10T09:50:43.445 INFO:teuthology.orchestra.run.smithi050.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T09:50:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T09:50:43.446 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2024-09-10T09:50:43.446 INFO:teuthology.orchestra.run.smithi050.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T09:50:43.446 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T09:50:43.446 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T09:50:43.446 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2024-09-10T09:50:43.447 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2024-09-10T09:50:43.524 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2024-09-10T09:50:43.524 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2024-09-10T09:50:43.524 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.06 2024-09-10T09:50:43.524 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 82.el9 2024-09-10T09:50:43.524 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2024-09-10T09:50:43.524 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T09:50:43.524 INFO:teuthology.orchestra.run.smithi050.stdout:Group : Unspecified 2024-09-10T09:50:43.524 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 8274670 2024-09-10T09:50:43.524 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2024-09-10T09:50:43.524 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : builder@centos.org 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2024-09-10T09:50:43.525 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:50:43.526 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T09:50:43.526 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T09:50:43.526 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T09:50:43.527 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T09:50:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-09-10T09:50:45.542 INFO:teuthology.orchestra.run.smithi050.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T09:50:45.589 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-09-10T09:50:45.591 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-10T09:50:45.607 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.uPWBulN9fU 2024-09-10T09:50:45.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uPWBulN9fU 2024-09-10T09:50:45.675 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.uPWBulN9fU 2024-09-10T09:50:45.819 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.uPWBulN9fU is 6KB 2024-09-10T09:50:45.868 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.uPWBulN9fU 2024-09-10T09:50:45.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T09:50:45.952 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T09:50:45.952 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T09:50:45.952 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T09:50:45.953 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T09:50:45.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T09:50:46.091 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2024-09-10T09:51:16.094 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T09:51:16.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-10T09:51:16.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:52:16.098 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T09:52:25.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-10T09:52:25.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:52:25.527 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-10T09:52:26.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-10T09:52:26.037 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T09:52:26.037 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-10T09:52:26.070 INFO:teuthology.orchestra.run.smithi050.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T09:52:26.071 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T09:52:26.071 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T09:52:26.071 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T09:52:27.074 DEBUG:teuthology.parallel:result is None 2024-09-10T09:52:27.074 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T09:52:27.086 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T09:52:27.086 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T09:52:27.090 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T09:52:27.092 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T09:52:27.120 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T09:52:27.127 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T09:52:27.141 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T09:52:27.141 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T09:52:27.166 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T09:52:27.168 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T09:52:27.222 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T09:52:27.230 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T09:52:27.230 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T09:52:27.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:52:27.250 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T09:52:27.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:52:27.267 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T09:52:27.271 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T09:52:27.292 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T09:52:27.331 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:52:27.348 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:52:27.360 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:52:27.374 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:52:27.394 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:52:27.413 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:52:27.416 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T09:52:27.427 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T09:52:27.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T09:52:27.430 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T09:52:27.433 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T09:52:27.485 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T09:52:27.495 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T09:52:27.495 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T09:52:27.498 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T09:52:27.501 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T09:52:27.529 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:52:27.636 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:52:27.725 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:52:27.788 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:52:27.861 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T09:52:27.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T09:52:27.942 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:52:27.979 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:52:28.042 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:52:28.121 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:52:28.168 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T09:52:28.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T09:52:28.234 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:52:28.278 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:52:28.337 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:52:28.411 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:52:28.464 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T09:52:28.464 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T09:52:28.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-09-10T09:52:28.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-09-10T09:52:28.538 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-09-10T09:52:28.569 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T09:52:28.605 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T09:52:28.612 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T09:52:29.121 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T09:52:29.129 INFO:teuthology.task.internal:Starting timer... 2024-09-10T09:52:29.129 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T09:52:29.140 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T09:52:29.149 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-10T09:52:29.150 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2024-09-10T09:52:29.282 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2024-09-10T09:52:29.286 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2024-09-10T09:52:29.339 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2024-09-10T09:52:29.341 DEBUG:teuthology.orchestra.run.smithi189:> sudo service auditd rotate 2024-09-10T09:52:29.398 INFO:teuthology.orchestra.run.smithi189.stdout:Rotating logs: 2024-09-10T09:52:29.401 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T09:52:29.401 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2024-09-10T09:52:29.449 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2024-09-10T09:52:29.450 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2024-09-10T09:52:29.475 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2024-09-10T09:52:29.475 DEBUG:teuthology.orchestra.run.smithi189:> /usr/sbin/getenforce 2024-09-10T09:52:29.505 INFO:teuthology.orchestra.run.smithi189.stdout:Permissive 2024-09-10T09:52:29.505 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi189.front.sepia.ceph.com': 'permissive'} 2024-09-10T09:52:29.505 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T09:52:29.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:52:29.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T09:52:29.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:52:29.591 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T09:52:29.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:52:29.618 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T09:52:29.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2024-09-10T09:52:29.748 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2024-09-10T09:52:29.778 DEBUG:teuthology.orchestra.run.smithi189:> sudo /usr/sbin/setenforce permissive 2024-09-10T09:52:29.824 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T09:52:29.835 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T09:52:29.838 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T09:52:29.948 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T09:52:29.959 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T09:52:29.960 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi084.front.sepia.ceph.com,smithi189.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T09:57:07.540 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com')] 2024-09-10T09:57:07.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-10T09:57:07.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:57:07.631 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-10T09:57:07.739 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-10T09:57:07.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-10T09:57:07.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:57:07.812 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-09-10T09:57:07.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-10T09:57:07.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T09:57:07.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:57:07.968 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-10T09:57:08.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T09:57:08.046 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T09:57:08.058 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T09:57:08.058 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T09:57:08.059 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T09:57:08.063 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T09:57:08.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T09:57:08.065 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T09:57:08.065 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T09:57:08.093 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T09:57:08.108 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T09:57:08.115 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T09:57:08.122 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T09:57:08.130 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T09:57:08.132 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2024-09-10T09:57:08.143 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2024-09-10T09:57:08.152 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T09:57:08.155 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: ntpd: command not found 2024-09-10T09:57:08.157 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T09:57:08.166 INFO:teuthology.orchestra.run.smithi189.stdout:506 Cannot talk to daemon 2024-09-10T09:57:08.171 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T09:57:08.181 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T09:57:08.195 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T09:57:08.204 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2024-09-10T09:57:08.228 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2024-09-10T09:57:08.233 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-09-10T09:57:08.237 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T09:57:08.237 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-09-10T09:57:08.237 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:57:08.237 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:57:08.237 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:57:08.237 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:57:08.255 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-10T09:57:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T09:57:08.258 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T09:57:08.258 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-10T09:57:08.258 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:57:08.258 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:57:08.258 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:57:08.258 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:57:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T09:57:08.390 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-09-10T09:57:08.397 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T09:57:08.397 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-09-10T09:57:08.397 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:57:08.397 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:57:08.397 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:57:08.397 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:57:08.398 INFO:teuthology.run_tasks:Running task install... 2024-09-10T09:57:08.406 DEBUG:teuthology.task.install:project ceph 2024-09-10T09:57:08.406 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}} 2024-09-10T09:57:08.407 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T09:57:08.407 INFO:teuthology.task.install:Using flavor: default 2024-09-10T09:57:08.412 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T09:57:08.412 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T09:57:08.413 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T09:57:08.413 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:57:08.415 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T09:57:08.416 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:57:08.416 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T09:57:08.417 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:57:08.558 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T09:57:08.558 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T09:57:08.582 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T09:57:08.582 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T09:57:08.593 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T09:57:08.593 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T09:57:08.673 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T09:57:08.673 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T09:57:08.673 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T09:57:08.694 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T09:57:08.694 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T09:57:08.694 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T09:57:08.704 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T09:57:08.705 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T09:57:08.705 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T09:57:08.720 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T09:57:08.721 DEBUG:teuthology.orchestra.run.smithi189:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T09:57:08.731 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T09:57:08.732 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T09:57:08.733 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T09:57:08.733 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T09:57:08.788 DEBUG:teuthology.orchestra.run.smithi189:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T09:57:08.798 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T09:57:08.831 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T09:57:08.863 DEBUG:teuthology.orchestra.run.smithi189:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T09:57:08.874 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T09:57:08.910 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi189.stdout:check_obsoletes = 1 2024-09-10T09:57:08.930 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum clean all 2024-09-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2024-09-10T09:57:08.939 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2024-09-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2024-09-10T09:57:08.969 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2024-09-10T09:57:09.155 INFO:teuthology.orchestra.run.smithi189.stdout:45 files removed 2024-09-10T09:57:09.171 INFO:teuthology.orchestra.run.smithi084.stdout:45 files removed 2024-09-10T09:57:09.183 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T09:57:09.198 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T09:57:09.252 INFO:teuthology.orchestra.run.smithi050.stdout:45 files removed 2024-09-10T09:57:09.285 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T09:57:09.722 INFO:teuthology.orchestra.run.smithi189.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-10T09:57:09.749 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-10T09:57:09.979 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 295 kB/s | 84 kB 00:00 2024-09-10T09:57:09.998 INFO:teuthology.orchestra.run.smithi189.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-10T09:57:10.033 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi189.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-10T09:57:10.564 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-10T09:57:11.998 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-10T09:57:13.547 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-09-10T09:57:13.934 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.2 MB 00:03 2024-09-10T09:57:13.991 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-10T09:57:15.718 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-10T09:57:16.831 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 20 MB 00:02 2024-09-10T09:57:20.960 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-10T09:57:21.840 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 6.5 MB 00:00 2024-09-10T09:57:22.133 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 1.5 MB/s | 6.5 MB 00:04 2024-09-10T09:57:22.428 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-10T09:57:23.248 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-10T09:57:23.521 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 107 kB/s | 19 kB 00:00 2024-09-10T09:57:23.625 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-10T09:57:24.587 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-10T09:57:24.646 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-10T09:57:28.712 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-10T09:57:30.202 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-10T09:57:31.083 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T09:57:31.084 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T09:57:31.098 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T09:57:31.099 INFO:teuthology.orchestra.run.smithi084.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T09:57:31.100 INFO:teuthology.orchestra.run.smithi084.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T09:57:31.101 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T09:57:31.101 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-10T09:57:31.103 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T09:57:31.106 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T09:57:31.107 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T09:57:31.170 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-10T09:57:31.180 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================== 2024-09-10T09:57:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-10T09:57:31.180 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================== 2024-09-10T09:57:31.180 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-10T09:57:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T09:57:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T09:57:31.180 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T09:57:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T09:57:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T09:57:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T09:57:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T09:57:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T09:57:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T09:57:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T09:57:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T09:57:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T09:57:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T09:57:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T09:57:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T09:57:31.181 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T09:57:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T09:57:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T09:57:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T09:57:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T09:57:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T09:57:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T09:57:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T09:57:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T09:57:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T09:57:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T09:57:31.182 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T09:57:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T09:57:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T09:57:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T09:57:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T09:57:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T09:57:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T09:57:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T09:57:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T09:57:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T09:57:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T09:57:31.183 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-09-10T09:57:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T09:57:31.183 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T09:57:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T09:57:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T09:57:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T09:57:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T09:57:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T09:57:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T09:57:31.184 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-10T09:57:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T09:57:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T09:57:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T09:57:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T09:57:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T09:57:31.184 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T09:57:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T09:57:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T09:57:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T09:57:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T09:57:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T09:57:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T09:57:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T09:57:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T09:57:31.185 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T09:57:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T09:57:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T09:57:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T09:57:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T09:57:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T09:57:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T09:57:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T09:57:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T09:57:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T09:57:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T09:57:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T09:57:31.186 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T09:57:31.187 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T09:57:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T09:57:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T09:57:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T09:57:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T09:57:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T09:57:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T09:57:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T09:57:31.188 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T09:57:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T09:57:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T09:57:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T09:57:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T09:57:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T09:57:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T09:57:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T09:57:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T09:57:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T09:57:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T09:57:31.189 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T09:57:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T09:57:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T09:57:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T09:57:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T09:57:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T09:57:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T09:57:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T09:57:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T09:57:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T09:57:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T09:57:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T09:57:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T09:57:31.190 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T09:57:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T09:57:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T09:57:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T09:57:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T09:57:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T09:57:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T09:57:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T09:57:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T09:57:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T09:57:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T09:57:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T09:57:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T09:57:31.191 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T09:57:31.192 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-10T09:57:31.193 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================== 2024-09-10T09:57:31.194 INFO:teuthology.orchestra.run.smithi084.stdout:Install 148 Packages 2024-09-10T09:57:31.194 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 8 Packages 2024-09-10T09:57:31.194 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:57:31.194 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 226 M 2024-09-10T09:57:31.194 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-10T09:57:31.780 INFO:teuthology.orchestra.run.smithi084.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-10T09:57:31.971 INFO:teuthology.orchestra.run.smithi084.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 4.6 MB/s | 897 kB 00:00 2024-09-10T09:57:32.047 INFO:teuthology.orchestra.run.smithi084.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.9 MB/s | 145 kB 00:00 2024-09-10T09:57:32.130 INFO:teuthology.orchestra.run.smithi084.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-10T09:57:32.264 INFO:teuthology.orchestra.run.smithi084.stdout:(5/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-10T09:57:32.306 INFO:teuthology.orchestra.run.smithi084.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 8.7 MB/s | 1.5 MB 00:00 2024-09-10T09:57:32.490 INFO:teuthology.orchestra.run.smithi189.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T09:57:32.490 INFO:teuthology.orchestra.run.smithi189.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T09:57:32.504 INFO:teuthology.orchestra.run.smithi189.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T09:57:32.505 INFO:teuthology.orchestra.run.smithi189.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T09:57:32.506 INFO:teuthology.orchestra.run.smithi189.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T09:57:32.507 INFO:teuthology.orchestra.run.smithi189.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T09:57:32.509 INFO:teuthology.orchestra.run.smithi189.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T09:57:32.511 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T09:57:32.512 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T09:57:32.577 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-09-10T09:57:32.602 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-10T09:57:32.602 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2024-09-10T09:57:32.602 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-10T09:57:32.602 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2024-09-10T09:57:32.602 INFO:teuthology.orchestra.run.smithi189.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T09:57:32.602 INFO:teuthology.orchestra.run.smithi189.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T09:57:32.602 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T09:57:32.602 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T09:57:32.602 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T09:57:32.603 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T09:57:32.603 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T09:57:32.603 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T09:57:32.603 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T09:57:32.603 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T09:57:32.603 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T09:57:32.603 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T09:57:32.603 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T09:57:32.603 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T09:57:32.603 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T09:57:32.603 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T09:57:32.603 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T09:57:32.603 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T09:57:32.604 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T09:57:32.605 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T09:57:32.605 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T09:57:32.605 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T09:57:32.605 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T09:57:32.605 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrading: 2024-09-10T09:57:32.605 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T09:57:32.605 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T09:57:32.605 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T09:57:32.605 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T09:57:32.605 INFO:teuthology.orchestra.run.smithi189.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T09:57:32.605 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T09:57:32.605 INFO:teuthology.orchestra.run.smithi189.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T09:57:32.605 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout:Installing dependencies: 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T09:57:32.606 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T09:57:32.607 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T09:57:32.608 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T09:57:32.609 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T09:57:32.610 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T09:57:32.611 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T09:57:32.612 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout:Installing weak dependencies: 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout:====================================================================================== 2024-09-10T09:57:32.613 INFO:teuthology.orchestra.run.smithi189.stdout:Install 148 Packages 2024-09-10T09:57:32.614 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrade 8 Packages 2024-09-10T09:57:32.614 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:57:32.614 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 226 M 2024-09-10T09:57:32.614 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-09-10T09:57:32.723 INFO:teuthology.orchestra.run.smithi084.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 10 MB/s | 4.7 MB 00:00 2024-09-10T09:57:32.948 INFO:teuthology.orchestra.run.smithi084.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 16 MB/s | 21 MB 00:01 2024-09-10T09:57:32.998 INFO:teuthology.orchestra.run.smithi084.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 507 kB/s | 25 kB 00:00 2024-09-10T09:57:33.353 INFO:teuthology.orchestra.run.smithi189.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-10T09:57:33.398 INFO:teuthology.orchestra.run.smithi084.stdout:(10/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 15 MB/s | 17 MB 00:01 2024-09-10T09:57:33.515 INFO:teuthology.orchestra.run.smithi084.stdout:(11/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 13 MB/s | 11 MB 00:00 2024-09-10T09:57:33.541 INFO:teuthology.orchestra.run.smithi084.stdout:(12/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 1.6 MB/s | 228 kB 00:00 2024-09-10T09:57:33.553 INFO:teuthology.orchestra.run.smithi189.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 4.4 MB/s | 897 kB 00:00 2024-09-10T09:57:33.591 INFO:teuthology.orchestra.run.smithi084.stdout:(13/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 359 kB/s | 27 kB 00:00 2024-09-10T09:57:33.616 INFO:teuthology.orchestra.run.smithi084.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 421 kB/s | 32 kB 00:00 2024-09-10T09:57:33.637 INFO:teuthology.orchestra.run.smithi189.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.7 MB/s | 145 kB 00:00 2024-09-10T09:57:33.699 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T09:57:33.699 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T09:57:33.712 INFO:teuthology.orchestra.run.smithi050.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T09:57:33.712 INFO:teuthology.orchestra.run.smithi050.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T09:57:33.713 INFO:teuthology.orchestra.run.smithi050.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T09:57:33.715 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T09:57:33.716 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T09:57:33.717 INFO:teuthology.orchestra.run.smithi084.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 1.6 MB/s | 164 kB 00:00 2024-09-10T09:57:33.719 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T09:57:33.720 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T09:57:33.775 INFO:teuthology.orchestra.run.smithi084.stdout:(16/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 4.0 MB/s | 751 kB 00:00 2024-09-10T09:57:33.793 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-09-10T09:57:33.800 INFO:teuthology.orchestra.run.smithi084.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 1.5 MB/s | 127 kB 00:00 2024-09-10T09:57:33.804 INFO:teuthology.orchestra.run.smithi189.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 9.4 MB/s | 5.4 MB 00:00 2024-09-10T09:57:33.812 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================== 2024-09-10T09:57:33.812 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-09-10T09:57:33.812 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================== 2024-09-10T09:57:33.813 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-09-10T09:57:33.813 INFO:teuthology.orchestra.run.smithi050.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T09:57:33.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T09:57:33.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T09:57:33.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T09:57:33.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T09:57:33.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T09:57:33.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T09:57:33.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T09:57:33.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T09:57:33.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T09:57:33.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T09:57:33.813 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T09:57:33.814 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T09:57:33.815 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T09:57:33.816 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T09:57:33.816 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T09:57:33.816 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T09:57:33.816 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T09:57:33.816 INFO:teuthology.orchestra.run.smithi050.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T09:57:33.816 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T09:57:33.816 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-09-10T09:57:33.816 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T09:57:33.816 INFO:teuthology.orchestra.run.smithi050.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T09:57:33.816 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T09:57:33.816 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T09:57:33.816 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T09:57:33.816 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T09:57:33.817 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T09:57:33.817 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T09:57:33.817 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T09:57:33.817 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T09:57:33.817 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T09:57:33.817 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T09:57:33.817 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T09:57:33.817 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T09:57:33.817 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T09:57:33.817 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T09:57:33.818 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T09:57:33.819 INFO:teuthology.orchestra.run.smithi050.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T09:57:33.819 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T09:57:33.819 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T09:57:33.819 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T09:57:33.819 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T09:57:33.819 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T09:57:33.819 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T09:57:33.819 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T09:57:33.819 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T09:57:33.819 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T09:57:33.819 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T09:57:33.819 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T09:57:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T09:57:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T09:57:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T09:57:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T09:57:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T09:57:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T09:57:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T09:57:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T09:57:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T09:57:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T09:57:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T09:57:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T09:57:33.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T09:57:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T09:57:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T09:57:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T09:57:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T09:57:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T09:57:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T09:57:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T09:57:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T09:57:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T09:57:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T09:57:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T09:57:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T09:57:33.821 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T09:57:33.822 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T09:57:33.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T09:57:33.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T09:57:33.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T09:57:33.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T09:57:33.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T09:57:33.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T09:57:33.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T09:57:33.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T09:57:33.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T09:57:33.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T09:57:33.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T09:57:33.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T09:57:33.823 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T09:57:33.824 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T09:57:33.825 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2024-09-10T09:57:33.825 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T09:57:33.825 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:57:33.825 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-09-10T09:57:33.825 INFO:teuthology.orchestra.run.smithi050.stdout:====================================================================================== 2024-09-10T09:57:33.825 INFO:teuthology.orchestra.run.smithi050.stdout:Install 148 Packages 2024-09-10T09:57:33.825 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 8 Packages 2024-09-10T09:57:33.825 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:57:33.826 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 226 M 2024-09-10T09:57:33.826 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-09-10T09:57:33.867 INFO:teuthology.orchestra.run.smithi084.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 5.4 MB/s | 506 kB 00:00 2024-09-10T09:57:33.976 INFO:teuthology.orchestra.run.smithi084.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 417 kB/s | 45 kB 00:00 2024-09-10T09:57:34.054 INFO:teuthology.orchestra.run.smithi189.stdout:(5/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 5.7 MB/s | 2.4 MB 00:00 2024-09-10T09:57:34.068 INFO:teuthology.orchestra.run.smithi084.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 1.4 MB/s | 136 kB 00:00 2024-09-10T09:57:34.243 INFO:teuthology.orchestra.run.smithi084.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 923 kB/s | 161 kB 00:00 2024-09-10T09:57:34.360 INFO:teuthology.orchestra.run.smithi084.stdout:(22/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 9.6 MB/s | 5.3 MB 00:00 2024-09-10T09:57:34.394 INFO:teuthology.orchestra.run.smithi084.stdout:(23/156): python3-rados-19.1.1-305.g1cf819b7.el 2.1 MB/s | 320 kB 00:00 2024-09-10T09:57:34.446 INFO:teuthology.orchestra.run.smithi189.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 2.4 MB/s | 1.5 MB 00:00 2024-09-10T09:57:34.452 INFO:teuthology.orchestra.run.smithi084.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 3.2 MB/s | 301 kB 00:00 2024-09-10T09:57:34.478 INFO:teuthology.orchestra.run.smithi084.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.2 MB/s | 99 kB 00:00 2024-09-10T09:57:34.536 INFO:teuthology.orchestra.run.smithi084.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-10T09:57:34.547 INFO:teuthology.orchestra.run.smithi189.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 9.6 MB/s | 4.7 MB 00:00 2024-09-10T09:57:34.603 INFO:teuthology.orchestra.run.smithi084.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 2.5 MB/s | 170 kB 00:00 2024-09-10T09:57:34.670 INFO:teuthology.orchestra.run.smithi084.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 477 kB/s | 32 kB 00:00 2024-09-10T09:57:34.739 INFO:teuthology.orchestra.run.smithi189.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 14 MB/s | 21 MB 00:01 2024-09-10T09:57:34.745 INFO:teuthology.orchestra.run.smithi084.stdout:(29/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-10T09:57:34.771 INFO:teuthology.orchestra.run.smithi084.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 1.4 MB/s | 146 kB 00:00 2024-09-10T09:57:34.797 INFO:teuthology.orchestra.run.smithi189.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 434 kB/s | 25 kB 00:00 2024-09-10T09:57:35.178 INFO:teuthology.orchestra.run.smithi050.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 20 kB/s | 6.5 kB 00:00 2024-09-10T09:57:35.204 INFO:teuthology.orchestra.run.smithi084.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 7.8 MB/s | 3.6 MB 00:00 2024-09-10T09:57:35.304 INFO:teuthology.orchestra.run.smithi084.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 2.4 MB/s | 249 kB 00:00 2024-09-10T09:57:35.405 INFO:teuthology.orchestra.run.smithi084.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 493 kB/s | 49 kB 00:00 2024-09-10T09:57:35.463 INFO:teuthology.orchestra.run.smithi084.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 282 kB/s | 16 kB 00:00 2024-09-10T09:57:35.464 INFO:teuthology.orchestra.run.smithi189.stdout:(10/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 12 MB/s | 11 MB 00:00 2024-09-10T09:57:35.547 INFO:teuthology.orchestra.run.smithi084.stdout:(35/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 3.4 MB/s | 285 kB 00:00 2024-09-10T09:57:35.555 INFO:teuthology.orchestra.run.smithi189.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 2.4 MB/s | 228 kB 00:00 2024-09-10T09:57:35.623 INFO:teuthology.orchestra.run.smithi189.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 405 kB/s | 27 kB 00:00 2024-09-10T09:57:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 8.6 MB/s | 7.4 MB 00:00 2024-09-10T09:57:35.673 INFO:teuthology.orchestra.run.smithi189.stdout:(13/156): libcephfs-devel-19.1.1-305.g1cf819b7. 637 kB/s | 32 kB 00:00 2024-09-10T09:57:35.698 INFO:teuthology.orchestra.run.smithi084.stdout:(37/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 5.0 MB/s | 766 kB 00:00 2024-09-10T09:57:35.720 INFO:teuthology.orchestra.run.smithi050.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 1.6 MB/s | 897 kB 00:00 2024-09-10T09:57:35.723 INFO:teuthology.orchestra.run.smithi084.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 198 kB/s | 18 kB 00:00 2024-09-10T09:57:35.748 INFO:teuthology.orchestra.run.smithi189.stdout:(14/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-10T09:57:35.787 INFO:teuthology.orchestra.run.smithi050.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 2.1 MB/s | 145 kB 00:00 2024-09-10T09:57:35.807 INFO:teuthology.orchestra.run.smithi189.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 2.7 MB/s | 164 kB 00:00 2024-09-10T09:57:35.865 INFO:teuthology.orchestra.run.smithi189.stdout:(16/156): librados-devel-19.1.1-305.g1cf819b7.e 2.1 MB/s | 127 kB 00:00 2024-09-10T09:57:35.933 INFO:teuthology.orchestra.run.smithi189.stdout:(17/156): libradosstriper1-19.1.1-305.g1cf819b7 7.4 MB/s | 506 kB 00:00 2024-09-10T09:57:36.148 INFO:teuthology.orchestra.run.smithi084.stdout:(39/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 15 MB/s | 49 MB 00:03 2024-09-10T09:57:36.290 INFO:teuthology.orchestra.run.smithi084.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 135 kB/s | 80 kB 00:00 2024-09-10T09:57:36.308 INFO:teuthology.orchestra.run.smithi189.stdout:(18/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-10T09:57:36.349 INFO:teuthology.orchestra.run.smithi084.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 958 kB/s | 191 kB 00:00 2024-09-10T09:57:36.349 INFO:teuthology.orchestra.run.smithi189.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 1.1 MB/s | 45 kB 00:00 2024-09-10T09:57:36.354 INFO:teuthology.orchestra.run.smithi050.stdout:(4/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 4.2 MB/s | 2.4 MB 00:00 2024-09-10T09:57:36.391 INFO:teuthology.orchestra.run.smithi084.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-10T09:57:36.408 INFO:teuthology.orchestra.run.smithi189.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.3 MB/s | 136 kB 00:00 2024-09-10T09:57:36.416 INFO:teuthology.orchestra.run.smithi084.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-10T09:57:36.450 INFO:teuthology.orchestra.run.smithi084.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T09:57:36.467 INFO:teuthology.orchestra.run.smithi189.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 2.7 MB/s | 161 kB 00:00 2024-09-10T09:57:36.482 INFO:teuthology.orchestra.run.smithi084.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-10T09:57:36.504 INFO:teuthology.orchestra.run.smithi050.stdout:(5/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 3.3 MB/s | 5.4 MB 00:01 2024-09-10T09:57:36.507 INFO:teuthology.orchestra.run.smithi084.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-10T09:57:36.525 INFO:teuthology.orchestra.run.smithi189.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 5.4 MB/s | 320 kB 00:00 2024-09-10T09:57:36.558 INFO:teuthology.orchestra.run.smithi084.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-09-10T09:57:36.583 INFO:teuthology.orchestra.run.smithi084.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-09-10T09:57:36.592 INFO:teuthology.orchestra.run.smithi189.stdout:(23/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 4.4 MB/s | 301 kB 00:00 2024-09-10T09:57:36.654 INFO:teuthology.orchestra.run.smithi050.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 5.1 MB/s | 1.5 MB 00:00 2024-09-10T09:57:36.659 INFO:teuthology.orchestra.run.smithi189.stdout:(24/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.5 MB/s | 99 kB 00:00 2024-09-10T09:57:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 917 kB/s | 107 kB 00:00 2024-09-10T09:57:36.726 INFO:teuthology.orchestra.run.smithi189.stdout:(25/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-10T09:57:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-10T09:57:36.768 INFO:teuthology.orchestra.run.smithi084.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-10T09:57:36.809 INFO:teuthology.orchestra.run.smithi084.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 786 kB/s | 33 kB 00:00 2024-09-10T09:57:36.843 INFO:teuthology.orchestra.run.smithi084.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-10T09:57:36.868 INFO:teuthology.orchestra.run.smithi084.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-10T09:57:36.893 INFO:teuthology.orchestra.run.smithi084.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-10T09:57:36.919 INFO:teuthology.orchestra.run.smithi084.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T09:57:36.961 INFO:teuthology.orchestra.run.smithi084.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-10T09:57:36.986 INFO:teuthology.orchestra.run.smithi084.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-10T09:57:37.002 INFO:teuthology.orchestra.run.smithi189.stdout:(26/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-10T09:57:37.088 INFO:teuthology.orchestra.run.smithi050.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 8.1 MB/s | 4.7 MB 00:00 2024-09-10T09:57:37.093 INFO:teuthology.orchestra.run.smithi189.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 1.8 MB/s | 170 kB 00:00 2024-09-10T09:57:37.153 INFO:teuthology.orchestra.run.smithi084.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-10T09:57:37.160 INFO:teuthology.orchestra.run.smithi189.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 477 kB/s | 32 kB 00:00 2024-09-10T09:57:37.186 INFO:teuthology.orchestra.run.smithi084.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-10T09:57:37.212 INFO:teuthology.orchestra.run.smithi084.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-10T09:57:37.237 INFO:teuthology.orchestra.run.smithi084.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-10T09:57:37.244 INFO:teuthology.orchestra.run.smithi189.stdout:(29/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 1.7 MB/s | 146 kB 00:00 2024-09-10T09:57:37.304 INFO:teuthology.orchestra.run.smithi084.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.0 MB/s | 3.0 MB 00:00 2024-09-10T09:57:37.338 INFO:teuthology.orchestra.run.smithi084.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-10T09:57:37.363 INFO:teuthology.orchestra.run.smithi084.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-10T09:57:37.388 INFO:teuthology.orchestra.run.smithi084.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-10T09:57:37.705 INFO:teuthology.orchestra.run.smithi084.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-09-10T09:57:37.863 INFO:teuthology.orchestra.run.smithi050.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 7.0 MB/s | 21 MB 00:03 2024-09-10T09:57:37.872 INFO:teuthology.orchestra.run.smithi084.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2024-09-10T09:57:37.905 INFO:teuthology.orchestra.run.smithi050.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 607 kB/s | 25 kB 00:00 2024-09-10T09:57:37.911 INFO:teuthology.orchestra.run.smithi189.stdout:(30/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 16 MB/s | 49 MB 00:03 2024-09-10T09:57:37.914 INFO:teuthology.orchestra.run.smithi084.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 3.2 MB/s | 137 kB 00:00 2024-09-10T09:57:37.969 INFO:teuthology.orchestra.run.smithi189.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 4.9 MB/s | 3.6 MB 00:00 2024-09-10T09:57:38.028 INFO:teuthology.orchestra.run.smithi189.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 4.2 MB/s | 249 kB 00:00 2024-09-10T09:57:38.039 INFO:teuthology.orchestra.run.smithi084.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 2.7 MB/s | 910 kB 00:00 2024-09-10T09:57:38.055 INFO:teuthology.orchestra.run.smithi050.stdout:(10/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 11 MB/s | 11 MB 00:00 2024-09-10T09:57:38.087 INFO:teuthology.orchestra.run.smithi189.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 848 kB/s | 49 kB 00:00 2024-09-10T09:57:38.145 INFO:teuthology.orchestra.run.smithi189.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 283 kB/s | 16 kB 00:00 2024-09-10T09:57:38.212 INFO:teuthology.orchestra.run.smithi189.stdout:(35/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 4.2 MB/s | 285 kB 00:00 2024-09-10T09:57:38.247 INFO:teuthology.orchestra.run.smithi050.stdout:(11/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 17 MB 00:01 2024-09-10T09:57:38.273 INFO:teuthology.orchestra.run.smithi050.stdout:(12/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 1.0 MB/s | 228 kB 00:00 2024-09-10T09:57:38.298 INFO:teuthology.orchestra.run.smithi050.stdout:(13/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 542 kB/s | 27 kB 00:00 2024-09-10T09:57:38.323 INFO:teuthology.orchestra.run.smithi050.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 633 kB/s | 32 kB 00:00 2024-09-10T09:57:38.340 INFO:teuthology.orchestra.run.smithi084.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-09-10T09:57:38.346 INFO:teuthology.orchestra.run.smithi189.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 17 MB/s | 7.4 MB 00:00 2024-09-10T09:57:38.388 INFO:teuthology.orchestra.run.smithi189.stdout:(37/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 4.3 MB/s | 766 kB 00:00 2024-09-10T09:57:38.398 INFO:teuthology.orchestra.run.smithi084.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T09:57:38.398 INFO:teuthology.orchestra.run.smithi050.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 2.1 MB/s | 164 kB 00:00 2024-09-10T09:57:38.422 INFO:teuthology.orchestra.run.smithi189.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 244 kB/s | 18 kB 00:00 2024-09-10T09:57:38.423 INFO:teuthology.orchestra.run.smithi050.stdout:(16/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 5.8 MB/s | 751 kB 00:00 2024-09-10T09:57:38.449 INFO:teuthology.orchestra.run.smithi050.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 2.5 MB/s | 127 kB 00:00 2024-09-10T09:57:38.491 INFO:teuthology.orchestra.run.smithi050.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 7.4 MB/s | 506 kB 00:00 2024-09-10T09:57:38.541 INFO:teuthology.orchestra.run.smithi050.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 904 kB/s | 45 kB 00:00 2024-09-10T09:57:38.573 INFO:teuthology.orchestra.run.smithi084.stdout:(73/156): postgresql-server-13.16-1.el9.x86_64. 8.8 MB/s | 5.8 MB 00:00 2024-09-10T09:57:38.589 INFO:teuthology.orchestra.run.smithi189.stdout:(39/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 4.1 MB/s | 17 MB 00:04 2024-09-10T09:57:38.608 INFO:teuthology.orchestra.run.smithi050.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.0 MB/s | 136 kB 00:00 2024-09-10T09:57:38.615 INFO:teuthology.orchestra.run.smithi084.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-10T09:57:38.657 INFO:teuthology.orchestra.run.smithi084.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 5.7 MB/s | 245 kB 00:00 2024-09-10T09:57:38.672 INFO:teuthology.orchestra.run.smithi189.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 281 kB/s | 80 kB 00:00 2024-09-10T09:57:38.684 INFO:teuthology.orchestra.run.smithi050.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 2.1 MB/s | 161 kB 00:00 2024-09-10T09:57:38.708 INFO:teuthology.orchestra.run.smithi189.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-10T09:57:38.724 INFO:teuthology.orchestra.run.smithi084.stdout:(76/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.6 MB/s | 4.9 MB 00:01 2024-09-10T09:57:38.748 INFO:teuthology.orchestra.run.smithi189.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-10T09:57:38.750 INFO:teuthology.orchestra.run.smithi084.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-10T09:57:38.775 INFO:teuthology.orchestra.run.smithi084.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 508 kB/s | 26 kB 00:00 2024-09-10T09:57:38.776 INFO:teuthology.orchestra.run.smithi050.stdout:(22/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-10T09:57:38.781 INFO:teuthology.orchestra.run.smithi189.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 801 kB 00:00 2024-09-10T09:57:38.800 INFO:teuthology.orchestra.run.smithi084.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-10T09:57:38.801 INFO:teuthology.orchestra.run.smithi050.stdout:(23/156): python3-rados-19.1.1-305.g1cf819b7.el 2.7 MB/s | 320 kB 00:00 2024-09-10T09:57:38.807 INFO:teuthology.orchestra.run.smithi189.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T09:57:38.826 INFO:teuthology.orchestra.run.smithi050.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 5.9 MB/s | 301 kB 00:00 2024-09-10T09:57:38.832 INFO:teuthology.orchestra.run.smithi189.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-10T09:57:38.842 INFO:teuthology.orchestra.run.smithi084.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 837 kB/s | 35 kB 00:00 2024-09-10T09:57:38.851 INFO:teuthology.orchestra.run.smithi050.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.9 MB/s | 99 kB 00:00 2024-09-10T09:57:38.857 INFO:teuthology.orchestra.run.smithi189.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-10T09:57:38.867 INFO:teuthology.orchestra.run.smithi084.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-10T09:57:38.877 INFO:teuthology.orchestra.run.smithi050.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-10T09:57:38.899 INFO:teuthology.orchestra.run.smithi189.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-10T09:57:38.927 INFO:teuthology.orchestra.run.smithi050.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-10T09:57:38.959 INFO:teuthology.orchestra.run.smithi084.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-10T09:57:38.966 INFO:teuthology.orchestra.run.smithi189.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 4.7 MB/s | 1.2 MB 00:00 2024-09-10T09:57:39.002 INFO:teuthology.orchestra.run.smithi050.stdout:(28/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 21 MB/s | 3.1 MB 00:00 2024-09-10T09:57:39.028 INFO:teuthology.orchestra.run.smithi050.stdout:(29/156): ceph-grafana-dashboards-19.1.1-305.g1 318 kB/s | 32 kB 00:00 2024-09-10T09:57:39.051 INFO:teuthology.orchestra.run.smithi084.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-10T09:57:39.061 INFO:teuthology.orchestra.run.smithi050.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.5 MB/s | 146 kB 00:00 2024-09-10T09:57:39.066 INFO:teuthology.orchestra.run.smithi189.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-10T09:57:39.092 INFO:teuthology.orchestra.run.smithi189.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 854 kB/s | 107 kB 00:00 2024-09-10T09:57:39.109 INFO:teuthology.orchestra.run.smithi189.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 518 kB/s | 22 kB 00:00 2024-09-10T09:57:39.110 INFO:teuthology.orchestra.run.smithi084.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-10T09:57:39.142 INFO:teuthology.orchestra.run.smithi189.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-10T09:57:39.152 INFO:teuthology.orchestra.run.smithi084.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-10T09:57:39.159 INFO:teuthology.orchestra.run.smithi189.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-10T09:57:39.184 INFO:teuthology.orchestra.run.smithi189.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-10T09:57:39.210 INFO:teuthology.orchestra.run.smithi189.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-10T09:57:39.235 INFO:teuthology.orchestra.run.smithi189.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T09:57:39.260 INFO:teuthology.orchestra.run.smithi084.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-09-10T09:57:39.269 INFO:teuthology.orchestra.run.smithi189.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-10T09:57:39.294 INFO:teuthology.orchestra.run.smithi189.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-09-10T09:57:39.312 INFO:teuthology.orchestra.run.smithi050.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 13 MB/s | 3.6 MB 00:00 2024-09-10T09:57:39.319 INFO:teuthology.orchestra.run.smithi084.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-10T09:57:39.336 INFO:teuthology.orchestra.run.smithi189.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-10T09:57:39.361 INFO:teuthology.orchestra.run.smithi084.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 6.6 MB/s | 279 kB 00:00 2024-09-10T09:57:39.394 INFO:teuthology.orchestra.run.smithi189.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-10T09:57:39.395 INFO:teuthology.orchestra.run.smithi050.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 2.9 MB/s | 249 kB 00:00 2024-09-10T09:57:39.420 INFO:teuthology.orchestra.run.smithi189.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-10T09:57:39.428 INFO:teuthology.orchestra.run.smithi084.stdout:(89/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.7 MB/s | 5.1 MB 00:00 2024-09-10T09:57:39.453 INFO:teuthology.orchestra.run.smithi189.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-09-10T09:57:39.453 INFO:teuthology.orchestra.run.smithi084.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-09-10T09:57:39.479 INFO:teuthology.orchestra.run.smithi084.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T09:57:39.479 INFO:teuthology.orchestra.run.smithi189.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-10T09:57:39.504 INFO:teuthology.orchestra.run.smithi189.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-10T09:57:39.504 INFO:teuthology.orchestra.run.smithi050.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 17 MB/s | 7.4 MB 00:00 2024-09-10T09:57:39.521 INFO:teuthology.orchestra.run.smithi084.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 999 kB/s | 42 kB 00:00 2024-09-10T09:57:39.529 INFO:teuthology.orchestra.run.smithi189.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 763 kB/s | 38 kB 00:00 2024-09-10T09:57:39.529 INFO:teuthology.orchestra.run.smithi050.stdout:(34/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 370 kB/s | 49 kB 00:00 2024-09-10T09:57:39.555 INFO:teuthology.orchestra.run.smithi050.stdout:(35/156): ceph-prometheus-alerts-19.1.1-305.g1c 329 kB/s | 16 kB 00:00 2024-09-10T09:57:39.555 INFO:teuthology.orchestra.run.smithi189.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-10T09:57:39.562 INFO:teuthology.orchestra.run.smithi084.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-10T09:57:39.580 INFO:teuthology.orchestra.run.smithi050.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 5.6 MB/s | 285 kB 00:00 2024-09-10T09:57:39.613 INFO:teuthology.orchestra.run.smithi084.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T09:57:39.613 INFO:teuthology.orchestra.run.smithi050.stdout:(37/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 13 MB/s | 766 kB 00:00 2024-09-10T09:57:39.630 INFO:teuthology.orchestra.run.smithi050.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 362 kB/s | 18 kB 00:00 2024-09-10T09:57:39.646 INFO:teuthology.orchestra.run.smithi189.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-10T09:57:39.655 INFO:teuthology.orchestra.run.smithi084.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 861 kB/s | 36 kB 00:00 2024-09-10T09:57:39.688 INFO:teuthology.orchestra.run.smithi189.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-10T09:57:39.731 INFO:teuthology.orchestra.run.smithi189.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-10T09:57:39.789 INFO:teuthology.orchestra.run.smithi189.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-10T09:57:39.814 INFO:teuthology.orchestra.run.smithi189.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-10T09:57:39.822 INFO:teuthology.orchestra.run.smithi084.stdout:(96/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-09-10T09:57:39.847 INFO:teuthology.orchestra.run.smithi084.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 247 kB/s | 47 kB 00:00 2024-09-10T09:57:39.856 INFO:teuthology.orchestra.run.smithi189.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-10T09:57:39.872 INFO:teuthology.orchestra.run.smithi084.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-10T09:57:39.881 INFO:teuthology.orchestra.run.smithi189.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-10T09:57:39.897 INFO:teuthology.orchestra.run.smithi084.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T09:57:39.923 INFO:teuthology.orchestra.run.smithi084.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T09:57:39.923 INFO:teuthology.orchestra.run.smithi189.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-10T09:57:39.948 INFO:teuthology.orchestra.run.smithi084.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T09:57:39.973 INFO:teuthology.orchestra.run.smithi084.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 889 kB/s | 45 kB 00:00 2024-09-10T09:57:39.999 INFO:teuthology.orchestra.run.smithi189.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-10T09:57:40.024 INFO:teuthology.orchestra.run.smithi189.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-10T09:57:40.049 INFO:teuthology.orchestra.run.smithi084.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-10T09:57:40.066 INFO:teuthology.orchestra.run.smithi189.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-10T09:57:40.091 INFO:teuthology.orchestra.run.smithi189.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-09-10T09:57:40.107 INFO:teuthology.orchestra.run.smithi084.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T09:57:40.116 INFO:teuthology.orchestra.run.smithi189.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-10T09:57:40.141 INFO:teuthology.orchestra.run.smithi084.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T09:57:40.141 INFO:teuthology.orchestra.run.smithi189.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-10T09:57:40.159 INFO:teuthology.orchestra.run.smithi189.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 829 kB/s | 35 kB 00:00 2024-09-10T09:57:40.183 INFO:teuthology.orchestra.run.smithi084.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 465 kB/s | 19 kB 00:00 2024-09-10T09:57:40.217 INFO:teuthology.orchestra.run.smithi084.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-09-10T09:57:40.242 INFO:teuthology.orchestra.run.smithi189.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-10T09:57:40.256 INFO:teuthology.orchestra.run.smithi050.stdout:(39/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 21 MB/s | 49 MB 00:02 2024-09-10T09:57:40.267 INFO:teuthology.orchestra.run.smithi084.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 521 kB/s | 26 kB 00:00 2024-09-10T09:57:40.267 INFO:teuthology.orchestra.run.smithi189.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-10T09:57:40.281 INFO:teuthology.orchestra.run.smithi050.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 120 kB/s | 80 kB 00:00 2024-09-10T09:57:40.292 INFO:teuthology.orchestra.run.smithi084.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T09:57:40.301 INFO:teuthology.orchestra.run.smithi189.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.8 MB/s | 222 kB 00:00 2024-09-10T09:57:40.317 INFO:teuthology.orchestra.run.smithi084.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T09:57:40.326 INFO:teuthology.orchestra.run.smithi189.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-10T09:57:40.351 INFO:teuthology.orchestra.run.smithi189.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-09-10T09:57:40.359 INFO:teuthology.orchestra.run.smithi084.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-10T09:57:40.385 INFO:teuthology.orchestra.run.smithi189.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-10T09:57:40.410 INFO:teuthology.orchestra.run.smithi189.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-10T09:57:40.435 INFO:teuthology.orchestra.run.smithi189.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-10T09:57:40.451 INFO:teuthology.orchestra.run.smithi084.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-10T09:57:40.452 INFO:teuthology.orchestra.run.smithi189.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-10T09:57:40.469 INFO:teuthology.orchestra.run.smithi189.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-10T09:57:40.485 INFO:teuthology.orchestra.run.smithi084.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-10T09:57:40.502 INFO:teuthology.orchestra.run.smithi189.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-10T09:57:40.510 INFO:teuthology.orchestra.run.smithi084.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T09:57:40.544 INFO:teuthology.orchestra.run.smithi084.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-10T09:57:40.569 INFO:teuthology.orchestra.run.smithi084.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-09-10T09:57:40.570 INFO:teuthology.orchestra.run.smithi189.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-10T09:57:40.586 INFO:teuthology.orchestra.run.smithi189.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 529 kB/s | 44 kB 00:00 2024-09-10T09:57:40.595 INFO:teuthology.orchestra.run.smithi084.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-10T09:57:40.620 INFO:teuthology.orchestra.run.smithi084.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T09:57:40.620 INFO:teuthology.orchestra.run.smithi189.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T09:57:40.637 INFO:teuthology.orchestra.run.smithi189.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-10T09:57:40.645 INFO:teuthology.orchestra.run.smithi084.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-10T09:57:40.654 INFO:teuthology.orchestra.run.smithi189.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-10T09:57:40.670 INFO:teuthology.orchestra.run.smithi084.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-10T09:57:40.687 INFO:teuthology.orchestra.run.smithi189.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-10T09:57:40.696 INFO:teuthology.orchestra.run.smithi084.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T09:57:40.706 INFO:teuthology.orchestra.run.smithi050.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 596 kB/s | 253 kB 00:00 2024-09-10T09:57:40.713 INFO:teuthology.orchestra.run.smithi189.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-09-10T09:57:40.721 INFO:teuthology.orchestra.run.smithi084.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-10T09:57:40.738 INFO:teuthology.orchestra.run.smithi189.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T09:57:40.746 INFO:teuthology.orchestra.run.smithi084.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-10T09:57:40.763 INFO:teuthology.orchestra.run.smithi189.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T09:57:40.771 INFO:teuthology.orchestra.run.smithi084.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-10T09:57:40.788 INFO:teuthology.orchestra.run.smithi189.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-09-10T09:57:40.797 INFO:teuthology.orchestra.run.smithi084.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-10T09:57:40.814 INFO:teuthology.orchestra.run.smithi189.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 442 kB/s | 22 kB 00:00 2024-09-10T09:57:40.822 INFO:teuthology.orchestra.run.smithi084.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-10T09:57:40.840 INFO:teuthology.orchestra.run.smithi050.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 328 kB/s | 191 kB 00:00 2024-09-10T09:57:40.847 INFO:teuthology.orchestra.run.smithi084.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 793 kB/s | 20 kB 00:00 2024-09-10T09:57:40.856 INFO:teuthology.orchestra.run.smithi189.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 13 MB/s | 863 kB 00:00 2024-09-10T09:57:40.865 INFO:teuthology.orchestra.run.smithi050.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 649 kB/s | 801 kB 00:01 2024-09-10T09:57:40.897 INFO:teuthology.orchestra.run.smithi084.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-10T09:57:40.898 INFO:teuthology.orchestra.run.smithi189.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-10T09:57:40.923 INFO:teuthology.orchestra.run.smithi084.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T09:57:40.949 INFO:teuthology.orchestra.run.smithi050.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 982 kB/s | 106 kB 00:00 2024-09-10T09:57:40.974 INFO:teuthology.orchestra.run.smithi050.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-10T09:57:40.998 INFO:teuthology.orchestra.run.smithi189.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 198 kB/s | 19 kB 00:00 2024-09-10T09:57:41.007 INFO:teuthology.orchestra.run.smithi084.stdout:(130/156): python3-babel-2.9.1-2.el9.noarch.rpm 2.3 MB/s | 6.0 MB 00:02 2024-09-10T09:57:41.032 INFO:teuthology.orchestra.run.smithi189.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.7 MB/s | 309 kB 00:00 2024-09-10T09:57:41.040 INFO:teuthology.orchestra.run.smithi084.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 674 kB/s | 79 kB 00:00 2024-09-10T09:57:41.057 INFO:teuthology.orchestra.run.smithi189.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T09:57:41.058 INFO:teuthology.orchestra.run.smithi050.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-10T09:57:41.082 INFO:teuthology.orchestra.run.smithi084.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 4.4 MB/s | 1.0 MB 00:00 2024-09-10T09:57:41.083 INFO:teuthology.orchestra.run.smithi189.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T09:57:41.083 INFO:teuthology.orchestra.run.smithi050.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-10T09:57:41.108 INFO:teuthology.orchestra.run.smithi189.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-10T09:57:41.116 INFO:teuthology.orchestra.run.smithi084.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-09-10T09:57:41.133 INFO:teuthology.orchestra.run.smithi084.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 342 kB/s | 16 kB 00:00 2024-09-10T09:57:41.133 INFO:teuthology.orchestra.run.smithi189.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-10T09:57:41.150 INFO:teuthology.orchestra.run.smithi050.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.8 MB/s | 1.2 MB 00:00 2024-09-10T09:57:41.158 INFO:teuthology.orchestra.run.smithi084.stdout:(135/156): python3-natsort-7.1.1-5.el9.noarch.r 382 kB/s | 58 kB 00:00 2024-09-10T09:57:41.175 INFO:teuthology.orchestra.run.smithi084.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 674 kB/s | 28 kB 00:00 2024-09-10T09:57:41.191 INFO:teuthology.orchestra.run.smithi189.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-10T09:57:41.200 INFO:teuthology.orchestra.run.smithi084.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-10T09:57:41.225 INFO:teuthology.orchestra.run.smithi084.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-09-10T09:57:41.233 INFO:teuthology.orchestra.run.smithi189.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-10T09:57:41.242 INFO:teuthology.orchestra.run.smithi050.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-10T09:57:41.251 INFO:teuthology.orchestra.run.smithi084.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-10T09:57:41.259 INFO:teuthology.orchestra.run.smithi189.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T09:57:41.267 INFO:teuthology.orchestra.run.smithi050.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 917 kB/s | 107 kB 00:00 2024-09-10T09:57:41.276 INFO:teuthology.orchestra.run.smithi084.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-10T09:57:41.284 INFO:teuthology.orchestra.run.smithi189.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T09:57:41.293 INFO:teuthology.orchestra.run.smithi050.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-10T09:57:41.301 INFO:teuthology.orchestra.run.smithi084.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T09:57:41.309 INFO:teuthology.orchestra.run.smithi189.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-10T09:57:41.326 INFO:teuthology.orchestra.run.smithi050.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-10T09:57:41.327 INFO:teuthology.orchestra.run.smithi084.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-10T09:57:41.351 INFO:teuthology.orchestra.run.smithi050.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 563 kB/s | 33 kB 00:00 2024-09-10T09:57:41.352 INFO:teuthology.orchestra.run.smithi084.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T09:57:41.377 INFO:teuthology.orchestra.run.smithi050.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-10T09:57:41.377 INFO:teuthology.orchestra.run.smithi084.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T09:57:41.402 INFO:teuthology.orchestra.run.smithi050.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-10T09:57:41.403 INFO:teuthology.orchestra.run.smithi084.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-10T09:57:41.427 INFO:teuthology.orchestra.run.smithi050.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T09:57:41.436 INFO:teuthology.orchestra.run.smithi084.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-10T09:57:41.453 INFO:teuthology.orchestra.run.smithi050.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-10T09:57:41.460 INFO:teuthology.orchestra.run.smithi189.stdout:(117/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-09-10T09:57:41.461 INFO:teuthology.orchestra.run.smithi084.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-10T09:57:41.478 INFO:teuthology.orchestra.run.smithi050.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-09-10T09:57:41.493 INFO:teuthology.orchestra.run.smithi189.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 936 kB/s | 172 kB 00:00 2024-09-10T09:57:41.503 INFO:teuthology.orchestra.run.smithi084.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T09:57:41.520 INFO:teuthology.orchestra.run.smithi050.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-10T09:57:41.569 INFO:teuthology.orchestra.run.smithi189.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 4.4 MB 00:00 2024-09-10T09:57:41.571 INFO:teuthology.orchestra.run.smithi050.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.1 MB/s | 581 kB 00:00 2024-09-10T09:57:41.602 INFO:teuthology.orchestra.run.smithi189.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.8 MB/s | 303 kB 00:00 2024-09-10T09:57:41.612 INFO:teuthology.orchestra.run.smithi050.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 266 kB/s | 24 kB 00:00 2024-09-10T09:57:41.627 INFO:teuthology.orchestra.run.smithi189.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T09:57:41.637 INFO:teuthology.orchestra.run.smithi050.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 719 kB/s | 47 kB 00:00 2024-09-10T09:57:41.652 INFO:teuthology.orchestra.run.smithi189.stdout:(122/156): python3-cherrypy-18.6.1-2.el9.noarch 1.8 MB/s | 358 kB 00:00 2024-09-10T09:57:41.663 INFO:teuthology.orchestra.run.smithi050.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-10T09:57:41.678 INFO:teuthology.orchestra.run.smithi189.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-10T09:57:41.687 INFO:teuthology.orchestra.run.smithi084.stdout:(149/156): librados2-19.1.1-305.g1cf819b7.el9.x 14 MB/s | 3.4 MB 00:00 2024-09-10T09:57:41.688 INFO:teuthology.orchestra.run.smithi050.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-10T09:57:41.703 INFO:teuthology.orchestra.run.smithi189.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-10T09:57:41.713 INFO:teuthology.orchestra.run.smithi050.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 772 kB/s | 38 kB 00:00 2024-09-10T09:57:41.728 INFO:teuthology.orchestra.run.smithi189.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-10T09:57:41.754 INFO:teuthology.orchestra.run.smithi189.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-10T09:57:41.772 INFO:teuthology.orchestra.run.smithi050.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.7 MB/s | 3.0 MB 00:00 2024-09-10T09:57:41.779 INFO:teuthology.orchestra.run.smithi189.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-10T09:57:41.804 INFO:teuthology.orchestra.run.smithi189.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-10T09:57:41.820 INFO:teuthology.orchestra.run.smithi084.stdout:(150/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 8.8 MB/s | 3.2 MB 00:00 2024-09-10T09:57:41.829 INFO:teuthology.orchestra.run.smithi189.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T09:57:41.855 INFO:teuthology.orchestra.run.smithi050.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-10T09:57:41.863 INFO:teuthology.orchestra.run.smithi189.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T09:57:41.888 INFO:teuthology.orchestra.run.smithi189.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T09:57:41.930 INFO:teuthology.orchestra.run.smithi189.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-10T09:57:41.931 INFO:teuthology.orchestra.run.smithi050.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-09-10T09:57:41.937 INFO:teuthology.orchestra.run.smithi084.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 350 kB/s | 41 kB 00:00 2024-09-10T09:57:41.956 INFO:teuthology.orchestra.run.smithi189.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 652 kB/s | 16 kB 00:00 2024-09-10T09:57:41.981 INFO:teuthology.orchestra.run.smithi189.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T09:57:41.998 INFO:teuthology.orchestra.run.smithi050.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-10T09:57:42.007 INFO:teuthology.orchestra.run.smithi189.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-10T09:57:42.023 INFO:teuthology.orchestra.run.smithi189.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 674 kB/s | 28 kB 00:00 2024-09-10T09:57:42.040 INFO:teuthology.orchestra.run.smithi050.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-10T09:57:42.040 INFO:teuthology.orchestra.run.smithi189.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 921 kB/s | 31 kB 00:00 2024-09-10T09:57:42.057 INFO:teuthology.orchestra.run.smithi189.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-10T09:57:42.071 INFO:teuthology.orchestra.run.smithi084.stdout:(152/156): NetworkManager-libnm-1.49.90-1.el9.x 4.7 MB/s | 1.8 MB 00:00 2024-09-10T09:57:42.091 INFO:teuthology.orchestra.run.smithi189.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-09-10T09:57:42.096 INFO:teuthology.orchestra.run.smithi084.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.5 MB/s | 249 kB 00:00 2024-09-10T09:57:42.108 INFO:teuthology.orchestra.run.smithi189.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-10T09:57:42.138 INFO:teuthology.orchestra.run.smithi084.stdout:(154/156): NetworkManager-1.49.90-1.el9.x86_64. 3.7 MB/s | 2.3 MB 00:00 2024-09-10T09:57:42.150 INFO:teuthology.orchestra.run.smithi189.stdout:(141/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-09-10T09:57:42.175 INFO:teuthology.orchestra.run.smithi189.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-10T09:57:42.180 INFO:teuthology.orchestra.run.smithi050.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 2.7 MB/s | 910 kB 00:00 2024-09-10T09:57:42.200 INFO:teuthology.orchestra.run.smithi189.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T09:57:42.225 INFO:teuthology.orchestra.run.smithi189.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-10T09:57:42.240 INFO:teuthology.orchestra.run.smithi050.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-10T09:57:42.251 INFO:teuthology.orchestra.run.smithi189.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-10T09:57:42.265 INFO:teuthology.orchestra.run.smithi050.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-10T09:57:42.276 INFO:teuthology.orchestra.run.smithi189.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T09:57:42.301 INFO:teuthology.orchestra.run.smithi189.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T09:57:42.307 INFO:teuthology.orchestra.run.smithi050.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-10T09:57:42.349 INFO:teuthology.orchestra.run.smithi050.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-09-10T09:57:42.351 INFO:teuthology.orchestra.run.smithi189.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T09:57:42.441 INFO:teuthology.orchestra.run.smithi050.stdout:(76/156): postgresql-server-13.16-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-09-10T09:57:42.475 INFO:teuthology.orchestra.run.smithi050.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-10T09:57:42.488 INFO:teuthology.orchestra.run.smithi084.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.1 MB/s | 2.4 MB 00:00 2024-09-10T09:57:42.500 INFO:teuthology.orchestra.run.smithi050.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-09-10T09:57:42.526 INFO:teuthology.orchestra.run.smithi050.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-10T09:57:42.544 INFO:teuthology.orchestra.run.smithi189.stdout:(149/156): librados2-19.1.1-305.g1cf819b7.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-10T09:57:42.551 INFO:teuthology.orchestra.run.smithi050.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-10T09:57:42.576 INFO:teuthology.orchestra.run.smithi050.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 697 kB/s | 35 kB 00:00 2024-09-10T09:57:42.668 INFO:teuthology.orchestra.run.smithi050.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-10T09:57:42.694 INFO:teuthology.orchestra.run.smithi050.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-10T09:57:42.719 INFO:teuthology.orchestra.run.smithi050.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-10T09:57:42.744 INFO:teuthology.orchestra.run.smithi050.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T09:57:42.752 INFO:teuthology.orchestra.run.smithi189.stdout:(150/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 7.0 MB/s | 3.2 MB 00:00 2024-09-10T09:57:42.769 INFO:teuthology.orchestra.run.smithi050.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 847 kB/s | 42 kB 00:00 2024-09-10T09:57:42.795 INFO:teuthology.orchestra.run.smithi050.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-10T09:57:42.813 INFO:teuthology.orchestra.run.smithi084.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 1.4 MB 00:00 2024-09-10T09:57:42.819 INFO:teuthology.orchestra.run.smithi189.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 612 kB/s | 41 kB 00:00 2024-09-10T09:57:42.820 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:57:42.820 INFO:teuthology.orchestra.run.smithi084.stdout:Total 19 MB/s | 226 MB 00:11 2024-09-10T09:57:42.820 INFO:teuthology.orchestra.run.smithi050.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-10T09:57:42.845 INFO:teuthology.orchestra.run.smithi050.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-10T09:57:42.871 INFO:teuthology.orchestra.run.smithi050.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T09:57:42.877 INFO:teuthology.orchestra.run.smithi189.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 4.4 MB/s | 2.3 MB 00:00 2024-09-10T09:57:42.903 INFO:teuthology.orchestra.run.smithi189.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.9 MB/s | 249 kB 00:00 2024-09-10T09:57:42.921 INFO:teuthology.orchestra.run.smithi050.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 718 kB/s | 54 kB 00:00 2024-09-10T09:57:42.971 INFO:teuthology.orchestra.run.smithi050.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-09-10T09:57:43.036 INFO:teuthology.orchestra.run.smithi189.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 3.7 MB/s | 1.8 MB 00:00 2024-09-10T09:57:43.047 INFO:teuthology.orchestra.run.smithi050.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-09-10T09:57:43.072 INFO:teuthology.orchestra.run.smithi050.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 442 kB/s | 44 kB 00:00 2024-09-10T09:57:43.097 INFO:teuthology.orchestra.run.smithi050.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T09:57:43.122 INFO:teuthology.orchestra.run.smithi050.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-10T09:57:43.145 INFO:teuthology.orchestra.run.smithi189.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.9 MB/s | 2.4 MB 00:00 2024-09-10T09:57:43.148 INFO:teuthology.orchestra.run.smithi050.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-10T09:57:43.190 INFO:teuthology.orchestra.run.smithi050.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-09-10T09:57:43.223 INFO:teuthology.orchestra.run.smithi050.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 770 kB/s | 58 kB 00:00 2024-09-10T09:57:43.248 INFO:teuthology.orchestra.run.smithi050.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T09:57:43.270 INFO:teuthology.orchestra.run.smithi189.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 1.4 MB 00:00 2024-09-10T09:57:43.274 INFO:teuthology.orchestra.run.smithi050.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T09:57:43.276 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:57:43.276 INFO:teuthology.orchestra.run.smithi189.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-10T09:57:43.299 INFO:teuthology.orchestra.run.smithi050.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-10T09:57:43.324 INFO:teuthology.orchestra.run.smithi050.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-09-10T09:57:43.383 INFO:teuthology.orchestra.run.smithi050.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 10 MB/s | 863 kB 00:00 2024-09-10T09:57:43.450 INFO:teuthology.orchestra.run.smithi050.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-09-10T09:57:43.475 INFO:teuthology.orchestra.run.smithi050.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.4 MB/s | 309 kB 00:00 2024-09-10T09:57:43.501 INFO:teuthology.orchestra.run.smithi050.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-09-10T09:57:43.526 INFO:teuthology.orchestra.run.smithi050.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T09:57:43.551 INFO:teuthology.orchestra.run.smithi050.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T09:57:43.577 INFO:teuthology.orchestra.run.smithi050.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-10T09:57:43.610 INFO:teuthology.orchestra.run.smithi050.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-10T09:57:43.677 INFO:teuthology.orchestra.run.smithi050.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-10T09:57:43.719 INFO:teuthology.orchestra.run.smithi050.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-10T09:57:43.745 INFO:teuthology.orchestra.run.smithi050.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T09:57:43.769 INFO:teuthology.orchestra.run.smithi050.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T09:57:43.823 INFO:teuthology.orchestra.run.smithi050.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 266 kB/s | 14 kB 00:00 2024-09-10T09:57:43.862 INFO:teuthology.orchestra.run.smithi050.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.4 MB/s | 172 kB 00:00 2024-09-10T09:57:43.904 INFO:teuthology.orchestra.run.smithi050.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 8.5 MB/s | 358 kB 00:00 2024-09-10T09:57:43.938 INFO:teuthology.orchestra.run.smithi050.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.0 MB/s | 303 kB 00:00 2024-09-10T09:57:43.971 INFO:teuthology.orchestra.run.smithi050.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-10T09:57:44.026 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-10T09:57:44.072 INFO:teuthology.orchestra.run.smithi050.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.4 MB/s | 4.4 MB 00:00 2024-09-10T09:57:44.105 INFO:teuthology.orchestra.run.smithi050.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T09:57:44.131 INFO:teuthology.orchestra.run.smithi050.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-10T09:57:44.156 INFO:teuthology.orchestra.run.smithi050.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 718 kB/s | 18 kB 00:00 2024-09-10T09:57:44.176 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-10T09:57:44.176 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-10T09:57:44.181 INFO:teuthology.orchestra.run.smithi050.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-10T09:57:44.206 INFO:teuthology.orchestra.run.smithi050.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-10T09:57:44.232 INFO:teuthology.orchestra.run.smithi050.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 793 kB/s | 20 kB 00:00 2024-09-10T09:57:44.407 INFO:teuthology.orchestra.run.smithi050.stdout:(128/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-10T09:57:44.457 INFO:teuthology.orchestra.run.smithi050.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.2 MB/s | 2.0 MB 00:00 2024-09-10T09:57:44.482 INFO:teuthology.orchestra.run.smithi050.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 618 kB/s | 46 kB 00:00 2024-09-10T09:57:44.516 INFO:teuthology.orchestra.run.smithi050.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.5 MB/s | 58 kB 00:00 2024-09-10T09:57:44.520 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-09-10T09:57:44.550 INFO:teuthology.orchestra.run.smithi050.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.5 MB/s | 272 kB 00:00 2024-09-10T09:57:44.575 INFO:teuthology.orchestra.run.smithi050.stdout:(133/156): python3-more-itertools-8.12.0-2.el9. 671 kB/s | 79 kB 00:00 2024-09-10T09:57:44.601 INFO:teuthology.orchestra.run.smithi050.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 324 kB/s | 16 kB 00:00 2024-09-10T09:57:44.626 INFO:teuthology.orchestra.run.smithi050.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-10T09:57:44.651 INFO:teuthology.orchestra.run.smithi050.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-10T09:57:44.674 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-09-10T09:57:44.675 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-09-10T09:57:44.685 INFO:teuthology.orchestra.run.smithi050.stdout:(137/156): python3-kubernetes-26.1.0-2.el9.noar 2.3 MB/s | 1.0 MB 00:00 2024-09-10T09:57:44.727 INFO:teuthology.orchestra.run.smithi050.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-09-10T09:57:44.743 INFO:teuthology.orchestra.run.smithi050.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-10T09:57:44.761 INFO:teuthology.orchestra.run.smithi050.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-10T09:57:44.786 INFO:teuthology.orchestra.run.smithi050.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-10T09:57:44.811 INFO:teuthology.orchestra.run.smithi050.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-10T09:57:44.836 INFO:teuthology.orchestra.run.smithi050.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 3.6 MB/s | 90 kB 00:00 2024-09-10T09:57:44.862 INFO:teuthology.orchestra.run.smithi050.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T09:57:44.887 INFO:teuthology.orchestra.run.smithi050.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-10T09:57:44.920 INFO:teuthology.orchestra.run.smithi050.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-10T09:57:44.946 INFO:teuthology.orchestra.run.smithi050.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-10T09:57:45.005 INFO:teuthology.orchestra.run.smithi050.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-10T09:57:45.231 INFO:teuthology.orchestra.run.smithi050.stdout:(149/156): librados2-19.1.1-305.g1cf819b7.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-10T09:57:45.290 INFO:teuthology.orchestra.run.smithi050.stdout:(150/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 9.2 MB/s | 3.2 MB 00:00 2024-09-10T09:57:45.473 INFO:teuthology.orchestra.run.smithi050.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 223 kB/s | 41 kB 00:00 2024-09-10T09:57:45.740 INFO:teuthology.orchestra.run.smithi050.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 932 kB/s | 249 kB 00:00 2024-09-10T09:57:45.980 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-10T09:57:45.980 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-10T09:57:46.023 INFO:teuthology.orchestra.run.smithi050.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 2.3 MB/s | 2.3 MB 00:01 2024-09-10T09:57:46.066 INFO:teuthology.orchestra.run.smithi050.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 2.2 MB/s | 1.8 MB 00:00 2024-09-10T09:57:46.141 INFO:teuthology.orchestra.run.smithi050.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 1.4 MB 00:00 2024-09-10T09:57:46.472 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-09-10T09:57:46.472 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-09-10T09:57:46.900 INFO:teuthology.orchestra.run.smithi050.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.7 MB/s | 2.4 MB 00:00 2024-09-10T09:57:46.906 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:57:46.907 INFO:teuthology.orchestra.run.smithi050.stdout:Total 17 MB/s | 226 MB 00:13 2024-09-10T09:57:48.967 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-09-10T09:57:49.167 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-09-10T09:57:49.167 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-09-10T09:57:51.684 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-09-10T09:57:51.684 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-09-10T09:57:52.208 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-10T09:57:52.325 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T09:57:52.464 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T09:57:52.671 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T09:57:52.718 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T09:57:52.743 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T09:57:52.795 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T09:57:52.831 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-09-10T09:57:52.966 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T09:57:53.012 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T09:57:53.066 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T09:57:53.099 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T09:57:53.125 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T09:57:53.125 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T09:57:53.176 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T09:57:53.243 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:57:53.349 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:57:53.378 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:57:53.468 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:57:53.499 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T09:57:53.506 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T09:57:53.617 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:57:53.646 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T09:57:53.704 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T09:57:53.722 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:57:53.732 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:57:53.760 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:57:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:57:53.850 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:57:53.866 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T09:57:53.881 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T09:57:53.929 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T09:57:53.951 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T09:57:53.977 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T09:57:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T09:57:54.086 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T09:57:54.122 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:57:54.152 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T09:57:54.210 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:57:54.240 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T09:57:54.286 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T09:57:54.316 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T09:57:54.319 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T09:57:54.341 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T09:57:54.449 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T09:57:54.543 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T09:57:54.562 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:57:54.642 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:57:54.699 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T09:57:54.814 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T09:57:54.871 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:57:54.917 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:57:54.991 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:57:55.001 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T09:57:55.092 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T09:57:55.121 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T09:57:55.164 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T09:57:55.210 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:57:55.236 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T09:57:55.282 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T09:57:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T09:57:55.340 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T09:57:55.377 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T09:57:55.410 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T09:57:55.435 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T09:57:55.438 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T09:57:55.471 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T09:57:55.505 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T09:57:55.506 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T09:57:55.570 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T09:57:55.579 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T09:57:55.599 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T09:57:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T09:57:55.642 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T09:57:55.664 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T09:57:55.707 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T09:57:55.718 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T09:57:55.739 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T09:57:55.761 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T09:57:55.776 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T09:57:55.805 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T09:57:55.851 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T09:57:55.853 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T09:57:55.915 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T09:57:55.928 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T09:57:55.945 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T09:57:55.974 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T09:57:55.981 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T09:57:56.048 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T09:57:56.057 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T09:57:56.091 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T09:57:56.134 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T09:57:56.163 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T09:57:56.188 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T09:57:56.233 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T09:57:56.250 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T09:57:56.286 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T09:57:56.378 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T09:57:56.511 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T09:57:56.564 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T09:57:56.772 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T09:57:56.854 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T09:57:56.892 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T09:57:56.935 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T09:57:56.973 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T09:57:57.023 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T09:57:57.090 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T09:57:57.176 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T09:57:57.180 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T09:57:57.216 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T09:57:57.234 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T09:57:57.259 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T09:57:57.295 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T09:57:57.298 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T09:57:57.340 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T09:57:57.377 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T09:57:57.417 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T09:57:57.453 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T09:57:57.492 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T09:57:57.500 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T09:57:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T09:57:57.550 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T09:57:57.579 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T09:57:57.605 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T09:57:57.629 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T09:57:57.686 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T09:57:57.726 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T09:57:57.762 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T09:57:57.764 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T09:57:57.809 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T09:57:57.845 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T09:57:57.884 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T09:57:57.888 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T09:57:57.924 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T09:57:57.930 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T09:57:58.026 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T09:57:58.066 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T09:57:58.075 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T09:57:58.114 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T09:57:58.115 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T09:57:58.140 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T09:57:58.156 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T09:57:58.170 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T09:57:58.259 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T09:57:58.290 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T09:57:58.349 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T09:57:58.388 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T09:57:58.581 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T09:57:58.606 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T09:57:58.648 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-09-10T09:57:58.650 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T09:57:58.684 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T09:57:58.689 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T09:57:58.717 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T09:57:58.751 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T09:57:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T09:57:58.790 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T09:57:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T09:57:58.824 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T09:57:58.851 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T09:57:58.871 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T09:57:58.886 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T09:57:58.898 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T09:57:58.919 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T09:57:58.941 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T09:57:58.960 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T09:57:58.980 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T09:57:58.986 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T09:57:58.995 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T09:57:59.011 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T09:57:59.041 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T09:57:59.076 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T09:57:59.089 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T09:57:59.109 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T09:57:59.140 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T09:57:59.141 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T09:57:59.159 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T09:57:59.173 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T09:57:59.193 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T09:57:59.208 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T09:57:59.247 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T09:57:59.281 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T09:57:59.284 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T09:57:59.310 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T09:57:59.323 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T09:57:59.341 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T09:57:59.355 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T09:57:59.458 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T09:57:59.506 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T09:57:59.707 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T09:57:59.814 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:57:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:57:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:58:00.055 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T09:58:00.105 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T09:58:00.121 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:58:00.138 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T09:58:00.161 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T09:58:00.236 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T09:58:00.241 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T09:58:00.286 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T09:58:00.293 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T09:58:00.320 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T09:58:00.337 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T09:58:00.385 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T09:58:00.417 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T09:58:00.419 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T09:58:00.451 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T09:58:00.457 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T09:58:00.466 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T09:58:00.477 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:58:00.529 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T09:58:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:58:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T09:58:00.625 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T09:58:00.642 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T09:58:00.655 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T09:58:00.672 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T09:58:00.703 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T09:58:00.730 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T09:58:00.749 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T09:58:00.768 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T09:58:00.843 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T09:58:00.878 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T09:58:00.956 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T09:58:01.024 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T09:58:01.219 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T09:58:01.388 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T09:58:01.395 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T09:58:01.510 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T09:58:01.542 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:58:01.615 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T09:58:01.630 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:58:01.794 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T09:58:01.910 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T09:58:02.061 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T09:58:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T09:58:02.220 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T09:58:02.265 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T09:58:02.349 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T09:58:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T09:58:02.448 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T09:58:02.503 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T09:58:02.540 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T09:58:02.574 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T09:58:02.667 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T09:58:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T09:58:02.747 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T09:58:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T09:58:02.834 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T09:58:02.925 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T09:58:02.957 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T09:58:02.965 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T09:58:02.986 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T09:58:03.019 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T09:58:03.026 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T09:58:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T09:58:03.108 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T09:58:03.128 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T09:58:03.135 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T09:58:03.169 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T09:58:03.329 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T09:58:03.390 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T09:58:03.481 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T09:58:03.488 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T09:58:03.490 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T09:58:03.520 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T09:58:03.532 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T09:58:03.549 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T09:58:03.556 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T09:58:03.623 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T09:58:03.642 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T09:58:03.653 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T09:58:03.690 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T09:58:03.823 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T09:58:03.886 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T09:58:04.035 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T09:58:04.076 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T09:58:04.131 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T09:58:04.161 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T09:58:04.170 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T09:58:04.210 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T09:58:04.273 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T09:58:04.303 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T09:58:04.558 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T09:58:04.663 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T09:58:04.713 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T09:58:04.757 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T09:58:04.796 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T09:58:04.849 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T09:58:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T09:58:05.140 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T09:58:05.228 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T09:58:05.313 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T09:58:05.358 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T09:58:05.394 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T09:58:05.472 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T09:58:05.518 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T09:58:05.564 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T09:58:05.615 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T09:58:05.794 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T09:58:05.847 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T09:58:05.891 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T09:58:06.024 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T09:58:06.064 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T09:58:06.109 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T09:58:06.152 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T09:58:06.180 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T09:58:06.295 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T09:58:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:58:06.496 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T09:58:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:58:06.539 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T09:58:06.576 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T09:58:06.599 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:58:06.617 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T09:58:06.641 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:58:06.687 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T09:58:06.732 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T09:58:06.769 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T09:58:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T09:58:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T09:58:06.881 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T09:58:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T09:58:07.015 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T09:58:07.057 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:58:07.072 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T09:58:07.102 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T09:58:07.108 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T09:58:07.186 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:58:07.195 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T09:58:07.195 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T09:58:07.195 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T09:58:07.195 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:58:07.229 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T09:58:07.235 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T09:58:07.236 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T09:58:07.305 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T09:58:07.337 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T09:58:07.337 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T09:58:07.337 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T09:58:07.337 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:58:07.370 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T09:58:08.239 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T09:58:08.292 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T09:58:08.327 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T09:58:08.445 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T09:58:08.501 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T09:58:08.555 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T09:58:08.662 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T09:58:08.712 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T09:58:08.960 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T09:58:08.992 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T09:58:09.114 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T09:58:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T09:58:10.117 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T09:58:11.754 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T09:58:11.855 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T09:58:11.891 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T09:58:11.924 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T09:58:12.282 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T09:58:12.319 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T09:58:12.416 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T09:58:12.450 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T09:58:12.499 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T09:58:13.059 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T09:58:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T09:58:13.239 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T09:58:13.265 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T09:58:16.115 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:58:16.154 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:58:16.827 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T09:58:16.874 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T09:58:16.991 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T09:58:16.991 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T09:58:16.991 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T09:58:16.991 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:17.033 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T09:58:18.838 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T09:58:18.839 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2024-09-10T09:58:18.839 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2024-09-10T09:58:18.839 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2024-09-10T09:58:18.839 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2024-09-10T09:58:18.839 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2024-09-10T09:58:18.839 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /root 2024-09-10T09:58:18.839 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2024-09-10T09:58:18.839 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:58:19.013 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T09:58:19.028 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T09:58:19.028 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:19.028 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T09:58:19.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:58:19.218 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T09:58:19.218 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /sys 2024-09-10T09:58:19.218 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /proc 2024-09-10T09:58:19.218 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /mnt 2024-09-10T09:58:19.218 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /var/tmp 2024-09-10T09:58:19.219 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /home 2024-09-10T09:58:19.219 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /root 2024-09-10T09:58:19.219 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /tmp 2024-09-10T09:58:19.219 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:58:19.425 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T09:58:19.442 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T09:58:19.442 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:19.442 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T09:58:19.442 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:58:20.499 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T09:58:20.525 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T09:58:20.526 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:20.526 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T09:58:20.526 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:58:20.526 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:58:20.526 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:58:20.766 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T09:58:20.789 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T09:58:20.789 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:20.789 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T09:58:20.789 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:58:20.790 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:58:20.790 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:58:20.933 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T09:58:20.961 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T09:58:20.961 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:20.961 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T09:58:20.961 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:58:20.962 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:58:20.962 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:58:21.192 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T09:58:21.216 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T09:58:21.216 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:21.216 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T09:58:21.216 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:58:21.216 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:58:21.216 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:58:21.225 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T09:58:21.248 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T09:58:21.248 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:21.248 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T09:58:21.248 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:58:21.248 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:58:21.248 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:58:21.355 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T09:58:21.411 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T09:58:21.466 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T09:58:21.659 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T09:58:21.659 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T09:58:21.683 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T09:58:21.683 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:21.683 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T09:58:21.684 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:58:21.684 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:58:21.684 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:58:21.717 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T09:58:21.781 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T09:58:21.786 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T09:58:21.838 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T09:58:21.875 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T09:58:21.902 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T09:58:22.015 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T09:58:22.059 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T09:58:22.088 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T09:58:22.091 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T09:58:22.118 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T09:58:22.143 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T09:58:22.222 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T09:58:22.320 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T09:58:22.476 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T09:58:22.527 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T09:58:22.567 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T09:58:22.571 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T09:58:22.595 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T09:58:22.600 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T09:58:22.623 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T09:58:22.685 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T09:58:22.714 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T09:58:22.973 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T09:58:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T09:58:23.041 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T09:58:23.104 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T09:58:23.141 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T09:58:23.754 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T09:58:23.811 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T09:58:24.197 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T09:58:24.234 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T09:58:24.773 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T09:58:24.800 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T09:58:24.900 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T09:58:25.061 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T09:58:25.085 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T09:58:25.109 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T09:58:25.109 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:25.109 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T09:58:25.109 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:58:25.109 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:58:25.109 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:58:25.153 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T09:58:25.164 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T09:58:25.204 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T09:58:25.243 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T09:58:25.253 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T09:58:25.310 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T09:58:25.348 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T09:58:25.514 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T09:58:25.545 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T09:58:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T09:58:25.570 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:25.570 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T09:58:25.570 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:58:25.570 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:58:25.570 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:58:25.629 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T09:58:25.641 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T09:58:25.739 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T09:58:25.795 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T09:58:26.231 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T09:58:26.263 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T09:58:26.287 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T09:58:26.287 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:26.287 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T09:58:26.287 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:58:26.287 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:58:26.287 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:58:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T09:58:26.353 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T09:58:26.353 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:26.353 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T09:58:26.353 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:58:26.397 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T09:58:26.420 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T09:58:26.420 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:26.421 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T09:58:26.421 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T09:58:26.421 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T09:58:26.421 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:58:26.723 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T09:58:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T09:58:26.746 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T09:58:26.746 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:26.747 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T09:58:26.747 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:58:26.747 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:58:26.747 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:58:26.756 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T09:58:26.781 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T09:58:26.781 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:26.781 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T09:58:26.781 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:58:26.781 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:58:26.781 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:58:26.824 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T09:58:26.847 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T09:58:26.847 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:26.848 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T09:58:26.848 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:58:26.908 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T09:58:26.932 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T09:58:26.932 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:26.933 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T09:58:26.933 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T09:58:26.936 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T09:58:26.936 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:58:27.234 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T09:58:27.258 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T09:58:27.258 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:27.258 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T09:58:27.258 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:58:27.258 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:58:27.258 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:58:30.289 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T09:58:30.289 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2024-09-10T09:58:30.289 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2024-09-10T09:58:30.289 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2024-09-10T09:58:30.289 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2024-09-10T09:58:30.289 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2024-09-10T09:58:30.289 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /root 2024-09-10T09:58:30.290 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2024-09-10T09:58:30.290 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T09:58:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T09:58:30.548 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:30.548 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T09:58:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:31.293 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T09:58:31.335 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T09:58:31.375 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T09:58:31.407 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T09:58:31.435 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T09:58:31.616 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T09:58:31.656 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T09:58:31.686 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T09:58:31.716 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T09:58:31.754 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T09:58:31.813 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T09:58:31.854 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T09:58:31.903 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T09:58:31.943 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T09:58:31.979 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T09:58:32.165 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T09:58:32.206 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T09:58:32.209 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T09:58:32.239 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T09:58:32.265 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T09:58:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T09:58:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:58:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:58:32.265 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:32.269 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T09:58:32.315 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T09:58:32.358 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:58:32.393 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:58:32.413 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:58:32.524 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T09:58:32.575 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T09:58:32.575 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:32.575 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T09:58:32.575 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:58:32.575 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:58:32.575 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:32.894 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:58:32.929 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:58:32.950 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:58:33.084 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T09:58:33.134 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T09:58:33.134 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:33.134 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T09:58:33.134 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:58:33.134 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:58:33.134 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:33.242 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T09:58:33.267 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T09:58:33.330 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T09:58:33.345 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T09:58:33.371 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T09:58:33.418 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T09:58:33.451 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T09:58:33.483 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T09:58:33.509 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T09:58:33.534 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T09:58:33.534 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T09:58:33.618 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T09:58:33.619 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T09:58:33.673 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T09:58:33.703 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T09:58:33.727 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T09:58:33.733 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:58:33.733 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:58:33.737 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T09:58:33.816 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T09:58:33.827 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T09:58:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:58:33.904 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T09:58:33.908 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T09:58:33.937 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T09:58:33.949 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T09:58:33.997 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T09:58:34.032 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T09:58:34.060 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:58:34.061 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T09:58:34.087 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T09:58:34.121 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T09:58:34.121 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T09:58:34.125 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T09:58:34.173 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T09:58:34.218 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T09:58:34.222 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T09:58:34.222 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T09:58:34.243 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T09:58:34.308 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T09:58:34.330 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T09:58:34.337 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:58:34.337 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:58:34.524 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:58:34.524 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T09:58:34.600 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T09:58:34.665 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:58:34.843 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T09:58:34.884 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T09:58:34.926 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T09:58:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T09:58:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T09:58:36.329 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T09:58:36.367 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T09:58:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T09:58:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T09:58:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T09:58:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T09:58:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T09:58:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T09:58:37.963 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:37.963 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T09:58:37.963 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:58:37.963 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:58:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T09:58:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T09:58:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T09:58:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T09:58:39.287 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T09:58:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T09:58:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T09:58:39.373 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:39.373 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T09:58:39.374 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:58:39.374 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:58:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T09:58:39.472 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T09:58:39.473 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:39.473 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T09:58:39.473 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:39.560 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T09:58:39.611 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T09:58:39.611 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:39.611 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T09:58:39.612 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T09:58:39.612 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T09:58:39.612 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:39.634 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:58:39.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T09:58:39.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T09:58:39.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T09:58:39.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T09:58:39.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T09:58:39.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T09:58:39.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T09:58:39.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:58:39.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:58:39.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T09:58:39.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T09:58:39.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T09:58:39.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:58:39.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T09:58:39.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T09:58:39.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T09:58:39.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T09:58:39.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T09:58:39.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T09:58:39.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T09:58:39.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T09:58:39.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T09:58:39.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T09:58:39.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T09:58:39.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T09:58:39.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T09:58:39.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T09:58:39.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T09:58:39.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T09:58:39.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T09:58:39.637 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T09:58:39.648 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T09:58:39.648 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T09:58:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T09:58:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T09:58:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T09:58:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T09:58:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T09:58:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T09:58:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T09:58:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T09:58:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T09:58:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T09:58:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T09:58:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T09:58:39.649 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T09:58:39.650 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T09:58:39.650 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T09:58:39.650 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T09:58:39.650 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T09:58:39.650 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T09:58:39.650 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T09:58:39.650 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T09:58:39.650 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T09:58:39.650 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T09:58:39.650 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T09:58:39.650 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T09:58:39.650 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T09:58:39.650 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T09:58:39.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T09:58:39.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T09:58:39.653 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T09:58:39.653 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T09:58:39.653 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T09:58:39.653 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T09:58:39.653 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T09:58:39.653 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T09:58:39.653 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T09:58:39.653 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T09:58:39.653 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T09:58:39.653 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T09:58:39.653 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T09:58:39.653 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T09:58:39.654 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T09:58:39.655 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T09:58:39.656 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T09:58:39.656 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T09:58:39.656 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T09:58:39.656 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T09:58:39.656 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T09:58:39.656 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T09:58:39.656 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T09:58:39.656 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T09:58:39.656 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T09:58:39.656 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T09:58:39.656 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T09:58:39.656 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T09:58:39.656 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T09:58:39.657 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T09:58:39.657 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T09:58:39.657 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T09:58:39.657 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T09:58:39.657 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T09:58:39.657 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T09:58:39.657 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T09:58:39.657 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T09:58:39.657 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T09:58:39.657 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T09:58:39.657 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T09:58:39.657 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T09:58:39.657 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T09:58:39.658 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T09:58:39.658 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T09:58:39.658 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T09:58:39.658 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T09:58:39.658 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T09:58:39.658 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T09:58:39.658 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T09:58:39.658 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T09:58:39.966 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T09:58:40.017 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T09:58:40.017 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:58:40.017 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T09:58:40.017 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:58:40.018 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:58:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:40.512 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:58:40.512 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T09:58:40.512 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T09:58:40.512 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T09:58:40.512 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T09:58:40.512 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T09:58:40.512 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T09:58:40.512 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T09:58:40.512 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:58:40.513 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:58:40.513 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T09:58:40.513 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T09:58:40.513 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T09:58:40.513 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:58:40.513 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T09:58:40.513 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T09:58:40.513 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T09:58:40.513 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T09:58:40.513 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T09:58:40.513 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T09:58:40.513 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T09:58:40.513 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T09:58:40.514 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T09:58:40.515 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T09:58:40.516 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T09:58:40.516 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T09:58:40.516 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T09:58:40.516 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T09:58:40.516 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T09:58:40.516 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T09:58:40.516 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T09:58:40.516 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T09:58:40.516 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T09:58:40.516 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T09:58:40.516 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T09:58:40.516 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T09:58:40.517 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T09:58:40.517 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T09:58:40.517 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T09:58:40.517 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T09:58:40.517 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T09:58:40.517 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T09:58:40.517 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T09:58:40.517 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T09:58:40.517 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T09:58:40.517 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T09:58:40.517 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T09:58:40.517 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T09:58:40.517 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T09:58:40.518 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T09:58:40.518 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T09:58:40.518 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T09:58:40.518 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T09:58:40.518 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T09:58:40.518 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T09:58:40.518 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T09:58:40.518 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T09:58:40.518 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T09:58:40.518 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T09:58:40.518 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T09:58:40.518 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T09:58:40.518 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T09:58:40.519 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T09:58:40.519 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T09:58:40.519 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T09:58:40.519 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T09:58:40.519 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T09:58:40.519 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T09:58:40.519 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T09:58:40.519 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T09:58:40.519 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T09:58:40.519 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T09:58:40.519 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T09:58:40.520 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T09:58:40.520 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T09:58:40.520 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T09:58:40.520 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T09:58:40.520 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T09:58:40.520 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T09:58:40.520 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T09:58:40.520 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T09:58:40.520 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T09:58:40.520 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T09:58:40.520 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T09:58:40.520 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T09:58:40.520 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T09:58:40.521 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T09:58:40.521 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T09:58:40.521 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T09:58:40.521 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T09:58:40.521 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T09:58:40.521 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T09:58:40.521 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T09:58:40.521 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T09:58:40.521 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T09:58:40.521 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T09:58:40.521 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T09:58:40.521 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T09:58:40.521 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T09:58:40.522 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T09:58:40.523 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T09:58:40.523 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T09:58:40.523 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T09:58:40.523 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T09:58:40.523 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T09:58:40.523 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T09:58:40.523 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T09:58:40.523 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T09:58:40.523 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T09:58:40.523 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T09:58:40.523 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T09:58:40.523 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T09:58:40.523 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T09:58:40.524 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T09:58:40.524 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T09:58:40.524 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T09:58:40.524 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T09:58:40.524 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T09:58:40.524 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T09:58:40.524 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T09:58:40.524 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T09:58:40.524 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T09:58:40.524 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T09:58:40.524 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T09:58:40.524 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T09:58:42.585 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:58:42.585 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:58:42.586 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-09-10T09:58:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T09:58:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T09:58:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T09:58:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T09:58:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T09:58:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T09:58:42.586 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-10T09:58:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T09:58:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T09:58:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T09:58:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T09:58:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T09:58:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T09:58:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T09:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T09:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T09:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T09:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T09:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T09:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T09:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T09:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T09:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T09:58:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T09:58:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T09:58:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T09:58:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T09:58:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T09:58:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T09:58:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T09:58:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T09:58:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T09:58:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T09:58:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T09:58:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T09:58:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T09:58:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T09:58:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T09:58:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T09:58:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T09:58:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T09:58:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T09:58:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T09:58:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T09:58:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T09:58:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T09:58:42.598 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T09:58:42.598 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T09:58:42.598 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-10T09:58:42.982 DEBUG:teuthology.parallel:result is None 2024-09-10T09:58:43.154 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:58:43.155 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:58:43.155 INFO:teuthology.orchestra.run.smithi189.stdout:Upgraded: 2024-09-10T09:58:43.155 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T09:58:43.155 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T09:58:43.155 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T09:58:43.155 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T09:58:43.155 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.155 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.155 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T09:58:43.155 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T09:58:43.155 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2024-09-10T09:58:43.156 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T09:58:43.156 INFO:teuthology.orchestra.run.smithi189.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T09:58:43.156 INFO:teuthology.orchestra.run.smithi189.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T09:58:43.156 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T09:58:43.156 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.156 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.156 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.156 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.156 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:43.156 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.156 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.156 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.156 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:43.157 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T09:58:43.158 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T09:58:43.159 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T09:58:43.160 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T09:58:43.161 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T09:58:43.161 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T09:58:43.161 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T09:58:43.161 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T09:58:43.161 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.161 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.161 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.161 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T09:58:43.161 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T09:58:43.161 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T09:58:43.161 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T09:58:43.161 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T09:58:43.162 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T09:58:43.163 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T09:58:43.164 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.165 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:43.166 INFO:teuthology.orchestra.run.smithi189.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T09:58:43.166 INFO:teuthology.orchestra.run.smithi189.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T09:58:43.166 INFO:teuthology.orchestra.run.smithi189.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T09:58:43.166 INFO:teuthology.orchestra.run.smithi189.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T09:58:43.166 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T09:58:43.166 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T09:58:43.166 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T09:58:43.166 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T09:58:43.166 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-09-10T09:58:43.582 DEBUG:teuthology.parallel:result is None 2024-09-10T09:58:45.272 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T09:58:45.314 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T09:58:45.360 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T09:58:45.394 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T09:58:45.430 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T09:58:45.667 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T09:58:45.726 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T09:58:45.764 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T09:58:45.796 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T09:58:45.865 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T09:58:46.909 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:58:46.963 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:58:47.005 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T09:58:48.389 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T09:58:48.494 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T09:58:48.576 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T09:58:48.686 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T09:58:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T09:58:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T09:58:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T09:58:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T09:58:48.948 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T09:58:48.948 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T09:58:49.108 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T09:58:49.132 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T09:58:49.149 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:58:49.149 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:58:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T09:58:49.423 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T09:58:49.569 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T09:58:49.646 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:58:49.857 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:58:49.857 INFO:teuthology.orchestra.run.smithi050.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T09:58:49.857 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T09:58:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T09:58:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T09:58:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T09:58:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T09:58:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T09:58:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T09:58:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T09:58:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T09:58:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T09:58:55.486 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T09:58:55.487 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T09:58:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T09:58:55.488 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T09:58:55.499 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T09:58:55.500 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T09:58:55.500 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T09:58:55.500 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T09:58:55.500 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T09:58:55.500 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T09:58:55.500 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T09:58:55.500 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T09:58:55.500 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T09:58:55.500 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T09:58:55.500 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T09:58:55.500 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T09:58:55.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T09:58:55.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T09:58:55.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T09:58:55.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T09:58:55.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T09:58:55.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T09:58:55.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T09:58:55.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T09:58:55.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T09:58:55.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T09:58:55.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T09:58:55.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T09:58:55.501 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T09:58:55.502 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T09:58:55.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T09:58:55.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T09:58:55.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T09:58:55.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T09:58:55.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T09:58:55.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T09:58:55.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T09:58:55.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T09:58:55.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T09:58:55.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T09:58:55.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T09:58:55.503 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T09:58:55.504 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T09:58:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T09:58:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T09:58:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T09:58:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T09:58:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T09:58:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T09:58:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T09:58:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T09:58:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T09:58:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T09:58:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T09:58:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T09:58:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T09:58:55.506 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T09:58:55.507 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T09:58:55.508 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T09:58:55.509 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T09:58:55.510 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T09:58:57.722 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T09:58:57.722 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:57.722 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2024-09-10T09:58:57.722 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T09:58:57.723 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T09:58:57.723 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T09:58:57.723 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T09:58:57.723 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.723 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.723 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T09:58:57.723 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T09:58:57.723 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-09-10T09:58:57.723 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T09:58:57.724 INFO:teuthology.orchestra.run.smithi050.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T09:58:57.724 INFO:teuthology.orchestra.run.smithi050.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T09:58:57.724 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T09:58:57.724 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.724 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.724 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.724 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.725 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:57.725 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.725 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.725 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.725 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:57.725 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T09:58:57.727 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.728 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T09:58:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T09:58:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T09:58:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T09:58:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T09:58:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T09:58:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T09:58:57.729 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T09:58:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T09:58:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T09:58:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T09:58:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T09:58:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T09:58:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T09:58:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T09:58:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T09:58:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T09:58:57.730 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T09:58:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T09:58:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T09:58:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T09:58:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T09:58:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T09:58:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T09:58:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T09:58:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T09:58:57.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T09:58:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T09:58:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T09:58:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T09:58:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T09:58:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T09:58:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T09:58:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T09:58:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T09:58:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T09:58:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T09:58:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T09:58:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T09:58:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T09:58:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T09:58:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T09:58:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T09:58:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T09:58:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T09:58:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T09:58:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T09:58:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T09:58:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T09:58:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T09:58:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T09:58:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T09:58:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T09:58:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T09:58:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T09:58:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T09:58:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T09:58:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T09:58:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T09:58:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T09:58:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T09:58:57.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T09:58:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T09:58:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T09:58:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T09:58:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T09:58:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T09:58:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T09:58:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T09:58:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T09:58:57.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T09:58:57.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T09:58:57.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T09:58:57.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T09:58:57.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T09:58:57.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T09:58:57.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T09:58:57.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T09:58:57.736 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T09:58:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T09:58:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T09:58:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T09:58:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T09:58:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T09:58:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T09:58:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T09:58:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T09:58:57.737 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T09:58:57.738 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T09:58:57.738 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T09:58:57.738 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-09-10T09:58:58.384 DEBUG:teuthology.parallel:result is None 2024-09-10T09:58:58.385 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:58:58.538 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T09:58:58.584 INFO:teuthology.orchestra.run.smithi050.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T09:58:58.585 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T09:58:58.585 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T09:58:58.586 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:58:58.734 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T09:58:58.760 INFO:teuthology.orchestra.run.smithi084.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T09:58:58.761 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T09:58:58.761 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T09:58:58.762 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:58:58.911 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T09:58:58.938 INFO:teuthology.orchestra.run.smithi189.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T09:58:58.938 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T09:58:58.939 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T09:58:58.941 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T09:58:58.941 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T09:58:58.941 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T09:58:59.001 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T09:58:59.001 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T09:58:59.034 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T09:58:59.034 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T09:58:59.066 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T09:58:59.066 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T09:58:59.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T09:58:59.127 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T09:58:59.225 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T09:58:59.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T09:58:59.254 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T09:58:59.326 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T09:58:59.326 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T09:58:59.351 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T09:58:59.416 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T09:58:59.416 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T09:58:59.416 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T09:58:59.474 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T09:58:59.571 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T09:58:59.571 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T09:58:59.597 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T09:58:59.662 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T09:58:59.663 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T09:58:59.689 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T09:58:59.755 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T09:58:59.756 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T09:58:59.756 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T09:58:59.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T09:58:59.912 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T09:58:59.912 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T09:58:59.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T09:59:00.003 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T09:59:00.003 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T09:59:00.028 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T09:59:00.093 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T09:59:00.188 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-10T09:59:00.188 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:59:00.189 INFO:tasks.cephadm:Cluster fsid is 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T09:59:00.189 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T09:59:00.189 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.50', 'mon.b': '172.21.15.84', 'mon.c': '172.21.15.189'} 2024-09-10T09:59:00.189 INFO:tasks.cephadm:First mon is mon.a on smithi050 2024-09-10T09:59:00.189 INFO:tasks.cephadm:First mgr is x 2024-09-10T09:59:00.189 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T09:59:00.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname $(hostname -s) 2024-09-10T09:59:00.247 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname $(hostname -s) 2024-09-10T09:59:00.271 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname $(hostname -s) 2024-09-10T09:59:00.296 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T09:59:00.296 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:59:00.442 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82914/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:14:38.445020', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82912/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:05:03.996701', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-10T09:59:00.585 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240909.165402-squid, sha1 1cf819b7212a6048e92fc78c4eff963344f6d56b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:59:00.587 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm 2024-09-10T09:59:00.587 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm 2024-09-10T09:59:00.587 DEBUG:teuthology.orchestra.run.smithi050:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T09:59:01.030 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 09:59 /home/ubuntu/cephtest/cephadm 2024-09-10T09:59:01.031 DEBUG:teuthology.orchestra.run.smithi084:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T09:59:01.402 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 09:59 /home/ubuntu/cephtest/cephadm 2024-09-10T09:59:01.403 DEBUG:teuthology.orchestra.run.smithi189:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T09:59:01.802 INFO:teuthology.orchestra.run.smithi189.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 09:59 /home/ubuntu/cephtest/cephadm 2024-09-10T09:59:01.803 DEBUG:teuthology.orchestra.run.smithi050:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T09:59:01.844 DEBUG:teuthology.orchestra.run.smithi084:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T09:59:01.863 DEBUG:teuthology.orchestra.run.smithi189:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T09:59:01.899 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b on all hosts... 2024-09-10T09:59:01.900 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T09:59:01.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T09:59:01.906 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T09:59:03.471 INFO:teuthology.orchestra.run.smithi189.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T09:59:03.481 INFO:teuthology.orchestra.run.smithi084.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T09:59:03.955 INFO:teuthology.orchestra.run.smithi050.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T09:59:36.820 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T09:59:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T09:59:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T09:59:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "repo_digests": [ 2024-09-10T09:59:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T09:59:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-10T09:59:36.821 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T09:59:50.650 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-10T09:59:50.650 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T09:59:50.651 INFO:teuthology.orchestra.run.smithi084.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T09:59:50.651 INFO:teuthology.orchestra.run.smithi084.stdout: "repo_digests": [ 2024-09-10T09:59:50.651 INFO:teuthology.orchestra.run.smithi084.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T09:59:50.651 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-10T09:59:50.651 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-10T09:59:52.780 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-10T09:59:52.780 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T09:59:52.780 INFO:teuthology.orchestra.run.smithi189.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T09:59:52.780 INFO:teuthology.orchestra.run.smithi189.stdout: "repo_digests": [ 2024-09-10T09:59:52.780 INFO:teuthology.orchestra.run.smithi189.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T09:59:52.781 INFO:teuthology.orchestra.run.smithi189.stdout: ] 2024-09-10T09:59:52.781 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-10T09:59:52.805 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph 2024-09-10T09:59:52.871 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph 2024-09-10T09:59:52.904 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph 2024-09-10T09:59:52.931 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /etc/ceph 2024-09-10T09:59:52.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /etc/ceph 2024-09-10T09:59:53.019 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /etc/ceph 2024-09-10T09:59:53.043 INFO:tasks.cephadm:Writing seed config... 2024-09-10T09:59:53.044 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-10T09:59:53.044 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-10T09:59:53.044 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-10T09:59:53.045 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-10T09:59:53.045 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-10T09:59:53.045 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T09:59:53.045 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-10T09:59:53.045 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-10T09:59:53.045 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-10T09:59:53.045 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-10T09:59:53.045 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-10T09:59:53.045 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-10T09:59:53.045 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-10T09:59:53.045 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-10T09:59:53.046 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-10T09:59:53.046 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-10T09:59:53.046 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-10T09:59:53.046 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-10T09:59:53.046 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-10T09:59:53.046 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-10T09:59:53.046 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-10T09:59:53.046 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T09:59:53.046 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T09:59:53.046 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T09:59:53.047 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T09:59:53.048 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-10T09:59:53.048 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T09:59:53.048 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T09:59:53.048 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T09:59:53.048 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T09:59:53.048 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T09:59:53.048 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-10T09:59:53.048 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T09:59:53.048 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-10T09:59:53.049 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T09:59:53.049 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T09:59:53.085 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4d54e0f8-6f5b-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-10T09:59:53.085 DEBUG:teuthology.orchestra.run.smithi050:mon.a> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T09:59:53.129 DEBUG:teuthology.orchestra.run.smithi050:mgr.x> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T09:59:53.174 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T09:59:53.174 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b -v bootstrap --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.50 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T09:59:53.438 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:59:53.438 INFO:teuthology.orchestra.run.smithi050.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b', '-v', 'bootstrap', '--fsid', '4d54e0f8-6f5b-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.50', '--skip-admin-label'] 2024-09-10T09:59:53.438 INFO:teuthology.orchestra.run.smithi050.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T09:59:53.439 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying podman|docker is present... 2024-09-10T09:59:53.482 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stdout 5.2.2 2024-09-10T09:59:53.483 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying lvm2 is present... 2024-09-10T09:59:53.483 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying time synchronization is in place... 2024-09-10T09:59:53.497 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T09:59:53.497 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T09:59:53.509 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T09:59:53.509 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-09-10T09:59:53.523 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout enabled 2024-09-10T09:59:53.535 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout active 2024-09-10T09:59:53.535 INFO:teuthology.orchestra.run.smithi050.stdout:Unit chronyd.service is enabled and running 2024-09-10T09:59:53.535 INFO:teuthology.orchestra.run.smithi050.stdout:Repeating the final host check... 2024-09-10T09:59:53.580 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stdout 5.2.2 2024-09-10T09:59:53.580 INFO:teuthology.orchestra.run.smithi050.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T09:59:53.580 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl is present 2024-09-10T09:59:53.580 INFO:teuthology.orchestra.run.smithi050.stdout:lvcreate is present 2024-09-10T09:59:53.593 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T09:59:53.593 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T09:59:53.605 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T09:59:53.605 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-09-10T09:59:53.620 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout enabled 2024-09-10T09:59:53.631 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout active 2024-09-10T09:59:53.632 INFO:teuthology.orchestra.run.smithi050.stdout:Unit chronyd.service is enabled and running 2024-09-10T09:59:53.632 INFO:teuthology.orchestra.run.smithi050.stdout:Host looks OK 2024-09-10T09:59:53.632 INFO:teuthology.orchestra.run.smithi050.stdout:Cluster fsid: 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T09:59:53.632 INFO:teuthology.orchestra.run.smithi050.stdout:Acquiring lock 140367535350784 on /run/cephadm/4d54e0f8-6f5b-11ef-bcea-c7b262605968.lock 2024-09-10T09:59:53.632 INFO:teuthology.orchestra.run.smithi050.stdout:Lock 140367535350784 acquired on /run/cephadm/4d54e0f8-6f5b-11ef-bcea-c7b262605968.lock 2024-09-10T09:59:53.633 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying IP 172.21.15.50 port 3300 ... 2024-09-10T09:59:53.633 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying IP 172.21.15.50 port 6789 ... 2024-09-10T09:59:53.633 INFO:teuthology.orchestra.run.smithi050.stdout:Base mon IP(s) is [172.21.15.50:3300, 172.21.15.50:6789], mon addrv is [v2:172.21.15.50:3300,v1:172.21.15.50:6789] 2024-09-10T09:59:53.639 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.50 metric 100 2024-09-10T09:59:53.639 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.50 metric 100 2024-09-10T09:59:53.645 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T09:59:53.646 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T09:59:53.646 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1789sec hoplimit 64 pref medium 2024-09-10T09:59:53.651 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T09:59:53.651 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T09:59:53.651 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T09:59:53.652 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T09:59:53.652 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-10T09:59:53.652 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T09:59:53.652 INFO:teuthology.orchestra.run.smithi050.stdout:Mon IP `172.21.15.50` is in CIDR network `172.21.0.0/20` 2024-09-10T09:59:53.653 INFO:teuthology.orchestra.run.smithi050.stdout:Mon IP `172.21.15.50` is in CIDR network `172.21.0.0/20` 2024-09-10T09:59:53.653 INFO:teuthology.orchestra.run.smithi050.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T09:59:53.653 INFO:teuthology.orchestra.run.smithi050.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T09:59:53.654 INFO:teuthology.orchestra.run.smithi050.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T09:59:55.773 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stdout 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 2024-09-10T09:59:55.774 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T09:59:55.774 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T09:59:55.774 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T09:59:55.774 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Copying blob sha256:3965ca83761b6e221cd35b61f2ebac0e3b1f9d68a1ce39c1ada69153a1d73116 2024-09-10T09:59:55.774 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Copying config sha256:41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 2024-09-10T09:59:55.774 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T09:59:56.775 INFO:teuthology.orchestra.run.smithi050.stdout:ceph: stdout ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable) 2024-09-10T09:59:56.775 INFO:teuthology.orchestra.run.smithi050.stdout:Ceph version: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable) 2024-09-10T09:59:56.775 INFO:teuthology.orchestra.run.smithi050.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T09:59:57.755 INFO:teuthology.orchestra.run.smithi050.stdout:stat: stdout 167 167 2024-09-10T09:59:57.755 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial keys... 2024-09-10T09:59:59.169 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQCeGOBmk6++CBAA2me1JRB4KzW/KO+j+zQ8yQ== 2024-09-10T10:00:00.171 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQCfGOBmDDbhIRAAKWFZ4M5Ri1VmhXUv2jZZ2Q== 2024-09-10T10:00:01.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQCgGOBmUnXiIBAAjrsy0srhncfOe5z1DDoA1w== 2024-09-10T10:00:01.200 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial monmap... 2024-09-10T10:00:02.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T10:00:02.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T10:00:02.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:00:02.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T10:00:02.522 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool for a [v2:172.21.15.50:3300,v1:172.21.15.50:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T10:00:02.522 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = quincy 2024-09-10T10:00:02.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: set fsid to 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:00:02.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T10:00:02.522 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:00:02.522 INFO:teuthology.orchestra.run.smithi050.stdout:Creating mon... 2024-09-10T10:00:03.520 INFO:teuthology.orchestra.run.smithi050.stdout:create mon.a on 2024-09-10T10:00:03.871 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T10:00:04.094 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T10:00:04.359 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968.target. 2024-09-10T10:00:04.359 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968.target. 2024-09-10T10:00:04.669 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.a 2024-09-10T10:00:04.669 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T10:00:04.936 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968.target.wants/ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@.service. 2024-09-10T10:00:05.537 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:05 smithi050 podman[29963]: 2024-09-10 10:00:05.315886043 +0000 UTC m=+0.136043425 container create 9b9bf89c7a51b075318b35b49f6a7a4092110297bbc14785fc1d12c2bbf53408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T10:00:05.537 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:05 smithi050 podman[29963]: 2024-09-10 10:00:05.535224436 +0000 UTC m=+0.355381843 container init 9b9bf89c7a51b075318b35b49f6a7a4092110297bbc14785fc1d12c2bbf53408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:00:05.704 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T10:00:05.704 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2024-09-10T10:00:05.717 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T10:00:05.717 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-09-10T10:00:05.718 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2024-09-10T10:00:05.718 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T10:00:05.718 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mon to start... 2024-09-10T10:00:05.718 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mon... 2024-09-10T10:00:05.859 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:05 smithi050 podman[29963]: 2024-09-10 10:00:05.541616055 +0000 UTC m=+0.361773439 container start 9b9bf89c7a51b075318b35b49f6a7a4092110297bbc14785fc1d12c2bbf53408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-10T10:00:05.859 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:05 smithi050 ceph-mon[29981]: mkfs 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:00:05.859 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:05 smithi050 ceph-mon[29981]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T10:00:05.859 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:05 smithi050 bash[29963]: 9b9bf89c7a51b075318b35b49f6a7a4092110297bbc14785fc1d12c2bbf53408 2024-09-10T10:00:05.860 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:05 smithi050 systemd[1]: Started Ceph mon.a for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:00:06.943 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:06 smithi050 ceph-mon[29981]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T10:00:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:06 smithi050 ceph-mon[29981]: monmap epoch 1 2024-09-10T10:00:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:06 smithi050 ceph-mon[29981]: fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:00:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:06 smithi050 ceph-mon[29981]: last_changed 2024-09-10T10:00:01.957230+0000 2024-09-10T10:00:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:06 smithi050 ceph-mon[29981]: created 2024-09-10T10:00:01.957230+0000 2024-09-10T10:00:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:06 smithi050 ceph-mon[29981]: min_mon_release 19 (squid) 2024-09-10T10:00:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:06 smithi050 ceph-mon[29981]: election_strategy: 1 2024-09-10T10:00:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:06 smithi050 ceph-mon[29981]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-10T10:00:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:06 smithi050 ceph-mon[29981]: fsmap 2024-09-10T10:00:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:06 smithi050 ceph-mon[29981]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T10:00:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:06 smithi050 ceph-mon[29981]: mgrmap e1: no daemons active 2024-09-10T10:00:06.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:06 smithi050 ceph-mon[29981]: from='client.? 172.21.15.50:0/1342034889' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-10T10:00:07.198 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T10:00:07.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout id: 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:00:07.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T10:00:07.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-09-10T10:00:07.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout services: 2024-09-10T10:00:07.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.689334s) 2024-09-10T10:00:07.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T10:00:07.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T10:00:07.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-09-10T10:00:07.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout data: 2024-09-10T10:00:07.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T10:00:07.199 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T10:00:07.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T10:00:07.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T10:00:07.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-09-10T10:00:07.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.207+0000 7f5d06600640 1 Processor -- start 2024-09-10T10:00:07.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.207+0000 7f5d06600640 1 -- start start 2024-09-10T10:00:07.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.207+0000 7f5d06600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 0x7f5d00109d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:07.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.207+0000 7f5d06600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0010a310 con 0x7f5d00109920 2024-09-10T10:00:07.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.208+0000 7f5cff400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 0x7f5d00109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:07.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.209+0000 7f5cff400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 0x7f5d00109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42556/0 (socket says 172.21.15.50:42556) 2024-09-10T10:00:07.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.209+0000 7f5cff400640 1 -- 172.21.15.50:0/495428770 learned_addr learned my addr 172.21.15.50:0/495428770 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:07.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.209+0000 7f5cff400640 1 -- 172.21.15.50:0/495428770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0010aa10 con 0x7f5d00109920 2024-09-10T10:00:07.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.212+0000 7f5cff400640 1 --2- 172.21.15.50:0/495428770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 0x7f5d00109d40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009820 tx=0x7f5cf002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1db49fb40422af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:07.200 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.212+0000 7f5cfe000640 1 -- 172.21.15.50:0/495428770 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf0037070 con 0x7f5d00109920 2024-09-10T10:00:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.212+0000 7f5cfe000640 1 -- 172.21.15.50:0/495428770 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf0032440 con 0x7f5d00109920 2024-09-10T10:00:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.212+0000 7f5cfe000640 1 -- 172.21.15.50:0/495428770 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf0032740 con 0x7f5d00109920 2024-09-10T10:00:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.213+0000 7f5d06600640 1 -- 172.21.15.50:0/495428770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 msgr2=0x7f5d00109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.213+0000 7f5d06600640 1 --2- 172.21.15.50:0/495428770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 0x7f5d00109d40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009820 tx=0x7f5cf002a270 comp rx=0 tx=0).stop 2024-09-10T10:00:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.213+0000 7f5d06600640 1 -- 172.21.15.50:0/495428770 shutdown_connections 2024-09-10T10:00:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.213+0000 7f5d06600640 1 --2- 172.21.15.50:0/495428770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 0x7f5d00109d40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.213+0000 7f5d06600640 1 -- 172.21.15.50:0/495428770 >> 172.21.15.50:0/495428770 conn(0x7f5d0007cf40 msgr2=0x7f5d0007d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.213+0000 7f5d06600640 1 -- 172.21.15.50:0/495428770 shutdown_connections 2024-09-10T10:00:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.213+0000 7f5d06600640 1 -- 172.21.15.50:0/495428770 wait complete. 2024-09-10T10:00:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.214+0000 7f5d06600640 1 Processor -- start 2024-09-10T10:00:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.214+0000 7f5d06600640 1 -- start start 2024-09-10T10:00:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.214+0000 7f5d06600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 0x7f5d0019cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:07.201 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.214+0000 7f5d06600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0010aee0 con 0x7f5d00109920 2024-09-10T10:00:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.215+0000 7f5cff400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 0x7f5d0019cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.215+0000 7f5cff400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 0x7f5d0019cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42566/0 (socket says 172.21.15.50:42566) 2024-09-10T10:00:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.215+0000 7f5cff400640 1 -- 172.21.15.50:0/1342034889 learned_addr learned my addr 172.21.15.50:0/1342034889 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.215+0000 7f5cff400640 1 -- 172.21.15.50:0/1342034889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0019d510 con 0x7f5d00109920 2024-09-10T10:00:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.215+0000 7f5cff400640 1 --2- 172.21.15.50:0/1342034889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 0x7f5d0019cfd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00090b0 tx=0x7f5cf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.215+0000 7f5cf7e00640 1 -- 172.21.15.50:0/1342034889 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf0041070 con 0x7f5d00109920 2024-09-10T10:00:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.216+0000 7f5cf7e00640 1 -- 172.21.15.50:0/1342034889 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf003c7a0 con 0x7f5d00109920 2024-09-10T10:00:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.216+0000 7f5cf7e00640 1 -- 172.21.15.50:0/1342034889 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf0037040 con 0x7f5d00109920 2024-09-10T10:00:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.216+0000 7f5d06600640 1 -- 172.21.15.50:0/1342034889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0019d7a0 con 0x7f5d00109920 2024-09-10T10:00:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.216+0000 7f5d06600640 1 -- 172.21.15.50:0/1342034889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d001a0490 con 0x7f5d00109920 2024-09-10T10:00:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.216+0000 7f5cf7e00640 1 -- 172.21.15.50:0/1342034889 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5cf0044070 con 0x7f5d00109920 2024-09-10T10:00:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.216+0000 7f5cf7e00640 1 -- 172.21.15.50:0/1342034889 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5cf003d3f0 con 0x7f5d00109920 2024-09-10T10:00:07.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.217+0000 7f5d06600640 1 -- 172.21.15.50:0/1342034889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d0010b580 con 0x7f5d00109920 2024-09-10T10:00:07.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.220+0000 7f5cf7e00640 1 -- 172.21.15.50:0/1342034889 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5cf0046450 con 0x7f5d00109920 2024-09-10T10:00:07.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.287+0000 7f5d06600640 1 -- 172.21.15.50:0/1342034889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f5d001a09f0 con 0x7f5d00109920 2024-09-10T10:00:07.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.287+0000 7f5cf7e00640 1 -- 172.21.15.50:0/1342034889 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f5cf0046630 con 0x7f5d00109920 2024-09-10T10:00:07.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.288+0000 7f5d06600640 1 -- 172.21.15.50:0/1342034889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 msgr2=0x7f5d0019cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:07.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.288+0000 7f5d06600640 1 --2- 172.21.15.50:0/1342034889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 0x7f5d0019cfd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00090b0 tx=0x7f5cf00046c0 comp rx=0 tx=0).stop 2024-09-10T10:00:07.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.288+0000 7f5d06600640 1 -- 172.21.15.50:0/1342034889 shutdown_connections 2024-09-10T10:00:07.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.288+0000 7f5d06600640 1 --2- 172.21.15.50:0/1342034889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d00109920 0x7f5d0019cfd0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:07.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.288+0000 7f5d06600640 1 -- 172.21.15.50:0/1342034889 >> 172.21.15.50:0/1342034889 conn(0x7f5d0007cf40 msgr2=0x7f5d001912c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:07.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.288+0000 7f5d06600640 1 -- 172.21.15.50:0/1342034889 shutdown_connections 2024-09-10T10:00:07.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:06.288+0000 7f5d06600640 1 -- 172.21.15.50:0/1342034889 wait complete. 2024-09-10T10:00:07.203 INFO:teuthology.orchestra.run.smithi050.stdout:mon is available 2024-09-10T10:00:07.203 INFO:teuthology.orchestra.run.smithi050.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T10:00:08.113 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:07 smithi050 ceph-mon[29981]: from='client.? 172.21.15.50:0/4166345185' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T10:00:08.114 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:07 smithi050 ceph-mon[29981]: from='client.? 172.21.15.50:0/4166345185' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T10:00:08.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-09-10T10:00:08.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T10:00:08.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout fsid = 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:00:08.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.50:3300,v1:172.21.15.50:6789] 2024-09-10T10:00:08.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T10:00:08.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T10:00:08.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T10:00:08.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T10:00:08.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-09-10T10:00:08.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T10:00:08.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T10:00:08.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-09-10T10:00:08.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T10:00:08.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T10:00:08.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T10:00:08.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T10:00:08.464 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T10:00:08.464 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T10:00:08.464 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.711+0000 7fc2c5600640 1 Processor -- start 2024-09-10T10:00:08.464 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.711+0000 7fc2c5600640 1 -- start start 2024-09-10T10:00:08.464 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.712+0000 7fc2c5600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 0x7fc2c0107a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:08.465 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.712+0000 7fc2c5600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c0107fc0 con 0x7fc2c0107680 2024-09-10T10:00:08.465 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.712+0000 7fc2bea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 0x7fc2c0107a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:08.465 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.712+0000 7fc2bea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 0x7fc2c0107a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38226/0 (socket says 172.21.15.50:38226) 2024-09-10T10:00:08.465 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.712+0000 7fc2bea00640 1 -- 172.21.15.50:0/3743836973 learned_addr learned my addr 172.21.15.50:0/3743836973 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:08.465 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.712+0000 7fc2bea00640 1 -- 172.21.15.50:0/3743836973 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c0108140 con 0x7fc2c0107680 2024-09-10T10:00:08.466 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.713+0000 7fc2bea00640 1 --2- 172.21.15.50:0/3743836973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 0x7fc2c0107a80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009820 tx=0x7fc2b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3840697d3a5032 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:08.466 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.714+0000 7fc2be000640 1 -- 172.21.15.50:0/3743836973 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b0037070 con 0x7fc2c0107680 2024-09-10T10:00:08.466 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.714+0000 7fc2be000640 1 -- 172.21.15.50:0/3743836973 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b0032440 con 0x7fc2c0107680 2024-09-10T10:00:08.466 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.714+0000 7fc2be000640 1 -- 172.21.15.50:0/3743836973 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b0032740 con 0x7fc2c0107680 2024-09-10T10:00:08.466 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.714+0000 7fc2c5600640 1 -- 172.21.15.50:0/3743836973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 msgr2=0x7fc2c0107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:08.467 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.714+0000 7fc2c5600640 1 --2- 172.21.15.50:0/3743836973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 0x7fc2c0107a80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009820 tx=0x7fc2b002a270 comp rx=0 tx=0).stop 2024-09-10T10:00:08.467 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.715+0000 7fc2c5600640 1 -- 172.21.15.50:0/3743836973 shutdown_connections 2024-09-10T10:00:08.467 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.715+0000 7fc2c5600640 1 --2- 172.21.15.50:0/3743836973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 0x7fc2c0107a80 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:08.467 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.715+0000 7fc2c5600640 1 -- 172.21.15.50:0/3743836973 >> 172.21.15.50:0/3743836973 conn(0x7fc2c0102eb0 msgr2=0x7fc2c01052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:08.467 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.715+0000 7fc2c5600640 1 -- 172.21.15.50:0/3743836973 shutdown_connections 2024-09-10T10:00:08.467 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.715+0000 7fc2c5600640 1 -- 172.21.15.50:0/3743836973 wait complete. 2024-09-10T10:00:08.468 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.716+0000 7fc2c5600640 1 Processor -- start 2024-09-10T10:00:08.468 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.716+0000 7fc2c5600640 1 -- start start 2024-09-10T10:00:08.468 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.716+0000 7fc2c5600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 0x7fc2c019d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:08.468 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.716+0000 7fc2c5600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c0108ba0 con 0x7fc2c0107680 2024-09-10T10:00:08.468 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.716+0000 7fc2bea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 0x7fc2c019d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:08.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.716+0000 7fc2bea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 0x7fc2c019d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38232/0 (socket says 172.21.15.50:38232) 2024-09-10T10:00:08.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.716+0000 7fc2bea00640 1 -- 172.21.15.50:0/4166345185 learned_addr learned my addr 172.21.15.50:0/4166345185 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:08.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.717+0000 7fc2bea00640 1 -- 172.21.15.50:0/4166345185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c019d590 con 0x7fc2c0107680 2024-09-10T10:00:08.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.717+0000 7fc2bea00640 1 --2- 172.21.15.50:0/4166345185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 0x7fc2c019d050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00090b0 tx=0x7fc2b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:08.469 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.717+0000 7fc2b7e00640 1 -- 172.21.15.50:0/4166345185 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b0041070 con 0x7fc2c0107680 2024-09-10T10:00:08.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.717+0000 7fc2b7e00640 1 -- 172.21.15.50:0/4166345185 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b003c7a0 con 0x7fc2c0107680 2024-09-10T10:00:08.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.717+0000 7fc2b7e00640 1 -- 172.21.15.50:0/4166345185 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b0037040 con 0x7fc2c0107680 2024-09-10T10:00:08.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.717+0000 7fc2c5600640 1 -- 172.21.15.50:0/4166345185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c019d820 con 0x7fc2c0107680 2024-09-10T10:00:08.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.718+0000 7fc2c5600640 1 -- 172.21.15.50:0/4166345185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c01a0510 con 0x7fc2c0107680 2024-09-10T10:00:08.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.718+0000 7fc2b7e00640 1 -- 172.21.15.50:0/4166345185 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc2b0044070 con 0x7fc2c0107680 2024-09-10T10:00:08.470 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.718+0000 7fc2b7e00640 1 -- 172.21.15.50:0/4166345185 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc2b003d3f0 con 0x7fc2c0107680 2024-09-10T10:00:08.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.719+0000 7fc2c5600640 1 -- 172.21.15.50:0/4166345185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2c0107b00 con 0x7fc2c0107680 2024-09-10T10:00:08.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.721+0000 7fc2b7e00640 1 -- 172.21.15.50:0/4166345185 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc2b0046450 con 0x7fc2c0107680 2024-09-10T10:00:08.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.784+0000 7fc2c5600640 1 -- 172.21.15.50:0/4166345185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fc2c01a1be0 con 0x7fc2c0107680 2024-09-10T10:00:08.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.788+0000 7fc2b7e00640 1 -- 172.21.15.50:0/4166345185 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7fc2b0046630 con 0x7fc2c0107680 2024-09-10T10:00:08.471 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.789+0000 7fc2b7e00640 1 -- 172.21.15.50:0/4166345185 <== mon.0 v2:172.21.15.50:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2b00584b0 con 0x7fc2c0107680 2024-09-10T10:00:08.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.790+0000 7fc2c5600640 1 -- 172.21.15.50:0/4166345185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 msgr2=0x7fc2c019d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:08.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.790+0000 7fc2c5600640 1 --2- 172.21.15.50:0/4166345185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 0x7fc2c019d050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00090b0 tx=0x7fc2b00046c0 comp rx=0 tx=0).stop 2024-09-10T10:00:08.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.790+0000 7fc2c5600640 1 -- 172.21.15.50:0/4166345185 shutdown_connections 2024-09-10T10:00:08.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.790+0000 7fc2c5600640 1 --2- 172.21.15.50:0/4166345185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c0107680 0x7fc2c019d050 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:08.472 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.790+0000 7fc2c5600640 1 -- 172.21.15.50:0/4166345185 >> 172.21.15.50:0/4166345185 conn(0x7fc2c0102eb0 msgr2=0x7fc2c007d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:08.473 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.790+0000 7fc2c5600640 1 -- 172.21.15.50:0/4166345185 shutdown_connections 2024-09-10T10:00:08.473 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:07.790+0000 7fc2c5600640 1 -- 172.21.15.50:0/4166345185 wait complete. 2024-09-10T10:00:08.473 INFO:teuthology.orchestra.run.smithi050.stdout:Generating new minimal ceph.conf... 2024-09-10T10:00:09.353 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:09 smithi050 ceph-mon[29981]: from='client.? 172.21.15.50:0/1258333939' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:00:09.600 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.942+0000 7f428be00640 1 Processor -- start 2024-09-10T10:00:09.600 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.943+0000 7f428be00640 1 -- start start 2024-09-10T10:00:09.600 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.943+0000 7f428be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 0x7f428c07c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:09.600 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.943+0000 7f428be00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f428c07c910 con 0x7f428c07dee0 2024-09-10T10:00:09.600 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.943+0000 7f428aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 0x7f428c07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:09.600 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.943+0000 7f428aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 0x7f428c07c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38242/0 (socket says 172.21.15.50:38242) 2024-09-10T10:00:09.600 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.943+0000 7f428aa00640 1 -- 172.21.15.50:0/1525631722 learned_addr learned my addr 172.21.15.50:0/1525631722 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:09.600 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.944+0000 7f428aa00640 1 -- 172.21.15.50:0/1525631722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c07ca90 con 0x7f428c07dee0 2024-09-10T10:00:09.600 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.945+0000 7f428aa00640 1 --2- 172.21.15.50:0/1525631722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 0x7f428c07c340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f427c009820 tx=0x7f427c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5dfcd3d58f674f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:09.601 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.945+0000 7f428a000640 1 -- 172.21.15.50:0/1525631722 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427c037070 con 0x7f428c07dee0 2024-09-10T10:00:09.601 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.945+0000 7f428a000640 1 -- 172.21.15.50:0/1525631722 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f427c032900 con 0x7f428c07dee0 2024-09-10T10:00:09.601 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.945+0000 7f428a000640 1 -- 172.21.15.50:0/1525631722 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427c030850 con 0x7f428c07dee0 2024-09-10T10:00:09.601 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.945+0000 7f428be00640 1 -- 172.21.15.50:0/1525631722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 msgr2=0x7f428c07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:09.601 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.945+0000 7f428be00640 1 --2- 172.21.15.50:0/1525631722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 0x7f428c07c340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f427c009820 tx=0x7f427c02a270 comp rx=0 tx=0).stop 2024-09-10T10:00:09.601 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.946+0000 7f428be00640 1 -- 172.21.15.50:0/1525631722 shutdown_connections 2024-09-10T10:00:09.601 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.946+0000 7f428be00640 1 --2- 172.21.15.50:0/1525631722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 0x7f428c07c340 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:09.601 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.946+0000 7f428be00640 1 -- 172.21.15.50:0/1525631722 >> 172.21.15.50:0/1525631722 conn(0x7f428c102c10 msgr2=0x7f428c105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:09.601 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.946+0000 7f428be00640 1 -- 172.21.15.50:0/1525631722 shutdown_connections 2024-09-10T10:00:09.601 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.946+0000 7f428be00640 1 -- 172.21.15.50:0/1525631722 wait complete. 2024-09-10T10:00:09.601 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.947+0000 7f428be00640 1 Processor -- start 2024-09-10T10:00:09.601 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.947+0000 7f428be00640 1 -- start start 2024-09-10T10:00:09.601 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.947+0000 7f428be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 0x7f428c1a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:09.602 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.947+0000 7f428be00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f428c109660 con 0x7f428c07dee0 2024-09-10T10:00:09.602 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.947+0000 7f428aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 0x7f428c1a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:09.602 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.947+0000 7f428aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 0x7f428c1a1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38258/0 (socket says 172.21.15.50:38258) 2024-09-10T10:00:09.602 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.947+0000 7f428aa00640 1 -- 172.21.15.50:0/1258333939 learned_addr learned my addr 172.21.15.50:0/1258333939 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:09.602 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.948+0000 7f428aa00640 1 -- 172.21.15.50:0/1258333939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c1a2010 con 0x7f428c07dee0 2024-09-10T10:00:09.602 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.948+0000 7f428aa00640 1 --2- 172.21.15.50:0/1258333939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 0x7f428c1a1ad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f427c0097f0 tx=0x7f427c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:09.602 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.948+0000 7f4283e00640 1 -- 172.21.15.50:0/1258333939 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427c042070 con 0x7f428c07dee0 2024-09-10T10:00:09.602 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.948+0000 7f4283e00640 1 -- 172.21.15.50:0/1258333939 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f427c032ca0 con 0x7f428c07dee0 2024-09-10T10:00:09.602 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.948+0000 7f428be00640 1 -- 172.21.15.50:0/1258333939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f428c1a22a0 con 0x7f428c07dee0 2024-09-10T10:00:09.602 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.948+0000 7f4283e00640 1 -- 172.21.15.50:0/1258333939 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427c037040 con 0x7f428c07dee0 2024-09-10T10:00:09.602 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.949+0000 7f428be00640 1 -- 172.21.15.50:0/1258333939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f428c1a4f90 con 0x7f428c07dee0 2024-09-10T10:00:09.602 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.949+0000 7f4283e00640 1 -- 172.21.15.50:0/1258333939 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f427c045070 con 0x7f428c07dee0 2024-09-10T10:00:09.603 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.949+0000 7f4283e00640 1 -- 172.21.15.50:0/1258333939 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f427c047a30 con 0x7f428c07dee0 2024-09-10T10:00:09.603 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.950+0000 7f428be00640 1 -- 172.21.15.50:0/1258333939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f428c07c3c0 con 0x7f428c07dee0 2024-09-10T10:00:09.603 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:08.952+0000 7f4283e00640 1 -- 172.21.15.50:0/1258333939 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f427c03da60 con 0x7f428c07dee0 2024-09-10T10:00:09.603 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:09.015+0000 7f428be00640 1 -- 172.21.15.50:0/1258333939 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f428c02d950 con 0x7f428c07dee0 2024-09-10T10:00:09.603 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:09.016+0000 7f4283e00640 1 -- 172.21.15.50:0/1258333939 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f427c03d430 con 0x7f428c07dee0 2024-09-10T10:00:09.603 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:09.017+0000 7f428be00640 1 -- 172.21.15.50:0/1258333939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 msgr2=0x7f428c1a1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:09.603 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:09.017+0000 7f428be00640 1 --2- 172.21.15.50:0/1258333939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 0x7f428c1a1ad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f427c0097f0 tx=0x7f427c030ec0 comp rx=0 tx=0).stop 2024-09-10T10:00:09.603 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:09.017+0000 7f428be00640 1 -- 172.21.15.50:0/1258333939 shutdown_connections 2024-09-10T10:00:09.603 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:09.017+0000 7f428be00640 1 --2- 172.21.15.50:0/1258333939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f428c07dee0 0x7f428c1a1ad0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:09.603 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:09.017+0000 7f428be00640 1 -- 172.21.15.50:0/1258333939 >> 172.21.15.50:0/1258333939 conn(0x7f428c102c10 msgr2=0x7f428c198730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:09.603 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:09.017+0000 7f428be00640 1 -- 172.21.15.50:0/1258333939 shutdown_connections 2024-09-10T10:00:09.603 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:09.017+0000 7f428be00640 1 -- 172.21.15.50:0/1258333939 wait complete. 2024-09-10T10:00:09.603 INFO:teuthology.orchestra.run.smithi050.stdout:Restarting the monitor... 2024-09-10T10:00:09.963 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:09 smithi050 systemd[1]: Stopping Ceph mon.a for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:00:10.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:09 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a[29977]: 2024-09-10T10:00:09.961+0000 7fea65e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:00:10.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:09 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a[29977]: 2024-09-10T10:00:09.961+0000 7fea65e00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T10:00:10.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:09 smithi050 podman[30231]: 2024-09-10 10:00:09.972731509 +0000 UTC m=+0.128994040 container died 9b9bf89c7a51b075318b35b49f6a7a4092110297bbc14785fc1d12c2bbf53408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:00:10.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:10 smithi050 podman[30231]: 2024-09-10 10:00:10.36650604 +0000 UTC m=+0.522768567 container cleanup 9b9bf89c7a51b075318b35b49f6a7a4092110297bbc14785fc1d12c2bbf53408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T10:00:10.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:10 smithi050 bash[30231]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a 2024-09-10T10:00:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:10 smithi050 podman[30243]: 2024-09-10 10:00:10.634231442 +0000 UTC m=+0.648518225 container remove 9b9bf89c7a51b075318b35b49f6a7a4092110297bbc14785fc1d12c2bbf53408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T10:00:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:10 smithi050 systemd[1]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T10:00:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:10 smithi050 systemd[1]: Stopped Ceph mon.a for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:00:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:10 smithi050 systemd[1]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.a.service: Consumed 1.221s CPU time. 2024-09-10T10:00:10.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:10 smithi050 systemd[1]: Starting Ceph mon.a for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:00:11.370 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 podman[30335]: 2024-09-10 10:00:11.118419013 +0000 UTC m=+0.121365255 container create 53aa894ee78c996b89e57bb6396d6654328662315ca1f0e1e8a4fc0ef4e8578c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731) 2024-09-10T10:00:11.370 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 podman[30335]: 2024-09-10 10:00:11.024030584 +0000 UTC m=+0.026976848 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:00:11.370 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 podman[30335]: 2024-09-10 10:00:11.32889477 +0000 UTC m=+0.331841036 container init 53aa894ee78c996b89e57bb6396d6654328662315ca1f0e1e8a4fc0ef4e8578c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T10:00:11.370 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 podman[30335]: 2024-09-10 10:00:11.335345242 +0000 UTC m=+0.338291484 container start 53aa894ee78c996b89e57bb6396d6654328662315ca1f0e1e8a4fc0ef4e8578c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T10:00:11.430 INFO:teuthology.orchestra.run.smithi050.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T10:00:11.666 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T10:00:11.667 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable), process ceph-mon, pid 2 2024-09-10T10:00:11.667 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: pidfile_write: ignore empty --pid-file 2024-09-10T10:00:11.667 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: load: jerasure load: lrc 2024-09-10T10:00:11.667 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: RocksDB version: 7.9.2 2024-09-10T10:00:11.667 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Git sha 0 2024-09-10T10:00:11.667 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Compile date 2024-09-09 20:43:47 2024-09-10T10:00:11.667 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: DB SUMMARY 2024-09-10T10:00:11.667 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: DB Session ID: I7TVMGXSKJTQ9H6OZDT8 2024-09-10T10:00:11.667 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: CURRENT file: CURRENT 2024-09-10T10:00:11.667 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T10:00:11.667 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T10:00:11.667 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T10:00:11.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105390 ; 2024-09-10T10:00:11.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.error_if_exists: 0 2024-09-10T10:00:11.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.create_if_missing: 0 2024-09-10T10:00:11.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.paranoid_checks: 1 2024-09-10T10:00:11.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T10:00:11.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T10:00:11.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T10:00:11.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.env: 0x561bc057f940 2024-09-10T10:00:11.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T10:00:11.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.info_log: 0x561bf3e716a0 2024-09-10T10:00:11.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T10:00:11.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.statistics: (nil) 2024-09-10T10:00:11.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.use_fsync: 0 2024-09-10T10:00:11.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_log_file_size: 0 2024-09-10T10:00:11.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T10:00:11.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T10:00:11.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T10:00:11.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T10:00:11.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.allow_fallocate: 1 2024-09-10T10:00:11.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T10:00:11.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T10:00:11.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.use_direct_reads: 0 2024-09-10T10:00:11.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T10:00:11.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T10:00:11.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.db_log_dir: 2024-09-10T10:00:11.670 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.wal_dir: 2024-09-10T10:00:11.670 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T10:00:11.671 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T10:00:11.671 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T10:00:11.671 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T10:00:11.671 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T10:00:11.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T10:00:11.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T10:00:11.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T10:00:11.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.write_buffer_manager: 0x561bf3e80dc0 2024-09-10T10:00:11.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T10:00:11.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T10:00:11.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T10:00:11.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T10:00:11.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T10:00:11.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T10:00:11.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T10:00:11.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T10:00:11.672 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.unordered_write: 0 2024-09-10T10:00:11.673 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T10:00:11.673 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T10:00:11.673 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T10:00:11.673 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T10:00:11.673 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.row_cache: None 2024-09-10T10:00:11.673 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.wal_filter: None 2024-09-10T10:00:11.673 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T10:00:11.673 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T10:00:11.673 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.two_write_queues: 0 2024-09-10T10:00:11.673 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T10:00:11.673 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.wal_compression: 0 2024-09-10T10:00:11.673 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.atomic_flush: 0 2024-09-10T10:00:11.673 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T10:00:11.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T10:00:11.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T10:00:11.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.log_readahead_size: 0 2024-09-10T10:00:11.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T10:00:11.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T10:00:11.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T10:00:11.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T10:00:11.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T10:00:11.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T10:00:11.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T10:00:11.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_background_jobs: 2 2024-09-10T10:00:11.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_background_compactions: -1 2024-09-10T10:00:11.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_subcompactions: 1 2024-09-10T10:00:11.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T10:00:11.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T10:00:11.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T10:00:11.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T10:00:11.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T10:00:11.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T10:00:11.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T10:00:11.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T10:00:11.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_open_files: -1 2024-09-10T10:00:11.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T10:00:11.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T10:00:11.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T10:00:11.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_background_flushes: -1 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Compression algorithms supported: 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: kZSTD supported: 0 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: kXpressCompression supported: 0 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: kBZip2Compression supported: 0 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: kLZ4Compression supported: 1 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: kZlibCompression supported: 1 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: kSnappyCompression supported: 1 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T10:00:11.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.merge_operator: 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compaction_filter: None 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561bf3e71300) 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout: cache_index_and_filter_blocks: 1 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout: pin_top_level_index_and_filter: 1 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout: index_type: 0 2024-09-10T10:00:11.677 INFO:journalctl@ceph.mon.a.smithi050.stdout: data_block_index_type: 0 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: index_shortening: 1 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: checksum: 4 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: no_block_cache: 0 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache: 0x561bf3e651f0 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache_name: BinnedLRUCache 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache_options: 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: capacity : 536870912 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: num_shard_bits : 4 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: strict_capacity_limit : 0 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: high_pri_pool_ratio: 0.000 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache_compressed: (nil) 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: persistent_cache: (nil) 2024-09-10T10:00:11.678 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_size: 4096 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_size_deviation: 10 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_restart_interval: 16 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: index_block_restart_interval: 1 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: metadata_block_size: 4096 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: partition_filters: 0 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: use_delta_encoding: 1 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: filter_policy: bloomfilter 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: whole_key_filtering: 1 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: verify_compression: 0 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: read_amp_bytes_per_bit: 0 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: format_version: 5 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: enable_index_compression: 1 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_align: 0 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: max_auto_readahead_size: 262144 2024-09-10T10:00:11.679 INFO:journalctl@ceph.mon.a.smithi050.stdout: prepopulate_block_cache: 0 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout: initial_auto_readahead_size: 8192 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compression: NoCompression 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.num_levels: 7 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T10:00:11.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T10:00:11.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T10:00:11.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T10:00:11.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T10:00:11.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T10:00:11.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T10:00:11.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T10:00:11.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T10:00:11.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T10:00:11.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T10:00:11.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T10:00:11.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T10:00:11.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T10:00:11.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T10:00:11.682 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T10:00:11.682 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T10:00:11.682 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T10:00:11.682 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T10:00:11.682 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T10:00:11.682 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T10:00:11.682 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T10:00:11.682 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T10:00:11.682 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T10:00:11.682 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T10:00:11.682 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T10:00:11.682 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T10:00:11.682 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T10:00:11.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T10:00:11.684 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T10:00:11.684 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T10:00:11.684 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T10:00:11.684 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T10:00:11.684 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T10:00:11.684 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T10:00:11.684 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T10:00:11.684 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T10:00:11.684 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T10:00:11.684 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.inplace_update_support: 0 2024-09-10T10:00:11.684 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.bloom_locality: 0 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.max_successive_merges: 0 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.ttl: 2592000 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T10:00:11.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.enable_blob_files: false 2024-09-10T10:00:11.686 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.min_blob_size: 0 2024-09-10T10:00:11.686 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T10:00:11.686 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T10:00:11.686 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T10:00:11.686 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T10:00:11.686 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T10:00:11.686 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T10:00:11.686 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T10:00:11.686 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T10:00:11.686 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T10:00:11.686 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T10:00:11.686 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e2e8479a-d7bd-488b-b790-cfccbe6fc6ae 2024-09-10T10:00:11.687 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962411377669, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T10:00:11.687 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T10:00:11.687 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962411379176, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100463, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98347, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14312, "raw_average_key_size": 49, "raw_value_size": 90593, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725962411, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e2e8479a-d7bd-488b-b790-cfccbe6fc6ae", "db_session_id": "I7TVMGXSKJTQ9H6OZDT8", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T10:00:11.687 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962411379350, "job": 1, "event": "recovery_finished"} 2024-09-10T10:00:11.687 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T10:00:11.687 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T10:00:11.687 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561bf3e94e00 2024-09-10T10:00:11.687 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: DB pointer 0x561bf3f90000 2024-09-10T10:00:11.687 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T10:00:11.687 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T10:00:11.687 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** DB Stats ** 2024-09-10T10:00:11.687 INFO:journalctl@ceph.mon.a.smithi050.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T10:00:11.688 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T10:00:11.688 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T10:00:11.688 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T10:00:11.688 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T10:00:11.688 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T10:00:11.688 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T10:00:11.688 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-09-10T10:00:11.688 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** Compaction Stats [default] ** 2024-09-10T10:00:11.688 INFO:journalctl@ceph.mon.a.smithi050.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T10:00:11.688 INFO:journalctl@ceph.mon.a.smithi050.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T10:00:11.688 INFO:journalctl@ceph.mon.a.smithi050.stdout: L0 2/0 99.97 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 120.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T10:00:11.688 INFO:journalctl@ceph.mon.a.smithi050.stdout: Sum 2/0 99.97 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 120.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 120.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** Compaction Stats [default] ** 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 120.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T10:00:11.689 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative compaction: 0.00 GB write, 16.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval compaction: 0.00 GB write, 16.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout: Block cache BinnedLRUCache@0x561bf3e651f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: starting mon.a rank 0 at public addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] at bind addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: mon.a@-1(???) e1 preinit fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: mon.a@-1(???).mds e1 new map 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: mon.a@-1(???).mds e1 print_map 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout: e1 2024-09-10T10:00:11.690 INFO:journalctl@ceph.mon.a.smithi050.stdout: btime 2024-09-10T10:00:05:599805+0000 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout: legacy client fscid: -1 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout: No filesystems configured 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 bash[30335]: 53aa894ee78c996b89e57bb6396d6654328662315ca1f0e1e8a4fc0ef4e8578c 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 systemd[1]: Started Ceph mon.a for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T10:00:11.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: monmap epoch 1 2024-09-10T10:00:11.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:00:11.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: last_changed 2024-09-10T10:00:01.957230+0000 2024-09-10T10:00:11.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: created 2024-09-10T10:00:01.957230+0000 2024-09-10T10:00:11.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: min_mon_release 19 (squid) 2024-09-10T10:00:11.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: election_strategy: 1 2024-09-10T10:00:11.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-10T10:00:11.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: fsmap 2024-09-10T10:00:11.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T10:00:11.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:11 smithi050 ceph-mon[30354]: mgrmap e1: no daemons active 2024-09-10T10:00:12.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.894+0000 7fa137e00640 1 Processor -- start 2024-09-10T10:00:12.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.894+0000 7fa137e00640 1 -- start start 2024-09-10T10:00:12.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.894+0000 7fa137e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 0x7fa13007c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:12.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.894+0000 7fa137e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa13007c860 con 0x7fa13007ddb0 2024-09-10T10:00:12.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.895+0000 7fa135400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 0x7fa13007c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:12.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.895+0000 7fa135400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 0x7fa13007c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38260/0 (socket says 172.21.15.50:38260) 2024-09-10T10:00:12.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.895+0000 7fa135400640 1 -- 172.21.15.50:0/1324641555 learned_addr learned my addr 172.21.15.50:0/1324641555 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:12.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.895+0000 7fa135400640 1 -- 172.21.15.50:0/1324641555 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13007c9e0 con 0x7fa13007ddb0 2024-09-10T10:00:12.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.898+0000 7fa135400640 1 --2- 172.21.15.50:0/1324641555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 0x7fa13007c320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa124009820 tx=0x7fa12402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce356a2c70c8da5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:12.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.898+0000 7fa12fe00640 1 -- 172.21.15.50:0/1324641555 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa124037070 con 0x7fa13007ddb0 2024-09-10T10:00:12.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.898+0000 7fa12fe00640 1 -- 172.21.15.50:0/1324641555 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa124032900 con 0x7fa13007ddb0 2024-09-10T10:00:12.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.898+0000 7fa12fe00640 1 -- 172.21.15.50:0/1324641555 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa124030850 con 0x7fa13007ddb0 2024-09-10T10:00:12.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.899+0000 7fa137e00640 1 -- 172.21.15.50:0/1324641555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 msgr2=0x7fa13007c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:12.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.899+0000 7fa137e00640 1 --2- 172.21.15.50:0/1324641555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 0x7fa13007c320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa124009820 tx=0x7fa12402a270 comp rx=0 tx=0).stop 2024-09-10T10:00:12.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.899+0000 7fa137e00640 1 -- 172.21.15.50:0/1324641555 shutdown_connections 2024-09-10T10:00:12.523 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.899+0000 7fa137e00640 1 --2- 172.21.15.50:0/1324641555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 0x7fa13007c320 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:12.523 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.899+0000 7fa137e00640 1 -- 172.21.15.50:0/1324641555 >> 172.21.15.50:0/1324641555 conn(0x7fa130102eb0 msgr2=0x7fa1301052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:12.523 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.899+0000 7fa137e00640 1 -- 172.21.15.50:0/1324641555 shutdown_connections 2024-09-10T10:00:12.523 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.899+0000 7fa137e00640 1 -- 172.21.15.50:0/1324641555 wait complete. 2024-09-10T10:00:12.523 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.900+0000 7fa137e00640 1 Processor -- start 2024-09-10T10:00:12.523 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.900+0000 7fa137e00640 1 -- start start 2024-09-10T10:00:12.523 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.901+0000 7fa137e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 0x7fa13019d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:12.523 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.901+0000 7fa137e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa13010dbe0 con 0x7fa13007ddb0 2024-09-10T10:00:12.523 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.901+0000 7fa135400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 0x7fa13019d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:12.523 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.901+0000 7fa135400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 0x7fa13019d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38270/0 (socket says 172.21.15.50:38270) 2024-09-10T10:00:12.523 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.901+0000 7fa135400640 1 -- 172.21.15.50:0/1485820020 learned_addr learned my addr 172.21.15.50:0/1485820020 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:12.523 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.901+0000 7fa135400640 1 -- 172.21.15.50:0/1485820020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13019ddd0 con 0x7fa13007ddb0 2024-09-10T10:00:12.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.902+0000 7fa135400640 1 --2- 172.21.15.50:0/1485820020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 0x7fa13019d890 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa1240097f0 tx=0x7fa124030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:12.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.902+0000 7fa12e000640 1 -- 172.21.15.50:0/1485820020 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa124042070 con 0x7fa13007ddb0 2024-09-10T10:00:12.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.902+0000 7fa12e000640 1 -- 172.21.15.50:0/1485820020 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa124032ca0 con 0x7fa13007ddb0 2024-09-10T10:00:12.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.902+0000 7fa137e00640 1 -- 172.21.15.50:0/1485820020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13019e060 con 0x7fa13007ddb0 2024-09-10T10:00:12.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.902+0000 7fa12e000640 1 -- 172.21.15.50:0/1485820020 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa124037040 con 0x7fa13007ddb0 2024-09-10T10:00:12.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.902+0000 7fa137e00640 1 -- 172.21.15.50:0/1485820020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1301a0d50 con 0x7fa13007ddb0 2024-09-10T10:00:12.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.902+0000 7fa12e000640 1 -- 172.21.15.50:0/1485820020 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa124045070 con 0x7fa13007ddb0 2024-09-10T10:00:12.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.903+0000 7fa12e000640 1 -- 172.21.15.50:0/1485820020 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa124047af0 con 0x7fa13007ddb0 2024-09-10T10:00:12.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.903+0000 7fa137e00640 1 -- 172.21.15.50:0/1485820020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa13007c3a0 con 0x7fa13007ddb0 2024-09-10T10:00:12.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.906+0000 7fa12e000640 1 -- 172.21.15.50:0/1485820020 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa12403db10 con 0x7fa13007ddb0 2024-09-10T10:00:12.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.968+0000 7fa137e00640 1 -- 172.21.15.50:0/1485820020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fa1301a1330 con 0x7fa13007ddb0 2024-09-10T10:00:12.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.970+0000 7fa12e000640 1 -- 172.21.15.50:0/1485820020 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fa12403d430 con 0x7fa13007ddb0 2024-09-10T10:00:12.524 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.971+0000 7fa137e00640 1 -- 172.21.15.50:0/1485820020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 msgr2=0x7fa13019d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:12.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.971+0000 7fa137e00640 1 --2- 172.21.15.50:0/1485820020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 0x7fa13019d890 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa1240097f0 tx=0x7fa124030ec0 comp rx=0 tx=0).stop 2024-09-10T10:00:12.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.972+0000 7fa137e00640 1 -- 172.21.15.50:0/1485820020 shutdown_connections 2024-09-10T10:00:12.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.972+0000 7fa137e00640 1 --2- 172.21.15.50:0/1485820020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa13007ddb0 0x7fa13019d890 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:12.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.972+0000 7fa137e00640 1 -- 172.21.15.50:0/1485820020 >> 172.21.15.50:0/1485820020 conn(0x7fa130102eb0 msgr2=0x7fa130103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:12.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.972+0000 7fa137e00640 1 -- 172.21.15.50:0/1485820020 shutdown_connections 2024-09-10T10:00:12.525 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:11.972+0000 7fa137e00640 1 -- 172.21.15.50:0/1485820020 wait complete. 2024-09-10T10:00:12.525 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T10:00:12.544 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:00:12.544 INFO:teuthology.orchestra.run.smithi050.stdout:Creating mgr... 2024-09-10T10:00:12.544 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T10:00:12.545 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T10:00:12.899 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mgr.x 2024-09-10T10:00:12.899 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T10:00:13.142 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968.target.wants/ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@.service. 2024-09-10T10:00:13.168 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:12 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1485820020' entity='client.admin' 2024-09-10T10:00:13.465 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:13 smithi050 systemd[1]: Starting Ceph mgr.x for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:00:13.756 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:13 smithi050 podman[30561]: 2024-09-10 10:00:13.404035063 +0000 UTC m=+0.047846203 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:00:13.756 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:13 smithi050 podman[30561]: 2024-09-10 10:00:13.513020639 +0000 UTC m=+0.156831783 container create 5501499e73579c08624a146d68d79e2ee691701d68ad1196edbe0047bee048b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T10:00:13.756 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:13 smithi050 podman[30561]: 2024-09-10 10:00:13.748824681 +0000 UTC m=+0.392635839 container init 5501499e73579c08624a146d68d79e2ee691701d68ad1196edbe0047bee048b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:00:13.756 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:13 smithi050 podman[30561]: 2024-09-10 10:00:13.75496634 +0000 UTC m=+0.398777480 container start 5501499e73579c08624a146d68d79e2ee691701d68ad1196edbe0047bee048b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T10:00:13.842 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T10:00:13.842 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2024-09-10T10:00:13.857 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T10:00:13.857 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-09-10T10:00:13.857 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2024-09-10T10:00:13.857 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T10:00:13.875 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T10:00:13.875 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2024-09-10T10:00:13.889 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T10:00:13.889 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-09-10T10:00:13.889 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2024-09-10T10:00:13.889 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T10:00:13.889 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr to start... 2024-09-10T10:00:13.889 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr... 2024-09-10T10:00:14.009 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:13 smithi050 bash[30561]: 5501499e73579c08624a146d68d79e2ee691701d68ad1196edbe0047bee048b0 2024-09-10T10:00:14.009 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:13 smithi050 systemd[1]: Started Ceph mgr.x for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:00:14.009 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:13 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:13.936+0000 7fe638436040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:00:14.009 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:14 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:14.008+0000 7fe638436040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:00:14.296 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:14 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:14.211+0000 7fe638436040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:00:14.658 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:14 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2574272571' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T10:00:14.658 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:14 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:14.294+0000 7fe638436040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:00:14.658 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:14 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:14.482+0000 7fe638436040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:00:14.658 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:14 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:14.656+0000 7fe638436040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:00:15.191 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-09-10T10:00:15.192 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:00:15.192 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "4d54e0f8-6f5b-11ef-bcea-c7b262605968", 2024-09-10T10:00:15.192 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T10:00:15.192 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T10:00:15.192 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T10:00:15.192 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T10:00:15.192 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:15.192 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T10:00:15.192 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T10:00:15.192 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2024-09-10T10:00:15.192 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T10:00:15.193 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T10:00:15.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T10:00:15.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T10:00:15.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T10:00:15.202 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:15.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T10:00:15.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T10:00:15.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T10:00:15.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T10:00:15.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T10:00:15.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T10:00:15.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T10:00:15.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T10:00:15.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T10:00:15.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:15.203 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T10:00:15.204 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:00:15.204 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T10:00:05:599805+0000", 2024-09-10T10:00:15.204 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T10:00:15.204 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T10:00:15.204 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:15.204 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T10:00:15.204 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T10:00:15.204 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T10:00:15.204 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T10:00:15.204 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T10:00:15.204 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T10:00:15.204 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T10:00:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:00:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:00:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T10:00:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:00:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T10:00:05.600549+0000", 2024-09-10T10:00:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:00:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T10:00:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:00:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.412+0000 7f2f95c00640 1 Processor -- start 2024-09-10T10:00:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.412+0000 7f2f95c00640 1 -- start start 2024-09-10T10:00:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.412+0000 7f2f95c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 0x7f2f9007c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.412+0000 7f2f95c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9007c910 con 0x7f2f9007dee0 2024-09-10T10:00:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.413+0000 7f2f8fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 0x7f2f9007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.413+0000 7f2f8fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 0x7f2f9007c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38296/0 (socket says 172.21.15.50:38296) 2024-09-10T10:00:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.413+0000 7f2f8fe00640 1 -- 172.21.15.50:0/2333079617 learned_addr learned my addr 172.21.15.50:0/2333079617 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.413+0000 7f2f8fe00640 1 -- 172.21.15.50:0/2333079617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9007ca90 con 0x7f2f9007dee0 2024-09-10T10:00:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.414+0000 7f2f8fe00640 1 --2- 172.21.15.50:0/2333079617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 0x7f2f9007c340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009820 tx=0x7f2f8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec26496bdad7b93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.415+0000 7f2f8ea00640 1 -- 172.21.15.50:0/2333079617 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f80037070 con 0x7f2f9007dee0 2024-09-10T10:00:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.415+0000 7f2f8ea00640 1 -- 172.21.15.50:0/2333079617 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f80032900 con 0x7f2f9007dee0 2024-09-10T10:00:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.415+0000 7f2f8ea00640 1 -- 172.21.15.50:0/2333079617 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f80030850 con 0x7f2f9007dee0 2024-09-10T10:00:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.415+0000 7f2f95c00640 1 -- 172.21.15.50:0/2333079617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 msgr2=0x7f2f9007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.415+0000 7f2f95c00640 1 --2- 172.21.15.50:0/2333079617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 0x7f2f9007c340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009820 tx=0x7f2f8002a270 comp rx=0 tx=0).stop 2024-09-10T10:00:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.416+0000 7f2f95c00640 1 -- 172.21.15.50:0/2333079617 shutdown_connections 2024-09-10T10:00:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.416+0000 7f2f95c00640 1 --2- 172.21.15.50:0/2333079617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 0x7f2f9007c340 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:15.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.416+0000 7f2f95c00640 1 -- 172.21.15.50:0/2333079617 >> 172.21.15.50:0/2333079617 conn(0x7f2f90102c10 msgr2=0x7f2f90105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:15.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.416+0000 7f2f95c00640 1 -- 172.21.15.50:0/2333079617 shutdown_connections 2024-09-10T10:00:15.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.416+0000 7f2f95c00640 1 -- 172.21.15.50:0/2333079617 wait complete. 2024-09-10T10:00:15.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.417+0000 7f2f95c00640 1 Processor -- start 2024-09-10T10:00:15.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.417+0000 7f2f95c00640 1 -- start start 2024-09-10T10:00:15.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.418+0000 7f2f95c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 0x7f2f9019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:15.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.418+0000 7f2f95c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9010da70 con 0x7f2f9007dee0 2024-09-10T10:00:15.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.418+0000 7f2f8fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 0x7f2f9019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:15.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.418+0000 7f2f8fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 0x7f2f9019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38312/0 (socket says 172.21.15.50:38312) 2024-09-10T10:00:15.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.418+0000 7f2f8fe00640 1 -- 172.21.15.50:0/2574272571 learned_addr learned my addr 172.21.15.50:0/2574272571 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:15.207 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.418+0000 7f2f8fe00640 1 -- 172.21.15.50:0/2574272571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9019dc10 con 0x7f2f9007dee0 2024-09-10T10:00:15.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.419+0000 7f2f8fe00640 1 --2- 172.21.15.50:0/2574272571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 0x7f2f9019d6d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009940 tx=0x7f2f800326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:15.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.419+0000 7f2f8cc00640 1 -- 172.21.15.50:0/2574272571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f80042070 con 0x7f2f9007dee0 2024-09-10T10:00:15.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.419+0000 7f2f8cc00640 1 -- 172.21.15.50:0/2574272571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f80032be0 con 0x7f2f9007dee0 2024-09-10T10:00:15.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.419+0000 7f2f8cc00640 1 -- 172.21.15.50:0/2574272571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f80037040 con 0x7f2f9007dee0 2024-09-10T10:00:15.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.419+0000 7f2f95c00640 1 -- 172.21.15.50:0/2574272571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9019dea0 con 0x7f2f9007dee0 2024-09-10T10:00:15.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.419+0000 7f2f95c00640 1 -- 172.21.15.50:0/2574272571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f901a0b90 con 0x7f2f9007dee0 2024-09-10T10:00:15.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.420+0000 7f2f8cc00640 1 -- 172.21.15.50:0/2574272571 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2f80045070 con 0x7f2f9007dee0 2024-09-10T10:00:15.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.420+0000 7f2f8cc00640 1 -- 172.21.15.50:0/2574272571 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2f800463b0 con 0x7f2f9007dee0 2024-09-10T10:00:15.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.420+0000 7f2f95c00640 1 -- 172.21.15.50:0/2574272571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9007c3c0 con 0x7f2f9007dee0 2024-09-10T10:00:15.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.423+0000 7f2f8cc00640 1 -- 172.21.15.50:0/2574272571 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2f80032d90 con 0x7f2f9007dee0 2024-09-10T10:00:15.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.489+0000 7f2f95c00640 1 -- 172.21.15.50:0/2574272571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2f901a0d60 con 0x7f2f9007dee0 2024-09-10T10:00:15.208 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.489+0000 7f2f8cc00640 1 -- 172.21.15.50:0/2574272571 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f2f80047440 con 0x7f2f9007dee0 2024-09-10T10:00:15.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.490+0000 7f2f95c00640 1 -- 172.21.15.50:0/2574272571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 msgr2=0x7f2f9019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:15.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.490+0000 7f2f95c00640 1 --2- 172.21.15.50:0/2574272571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 0x7f2f9019d6d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009940 tx=0x7f2f800326e0 comp rx=0 tx=0).stop 2024-09-10T10:00:15.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.490+0000 7f2f95c00640 1 -- 172.21.15.50:0/2574272571 shutdown_connections 2024-09-10T10:00:15.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.490+0000 7f2f95c00640 1 --2- 172.21.15.50:0/2574272571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f9007dee0 0x7f2f9019d6d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:15.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.490+0000 7f2f95c00640 1 -- 172.21.15.50:0/2574272571 >> 172.21.15.50:0/2574272571 conn(0x7f2f90102c10 msgr2=0x7f2f901037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:15.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.490+0000 7f2f95c00640 1 -- 172.21.15.50:0/2574272571 shutdown_connections 2024-09-10T10:00:15.209 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:14.490+0000 7f2f95c00640 1 -- 172.21.15.50:0/2574272571 wait complete. 2024-09-10T10:00:15.209 INFO:teuthology.orchestra.run.smithi050.stdout:mgr not available, waiting (1/15)... 2024-09-10T10:00:15.351 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:15 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:15.054+0000 7fe638436040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:00:15.351 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:15 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:15.128+0000 7fe638436040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:00:15.351 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:15 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:15.349+0000 7fe638436040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:00:16.965 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:16 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:16.501+0000 7fe638436040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:00:16.965 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:16 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:16.584+0000 7fe638436040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:00:17.667 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:17 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:17.577+0000 7fe638436040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:00:17.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:17 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/352086113' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T10:00:17.965 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:17 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:17.722+0000 7fe638436040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:00:17.965 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:17 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:17.899+0000 7fe638436040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:00:18.240 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:17 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:17.974+0000 7fe638436040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:00:18.240 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:18.153+0000 7fe638436040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:00:18.240 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:18.238+0000 7fe638436040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:00:18.448 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-09-10T10:00:18.448 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:00:18.448 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "4d54e0f8-6f5b-11ef-bcea-c7b262605968", 2024-09-10T10:00:18.448 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T10:00:18.448 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T10:00:18.448 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T10:00:18.448 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T10:00:18.448 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:18.448 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T10:00:18.448 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T10:00:18.448 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2024-09-10T10:00:18.448 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:00:18.449 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T10:00:18.449 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T10:00:18.449 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:00:18.449 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-10T10:00:18.449 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T10:00:18.449 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:00:18.449 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T10:00:18.449 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T10:00:18.449 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:18.449 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T10:00:18.449 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:00:18.449 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T10:00:18.449 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T10:00:18.450 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T10:00:18.457 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T10:00:18.457 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T10:00:18.457 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T10:00:18.458 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:18.458 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T10:00:18.458 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T10:00:18.458 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T10:00:18.458 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T10:00:18.458 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T10:00:18.458 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T10:00:18.458 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T10:00:18.458 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T10:00:18.458 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T10:00:18.458 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:18.458 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T10:00:18.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:00:18.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T10:00:05:599805+0000", 2024-09-10T10:00:18.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T10:00:18.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T10:00:18.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:18.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T10:00:18.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T10:00:18.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T10:00:18.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T10:00:18.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T10:00:18.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T10:00:18.459 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T10:00:18.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:00:18.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:00:18.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:18.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T10:00:18.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:00:18.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T10:00:05.600549+0000", 2024-09-10T10:00:18.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:00:18.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:18.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T10:00:18.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:00:18.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.667+0000 7f7dc6400640 1 Processor -- start 2024-09-10T10:00:18.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.667+0000 7f7dc6400640 1 -- start start 2024-09-10T10:00:18.460 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.667+0000 7f7dc6400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 0x7f7dc007c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:18.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.667+0000 7f7dc6400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc007c880 con 0x7f7dc007de40 2024-09-10T10:00:18.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.667+0000 7f7dc5000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 0x7f7dc007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:18.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.667+0000 7f7dc5000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 0x7f7dc007c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49456/0 (socket says 172.21.15.50:49456) 2024-09-10T10:00:18.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.667+0000 7f7dc5000640 1 -- 172.21.15.50:0/431651668 learned_addr learned my addr 172.21.15.50:0/431651668 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:18.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.668+0000 7f7dc5000640 1 -- 172.21.15.50:0/431651668 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc007ca00 con 0x7f7dc007de40 2024-09-10T10:00:18.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.669+0000 7f7dc5000640 1 --2- 172.21.15.50:0/431651668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 0x7f7dc007c340 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009820 tx=0x7f7db402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd40fbcf95e08b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:18.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.669+0000 7f7dbf400640 1 -- 172.21.15.50:0/431651668 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db4037070 con 0x7f7dc007de40 2024-09-10T10:00:18.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.669+0000 7f7dbf400640 1 -- 172.21.15.50:0/431651668 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7db4032900 con 0x7f7dc007de40 2024-09-10T10:00:18.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.669+0000 7f7dbf400640 1 -- 172.21.15.50:0/431651668 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db4030850 con 0x7f7dc007de40 2024-09-10T10:00:18.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.670+0000 7f7dc6400640 1 -- 172.21.15.50:0/431651668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 msgr2=0x7f7dc007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:18.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.670+0000 7f7dc6400640 1 --2- 172.21.15.50:0/431651668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 0x7f7dc007c340 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009820 tx=0x7f7db402a270 comp rx=0 tx=0).stop 2024-09-10T10:00:18.461 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.670+0000 7f7dc6400640 1 -- 172.21.15.50:0/431651668 shutdown_connections 2024-09-10T10:00:18.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.670+0000 7f7dc6400640 1 --2- 172.21.15.50:0/431651668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 0x7f7dc007c340 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:18.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.670+0000 7f7dc6400640 1 -- 172.21.15.50:0/431651668 >> 172.21.15.50:0/431651668 conn(0x7f7dc0102d00 msgr2=0x7f7dc0105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:18.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.670+0000 7f7dc6400640 1 -- 172.21.15.50:0/431651668 shutdown_connections 2024-09-10T10:00:18.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.670+0000 7f7dc6400640 1 -- 172.21.15.50:0/431651668 wait complete. 2024-09-10T10:00:18.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.671+0000 7f7dc6400640 1 Processor -- start 2024-09-10T10:00:18.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.671+0000 7f7dc6400640 1 -- start start 2024-09-10T10:00:18.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.671+0000 7f7dc6400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 0x7f7dc01a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:18.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.671+0000 7f7dc6400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01096b0 con 0x7f7dc007de40 2024-09-10T10:00:18.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.672+0000 7f7dc5000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 0x7f7dc01a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:18.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.672+0000 7f7dc5000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 0x7f7dc01a1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49472/0 (socket says 172.21.15.50:49472) 2024-09-10T10:00:18.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.672+0000 7f7dc5000640 1 -- 172.21.15.50:0/352086113 learned_addr learned my addr 172.21.15.50:0/352086113 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:18.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.672+0000 7f7dc5000640 1 -- 172.21.15.50:0/352086113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc01a1fe0 con 0x7f7dc007de40 2024-09-10T10:00:18.462 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.672+0000 7f7dc5000640 1 --2- 172.21.15.50:0/352086113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 0x7f7dc01a1aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7db40097f0 tx=0x7f7db4030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:18.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.673+0000 7f7dbd600640 1 -- 172.21.15.50:0/352086113 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db4042070 con 0x7f7dc007de40 2024-09-10T10:00:18.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.673+0000 7f7dbd600640 1 -- 172.21.15.50:0/352086113 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7db4032ca0 con 0x7f7dc007de40 2024-09-10T10:00:18.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.673+0000 7f7dbd600640 1 -- 172.21.15.50:0/352086113 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db4037040 con 0x7f7dc007de40 2024-09-10T10:00:18.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.673+0000 7f7dc6400640 1 -- 172.21.15.50:0/352086113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc01a2270 con 0x7f7dc007de40 2024-09-10T10:00:18.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.673+0000 7f7dc6400640 1 -- 172.21.15.50:0/352086113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc01a4f60 con 0x7f7dc007de40 2024-09-10T10:00:18.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.673+0000 7f7dbd600640 1 -- 172.21.15.50:0/352086113 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7db4045070 con 0x7f7dc007de40 2024-09-10T10:00:18.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.673+0000 7f7dbd600640 1 -- 172.21.15.50:0/352086113 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7db4047a90 con 0x7f7dc007de40 2024-09-10T10:00:18.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.674+0000 7f7dc6400640 1 -- 172.21.15.50:0/352086113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc007c3c0 con 0x7f7dc007de40 2024-09-10T10:00:18.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.677+0000 7f7dbd600640 1 -- 172.21.15.50:0/352086113 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7db403db10 con 0x7f7dc007de40 2024-09-10T10:00:18.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.742+0000 7f7dc6400640 1 -- 172.21.15.50:0/352086113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7dc002d940 con 0x7f7dc007de40 2024-09-10T10:00:18.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.743+0000 7f7dbd600640 1 -- 172.21.15.50:0/352086113 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f7db403d430 con 0x7f7dc007de40 2024-09-10T10:00:18.463 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.744+0000 7f7dc6400640 1 -- 172.21.15.50:0/352086113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 msgr2=0x7f7dc01a1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:18.464 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.744+0000 7f7dc6400640 1 --2- 172.21.15.50:0/352086113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 0x7f7dc01a1aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7db40097f0 tx=0x7f7db4030ec0 comp rx=0 tx=0).stop 2024-09-10T10:00:18.464 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.744+0000 7f7dc6400640 1 -- 172.21.15.50:0/352086113 shutdown_connections 2024-09-10T10:00:18.464 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.744+0000 7f7dc6400640 1 --2- 172.21.15.50:0/352086113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7dc007de40 0x7f7dc01a1aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:18.464 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.744+0000 7f7dc6400640 1 -- 172.21.15.50:0/352086113 >> 172.21.15.50:0/352086113 conn(0x7f7dc0102d00 msgr2=0x7f7dc01050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:18.464 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.744+0000 7f7dc6400640 1 -- 172.21.15.50:0/352086113 shutdown_connections 2024-09-10T10:00:18.464 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:17.744+0000 7f7dc6400640 1 -- 172.21.15.50:0/352086113 wait complete. 2024-09-10T10:00:18.464 INFO:teuthology.orchestra.run.smithi050.stdout:mgr not available, waiting (2/15)... 2024-09-10T10:00:18.507 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:18.313+0000 7fe638436040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:00:18.771 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:18.505+0000 7fe638436040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:00:18.771 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:18.586+0000 7fe638436040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:00:18.771 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:18.668+0000 7fe638436040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:00:18.771 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:18.769+0000 7fe638436040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:00:19.215 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:18.849+0000 7fe638436040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:00:19.215 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:18.922+0000 7fe638436040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:00:20.215 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:19.880+0000 7fe638436040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:00:20.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-mon[30354]: Activating manager daemon x 2024-09-10T10:00:20.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-mon[30354]: mgrmap e2: x(active, starting, since 0.00391233s) 2024-09-10T10:00:20.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-mon[30354]: from='mgr.14100 172.21.15.50:0/1262807316' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:00:20.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-mon[30354]: from='mgr.14100 172.21.15.50:0/1262807316' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:00:20.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-mon[30354]: from='mgr.14100 172.21.15.50:0/1262807316' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:00:20.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-mon[30354]: from='mgr.14100 172.21.15.50:0/1262807316' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:00:20.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-mon[30354]: from='mgr.14100 172.21.15.50:0/1262807316' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T10:00:20.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-mon[30354]: Manager daemon x is now available 2024-09-10T10:00:20.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-mon[30354]: from='mgr.14100 172.21.15.50:0/1262807316' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:00:20.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-mon[30354]: from='mgr.14100 172.21.15.50:0/1262807316' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T10:00:20.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-mon[30354]: from='mgr.14100 172.21.15.50:0/1262807316' entity='mgr.x' 2024-09-10T10:00:20.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-mon[30354]: from='mgr.14100 172.21.15.50:0/1262807316' entity='mgr.x' 2024-09-10T10:00:20.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:19 smithi050 ceph-mon[30354]: from='mgr.14100 172.21.15.50:0/1262807316' entity='mgr.x' 2024-09-10T10:00:21.885 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-09-10T10:00:21.885 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:00:21.885 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "4d54e0f8-6f5b-11ef-bcea-c7b262605968", 2024-09-10T10:00:21.885 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T10:00:21.885 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T10:00:21.885 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T10:00:21.885 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T10:00:21.886 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:21.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T10:00:21.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:00:21.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T10:00:21.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T10:00:21.887 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T10:00:21.895 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T10:00:21.896 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T10:00:21.896 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T10:00:21.896 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:21.896 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T10:00:21.896 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T10:00:21.896 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T10:00:21.896 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T10:00:21.896 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T10:00:21.896 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T10:00:21.896 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T10:00:21.896 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T10:00:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T10:00:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T10:00:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:00:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T10:00:05:599805+0000", 2024-09-10T10:00:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T10:00:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T10:00:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T10:00:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T10:00:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T10:00:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T10:00:21.897 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T10:00:05.600549+0000", 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.956+0000 7fb395400640 1 Processor -- start 2024-09-10T10:00:21.898 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.956+0000 7fb395400640 1 -- start start 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.957+0000 7fb395400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 0x7fb39007c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.957+0000 7fb395400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb39007c860 con 0x7fb39007ddb0 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.957+0000 7fb38e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 0x7fb39007c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.957+0000 7fb38e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 0x7fb39007c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49518/0 (socket says 172.21.15.50:49518) 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.957+0000 7fb38e800640 1 -- 172.21.15.50:0/4121257250 learned_addr learned my addr 172.21.15.50:0/4121257250 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.957+0000 7fb38e800640 1 -- 172.21.15.50:0/4121257250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39007c9e0 con 0x7fb39007ddb0 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.958+0000 7fb38e800640 1 --2- 172.21.15.50:0/4121257250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 0x7fb39007c320 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb380009820 tx=0x7fb38002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1ba5a159c1f2e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.959+0000 7fb38de00640 1 -- 172.21.15.50:0/4121257250 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb380037070 con 0x7fb39007ddb0 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.959+0000 7fb38de00640 1 -- 172.21.15.50:0/4121257250 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb380032900 con 0x7fb39007ddb0 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.959+0000 7fb38de00640 1 -- 172.21.15.50:0/4121257250 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb380030850 con 0x7fb39007ddb0 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.959+0000 7fb395400640 1 -- 172.21.15.50:0/4121257250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 msgr2=0x7fb39007c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.959+0000 7fb395400640 1 --2- 172.21.15.50:0/4121257250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 0x7fb39007c320 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb380009820 tx=0x7fb38002a270 comp rx=0 tx=0).stop 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.959+0000 7fb395400640 1 -- 172.21.15.50:0/4121257250 shutdown_connections 2024-09-10T10:00:21.899 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.959+0000 7fb395400640 1 --2- 172.21.15.50:0/4121257250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 0x7fb39007c320 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:21.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.959+0000 7fb395400640 1 -- 172.21.15.50:0/4121257250 >> 172.21.15.50:0/4121257250 conn(0x7fb390102eb0 msgr2=0x7fb3901052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:21.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.959+0000 7fb395400640 1 -- 172.21.15.50:0/4121257250 shutdown_connections 2024-09-10T10:00:21.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.959+0000 7fb395400640 1 -- 172.21.15.50:0/4121257250 wait complete. 2024-09-10T10:00:21.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.960+0000 7fb395400640 1 Processor -- start 2024-09-10T10:00:21.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.961+0000 7fb395400640 1 -- start start 2024-09-10T10:00:21.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.961+0000 7fb395400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 0x7fb39019d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:21.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.961+0000 7fb395400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb39010dbe0 con 0x7fb39007ddb0 2024-09-10T10:00:21.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.961+0000 7fb38e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 0x7fb39019d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:21.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.961+0000 7fb38e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 0x7fb39019d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49534/0 (socket says 172.21.15.50:49534) 2024-09-10T10:00:21.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.961+0000 7fb38e800640 1 -- 172.21.15.50:0/2603706497 learned_addr learned my addr 172.21.15.50:0/2603706497 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:21.900 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.961+0000 7fb38e800640 1 -- 172.21.15.50:0/2603706497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39019ddd0 con 0x7fb39007ddb0 2024-09-10T10:00:21.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.962+0000 7fb38e800640 1 --2- 172.21.15.50:0/2603706497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 0x7fb39019d890 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb3800097f0 tx=0x7fb380030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:21.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.962+0000 7fb387400640 1 -- 172.21.15.50:0/2603706497 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb380042070 con 0x7fb39007ddb0 2024-09-10T10:00:21.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.962+0000 7fb387400640 1 -- 172.21.15.50:0/2603706497 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb380032ca0 con 0x7fb39007ddb0 2024-09-10T10:00:21.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.962+0000 7fb387400640 1 -- 172.21.15.50:0/2603706497 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb380037040 con 0x7fb39007ddb0 2024-09-10T10:00:21.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.962+0000 7fb395400640 1 -- 172.21.15.50:0/2603706497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb39019e060 con 0x7fb39007ddb0 2024-09-10T10:00:21.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.962+0000 7fb395400640 1 -- 172.21.15.50:0/2603706497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3901a0d50 con 0x7fb39007ddb0 2024-09-10T10:00:21.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.963+0000 7fb387400640 1 -- 172.21.15.50:0/2603706497 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7fb380045070 con 0x7fb39007ddb0 2024-09-10T10:00:21.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.963+0000 7fb395400640 1 -- 172.21.15.50:0/2603706497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb39007c3a0 con 0x7fb39007ddb0 2024-09-10T10:00:21.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.964+0000 7fb387400640 1 --2- 172.21.15.50:0/2603706497 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7fb374038e60 0x7fb37403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:21.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.964+0000 7fb387400640 1 -- 172.21.15.50:0/2603706497 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb38006bcb0 con 0x7fb39007ddb0 2024-09-10T10:00:21.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.964+0000 7fb387e00640 1 --2- 172.21.15.50:0/2603706497 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7fb374038e60 0x7fb37403b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:21.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.965+0000 7fb387e00640 1 --2- 172.21.15.50:0/2603706497 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7fb374038e60 0x7fb37403b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb3780098c0 tx=0x7fb378006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:21.901 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:20.970+0000 7fb387400640 1 -- 172.21.15.50:0/2603706497 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb38004b170 con 0x7fb39007ddb0 2024-09-10T10:00:21.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:21.223+0000 7fb395400640 1 -- 172.21.15.50:0/2603706497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb3901a13d0 con 0x7fb39007ddb0 2024-09-10T10:00:21.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:21.223+0000 7fb387400640 1 -- 172.21.15.50:0/2603706497 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fb38003d430 con 0x7fb39007ddb0 2024-09-10T10:00:21.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:21.226+0000 7fb395400640 1 -- 172.21.15.50:0/2603706497 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7fb374038e60 msgr2=0x7fb37403b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:21.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:21.226+0000 7fb395400640 1 --2- 172.21.15.50:0/2603706497 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7fb374038e60 0x7fb37403b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb3780098c0 tx=0x7fb378006db0 comp rx=0 tx=0).stop 2024-09-10T10:00:21.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:21.226+0000 7fb395400640 1 -- 172.21.15.50:0/2603706497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 msgr2=0x7fb39019d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:21.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:21.226+0000 7fb395400640 1 --2- 172.21.15.50:0/2603706497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 0x7fb39019d890 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb3800097f0 tx=0x7fb380030ec0 comp rx=0 tx=0).stop 2024-09-10T10:00:21.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:21.226+0000 7fb395400640 1 -- 172.21.15.50:0/2603706497 shutdown_connections 2024-09-10T10:00:21.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:21.226+0000 7fb395400640 1 --2- 172.21.15.50:0/2603706497 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7fb374038e60 0x7fb37403b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:21.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:21.226+0000 7fb395400640 1 --2- 172.21.15.50:0/2603706497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb39007ddb0 0x7fb39019d890 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:21.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:21.226+0000 7fb395400640 1 -- 172.21.15.50:0/2603706497 >> 172.21.15.50:0/2603706497 conn(0x7fb390102eb0 msgr2=0x7fb390103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:21.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:21.226+0000 7fb395400640 1 -- 172.21.15.50:0/2603706497 shutdown_connections 2024-09-10T10:00:21.902 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:21.226+0000 7fb395400640 1 -- 172.21.15.50:0/2603706497 wait complete. 2024-09-10T10:00:21.903 INFO:teuthology.orchestra.run.smithi050.stdout:mgr is available 2024-09-10T10:00:22.131 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:21 smithi050 ceph-mon[30354]: mgrmap e3: x(active, since 1.00855s) 2024-09-10T10:00:22.131 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:21 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2603706497' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T10:00:23.209 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:22 smithi050 ceph-mon[30354]: mgrmap e4: x(active, since 2s) 2024-09-10T10:00:23.209 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:22 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1862473677' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T10:00:23.214 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-09-10T10:00:23.221 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T10:00:23.221 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout fsid = 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:00:23.221 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.50:3300,v1:172.21.15.50:6789] 2024-09-10T10:00:23.221 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T10:00:23.221 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T10:00:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T10:00:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T10:00:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-09-10T10:00:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T10:00:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T10:00:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-09-10T10:00:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T10:00:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T10:00:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T10:00:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T10:00:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T10:00:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T10:00:23.222 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.328+0000 7ff5e2a00640 1 Processor -- start 2024-09-10T10:00:23.223 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.328+0000 7ff5e2a00640 1 -- start start 2024-09-10T10:00:23.223 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.328+0000 7ff5e2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 0x7ff5dc109c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:23.223 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.328+0000 7ff5e2a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc10a240 con 0x7ff5dc109870 2024-09-10T10:00:23.223 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.329+0000 7ff5dbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 0x7ff5dc109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:23.223 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.329+0000 7ff5dbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 0x7ff5dc109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49540/0 (socket says 172.21.15.50:49540) 2024-09-10T10:00:23.223 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.329+0000 7ff5dbe00640 1 -- 172.21.15.50:0/3178972065 learned_addr learned my addr 172.21.15.50:0/3178972065 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:23.223 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.329+0000 7ff5dbe00640 1 -- 172.21.15.50:0/3178972065 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc10aa10 con 0x7ff5dc109870 2024-09-10T10:00:23.223 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.330+0000 7ff5dbe00640 1 --2- 172.21.15.50:0/3178972065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 0x7ff5dc109c70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009820 tx=0x7ff5cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbaae98734f4640 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:23.223 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.330+0000 7ff5daa00640 1 -- 172.21.15.50:0/3178972065 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5cc037070 con 0x7ff5dc109870 2024-09-10T10:00:23.223 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.330+0000 7ff5daa00640 1 -- 172.21.15.50:0/3178972065 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5cc032900 con 0x7ff5dc109870 2024-09-10T10:00:23.223 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.330+0000 7ff5daa00640 1 -- 172.21.15.50:0/3178972065 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5cc030850 con 0x7ff5dc109870 2024-09-10T10:00:23.223 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.331+0000 7ff5e2a00640 1 -- 172.21.15.50:0/3178972065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 msgr2=0x7ff5dc109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:23.223 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.331+0000 7ff5e2a00640 1 --2- 172.21.15.50:0/3178972065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 0x7ff5dc109c70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009820 tx=0x7ff5cc02a270 comp rx=0 tx=0).stop 2024-09-10T10:00:23.224 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.331+0000 7ff5e2a00640 1 -- 172.21.15.50:0/3178972065 shutdown_connections 2024-09-10T10:00:23.224 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.331+0000 7ff5e2a00640 1 --2- 172.21.15.50:0/3178972065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 0x7ff5dc109c70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:23.224 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.331+0000 7ff5e2a00640 1 -- 172.21.15.50:0/3178972065 >> 172.21.15.50:0/3178972065 conn(0x7ff5dc07cf40 msgr2=0x7ff5dc07d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:23.224 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.331+0000 7ff5e2a00640 1 -- 172.21.15.50:0/3178972065 shutdown_connections 2024-09-10T10:00:23.224 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.331+0000 7ff5e2a00640 1 -- 172.21.15.50:0/3178972065 wait complete. 2024-09-10T10:00:23.224 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.332+0000 7ff5e2a00640 1 Processor -- start 2024-09-10T10:00:23.224 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.332+0000 7ff5e2a00640 1 -- start start 2024-09-10T10:00:23.224 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.333+0000 7ff5e2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 0x7ff5dc19d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:23.224 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.333+0000 7ff5e2a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc10ddc0 con 0x7ff5dc109870 2024-09-10T10:00:23.224 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.333+0000 7ff5dbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 0x7ff5dc19d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:23.224 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.333+0000 7ff5dbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 0x7ff5dc19d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49548/0 (socket says 172.21.15.50:49548) 2024-09-10T10:00:23.224 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.333+0000 7ff5dbe00640 1 -- 172.21.15.50:0/1862473677 learned_addr learned my addr 172.21.15.50:0/1862473677 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:23.224 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.333+0000 7ff5dbe00640 1 -- 172.21.15.50:0/1862473677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc19dd20 con 0x7ff5dc109870 2024-09-10T10:00:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.333+0000 7ff5dbe00640 1 --2- 172.21.15.50:0/1862473677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 0x7ff5dc19d7e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc032ce0 tx=0x7ff5cc032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.334+0000 7ff5d8c00640 1 -- 172.21.15.50:0/1862473677 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5cc042070 con 0x7ff5dc109870 2024-09-10T10:00:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.334+0000 7ff5d8c00640 1 -- 172.21.15.50:0/1862473677 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5cc0308c0 con 0x7ff5dc109870 2024-09-10T10:00:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.334+0000 7ff5d8c00640 1 -- 172.21.15.50:0/1862473677 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5cc037040 con 0x7ff5dc109870 2024-09-10T10:00:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.334+0000 7ff5e2a00640 1 -- 172.21.15.50:0/1862473677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5dc19dfb0 con 0x7ff5dc109870 2024-09-10T10:00:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.334+0000 7ff5e2a00640 1 -- 172.21.15.50:0/1862473677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5dc1a0ca0 con 0x7ff5dc109870 2024-09-10T10:00:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.335+0000 7ff5d8c00640 1 -- 172.21.15.50:0/1862473677 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7ff5cc045070 con 0x7ff5dc109870 2024-09-10T10:00:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.335+0000 7ff5e2a00640 1 -- 172.21.15.50:0/1862473677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5dc109c70 con 0x7ff5dc109870 2024-09-10T10:00:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.335+0000 7ff5d8c00640 1 --2- 172.21.15.50:0/1862473677 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff5c0038f20 0x7ff5c003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.336+0000 7ff5d8c00640 1 -- 172.21.15.50:0/1862473677 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff5cc06bf20 con 0x7ff5dc109870 2024-09-10T10:00:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.336+0000 7ff5db400640 1 --2- 172.21.15.50:0/1862473677 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff5c0038f20 0x7ff5c003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:23.225 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.336+0000 7ff5db400640 1 --2- 172.21.15.50:0/1862473677 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff5c0038f20 0x7ff5c003b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80098c0 tx=0x7ff5c8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.341+0000 7ff5d8c00640 1 -- 172.21.15.50:0/1862473677 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff5cc06b940 con 0x7ff5dc109870 2024-09-10T10:00:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.524+0000 7ff5e2a00640 1 -- 172.21.15.50:0/1862473677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7ff5dc1a24a0 con 0x7ff5dc109870 2024-09-10T10:00:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.525+0000 7ff5d8c00640 1 -- 172.21.15.50:0/1862473677 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7ff5cc03d430 con 0x7ff5dc109870 2024-09-10T10:00:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.527+0000 7ff5e2a00640 1 -- 172.21.15.50:0/1862473677 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff5c0038f20 msgr2=0x7ff5c003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.527+0000 7ff5e2a00640 1 --2- 172.21.15.50:0/1862473677 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff5c0038f20 0x7ff5c003b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80098c0 tx=0x7ff5c8006db0 comp rx=0 tx=0).stop 2024-09-10T10:00:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.527+0000 7ff5e2a00640 1 -- 172.21.15.50:0/1862473677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 msgr2=0x7ff5dc19d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.527+0000 7ff5e2a00640 1 --2- 172.21.15.50:0/1862473677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 0x7ff5dc19d7e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc032ce0 tx=0x7ff5cc032d10 comp rx=0 tx=0).stop 2024-09-10T10:00:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.527+0000 7ff5e2a00640 1 -- 172.21.15.50:0/1862473677 shutdown_connections 2024-09-10T10:00:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.527+0000 7ff5e2a00640 1 --2- 172.21.15.50:0/1862473677 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff5c0038f20 0x7ff5c003b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.527+0000 7ff5e2a00640 1 --2- 172.21.15.50:0/1862473677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5dc109870 0x7ff5dc19d7e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.527+0000 7ff5e2a00640 1 -- 172.21.15.50:0/1862473677 >> 172.21.15.50:0/1862473677 conn(0x7ff5dc07cf40 msgr2=0x7ff5dc107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.527+0000 7ff5e2a00640 1 -- 172.21.15.50:0/1862473677 shutdown_connections 2024-09-10T10:00:23.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:22.527+0000 7ff5e2a00640 1 -- 172.21.15.50:0/1862473677 wait complete. 2024-09-10T10:00:23.227 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling cephadm module... 2024-09-10T10:00:24.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:24 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2208954999' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-10T10:00:24.251 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: ignoring --setuser ceph since I am not root 2024-09-10T10:00:24.251 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: ignoring --setgroup ceph since I am not root 2024-09-10T10:00:24.251 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:24.249+0000 7fea38813040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:00:24.519 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:24.324+0000 7fea38813040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:00:24.519 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:24.518+0000 7fea38813040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:00:24.780 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:24.602+0000 7fea38813040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:00:24.780 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:24.779+0000 7fea38813040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:00:24.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.713+0000 7fd03da00640 1 Processor -- start 2024-09-10T10:00:24.922 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.713+0000 7fd03da00640 1 -- start start 2024-09-10T10:00:24.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.714+0000 7fd03da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 0x7fd038107aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:24.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.714+0000 7fd03da00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd038108070 con 0x7fd0381076a0 2024-09-10T10:00:24.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.714+0000 7fd036a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 0x7fd038107aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:24.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.714+0000 7fd036a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 0x7fd038107aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49564/0 (socket says 172.21.15.50:49564) 2024-09-10T10:00:24.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.714+0000 7fd036a00640 1 -- 172.21.15.50:0/1894308384 learned_addr learned my addr 172.21.15.50:0/1894308384 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:24.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.714+0000 7fd036a00640 1 -- 172.21.15.50:0/1894308384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd038108800 con 0x7fd0381076a0 2024-09-10T10:00:24.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.715+0000 7fd036a00640 1 --2- 172.21.15.50:0/1894308384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 0x7fd038107aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd028009820 tx=0x7fd02802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87c1781d3ea2299 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:24.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.716+0000 7fd036000640 1 -- 172.21.15.50:0/1894308384 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd028037070 con 0x7fd0381076a0 2024-09-10T10:00:24.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.716+0000 7fd036000640 1 -- 172.21.15.50:0/1894308384 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd028032900 con 0x7fd0381076a0 2024-09-10T10:00:24.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.716+0000 7fd036000640 1 -- 172.21.15.50:0/1894308384 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd028030850 con 0x7fd0381076a0 2024-09-10T10:00:24.923 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.716+0000 7fd03da00640 1 -- 172.21.15.50:0/1894308384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 msgr2=0x7fd038107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:24.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.716+0000 7fd03da00640 1 --2- 172.21.15.50:0/1894308384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 0x7fd038107aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd028009820 tx=0x7fd02802a270 comp rx=0 tx=0).stop 2024-09-10T10:00:24.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.716+0000 7fd03da00640 1 -- 172.21.15.50:0/1894308384 shutdown_connections 2024-09-10T10:00:24.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.716+0000 7fd03da00640 1 --2- 172.21.15.50:0/1894308384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 0x7fd038107aa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:24.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.716+0000 7fd03da00640 1 -- 172.21.15.50:0/1894308384 >> 172.21.15.50:0/1894308384 conn(0x7fd038102e50 msgr2=0x7fd038105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:24.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.716+0000 7fd03da00640 1 -- 172.21.15.50:0/1894308384 shutdown_connections 2024-09-10T10:00:24.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.717+0000 7fd03da00640 1 -- 172.21.15.50:0/1894308384 wait complete. 2024-09-10T10:00:24.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.717+0000 7fd03da00640 1 Processor -- start 2024-09-10T10:00:24.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.717+0000 7fd03da00640 1 -- start start 2024-09-10T10:00:24.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.718+0000 7fd03da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 0x7fd03807db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:24.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.718+0000 7fd03da00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd03810bbb0 con 0x7fd0381076a0 2024-09-10T10:00:24.924 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.718+0000 7fd036a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 0x7fd03807db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.718+0000 7fd036a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 0x7fd03807db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49576/0 (socket says 172.21.15.50:49576) 2024-09-10T10:00:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.718+0000 7fd036a00640 1 -- 172.21.15.50:0/2208954999 learned_addr learned my addr 172.21.15.50:0/2208954999 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.718+0000 7fd036a00640 1 -- 172.21.15.50:0/2208954999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03807e0b0 con 0x7fd0381076a0 2024-09-10T10:00:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.719+0000 7fd036a00640 1 --2- 172.21.15.50:0/2208954999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 0x7fd03807db70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd0280097f0 tx=0x7fd028030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.719+0000 7fd02f400640 1 -- 172.21.15.50:0/2208954999 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd028042070 con 0x7fd0381076a0 2024-09-10T10:00:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.719+0000 7fd02f400640 1 -- 172.21.15.50:0/2208954999 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd028032ca0 con 0x7fd0381076a0 2024-09-10T10:00:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.719+0000 7fd02f400640 1 -- 172.21.15.50:0/2208954999 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd028037040 con 0x7fd0381076a0 2024-09-10T10:00:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.719+0000 7fd03da00640 1 -- 172.21.15.50:0/2208954999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03807c2a0 con 0x7fd0381076a0 2024-09-10T10:00:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.719+0000 7fd03da00640 1 -- 172.21.15.50:0/2208954999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03807c7e0 con 0x7fd0381076a0 2024-09-10T10:00:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.720+0000 7fd02f400640 1 -- 172.21.15.50:0/2208954999 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fd028045070 con 0x7fd0381076a0 2024-09-10T10:00:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.720+0000 7fd03da00640 1 -- 172.21.15.50:0/2208954999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd038107b20 con 0x7fd0381076a0 2024-09-10T10:00:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.721+0000 7fd02f400640 1 --2- 172.21.15.50:0/2208954999 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7fd01c038f20 0x7fd01c03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:24.926 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.721+0000 7fd02f400640 1 -- 172.21.15.50:0/2208954999 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd02806be80 con 0x7fd0381076a0 2024-09-10T10:00:24.926 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.721+0000 7fd02fe00640 1 --2- 172.21.15.50:0/2208954999 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7fd01c038f20 0x7fd01c03b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:24.926 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.721+0000 7fd02fe00640 1 --2- 172.21.15.50:0/2208954999 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7fd01c038f20 0x7fd01c03b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0200098c0 tx=0x7fd020006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:24.926 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.726+0000 7fd02f400640 1 -- 172.21.15.50:0/2208954999 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd02806b8a0 con 0x7fd0381076a0 2024-09-10T10:00:24.926 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:23.964+0000 7fd03da00640 1 -- 172.21.15.50:0/2208954999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fd03807ca60 con 0x7fd0381076a0 2024-09-10T10:00:24.926 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:24.017+0000 7fd02f400640 1 -- 172.21.15.50:0/2208954999 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fd02803d430 con 0x7fd0381076a0 2024-09-10T10:00:24.926 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:24.018+0000 7fd02f400640 1 -- 172.21.15.50:0/2208954999 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fd028068090 con 0x7fd0381076a0 2024-09-10T10:00:24.926 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:24.020+0000 7fd03da00640 1 -- 172.21.15.50:0/2208954999 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7fd01c038f20 msgr2=0x7fd01c03b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:24.926 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:24.020+0000 7fd03da00640 1 --2- 172.21.15.50:0/2208954999 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7fd01c038f20 0x7fd01c03b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0200098c0 tx=0x7fd020006db0 comp rx=0 tx=0).stop 2024-09-10T10:00:24.926 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:24.020+0000 7fd03da00640 1 -- 172.21.15.50:0/2208954999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 msgr2=0x7fd03807db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:24.926 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:24.020+0000 7fd03da00640 1 --2- 172.21.15.50:0/2208954999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 0x7fd03807db70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd0280097f0 tx=0x7fd028030ec0 comp rx=0 tx=0).stop 2024-09-10T10:00:24.927 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:24.020+0000 7fd03da00640 1 -- 172.21.15.50:0/2208954999 shutdown_connections 2024-09-10T10:00:24.927 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:24.020+0000 7fd03da00640 1 --2- 172.21.15.50:0/2208954999 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7fd01c038f20 0x7fd01c03b3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:24.927 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:24.020+0000 7fd03da00640 1 --2- 172.21.15.50:0/2208954999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0381076a0 0x7fd03807db70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:24.927 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:24.020+0000 7fd03da00640 1 -- 172.21.15.50:0/2208954999 >> 172.21.15.50:0/2208954999 conn(0x7fd038102e50 msgr2=0x7fd0381039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:24.927 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:24.020+0000 7fd03da00640 1 -- 172.21.15.50:0/2208954999 shutdown_connections 2024-09-10T10:00:24.927 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:24.020+0000 7fd03da00640 1 -- 172.21.15.50:0/2208954999 wait complete. 2024-09-10T10:00:25.061 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:25 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2208954999' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T10:00:25.061 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:25 smithi050 ceph-mon[30354]: mgrmap e5: x(active, since 4s) 2024-09-10T10:00:25.061 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:24.955+0000 7fea38813040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:00:25.645 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:25 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:25.343+0000 7fea38813040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:00:25.646 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:25 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:25.420+0000 7fea38813040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:00:25.646 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:25 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:25.644+0000 7fea38813040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:00:26.399 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:26 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3094991817' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T10:00:26.418 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:00:26.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T10:00:26.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T10:00:26.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T10:00:26.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T10:00:26.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:00:26.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.469+0000 7ff6cd400640 1 Processor -- start 2024-09-10T10:00:26.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.469+0000 7ff6cd400640 1 -- start start 2024-09-10T10:00:26.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.469+0000 7ff6cd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 0x7ff6c8109d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:26.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.469+0000 7ff6cd400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c810a310 con 0x7ff6c8109920 2024-09-10T10:00:26.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.470+0000 7ff6c6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 0x7ff6c8109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:26.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.470+0000 7ff6c6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 0x7ff6c8109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49618/0 (socket says 172.21.15.50:49618) 2024-09-10T10:00:26.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.470+0000 7ff6c6800640 1 -- 172.21.15.50:0/1151294605 learned_addr learned my addr 172.21.15.50:0/1151294605 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:26.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.470+0000 7ff6c6800640 1 -- 172.21.15.50:0/1151294605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c810aa10 con 0x7ff6c8109920 2024-09-10T10:00:26.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.471+0000 7ff6c6800640 1 --2- 172.21.15.50:0/1151294605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 0x7ff6c8109d40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009820 tx=0x7ff6b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43b8a0bf0dcc11f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:26.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.471+0000 7ff6c5400640 1 -- 172.21.15.50:0/1151294605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6b8037070 con 0x7ff6c8109920 2024-09-10T10:00:26.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.472+0000 7ff6c5400640 1 -- 172.21.15.50:0/1151294605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6b8032900 con 0x7ff6c8109920 2024-09-10T10:00:26.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.472+0000 7ff6c5400640 1 -- 172.21.15.50:0/1151294605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6b8030850 con 0x7ff6c8109920 2024-09-10T10:00:26.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.472+0000 7ff6cd400640 1 -- 172.21.15.50:0/1151294605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 msgr2=0x7ff6c8109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:26.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.472+0000 7ff6cd400640 1 --2- 172.21.15.50:0/1151294605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 0x7ff6c8109d40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009820 tx=0x7ff6b802a270 comp rx=0 tx=0).stop 2024-09-10T10:00:26.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.472+0000 7ff6cd400640 1 -- 172.21.15.50:0/1151294605 shutdown_connections 2024-09-10T10:00:26.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.472+0000 7ff6cd400640 1 --2- 172.21.15.50:0/1151294605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 0x7ff6c8109d40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:26.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.472+0000 7ff6cd400640 1 -- 172.21.15.50:0/1151294605 >> 172.21.15.50:0/1151294605 conn(0x7ff6c807cf40 msgr2=0x7ff6c807d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:26.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.473+0000 7ff6cd400640 1 -- 172.21.15.50:0/1151294605 shutdown_connections 2024-09-10T10:00:26.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.473+0000 7ff6cd400640 1 -- 172.21.15.50:0/1151294605 wait complete. 2024-09-10T10:00:26.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.473+0000 7ff6cd400640 1 Processor -- start 2024-09-10T10:00:26.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.474+0000 7ff6cd400640 1 -- start start 2024-09-10T10:00:26.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.474+0000 7ff6cd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 0x7ff6c819d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:26.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.474+0000 7ff6cd400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c810ddc0 con 0x7ff6c8109920 2024-09-10T10:00:26.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.474+0000 7ff6c6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 0x7ff6c819d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:26.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.474+0000 7ff6c6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 0x7ff6c819d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49634/0 (socket says 172.21.15.50:49634) 2024-09-10T10:00:26.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.474+0000 7ff6c6800640 1 -- 172.21.15.50:0/3094991817 learned_addr learned my addr 172.21.15.50:0/3094991817 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:26.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.475+0000 7ff6c6800640 1 -- 172.21.15.50:0/3094991817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c819dd70 con 0x7ff6c8109920 2024-09-10T10:00:26.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.475+0000 7ff6c6800640 1 --2- 172.21.15.50:0/3094991817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 0x7ff6c819d830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80097f0 tx=0x7ff6b8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:26.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.475+0000 7ff6bf400640 1 -- 172.21.15.50:0/3094991817 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6b8037040 con 0x7ff6c8109920 2024-09-10T10:00:26.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.475+0000 7ff6bf400640 1 -- 172.21.15.50:0/3094991817 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6b8040070 con 0x7ff6c8109920 2024-09-10T10:00:26.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.475+0000 7ff6bf400640 1 -- 172.21.15.50:0/3094991817 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6b803a390 con 0x7ff6c8109920 2024-09-10T10:00:26.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.475+0000 7ff6cd400640 1 -- 172.21.15.50:0/3094991817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c819e000 con 0x7ff6c8109920 2024-09-10T10:00:26.423 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.475+0000 7ff6cd400640 1 -- 172.21.15.50:0/3094991817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c81a0cf0 con 0x7ff6c8109920 2024-09-10T10:00:26.423 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.477+0000 7ff6bf400640 1 -- 172.21.15.50:0/3094991817 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7ff6b803b430 con 0x7ff6c8109920 2024-09-10T10:00:26.423 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.477+0000 7ff6cd400640 1 -- 172.21.15.50:0/3094991817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6c8109dc0 con 0x7ff6c8109920 2024-09-10T10:00:26.423 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.477+0000 7ff6bf400640 1 --2- 172.21.15.50:0/3094991817 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff6ac038fc0 0x7ff6ac03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:26.423 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.477+0000 7ff6bf400640 1 -- 172.21.15.50:0/3094991817 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff6b806c0d0 con 0x7ff6c8109920 2024-09-10T10:00:26.423 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.477+0000 7ff6c5e00640 1 -- 172.21.15.50:0/3094991817 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff6ac038fc0 msgr2=0x7ff6ac03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/3083035719 2024-09-10T10:00:26.423 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.477+0000 7ff6c5e00640 1 --2- 172.21.15.50:0/3094991817 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff6ac038fc0 0x7ff6ac03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:00:26.423 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.482+0000 7ff6bf400640 1 -- 172.21.15.50:0/3094991817 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6b806be30 con 0x7ff6c8109920 2024-09-10T10:00:26.423 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.678+0000 7ff6c5e00640 1 -- 172.21.15.50:0/3094991817 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff6ac038fc0 msgr2=0x7ff6ac03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/3083035719 2024-09-10T10:00:26.423 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.678+0000 7ff6c5e00640 1 --2- 172.21.15.50:0/3094991817 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff6ac038fc0 0x7ff6ac03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:00:26.423 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.714+0000 7ff6cd400640 1 -- 172.21.15.50:0/3094991817 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ff6c81a13c0 con 0x7ff6c8109920 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.715+0000 7ff6bf400640 1 -- 172.21.15.50:0/3094991817 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7ff6b8032900 con 0x7ff6c8109920 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.717+0000 7ff6cd400640 1 -- 172.21.15.50:0/3094991817 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff6ac038fc0 msgr2=0x7ff6ac03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.717+0000 7ff6cd400640 1 --2- 172.21.15.50:0/3094991817 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff6ac038fc0 0x7ff6ac03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.717+0000 7ff6cd400640 1 -- 172.21.15.50:0/3094991817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 msgr2=0x7ff6c819d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.717+0000 7ff6cd400640 1 --2- 172.21.15.50:0/3094991817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 0x7ff6c819d830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80097f0 tx=0x7ff6b8030d80 comp rx=0 tx=0).stop 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.717+0000 7ff6cd400640 1 -- 172.21.15.50:0/3094991817 shutdown_connections 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.717+0000 7ff6cd400640 1 --2- 172.21.15.50:0/3094991817 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7ff6ac038fc0 0x7ff6ac03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.717+0000 7ff6cd400640 1 --2- 172.21.15.50:0/3094991817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6c8109920 0x7ff6c819d830 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.717+0000 7ff6cd400640 1 -- 172.21.15.50:0/3094991817 >> 172.21.15.50:0/3094991817 conn(0x7ff6c807cf40 msgr2=0x7ff6c8107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:26.424 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.717+0000 7ff6cd400640 1 -- 172.21.15.50:0/3094991817 shutdown_connections 2024-09-10T10:00:26.425 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:25.717+0000 7ff6cd400640 1 -- 172.21.15.50:0/3094991817 wait complete. 2024-09-10T10:00:26.425 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for the mgr to restart... 2024-09-10T10:00:26.425 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr epoch 5... 2024-09-10T10:00:26.965 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:26 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:26.825+0000 7fea38813040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:00:26.965 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:26 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:26.912+0000 7fea38813040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:00:28.170 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:27 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:27.858+0000 7fea38813040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:00:28.170 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:28 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:27.999+0000 7fea38813040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:00:28.170 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:28 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:28.168+0000 7fea38813040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:00:28.422 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:28 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:28.243+0000 7fea38813040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:00:28.422 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:28 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:28.420+0000 7fea38813040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:00:28.714 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:28 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:28.505+0000 7fea38813040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:00:28.715 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:28 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:28.579+0000 7fea38813040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:00:29.029 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:28 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:28.766+0000 7fea38813040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:00:29.030 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:28 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:28.846+0000 7fea38813040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:00:29.030 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:28 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:28.927+0000 7fea38813040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:00:29.030 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:29 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:29.028+0000 7fea38813040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:00:29.465 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:29 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:29.101+0000 7fea38813040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:00:29.465 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:29 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:29.173+0000 7fea38813040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:00:30.177 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:30.121+0000 7fea38813040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:00:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: Active manager daemon x restarted 2024-09-10T10:00:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: Activating manager daemon x 2024-09-10T10:00:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T10:00:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: mgrmap e6: x(active, starting, since 0.00410641s) 2024-09-10T10:00:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:00:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T10:00:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:00:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:00:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:00:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: Manager daemon x is now available 2024-09-10T10:00:30.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:30.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:30.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:00:30.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:30 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:00:31.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:31 smithi050 ceph-mon[30354]: Found migration_current of "None". Setting to last migration. 2024-09-10T10:00:31.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:31 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:00:31.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:31 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T10:00:31.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:31 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:31.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:31 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:31.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:31 smithi050 ceph-mon[30354]: mgrmap e7: x(active, since 1.00667s) 2024-09-10T10:00:32.177 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:00:32.177 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T10:00:32.177 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T10:00:32.177 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:00:32.177 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.895+0000 7f2643800640 1 Processor -- start 2024-09-10T10:00:32.177 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.895+0000 7f2643800640 1 -- start start 2024-09-10T10:00:32.177 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.896+0000 7f2643800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 0x7f263c109d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:32.177 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.896+0000 7f2643800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f263c10a330 con 0x7f263c109960 2024-09-10T10:00:32.177 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.896+0000 7f2640e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 0x7f263c109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:32.177 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.896+0000 7f2640e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 0x7f263c109d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55800/0 (socket says 172.21.15.50:55800) 2024-09-10T10:00:32.177 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.896+0000 7f2640e00640 1 -- 172.21.15.50:0/2859728566 learned_addr learned my addr 172.21.15.50:0/2859728566 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:32.178 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.897+0000 7f2640e00640 1 -- 172.21.15.50:0/2859728566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263c10aa30 con 0x7f263c109960 2024-09-10T10:00:32.178 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.898+0000 7f2640e00640 1 --2- 172.21.15.50:0/2859728566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 0x7f263c109d60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2630009820 tx=0x7f263002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d17ffdeb0e18025 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:32.178 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.898+0000 7f263b400640 1 -- 172.21.15.50:0/2859728566 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2630037070 con 0x7f263c109960 2024-09-10T10:00:32.178 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.898+0000 7f263b400640 1 -- 172.21.15.50:0/2859728566 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2630032900 con 0x7f263c109960 2024-09-10T10:00:32.178 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.898+0000 7f263b400640 1 -- 172.21.15.50:0/2859728566 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2630030850 con 0x7f263c109960 2024-09-10T10:00:32.178 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.899+0000 7f2643800640 1 -- 172.21.15.50:0/2859728566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 msgr2=0x7f263c109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:32.178 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.899+0000 7f2643800640 1 --2- 172.21.15.50:0/2859728566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 0x7f263c109d60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2630009820 tx=0x7f263002a270 comp rx=0 tx=0).stop 2024-09-10T10:00:32.178 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.899+0000 7f2643800640 1 -- 172.21.15.50:0/2859728566 shutdown_connections 2024-09-10T10:00:32.178 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.899+0000 7f2643800640 1 --2- 172.21.15.50:0/2859728566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 0x7f263c109d60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:32.178 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.899+0000 7f2643800640 1 -- 172.21.15.50:0/2859728566 >> 172.21.15.50:0/2859728566 conn(0x7f263c07ceb0 msgr2=0x7f263c07d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:32.178 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.899+0000 7f2643800640 1 -- 172.21.15.50:0/2859728566 shutdown_connections 2024-09-10T10:00:32.178 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.899+0000 7f2643800640 1 -- 172.21.15.50:0/2859728566 wait complete. 2024-09-10T10:00:32.178 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.900+0000 7f2643800640 1 Processor -- start 2024-09-10T10:00:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.900+0000 7f2643800640 1 -- start start 2024-09-10T10:00:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.900+0000 7f2643800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 0x7f263c19d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.900+0000 7f2643800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f263c10dde0 con 0x7f263c109960 2024-09-10T10:00:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.901+0000 7f2640e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 0x7f263c19d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.901+0000 7f2640e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 0x7f263c19d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55806/0 (socket says 172.21.15.50:55806) 2024-09-10T10:00:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.901+0000 7f2640e00640 1 -- 172.21.15.50:0/4286473197 learned_addr learned my addr 172.21.15.50:0/4286473197 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.901+0000 7f2640e00640 1 -- 172.21.15.50:0/4286473197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263c19ddc0 con 0x7f263c109960 2024-09-10T10:00:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.901+0000 7f2640e00640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 0x7f263c19d880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f26300097f0 tx=0x7f2630030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.901+0000 7f2639600640 1 -- 172.21.15.50:0/4286473197 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2630042070 con 0x7f263c109960 2024-09-10T10:00:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.902+0000 7f2639600640 1 -- 172.21.15.50:0/4286473197 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2630032ca0 con 0x7f263c109960 2024-09-10T10:00:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.902+0000 7f2639600640 1 -- 172.21.15.50:0/4286473197 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2630037040 con 0x7f263c109960 2024-09-10T10:00:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.902+0000 7f2643800640 1 -- 172.21.15.50:0/4286473197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263c19e050 con 0x7f263c109960 2024-09-10T10:00:32.179 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.902+0000 7f2643800640 1 -- 172.21.15.50:0/4286473197 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263c1a0d40 con 0x7f263c109960 2024-09-10T10:00:32.180 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.903+0000 7f2639600640 1 -- 172.21.15.50:0/4286473197 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f2630045070 con 0x7f263c109960 2024-09-10T10:00:32.180 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.903+0000 7f2639600640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 0x7f262403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:32.180 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.903+0000 7f2639600640 1 -- 172.21.15.50:0/4286473197 --> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f262403bb40 con 0x7f2624038f70 2024-09-10T10:00:32.180 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.903+0000 7f2639600640 1 -- 172.21.15.50:0/4286473197 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f263006bea0 con 0x7f263c109960 2024-09-10T10:00:32.180 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.903+0000 7f263be00640 1 -- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 msgr2=0x7f262403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/3083035719 2024-09-10T10:00:32.180 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:26.904+0000 7f263be00640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 0x7f262403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:00:32.180 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:27.105+0000 7f263be00640 1 -- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 msgr2=0x7f262403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/3083035719 2024-09-10T10:00:32.180 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:27.105+0000 7f263be00640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 0x7f262403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:00:32.180 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:27.506+0000 7f263be00640 1 -- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 msgr2=0x7f262403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/3083035719 2024-09-10T10:00:32.180 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:27.506+0000 7f263be00640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 0x7f262403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T10:00:32.180 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:28.307+0000 7f263be00640 1 -- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 msgr2=0x7f262403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/3083035719 2024-09-10T10:00:32.180 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:28.307+0000 7f263be00640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 0x7f262403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T10:00:32.181 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:29.908+0000 7f263be00640 1 -- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 msgr2=0x7f262403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/3083035719 2024-09-10T10:00:32.181 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:29.908+0000 7f263be00640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 0x7f262403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-10T10:00:32.181 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:30.126+0000 7f2639600640 1 -- 172.21.15.50:0/4286473197 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f263003d430 con 0x7f263c109960 2024-09-10T10:00:32.181 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:30.126+0000 7f2639600640 1 -- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 msgr2=0x7f262403b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:00:32.181 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:30.126+0000 7f2639600640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 0x7f262403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:32.181 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.127+0000 7f2639600640 1 -- 172.21.15.50:0/4286473197 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f263006d880 con 0x7f263c109960 2024-09-10T10:00:32.181 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.128+0000 7f2639600640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f262403c8a0 0x7f262403ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:32.181 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.128+0000 7f2639600640 1 -- 172.21.15.50:0/4286473197 --> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f262403bb40 con 0x7f262403c8a0 2024-09-10T10:00:32.181 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.128+0000 7f263be00640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f262403c8a0 0x7f262403ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:32.181 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.129+0000 7f263be00640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f262403c8a0 0x7f262403ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2628003980 tx=0x7f2628009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.130+0000 7f2639600640 1 -- 172.21.15.50:0/4286473197 <== mgr.14118 v2:172.21.15.50:6800/2344357525 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f262403bb40 con 0x7f262403c8a0 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.137+0000 7f2643800640 1 -- 172.21.15.50:0/4286473197 --> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f263c10df60 con 0x7f262403c8a0 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.138+0000 7f2639600640 1 -- 172.21.15.50:0/4286473197 <== mgr.14118 v2:172.21.15.50:6800/2344357525 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f263c10df60 con 0x7f262403c8a0 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.138+0000 7f2643800640 1 -- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f262403c8a0 msgr2=0x7f262403ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.138+0000 7f2643800640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f262403c8a0 0x7f262403ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2628003980 tx=0x7f2628009290 comp rx=0 tx=0).stop 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.138+0000 7f2643800640 1 -- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 msgr2=0x7f263c19d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.138+0000 7f2643800640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 0x7f263c19d880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f26300097f0 tx=0x7f2630030ec0 comp rx=0 tx=0).stop 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.138+0000 7f2643800640 1 -- 172.21.15.50:0/4286473197 shutdown_connections 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.138+0000 7f2643800640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f262403c8a0 0x7f262403ec90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.138+0000 7f2643800640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:6800/3083035719,v1:172.21.15.50:6801/3083035719] conn(0x7f2624038f70 0x7f262403b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.138+0000 7f2643800640 1 --2- 172.21.15.50:0/4286473197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f263c109960 0x7f263c19d880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.138+0000 7f2643800640 1 -- 172.21.15.50:0/4286473197 >> 172.21.15.50:0/4286473197 conn(0x7f263c07ceb0 msgr2=0x7f263c107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.138+0000 7f2643800640 1 -- 172.21.15.50:0/4286473197 shutdown_connections 2024-09-10T10:00:32.182 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:31.138+0000 7f2643800640 1 -- 172.21.15.50:0/4286473197 wait complete. 2024-09-10T10:00:32.183 INFO:teuthology.orchestra.run.smithi050.stdout:mgr epoch 5 is available 2024-09-10T10:00:32.183 INFO:teuthology.orchestra.run.smithi050.stdout:Setting orchestrator backend to cephadm... 2024-09-10T10:00:32.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-mon[30354]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T10:00:32.433 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-mon[30354]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T10:00:32.715 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:32.543+0000 7fe991000640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:10:00:32] ENGINE Error in HTTPServer.serve 2024-09-10T10:00:32.715 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: Traceback (most recent call last): 2024-09-10T10:00:32.715 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:00:32.715 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: self._connections.run(self.expiration_interval) 2024-09-10T10:00:32.715 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:00:32.715 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: self._run(expiration_interval) 2024-09-10T10:00:32.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:00:32.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:00:32.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:00:32.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:00:32.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:00:32.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: s = self.context.wrap_socket( 2024-09-10T10:00:32.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:00:32.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: return self.sslsocket_class._create( 2024-09-10T10:00:32.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:00:32.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: self.do_handshake() 2024-09-10T10:00:32.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:00:32.716 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: self._sslobj.do_handshake() 2024-09-10T10:00:32.717 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:00:32.717 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:33.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:33 smithi050 ceph-mon[30354]: mgrmap e8: x(active, since 2s) 2024-09-10T10:00:33.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:33 smithi050 ceph-mon[30354]: [10/Sep/2024:10:00:32] ENGINE Bus STARTING 2024-09-10T10:00:33.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:33 smithi050 ceph-mon[30354]: [10/Sep/2024:10:00:32] ENGINE Serving on http://172.21.15.50:8765 2024-09-10T10:00:33.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:33 smithi050 ceph-mon[30354]: [10/Sep/2024:10:00:32] ENGINE Serving on https://172.21.15.50:7150 2024-09-10T10:00:33.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:33 smithi050 ceph-mon[30354]: [10/Sep/2024:10:00:32] ENGINE Bus STARTED 2024-09-10T10:00:33.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:33 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:00:33.441 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:33 smithi050 ceph-mon[30354]: [10/Sep/2024:10:00:32] ENGINE Error in HTTPServer.serve 2024-09-10T10:00:33.441 INFO:journalctl@ceph.mon.a.smithi050.stdout: Traceback (most recent call last): 2024-09-10T10:00:33.441 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:00:33.441 INFO:journalctl@ceph.mon.a.smithi050.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:00:33.441 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:00:33.441 INFO:journalctl@ceph.mon.a.smithi050.stdout: self._run(expiration_interval) 2024-09-10T10:00:33.441 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:00:33.441 INFO:journalctl@ceph.mon.a.smithi050.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:00:33.441 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:00:33.441 INFO:journalctl@ceph.mon.a.smithi050.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:00:33.441 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:00:33.442 INFO:journalctl@ceph.mon.a.smithi050.stdout: s = self.context.wrap_socket( 2024-09-10T10:00:33.442 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:00:33.442 INFO:journalctl@ceph.mon.a.smithi050.stdout: return self.sslsocket_class._create( 2024-09-10T10:00:33.442 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:00:33.442 INFO:journalctl@ceph.mon.a.smithi050.stdout: self.do_handshake() 2024-09-10T10:00:33.442 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:00:33.442 INFO:journalctl@ceph.mon.a.smithi050.stdout: self._sslobj.do_handshake() 2024-09-10T10:00:33.442 INFO:journalctl@ceph.mon.a.smithi050.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:00:33.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:33 smithi050 ceph-mon[30354]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:00:33.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:33 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:33.442 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:33 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:00:33.565 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.666+0000 7f7187000640 1 Processor -- start 2024-09-10T10:00:33.565 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.667+0000 7f7187000640 1 -- start start 2024-09-10T10:00:33.565 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.667+0000 7f7187000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 0x7f7180109d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:33.565 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.667+0000 7f7187000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f718010a2f0 con 0x7f7180109920 2024-09-10T10:00:33.565 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.667+0000 7f7185c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 0x7f7180109d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:33.565 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.667+0000 7f7185c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 0x7f7180109d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55884/0 (socket says 172.21.15.50:55884) 2024-09-10T10:00:33.566 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.667+0000 7f7185c00640 1 -- 172.21.15.50:0/1675146736 learned_addr learned my addr 172.21.15.50:0/1675146736 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:33.566 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.668+0000 7f7185c00640 1 -- 172.21.15.50:0/1675146736 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718010a840 con 0x7f7180109920 2024-09-10T10:00:33.566 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.669+0000 7f7185c00640 1 --2- 172.21.15.50:0/1675146736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 0x7f7180109d20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7174009820 tx=0x7f717402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51c5e91de9bd9c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:33.566 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.669+0000 7f717fe00640 1 -- 172.21.15.50:0/1675146736 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7174037070 con 0x7f7180109920 2024-09-10T10:00:33.566 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.669+0000 7f717fe00640 1 -- 172.21.15.50:0/1675146736 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7174032900 con 0x7f7180109920 2024-09-10T10:00:33.566 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.669+0000 7f717fe00640 1 -- 172.21.15.50:0/1675146736 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7174030850 con 0x7f7180109920 2024-09-10T10:00:33.566 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.670+0000 7f7187000640 1 -- 172.21.15.50:0/1675146736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 msgr2=0x7f7180109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:33.566 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.670+0000 7f7187000640 1 --2- 172.21.15.50:0/1675146736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 0x7f7180109d20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7174009820 tx=0x7f717402a270 comp rx=0 tx=0).stop 2024-09-10T10:00:33.566 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.670+0000 7f7187000640 1 -- 172.21.15.50:0/1675146736 shutdown_connections 2024-09-10T10:00:33.566 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.670+0000 7f7187000640 1 --2- 172.21.15.50:0/1675146736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 0x7f7180109d20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:33.566 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.670+0000 7f7187000640 1 -- 172.21.15.50:0/1675146736 >> 172.21.15.50:0/1675146736 conn(0x7f718007cba0 msgr2=0x7f718007d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:33.566 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.670+0000 7f7187000640 1 -- 172.21.15.50:0/1675146736 shutdown_connections 2024-09-10T10:00:33.566 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.670+0000 7f7187000640 1 -- 172.21.15.50:0/1675146736 wait complete. 2024-09-10T10:00:33.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.671+0000 7f7187000640 1 Processor -- start 2024-09-10T10:00:33.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.671+0000 7f7187000640 1 -- start start 2024-09-10T10:00:33.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.671+0000 7f7187000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 0x7f718019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:33.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.671+0000 7f7187000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f718010dbf0 con 0x7f7180109920 2024-09-10T10:00:33.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.672+0000 7f7185c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 0x7f718019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:33.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.672+0000 7f7185c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 0x7f718019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55898/0 (socket says 172.21.15.50:55898) 2024-09-10T10:00:33.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.672+0000 7f7185c00640 1 -- 172.21.15.50:0/1293062046 learned_addr learned my addr 172.21.15.50:0/1293062046 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:33.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.672+0000 7f7185c00640 1 -- 172.21.15.50:0/1293062046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718019dbc0 con 0x7f7180109920 2024-09-10T10:00:33.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.672+0000 7f7185c00640 1 --2- 172.21.15.50:0/1293062046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 0x7f718019d680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f71740097f0 tx=0x7f7174030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:33.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.672+0000 7f717e000640 1 -- 172.21.15.50:0/1293062046 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7174042070 con 0x7f7180109920 2024-09-10T10:00:33.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.673+0000 7f717e000640 1 -- 172.21.15.50:0/1293062046 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7174032ca0 con 0x7f7180109920 2024-09-10T10:00:33.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.673+0000 7f717e000640 1 -- 172.21.15.50:0/1293062046 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7174037040 con 0x7f7180109920 2024-09-10T10:00:33.567 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.673+0000 7f7187000640 1 -- 172.21.15.50:0/1293062046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f718019de50 con 0x7f7180109920 2024-09-10T10:00:33.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.673+0000 7f7187000640 1 -- 172.21.15.50:0/1293062046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71801a0b40 con 0x7f7180109920 2024-09-10T10:00:33.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.674+0000 7f717e000640 1 -- 172.21.15.50:0/1293062046 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7174045070 con 0x7f7180109920 2024-09-10T10:00:33.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.674+0000 7f7187000640 1 -- 172.21.15.50:0/1293062046 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7180109da0 con 0x7f7180109920 2024-09-10T10:00:33.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.674+0000 7f717e000640 1 --2- 172.21.15.50:0/1293062046 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f7168038fc0 0x7f716803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:33.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.674+0000 7f717e000640 1 -- 172.21.15.50:0/1293062046 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f717406bfc0 con 0x7f7180109920 2024-09-10T10:00:33.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.674+0000 7f7185200640 1 --2- 172.21.15.50:0/1293062046 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f7168038fc0 0x7f716803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:33.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.675+0000 7f7185200640 1 --2- 172.21.15.50:0/1293062046 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f7168038fc0 0x7f716803b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f716c0098c0 tx=0x7f716c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:33.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.680+0000 7f717e000640 1 -- 172.21.15.50:0/1293062046 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7174045360 con 0x7f7180109920 2024-09-10T10:00:33.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.880+0000 7f7187000640 1 -- 172.21.15.50:0/1293062046 --> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f7180107c60 con 0x7f7168038fc0 2024-09-10T10:00:33.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.885+0000 7f717e000640 1 -- 172.21.15.50:0/1293062046 <== mgr.14118 v2:172.21.15.50:6800/2344357525 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7180107c60 con 0x7f7168038fc0 2024-09-10T10:00:33.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.888+0000 7f7187000640 1 -- 172.21.15.50:0/1293062046 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f7168038fc0 msgr2=0x7f716803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:33.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.888+0000 7f7187000640 1 --2- 172.21.15.50:0/1293062046 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f7168038fc0 0x7f716803b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f716c0098c0 tx=0x7f716c006db0 comp rx=0 tx=0).stop 2024-09-10T10:00:33.568 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.888+0000 7f7187000640 1 -- 172.21.15.50:0/1293062046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 msgr2=0x7f718019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:33.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.888+0000 7f7187000640 1 --2- 172.21.15.50:0/1293062046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 0x7f718019d680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f71740097f0 tx=0x7f7174030ec0 comp rx=0 tx=0).stop 2024-09-10T10:00:33.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.888+0000 7f7187000640 1 -- 172.21.15.50:0/1293062046 shutdown_connections 2024-09-10T10:00:33.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.888+0000 7f7187000640 1 --2- 172.21.15.50:0/1293062046 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f7168038fc0 0x7f716803b480 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:33.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.888+0000 7f7187000640 1 --2- 172.21.15.50:0/1293062046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7180109920 0x7f718019d680 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:33.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.888+0000 7f7187000640 1 -- 172.21.15.50:0/1293062046 >> 172.21.15.50:0/1293062046 conn(0x7f718007cba0 msgr2=0x7f7180107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:33.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.888+0000 7f7187000640 1 -- 172.21.15.50:0/1293062046 shutdown_connections 2024-09-10T10:00:33.569 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:32.888+0000 7f7187000640 1 -- 172.21.15.50:0/1293062046 wait complete. 2024-09-10T10:00:34.862 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T10:00:34.862 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.012+0000 7f0fe5e00640 1 Processor -- start 2024-09-10T10:00:34.862 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.012+0000 7f0fe5e00640 1 -- start start 2024-09-10T10:00:34.862 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.013+0000 7f0fe5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 0x7f0fe0109c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:34.862 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.013+0000 7f0fe5e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe010a200 con 0x7f0fe0109830 2024-09-10T10:00:34.862 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.013+0000 7f0fdea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 0x7f0fe0109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:34.862 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.013+0000 7f0fdea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 0x7f0fe0109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55904/0 (socket says 172.21.15.50:55904) 2024-09-10T10:00:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.013+0000 7f0fdea00640 1 -- 172.21.15.50:0/317896697 learned_addr learned my addr 172.21.15.50:0/317896697 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.013+0000 7f0fdea00640 1 -- 172.21.15.50:0/317896697 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe010aa40 con 0x7f0fe0109830 2024-09-10T10:00:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.014+0000 7f0fdea00640 1 --2- 172.21.15.50:0/317896697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 0x7f0fe0109c30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009820 tx=0x7f0fd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a896b013d7c78df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.015+0000 7f0fde000640 1 -- 172.21.15.50:0/317896697 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd0037070 con 0x7f0fe0109830 2024-09-10T10:00:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.015+0000 7f0fde000640 1 -- 172.21.15.50:0/317896697 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0fd0032900 con 0x7f0fe0109830 2024-09-10T10:00:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.015+0000 7f0fde000640 1 -- 172.21.15.50:0/317896697 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd0030850 con 0x7f0fe0109830 2024-09-10T10:00:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.015+0000 7f0fe5e00640 1 -- 172.21.15.50:0/317896697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 msgr2=0x7f0fe0109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.015+0000 7f0fe5e00640 1 --2- 172.21.15.50:0/317896697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 0x7f0fe0109c30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009820 tx=0x7f0fd002a270 comp rx=0 tx=0).stop 2024-09-10T10:00:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.015+0000 7f0fe5e00640 1 -- 172.21.15.50:0/317896697 shutdown_connections 2024-09-10T10:00:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.015+0000 7f0fe5e00640 1 --2- 172.21.15.50:0/317896697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 0x7f0fe0109c30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.015+0000 7f0fe5e00640 1 -- 172.21.15.50:0/317896697 >> 172.21.15.50:0/317896697 conn(0x7f0fe007ce40 msgr2=0x7f0fe007d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.015+0000 7f0fe5e00640 1 -- 172.21.15.50:0/317896697 shutdown_connections 2024-09-10T10:00:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.015+0000 7f0fe5e00640 1 -- 172.21.15.50:0/317896697 wait complete. 2024-09-10T10:00:34.864 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.016+0000 7f0fe5e00640 1 Processor -- start 2024-09-10T10:00:34.864 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.016+0000 7f0fe5e00640 1 -- start start 2024-09-10T10:00:34.864 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.017+0000 7f0fe5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 0x7f0fe019d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:34.864 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.017+0000 7f0fe5e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe010ddf0 con 0x7f0fe0109830 2024-09-10T10:00:34.864 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.017+0000 7f0fdea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 0x7f0fe019d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:34.864 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.017+0000 7f0fdea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 0x7f0fe019d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55906/0 (socket says 172.21.15.50:55906) 2024-09-10T10:00:34.864 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.017+0000 7f0fdea00640 1 -- 172.21.15.50:0/1776703460 learned_addr learned my addr 172.21.15.50:0/1776703460 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:34.864 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.017+0000 7f0fdea00640 1 -- 172.21.15.50:0/1776703460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe019de40 con 0x7f0fe0109830 2024-09-10T10:00:34.865 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.018+0000 7f0fdea00640 1 --2- 172.21.15.50:0/1776703460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 0x7f0fe019d900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00097f0 tx=0x7f0fd0030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:34.865 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.018+0000 7f0fe4a00640 1 -- 172.21.15.50:0/1776703460 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd0042070 con 0x7f0fe0109830 2024-09-10T10:00:34.865 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.018+0000 7f0fe4a00640 1 -- 172.21.15.50:0/1776703460 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0fd0032ca0 con 0x7f0fe0109830 2024-09-10T10:00:34.865 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.018+0000 7f0fe5e00640 1 -- 172.21.15.50:0/1776703460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe019e0d0 con 0x7f0fe0109830 2024-09-10T10:00:34.865 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.018+0000 7f0fe4a00640 1 -- 172.21.15.50:0/1776703460 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd0037040 con 0x7f0fe0109830 2024-09-10T10:00:34.865 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.018+0000 7f0fe5e00640 1 -- 172.21.15.50:0/1776703460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe01a0dc0 con 0x7f0fe0109830 2024-09-10T10:00:34.865 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.019+0000 7f0fe4a00640 1 -- 172.21.15.50:0/1776703460 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0fd0045070 con 0x7f0fe0109830 2024-09-10T10:00:34.865 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.019+0000 7f0fe5e00640 1 -- 172.21.15.50:0/1776703460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fe0109c30 con 0x7f0fe0109830 2024-09-10T10:00:34.865 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.020+0000 7f0fe4a00640 1 --2- 172.21.15.50:0/1776703460 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f0fc4038f70 0x7f0fc403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:34.865 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.020+0000 7f0fe4a00640 1 -- 172.21.15.50:0/1776703460 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0fd006bf50 con 0x7f0fe0109830 2024-09-10T10:00:34.865 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.020+0000 7f0fd6000640 1 --2- 172.21.15.50:0/1776703460 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f0fc4038f70 0x7f0fc403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:34.865 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.020+0000 7f0fd6000640 1 --2- 172.21.15.50:0/1776703460 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f0fc4038f70 0x7f0fc403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80098c0 tx=0x7f0fc8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.025+0000 7f0fe4a00640 1 -- 172.21.15.50:0/1776703460 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0fd006b8a0 con 0x7f0fe0109830 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.210+0000 7f0fe5e00640 1 -- 172.21.15.50:0/1776703460 --> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f0fe0107cc0 con 0x7f0fc4038f70 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.210+0000 7f0fe4a00640 1 -- 172.21.15.50:0/1776703460 <== mgr.14118 v2:172.21.15.50:6800/2344357525 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f0fe0107cc0 con 0x7f0fc4038f70 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.213+0000 7f0fe5e00640 1 -- 172.21.15.50:0/1776703460 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f0fc4038f70 msgr2=0x7f0fc403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.213+0000 7f0fe5e00640 1 --2- 172.21.15.50:0/1776703460 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f0fc4038f70 0x7f0fc403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80098c0 tx=0x7f0fc8006db0 comp rx=0 tx=0).stop 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.213+0000 7f0fe5e00640 1 -- 172.21.15.50:0/1776703460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 msgr2=0x7f0fe019d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.213+0000 7f0fe5e00640 1 --2- 172.21.15.50:0/1776703460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 0x7f0fe019d900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00097f0 tx=0x7f0fd0030ec0 comp rx=0 tx=0).stop 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.213+0000 7f0fe5e00640 1 -- 172.21.15.50:0/1776703460 shutdown_connections 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.213+0000 7f0fe5e00640 1 --2- 172.21.15.50:0/1776703460 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f0fc4038f70 0x7f0fc403b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.213+0000 7f0fe5e00640 1 --2- 172.21.15.50:0/1776703460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0fe0109830 0x7f0fe019d900 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.213+0000 7f0fe5e00640 1 -- 172.21.15.50:0/1776703460 >> 172.21.15.50:0/1776703460 conn(0x7f0fe007ce40 msgr2=0x7f0fe01075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.213+0000 7f0fe5e00640 1 -- 172.21.15.50:0/1776703460 shutdown_connections 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:34.213+0000 7f0fe5e00640 1 -- 172.21.15.50:0/1776703460 wait complete. 2024-09-10T10:00:34.866 INFO:teuthology.orchestra.run.smithi050.stdout:Generating ssh key... 2024-09-10T10:00:35.356 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-mon[30354]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:00:36.116 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: Generating public/private rsa key pair. 2024-09-10T10:00:36.116 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: Your identification has been saved in /tmp/tmplyvxnks8/key 2024-09-10T10:00:36.116 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: Your public key has been saved in /tmp/tmplyvxnks8/key.pub 2024-09-10T10:00:36.116 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: The key fingerprint is: 2024-09-10T10:00:36.117 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: SHA256:kZUcefzpzBfhM3BrlevIhRbubQEPENIFprURtwceuRY ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:00:36.117 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: The key's randomart image is: 2024-09-10T10:00:36.117 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: +---[RSA 3072]----+ 2024-09-10T10:00:36.117 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: | o+&*=. .| 2024-09-10T10:00:36.117 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: | oO.BE++.| 2024-09-10T10:00:36.117 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: | o. o.+%o=| 2024-09-10T10:00:36.118 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: | . *+% | 2024-09-10T10:00:36.118 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: | S =+* =| 2024-09-10T10:00:36.118 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: | +++.| 2024-09-10T10:00:36.118 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: | .. | 2024-09-10T10:00:36.118 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: | | 2024-09-10T10:00:36.118 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: | | 2024-09-10T10:00:36.118 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: +----[SHA256]-----+ 2024-09-10T10:00:36.418 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.352+0000 7ff538a00640 1 Processor -- start 2024-09-10T10:00:36.418 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.352+0000 7ff538a00640 1 -- start start 2024-09-10T10:00:36.418 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.352+0000 7ff538a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 0x7ff534109d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:36.418 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.352+0000 7ff538a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff53410a340 con 0x7ff534109970 2024-09-10T10:00:36.418 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.353+0000 7ff532800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 0x7ff534109d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:36.418 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.353+0000 7ff532800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 0x7ff534109d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55910/0 (socket says 172.21.15.50:55910) 2024-09-10T10:00:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.353+0000 7ff532800640 1 -- 172.21.15.50:0/3959307354 learned_addr learned my addr 172.21.15.50:0/3959307354 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.353+0000 7ff532800640 1 -- 172.21.15.50:0/3959307354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53410a840 con 0x7ff534109970 2024-09-10T10:00:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.354+0000 7ff532800640 1 --2- 172.21.15.50:0/3959307354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 0x7ff534109d70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff524009820 tx=0x7ff52402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7378bebc2aaad49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.354+0000 7ff531400640 1 -- 172.21.15.50:0/3959307354 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff524037070 con 0x7ff534109970 2024-09-10T10:00:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.354+0000 7ff531400640 1 -- 172.21.15.50:0/3959307354 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff524032900 con 0x7ff534109970 2024-09-10T10:00:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.354+0000 7ff531400640 1 -- 172.21.15.50:0/3959307354 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff524030850 con 0x7ff534109970 2024-09-10T10:00:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.355+0000 7ff538a00640 1 -- 172.21.15.50:0/3959307354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 msgr2=0x7ff534109d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.355+0000 7ff538a00640 1 --2- 172.21.15.50:0/3959307354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 0x7ff534109d70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff524009820 tx=0x7ff52402a270 comp rx=0 tx=0).stop 2024-09-10T10:00:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.355+0000 7ff538a00640 1 -- 172.21.15.50:0/3959307354 shutdown_connections 2024-09-10T10:00:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.355+0000 7ff538a00640 1 --2- 172.21.15.50:0/3959307354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 0x7ff534109d70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.355+0000 7ff538a00640 1 -- 172.21.15.50:0/3959307354 >> 172.21.15.50:0/3959307354 conn(0x7ff53407cca0 msgr2=0x7ff53407d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.355+0000 7ff538a00640 1 -- 172.21.15.50:0/3959307354 shutdown_connections 2024-09-10T10:00:36.419 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.356+0000 7ff538a00640 1 -- 172.21.15.50:0/3959307354 wait complete. 2024-09-10T10:00:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.357+0000 7ff538a00640 1 Processor -- start 2024-09-10T10:00:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.357+0000 7ff538a00640 1 -- start start 2024-09-10T10:00:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.357+0000 7ff538a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 0x7ff53419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.357+0000 7ff538a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff53410dbf0 con 0x7ff534109970 2024-09-10T10:00:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.358+0000 7ff532800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 0x7ff53419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.358+0000 7ff532800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 0x7ff53419d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55926/0 (socket says 172.21.15.50:55926) 2024-09-10T10:00:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.358+0000 7ff532800640 1 -- 172.21.15.50:0/3337736442 learned_addr learned my addr 172.21.15.50:0/3337736442 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.358+0000 7ff532800640 1 -- 172.21.15.50:0/3337736442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53419dc70 con 0x7ff534109970 2024-09-10T10:00:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.358+0000 7ff532800640 1 --2- 172.21.15.50:0/3337736442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 0x7ff53419d730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff5240097f0 tx=0x7ff524030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.359+0000 7ff52b400640 1 -- 172.21.15.50:0/3337736442 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff524042070 con 0x7ff534109970 2024-09-10T10:00:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.359+0000 7ff52b400640 1 -- 172.21.15.50:0/3337736442 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff524032be0 con 0x7ff534109970 2024-09-10T10:00:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.359+0000 7ff52b400640 1 -- 172.21.15.50:0/3337736442 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff524037040 con 0x7ff534109970 2024-09-10T10:00:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.359+0000 7ff538a00640 1 -- 172.21.15.50:0/3337736442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53419df00 con 0x7ff534109970 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.359+0000 7ff538a00640 1 -- 172.21.15.50:0/3337736442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5341a0bf0 con 0x7ff534109970 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.360+0000 7ff52b400640 1 -- 172.21.15.50:0/3337736442 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff524045070 con 0x7ff534109970 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.360+0000 7ff538a00640 1 -- 172.21.15.50:0/3337736442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff534109df0 con 0x7ff534109970 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.361+0000 7ff52b400640 1 --2- 172.21.15.50:0/3337736442 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ff518038fc0 0x7ff51803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.361+0000 7ff52b400640 1 -- 172.21.15.50:0/3337736442 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff52406bec0 con 0x7ff534109970 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.361+0000 7ff531e00640 1 --2- 172.21.15.50:0/3337736442 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ff518038fc0 0x7ff51803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.361+0000 7ff531e00640 1 --2- 172.21.15.50:0/3337736442 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ff518038fc0 0x7ff51803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff5200098c0 tx=0x7ff520006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.366+0000 7ff52b400640 1 -- 172.21.15.50:0/3337736442 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff52404b170 con 0x7ff534109970 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.551+0000 7ff538a00640 1 -- 172.21.15.50:0/3337736442 --> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7ff534107d10 con 0x7ff518038fc0 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.772+0000 7ff52b400640 1 -- 172.21.15.50:0/3337736442 <== mgr.14118 v2:172.21.15.50:6800/2344357525 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff534107d10 con 0x7ff518038fc0 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.774+0000 7ff538a00640 1 -- 172.21.15.50:0/3337736442 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ff518038fc0 msgr2=0x7ff51803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.774+0000 7ff538a00640 1 --2- 172.21.15.50:0/3337736442 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ff518038fc0 0x7ff51803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff5200098c0 tx=0x7ff520006db0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.774+0000 7ff538a00640 1 -- 172.21.15.50:0/3337736442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 msgr2=0x7ff53419d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:36.421 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.774+0000 7ff538a00640 1 --2- 172.21.15.50:0/3337736442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 0x7ff53419d730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff5240097f0 tx=0x7ff524030d80 comp rx=0 tx=0).stop 2024-09-10T10:00:36.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.774+0000 7ff538a00640 1 -- 172.21.15.50:0/3337736442 shutdown_connections 2024-09-10T10:00:36.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.774+0000 7ff538a00640 1 --2- 172.21.15.50:0/3337736442 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ff518038fc0 0x7ff51803b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.774+0000 7ff538a00640 1 --2- 172.21.15.50:0/3337736442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534109970 0x7ff53419d730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:36.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.774+0000 7ff538a00640 1 -- 172.21.15.50:0/3337736442 >> 172.21.15.50:0/3337736442 conn(0x7ff53407cca0 msgr2=0x7ff534107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:36.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.775+0000 7ff538a00640 1 -- 172.21.15.50:0/3337736442 shutdown_connections 2024-09-10T10:00:36.422 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:35.775+0000 7ff538a00640 1 -- 172.21.15.50:0/3337736442 wait complete. 2024-09-10T10:00:36.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:36 smithi050 ceph-mon[30354]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:00:36.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:36 smithi050 ceph-mon[30354]: Generating ssh key... 2024-09-10T10:00:36.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:36 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:36.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:36 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:37.710 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC78sF/H3u3+cN3C/YUrK4Vcd7gW974T5jNmP/RnNNBV9hhysiC2R6dLyb29/G8LIF5estin4Nt2PddEMarfdOg65ae5yCLgLuvjcgQ+DFO7CfZhpblGrxlFtUAnUWn+lLoTMyXNph7QxgcBfZlr4kx6+KTQaJ0vAGmVVdDqMwSPTVlmEXg2UBI6Pt2+z0MbsT55dGlRNO1LwsBoa9ihnk6gR7l3jIU6pY3JFmgVDmtw7tID4KbSYkJHl5iRYzOcrGm6GWXO2YsHracfUHkbzOa50AQyipJLrjQcLtuIMLB+hLTXXhYVCmaXm962nz/IYjZMn1ZEHQnkQynWFj+nVJGvdVhM/FO1RTf+QmpV1xOdyvymCajm6AFgxmGBTBLYG96/dGsV6mErpZXBFFxsPC1FNpqp/N2CjDhgDAhPkFEzOMEmJJnq0EvdBcg2YBCbwmdr+D20cysukOmuFxnlzw6zpuaoi0nfqfUJNdgtycyqyasRp/BnHpOpYDJtLta9sE= ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:00:37.711 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.902+0000 7fdd92800640 1 Processor -- start 2024-09-10T10:00:37.711 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.902+0000 7fdd92800640 1 -- start start 2024-09-10T10:00:37.711 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.903+0000 7fdd92800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 0x7fdd8c109d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:37.711 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.903+0000 7fdd92800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c10a310 con 0x7fdd8c109920 2024-09-10T10:00:37.711 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.903+0000 7fdd8b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 0x7fdd8c109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:37.711 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.903+0000 7fdd8b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 0x7fdd8c109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37354/0 (socket says 172.21.15.50:37354) 2024-09-10T10:00:37.711 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.903+0000 7fdd8b400640 1 -- 172.21.15.50:0/1478775436 learned_addr learned my addr 172.21.15.50:0/1478775436 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:37.711 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.904+0000 7fdd8b400640 1 -- 172.21.15.50:0/1478775436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8c10aa10 con 0x7fdd8c109920 2024-09-10T10:00:37.711 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.905+0000 7fdd8b400640 1 --2- 172.21.15.50:0/1478775436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 0x7fdd8c109d40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009820 tx=0x7fdd7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3f7b20a65bd92b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:37.711 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.905+0000 7fdd8a000640 1 -- 172.21.15.50:0/1478775436 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c037070 con 0x7fdd8c109920 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.905+0000 7fdd8a000640 1 -- 172.21.15.50:0/1478775436 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdd7c032900 con 0x7fdd8c109920 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.905+0000 7fdd8a000640 1 -- 172.21.15.50:0/1478775436 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c030850 con 0x7fdd8c109920 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.906+0000 7fdd92800640 1 -- 172.21.15.50:0/1478775436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 msgr2=0x7fdd8c109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.906+0000 7fdd92800640 1 --2- 172.21.15.50:0/1478775436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 0x7fdd8c109d40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009820 tx=0x7fdd7c02a270 comp rx=0 tx=0).stop 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.906+0000 7fdd92800640 1 -- 172.21.15.50:0/1478775436 shutdown_connections 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.906+0000 7fdd92800640 1 --2- 172.21.15.50:0/1478775436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 0x7fdd8c109d40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.906+0000 7fdd92800640 1 -- 172.21.15.50:0/1478775436 >> 172.21.15.50:0/1478775436 conn(0x7fdd8c07cf40 msgr2=0x7fdd8c07d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.906+0000 7fdd92800640 1 -- 172.21.15.50:0/1478775436 shutdown_connections 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.906+0000 7fdd92800640 1 -- 172.21.15.50:0/1478775436 wait complete. 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.907+0000 7fdd92800640 1 Processor -- start 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.907+0000 7fdd92800640 1 -- start start 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.907+0000 7fdd92800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 0x7fdd8c19d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.907+0000 7fdd92800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c10ddc0 con 0x7fdd8c109920 2024-09-10T10:00:37.712 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.908+0000 7fdd8b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 0x7fdd8c19d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:37.713 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.908+0000 7fdd8b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 0x7fdd8c19d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37360/0 (socket says 172.21.15.50:37360) 2024-09-10T10:00:37.713 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.908+0000 7fdd8b400640 1 -- 172.21.15.50:0/3186100131 learned_addr learned my addr 172.21.15.50:0/3186100131 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:37.713 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.908+0000 7fdd8b400640 1 -- 172.21.15.50:0/3186100131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8c19dd70 con 0x7fdd8c109920 2024-09-10T10:00:37.713 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.908+0000 7fdd8b400640 1 --2- 172.21.15.50:0/3186100131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 0x7fdd8c19d830 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0097f0 tx=0x7fdd7c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:37.713 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.909+0000 7fdd83e00640 1 -- 172.21.15.50:0/3186100131 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c037040 con 0x7fdd8c109920 2024-09-10T10:00:37.713 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.909+0000 7fdd83e00640 1 -- 172.21.15.50:0/3186100131 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdd7c040070 con 0x7fdd8c109920 2024-09-10T10:00:37.713 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.909+0000 7fdd83e00640 1 -- 172.21.15.50:0/3186100131 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c03a390 con 0x7fdd8c109920 2024-09-10T10:00:37.713 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.909+0000 7fdd92800640 1 -- 172.21.15.50:0/3186100131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd8c19e000 con 0x7fdd8c109920 2024-09-10T10:00:37.713 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.909+0000 7fdd92800640 1 -- 172.21.15.50:0/3186100131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd8c1a0cf0 con 0x7fdd8c109920 2024-09-10T10:00:37.713 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.910+0000 7fdd83e00640 1 -- 172.21.15.50:0/3186100131 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fdd7c03b430 con 0x7fdd8c109920 2024-09-10T10:00:37.713 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.910+0000 7fdd92800640 1 -- 172.21.15.50:0/3186100131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd8c10df40 con 0x7fdd8c109920 2024-09-10T10:00:37.713 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.910+0000 7fdd83e00640 1 --2- 172.21.15.50:0/3186100131 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fdd70038fc0 0x7fdd7003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:37.713 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.910+0000 7fdd83e00640 1 -- 172.21.15.50:0/3186100131 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fdd7c06c4e0 con 0x7fdd8c109920 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.911+0000 7fdd8aa00640 1 --2- 172.21.15.50:0/3186100131 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fdd70038fc0 0x7fdd7003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.911+0000 7fdd8aa00640 1 --2- 172.21.15.50:0/3186100131 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fdd70038fc0 0x7fdd7003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdd780098c0 tx=0x7fdd78006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:36.916+0000 7fdd83e00640 1 -- 172.21.15.50:0/3186100131 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd7c06be30 con 0x7fdd8c109920 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:37.105+0000 7fdd92800640 1 -- 172.21.15.50:0/3186100131 --> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fdd8c107c50 con 0x7fdd70038fc0 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:37.106+0000 7fdd83e00640 1 -- 172.21.15.50:0/3186100131 <== mgr.14118 v2:172.21.15.50:6800/2344357525 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fdd8c107c50 con 0x7fdd70038fc0 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:37.108+0000 7fdd92800640 1 -- 172.21.15.50:0/3186100131 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fdd70038fc0 msgr2=0x7fdd7003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:37.108+0000 7fdd92800640 1 --2- 172.21.15.50:0/3186100131 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fdd70038fc0 0x7fdd7003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdd780098c0 tx=0x7fdd78006db0 comp rx=0 tx=0).stop 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:37.108+0000 7fdd92800640 1 -- 172.21.15.50:0/3186100131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 msgr2=0x7fdd8c19d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:37.108+0000 7fdd92800640 1 --2- 172.21.15.50:0/3186100131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 0x7fdd8c19d830 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0097f0 tx=0x7fdd7c030d80 comp rx=0 tx=0).stop 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:37.108+0000 7fdd92800640 1 -- 172.21.15.50:0/3186100131 shutdown_connections 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:37.108+0000 7fdd92800640 1 --2- 172.21.15.50:0/3186100131 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fdd70038fc0 0x7fdd7003b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:37.108+0000 7fdd92800640 1 --2- 172.21.15.50:0/3186100131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd8c109920 0x7fdd8c19d830 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:37.108+0000 7fdd92800640 1 -- 172.21.15.50:0/3186100131 >> 172.21.15.50:0/3186100131 conn(0x7fdd8c07cf40 msgr2=0x7fdd8c107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:37.714 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:37.108+0000 7fdd92800640 1 -- 172.21.15.50:0/3186100131 shutdown_connections 2024-09-10T10:00:37.715 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:37.108+0000 7fdd92800640 1 -- 172.21.15.50:0/3186100131 wait complete. 2024-09-10T10:00:37.715 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T10:00:37.715 INFO:teuthology.orchestra.run.smithi050.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T10:00:37.717 INFO:teuthology.orchestra.run.smithi050.stdout:Adding host smithi050... 2024-09-10T10:00:37.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:37 smithi050 ceph-mon[30354]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:00:39.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:39 smithi050 ceph-mon[30354]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi050", "addr": "172.21.15.50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:00:40.359 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:40 smithi050 ceph-mon[30354]: Deploying cephadm binary to smithi050 2024-09-10T10:00:43.664 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Added host 'smithi050' with addr '172.21.15.50' 2024-09-10T10:00:43.664 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.262+0000 7fe767200640 1 Processor -- start 2024-09-10T10:00:43.664 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.262+0000 7fe767200640 1 -- start start 2024-09-10T10:00:43.664 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.262+0000 7fe767200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 0x7fe760107a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:43.664 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.262+0000 7fe767200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe760107fc0 con 0x7fe760107680 2024-09-10T10:00:43.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.263+0000 7fe75fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 0x7fe760107a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:43.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.263+0000 7fe75fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 0x7fe760107a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37376/0 (socket says 172.21.15.50:37376) 2024-09-10T10:00:43.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.263+0000 7fe75fe00640 1 -- 172.21.15.50:0/2446498279 learned_addr learned my addr 172.21.15.50:0/2446498279 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:43.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.263+0000 7fe75fe00640 1 -- 172.21.15.50:0/2446498279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe760108140 con 0x7fe760107680 2024-09-10T10:00:43.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.264+0000 7fe75fe00640 1 --2- 172.21.15.50:0/2446498279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 0x7fe760107a80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe750009820 tx=0x7fe75002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0a1bd8312c45ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:43.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.265+0000 7fe75ea00640 1 -- 172.21.15.50:0/2446498279 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe750037070 con 0x7fe760107680 2024-09-10T10:00:43.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.265+0000 7fe75ea00640 1 -- 172.21.15.50:0/2446498279 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe750032900 con 0x7fe760107680 2024-09-10T10:00:43.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.265+0000 7fe75ea00640 1 -- 172.21.15.50:0/2446498279 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe750030850 con 0x7fe760107680 2024-09-10T10:00:43.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.265+0000 7fe767200640 1 -- 172.21.15.50:0/2446498279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 msgr2=0x7fe760107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:43.665 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.265+0000 7fe767200640 1 --2- 172.21.15.50:0/2446498279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 0x7fe760107a80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe750009820 tx=0x7fe75002a270 comp rx=0 tx=0).stop 2024-09-10T10:00:43.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.265+0000 7fe767200640 1 -- 172.21.15.50:0/2446498279 shutdown_connections 2024-09-10T10:00:43.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.265+0000 7fe767200640 1 --2- 172.21.15.50:0/2446498279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 0x7fe760107a80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.265+0000 7fe767200640 1 -- 172.21.15.50:0/2446498279 >> 172.21.15.50:0/2446498279 conn(0x7fe760102eb0 msgr2=0x7fe7601052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:43.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.265+0000 7fe767200640 1 -- 172.21.15.50:0/2446498279 shutdown_connections 2024-09-10T10:00:43.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.265+0000 7fe767200640 1 -- 172.21.15.50:0/2446498279 wait complete. 2024-09-10T10:00:43.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.266+0000 7fe767200640 1 Processor -- start 2024-09-10T10:00:43.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.267+0000 7fe767200640 1 -- start start 2024-09-10T10:00:43.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.267+0000 7fe767200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 0x7fe76019d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:43.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.267+0000 7fe767200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe76010baf0 con 0x7fe760107680 2024-09-10T10:00:43.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.267+0000 7fe75fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 0x7fe76019d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:43.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.267+0000 7fe75fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 0x7fe76019d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37378/0 (socket says 172.21.15.50:37378) 2024-09-10T10:00:43.666 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.267+0000 7fe75fe00640 1 -- 172.21.15.50:0/2237099758 learned_addr learned my addr 172.21.15.50:0/2237099758 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:43.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.267+0000 7fe75fe00640 1 -- 172.21.15.50:0/2237099758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76019dde0 con 0x7fe760107680 2024-09-10T10:00:43.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.268+0000 7fe75fe00640 1 --2- 172.21.15.50:0/2237099758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 0x7fe76019d8a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe7500097f0 tx=0x7fe750030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:43.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.268+0000 7fe75cc00640 1 -- 172.21.15.50:0/2237099758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe750042070 con 0x7fe760107680 2024-09-10T10:00:43.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.268+0000 7fe75cc00640 1 -- 172.21.15.50:0/2237099758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe750032ca0 con 0x7fe760107680 2024-09-10T10:00:43.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.268+0000 7fe75cc00640 1 -- 172.21.15.50:0/2237099758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe750037040 con 0x7fe760107680 2024-09-10T10:00:43.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.268+0000 7fe767200640 1 -- 172.21.15.50:0/2237099758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76019e070 con 0x7fe760107680 2024-09-10T10:00:43.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.268+0000 7fe767200640 1 -- 172.21.15.50:0/2237099758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7601a0d60 con 0x7fe760107680 2024-09-10T10:00:43.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.269+0000 7fe75cc00640 1 -- 172.21.15.50:0/2237099758 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe750045070 con 0x7fe760107680 2024-09-10T10:00:43.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.269+0000 7fe767200640 1 -- 172.21.15.50:0/2237099758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe760107b00 con 0x7fe760107680 2024-09-10T10:00:43.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.270+0000 7fe75cc00640 1 --2- 172.21.15.50:0/2237099758 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fe744038f70 0x7fe74403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:43.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.270+0000 7fe75cc00640 1 -- 172.21.15.50:0/2237099758 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe75006c020 con 0x7fe760107680 2024-09-10T10:00:43.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.270+0000 7fe75f400640 1 --2- 172.21.15.50:0/2237099758 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fe744038f70 0x7fe74403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:43.667 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.271+0000 7fe75f400640 1 --2- 172.21.15.50:0/2237099758 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fe744038f70 0x7fe74403b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0098c0 tx=0x7fe74c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:43.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.275+0000 7fe75cc00640 1 -- 172.21.15.50:0/2237099758 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe750045360 con 0x7fe760107680 2024-09-10T10:00:43.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:38.462+0000 7fe767200640 1 -- 172.21.15.50:0/2237099758 --> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi050", "addr": "172.21.15.50", "target": ["mon-mgr", ""]}) -- 0x7fe7601040c0 con 0x7fe744038f70 2024-09-10T10:00:43.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:42.944+0000 7fe75cc00640 1 -- 172.21.15.50:0/2237099758 <== mgr.14118 v2:172.21.15.50:6800/2344357525 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fe7601040c0 con 0x7fe744038f70 2024-09-10T10:00:43.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:42.947+0000 7fe767200640 1 -- 172.21.15.50:0/2237099758 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fe744038f70 msgr2=0x7fe74403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:43.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:42.947+0000 7fe767200640 1 --2- 172.21.15.50:0/2237099758 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fe744038f70 0x7fe74403b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0098c0 tx=0x7fe74c006db0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:42.947+0000 7fe767200640 1 -- 172.21.15.50:0/2237099758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 msgr2=0x7fe76019d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:43.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:42.947+0000 7fe767200640 1 --2- 172.21.15.50:0/2237099758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 0x7fe76019d8a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe7500097f0 tx=0x7fe750030ec0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:42.948+0000 7fe767200640 1 -- 172.21.15.50:0/2237099758 shutdown_connections 2024-09-10T10:00:43.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:42.948+0000 7fe767200640 1 --2- 172.21.15.50:0/2237099758 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fe744038f70 0x7fe74403b430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:42.948+0000 7fe767200640 1 --2- 172.21.15.50:0/2237099758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe760107680 0x7fe76019d8a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:43.668 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:42.948+0000 7fe767200640 1 -- 172.21.15.50:0/2237099758 >> 172.21.15.50:0/2237099758 conn(0x7fe760102eb0 msgr2=0x7fe7601039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:43.669 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:42.948+0000 7fe767200640 1 -- 172.21.15.50:0/2237099758 shutdown_connections 2024-09-10T10:00:43.669 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:42.948+0000 7fe767200640 1 -- 172.21.15.50:0/2237099758 wait complete. 2024-09-10T10:00:43.669 INFO:teuthology.orchestra.run.smithi050.stdout:Deploying unmanaged mon service... 2024-09-10T10:00:44.158 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:43 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:44.158 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:43 smithi050 ceph-mon[30354]: Added host smithi050 2024-09-10T10:00:44.158 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:43 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:00:45.251 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T10:00:45.251 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.143+0000 7f2886c00640 1 Processor -- start 2024-09-10T10:00:45.251 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.143+0000 7f2886c00640 1 -- start start 2024-09-10T10:00:45.251 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.144+0000 7f2886c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 0x7f2880107aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:45.251 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.144+0000 7f2886c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2880108070 con 0x7f28801076a0 2024-09-10T10:00:45.251 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.144+0000 7f287fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 0x7f2880107aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:45.251 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.144+0000 7f287fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 0x7f2880107aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37384/0 (socket says 172.21.15.50:37384) 2024-09-10T10:00:45.251 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.144+0000 7f287fe00640 1 -- 172.21.15.50:0/1284093024 learned_addr learned my addr 172.21.15.50:0/1284093024 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:45.251 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.145+0000 7f287fe00640 1 -- 172.21.15.50:0/1284093024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2880108800 con 0x7f28801076a0 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.145+0000 7f287fe00640 1 --2- 172.21.15.50:0/1284093024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 0x7f2880107aa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2870009820 tx=0x7f287002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1e4963cc53359a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.146+0000 7f287f400640 1 -- 172.21.15.50:0/1284093024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2870037070 con 0x7f28801076a0 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.146+0000 7f287f400640 1 -- 172.21.15.50:0/1284093024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2870032900 con 0x7f28801076a0 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.146+0000 7f287f400640 1 -- 172.21.15.50:0/1284093024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2870030850 con 0x7f28801076a0 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.146+0000 7f2886c00640 1 -- 172.21.15.50:0/1284093024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 msgr2=0x7f2880107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.146+0000 7f2886c00640 1 --2- 172.21.15.50:0/1284093024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 0x7f2880107aa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2870009820 tx=0x7f287002a270 comp rx=0 tx=0).stop 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.146+0000 7f2886c00640 1 -- 172.21.15.50:0/1284093024 shutdown_connections 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.147+0000 7f2886c00640 1 --2- 172.21.15.50:0/1284093024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 0x7f2880107aa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.147+0000 7f2886c00640 1 -- 172.21.15.50:0/1284093024 >> 172.21.15.50:0/1284093024 conn(0x7f2880102e50 msgr2=0x7f2880105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.147+0000 7f2886c00640 1 -- 172.21.15.50:0/1284093024 shutdown_connections 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.147+0000 7f2886c00640 1 -- 172.21.15.50:0/1284093024 wait complete. 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.148+0000 7f2886c00640 1 Processor -- start 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.148+0000 7f2886c00640 1 -- start start 2024-09-10T10:00:45.252 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.148+0000 7f2886c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 0x7f288019d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:45.253 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.148+0000 7f2886c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f288010bbb0 con 0x7f28801076a0 2024-09-10T10:00:45.253 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.148+0000 7f287fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 0x7f288019d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:45.253 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.148+0000 7f287fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 0x7f288019d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37388/0 (socket says 172.21.15.50:37388) 2024-09-10T10:00:45.253 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.148+0000 7f287fe00640 1 -- 172.21.15.50:0/1849195104 learned_addr learned my addr 172.21.15.50:0/1849195104 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:45.253 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.149+0000 7f287fe00640 1 -- 172.21.15.50:0/1849195104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288019de00 con 0x7f28801076a0 2024-09-10T10:00:45.253 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.149+0000 7f287fe00640 1 --2- 172.21.15.50:0/1849195104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 0x7f288019d8c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28700097f0 tx=0x7f2870030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:45.253 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.149+0000 7f287d600640 1 -- 172.21.15.50:0/1849195104 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2870042070 con 0x7f28801076a0 2024-09-10T10:00:45.253 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.149+0000 7f287d600640 1 -- 172.21.15.50:0/1849195104 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2870032ca0 con 0x7f28801076a0 2024-09-10T10:00:45.253 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.149+0000 7f287d600640 1 -- 172.21.15.50:0/1849195104 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2870037040 con 0x7f28801076a0 2024-09-10T10:00:45.253 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.149+0000 7f2886c00640 1 -- 172.21.15.50:0/1849195104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f288019e090 con 0x7f28801076a0 2024-09-10T10:00:45.253 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.149+0000 7f2886c00640 1 -- 172.21.15.50:0/1849195104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28801a0d80 con 0x7f28801076a0 2024-09-10T10:00:45.253 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.150+0000 7f287d600640 1 -- 172.21.15.50:0/1849195104 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2870045070 con 0x7f28801076a0 2024-09-10T10:00:45.254 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.151+0000 7f2886c00640 1 -- 172.21.15.50:0/1849195104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f288010bd30 con 0x7f28801076a0 2024-09-10T10:00:45.254 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.151+0000 7f287d600640 1 --2- 172.21.15.50:0/1849195104 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f2864038fc0 0x7f286403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:45.254 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.151+0000 7f287d600640 1 -- 172.21.15.50:0/1849195104 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f287006bf40 con 0x7f28801076a0 2024-09-10T10:00:45.254 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.151+0000 7f2877e00640 1 --2- 172.21.15.50:0/1849195104 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f2864038fc0 0x7f286403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:45.254 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.152+0000 7f2877e00640 1 --2- 172.21.15.50:0/1849195104 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f2864038fc0 0x7f286403b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f28680098c0 tx=0x7f2868006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:45.254 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.157+0000 7f287d600640 1 -- 172.21.15.50:0/1849195104 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f287004b170 con 0x7f28801076a0 2024-09-10T10:00:45.254 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.358+0000 7f2886c00640 1 -- 172.21.15.50:0/1849195104 --> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f28801040d0 con 0x7f2864038fc0 2024-09-10T10:00:45.254 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.364+0000 7f287d600640 1 -- 172.21.15.50:0/1849195104 <== mgr.14118 v2:172.21.15.50:6800/2344357525 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f28801040d0 con 0x7f2864038fc0 2024-09-10T10:00:45.254 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.366+0000 7f2886c00640 1 -- 172.21.15.50:0/1849195104 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f2864038fc0 msgr2=0x7f286403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:45.254 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.366+0000 7f2886c00640 1 --2- 172.21.15.50:0/1849195104 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f2864038fc0 0x7f286403b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f28680098c0 tx=0x7f2868006db0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.254 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.366+0000 7f2886c00640 1 -- 172.21.15.50:0/1849195104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 msgr2=0x7f288019d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:45.255 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.366+0000 7f2886c00640 1 --2- 172.21.15.50:0/1849195104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 0x7f288019d8c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28700097f0 tx=0x7f2870030ec0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.255 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.366+0000 7f2886c00640 1 -- 172.21.15.50:0/1849195104 shutdown_connections 2024-09-10T10:00:45.255 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.366+0000 7f2886c00640 1 --2- 172.21.15.50:0/1849195104 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f2864038fc0 0x7f286403b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.255 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.366+0000 7f2886c00640 1 --2- 172.21.15.50:0/1849195104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28801076a0 0x7f288019d8c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:45.255 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.366+0000 7f2886c00640 1 -- 172.21.15.50:0/1849195104 >> 172.21.15.50:0/1849195104 conn(0x7f2880102e50 msgr2=0x7f28801039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:45.255 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.366+0000 7f2886c00640 1 -- 172.21.15.50:0/1849195104 shutdown_connections 2024-09-10T10:00:45.255 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:44.367+0000 7f2886c00640 1 -- 172.21.15.50:0/1849195104 wait complete. 2024-09-10T10:00:45.255 INFO:teuthology.orchestra.run.smithi050.stdout:Deploying unmanaged mgr service... 2024-09-10T10:00:45.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:45 smithi050 ceph-mon[30354]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:00:45.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:45 smithi050 ceph-mon[30354]: Saving service mon spec with placement count:5 2024-09-10T10:00:45.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:45 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:46.877 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T10:00:46.877 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.902+0000 7fce2b000640 1 Processor -- start 2024-09-10T10:00:46.877 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.902+0000 7fce2b000640 1 -- start start 2024-09-10T10:00:46.877 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.903+0000 7fce2b000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 0x7fce24107a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:46.877 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.903+0000 7fce2b000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce24107fc0 con 0x7fce24107680 2024-09-10T10:00:46.877 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.903+0000 7fce23e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 0x7fce24107a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:46.877 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.903+0000 7fce23e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 0x7fce24107a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37392/0 (socket says 172.21.15.50:37392) 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.903+0000 7fce23e00640 1 -- 172.21.15.50:0/2432390971 learned_addr learned my addr 172.21.15.50:0/2432390971 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.903+0000 7fce23e00640 1 -- 172.21.15.50:0/2432390971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce24108140 con 0x7fce24107680 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.904+0000 7fce23e00640 1 --2- 172.21.15.50:0/2432390971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 0x7fce24107a80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fce14009820 tx=0x7fce1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb454a13170e66c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.905+0000 7fce23400640 1 -- 172.21.15.50:0/2432390971 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce14037070 con 0x7fce24107680 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.905+0000 7fce23400640 1 -- 172.21.15.50:0/2432390971 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce14032900 con 0x7fce24107680 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.905+0000 7fce23400640 1 -- 172.21.15.50:0/2432390971 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce14030850 con 0x7fce24107680 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.905+0000 7fce2b000640 1 -- 172.21.15.50:0/2432390971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 msgr2=0x7fce24107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.905+0000 7fce2b000640 1 --2- 172.21.15.50:0/2432390971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 0x7fce24107a80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fce14009820 tx=0x7fce1402a270 comp rx=0 tx=0).stop 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.905+0000 7fce2b000640 1 -- 172.21.15.50:0/2432390971 shutdown_connections 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.905+0000 7fce2b000640 1 --2- 172.21.15.50:0/2432390971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 0x7fce24107a80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.905+0000 7fce2b000640 1 -- 172.21.15.50:0/2432390971 >> 172.21.15.50:0/2432390971 conn(0x7fce24102eb0 msgr2=0x7fce241052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.905+0000 7fce2b000640 1 -- 172.21.15.50:0/2432390971 shutdown_connections 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.905+0000 7fce2b000640 1 -- 172.21.15.50:0/2432390971 wait complete. 2024-09-10T10:00:46.878 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.906+0000 7fce2b000640 1 Processor -- start 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.906+0000 7fce2b000640 1 -- start start 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.907+0000 7fce2b000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 0x7fce2419d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.907+0000 7fce2b000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce2410baf0 con 0x7fce24107680 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.907+0000 7fce23e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 0x7fce2419d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.907+0000 7fce23e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 0x7fce2419d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37400/0 (socket says 172.21.15.50:37400) 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.907+0000 7fce23e00640 1 -- 172.21.15.50:0/2270979999 learned_addr learned my addr 172.21.15.50:0/2270979999 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.907+0000 7fce23e00640 1 -- 172.21.15.50:0/2270979999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2419dde0 con 0x7fce24107680 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.908+0000 7fce23e00640 1 --2- 172.21.15.50:0/2270979999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 0x7fce2419d8a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fce140097f0 tx=0x7fce14030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.908+0000 7fce21600640 1 -- 172.21.15.50:0/2270979999 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce14042070 con 0x7fce24107680 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.908+0000 7fce21600640 1 -- 172.21.15.50:0/2270979999 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce14032ca0 con 0x7fce24107680 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.908+0000 7fce21600640 1 -- 172.21.15.50:0/2270979999 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce14037040 con 0x7fce24107680 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.908+0000 7fce2b000640 1 -- 172.21.15.50:0/2270979999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2419e070 con 0x7fce24107680 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.908+0000 7fce2b000640 1 -- 172.21.15.50:0/2270979999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce241a0d60 con 0x7fce24107680 2024-09-10T10:00:46.879 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.909+0000 7fce21600640 1 -- 172.21.15.50:0/2270979999 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fce14045070 con 0x7fce24107680 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.909+0000 7fce2b000640 1 -- 172.21.15.50:0/2270979999 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce24107b00 con 0x7fce24107680 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.910+0000 7fce21600640 1 --2- 172.21.15.50:0/2270979999 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fce08038fc0 0x7fce0803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.910+0000 7fce21600640 1 -- 172.21.15.50:0/2270979999 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fce1406bfe0 con 0x7fce24107680 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.910+0000 7fce1be00640 1 --2- 172.21.15.50:0/2270979999 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fce08038fc0 0x7fce0803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.911+0000 7fce1be00640 1 --2- 172.21.15.50:0/2270979999 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fce08038fc0 0x7fce0803b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0098c0 tx=0x7fce0c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:45.915+0000 7fce21600640 1 -- 172.21.15.50:0/2270979999 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce14045360 con 0x7fce24107680 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:46.114+0000 7fce2b000640 1 -- 172.21.15.50:0/2270979999 --> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fce241040c0 con 0x7fce08038fc0 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:46.119+0000 7fce21600640 1 -- 172.21.15.50:0/2270979999 <== mgr.14118 v2:172.21.15.50:6800/2344357525 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fce241040c0 con 0x7fce08038fc0 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:46.121+0000 7fce2b000640 1 -- 172.21.15.50:0/2270979999 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fce08038fc0 msgr2=0x7fce0803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:46.121+0000 7fce2b000640 1 --2- 172.21.15.50:0/2270979999 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fce08038fc0 0x7fce0803b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0098c0 tx=0x7fce0c006db0 comp rx=0 tx=0).stop 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:46.121+0000 7fce2b000640 1 -- 172.21.15.50:0/2270979999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 msgr2=0x7fce2419d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:46.121+0000 7fce2b000640 1 --2- 172.21.15.50:0/2270979999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 0x7fce2419d8a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fce140097f0 tx=0x7fce14030ec0 comp rx=0 tx=0).stop 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:46.121+0000 7fce2b000640 1 -- 172.21.15.50:0/2270979999 shutdown_connections 2024-09-10T10:00:46.880 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:46.121+0000 7fce2b000640 1 --2- 172.21.15.50:0/2270979999 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fce08038fc0 0x7fce0803b480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:46.881 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:46.121+0000 7fce2b000640 1 --2- 172.21.15.50:0/2270979999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce24107680 0x7fce2419d8a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:46.881 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:46.121+0000 7fce2b000640 1 -- 172.21.15.50:0/2270979999 >> 172.21.15.50:0/2270979999 conn(0x7fce24102eb0 msgr2=0x7fce241039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:46.881 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:46.121+0000 7fce2b000640 1 -- 172.21.15.50:0/2270979999 shutdown_connections 2024-09-10T10:00:46.881 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:46.121+0000 7fce2b000640 1 -- 172.21.15.50:0/2270979999 wait complete. 2024-09-10T10:00:47.405 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:47 smithi050 ceph-mon[30354]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:00:47.405 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:47 smithi050 ceph-mon[30354]: Saving service mgr spec with placement count:2 2024-09-10T10:00:47.405 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:47 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:48.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:48 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:48.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:48 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:48.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:48 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2361500250' entity='client.admin' 2024-09-10T10:00:48.770 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.850+0000 7f846d000640 1 Processor -- start 2024-09-10T10:00:48.770 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.850+0000 7f846d000640 1 -- start start 2024-09-10T10:00:48.770 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.850+0000 7f846d000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 0x7f8468109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:48.770 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.850+0000 7f846d000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f846810a290 con 0x7f84681098c0 2024-09-10T10:00:48.770 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.851+0000 7f8465e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 0x7f8468109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:48.771 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.851+0000 7f8465e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 0x7f8468109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41280/0 (socket says 172.21.15.50:41280) 2024-09-10T10:00:48.771 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.851+0000 7f8465e00640 1 -- 172.21.15.50:0/1664936751 learned_addr learned my addr 172.21.15.50:0/1664936751 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:48.771 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.851+0000 7f8465e00640 1 -- 172.21.15.50:0/1664936751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846810aa70 con 0x7f84681098c0 2024-09-10T10:00:48.771 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.853+0000 7f8465e00640 1 --2- 172.21.15.50:0/1664936751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 0x7f8468109cc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8458009820 tx=0x7f845802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6266d1cf10f689 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:48.771 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.853+0000 7f8464a00640 1 -- 172.21.15.50:0/1664936751 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8458037070 con 0x7f84681098c0 2024-09-10T10:00:48.771 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.853+0000 7f8464a00640 1 -- 172.21.15.50:0/1664936751 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8458032920 con 0x7f84681098c0 2024-09-10T10:00:48.771 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.853+0000 7f8464a00640 1 -- 172.21.15.50:0/1664936751 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8458030810 con 0x7f84681098c0 2024-09-10T10:00:48.771 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.854+0000 7f846d000640 1 -- 172.21.15.50:0/1664936751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 msgr2=0x7f8468109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:48.771 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.854+0000 7f846d000640 1 --2- 172.21.15.50:0/1664936751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 0x7f8468109cc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8458009820 tx=0x7f845802a270 comp rx=0 tx=0).stop 2024-09-10T10:00:48.771 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.854+0000 7f846d000640 1 -- 172.21.15.50:0/1664936751 shutdown_connections 2024-09-10T10:00:48.771 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.854+0000 7f846d000640 1 --2- 172.21.15.50:0/1664936751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 0x7f8468109cc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:48.772 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.854+0000 7f846d000640 1 -- 172.21.15.50:0/1664936751 >> 172.21.15.50:0/1664936751 conn(0x7f846807cf40 msgr2=0x7f846807d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:48.772 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.854+0000 7f846d000640 1 -- 172.21.15.50:0/1664936751 shutdown_connections 2024-09-10T10:00:48.772 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.854+0000 7f846d000640 1 -- 172.21.15.50:0/1664936751 wait complete. 2024-09-10T10:00:48.772 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.855+0000 7f846d000640 1 Processor -- start 2024-09-10T10:00:48.772 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.855+0000 7f846d000640 1 -- start start 2024-09-10T10:00:48.772 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.855+0000 7f846d000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 0x7f846819d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:48.772 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.855+0000 7f846d000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f846810de20 con 0x7f84681098c0 2024-09-10T10:00:48.772 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.856+0000 7f8465e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 0x7f846819d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:48.772 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.856+0000 7f8465e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 0x7f846819d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41294/0 (socket says 172.21.15.50:41294) 2024-09-10T10:00:48.772 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.856+0000 7f8465e00640 1 -- 172.21.15.50:0/2361500250 learned_addr learned my addr 172.21.15.50:0/2361500250 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:48.773 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.856+0000 7f8465e00640 1 -- 172.21.15.50:0/2361500250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846819ddf0 con 0x7f84681098c0 2024-09-10T10:00:48.773 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.856+0000 7f8465e00640 1 --2- 172.21.15.50:0/2361500250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 0x7f846819d8b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f84580097f0 tx=0x7f84580327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:48.773 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.857+0000 7f845ea00640 1 -- 172.21.15.50:0/2361500250 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8458037040 con 0x7f84681098c0 2024-09-10T10:00:48.773 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.857+0000 7f845ea00640 1 -- 172.21.15.50:0/2361500250 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8458030cc0 con 0x7f84681098c0 2024-09-10T10:00:48.773 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.857+0000 7f845ea00640 1 -- 172.21.15.50:0/2361500250 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f845803a640 con 0x7f84681098c0 2024-09-10T10:00:48.773 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.857+0000 7f846d000640 1 -- 172.21.15.50:0/2361500250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846819e080 con 0x7f84681098c0 2024-09-10T10:00:48.773 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.857+0000 7f846d000640 1 -- 172.21.15.50:0/2361500250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84681a0d70 con 0x7f84681098c0 2024-09-10T10:00:48.773 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.858+0000 7f845ea00640 1 -- 172.21.15.50:0/2361500250 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f845803b3f0 con 0x7f84681098c0 2024-09-10T10:00:48.773 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.858+0000 7f8453e00640 1 -- 172.21.15.50:0/2361500250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8468109d40 con 0x7f84681098c0 2024-09-10T10:00:48.773 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.859+0000 7f845ea00640 1 --2- 172.21.15.50:0/2361500250 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f844c038fc0 0x7f844c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:48.773 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.859+0000 7f845ea00640 1 -- 172.21.15.50:0/2361500250 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f845806c5a0 con 0x7f84681098c0 2024-09-10T10:00:48.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.859+0000 7f8465400640 1 --2- 172.21.15.50:0/2361500250 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f844c038fc0 0x7f844c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:48.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.860+0000 7f8465400640 1 --2- 172.21.15.50:0/2361500250 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f844c038fc0 0x7f844c03b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f84540098c0 tx=0x7f8454006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:48.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:47.864+0000 7f845ea00640 1 -- 172.21.15.50:0/2361500250 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8458038250 con 0x7f84681098c0 2024-09-10T10:00:48.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:48.055+0000 7f8453e00640 1 -- 172.21.15.50:0/2361500250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f8468062630 con 0x7f84681098c0 2024-09-10T10:00:48.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:48.058+0000 7f845ea00640 1 -- 172.21.15.50:0/2361500250 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f845803ba40 con 0x7f84681098c0 2024-09-10T10:00:48.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:48.061+0000 7f8453e00640 1 -- 172.21.15.50:0/2361500250 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f844c038fc0 msgr2=0x7f844c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:48.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:48.061+0000 7f8453e00640 1 --2- 172.21.15.50:0/2361500250 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f844c038fc0 0x7f844c03b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f84540098c0 tx=0x7f8454006db0 comp rx=0 tx=0).stop 2024-09-10T10:00:48.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:48.061+0000 7f8453e00640 1 -- 172.21.15.50:0/2361500250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 msgr2=0x7f846819d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:48.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:48.061+0000 7f8453e00640 1 --2- 172.21.15.50:0/2361500250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 0x7f846819d8b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f84580097f0 tx=0x7f84580327b0 comp rx=0 tx=0).stop 2024-09-10T10:00:48.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:48.061+0000 7f8453e00640 1 -- 172.21.15.50:0/2361500250 shutdown_connections 2024-09-10T10:00:48.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:48.061+0000 7f8453e00640 1 --2- 172.21.15.50:0/2361500250 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f844c038fc0 0x7f844c03b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:48.774 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:48.061+0000 7f8453e00640 1 --2- 172.21.15.50:0/2361500250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681098c0 0x7f846819d8b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:48.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:48.061+0000 7f8453e00640 1 -- 172.21.15.50:0/2361500250 >> 172.21.15.50:0/2361500250 conn(0x7f846807cf40 msgr2=0x7f8468107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:48.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:48.061+0000 7f8453e00640 1 -- 172.21.15.50:0/2361500250 shutdown_connections 2024-09-10T10:00:48.775 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:48.061+0000 7f8453e00640 1 -- 172.21.15.50:0/2361500250 wait complete. 2024-09-10T10:00:50.741 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:50 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2766088663' entity='client.admin' 2024-09-10T10:00:50.741 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:50 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:50.746 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.274+0000 7f7505400640 1 Processor -- start 2024-09-10T10:00:50.746 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.274+0000 7f7505400640 1 -- start start 2024-09-10T10:00:50.746 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.275+0000 7f7505400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 0x7f7500107a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:50.746 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.275+0000 7f7505400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7500108050 con 0x7f7500107680 2024-09-10T10:00:50.746 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.275+0000 7f74fe800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 0x7f7500107a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:50.746 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.275+0000 7f74fe800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 0x7f7500107a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41308/0 (socket says 172.21.15.50:41308) 2024-09-10T10:00:50.746 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.275+0000 7f74fe800640 1 -- 172.21.15.50:0/3246358539 learned_addr learned my addr 172.21.15.50:0/3246358539 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:50.746 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.276+0000 7f74fe800640 1 -- 172.21.15.50:0/3246358539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7500108830 con 0x7f7500107680 2024-09-10T10:00:50.746 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.277+0000 7f74fe800640 1 --2- 172.21.15.50:0/3246358539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 0x7f7500107a80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009820 tx=0x7f74f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3709799741f6680c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:50.746 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.277+0000 7f74fde00640 1 -- 172.21.15.50:0/3246358539 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f0037070 con 0x7f7500107680 2024-09-10T10:00:50.746 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.277+0000 7f74fde00640 1 -- 172.21.15.50:0/3246358539 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74f0032920 con 0x7f7500107680 2024-09-10T10:00:50.747 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.277+0000 7f74fde00640 1 -- 172.21.15.50:0/3246358539 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f0030810 con 0x7f7500107680 2024-09-10T10:00:50.747 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.278+0000 7f7505400640 1 -- 172.21.15.50:0/3246358539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 msgr2=0x7f7500107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:50.747 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.278+0000 7f7505400640 1 --2- 172.21.15.50:0/3246358539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 0x7f7500107a80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009820 tx=0x7f74f002a270 comp rx=0 tx=0).stop 2024-09-10T10:00:50.747 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.278+0000 7f7505400640 1 -- 172.21.15.50:0/3246358539 shutdown_connections 2024-09-10T10:00:50.747 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.278+0000 7f7505400640 1 --2- 172.21.15.50:0/3246358539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 0x7f7500107a80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:50.747 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.278+0000 7f7505400640 1 -- 172.21.15.50:0/3246358539 >> 172.21.15.50:0/3246358539 conn(0x7f7500102e50 msgr2=0x7f7500105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:50.747 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.278+0000 7f7505400640 1 -- 172.21.15.50:0/3246358539 shutdown_connections 2024-09-10T10:00:50.747 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.278+0000 7f7505400640 1 -- 172.21.15.50:0/3246358539 wait complete. 2024-09-10T10:00:50.747 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.279+0000 7f7505400640 1 Processor -- start 2024-09-10T10:00:50.747 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.279+0000 7f7505400640 1 -- start start 2024-09-10T10:00:50.747 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.279+0000 7f7505400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 0x7f750007db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:50.747 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.279+0000 7f7505400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f750010bbe0 con 0x7f7500107680 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.280+0000 7f74fe800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 0x7f750007db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.280+0000 7f74fe800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 0x7f750007db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41310/0 (socket says 172.21.15.50:41310) 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.280+0000 7f74fe800640 1 -- 172.21.15.50:0/2766088663 learned_addr learned my addr 172.21.15.50:0/2766088663 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.280+0000 7f74fe800640 1 -- 172.21.15.50:0/2766088663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750007e0b0 con 0x7f7500107680 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.280+0000 7f74fe800640 1 --2- 172.21.15.50:0/2766088663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 0x7f750007db70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74f00097f0 tx=0x7f74f00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.281+0000 7f74f7400640 1 -- 172.21.15.50:0/2766088663 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f0037040 con 0x7f7500107680 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.281+0000 7f74f7400640 1 -- 172.21.15.50:0/2766088663 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74f0030c40 con 0x7f7500107680 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.281+0000 7f7505400640 1 -- 172.21.15.50:0/2766088663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f750007c2a0 con 0x7f7500107680 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.281+0000 7f74f7400640 1 -- 172.21.15.50:0/2766088663 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74f003a5b0 con 0x7f7500107680 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.281+0000 7f7505400640 1 -- 172.21.15.50:0/2766088663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f750007c7e0 con 0x7f7500107680 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.282+0000 7f74f7400640 1 -- 172.21.15.50:0/2766088663 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f74f003b3f0 con 0x7f7500107680 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.282+0000 7f7505400640 1 -- 172.21.15.50:0/2766088663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7500107b00 con 0x7f7500107680 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.283+0000 7f74f7400640 1 --2- 172.21.15.50:0/2766088663 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f74e4038f70 0x7f74e403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:50.748 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.283+0000 7f74f7400640 1 -- 172.21.15.50:0/2766088663 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f74f006c490 con 0x7f7500107680 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.283+0000 7f74f7e00640 1 --2- 172.21.15.50:0/2766088663 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f74e4038f70 0x7f74e403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.284+0000 7f74f7e00640 1 --2- 172.21.15.50:0/2766088663 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f74e4038f70 0x7f74e403b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f74e80098c0 tx=0x7f74e8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.288+0000 7f74f7400640 1 -- 172.21.15.50:0/2766088663 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f74f00371e0 con 0x7f7500107680 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.484+0000 7f7505400640 1 -- 172.21.15.50:0/2766088663 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f750007ca60 con 0x7f7500107680 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.487+0000 7f74f7400640 1 -- 172.21.15.50:0/2766088663 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f74f006bde0 con 0x7f7500107680 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.489+0000 7f7505400640 1 -- 172.21.15.50:0/2766088663 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f74e4038f70 msgr2=0x7f74e403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.489+0000 7f7505400640 1 --2- 172.21.15.50:0/2766088663 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f74e4038f70 0x7f74e403b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f74e80098c0 tx=0x7f74e8006db0 comp rx=0 tx=0).stop 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.489+0000 7f7505400640 1 -- 172.21.15.50:0/2766088663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 msgr2=0x7f750007db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.489+0000 7f7505400640 1 --2- 172.21.15.50:0/2766088663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 0x7f750007db70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74f00097f0 tx=0x7f74f00327b0 comp rx=0 tx=0).stop 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.489+0000 7f7505400640 1 -- 172.21.15.50:0/2766088663 shutdown_connections 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.489+0000 7f7505400640 1 --2- 172.21.15.50:0/2766088663 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f74e4038f70 0x7f74e403b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.489+0000 7f7505400640 1 --2- 172.21.15.50:0/2766088663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7500107680 0x7f750007db70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.489+0000 7f7505400640 1 -- 172.21.15.50:0/2766088663 >> 172.21.15.50:0/2766088663 conn(0x7f7500102e50 msgr2=0x7f7500103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:50.749 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.490+0000 7f7505400640 1 -- 172.21.15.50:0/2766088663 shutdown_connections 2024-09-10T10:00:50.750 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:49.490+0000 7f7505400640 1 -- 172.21.15.50:0/2766088663 wait complete. 2024-09-10T10:00:50.750 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling the dashboard module... 2024-09-10T10:00:51.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:51 smithi050 ceph-mon[30354]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:00:52.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:52 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/196305528' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-10T10:00:52.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:52 smithi050 ceph-mon[30354]: from='mgr.14118 172.21.15.50:0/3566768736' entity='mgr.x' 2024-09-10T10:00:52.715 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:52 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: ignoring --setuser ceph since I am not root 2024-09-10T10:00:52.715 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:52 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: ignoring --setgroup ceph since I am not root 2024-09-10T10:00:53.000 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:52 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:52.736+0000 7fa5e05d3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:00:53.000 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:52 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:52.807+0000 7fa5e05d3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:00:53.000 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:52 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:52.998+0000 7fa5e05d3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:00:53.261 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:53 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:53.082+0000 7fa5e05d3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:00:53.383 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.241+0000 7fea93600640 1 Processor -- start 2024-09-10T10:00:53.383 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.242+0000 7fea93600640 1 -- start start 2024-09-10T10:00:53.383 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.242+0000 7fea93600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 0x7fea8c107a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:53.383 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.242+0000 7fea93600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c108050 con 0x7fea8c107680 2024-09-10T10:00:53.383 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.242+0000 7fea90c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 0x7fea8c107a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:53.383 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.242+0000 7fea90c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 0x7fea8c107a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41326/0 (socket says 172.21.15.50:41326) 2024-09-10T10:00:53.383 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.242+0000 7fea90c00640 1 -- 172.21.15.50:0/1035921933 learned_addr learned my addr 172.21.15.50:0/1035921933 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:53.383 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.243+0000 7fea90c00640 1 -- 172.21.15.50:0/1035921933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8c108830 con 0x7fea8c107680 2024-09-10T10:00:53.383 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.244+0000 7fea90c00640 1 --2- 172.21.15.50:0/1035921933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 0x7fea8c107a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fea7c009820 tx=0x7fea7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b3d41d998a3210 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:53.383 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.244+0000 7fea8be00640 1 -- 172.21.15.50:0/1035921933 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea7c037070 con 0x7fea8c107680 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.244+0000 7fea8be00640 1 -- 172.21.15.50:0/1035921933 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea7c032920 con 0x7fea8c107680 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.244+0000 7fea8be00640 1 -- 172.21.15.50:0/1035921933 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea7c030810 con 0x7fea8c107680 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.245+0000 7fea93600640 1 -- 172.21.15.50:0/1035921933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 msgr2=0x7fea8c107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.245+0000 7fea93600640 1 --2- 172.21.15.50:0/1035921933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 0x7fea8c107a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fea7c009820 tx=0x7fea7c02a270 comp rx=0 tx=0).stop 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.245+0000 7fea93600640 1 -- 172.21.15.50:0/1035921933 shutdown_connections 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.245+0000 7fea93600640 1 --2- 172.21.15.50:0/1035921933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 0x7fea8c107a80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.245+0000 7fea93600640 1 -- 172.21.15.50:0/1035921933 >> 172.21.15.50:0/1035921933 conn(0x7fea8c102e50 msgr2=0x7fea8c105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.245+0000 7fea93600640 1 -- 172.21.15.50:0/1035921933 shutdown_connections 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.245+0000 7fea93600640 1 -- 172.21.15.50:0/1035921933 wait complete. 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.246+0000 7fea93600640 1 Processor -- start 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.246+0000 7fea93600640 1 -- start start 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.246+0000 7fea93600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 0x7fea8c19d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.246+0000 7fea93600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c10bbe0 con 0x7fea8c107680 2024-09-10T10:00:53.384 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.247+0000 7fea90c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 0x7fea8c19d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:53.385 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.247+0000 7fea90c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 0x7fea8c19d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41342/0 (socket says 172.21.15.50:41342) 2024-09-10T10:00:53.385 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.247+0000 7fea90c00640 1 -- 172.21.15.50:0/196305528 learned_addr learned my addr 172.21.15.50:0/196305528 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:53.385 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.247+0000 7fea90c00640 1 -- 172.21.15.50:0/196305528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8c19de00 con 0x7fea8c107680 2024-09-10T10:00:53.385 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.248+0000 7fea90c00640 1 --2- 172.21.15.50:0/196305528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 0x7fea8c19d8c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fea7c030560 tx=0x7fea7c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:53.385 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.248+0000 7fea8a000640 1 -- 172.21.15.50:0/196305528 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea7c037040 con 0x7fea8c107680 2024-09-10T10:00:53.385 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.248+0000 7fea8a000640 1 -- 172.21.15.50:0/196305528 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea7c040070 con 0x7fea8c107680 2024-09-10T10:00:53.385 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.248+0000 7fea8a000640 1 -- 172.21.15.50:0/196305528 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea7c03a6d0 con 0x7fea8c107680 2024-09-10T10:00:53.385 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.248+0000 7fea93600640 1 -- 172.21.15.50:0/196305528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8c19e090 con 0x7fea8c107680 2024-09-10T10:00:53.385 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.248+0000 7fea93600640 1 -- 172.21.15.50:0/196305528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea8c1a0d80 con 0x7fea8c107680 2024-09-10T10:00:53.385 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.249+0000 7fea8a000640 1 -- 172.21.15.50:0/196305528 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fea7c03b420 con 0x7fea8c107680 2024-09-10T10:00:53.385 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.249+0000 7fea93600640 1 -- 172.21.15.50:0/196305528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8c10bd60 con 0x7fea8c107680 2024-09-10T10:00:53.385 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.249+0000 7fea8a000640 1 --2- 172.21.15.50:0/196305528 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fea70038fc0 0x7fea7003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.250+0000 7fea8a000640 1 -- 172.21.15.50:0/196305528 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fea7c06c580 con 0x7fea8c107680 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.250+0000 7fea83e00640 1 --2- 172.21.15.50:0/196305528 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fea70038fc0 0x7fea7003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.250+0000 7fea83e00640 1 --2- 172.21.15.50:0/196305528 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fea70038fc0 0x7fea7003b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fea740098c0 tx=0x7fea74006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.255+0000 7fea8a000640 1 -- 172.21.15.50:0/196305528 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea7c04a200 con 0x7fea8c107680 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:51.489+0000 7fea93600640 1 -- 172.21.15.50:0/196305528 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fea8c1a0f50 con 0x7fea8c107680 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:52.490+0000 7fea8a000640 1 -- 172.21.15.50:0/196305528 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fea7c031e80 con 0x7fea8c107680 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:52.492+0000 7fea8a000640 1 -- 172.21.15.50:0/196305528 <== mon.0 v2:172.21.15.50:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fea7c03a870 con 0x7fea8c107680 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:52.494+0000 7fea93600640 1 -- 172.21.15.50:0/196305528 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fea70038fc0 msgr2=0x7fea7003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:52.494+0000 7fea93600640 1 --2- 172.21.15.50:0/196305528 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fea70038fc0 0x7fea7003b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fea740098c0 tx=0x7fea74006db0 comp rx=0 tx=0).stop 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:52.494+0000 7fea93600640 1 -- 172.21.15.50:0/196305528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 msgr2=0x7fea8c19d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:52.494+0000 7fea93600640 1 --2- 172.21.15.50:0/196305528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 0x7fea8c19d8c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fea7c030560 tx=0x7fea7c032670 comp rx=0 tx=0).stop 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:52.494+0000 7fea93600640 1 -- 172.21.15.50:0/196305528 shutdown_connections 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:52.494+0000 7fea93600640 1 --2- 172.21.15.50:0/196305528 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7fea70038fc0 0x7fea7003b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:53.386 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:52.494+0000 7fea93600640 1 --2- 172.21.15.50:0/196305528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea8c107680 0x7fea8c19d8c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:53.387 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:52.494+0000 7fea93600640 1 -- 172.21.15.50:0/196305528 >> 172.21.15.50:0/196305528 conn(0x7fea8c102e50 msgr2=0x7fea8c1039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:53.387 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:52.494+0000 7fea93600640 1 -- 172.21.15.50:0/196305528 shutdown_connections 2024-09-10T10:00:53.387 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:52.494+0000 7fea93600640 1 -- 172.21.15.50:0/196305528 wait complete. 2024-09-10T10:00:53.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:53 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/196305528' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T10:00:53.569 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:53 smithi050 ceph-mon[30354]: mgrmap e9: x(active, since 22s) 2024-09-10T10:00:53.570 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:53 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:53.260+0000 7fa5e05d3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:00:53.570 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:53 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:53.449+0000 7fa5e05d3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:00:54.096 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:53 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:53.842+0000 7fa5e05d3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:00:54.096 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:53 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:53.916+0000 7fa5e05d3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:00:54.465 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:54 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:54.147+0000 7fa5e05d3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:00:54.956 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:54 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1160371930' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T10:00:55.274 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:00:55.274 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T10:00:55.274 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T10:00:55.274 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T10:00:55.274 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T10:00:55.274 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:00:55.274 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.310+0000 7f86ffe00640 1 Processor -- start 2024-09-10T10:00:55.274 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.310+0000 7f86ffe00640 1 -- start start 2024-09-10T10:00:55.274 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.311+0000 7f86ffe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 0x7f86f8109d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:55.275 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.311+0000 7f86ffe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f86f810a310 con 0x7f86f8109920 2024-09-10T10:00:55.275 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.311+0000 7f86fd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 0x7f86f8109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:55.275 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.311+0000 7f86fd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 0x7f86f8109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41372/0 (socket says 172.21.15.50:41372) 2024-09-10T10:00:55.275 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.311+0000 7f86fd400640 1 -- 172.21.15.50:0/1971026900 learned_addr learned my addr 172.21.15.50:0/1971026900 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:55.275 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.311+0000 7f86fd400640 1 -- 172.21.15.50:0/1971026900 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f810aa10 con 0x7f86f8109920 2024-09-10T10:00:55.275 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.313+0000 7f86fd400640 1 --2- 172.21.15.50:0/1971026900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 0x7f86f8109d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009820 tx=0x7f86ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbba62db449ad8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:55.275 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.313+0000 7f86f7e00640 1 -- 172.21.15.50:0/1971026900 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86ec037070 con 0x7f86f8109920 2024-09-10T10:00:55.275 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.313+0000 7f86f7e00640 1 -- 172.21.15.50:0/1971026900 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ec032920 con 0x7f86f8109920 2024-09-10T10:00:55.275 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.313+0000 7f86f7e00640 1 -- 172.21.15.50:0/1971026900 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86ec030810 con 0x7f86f8109920 2024-09-10T10:00:55.275 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.314+0000 7f86ffe00640 1 -- 172.21.15.50:0/1971026900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 msgr2=0x7f86f8109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:55.275 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.314+0000 7f86ffe00640 1 --2- 172.21.15.50:0/1971026900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 0x7f86f8109d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009820 tx=0x7f86ec02a270 comp rx=0 tx=0).stop 2024-09-10T10:00:55.275 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.314+0000 7f86ffe00640 1 -- 172.21.15.50:0/1971026900 shutdown_connections 2024-09-10T10:00:55.275 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.314+0000 7f86ffe00640 1 --2- 172.21.15.50:0/1971026900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 0x7f86f8109d40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.314+0000 7f86ffe00640 1 -- 172.21.15.50:0/1971026900 >> 172.21.15.50:0/1971026900 conn(0x7f86f807cf40 msgr2=0x7f86f807d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.314+0000 7f86ffe00640 1 -- 172.21.15.50:0/1971026900 shutdown_connections 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.314+0000 7f86ffe00640 1 -- 172.21.15.50:0/1971026900 wait complete. 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.315+0000 7f86ffe00640 1 Processor -- start 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.315+0000 7f86ffe00640 1 -- start start 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.316+0000 7f86ffe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 0x7f86f819d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.316+0000 7f86ffe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f86f810ddc0 con 0x7f86f8109920 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.316+0000 7f86fd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 0x7f86f819d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.316+0000 7f86fd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 0x7f86f819d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41386/0 (socket says 172.21.15.50:41386) 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.316+0000 7f86fd400640 1 -- 172.21.15.50:0/1160371930 learned_addr learned my addr 172.21.15.50:0/1160371930 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.316+0000 7f86fd400640 1 -- 172.21.15.50:0/1160371930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f819dd50 con 0x7f86f8109920 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.317+0000 7f86fd400640 1 --2- 172.21.15.50:0/1160371930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 0x7f86f819d810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0097f0 tx=0x7f86ec0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.317+0000 7f86f6000640 1 -- 172.21.15.50:0/1160371930 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86ec037040 con 0x7f86f8109920 2024-09-10T10:00:55.276 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.317+0000 7f86f6000640 1 -- 172.21.15.50:0/1160371930 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ec030cc0 con 0x7f86f8109920 2024-09-10T10:00:55.277 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.317+0000 7f86f6000640 1 -- 172.21.15.50:0/1160371930 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86ec03a640 con 0x7f86f8109920 2024-09-10T10:00:55.277 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.317+0000 7f86ffe00640 1 -- 172.21.15.50:0/1160371930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f819dfe0 con 0x7f86f8109920 2024-09-10T10:00:55.277 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.317+0000 7f86ffe00640 1 -- 172.21.15.50:0/1160371930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f81a0cd0 con 0x7f86f8109920 2024-09-10T10:00:55.277 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.319+0000 7f86f6000640 1 -- 172.21.15.50:0/1160371930 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f86ec03b3f0 con 0x7f86f8109920 2024-09-10T10:00:55.277 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.318+0000 7f86ffe00640 1 -- 172.21.15.50:0/1160371930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f810df40 con 0x7f86f8109920 2024-09-10T10:00:55.277 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.319+0000 7f86f6000640 1 --2- 172.21.15.50:0/1160371930 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f86e0038fc0 0x7f86e003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:00:55.277 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.319+0000 7f86f6000640 1 -- 172.21.15.50:0/1160371930 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f86ec06c5d0 con 0x7f86f8109920 2024-09-10T10:00:55.277 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.319+0000 7f86fca00640 1 -- 172.21.15.50:0/1160371930 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f86e0038fc0 msgr2=0x7f86e003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2344357525 2024-09-10T10:00:55.277 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.319+0000 7f86fca00640 1 --2- 172.21.15.50:0/1160371930 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f86e0038fc0 0x7f86e003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:00:55.277 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.324+0000 7f86f6000640 1 -- 172.21.15.50:0/1160371930 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f86ec042e10 con 0x7f86f8109920 2024-09-10T10:00:55.277 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.520+0000 7f86fca00640 1 -- 172.21.15.50:0/1160371930 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f86e0038fc0 msgr2=0x7f86e003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2344357525 2024-09-10T10:00:55.277 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.520+0000 7f86fca00640 1 --2- 172.21.15.50:0/1160371930 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f86e0038fc0 0x7f86e003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.558+0000 7f86ffe00640 1 -- 172.21.15.50:0/1160371930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f86f81a0ea0 con 0x7f86f8109920 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.559+0000 7f86f6000640 1 -- 172.21.15.50:0/1160371930 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f86ec06bf60 con 0x7f86f8109920 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.561+0000 7f86ffe00640 1 -- 172.21.15.50:0/1160371930 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f86e0038fc0 msgr2=0x7f86e003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.561+0000 7f86ffe00640 1 --2- 172.21.15.50:0/1160371930 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f86e0038fc0 0x7f86e003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.561+0000 7f86ffe00640 1 -- 172.21.15.50:0/1160371930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 msgr2=0x7f86f819d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.561+0000 7f86ffe00640 1 --2- 172.21.15.50:0/1160371930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 0x7f86f819d810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0097f0 tx=0x7f86ec0327b0 comp rx=0 tx=0).stop 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.561+0000 7f86ffe00640 1 -- 172.21.15.50:0/1160371930 shutdown_connections 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.561+0000 7f86ffe00640 1 --2- 172.21.15.50:0/1160371930 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7f86e0038fc0 0x7f86e003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.561+0000 7f86ffe00640 1 --2- 172.21.15.50:0/1160371930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86f8109920 0x7f86f819d810 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.561+0000 7f86ffe00640 1 -- 172.21.15.50:0/1160371930 >> 172.21.15.50:0/1160371930 conn(0x7f86f807cf40 msgr2=0x7f86f81075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.561+0000 7f86ffe00640 1 -- 172.21.15.50:0/1160371930 shutdown_connections 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:54.561+0000 7f86ffe00640 1 -- 172.21.15.50:0/1160371930 wait complete. 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for the mgr to restart... 2024-09-10T10:00:55.278 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr epoch 9... 2024-09-10T10:00:55.545 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:55 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:55.333+0000 7fa5e05d3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:00:55.545 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:55 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:55.417+0000 7fa5e05d3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:00:56.694 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:56 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:56.380+0000 7fa5e05d3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:00:56.694 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:56 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:56.522+0000 7fa5e05d3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:00:56.694 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:56 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:56.692+0000 7fa5e05d3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:00:56.947 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:56 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:56.768+0000 7fa5e05d3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:00:56.947 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:56 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:56.945+0000 7fa5e05d3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:00:57.216 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:57 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:57.030+0000 7fa5e05d3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:00:57.217 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:57 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:57.104+0000 7fa5e05d3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:00:57.556 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:57 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:57.293+0000 7fa5e05d3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:00:57.557 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:57 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:57.373+0000 7fa5e05d3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:00:57.557 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:57 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:57.455+0000 7fa5e05d3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:00:57.557 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:57 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:57.555+0000 7fa5e05d3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:00:57.965 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:57 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:57.628+0000 7fa5e05d3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:00:57.965 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:57 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:57.701+0000 7fa5e05d3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:00:58.925 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:00:58 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:00:58.652+0000 7fa5e05d3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:00:58.925 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:58 smithi050 ceph-mon[30354]: Active manager daemon x restarted 2024-09-10T10:00:58.925 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:58 smithi050 ceph-mon[30354]: Activating manager daemon x 2024-09-10T10:00:58.925 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:58 smithi050 ceph-mon[30354]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T10:00:58.925 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:58 smithi050 ceph-mon[30354]: mgrmap e10: x(active, starting, since 0.00359836s) 2024-09-10T10:00:58.925 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:00:58.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T10:00:58.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:00:58.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:00:58.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:00:58.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:58 smithi050 ceph-mon[30354]: Manager daemon x is now available 2024-09-10T10:00:58.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:00:59.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:00:59.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T10:00:59.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:00:59 smithi050 ceph-mon[30354]: mgrmap e11: x(active, since 1.00766s) 2024-09-10T10:01:00.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:01:00.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T10:01:00.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T10:01:00.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:01:00.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.809+0000 7ffab3200640 1 Processor -- start 2024-09-10T10:01:00.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.809+0000 7ffab3200640 1 -- start start 2024-09-10T10:01:00.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.809+0000 7ffab3200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 0x7ffab407c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:00.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.809+0000 7ffab3200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffab407c8f0 con 0x7ffab407dec0 2024-09-10T10:01:00.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.810+0000 7ffab1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 0x7ffab407c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:00.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.810+0000 7ffab1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 0x7ffab407c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41400/0 (socket says 172.21.15.50:41400) 2024-09-10T10:01:00.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.810+0000 7ffab1e00640 1 -- 172.21.15.50:0/1947647703 learned_addr learned my addr 172.21.15.50:0/1947647703 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:00.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.810+0000 7ffab1e00640 1 -- 172.21.15.50:0/1947647703 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab407ca70 con 0x7ffab407dec0 2024-09-10T10:01:00.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.811+0000 7ffab1e00640 1 --2- 172.21.15.50:0/1947647703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 0x7ffab407c320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009820 tx=0x7ffaa402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eeca20d4755494 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:00.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.811+0000 7ffab0a00640 1 -- 172.21.15.50:0/1947647703 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaa4037070 con 0x7ffab407dec0 2024-09-10T10:01:00.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.811+0000 7ffab0a00640 1 -- 172.21.15.50:0/1947647703 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaa4032920 con 0x7ffab407dec0 2024-09-10T10:01:00.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.811+0000 7ffab0a00640 1 -- 172.21.15.50:0/1947647703 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaa4030810 con 0x7ffab407dec0 2024-09-10T10:01:00.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.812+0000 7ffab3200640 1 -- 172.21.15.50:0/1947647703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 msgr2=0x7ffab407c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:00.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.812+0000 7ffab3200640 1 --2- 172.21.15.50:0/1947647703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 0x7ffab407c320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009820 tx=0x7ffaa402a270 comp rx=0 tx=0).stop 2024-09-10T10:01:00.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.812+0000 7ffab3200640 1 -- 172.21.15.50:0/1947647703 shutdown_connections 2024-09-10T10:01:00.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.812+0000 7ffab3200640 1 --2- 172.21.15.50:0/1947647703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 0x7ffab407c320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:00.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.812+0000 7ffab3200640 1 -- 172.21.15.50:0/1947647703 >> 172.21.15.50:0/1947647703 conn(0x7ffab4102c10 msgr2=0x7ffab4105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:00.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.812+0000 7ffab3200640 1 -- 172.21.15.50:0/1947647703 shutdown_connections 2024-09-10T10:01:00.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.812+0000 7ffab3200640 1 -- 172.21.15.50:0/1947647703 wait complete. 2024-09-10T10:01:00.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.813+0000 7ffab3200640 1 Processor -- start 2024-09-10T10:01:00.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.813+0000 7ffab3200640 1 -- start start 2024-09-10T10:01:00.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.813+0000 7ffab3200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 0x7ffab419d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:00.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.813+0000 7ffab3200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffab410daf0 con 0x7ffab407dec0 2024-09-10T10:01:00.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.814+0000 7ffab1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 0x7ffab419d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:00.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.814+0000 7ffab1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 0x7ffab419d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41414/0 (socket says 172.21.15.50:41414) 2024-09-10T10:01:00.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.814+0000 7ffab1e00640 1 -- 172.21.15.50:0/1843602102 learned_addr learned my addr 172.21.15.50:0/1843602102 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:00.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.814+0000 7ffab1e00640 1 -- 172.21.15.50:0/1843602102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab419dc20 con 0x7ffab407dec0 2024-09-10T10:01:00.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.815+0000 7ffab1e00640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 0x7ffab419d6e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40097f0 tx=0x7ffaa40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:00.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.817+0000 7ffaaaa00640 1 -- 172.21.15.50:0/1843602102 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaa4037040 con 0x7ffab407dec0 2024-09-10T10:01:00.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.817+0000 7ffaaaa00640 1 -- 172.21.15.50:0/1843602102 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaa4030c40 con 0x7ffab407dec0 2024-09-10T10:01:00.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.817+0000 7ffaaaa00640 1 -- 172.21.15.50:0/1843602102 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaa403a5b0 con 0x7ffab407dec0 2024-09-10T10:01:00.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.817+0000 7ffab3200640 1 -- 172.21.15.50:0/1843602102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab419deb0 con 0x7ffab407dec0 2024-09-10T10:01:00.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.817+0000 7ffab3200640 1 -- 172.21.15.50:0/1843602102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab41a0ba0 con 0x7ffab407dec0 2024-09-10T10:01:00.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.819+0000 7ffaaaa00640 1 -- 172.21.15.50:0/1843602102 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7ffaa403a750 con 0x7ffab407dec0 2024-09-10T10:01:00.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.819+0000 7ffaaaa00640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ffa98039070 0x7ffa9803b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:00.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.819+0000 7ffaaaa00640 1 -- 172.21.15.50:0/1843602102 --> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffa9803bc40 con 0x7ffa98039070 2024-09-10T10:01:00.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.819+0000 7ffaaaa00640 1 -- 172.21.15.50:0/1843602102 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffaa406bda0 con 0x7ffab407dec0 2024-09-10T10:01:00.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.820+0000 7ffab1400640 1 -- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ffa98039070 msgr2=0x7ffa9803b530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2344357525 2024-09-10T10:01:00.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:55.820+0000 7ffab1400640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ffa98039070 0x7ffa9803b530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:01:00.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:56.021+0000 7ffab1400640 1 -- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ffa98039070 msgr2=0x7ffa9803b530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2344357525 2024-09-10T10:01:00.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:56.021+0000 7ffab1400640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ffa98039070 0x7ffa9803b530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:01:00.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:56.422+0000 7ffab1400640 1 -- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ffa98039070 msgr2=0x7ffa9803b530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2344357525 2024-09-10T10:01:00.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:56.422+0000 7ffab1400640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ffa98039070 0x7ffa9803b530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T10:01:00.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:57.223+0000 7ffab1400640 1 -- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ffa98039070 msgr2=0x7ffa9803b530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.50:6800/2344357525 2024-09-10T10:01:00.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:57.223+0000 7ffab1400640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ffa98039070 0x7ffa9803b530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T10:01:00.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:58.657+0000 7ffaaaa00640 1 -- 172.21.15.50:0/1843602102 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7ffaa406a850 con 0x7ffab407dec0 2024-09-10T10:01:00.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:58.657+0000 7ffaaaa00640 1 -- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ffa98039070 msgr2=0x7ffa9803b530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:01:00.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:58.657+0000 7ffaaaa00640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ffa98039070 0x7ffa9803b530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:00.579 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.659+0000 7ffaaaa00640 1 -- 172.21.15.50:0/1843602102 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7ffaa402e590 con 0x7ffab407dec0 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.659+0000 7ffaaaa00640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffa9803cb30 0x7ffa9803ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.660+0000 7ffaaaa00640 1 -- 172.21.15.50:0/1843602102 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffaa403de80 con 0x7ffa9803cb30 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.660+0000 7ffab1400640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffa9803cb30 0x7ffa9803ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.661+0000 7ffab1400640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffa9803cb30 0x7ffa9803ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0003980 tx=0x7ffaa00092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.663+0000 7ffaaaa00640 1 -- 172.21.15.50:0/1843602102 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ffaa403de80 con 0x7ffa9803cb30 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.670+0000 7ffab3200640 1 -- 172.21.15.50:0/1843602102 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ffab407c3a0 con 0x7ffa9803cb30 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.670+0000 7ffaaaa00640 1 -- 172.21.15.50:0/1843602102 <== mgr.14150 v2:172.21.15.50:6800/2546156966 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ffab407c3a0 con 0x7ffa9803cb30 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.671+0000 7ffab3200640 1 -- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffa9803cb30 msgr2=0x7ffa9803ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.671+0000 7ffab3200640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffa9803cb30 0x7ffa9803ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0003980 tx=0x7ffaa00092b0 comp rx=0 tx=0).stop 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.671+0000 7ffab3200640 1 -- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 msgr2=0x7ffab419d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.671+0000 7ffab3200640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 0x7ffab419d6e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40097f0 tx=0x7ffaa40327b0 comp rx=0 tx=0).stop 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.671+0000 7ffab3200640 1 -- 172.21.15.50:0/1843602102 shutdown_connections 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.671+0000 7ffab3200640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffa9803cb30 0x7ffa9803ef20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:00.580 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.671+0000 7ffab3200640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:6800/2344357525,v1:172.21.15.50:6801/2344357525] conn(0x7ffa98039070 0x7ffa9803b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:00.581 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.671+0000 7ffab3200640 1 --2- 172.21.15.50:0/1843602102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffab407dec0 0x7ffab419d6e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:00.581 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.671+0000 7ffab3200640 1 -- 172.21.15.50:0/1843602102 >> 172.21.15.50:0/1843602102 conn(0x7ffab4102c10 msgr2=0x7ffab41037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:00.581 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.671+0000 7ffab3200640 1 -- 172.21.15.50:0/1843602102 shutdown_connections 2024-09-10T10:01:00.581 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:00:59.671+0000 7ffab3200640 1 -- 172.21.15.50:0/1843602102 wait complete. 2024-09-10T10:01:00.581 INFO:teuthology.orchestra.run.smithi050.stdout:mgr epoch 9 is available 2024-09-10T10:01:00.581 INFO:teuthology.orchestra.run.smithi050.stdout:Generating a dashboard self-signed certificate... 2024-09-10T10:01:00.847 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-mon[30354]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T10:01:00.847 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-mon[30354]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T10:01:01.209 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:01:00.866+0000 7fa53ce00640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:10:01:00] ENGINE Error in HTTPServer.serve 2024-09-10T10:01:01.210 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: Traceback (most recent call last): 2024-09-10T10:01:01.210 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:01:01.210 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: self._connections.run(self.expiration_interval) 2024-09-10T10:01:01.210 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:01:01.210 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: self._run(expiration_interval) 2024-09-10T10:01:01.210 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:01:01.210 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:01:01.210 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:01:01.210 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:01:01.210 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:01:01.210 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: s = self.context.wrap_socket( 2024-09-10T10:01:01.210 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:01:01.210 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: return self.sslsocket_class._create( 2024-09-10T10:01:01.211 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:01:01.211 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: self.do_handshake() 2024-09-10T10:01:01.211 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:01:01.211 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: self._sslobj.do_handshake() 2024-09-10T10:01:01.211 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:01:01.211 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:01:01.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:01 smithi050 ceph-mon[30354]: mgrmap e12: x(active, since 2s) 2024-09-10T10:01:01.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:01 smithi050 ceph-mon[30354]: [10/Sep/2024:10:01:00] ENGINE Bus STARTING 2024-09-10T10:01:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:01 smithi050 ceph-mon[30354]: [10/Sep/2024:10:01:00] ENGINE Serving on https://172.21.15.50:7150 2024-09-10T10:01:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:01 smithi050 ceph-mon[30354]: [10/Sep/2024:10:01:00] ENGINE Error in HTTPServer.serve 2024-09-10T10:01:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout: Traceback (most recent call last): 2024-09-10T10:01:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:01:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:01:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:01:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout: self._run(expiration_interval) 2024-09-10T10:01:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:01:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:01:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:01:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:01:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:01:01.945 INFO:journalctl@ceph.mon.a.smithi050.stdout: s = self.context.wrap_socket( 2024-09-10T10:01:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:01:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout: return self.sslsocket_class._create( 2024-09-10T10:01:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:01:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout: self.do_handshake() 2024-09-10T10:01:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:01:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout: self._sslobj.do_handshake() 2024-09-10T10:01:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:01:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:01 smithi050 ceph-mon[30354]: [10/Sep/2024:10:01:00] ENGINE Serving on http://172.21.15.50:8765 2024-09-10T10:01:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:01 smithi050 ceph-mon[30354]: [10/Sep/2024:10:01:00] ENGINE Bus STARTED 2024-09-10T10:01:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:01 smithi050 ceph-mon[30354]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:01.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:02.340 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-10T10:01:02.340 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.317+0000 7f1d11000640 1 Processor -- start 2024-09-10T10:01:02.340 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.317+0000 7f1d11000640 1 -- start start 2024-09-10T10:01:02.340 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.318+0000 7f1d11000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 0x7f1d0c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:02.340 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.318+0000 7f1d11000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c10a240 con 0x7f1d0c109870 2024-09-10T10:01:02.340 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.318+0000 7f1d09e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 0x7f1d0c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:02.340 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.318+0000 7f1d09e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 0x7f1d0c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33192/0 (socket says 172.21.15.50:33192) 2024-09-10T10:01:02.340 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.318+0000 7f1d09e00640 1 -- 172.21.15.50:0/3211569761 learned_addr learned my addr 172.21.15.50:0/3211569761 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:02.340 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.318+0000 7f1d09e00640 1 -- 172.21.15.50:0/3211569761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0c10aa10 con 0x7f1d0c109870 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.319+0000 7f1d09e00640 1 --2- 172.21.15.50:0/3211569761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 0x7f1d0c109c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009820 tx=0x7f1cfc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac11b2c14b992c7a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.320+0000 7f1d09400640 1 -- 172.21.15.50:0/3211569761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc037070 con 0x7f1d0c109870 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.320+0000 7f1d09400640 1 -- 172.21.15.50:0/3211569761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cfc032920 con 0x7f1d0c109870 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.320+0000 7f1d09400640 1 -- 172.21.15.50:0/3211569761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc030810 con 0x7f1d0c109870 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.320+0000 7f1d11000640 1 -- 172.21.15.50:0/3211569761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 msgr2=0x7f1d0c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.320+0000 7f1d11000640 1 --2- 172.21.15.50:0/3211569761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 0x7f1d0c109c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009820 tx=0x7f1cfc02a270 comp rx=0 tx=0).stop 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.320+0000 7f1d11000640 1 -- 172.21.15.50:0/3211569761 shutdown_connections 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.321+0000 7f1d11000640 1 --2- 172.21.15.50:0/3211569761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 0x7f1d0c109c70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.321+0000 7f1d11000640 1 -- 172.21.15.50:0/3211569761 >> 172.21.15.50:0/3211569761 conn(0x7f1d0c07cf40 msgr2=0x7f1d0c07d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.321+0000 7f1d11000640 1 -- 172.21.15.50:0/3211569761 shutdown_connections 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.321+0000 7f1d11000640 1 -- 172.21.15.50:0/3211569761 wait complete. 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.321+0000 7f1d11000640 1 Processor -- start 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.322+0000 7f1d11000640 1 -- start start 2024-09-10T10:01:02.341 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.322+0000 7f1d11000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 0x7f1d0c19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:02.342 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.322+0000 7f1d11000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c10ddc0 con 0x7f1d0c109870 2024-09-10T10:01:02.342 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.322+0000 7f1d09e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 0x7f1d0c19d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:02.342 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.322+0000 7f1d09e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 0x7f1d0c19d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33208/0 (socket says 172.21.15.50:33208) 2024-09-10T10:01:02.342 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.322+0000 7f1d09e00640 1 -- 172.21.15.50:0/1504467595 learned_addr learned my addr 172.21.15.50:0/1504467595 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:02.342 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.323+0000 7f1d09e00640 1 -- 172.21.15.50:0/1504467595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0c19dd10 con 0x7f1d0c109870 2024-09-10T10:01:02.342 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.323+0000 7f1d09e00640 1 --2- 172.21.15.50:0/1504467595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 0x7f1d0c19d7d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0097f0 tx=0x7f1cfc0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:02.342 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.323+0000 7f1d02a00640 1 -- 172.21.15.50:0/1504467595 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc037040 con 0x7f1d0c109870 2024-09-10T10:01:02.342 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.323+0000 7f1d02a00640 1 -- 172.21.15.50:0/1504467595 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cfc030cc0 con 0x7f1d0c109870 2024-09-10T10:01:02.342 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.323+0000 7f1d11000640 1 -- 172.21.15.50:0/1504467595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d0c19dfa0 con 0x7f1d0c109870 2024-09-10T10:01:02.342 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.323+0000 7f1d02a00640 1 -- 172.21.15.50:0/1504467595 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc03a6b0 con 0x7f1d0c109870 2024-09-10T10:01:02.342 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.323+0000 7f1d11000640 1 -- 172.21.15.50:0/1504467595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d0c1a0c90 con 0x7f1d0c109870 2024-09-10T10:01:02.342 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.324+0000 7f1d02a00640 1 -- 172.21.15.50:0/1504467595 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f1cfc03baf0 con 0x7f1d0c109870 2024-09-10T10:01:02.342 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.324+0000 7f1d11000640 1 -- 172.21.15.50:0/1504467595 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d0c109cf0 con 0x7f1d0c109870 2024-09-10T10:01:02.343 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.325+0000 7f1d02a00640 1 --2- 172.21.15.50:0/1504467595 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1cf0039020 0x7f1cf003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:02.343 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.325+0000 7f1d02a00640 1 -- 172.21.15.50:0/1504467595 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1cfc06c6b0 con 0x7f1d0c109870 2024-09-10T10:01:02.343 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.325+0000 7f1d03e00640 1 --2- 172.21.15.50:0/1504467595 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1cf0039020 0x7f1cf003b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:02.343 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.326+0000 7f1d03e00640 1 --2- 172.21.15.50:0/1504467595 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1cf0039020 0x7f1cf003b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40098c0 tx=0x7f1cf4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:02.343 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.330+0000 7f1d02a00640 1 -- 172.21.15.50:0/1504467595 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1cfc0371e0 con 0x7f1d0c109870 2024-09-10T10:01:02.343 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.534+0000 7f1d11000640 1 -- 172.21.15.50:0/1504467595 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f1d0c107c10 con 0x7f1cf0039020 2024-09-10T10:01:02.343 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.642+0000 7f1d02a00640 1 -- 172.21.15.50:0/1504467595 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f1d0c107c10 con 0x7f1cf0039020 2024-09-10T10:01:02.343 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.645+0000 7f1d11000640 1 -- 172.21.15.50:0/1504467595 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1cf0039020 msgr2=0x7f1cf003b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:02.343 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.645+0000 7f1d11000640 1 --2- 172.21.15.50:0/1504467595 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1cf0039020 0x7f1cf003b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40098c0 tx=0x7f1cf4006db0 comp rx=0 tx=0).stop 2024-09-10T10:01:02.343 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.645+0000 7f1d11000640 1 -- 172.21.15.50:0/1504467595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 msgr2=0x7f1d0c19d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:02.343 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.645+0000 7f1d11000640 1 --2- 172.21.15.50:0/1504467595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 0x7f1d0c19d7d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0097f0 tx=0x7f1cfc0327b0 comp rx=0 tx=0).stop 2024-09-10T10:01:02.343 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.645+0000 7f1d11000640 1 -- 172.21.15.50:0/1504467595 shutdown_connections 2024-09-10T10:01:02.343 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.645+0000 7f1d11000640 1 --2- 172.21.15.50:0/1504467595 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1cf0039020 0x7f1cf003b4e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:02.344 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.645+0000 7f1d11000640 1 --2- 172.21.15.50:0/1504467595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d0c109870 0x7f1d0c19d7d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:02.344 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.645+0000 7f1d11000640 1 -- 172.21.15.50:0/1504467595 >> 172.21.15.50:0/1504467595 conn(0x7f1d0c07cf40 msgr2=0x7f1d0c107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:02.344 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.645+0000 7f1d11000640 1 -- 172.21.15.50:0/1504467595 shutdown_connections 2024-09-10T10:01:02.344 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:01.645+0000 7f1d11000640 1 -- 172.21.15.50:0/1504467595 wait complete. 2024-09-10T10:01:02.344 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial admin user... 2024-09-10T10:01:03.854 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:03 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:03.854 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:03 smithi050 ceph-mon[30354]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:03.854 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:03 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:03.866 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$PXSkVlzWQYO9SjI3pdL5ou6zMjyrIB1AyK00BDPkMxPHuSYjeLBNi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725962463, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T10:01:03.867 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.796+0000 7f00c5e00640 1 Processor -- start 2024-09-10T10:01:03.867 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.797+0000 7f00c5e00640 1 -- start start 2024-09-10T10:01:03.867 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.797+0000 7f00c5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 0x7f00c0109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:03.867 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.797+0000 7f00c5e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f00c010a290 con 0x7f00c01098c0 2024-09-10T10:01:03.867 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.797+0000 7f00bea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 0x7f00c0109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:03.867 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.797+0000 7f00bea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 0x7f00c0109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33212/0 (socket says 172.21.15.50:33212) 2024-09-10T10:01:03.868 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.797+0000 7f00bea00640 1 -- 172.21.15.50:0/505955563 learned_addr learned my addr 172.21.15.50:0/505955563 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:03.868 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.798+0000 7f00bea00640 1 -- 172.21.15.50:0/505955563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c010aa00 con 0x7f00c01098c0 2024-09-10T10:01:03.868 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.799+0000 7f00bea00640 1 --2- 172.21.15.50:0/505955563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 0x7f00c0109cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009820 tx=0x7f00b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae75579879e3ba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:03.868 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.799+0000 7f00be000640 1 -- 172.21.15.50:0/505955563 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b0037070 con 0x7f00c01098c0 2024-09-10T10:01:03.868 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.799+0000 7f00be000640 1 -- 172.21.15.50:0/505955563 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00b0032920 con 0x7f00c01098c0 2024-09-10T10:01:03.868 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.799+0000 7f00be000640 1 -- 172.21.15.50:0/505955563 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b0030810 con 0x7f00c01098c0 2024-09-10T10:01:03.869 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.800+0000 7f00c5e00640 1 -- 172.21.15.50:0/505955563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 msgr2=0x7f00c0109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:03.869 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.800+0000 7f00c5e00640 1 --2- 172.21.15.50:0/505955563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 0x7f00c0109cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009820 tx=0x7f00b002a270 comp rx=0 tx=0).stop 2024-09-10T10:01:03.869 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.800+0000 7f00c5e00640 1 -- 172.21.15.50:0/505955563 shutdown_connections 2024-09-10T10:01:03.869 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.800+0000 7f00c5e00640 1 --2- 172.21.15.50:0/505955563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 0x7f00c0109cc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:03.869 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.800+0000 7f00c5e00640 1 -- 172.21.15.50:0/505955563 >> 172.21.15.50:0/505955563 conn(0x7f00c007cda0 msgr2=0x7f00c007d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:03.869 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.800+0000 7f00c5e00640 1 -- 172.21.15.50:0/505955563 shutdown_connections 2024-09-10T10:01:03.870 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.800+0000 7f00c5e00640 1 -- 172.21.15.50:0/505955563 wait complete. 2024-09-10T10:01:03.870 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.801+0000 7f00c5e00640 1 Processor -- start 2024-09-10T10:01:03.870 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.801+0000 7f00c5e00640 1 -- start start 2024-09-10T10:01:03.870 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.802+0000 7f00c5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 0x7f00c019d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:03.870 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.802+0000 7f00c5e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f00c010ddb0 con 0x7f00c01098c0 2024-09-10T10:01:03.871 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.802+0000 7f00bea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 0x7f00c019d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:03.871 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.802+0000 7f00bea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 0x7f00c019d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33216/0 (socket says 172.21.15.50:33216) 2024-09-10T10:01:03.871 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.802+0000 7f00bea00640 1 -- 172.21.15.50:0/899705081 learned_addr learned my addr 172.21.15.50:0/899705081 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:03.871 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.802+0000 7f00bea00640 1 -- 172.21.15.50:0/899705081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c019dde0 con 0x7f00c01098c0 2024-09-10T10:01:03.871 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.802+0000 7f00bea00640 1 --2- 172.21.15.50:0/899705081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 0x7f00c019d8a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00b0030560 tx=0x7f00b0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:03.872 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.803+0000 7f00c4a00640 1 -- 172.21.15.50:0/899705081 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b0037040 con 0x7f00c01098c0 2024-09-10T10:01:03.872 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.803+0000 7f00c4a00640 1 -- 172.21.15.50:0/899705081 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00b0040070 con 0x7f00c01098c0 2024-09-10T10:01:03.872 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.803+0000 7f00c4a00640 1 -- 172.21.15.50:0/899705081 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b003a6d0 con 0x7f00c01098c0 2024-09-10T10:01:03.872 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.803+0000 7f00c5e00640 1 -- 172.21.15.50:0/899705081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c019e070 con 0x7f00c01098c0 2024-09-10T10:01:03.872 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.803+0000 7f00c5e00640 1 -- 172.21.15.50:0/899705081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c01a0d60 con 0x7f00c01098c0 2024-09-10T10:01:03.872 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.804+0000 7f00c5e00640 1 -- 172.21.15.50:0/899705081 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c010df30 con 0x7f00c01098c0 2024-09-10T10:01:03.872 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.804+0000 7f00c4a00640 1 -- 172.21.15.50:0/899705081 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f00b003bb20 con 0x7f00c01098c0 2024-09-10T10:01:03.873 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.805+0000 7f00c4a00640 1 --2- 172.21.15.50:0/899705081 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f00a4038fc0 0x7f00a403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:03.873 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.805+0000 7f00c4a00640 1 -- 172.21.15.50:0/899705081 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f00b006c6b0 con 0x7f00c01098c0 2024-09-10T10:01:03.873 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.805+0000 7f00b7e00640 1 --2- 172.21.15.50:0/899705081 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f00a4038fc0 0x7f00a403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:03.873 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.806+0000 7f00b7e00640 1 --2- 172.21.15.50:0/899705081 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f00a4038fc0 0x7f00a403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f00a80098c0 tx=0x7f00a8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:03.873 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:02.810+0000 7f00c4a00640 1 -- 172.21.15.50:0/899705081 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00b004a200 con 0x7f00c01098c0 2024-09-10T10:01:03.873 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:03.011+0000 7f00c5e00640 1 -- 172.21.15.50:0/899705081 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f00c0109d40 con 0x7f00a4038fc0 2024-09-10T10:01:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:03.264+0000 7f00c4a00640 1 -- 172.21.15.50:0/899705081 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f00c0109d40 con 0x7f00a4038fc0 2024-09-10T10:01:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:03.267+0000 7f00c5e00640 1 -- 172.21.15.50:0/899705081 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f00a4038fc0 msgr2=0x7f00a403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:03.267+0000 7f00c5e00640 1 --2- 172.21.15.50:0/899705081 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f00a4038fc0 0x7f00a403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f00a80098c0 tx=0x7f00a8006db0 comp rx=0 tx=0).stop 2024-09-10T10:01:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:03.267+0000 7f00c5e00640 1 -- 172.21.15.50:0/899705081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 msgr2=0x7f00c019d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:03.267+0000 7f00c5e00640 1 --2- 172.21.15.50:0/899705081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 0x7f00c019d8a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00b0030560 tx=0x7f00b0032670 comp rx=0 tx=0).stop 2024-09-10T10:01:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:03.267+0000 7f00c5e00640 1 -- 172.21.15.50:0/899705081 shutdown_connections 2024-09-10T10:01:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:03.267+0000 7f00c5e00640 1 --2- 172.21.15.50:0/899705081 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f00a4038fc0 0x7f00a403b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:03.874 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:03.267+0000 7f00c5e00640 1 --2- 172.21.15.50:0/899705081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00c01098c0 0x7f00c019d8a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:03.875 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:03.267+0000 7f00c5e00640 1 -- 172.21.15.50:0/899705081 >> 172.21.15.50:0/899705081 conn(0x7f00c007cda0 msgr2=0x7f00c01075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:03.875 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:03.267+0000 7f00c5e00640 1 -- 172.21.15.50:0/899705081 shutdown_connections 2024-09-10T10:01:03.875 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:03.267+0000 7f00c5e00640 1 -- 172.21.15.50:0/899705081 wait complete. 2024-09-10T10:01:03.875 INFO:teuthology.orchestra.run.smithi050.stdout:Fetching dashboard port number... 2024-09-10T10:01:04.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:04 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2191108339' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-10T10:01:05.574 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T10:01:05.574 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.408+0000 7fd73ba00640 1 Processor -- start 2024-09-10T10:01:05.574 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.408+0000 7fd73ba00640 1 -- start start 2024-09-10T10:01:05.574 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.409+0000 7fd73ba00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 0x7fd73407c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:05.574 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.409+0000 7fd73ba00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd73407c860 con 0x7fd73407ddb0 2024-09-10T10:01:05.574 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.409+0000 7fd739000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 0x7fd73407c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:05.574 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.409+0000 7fd739000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 0x7fd73407c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33220/0 (socket says 172.21.15.50:33220) 2024-09-10T10:01:05.574 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.409+0000 7fd739000640 1 -- 172.21.15.50:0/3791714473 learned_addr learned my addr 172.21.15.50:0/3791714473 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:05.574 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.409+0000 7fd739000640 1 -- 172.21.15.50:0/3791714473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73407c9e0 con 0x7fd73407ddb0 2024-09-10T10:01:05.574 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.410+0000 7fd739000640 1 --2- 172.21.15.50:0/3791714473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 0x7fd73407c320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd728009820 tx=0x7fd72802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f969c05cb60503db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:05.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.411+0000 7fd733400640 1 -- 172.21.15.50:0/3791714473 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd728037070 con 0x7fd73407ddb0 2024-09-10T10:01:05.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.411+0000 7fd733400640 1 -- 172.21.15.50:0/3791714473 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd728032920 con 0x7fd73407ddb0 2024-09-10T10:01:05.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.411+0000 7fd733400640 1 -- 172.21.15.50:0/3791714473 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd728030810 con 0x7fd73407ddb0 2024-09-10T10:01:05.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.411+0000 7fd73ba00640 1 -- 172.21.15.50:0/3791714473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 msgr2=0x7fd73407c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:05.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.411+0000 7fd73ba00640 1 --2- 172.21.15.50:0/3791714473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 0x7fd73407c320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd728009820 tx=0x7fd72802a270 comp rx=0 tx=0).stop 2024-09-10T10:01:05.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.411+0000 7fd73ba00640 1 -- 172.21.15.50:0/3791714473 shutdown_connections 2024-09-10T10:01:05.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.411+0000 7fd73ba00640 1 --2- 172.21.15.50:0/3791714473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 0x7fd73407c320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:05.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.411+0000 7fd73ba00640 1 -- 172.21.15.50:0/3791714473 >> 172.21.15.50:0/3791714473 conn(0x7fd734102eb0 msgr2=0x7fd7341052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:05.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.411+0000 7fd73ba00640 1 -- 172.21.15.50:0/3791714473 shutdown_connections 2024-09-10T10:01:05.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.411+0000 7fd73ba00640 1 -- 172.21.15.50:0/3791714473 wait complete. 2024-09-10T10:01:05.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.412+0000 7fd73ba00640 1 Processor -- start 2024-09-10T10:01:05.575 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.413+0000 7fd73ba00640 1 -- start start 2024-09-10T10:01:05.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.413+0000 7fd73ba00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 0x7fd73419d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:05.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.413+0000 7fd73ba00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd73410dbe0 con 0x7fd73407ddb0 2024-09-10T10:01:05.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.413+0000 7fd739000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 0x7fd73419d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:05.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.413+0000 7fd739000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 0x7fd73419d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33236/0 (socket says 172.21.15.50:33236) 2024-09-10T10:01:05.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.413+0000 7fd739000640 1 -- 172.21.15.50:0/2191108339 learned_addr learned my addr 172.21.15.50:0/2191108339 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:05.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.413+0000 7fd739000640 1 -- 172.21.15.50:0/2191108339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73419ddf0 con 0x7fd73407ddb0 2024-09-10T10:01:05.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.414+0000 7fd739000640 1 --2- 172.21.15.50:0/2191108339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 0x7fd73419d8b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd728030420 tx=0x7fd728032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:05.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.414+0000 7fd731600640 1 -- 172.21.15.50:0/2191108339 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd728037040 con 0x7fd73407ddb0 2024-09-10T10:01:05.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.414+0000 7fd731600640 1 -- 172.21.15.50:0/2191108339 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd728040070 con 0x7fd73407ddb0 2024-09-10T10:01:05.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.414+0000 7fd731600640 1 -- 172.21.15.50:0/2191108339 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd72803a6e0 con 0x7fd73407ddb0 2024-09-10T10:01:05.576 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.414+0000 7fd73ba00640 1 -- 172.21.15.50:0/2191108339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd73419e080 con 0x7fd73407ddb0 2024-09-10T10:01:05.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.414+0000 7fd73ba00640 1 -- 172.21.15.50:0/2191108339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7341a0d70 con 0x7fd73407ddb0 2024-09-10T10:01:05.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.415+0000 7fd731600640 1 -- 172.21.15.50:0/2191108339 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fd72803bb20 con 0x7fd73407ddb0 2024-09-10T10:01:05.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.415+0000 7fd73ba00640 1 -- 172.21.15.50:0/2191108339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd73407c3a0 con 0x7fd73407ddb0 2024-09-10T10:01:05.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.416+0000 7fd731600640 1 --2- 172.21.15.50:0/2191108339 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd71c039020 0x7fd71c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:05.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.416+0000 7fd731600640 1 -- 172.21.15.50:0/2191108339 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd72806c720 con 0x7fd73407ddb0 2024-09-10T10:01:05.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.416+0000 7fd733e00640 1 --2- 172.21.15.50:0/2191108339 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd71c039020 0x7fd71c03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:05.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.417+0000 7fd733e00640 1 --2- 172.21.15.50:0/2191108339 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd71c039020 0x7fd71c03b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd7200098c0 tx=0x7fd720006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:05.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.421+0000 7fd731600640 1 -- 172.21.15.50:0/2191108339 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd728043360 con 0x7fd73407ddb0 2024-09-10T10:01:05.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.609+0000 7fd73ba00640 1 -- 172.21.15.50:0/2191108339 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fd7341a0f40 con 0x7fd73407ddb0 2024-09-10T10:01:05.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.610+0000 7fd731600640 1 -- 172.21.15.50:0/2191108339 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fd728040220 con 0x7fd73407ddb0 2024-09-10T10:01:05.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.612+0000 7fd73ba00640 1 -- 172.21.15.50:0/2191108339 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd71c039020 msgr2=0x7fd71c03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:05.577 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.612+0000 7fd73ba00640 1 --2- 172.21.15.50:0/2191108339 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd71c039020 0x7fd71c03b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd7200098c0 tx=0x7fd720006db0 comp rx=0 tx=0).stop 2024-09-10T10:01:05.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.612+0000 7fd73ba00640 1 -- 172.21.15.50:0/2191108339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 msgr2=0x7fd73419d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:05.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.612+0000 7fd73ba00640 1 --2- 172.21.15.50:0/2191108339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 0x7fd73419d8b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd728030420 tx=0x7fd728032670 comp rx=0 tx=0).stop 2024-09-10T10:01:05.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.612+0000 7fd73ba00640 1 -- 172.21.15.50:0/2191108339 shutdown_connections 2024-09-10T10:01:05.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.612+0000 7fd73ba00640 1 --2- 172.21.15.50:0/2191108339 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd71c039020 0x7fd71c03b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:05.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.612+0000 7fd73ba00640 1 --2- 172.21.15.50:0/2191108339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd73407ddb0 0x7fd73419d8b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:05.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.612+0000 7fd73ba00640 1 -- 172.21.15.50:0/2191108339 >> 172.21.15.50:0/2191108339 conn(0x7fd734102eb0 msgr2=0x7fd734103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:05.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.612+0000 7fd73ba00640 1 -- 172.21.15.50:0/2191108339 shutdown_connections 2024-09-10T10:01:05.578 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:04.612+0000 7fd73ba00640 1 -- 172.21.15.50:0/2191108339 wait complete. 2024-09-10T10:01:05.589 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T10:01:05.589 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2024-09-10T10:01:05.603 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T10:01:05.603 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-09-10T10:01:05.603 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2024-09-10T10:01:05.603 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T10:01:05.605 INFO:teuthology.orchestra.run.smithi050.stdout:Ceph Dashboard is now available at: 2024-09-10T10:01:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:01:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: URL: https://smithi050.front.sepia.ceph.com:8443/ 2024-09-10T10:01:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: User: admin 2024-09-10T10:01:05.605 INFO:teuthology.orchestra.run.smithi050.stdout: Password: w3rgvdaphe 2024-09-10T10:01:05.606 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:01:05.606 INFO:teuthology.orchestra.run.smithi050.stdout:Saving cluster configuration to /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config directory 2024-09-10T10:01:06.808 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:06 smithi050 ceph-mon[30354]: mgrmap e13: x(active, since 6s) 2024-09-10T10:01:07.518 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.514+0000 7f8c5e800640 1 Processor -- start 2024-09-10T10:01:07.518 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.514+0000 7f8c5e800640 1 -- start start 2024-09-10T10:01:07.518 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.515+0000 7f8c5e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 0x7f8c58109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:07.518 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.515+0000 7f8c5e800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5810a290 con 0x7f8c581098c0 2024-09-10T10:01:07.519 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.515+0000 7f8c57400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 0x7f8c58109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:07.519 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.515+0000 7f8c57400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 0x7f8c58109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33252/0 (socket says 172.21.15.50:33252) 2024-09-10T10:01:07.519 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.515+0000 7f8c57400640 1 -- 172.21.15.50:0/634281956 learned_addr learned my addr 172.21.15.50:0/634281956 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:07.519 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.516+0000 7f8c57400640 1 -- 172.21.15.50:0/634281956 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5810aa70 con 0x7f8c581098c0 2024-09-10T10:01:07.519 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.516+0000 7f8c57400640 1 --2- 172.21.15.50:0/634281956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 0x7f8c58109cc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009820 tx=0x7f8c4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32dbae991e03891 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:07.519 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.517+0000 7f8c56000640 1 -- 172.21.15.50:0/634281956 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c48037070 con 0x7f8c581098c0 2024-09-10T10:01:07.519 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.517+0000 7f8c56000640 1 -- 172.21.15.50:0/634281956 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c48032920 con 0x7f8c581098c0 2024-09-10T10:01:07.519 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.517+0000 7f8c56000640 1 -- 172.21.15.50:0/634281956 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c48030810 con 0x7f8c581098c0 2024-09-10T10:01:07.519 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.517+0000 7f8c5e800640 1 -- 172.21.15.50:0/634281956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 msgr2=0x7f8c58109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:07.519 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.517+0000 7f8c5e800640 1 --2- 172.21.15.50:0/634281956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 0x7f8c58109cc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009820 tx=0x7f8c4802a270 comp rx=0 tx=0).stop 2024-09-10T10:01:07.519 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.518+0000 7f8c5e800640 1 -- 172.21.15.50:0/634281956 shutdown_connections 2024-09-10T10:01:07.519 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.518+0000 7f8c5e800640 1 --2- 172.21.15.50:0/634281956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 0x7f8c58109cc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:07.519 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.518+0000 7f8c5e800640 1 -- 172.21.15.50:0/634281956 >> 172.21.15.50:0/634281956 conn(0x7f8c5807cf40 msgr2=0x7f8c5807d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.518+0000 7f8c5e800640 1 -- 172.21.15.50:0/634281956 shutdown_connections 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.518+0000 7f8c5e800640 1 -- 172.21.15.50:0/634281956 wait complete. 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.519+0000 7f8c5e800640 1 Processor -- start 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.519+0000 7f8c5e800640 1 -- start start 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.519+0000 7f8c5e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 0x7f8c5819d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.519+0000 7f8c5e800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5810de20 con 0x7f8c581098c0 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.519+0000 7f8c57400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 0x7f8c5819d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.519+0000 7f8c57400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 0x7f8c5819d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33268/0 (socket says 172.21.15.50:33268) 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.519+0000 7f8c57400640 1 -- 172.21.15.50:0/4086675772 learned_addr learned my addr 172.21.15.50:0/4086675772 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.520+0000 7f8c57400640 1 -- 172.21.15.50:0/4086675772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5819ddf0 con 0x7f8c581098c0 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.520+0000 7f8c57400640 1 --2- 172.21.15.50:0/4086675772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 0x7f8c5819d8b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c480097f0 tx=0x7f8c480327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.520+0000 7f8c4fe00640 1 -- 172.21.15.50:0/4086675772 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c48037040 con 0x7f8c581098c0 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.520+0000 7f8c4fe00640 1 -- 172.21.15.50:0/4086675772 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c48030cc0 con 0x7f8c581098c0 2024-09-10T10:01:07.520 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.520+0000 7f8c4fe00640 1 -- 172.21.15.50:0/4086675772 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c4803a640 con 0x7f8c581098c0 2024-09-10T10:01:07.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.520+0000 7f8c5e800640 1 -- 172.21.15.50:0/4086675772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c5819e080 con 0x7f8c581098c0 2024-09-10T10:01:07.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.520+0000 7f8c5e800640 1 -- 172.21.15.50:0/4086675772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c581a0d70 con 0x7f8c581098c0 2024-09-10T10:01:07.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.522+0000 7f8c4fe00640 1 -- 172.21.15.50:0/4086675772 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8c4803b3f0 con 0x7f8c581098c0 2024-09-10T10:01:07.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.522+0000 7f8c5e800640 1 -- 172.21.15.50:0/4086675772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c58109d40 con 0x7f8c581098c0 2024-09-10T10:01:07.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.522+0000 7f8c4fe00640 1 --2- 172.21.15.50:0/4086675772 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8c3c0390c0 0x7f8c3c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:07.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.522+0000 7f8c4fe00640 1 -- 172.21.15.50:0/4086675772 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8c4806c760 con 0x7f8c581098c0 2024-09-10T10:01:07.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.522+0000 7f8c56a00640 1 --2- 172.21.15.50:0/4086675772 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8c3c0390c0 0x7f8c3c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:07.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.523+0000 7f8c56a00640 1 --2- 172.21.15.50:0/4086675772 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8c3c0390c0 0x7f8c3c03b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c440098c0 tx=0x7f8c44006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:07.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.528+0000 7f8c4fe00640 1 -- 172.21.15.50:0/4086675772 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8c48041710 con 0x7f8c581098c0 2024-09-10T10:01:07.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.806+0000 7f8c5e800640 1 -- 172.21.15.50:0/4086675772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f8c581a0f40 con 0x7f8c581098c0 2024-09-10T10:01:07.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.810+0000 7f8c4fe00640 1 -- 172.21.15.50:0/4086675772 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f8c480328c0 con 0x7f8c581098c0 2024-09-10T10:01:07.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T10:01:07.521 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.812+0000 7f8c5e800640 1 -- 172.21.15.50:0/4086675772 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8c3c0390c0 msgr2=0x7f8c3c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.812+0000 7f8c5e800640 1 --2- 172.21.15.50:0/4086675772 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8c3c0390c0 0x7f8c3c03b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c440098c0 tx=0x7f8c44006db0 comp rx=0 tx=0).stop 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.812+0000 7f8c5e800640 1 -- 172.21.15.50:0/4086675772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 msgr2=0x7f8c5819d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.812+0000 7f8c5e800640 1 --2- 172.21.15.50:0/4086675772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 0x7f8c5819d8b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c480097f0 tx=0x7f8c480327b0 comp rx=0 tx=0).stop 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.812+0000 7f8c5e800640 1 -- 172.21.15.50:0/4086675772 shutdown_connections 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.812+0000 7f8c5e800640 1 --2- 172.21.15.50:0/4086675772 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8c3c0390c0 0x7f8c3c03b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.812+0000 7f8c5e800640 1 --2- 172.21.15.50:0/4086675772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c581098c0 0x7f8c5819d8b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.812+0000 7f8c5e800640 1 -- 172.21.15.50:0/4086675772 >> 172.21.15.50:0/4086675772 conn(0x7f8c5807cf40 msgr2=0x7f8c58107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.813+0000 7f8c5e800640 1 -- 172.21.15.50:0/4086675772 shutdown_connections 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr 2024-09-10T10:01:06.813+0000 7f8c5e800640 1 -- 172.21.15.50:0/4086675772 wait complete. 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T10:01:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:01:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T10:01:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:01:07.523 INFO:teuthology.orchestra.run.smithi050.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T10:01:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:01:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: ceph telemetry on 2024-09-10T10:01:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:01:07.523 INFO:teuthology.orchestra.run.smithi050.stdout:For more information see: 2024-09-10T10:01:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:01:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T10:01:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:01:07.523 INFO:teuthology.orchestra.run.smithi050.stdout:Bootstrap complete. 2024-09-10T10:01:07.577 INFO:tasks.cephadm:Fetching config... 2024-09-10T10:01:07.577 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:01:07.577 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T10:01:07.615 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T10:01:07.615 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:01:07.616 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T10:01:07.691 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T10:01:07.691 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:01:07.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T10:01:07.789 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T10:01:07.789 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:01:07.790 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T10:01:07.865 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T10:01:07.866 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC78sF/H3u3+cN3C/YUrK4Vcd7gW974T5jNmP/RnNNBV9hhysiC2R6dLyb29/G8LIF5estin4Nt2PddEMarfdOg65ae5yCLgLuvjcgQ+DFO7CfZhpblGrxlFtUAnUWn+lLoTMyXNph7QxgcBfZlr4kx6+KTQaJ0vAGmVVdDqMwSPTVlmEXg2UBI6Pt2+z0MbsT55dGlRNO1LwsBoa9ihnk6gR7l3jIU6pY3JFmgVDmtw7tID4KbSYkJHl5iRYzOcrGm6GWXO2YsHracfUHkbzOa50AQyipJLrjQcLtuIMLB+hLTXXhYVCmaXm962nz/IYjZMn1ZEHQnkQynWFj+nVJGvdVhM/FO1RTf+QmpV1xOdyvymCajm6AFgxmGBTBLYG96/dGsV6mErpZXBFFxsPC1FNpqp/N2CjDhgDAhPkFEzOMEmJJnq0EvdBcg2YBCbwmdr+D20cysukOmuFxnlzw6zpuaoi0nfqfUJNdgtycyqyasRp/BnHpOpYDJtLta9sE= ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T10:01:07.987 INFO:teuthology.orchestra.run.smithi050.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC78sF/H3u3+cN3C/YUrK4Vcd7gW974T5jNmP/RnNNBV9hhysiC2R6dLyb29/G8LIF5estin4Nt2PddEMarfdOg65ae5yCLgLuvjcgQ+DFO7CfZhpblGrxlFtUAnUWn+lLoTMyXNph7QxgcBfZlr4kx6+KTQaJ0vAGmVVdDqMwSPTVlmEXg2UBI6Pt2+z0MbsT55dGlRNO1LwsBoa9ihnk6gR7l3jIU6pY3JFmgVDmtw7tID4KbSYkJHl5iRYzOcrGm6GWXO2YsHracfUHkbzOa50AQyipJLrjQcLtuIMLB+hLTXXhYVCmaXm962nz/IYjZMn1ZEHQnkQynWFj+nVJGvdVhM/FO1RTf+QmpV1xOdyvymCajm6AFgxmGBTBLYG96/dGsV6mErpZXBFFxsPC1FNpqp/N2CjDhgDAhPkFEzOMEmJJnq0EvdBcg2YBCbwmdr+D20cysukOmuFxnlzw6zpuaoi0nfqfUJNdgtycyqyasRp/BnHpOpYDJtLta9sE= ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:01:08.011 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:07 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4086675772' entity='client.admin' 2024-09-10T10:01:08.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC78sF/H3u3+cN3C/YUrK4Vcd7gW974T5jNmP/RnNNBV9hhysiC2R6dLyb29/G8LIF5estin4Nt2PddEMarfdOg65ae5yCLgLuvjcgQ+DFO7CfZhpblGrxlFtUAnUWn+lLoTMyXNph7QxgcBfZlr4kx6+KTQaJ0vAGmVVdDqMwSPTVlmEXg2UBI6Pt2+z0MbsT55dGlRNO1LwsBoa9ihnk6gR7l3jIU6pY3JFmgVDmtw7tID4KbSYkJHl5iRYzOcrGm6GWXO2YsHracfUHkbzOa50AQyipJLrjQcLtuIMLB+hLTXXhYVCmaXm962nz/IYjZMn1ZEHQnkQynWFj+nVJGvdVhM/FO1RTf+QmpV1xOdyvymCajm6AFgxmGBTBLYG96/dGsV6mErpZXBFFxsPC1FNpqp/N2CjDhgDAhPkFEzOMEmJJnq0EvdBcg2YBCbwmdr+D20cysukOmuFxnlzw6zpuaoi0nfqfUJNdgtycyqyasRp/BnHpOpYDJtLta9sE= ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T10:01:08.057 INFO:teuthology.orchestra.run.smithi084.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC78sF/H3u3+cN3C/YUrK4Vcd7gW974T5jNmP/RnNNBV9hhysiC2R6dLyb29/G8LIF5estin4Nt2PddEMarfdOg65ae5yCLgLuvjcgQ+DFO7CfZhpblGrxlFtUAnUWn+lLoTMyXNph7QxgcBfZlr4kx6+KTQaJ0vAGmVVdDqMwSPTVlmEXg2UBI6Pt2+z0MbsT55dGlRNO1LwsBoa9ihnk6gR7l3jIU6pY3JFmgVDmtw7tID4KbSYkJHl5iRYzOcrGm6GWXO2YsHracfUHkbzOa50AQyipJLrjQcLtuIMLB+hLTXXhYVCmaXm962nz/IYjZMn1ZEHQnkQynWFj+nVJGvdVhM/FO1RTf+QmpV1xOdyvymCajm6AFgxmGBTBLYG96/dGsV6mErpZXBFFxsPC1FNpqp/N2CjDhgDAhPkFEzOMEmJJnq0EvdBcg2YBCbwmdr+D20cysukOmuFxnlzw6zpuaoi0nfqfUJNdgtycyqyasRp/BnHpOpYDJtLta9sE= ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:01:08.069 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC78sF/H3u3+cN3C/YUrK4Vcd7gW974T5jNmP/RnNNBV9hhysiC2R6dLyb29/G8LIF5estin4Nt2PddEMarfdOg65ae5yCLgLuvjcgQ+DFO7CfZhpblGrxlFtUAnUWn+lLoTMyXNph7QxgcBfZlr4kx6+KTQaJ0vAGmVVdDqMwSPTVlmEXg2UBI6Pt2+z0MbsT55dGlRNO1LwsBoa9ihnk6gR7l3jIU6pY3JFmgVDmtw7tID4KbSYkJHl5iRYzOcrGm6GWXO2YsHracfUHkbzOa50AQyipJLrjQcLtuIMLB+hLTXXhYVCmaXm962nz/IYjZMn1ZEHQnkQynWFj+nVJGvdVhM/FO1RTf+QmpV1xOdyvymCajm6AFgxmGBTBLYG96/dGsV6mErpZXBFFxsPC1FNpqp/N2CjDhgDAhPkFEzOMEmJJnq0EvdBcg2YBCbwmdr+D20cysukOmuFxnlzw6zpuaoi0nfqfUJNdgtycyqyasRp/BnHpOpYDJtLta9sE= ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T10:01:08.113 INFO:teuthology.orchestra.run.smithi189.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC78sF/H3u3+cN3C/YUrK4Vcd7gW974T5jNmP/RnNNBV9hhysiC2R6dLyb29/G8LIF5estin4Nt2PddEMarfdOg65ae5yCLgLuvjcgQ+DFO7CfZhpblGrxlFtUAnUWn+lLoTMyXNph7QxgcBfZlr4kx6+KTQaJ0vAGmVVdDqMwSPTVlmEXg2UBI6Pt2+z0MbsT55dGlRNO1LwsBoa9ihnk6gR7l3jIU6pY3JFmgVDmtw7tID4KbSYkJHl5iRYzOcrGm6GWXO2YsHracfUHkbzOa50AQyipJLrjQcLtuIMLB+hLTXXhYVCmaXm962nz/IYjZMn1ZEHQnkQynWFj+nVJGvdVhM/FO1RTf+QmpV1xOdyvymCajm6AFgxmGBTBLYG96/dGsV6mErpZXBFFxsPC1FNpqp/N2CjDhgDAhPkFEzOMEmJJnq0EvdBcg2YBCbwmdr+D20cysukOmuFxnlzw6zpuaoi0nfqfUJNdgtycyqyasRp/BnHpOpYDJtLta9sE= ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:01:08.125 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T10:01:08.500 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:01:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.053+0000 7f3f45200640 1 -- 172.21.15.50:0/3841570970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f401037f0 msgr2=0x7f3f40103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.053+0000 7f3f45200640 1 --2- 172.21.15.50:0/3841570970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f401037f0 0x7f3f40103bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009c20 tx=0x7f3f3002aa90 comp rx=0 tx=0).stop 2024-09-10T10:01:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.053+0000 7f3f45200640 1 -- 172.21.15.50:0/3841570970 shutdown_connections 2024-09-10T10:01:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.054+0000 7f3f45200640 1 --2- 172.21.15.50:0/3841570970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f401037f0 0x7f3f40103bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.054+0000 7f3f45200640 1 -- 172.21.15.50:0/3841570970 >> 172.21.15.50:0/3841570970 conn(0x7f3f400fefc0 msgr2=0x7f3f40101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.054+0000 7f3f45200640 1 -- 172.21.15.50:0/3841570970 shutdown_connections 2024-09-10T10:01:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.054+0000 7f3f45200640 1 -- 172.21.15.50:0/3841570970 wait complete. 2024-09-10T10:01:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.055+0000 7f3f45200640 1 Processor -- start 2024-09-10T10:01:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.055+0000 7f3f45200640 1 -- start start 2024-09-10T10:01:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.055+0000 7f3f45200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f401037f0 0x7f3f40198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.055+0000 7f3f45200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f40109900 con 0x7f3f401037f0 2024-09-10T10:01:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.055+0000 7f3f3de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f401037f0 0x7f3f40198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:09.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.055+0000 7f3f3de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f401037f0 0x7f3f40198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37328/0 (socket says 172.21.15.50:37328) 2024-09-10T10:01:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.055+0000 7f3f3de00640 1 -- 172.21.15.50:0/1072700375 learned_addr learned my addr 172.21.15.50:0/1072700375 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.056+0000 7f3f3de00640 1 -- 172.21.15.50:0/1072700375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f40199470 con 0x7f3f401037f0 2024-09-10T10:01:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.056+0000 7f3f3de00640 1 --2- 172.21.15.50:0/1072700375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f401037f0 0x7f3f40198f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3f3002f040 tx=0x7f3f3002e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.056+0000 7f3f37400640 1 -- 172.21.15.50:0/1072700375 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f30047070 con 0x7f3f401037f0 2024-09-10T10:01:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.056+0000 7f3f37400640 1 -- 172.21.15.50:0/1072700375 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f30003e50 con 0x7f3f401037f0 2024-09-10T10:01:09.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.056+0000 7f3f37400640 1 -- 172.21.15.50:0/1072700375 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f30033050 con 0x7f3f401037f0 2024-09-10T10:01:09.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.056+0000 7f3f45200640 1 -- 172.21.15.50:0/1072700375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f40199700 con 0x7f3f401037f0 2024-09-10T10:01:09.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.057+0000 7f3f45200640 1 -- 172.21.15.50:0/1072700375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4019c3f0 con 0x7f3f401037f0 2024-09-10T10:01:09.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.058+0000 7f3f45200640 1 -- 172.21.15.50:0/1072700375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4010a080 con 0x7f3f401037f0 2024-09-10T10:01:09.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.058+0000 7f3f37400640 1 -- 172.21.15.50:0/1072700375 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3f3004a070 con 0x7f3f401037f0 2024-09-10T10:01:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.059+0000 7f3f37400640 1 --2- 172.21.15.50:0/1072700375 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3f240390c0 0x7f3f2403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.059+0000 7f3f37400640 1 -- 172.21.15.50:0/1072700375 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3f3003e030 con 0x7f3f401037f0 2024-09-10T10:01:09.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.059+0000 7f3f35400640 1 --2- 172.21.15.50:0/1072700375 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3f240390c0 0x7f3f2403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:09.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.060+0000 7f3f35400640 1 --2- 172.21.15.50:0/1072700375 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3f240390c0 0x7f3f2403b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3f280098c0 tx=0x7f3f28006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.064+0000 7f3f37400640 1 -- 172.21.15.50:0/1072700375 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f30004310 con 0x7f3f401037f0 2024-09-10T10:01:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.254+0000 7f3f45200640 1 -- 172.21.15.50:0/1072700375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f3f4002d830 con 0x7f3f401037f0 2024-09-10T10:01:09.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.256+0000 7f3f37400640 1 -- 172.21.15.50:0/1072700375 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f3f30038450 con 0x7f3f401037f0 2024-09-10T10:01:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.259+0000 7f3f45200640 1 -- 172.21.15.50:0/1072700375 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3f240390c0 msgr2=0x7f3f2403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:09.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.259+0000 7f3f45200640 1 --2- 172.21.15.50:0/1072700375 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3f240390c0 0x7f3f2403b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3f280098c0 tx=0x7f3f28006db0 comp rx=0 tx=0).stop 2024-09-10T10:01:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.259+0000 7f3f45200640 1 -- 172.21.15.50:0/1072700375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f401037f0 msgr2=0x7f3f40198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.259+0000 7f3f45200640 1 --2- 172.21.15.50:0/1072700375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f401037f0 0x7f3f40198f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3f3002f040 tx=0x7f3f3002e3c0 comp rx=0 tx=0).stop 2024-09-10T10:01:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.259+0000 7f3f45200640 1 -- 172.21.15.50:0/1072700375 shutdown_connections 2024-09-10T10:01:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.259+0000 7f3f45200640 1 --2- 172.21.15.50:0/1072700375 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3f240390c0 0x7f3f2403b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.259+0000 7f3f45200640 1 --2- 172.21.15.50:0/1072700375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f401037f0 0x7f3f40198f30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.259+0000 7f3f45200640 1 -- 172.21.15.50:0/1072700375 >> 172.21.15.50:0/1072700375 conn(0x7f3f400fefc0 msgr2=0x7f3f400ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.259+0000 7f3f45200640 1 -- 172.21.15.50:0/1072700375 shutdown_connections 2024-09-10T10:01:09.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:09.259+0000 7f3f45200640 1 -- 172.21.15.50:0/1072700375 wait complete. 2024-09-10T10:01:10.513 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:10 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1072700375' entity='client.admin' 2024-09-10T10:01:10.513 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:10.513 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:10.513 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi050", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:01:10.513 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:10.513 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:10.513 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:10.514 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T10:01:10.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T10:01:11.146 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:01:11.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.705+0000 7f3494c00640 1 -- 172.21.15.50:0/2775741678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3490103610 msgr2=0x7f3490103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.705+0000 7f3494c00640 1 --2- 172.21.15.50:0/2775741678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3490103610 0x7f3490103a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3480009880 tx=0x7f348002a5d0 comp rx=0 tx=0).stop 2024-09-10T10:01:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.705+0000 7f3494c00640 1 -- 172.21.15.50:0/2775741678 shutdown_connections 2024-09-10T10:01:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.705+0000 7f3494c00640 1 --2- 172.21.15.50:0/2775741678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3490103610 0x7f3490103a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.705+0000 7f3494c00640 1 -- 172.21.15.50:0/2775741678 >> 172.21.15.50:0/2775741678 conn(0x7f34900feda0 msgr2=0x7f34901011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.705+0000 7f3494c00640 1 -- 172.21.15.50:0/2775741678 shutdown_connections 2024-09-10T10:01:11.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.705+0000 7f3494c00640 1 -- 172.21.15.50:0/2775741678 wait complete. 2024-09-10T10:01:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.706+0000 7f3494c00640 1 Processor -- start 2024-09-10T10:01:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.706+0000 7f3494c00640 1 -- start start 2024-09-10T10:01:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.706+0000 7f3494c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3490103610 0x7f3490198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.706+0000 7f3494c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3490109720 con 0x7f3490103610 2024-09-10T10:01:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.707+0000 7f348f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3490103610 0x7f3490198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.707+0000 7f348f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3490103610 0x7f3490198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37344/0 (socket says 172.21.15.50:37344) 2024-09-10T10:01:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.707+0000 7f348f400640 1 -- 172.21.15.50:0/3058363605 learned_addr learned my addr 172.21.15.50:0/3058363605 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:11.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.707+0000 7f348f400640 1 -- 172.21.15.50:0/3058363605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3490199310 con 0x7f3490103610 2024-09-10T10:01:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.707+0000 7f348f400640 1 --2- 172.21.15.50:0/3058363605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3490103610 0x7f3490198dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3480004f60 tx=0x7f34800048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.708+0000 7f3487e00640 1 -- 172.21.15.50:0/3058363605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348003f070 con 0x7f3490103610 2024-09-10T10:01:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.708+0000 7f3487e00640 1 -- 172.21.15.50:0/3058363605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3480004cc0 con 0x7f3490103610 2024-09-10T10:01:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.708+0000 7f3487e00640 1 -- 172.21.15.50:0/3058363605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3480035030 con 0x7f3490103610 2024-09-10T10:01:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.708+0000 7f3494c00640 1 -- 172.21.15.50:0/3058363605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34901995a0 con 0x7f3490103610 2024-09-10T10:01:11.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.708+0000 7f3494c00640 1 -- 172.21.15.50:0/3058363605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349019c290 con 0x7f3490103610 2024-09-10T10:01:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.709+0000 7f3487e00640 1 -- 172.21.15.50:0/3058363605 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3480042070 con 0x7f3490103610 2024-09-10T10:01:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.709+0000 7f3494c00640 1 -- 172.21.15.50:0/3058363605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3490109ea0 con 0x7f3490103610 2024-09-10T10:01:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.710+0000 7f3487e00640 1 --2- 172.21.15.50:0/3058363605 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f34740390c0 0x7f347403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.710+0000 7f3487e00640 1 -- 172.21.15.50:0/3058363605 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f348006cdd0 con 0x7f3490103610 2024-09-10T10:01:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.710+0000 7f348ea00640 1 --2- 172.21.15.50:0/3058363605 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f34740390c0 0x7f347403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.711+0000 7f348ea00640 1 --2- 172.21.15.50:0/3058363605 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f34740390c0 0x7f347403b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f347c0098c0 tx=0x7f347c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:11.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.716+0000 7f3487e00640 1 -- 172.21.15.50:0/3058363605 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3480040260 con 0x7f3490103610 2024-09-10T10:01:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.910+0000 7f3494c00640 1 -- 172.21.15.50:0/3058363605 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f349002d830 con 0x7f34740390c0 2024-09-10T10:01:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.914+0000 7f3487e00640 1 -- 172.21.15.50:0/3058363605 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f349002d830 con 0x7f34740390c0 2024-09-10T10:01:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.917+0000 7f3494c00640 1 -- 172.21.15.50:0/3058363605 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f34740390c0 msgr2=0x7f347403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.917+0000 7f3494c00640 1 --2- 172.21.15.50:0/3058363605 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f34740390c0 0x7f347403b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f347c0098c0 tx=0x7f347c006db0 comp rx=0 tx=0).stop 2024-09-10T10:01:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.917+0000 7f3494c00640 1 -- 172.21.15.50:0/3058363605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3490103610 msgr2=0x7f3490198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.917+0000 7f3494c00640 1 --2- 172.21.15.50:0/3058363605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3490103610 0x7f3490198dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3480004f60 tx=0x7f34800048f0 comp rx=0 tx=0).stop 2024-09-10T10:01:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.917+0000 7f3494c00640 1 -- 172.21.15.50:0/3058363605 shutdown_connections 2024-09-10T10:01:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.917+0000 7f3494c00640 1 --2- 172.21.15.50:0/3058363605 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f34740390c0 0x7f347403b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.917+0000 7f3494c00640 1 --2- 172.21.15.50:0/3058363605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3490103610 0x7f3490198dd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.917+0000 7f3494c00640 1 -- 172.21.15.50:0/3058363605 >> 172.21.15.50:0/3058363605 conn(0x7f34900feda0 msgr2=0x7f34900ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.917+0000 7f3494c00640 1 -- 172.21.15.50:0/3058363605 shutdown_connections 2024-09-10T10:01:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:11.917+0000 7f3494c00640 1 -- 172.21.15.50:0/3058363605 wait complete. 2024-09-10T10:01:13.180 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:12 smithi050 ceph-mon[30354]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:13.180 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:12 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:13.180 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:12 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:13.180 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:12 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:13.180 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:12 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:13.180 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:12 smithi050 ceph-mon[30354]: Updating smithi050:/etc/ceph/ceph.conf 2024-09-10T10:01:13.180 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:12 smithi050 ceph-mon[30354]: Updating smithi050:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:13.446 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi084 2024-09-10T10:01:13.446 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T10:01:13.446 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/etc/ceph/ceph.conf 2024-09-10T10:01:13.461 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T10:01:13.462 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:01:13.517 INFO:tasks.cephadm:Adding host smithi084 to orchestrator... 2024-09-10T10:01:13.517 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch host add smithi084 2024-09-10T10:01:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:01:14.173 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:13 smithi050 ceph-mon[30354]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:01:14.173 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:13 smithi050 ceph-mon[30354]: Updating smithi050:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:01:14.173 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:14.174 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:14.174 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.380+0000 7fe8b9600640 1 -- 172.21.15.50:0/3277636303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b4109770 msgr2=0x7fe8b4109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.380+0000 7fe8b9600640 1 --2- 172.21.15.50:0/3277636303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b4109770 0x7fe8b4109b50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4009c20 tx=0x7fe8a402aa90 comp rx=0 tx=0).stop 2024-09-10T10:01:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.380+0000 7fe8b9600640 1 -- 172.21.15.50:0/3277636303 shutdown_connections 2024-09-10T10:01:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.380+0000 7fe8b9600640 1 --2- 172.21.15.50:0/3277636303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b4109770 0x7fe8b4109b50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.380+0000 7fe8b9600640 1 -- 172.21.15.50:0/3277636303 >> 172.21.15.50:0/3277636303 conn(0x7fe8b40ff450 msgr2=0x7fe8b4101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.380+0000 7fe8b9600640 1 -- 172.21.15.50:0/3277636303 shutdown_connections 2024-09-10T10:01:14.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.380+0000 7fe8b9600640 1 -- 172.21.15.50:0/3277636303 wait complete. 2024-09-10T10:01:14.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.381+0000 7fe8b9600640 1 Processor -- start 2024-09-10T10:01:14.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.381+0000 7fe8b9600640 1 -- start start 2024-09-10T10:01:14.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.382+0000 7fe8b9600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b4109770 0x7fe8b41993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:14.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.382+0000 7fe8b9600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b410de30 con 0x7fe8b4109770 2024-09-10T10:01:14.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.382+0000 7fe8b2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b4109770 0x7fe8b41993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:14.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.382+0000 7fe8b2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b4109770 0x7fe8b41993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37358/0 (socket says 172.21.15.50:37358) 2024-09-10T10:01:14.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.382+0000 7fe8b2a00640 1 -- 172.21.15.50:0/3172295696 learned_addr learned my addr 172.21.15.50:0/3172295696 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:14.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.382+0000 7fe8b2a00640 1 -- 172.21.15.50:0/3172295696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b41998e0 con 0x7fe8b4109770 2024-09-10T10:01:14.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.383+0000 7fe8b2a00640 1 --2- 172.21.15.50:0/3172295696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b4109770 0x7fe8b41993a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4009d40 tx=0x7fe8a402fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:14.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.383+0000 7fe8abe00640 1 -- 172.21.15.50:0/3172295696 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8a4047070 con 0x7fe8b4109770 2024-09-10T10:01:14.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.383+0000 7fe8abe00640 1 -- 172.21.15.50:0/3172295696 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8a4003e40 con 0x7fe8b4109770 2024-09-10T10:01:14.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.383+0000 7fe8abe00640 1 -- 172.21.15.50:0/3172295696 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8a4033050 con 0x7fe8b4109770 2024-09-10T10:01:14.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.383+0000 7fe8b9600640 1 -- 172.21.15.50:0/3172295696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8b4199b70 con 0x7fe8b4109770 2024-09-10T10:01:14.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.383+0000 7fe8b9600640 1 -- 172.21.15.50:0/3172295696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8b4199fd0 con 0x7fe8b4109770 2024-09-10T10:01:14.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.384+0000 7fe8abe00640 1 -- 172.21.15.50:0/3172295696 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fe8a404a070 con 0x7fe8b4109770 2024-09-10T10:01:14.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.384+0000 7fe8b9600640 1 -- 172.21.15.50:0/3172295696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8b4104eb0 con 0x7fe8b4109770 2024-09-10T10:01:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.384+0000 7fe8abe00640 1 --2- 172.21.15.50:0/3172295696 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe8980390c0 0x7fe89803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.385+0000 7fe8abe00640 1 -- 172.21.15.50:0/3172295696 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe8a403e030 con 0x7fe8b4109770 2024-09-10T10:01:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.385+0000 7fe8aa000640 1 --2- 172.21.15.50:0/3172295696 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe8980390c0 0x7fe89803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:14.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.385+0000 7fe8aa000640 1 --2- 172.21.15.50:0/3172295696 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe8980390c0 0x7fe89803b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0098c0 tx=0x7fe89c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:14.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.389+0000 7fe8abe00640 1 -- 172.21.15.50:0/3172295696 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8a402e8e0 con 0x7fe8b4109770 2024-09-10T10:01:14.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:14.577+0000 7fe8b9600640 1 -- 172.21.15.50:0/3172295696 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi084", "target": ["mon-mgr", ""]}) -- 0x7fe8b419a700 con 0x7fe8980390c0 2024-09-10T10:01:15.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:14 smithi050 ceph-mon[30354]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi084", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:16 smithi050 ceph-mon[30354]: Deploying cephadm binary to smithi084 2024-09-10T10:01:18.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:18.440+0000 7fe8abe00640 1 -- 172.21.15.50:0/3172295696 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fe8b419a700 con 0x7fe8980390c0 2024-09-10T10:01:18.442 INFO:teuthology.orchestra.run.smithi050.stdout:Added host 'smithi084' with addr '172.21.15.84' 2024-09-10T10:01:18.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:18.443+0000 7fe8b9600640 1 -- 172.21.15.50:0/3172295696 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe8980390c0 msgr2=0x7fe89803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:18.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:18.443+0000 7fe8b9600640 1 --2- 172.21.15.50:0/3172295696 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe8980390c0 0x7fe89803b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0098c0 tx=0x7fe89c006db0 comp rx=0 tx=0).stop 2024-09-10T10:01:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:18.443+0000 7fe8b9600640 1 -- 172.21.15.50:0/3172295696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b4109770 msgr2=0x7fe8b41993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:18.443+0000 7fe8b9600640 1 --2- 172.21.15.50:0/3172295696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b4109770 0x7fe8b41993a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4009d40 tx=0x7fe8a402fc10 comp rx=0 tx=0).stop 2024-09-10T10:01:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:18.443+0000 7fe8b9600640 1 -- 172.21.15.50:0/3172295696 shutdown_connections 2024-09-10T10:01:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:18.443+0000 7fe8b9600640 1 --2- 172.21.15.50:0/3172295696 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe8980390c0 0x7fe89803b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:18.443+0000 7fe8b9600640 1 --2- 172.21.15.50:0/3172295696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8b4109770 0x7fe8b41993a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:18.443+0000 7fe8b9600640 1 -- 172.21.15.50:0/3172295696 >> 172.21.15.50:0/3172295696 conn(0x7fe8b40ff450 msgr2=0x7fe8b4107280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:18.443+0000 7fe8b9600640 1 -- 172.21.15.50:0/3172295696 shutdown_connections 2024-09-10T10:01:18.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:18.443+0000 7fe8b9600640 1 -- 172.21.15.50:0/3172295696 wait complete. 2024-09-10T10:01:19.165 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T10:01:19.542 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:01:19.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:19 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:19.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:19 smithi050 ceph-mon[30354]: Added host smithi084 2024-09-10T10:01:19.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:19 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:19.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:19 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:19.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:19 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:20.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.001+0000 7fbeb9c00640 1 -- 172.21.15.50:0/4114964072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb41097a0 msgr2=0x7fbeb4109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:20.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.001+0000 7fbeb9c00640 1 --2- 172.21.15.50:0/4114964072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb41097a0 0x7fbeb4109b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009880 tx=0x7fbea402a5d0 comp rx=0 tx=0).stop 2024-09-10T10:01:20.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.002+0000 7fbeb9c00640 1 -- 172.21.15.50:0/4114964072 shutdown_connections 2024-09-10T10:01:20.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.002+0000 7fbeb9c00640 1 --2- 172.21.15.50:0/4114964072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb41097a0 0x7fbeb4109b80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:20.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.002+0000 7fbeb9c00640 1 -- 172.21.15.50:0/4114964072 >> 172.21.15.50:0/4114964072 conn(0x7fbeb40ff4c0 msgr2=0x7fbeb41018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:20.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.002+0000 7fbeb9c00640 1 -- 172.21.15.50:0/4114964072 shutdown_connections 2024-09-10T10:01:20.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.002+0000 7fbeb9c00640 1 -- 172.21.15.50:0/4114964072 wait complete. 2024-09-10T10:01:20.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.003+0000 7fbeb9c00640 1 Processor -- start 2024-09-10T10:01:20.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.003+0000 7fbeb9c00640 1 -- start start 2024-09-10T10:01:20.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.003+0000 7fbeb9c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb41097a0 0x7fbeb41993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:20.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.003+0000 7fbeb9c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb410de60 con 0x7fbeb41097a0 2024-09-10T10:01:20.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.003+0000 7fbeb2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb41097a0 0x7fbeb41993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:20.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.003+0000 7fbeb2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb41097a0 0x7fbeb41993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59218/0 (socket says 172.21.15.50:59218) 2024-09-10T10:01:20.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.003+0000 7fbeb2a00640 1 -- 172.21.15.50:0/3053989367 learned_addr learned my addr 172.21.15.50:0/3053989367 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:20.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.004+0000 7fbeb2a00640 1 -- 172.21.15.50:0/3053989367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb4199910 con 0x7fbeb41097a0 2024-09-10T10:01:20.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.004+0000 7fbeb2a00640 1 --2- 172.21.15.50:0/3053989367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb41097a0 0x7fbeb41993d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009230 tx=0x7fbea4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:20.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.004+0000 7fbeab400640 1 -- 172.21.15.50:0/3053989367 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbea403f070 con 0x7fbeb41097a0 2024-09-10T10:01:20.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.004+0000 7fbeb9c00640 1 -- 172.21.15.50:0/3053989367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb4199c00 con 0x7fbeb41097a0 2024-09-10T10:01:20.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.004+0000 7fbeab400640 1 -- 172.21.15.50:0/3053989367 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbea403bc80 con 0x7fbeb41097a0 2024-09-10T10:01:20.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.004+0000 7fbeb9c00640 1 -- 172.21.15.50:0/3053989367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb419dca0 con 0x7fbeb41097a0 2024-09-10T10:01:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.004+0000 7fbeab400640 1 -- 172.21.15.50:0/3053989367 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbea4049060 con 0x7fbeb41097a0 2024-09-10T10:01:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.005+0000 7fbeab400640 1 -- 172.21.15.50:0/3053989367 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fbea4042070 con 0x7fbeb41097a0 2024-09-10T10:01:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.005+0000 7fbeb9c00640 1 -- 172.21.15.50:0/3053989367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb4104ee0 con 0x7fbeb41097a0 2024-09-10T10:01:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.006+0000 7fbeab400640 1 --2- 172.21.15.50:0/3053989367 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbe98039060 0x7fbe9803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.006+0000 7fbeab400640 1 -- 172.21.15.50:0/3053989367 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbea406d0a0 con 0x7fbeb41097a0 2024-09-10T10:01:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.006+0000 7fbeabe00640 1 --2- 172.21.15.50:0/3053989367 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbe98039060 0x7fbe9803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.007+0000 7fbeabe00640 1 --2- 172.21.15.50:0/3053989367 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbe98039060 0x7fbe9803b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0098c0 tx=0x7fbe9c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:20.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.011+0000 7fbeab400640 1 -- 172.21.15.50:0/3053989367 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbea4031d40 con 0x7fbeb41097a0 2024-09-10T10:01:20.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.201+0000 7fbeb9c00640 1 -- 172.21.15.50:0/3053989367 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbeb4109c60 con 0x7fbe98039060 2024-09-10T10:01:20.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.203+0000 7fbeab400640 1 -- 172.21.15.50:0/3053989367 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7fbeb4109c60 con 0x7fbe98039060 2024-09-10T10:01:20.204 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:01:20.204 INFO:teuthology.orchestra.run.smithi050.stdout:[{"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}, {"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}] 2024-09-10T10:01:20.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.205+0000 7fbeb9c00640 1 -- 172.21.15.50:0/3053989367 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbe98039060 msgr2=0x7fbe9803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:20.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.205+0000 7fbeb9c00640 1 --2- 172.21.15.50:0/3053989367 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbe98039060 0x7fbe9803b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0098c0 tx=0x7fbe9c006db0 comp rx=0 tx=0).stop 2024-09-10T10:01:20.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.205+0000 7fbeb9c00640 1 -- 172.21.15.50:0/3053989367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb41097a0 msgr2=0x7fbeb41993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:20.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.205+0000 7fbeb9c00640 1 --2- 172.21.15.50:0/3053989367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb41097a0 0x7fbeb41993d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009230 tx=0x7fbea4003d40 comp rx=0 tx=0).stop 2024-09-10T10:01:20.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.205+0000 7fbeb9c00640 1 -- 172.21.15.50:0/3053989367 shutdown_connections 2024-09-10T10:01:20.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.205+0000 7fbeb9c00640 1 --2- 172.21.15.50:0/3053989367 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbe98039060 0x7fbe9803b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:20.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.205+0000 7fbeb9c00640 1 --2- 172.21.15.50:0/3053989367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb41097a0 0x7fbeb41993d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:20.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.205+0000 7fbeb9c00640 1 -- 172.21.15.50:0/3053989367 >> 172.21.15.50:0/3053989367 conn(0x7fbeb40ff4c0 msgr2=0x7fbeb41072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:20.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.205+0000 7fbeb9c00640 1 -- 172.21.15.50:0/3053989367 shutdown_connections 2024-09-10T10:01:20.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:20.205+0000 7fbeb9c00640 1 -- 172.21.15.50:0/3053989367 wait complete. 2024-09-10T10:01:20.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:20 smithi050 ceph-mon[30354]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:20.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:20 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:20.841 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi189 2024-09-10T10:01:20.841 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T10:01:20.842 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.conf 2024-09-10T10:01:20.862 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T10:01:20.862 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:01:20.920 INFO:tasks.cephadm:Adding host smithi189 to orchestrator... 2024-09-10T10:01:20.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch host add smithi189 2024-09-10T10:01:21.284 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:01:21.678 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:21 smithi050 ceph-mon[30354]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:01:21.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.784+0000 7f3fd2400640 1 -- 172.21.15.50:0/906985259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fcc074590 msgr2=0x7f3fcc074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:21.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.784+0000 7f3fd2400640 1 --2- 172.21.15.50:0/906985259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fcc074590 0x7f3fcc074970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009880 tx=0x7f3fbc02a670 comp rx=0 tx=0).stop 2024-09-10T10:01:21.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.784+0000 7f3fd2400640 1 -- 172.21.15.50:0/906985259 shutdown_connections 2024-09-10T10:01:21.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.784+0000 7f3fd2400640 1 --2- 172.21.15.50:0/906985259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fcc074590 0x7f3fcc074970 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:21.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.784+0000 7f3fd2400640 1 -- 172.21.15.50:0/906985259 >> 172.21.15.50:0/906985259 conn(0x7f3fcc0fd230 msgr2=0x7f3fcc0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.785+0000 7f3fd2400640 1 -- 172.21.15.50:0/906985259 shutdown_connections 2024-09-10T10:01:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.785+0000 7f3fd2400640 1 -- 172.21.15.50:0/906985259 wait complete. 2024-09-10T10:01:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.785+0000 7f3fd2400640 1 Processor -- start 2024-09-10T10:01:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.786+0000 7f3fd2400640 1 -- start start 2024-09-10T10:01:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.786+0000 7f3fd2400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fcc074590 0x7f3fcc1a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.786+0000 7f3fd2400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc112290 con 0x7f3fcc074590 2024-09-10T10:01:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.786+0000 7f3fcb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fcc074590 0x7f3fcc1a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.786+0000 7f3fcb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fcc074590 0x7f3fcc1a33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59232/0 (socket says 172.21.15.50:59232) 2024-09-10T10:01:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.786+0000 7f3fcb400640 1 -- 172.21.15.50:0/1210329104 learned_addr learned my addr 172.21.15.50:0/1210329104 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.786+0000 7f3fcb400640 1 -- 172.21.15.50:0/1210329104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fcc1a3910 con 0x7f3fcc074590 2024-09-10T10:01:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.787+0000 7f3fcb400640 1 --2- 172.21.15.50:0/1210329104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fcc074590 0x7f3fcc1a33d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009230 tx=0x7f3fbc003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.787+0000 7f3fc3e00640 1 -- 172.21.15.50:0/1210329104 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc03f070 con 0x7f3fcc074590 2024-09-10T10:01:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.787+0000 7f3fc3e00640 1 -- 172.21.15.50:0/1210329104 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fbc03bd40 con 0x7f3fcc074590 2024-09-10T10:01:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.787+0000 7f3fd2400640 1 -- 172.21.15.50:0/1210329104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fcc1a3ba0 con 0x7f3fcc074590 2024-09-10T10:01:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.787+0000 7f3fc3e00640 1 -- 172.21.15.50:0/1210329104 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc035030 con 0x7f3fcc074590 2024-09-10T10:01:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.787+0000 7f3fd2400640 1 -- 172.21.15.50:0/1210329104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fcc19d590 con 0x7f3fcc074590 2024-09-10T10:01:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.788+0000 7f3fc3e00640 1 -- 172.21.15.50:0/1210329104 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3fbc042070 con 0x7f3fcc074590 2024-09-10T10:01:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.788+0000 7f3fd2400640 1 -- 172.21.15.50:0/1210329104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fcc075cd0 con 0x7f3fcc074590 2024-09-10T10:01:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.789+0000 7f3fc3e00640 1 --2- 172.21.15.50:0/1210329104 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3fb0039060 0x7f3fb003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.789+0000 7f3fc3e00640 1 -- 172.21.15.50:0/1210329104 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3fbc06cd20 con 0x7f3fcc074590 2024-09-10T10:01:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.789+0000 7f3fcaa00640 1 --2- 172.21.15.50:0/1210329104 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3fb0039060 0x7f3fb003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.789+0000 7f3fcaa00640 1 --2- 172.21.15.50:0/1210329104 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3fb0039060 0x7f3fb003b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80098c0 tx=0x7f3fb8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:21.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.794+0000 7f3fc3e00640 1 -- 172.21.15.50:0/1210329104 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fbc0412c0 con 0x7f3fcc074590 2024-09-10T10:01:21.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:21.982+0000 7f3fd2400640 1 -- 172.21.15.50:0/1210329104 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}) -- 0x7f3fcc19eac0 con 0x7f3fb0039060 2024-09-10T10:01:22.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:22 smithi050 ceph-mon[30354]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:23.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:23 smithi050 ceph-mon[30354]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:23.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:23 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:23.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:23 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:23.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:23 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:23.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:23 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:23.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:23 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:01:23.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:23 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:23.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:23 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:23.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:23 smithi050 ceph-mon[30354]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-10T10:01:23.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:23 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:23.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:23 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:23.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:23 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:24.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:24 smithi050 ceph-mon[30354]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:24.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:24 smithi050 ceph-mon[30354]: Updating smithi084:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:24.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:24 smithi050 ceph-mon[30354]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:01:24.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:24 smithi050 ceph-mon[30354]: Updating smithi084:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:01:24.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:24 smithi050 ceph-mon[30354]: Deploying cephadm binary to smithi189 2024-09-10T10:01:25.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:25.842+0000 7f3fc3e00640 1 -- 172.21.15.50:0/1210329104 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f3fcc19eac0 con 0x7f3fb0039060 2024-09-10T10:01:25.845 INFO:teuthology.orchestra.run.smithi050.stdout:Added host 'smithi189' with addr '172.21.15.189' 2024-09-10T10:01:25.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:25.844+0000 7f3fd2400640 1 -- 172.21.15.50:0/1210329104 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3fb0039060 msgr2=0x7f3fb003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:25.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:25.845+0000 7f3fd2400640 1 --2- 172.21.15.50:0/1210329104 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3fb0039060 0x7f3fb003b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80098c0 tx=0x7f3fb8006db0 comp rx=0 tx=0).stop 2024-09-10T10:01:25.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:25.845+0000 7f3fd2400640 1 -- 172.21.15.50:0/1210329104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fcc074590 msgr2=0x7f3fcc1a33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:25.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:25.845+0000 7f3fd2400640 1 --2- 172.21.15.50:0/1210329104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fcc074590 0x7f3fcc1a33d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009230 tx=0x7f3fbc003d80 comp rx=0 tx=0).stop 2024-09-10T10:01:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:25.845+0000 7f3fd2400640 1 -- 172.21.15.50:0/1210329104 shutdown_connections 2024-09-10T10:01:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:25.845+0000 7f3fd2400640 1 --2- 172.21.15.50:0/1210329104 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3fb0039060 0x7f3fb003b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:25.845+0000 7f3fd2400640 1 --2- 172.21.15.50:0/1210329104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fcc074590 0x7f3fcc1a33d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:25.845+0000 7f3fd2400640 1 -- 172.21.15.50:0/1210329104 >> 172.21.15.50:0/1210329104 conn(0x7f3fcc0fd230 msgr2=0x7f3fcc0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:25.845+0000 7f3fd2400640 1 -- 172.21.15.50:0/1210329104 shutdown_connections 2024-09-10T10:01:25.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:25.845+0000 7f3fd2400640 1 -- 172.21.15.50:0/1210329104 wait complete. 2024-09-10T10:01:26.647 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T10:01:26.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:26 smithi050 ceph-mon[30354]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:26.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:26.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:26.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:26.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:27.016 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:01:27.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.549+0000 7f34f0000640 1 -- 172.21.15.50:0/309001438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e8107640 msgr2=0x7f34e8107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:27.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.549+0000 7f34f0000640 1 --2- 172.21.15.50:0/309001438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e8107640 0x7f34e8107a20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f34dc009880 tx=0x7f34dc02a5d0 comp rx=0 tx=0).stop 2024-09-10T10:01:27.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.549+0000 7f34f0000640 1 -- 172.21.15.50:0/309001438 shutdown_connections 2024-09-10T10:01:27.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.549+0000 7f34f0000640 1 --2- 172.21.15.50:0/309001438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e8107640 0x7f34e8107a20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:27.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.549+0000 7f34f0000640 1 -- 172.21.15.50:0/309001438 >> 172.21.15.50:0/309001438 conn(0x7f34e80fd230 msgr2=0x7f34e80ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:27.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.550+0000 7f34f0000640 1 -- 172.21.15.50:0/309001438 shutdown_connections 2024-09-10T10:01:27.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.550+0000 7f34f0000640 1 -- 172.21.15.50:0/309001438 wait complete. 2024-09-10T10:01:27.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.551+0000 7f34f0000640 1 Processor -- start 2024-09-10T10:01:27.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.551+0000 7f34f0000640 1 -- start start 2024-09-10T10:01:27.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.551+0000 7f34f0000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e8107640 0x7f34e80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:27.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.551+0000 7f34f0000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f34e810bc70 con 0x7f34e8107640 2024-09-10T10:01:27.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.552+0000 7f34ed600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e8107640 0x7f34e80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:27.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.552+0000 7f34ed600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e8107640 0x7f34e80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56828/0 (socket says 172.21.15.50:56828) 2024-09-10T10:01:27.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.552+0000 7f34ed600640 1 -- 172.21.15.50:0/683481103 learned_addr learned my addr 172.21.15.50:0/683481103 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:27.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.552+0000 7f34ed600640 1 -- 172.21.15.50:0/683481103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e80763e0 con 0x7f34e8107640 2024-09-10T10:01:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.552+0000 7f34ed600640 1 --2- 172.21.15.50:0/683481103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e8107640 0x7f34e80744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f34dc009230 tx=0x7f34dc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.553+0000 7f34e6000640 1 -- 172.21.15.50:0/683481103 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc03f070 con 0x7f34e8107640 2024-09-10T10:01:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.553+0000 7f34e6000640 1 -- 172.21.15.50:0/683481103 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34dc03bc80 con 0x7f34e8107640 2024-09-10T10:01:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.553+0000 7f34e6000640 1 -- 172.21.15.50:0/683481103 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc035030 con 0x7f34e8107640 2024-09-10T10:01:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.553+0000 7f34f0000640 1 -- 172.21.15.50:0/683481103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e8074a30 con 0x7f34e8107640 2024-09-10T10:01:27.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.553+0000 7f34f0000640 1 -- 172.21.15.50:0/683481103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e8074ef0 con 0x7f34e8107640 2024-09-10T10:01:27.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.554+0000 7f34e6000640 1 -- 172.21.15.50:0/683481103 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f34dc042070 con 0x7f34e8107640 2024-09-10T10:01:27.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.554+0000 7f34f0000640 1 -- 172.21.15.50:0/683481103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e8102cb0 con 0x7f34e8107640 2024-09-10T10:01:27.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.554+0000 7f34e6000640 1 --2- 172.21.15.50:0/683481103 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f34d00390c0 0x7f34d003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:27.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.554+0000 7f34e6000640 1 -- 172.21.15.50:0/683481103 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f34dc06cd80 con 0x7f34e8107640 2024-09-10T10:01:27.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.555+0000 7f34ecc00640 1 --2- 172.21.15.50:0/683481103 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f34d00390c0 0x7f34d003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:27.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.555+0000 7f34ecc00640 1 --2- 172.21.15.50:0/683481103 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f34d00390c0 0x7f34d003b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f34d40098c0 tx=0x7f34d4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:27.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.560+0000 7f34e6000640 1 -- 172.21.15.50:0/683481103 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34dc0372d0 con 0x7f34e8107640 2024-09-10T10:01:27.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:27 smithi050 ceph-mon[30354]: Added host smithi189 2024-09-10T10:01:27.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:27 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:27.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.749+0000 7f34f0000640 1 -- 172.21.15.50:0/683481103 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34e8075a90 con 0x7f34d00390c0 2024-09-10T10:01:27.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.750+0000 7f34e6000640 1 -- 172.21.15.50:0/683481103 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f34e8075a90 con 0x7f34d00390c0 2024-09-10T10:01:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:01:27.752 INFO:teuthology.orchestra.run.smithi050.stdout:[{"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}, {"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.189", "hostname": "smithi189", "labels": [], "status": ""}] 2024-09-10T10:01:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.752+0000 7f34f0000640 1 -- 172.21.15.50:0/683481103 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f34d00390c0 msgr2=0x7f34d003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.752+0000 7f34f0000640 1 --2- 172.21.15.50:0/683481103 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f34d00390c0 0x7f34d003b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f34d40098c0 tx=0x7f34d4006db0 comp rx=0 tx=0).stop 2024-09-10T10:01:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.752+0000 7f34f0000640 1 -- 172.21.15.50:0/683481103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e8107640 msgr2=0x7f34e80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.752+0000 7f34f0000640 1 --2- 172.21.15.50:0/683481103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e8107640 0x7f34e80744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f34dc009230 tx=0x7f34dc003d40 comp rx=0 tx=0).stop 2024-09-10T10:01:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.752+0000 7f34f0000640 1 -- 172.21.15.50:0/683481103 shutdown_connections 2024-09-10T10:01:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.752+0000 7f34f0000640 1 --2- 172.21.15.50:0/683481103 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f34d00390c0 0x7f34d003b580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.752+0000 7f34f0000640 1 --2- 172.21.15.50:0/683481103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e8107640 0x7f34e80744f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.752+0000 7f34f0000640 1 -- 172.21.15.50:0/683481103 >> 172.21.15.50:0/683481103 conn(0x7f34e80fd230 msgr2=0x7f34e80feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.752+0000 7f34f0000640 1 -- 172.21.15.50:0/683481103 shutdown_connections 2024-09-10T10:01:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:27.752+0000 7f34f0000640 1 -- 172.21.15.50:0/683481103 wait complete. 2024-09-10T10:01:28.435 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T10:01:28.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T10:01:28.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:28 smithi050 ceph-mon[30354]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:28.798 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:01:29.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.389+0000 7f97da800640 1 -- 172.21.15.50:0/131430057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d4109670 msgr2=0x7f97d4109a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:29.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.389+0000 7f97da800640 1 --2- 172.21.15.50:0/131430057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d4109670 0x7f97d4109a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009880 tx=0x7f97c802a5d0 comp rx=0 tx=0).stop 2024-09-10T10:01:29.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.389+0000 7f97da800640 1 -- 172.21.15.50:0/131430057 shutdown_connections 2024-09-10T10:01:29.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.389+0000 7f97da800640 1 --2- 172.21.15.50:0/131430057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d4109670 0x7f97d4109a50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:29.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.390+0000 7f97da800640 1 -- 172.21.15.50:0/131430057 >> 172.21.15.50:0/131430057 conn(0x7f97d40ff260 msgr2=0x7f97d4101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:29.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.390+0000 7f97da800640 1 -- 172.21.15.50:0/131430057 shutdown_connections 2024-09-10T10:01:29.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.390+0000 7f97da800640 1 -- 172.21.15.50:0/131430057 wait complete. 2024-09-10T10:01:29.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.390+0000 7f97da800640 1 Processor -- start 2024-09-10T10:01:29.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.391+0000 7f97da800640 1 -- start start 2024-09-10T10:01:29.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.391+0000 7f97da800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d4109670 0x7f97d4199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:29.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.391+0000 7f97da800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f97d410dca0 con 0x7f97d4109670 2024-09-10T10:01:29.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.391+0000 7f97d9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d4109670 0x7f97d4199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:29.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.391+0000 7f97d9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d4109670 0x7f97d4199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56854/0 (socket says 172.21.15.50:56854) 2024-09-10T10:01:29.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.391+0000 7f97d9400640 1 -- 172.21.15.50:0/2167977872 learned_addr learned my addr 172.21.15.50:0/2167977872 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:29.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.392+0000 7f97d9400640 1 -- 172.21.15.50:0/2167977872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d41996c0 con 0x7f97d4109670 2024-09-10T10:01:29.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.392+0000 7f97d9400640 1 --2- 172.21.15.50:0/2167977872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d4109670 0x7f97d4199180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009230 tx=0x7f97c8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:29.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.392+0000 7f97d2000640 1 -- 172.21.15.50:0/2167977872 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97c803f070 con 0x7f97d4109670 2024-09-10T10:01:29.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.392+0000 7f97d2000640 1 -- 172.21.15.50:0/2167977872 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97c803bc80 con 0x7f97d4109670 2024-09-10T10:01:29.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.392+0000 7f97d2000640 1 -- 172.21.15.50:0/2167977872 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97c8035030 con 0x7f97d4109670 2024-09-10T10:01:29.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.392+0000 7f97da800640 1 -- 172.21.15.50:0/2167977872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d4199950 con 0x7f97d4109670 2024-09-10T10:01:29.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.392+0000 7f97da800640 1 -- 172.21.15.50:0/2167977872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d419da50 con 0x7f97d4109670 2024-09-10T10:01:29.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.393+0000 7f97d2000640 1 -- 172.21.15.50:0/2167977872 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f97c8042070 con 0x7f97d4109670 2024-09-10T10:01:29.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.393+0000 7f97da800640 1 -- 172.21.15.50:0/2167977872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d4104ce0 con 0x7f97d4109670 2024-09-10T10:01:29.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.394+0000 7f97d2000640 1 --2- 172.21.15.50:0/2167977872 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97bc0390c0 0x7f97bc03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:29.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.394+0000 7f97d2000640 1 -- 172.21.15.50:0/2167977872 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f97c806ca00 con 0x7f97d4109670 2024-09-10T10:01:29.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.394+0000 7f97d8a00640 1 --2- 172.21.15.50:0/2167977872 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97bc0390c0 0x7f97bc03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:29.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.395+0000 7f97d8a00640 1 --2- 172.21.15.50:0/2167977872 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97bc0390c0 0x7f97bc03b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f97c00098c0 tx=0x7f97c0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:29.400 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.399+0000 7f97d2000640 1 -- 172.21.15.50:0/2167977872 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f97c80372d0 con 0x7f97d4109670 2024-09-10T10:01:29.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:29.590+0000 7f97da800640 1 -- 172.21.15.50:0/2167977872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f97d419a4e0 con 0x7f97d4109670 2024-09-10T10:01:29.592 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:29 smithi050 ceph-mon[30354]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:01:30.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:30.500+0000 7f97d2000640 1 -- 172.21.15.50:0/2167977872 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f97c8031dd0 con 0x7f97d4109670 2024-09-10T10:01:30.501 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2024-09-10T10:01:30.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:30.504+0000 7f97da800640 1 -- 172.21.15.50:0/2167977872 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97bc0390c0 msgr2=0x7f97bc03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:30.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:30.504+0000 7f97da800640 1 --2- 172.21.15.50:0/2167977872 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97bc0390c0 0x7f97bc03b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f97c00098c0 tx=0x7f97c0006db0 comp rx=0 tx=0).stop 2024-09-10T10:01:30.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:30.504+0000 7f97da800640 1 -- 172.21.15.50:0/2167977872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d4109670 msgr2=0x7f97d4199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:30.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:30.504+0000 7f97da800640 1 --2- 172.21.15.50:0/2167977872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d4109670 0x7f97d4199180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009230 tx=0x7f97c8003d40 comp rx=0 tx=0).stop 2024-09-10T10:01:30.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:30.504+0000 7f97da800640 1 -- 172.21.15.50:0/2167977872 shutdown_connections 2024-09-10T10:01:30.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:30.504+0000 7f97da800640 1 --2- 172.21.15.50:0/2167977872 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97bc0390c0 0x7f97bc03b580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:30.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:30.504+0000 7f97da800640 1 --2- 172.21.15.50:0/2167977872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97d4109670 0x7f97d4199180 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:30.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:30.504+0000 7f97da800640 1 -- 172.21.15.50:0/2167977872 >> 172.21.15.50:0/2167977872 conn(0x7f97d40ff260 msgr2=0x7f97d4100ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:30.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:30.504+0000 7f97da800640 1 -- 172.21.15.50:0/2167977872 shutdown_connections 2024-09-10T10:01:30.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:30.504+0000 7f97da800640 1 -- 172.21.15.50:0/2167977872 wait complete. 2024-09-10T10:01:30.821 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:30 smithi050 ceph-mon[30354]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:30.821 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:30 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2167977872' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T10:01:30.821 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:30 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:30.821 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:30 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:30.821 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:30 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:30.821 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:30 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:30.822 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:30 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:01:30.822 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:30 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:30.822 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:30 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:31.192 INFO:tasks.cephadm:Adding mon.a on smithi050 2024-09-10T10:01:31.192 INFO:tasks.cephadm:Adding mon.b on smithi084 2024-09-10T10:01:31.192 INFO:tasks.cephadm:Adding mon.c on smithi189 2024-09-10T10:01:31.192 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi050:172.21.15.50=a;smithi084:172.21.15.84=b;smithi189:172.21.15.189=c' 2024-09-10T10:01:31.428 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:31.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:31 smithi050 ceph-mon[30354]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T10:01:31.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:31 smithi050 ceph-mon[30354]: Updating smithi189:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:31.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:31 smithi050 ceph-mon[30354]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:01:31.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:31 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2167977872' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T10:01:31.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:31 smithi050 ceph-mon[30354]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:01:31.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:31 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:31.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:31 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:31.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:31 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:31.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.862+0000 7f3b9818b640 1 -- 172.21.15.189:0/3265581195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b90106540 msgr2=0x7f3b90106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:31.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.862+0000 7f3b9818b640 1 --2- 172.21.15.189:0/3265581195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b90106540 0x7f3b90106920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009810 tx=0x7f3b8402a540 comp rx=0 tx=0).stop 2024-09-10T10:01:31.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.862+0000 7f3b9818b640 1 -- 172.21.15.189:0/3265581195 shutdown_connections 2024-09-10T10:01:31.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.862+0000 7f3b9818b640 1 --2- 172.21.15.189:0/3265581195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b90106540 0x7f3b90106920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:31.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.862+0000 7f3b9818b640 1 -- 172.21.15.189:0/3265581195 >> 172.21.15.189:0/3265581195 conn(0x7f3b90077310 msgr2=0x7f3b900fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:31.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.862+0000 7f3b9818b640 1 -- 172.21.15.189:0/3265581195 shutdown_connections 2024-09-10T10:01:31.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.862+0000 7f3b9818b640 1 -- 172.21.15.189:0/3265581195 wait complete. 2024-09-10T10:01:31.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.862+0000 7f3b9818b640 1 Processor -- start 2024-09-10T10:01:31.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.862+0000 7f3b9818b640 1 -- start start 2024-09-10T10:01:31.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.863+0000 7f3b9818b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b90106540 0x7f3b90196060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:31.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.863+0000 7f3b9818b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9010ab70 con 0x7f3b90106540 2024-09-10T10:01:31.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.863+0000 7f3b95f27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b90106540 0x7f3b90196060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:31.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.863+0000 7f3b95f27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b90106540 0x7f3b90196060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.189:34946/0 (socket says 172.21.15.189:34946) 2024-09-10T10:01:31.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.863+0000 7f3b95f27640 1 -- 172.21.15.189:0/1482532704 learned_addr learned my addr 172.21.15.189:0/1482532704 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T10:01:31.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.864+0000 7f3b95f27640 1 -- 172.21.15.189:0/1482532704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b901965a0 con 0x7f3b90106540 2024-09-10T10:01:31.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.864+0000 7f3b95f27640 1 --2- 172.21.15.189:0/1482532704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b90106540 0x7f3b90196060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b840045e0 tx=0x7f3b84004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:31.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.864+0000 7f3b82ffd640 1 -- 172.21.15.189:0/1482532704 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b84030e70 con 0x7f3b90106540 2024-09-10T10:01:31.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.864+0000 7f3b9818b640 1 -- 172.21.15.189:0/1482532704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b90196830 con 0x7f3b90106540 2024-09-10T10:01:31.978 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.864+0000 7f3b9818b640 1 -- 172.21.15.189:0/1482532704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b90196c90 con 0x7f3b90106540 2024-09-10T10:01:31.978 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.864+0000 7f3b82ffd640 1 -- 172.21.15.189:0/1482532704 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b840318e0 con 0x7f3b90106540 2024-09-10T10:01:31.978 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.864+0000 7f3b82ffd640 1 -- 172.21.15.189:0/1482532704 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b84049060 con 0x7f3b90106540 2024-09-10T10:01:31.978 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.865+0000 7f3b9818b640 1 -- 172.21.15.189:0/1482532704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b90101bb0 con 0x7f3b90106540 2024-09-10T10:01:31.978 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.865+0000 7f3b82ffd640 1 -- 172.21.15.189:0/1482532704 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3b84039040 con 0x7f3b90106540 2024-09-10T10:01:31.978 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.866+0000 7f3b82ffd640 1 --2- 172.21.15.189:0/1482532704 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b7c039060 0x7f3b7c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:31.978 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.866+0000 7f3b82ffd640 1 -- 172.21.15.189:0/1482532704 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3b8406cfb0 con 0x7f3b90106540 2024-09-10T10:01:31.978 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.866+0000 7f3b95726640 1 --2- 172.21.15.189:0/1482532704 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b7c039060 0x7f3b7c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:31.978 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.867+0000 7f3b95726640 1 --2- 172.21.15.189:0/1482532704 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b7c039060 0x7f3b7c03b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0098c0 tx=0x7f3b8c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:31.978 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:31.872+0000 7f3b82ffd640 1 -- 172.21.15.189:0/1482532704 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b84040030 con 0x7f3b90106540 2024-09-10T10:01:32.056 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:32.054+0000 7f3b9818b640 1 -- 172.21.15.189:0/1482532704 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:172.21.15.50=a;smithi084:172.21.15.84=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}) -- 0x7f3b900ff340 con 0x7f3b7c039060 2024-09-10T10:01:32.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:32.061+0000 7f3b82ffd640 1 -- 172.21.15.189:0/1482532704 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3b900ff340 con 0x7f3b7c039060 2024-09-10T10:01:32.063 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mon update... 2024-09-10T10:01:32.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:32.063+0000 7f3b9818b640 1 -- 172.21.15.189:0/1482532704 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b7c039060 msgr2=0x7f3b7c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:32.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:32.064+0000 7f3b9818b640 1 --2- 172.21.15.189:0/1482532704 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b7c039060 0x7f3b7c03b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0098c0 tx=0x7f3b8c006db0 comp rx=0 tx=0).stop 2024-09-10T10:01:32.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:32.064+0000 7f3b9818b640 1 -- 172.21.15.189:0/1482532704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b90106540 msgr2=0x7f3b90196060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:32.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:32.064+0000 7f3b9818b640 1 --2- 172.21.15.189:0/1482532704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b90106540 0x7f3b90196060 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b840045e0 tx=0x7f3b84004610 comp rx=0 tx=0).stop 2024-09-10T10:01:32.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:32.064+0000 7f3b9818b640 1 -- 172.21.15.189:0/1482532704 shutdown_connections 2024-09-10T10:01:32.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:32.064+0000 7f3b9818b640 1 --2- 172.21.15.189:0/1482532704 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b7c039060 0x7f3b7c03b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:32.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:32.064+0000 7f3b9818b640 1 --2- 172.21.15.189:0/1482532704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b90106540 0x7f3b90196060 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:32.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:32.064+0000 7f3b9818b640 1 -- 172.21.15.189:0/1482532704 >> 172.21.15.189:0/1482532704 conn(0x7f3b90077310 msgr2=0x7f3b900fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:32.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:32.064+0000 7f3b9818b640 1 -- 172.21.15.189:0/1482532704 shutdown_connections 2024-09-10T10:01:32.066 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:32.064+0000 7f3b9818b640 1 -- 172.21.15.189:0/1482532704 wait complete. 2024-09-10T10:01:32.666 DEBUG:teuthology.orchestra.run.smithi084:mon.b> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T10:01:32.669 DEBUG:teuthology.orchestra.run.smithi189:mon.c> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T10:01:32.672 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T10:01:32.672 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T10:01:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:32 smithi050 ceph-mon[30354]: Updating smithi189:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:01:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:32 smithi050 ceph-mon[30354]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:32.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:32.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:32.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:33.326 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:33.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.696+0000 7fac7a034640 1 -- 172.21.15.189:0/2661952159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac74106580 msgr2=0x7fac74106960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:33.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.696+0000 7fac7a034640 1 --2- 172.21.15.189:0/2661952159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac74106580 0x7fac74106960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fac64009880 tx=0x7fac6402a5d0 comp rx=0 tx=0).stop 2024-09-10T10:01:33.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.696+0000 7fac7a034640 1 -- 172.21.15.189:0/2661952159 shutdown_connections 2024-09-10T10:01:33.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.696+0000 7fac7a034640 1 --2- 172.21.15.189:0/2661952159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac74106580 0x7fac74106960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:33.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.696+0000 7fac7a034640 1 -- 172.21.15.189:0/2661952159 >> 172.21.15.189:0/2661952159 conn(0x7fac740fc190 msgr2=0x7fac740fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:33.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.696+0000 7fac7a034640 1 -- 172.21.15.189:0/2661952159 shutdown_connections 2024-09-10T10:01:33.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.696+0000 7fac7a034640 1 -- 172.21.15.189:0/2661952159 wait complete. 2024-09-10T10:01:33.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.697+0000 7fac7a034640 1 Processor -- start 2024-09-10T10:01:33.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.697+0000 7fac7a034640 1 -- start start 2024-09-10T10:01:33.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.697+0000 7fac7a034640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac74106580 0x7fac74197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:33.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.697+0000 7fac7a034640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fac7410abb0 con 0x7fac74106580 2024-09-10T10:01:33.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.698+0000 7fac737fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac74106580 0x7fac74197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.698+0000 7fac737fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac74106580 0x7fac74197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.189:38508/0 (socket says 172.21.15.189:38508) 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.698+0000 7fac737fe640 1 -- 172.21.15.189:0/1030195291 learned_addr learned my addr 172.21.15.189:0/1030195291 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.698+0000 7fac737fe640 1 -- 172.21.15.189:0/1030195291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac741984b0 con 0x7fac74106580 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.698+0000 7fac737fe640 1 --2- 172.21.15.189:0/1030195291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac74106580 0x7fac74197f70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fac64009230 tx=0x7fac64003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.699+0000 7fac70ff9640 1 -- 172.21.15.189:0/1030195291 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac6403f070 con 0x7fac74106580 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.699+0000 7fac7a034640 1 -- 172.21.15.189:0/1030195291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac74198740 con 0x7fac74106580 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.699+0000 7fac70ff9640 1 -- 172.21.15.189:0/1030195291 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac6403bd40 con 0x7fac74106580 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.699+0000 7fac7a034640 1 -- 172.21.15.189:0/1030195291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac74198ba0 con 0x7fac74106580 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.699+0000 7fac70ff9640 1 -- 172.21.15.189:0/1030195291 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac64049060 con 0x7fac74106580 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.700+0000 7fac70ff9640 1 -- 172.21.15.189:0/1030195291 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fac64042070 con 0x7fac74106580 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.700+0000 7fac7a034640 1 -- 172.21.15.189:0/1030195291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac74101bf0 con 0x7fac74106580 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.700+0000 7fac70ff9640 1 --2- 172.21.15.189:0/1030195291 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac5c039060 0x7fac5c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.700+0000 7fac70ff9640 1 -- 172.21.15.189:0/1030195291 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fac6406d060 con 0x7fac74106580 2024-09-10T10:01:33.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.700+0000 7fac72ffd640 1 --2- 172.21.15.189:0/1030195291 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac5c039060 0x7fac5c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:33.703 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.701+0000 7fac72ffd640 1 --2- 172.21.15.189:0/1030195291 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac5c039060 0x7fac5c03b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fac680098c0 tx=0x7fac68006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:33.706 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.705+0000 7fac70ff9640 1 -- 172.21.15.189:0/1030195291 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac64031df0 con 0x7fac74106580 2024-09-10T10:01:33.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.937+0000 7fac7a034640 1 -- 172.21.15.189:0/1030195291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fac741069e0 con 0x7fac74106580 2024-09-10T10:01:33.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.938+0000 7fac70ff9640 1 -- 172.21.15.189:0/1030195291 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fac64036260 con 0x7fac74106580 2024-09-10T10:01:33.939 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T10:01:33.939 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":1,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","modified":"2024-09-10T10:00:01.957230Z","created":"2024-09-10T10:00:01.957230Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T10:01:33.940 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 1 2024-09-10T10:01:33.941 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.940+0000 7fac7a034640 1 -- 172.21.15.189:0/1030195291 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac5c039060 msgr2=0x7fac5c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:33.941 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.940+0000 7fac7a034640 1 --2- 172.21.15.189:0/1030195291 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac5c039060 0x7fac5c03b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fac680098c0 tx=0x7fac68006db0 comp rx=0 tx=0).stop 2024-09-10T10:01:33.941 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.940+0000 7fac7a034640 1 -- 172.21.15.189:0/1030195291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac74106580 msgr2=0x7fac74197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:33.941 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.940+0000 7fac7a034640 1 --2- 172.21.15.189:0/1030195291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac74106580 0x7fac74197f70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fac64009230 tx=0x7fac64003d80 comp rx=0 tx=0).stop 2024-09-10T10:01:33.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.940+0000 7fac7a034640 1 -- 172.21.15.189:0/1030195291 shutdown_connections 2024-09-10T10:01:33.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.940+0000 7fac7a034640 1 --2- 172.21.15.189:0/1030195291 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac5c039060 0x7fac5c03b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:33.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.940+0000 7fac7a034640 1 --2- 172.21.15.189:0/1030195291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac74106580 0x7fac74197f70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:33.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.940+0000 7fac7a034640 1 -- 172.21.15.189:0/1030195291 >> 172.21.15.189:0/1030195291 conn(0x7fac740fc190 msgr2=0x7fac740fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:33.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.940+0000 7fac7a034640 1 -- 172.21.15.189:0/1030195291 shutdown_connections 2024-09-10T10:01:33.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:33.940+0000 7fac7a034640 1 -- 172.21.15.189:0/1030195291 wait complete. 2024-09-10T10:01:33.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:33 smithi050 ceph-mon[30354]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:172.21.15.50=a;smithi084:172.21.15.84=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:33.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:33 smithi050 ceph-mon[30354]: Saving service mon spec with placement smithi050:172.21.15.50=a;smithi084:172.21.15.84=b;smithi189:172.21.15.189=c;count:3 2024-09-10T10:01:33.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:33 smithi050 ceph-mon[30354]: Deploying daemon mon.c on smithi189 2024-09-10T10:01:34.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:34 smithi050 ceph-mon[30354]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:34.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:34 smithi050 ceph-mon[30354]: from='client.? 172.21.15.189:0/1030195291' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:01:36.595 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T10:01:36.595 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T10:01:36.768 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:36 smithi050 ceph-mon[30354]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:36.866 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:01:36.979 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:36 smithi189 systemd[1]: Started Ceph mon.c for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:01:42.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:42.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:01:42.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:42.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: mon.a calling monitor election 2024-09-10T10:01:42.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:42.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:42.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:42.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: mon.c calling monitor election 2024-09-10T10:01:42.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:42.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:42.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:42.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:42.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:01:42.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: monmap epoch 2 2024-09-10T10:01:42.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:01:42.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: last_changed 2024-09-10T10:01:36.747941+0000 2024-09-10T10:01:42.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: created 2024-09-10T10:00:01.957230+0000 2024-09-10T10:01:42.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: min_mon_release 19 (squid) 2024-09-10T10:01:42.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: election_strategy: 1 2024-09-10T10:01:42.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-10T10:01:42.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T10:01:42.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: fsmap 2024-09-10T10:01:42.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:01:42.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: mgrmap e13: x(active, since 43s) 2024-09-10T10:01:42.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: overall HEALTH_OK 2024-09-10T10:01:42.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:42.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:42.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:42.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:42.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:42.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:42.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:01:42.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:42.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: mon.a calling monitor election 2024-09-10T10:01:42.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:42.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:42.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:42.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: mon.c calling monitor election 2024-09-10T10:01:42.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:42.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:42.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:42.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:42.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:01:42.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: monmap epoch 2 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: last_changed 2024-09-10T10:01:36.747941+0000 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: created 2024-09-10T10:00:01.957230+0000 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: min_mon_release 19 (squid) 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: election_strategy: 1 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: fsmap 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: mgrmap e13: x(active, since 43s) 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: overall HEALTH_OK 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:42.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:42.218 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:42.218 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:43.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:42 smithi189 ceph-mon[34999]: Deploying daemon mon.b on smithi084 2024-09-10T10:01:43.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:42 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:43.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:42 smithi050 ceph-mon[30354]: Deploying daemon mon.b on smithi084 2024-09-10T10:01:43.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:42 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:43.339 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.337+0000 7f5fa1666640 1 -- 172.21.15.189:0/4216540662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f88005c00 msgr2=0x7f5f88008090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:43.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.337+0000 7f5fa1666640 1 --2- 172.21.15.189:0/4216540662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f88005c00 0x7f5f88008090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c102760 tx=0x7f5f8c02c5c0 comp rx=0 tx=0).stop 2024-09-10T10:01:43.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.338+0000 7f5fa1666640 1 -- 172.21.15.189:0/4216540662 shutdown_connections 2024-09-10T10:01:43.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.338+0000 7f5fa1666640 1 --2- 172.21.15.189:0/4216540662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f88005c00 0x7f5f88008090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:43.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.338+0000 7f5fa1666640 1 -- 172.21.15.189:0/4216540662 >> 172.21.15.189:0/4216540662 conn(0x7f5f9c0fd330 msgr2=0x7f5f9c0ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:43.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.338+0000 7f5fa1666640 1 -- 172.21.15.189:0/4216540662 shutdown_connections 2024-09-10T10:01:43.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.338+0000 7f5fa1666640 1 -- 172.21.15.189:0/4216540662 wait complete. 2024-09-10T10:01:43.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.338+0000 7f5fa1666640 1 Processor -- start 2024-09-10T10:01:43.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.339+0000 7f5fa1666640 1 -- start start 2024-09-10T10:01:43.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.339+0000 7f5fa1666640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f88005c00 0x7f5f9c199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:43.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.339+0000 7f5fa1666640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c199a50 0x7f5f9c19dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:43.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.339+0000 7f5fa1666640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c109770 con 0x7f5f9c199a50 2024-09-10T10:01:43.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.339+0000 7f5fa1666640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1095f0 con 0x7f5f88005c00 2024-09-10T10:01:43.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.339+0000 7f5f9affd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f88005c00 0x7f5f9c199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:43.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.339+0000 7f5f9affd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f88005c00 0x7f5f9c199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:46886/0 (socket says 172.21.15.189:46886) 2024-09-10T10:01:43.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.339+0000 7f5f9affd640 1 -- 172.21.15.189:0/2266521710 learned_addr learned my addr 172.21.15.189:0/2266521710 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T10:01:43.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.339+0000 7f5f9affd640 1 -- 172.21.15.189:0/2266521710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f88005c00 msgr2=0x7f5f9c199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T10:01:43.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.339+0000 7f5f9affd640 1 -- 172.21.15.189:0/2266521710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f88005c00 msgr2=0x7f5f9c199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T10:01:43.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.339+0000 7f5f9affd640 1 --2- 172.21.15.189:0/2266521710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f88005c00 0x7f5f9c199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T10:01:43.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.339+0000 7f5f9affd640 1 --2- 172.21.15.189:0/2266521710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f88005c00 0x7f5f9c199510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:01:43.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.340+0000 7f5f927fc640 1 --2- 172.21.15.189:0/2266521710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c199a50 0x7f5f9c19dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:43.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.340+0000 7f5f927fc640 1 -- 172.21.15.189:0/2266521710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f88005c00 msgr2=0x7f5f9c199510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:01:43.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.340+0000 7f5f927fc640 1 --2- 172.21.15.189:0/2266521710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f88005c00 0x7f5f9c199510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:43.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.340+0000 7f5f927fc640 1 -- 172.21.15.189:0/2266521710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c19a070 con 0x7f5f9c199a50 2024-09-10T10:01:43.343 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.340+0000 7f5f927fc640 1 --2- 172.21.15.189:0/2266521710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c199a50 0x7f5f9c19dde0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400b3d0 tx=0x7f5f8400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:43.344 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.341+0000 7f5f98ff9640 1 -- 172.21.15.189:0/2266521710 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5f84011630 con 0x7f5f9c199a50 2024-09-10T10:01:43.344 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.341+0000 7f5f98ff9640 1 -- 172.21.15.189:0/2266521710 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f84011cb0 con 0x7f5f9c199a50 2024-09-10T10:01:43.344 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.341+0000 7f5fa1666640 1 -- 172.21.15.189:0/2266521710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9c19e320 con 0x7f5f9c199a50 2024-09-10T10:01:43.344 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.341+0000 7f5f98ff9640 1 -- 172.21.15.189:0/2266521710 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5f84010df0 con 0x7f5f9c199a50 2024-09-10T10:01:43.344 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.341+0000 7f5fa1666640 1 -- 172.21.15.189:0/2266521710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f9c19e860 con 0x7f5f9c199a50 2024-09-10T10:01:43.344 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.342+0000 7f5f98ff9640 1 -- 172.21.15.189:0/2266521710 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f5f84018020 con 0x7f5f9c199a50 2024-09-10T10:01:43.344 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.342+0000 7f5fa1666640 1 -- 172.21.15.189:0/2266521710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9c102db0 con 0x7f5f9c199a50 2024-09-10T10:01:43.344 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.342+0000 7f5f98ff9640 1 --2- 172.21.15.189:0/2266521710 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f7c038e00 0x7f5f7c03b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:43.344 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.342+0000 7f5f98ff9640 1 -- 172.21.15.189:0/2266521710 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5f8404bbf0 con 0x7f5f9c199a50 2024-09-10T10:01:43.345 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.343+0000 7f5f9affd640 1 --2- 172.21.15.189:0/2266521710 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f7c038e00 0x7f5f7c03b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:43.345 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.343+0000 7f5f9affd640 1 --2- 172.21.15.189:0/2266521710 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f7c038e00 0x7f5f7c03b2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c012520 tx=0x7f5f8c012450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:43.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.347+0000 7f5f98ff9640 1 -- 172.21.15.189:0/2266521710 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f8401f020 con 0x7f5f9c199a50 2024-09-10T10:01:43.584 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.583+0000 7f5fa1666640 1 -- 172.21.15.189:0/2266521710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5f9c1068c0 con 0x7f5f9c199a50 2024-09-10T10:01:43.585 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.584+0000 7f5f98ff9640 1 -- 172.21.15.189:0/2266521710 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f5f84018310 con 0x7f5f9c199a50 2024-09-10T10:01:43.585 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T10:01:43.585 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":2,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","modified":"2024-09-10T10:01:36.747941Z","created":"2024-09-10T10:00:01.957230Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T10:01:43.586 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 2 2024-09-10T10:01:43.587 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.586+0000 7f5fa1666640 1 -- 172.21.15.189:0/2266521710 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f7c038e00 msgr2=0x7f5f7c03b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:43.587 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.586+0000 7f5fa1666640 1 --2- 172.21.15.189:0/2266521710 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f7c038e00 0x7f5f7c03b2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c012520 tx=0x7f5f8c012450 comp rx=0 tx=0).stop 2024-09-10T10:01:43.587 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.586+0000 7f5fa1666640 1 -- 172.21.15.189:0/2266521710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c199a50 msgr2=0x7f5f9c19dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:43.588 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.586+0000 7f5fa1666640 1 --2- 172.21.15.189:0/2266521710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c199a50 0x7f5f9c19dde0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400b3d0 tx=0x7f5f8400b890 comp rx=0 tx=0).stop 2024-09-10T10:01:43.588 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.586+0000 7f5fa1666640 1 -- 172.21.15.189:0/2266521710 shutdown_connections 2024-09-10T10:01:43.588 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.586+0000 7f5fa1666640 1 --2- 172.21.15.189:0/2266521710 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f7c038e00 0x7f5f7c03b2c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:43.588 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.586+0000 7f5fa1666640 1 --2- 172.21.15.189:0/2266521710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f9c199a50 0x7f5f9c19dde0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:43.588 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.586+0000 7f5fa1666640 1 --2- 172.21.15.189:0/2266521710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f88005c00 0x7f5f9c199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:43.588 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.586+0000 7f5fa1666640 1 -- 172.21.15.189:0/2266521710 >> 172.21.15.189:0/2266521710 conn(0x7f5f9c0fd330 msgr2=0x7f5f9c0750a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:43.588 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.586+0000 7f5fa1666640 1 -- 172.21.15.189:0/2266521710 shutdown_connections 2024-09-10T10:01:43.588 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:43.586+0000 7f5fa1666640 1 -- 172.21.15.189:0/2266521710 wait complete. 2024-09-10T10:01:43.910 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:43 smithi189 ceph-mon[34999]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:43.910 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:43 smithi189 ceph-mon[34999]: from='client.? 172.21.15.189:0/2266521710' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:01:44.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:43 smithi050 ceph-mon[30354]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:44.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:43 smithi050 ceph-mon[30354]: from='client.? 172.21.15.189:0/2266521710' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:01:44.215 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:01:43 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:01:43.747+0000 7fa57d400640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T10:01:45.206 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T10:01:45.206 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T10:01:45.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 podman[34792]: 2024-09-10 10:01:45.201355093 +0000 UTC m=+0.015620129 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:01:45.534 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:01:45.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 podman[34792]: 2024-09-10 10:01:45.507110102 +0000 UTC m=+0.321375121 container init 18af21be624a28f1465def39ec140bb4d6d8fd999f3142226df0bca8d32fd74b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-b, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:01:45.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 podman[34792]: 2024-09-10 10:01:45.510198918 +0000 UTC m=+0.324463936 container start 18af21be624a28f1465def39ec140bb4d6d8fd999f3142226df0bca8d32fd74b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:01:45.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T10:01:45.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable), process ceph-mon, pid 2 2024-09-10T10:01:45.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: pidfile_write: ignore empty --pid-file 2024-09-10T10:01:45.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: load: jerasure load: lrc 2024-09-10T10:01:45.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: RocksDB version: 7.9.2 2024-09-10T10:01:45.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Git sha 0 2024-09-10T10:01:45.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Compile date 2024-09-09 20:43:47 2024-09-10T10:01:45.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: DB SUMMARY 2024-09-10T10:01:45.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: DB Session ID: 5PS5P29314X7LLP5BYQY 2024-09-10T10:01:45.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: CURRENT file: CURRENT 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.error_if_exists: 0 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.create_if_missing: 0 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.paranoid_checks: 1 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.env: 0x55dc3618b940 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.info_log: 0x55dc37ed56e0 2024-09-10T10:01:45.851 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T10:01:45.853 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.statistics: (nil) 2024-09-10T10:01:45.853 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.use_fsync: 0 2024-09-10T10:01:45.853 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_log_file_size: 0 2024-09-10T10:01:45.854 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T10:01:45.854 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T10:01:45.854 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T10:01:45.854 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T10:01:45.854 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.allow_fallocate: 1 2024-09-10T10:01:45.854 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T10:01:45.854 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T10:01:45.854 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.use_direct_reads: 0 2024-09-10T10:01:45.854 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T10:01:45.854 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T10:01:45.854 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.db_log_dir: 2024-09-10T10:01:45.854 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.wal_dir: 2024-09-10T10:01:45.855 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T10:01:45.855 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T10:01:45.855 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T10:01:45.855 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T10:01:45.855 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T10:01:45.855 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T10:01:45.855 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T10:01:45.855 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T10:01:45.855 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.write_buffer_manager: 0x55dc37ee4dc0 2024-09-10T10:01:45.855 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T10:01:45.855 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T10:01:45.855 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T10:01:45.855 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T10:01:45.856 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T10:01:45.856 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T10:01:45.856 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T10:01:45.856 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T10:01:45.856 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.unordered_write: 0 2024-09-10T10:01:45.856 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T10:01:45.856 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T10:01:45.856 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T10:01:45.856 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T10:01:45.856 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.row_cache: None 2024-09-10T10:01:45.856 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.wal_filter: None 2024-09-10T10:01:45.856 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.two_write_queues: 0 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.wal_compression: 0 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.atomic_flush: 0 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.log_readahead_size: 0 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T10:01:45.857 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T10:01:45.858 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T10:01:45.858 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T10:01:45.858 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_background_jobs: 2 2024-09-10T10:01:45.858 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_background_compactions: -1 2024-09-10T10:01:45.858 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_subcompactions: 1 2024-09-10T10:01:45.858 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T10:01:45.858 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T10:01:45.858 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T10:01:45.858 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T10:01:45.858 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T10:01:45.858 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T10:01:45.858 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T10:01:45.858 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_open_files: -1 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_background_flushes: -1 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Compression algorithms supported: 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: kZSTD supported: 0 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: kXpressCompression supported: 0 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: kBZip2Compression supported: 0 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: kLZ4Compression supported: 1 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: kZlibCompression supported: 1 2024-09-10T10:01:45.859 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T10:01:45.860 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: kSnappyCompression supported: 1 2024-09-10T10:01:45.860 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T10:01:45.860 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T10:01:45.860 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-10T10:01:45.860 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T10:01:45.860 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T10:01:45.860 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.merge_operator: 2024-09-10T10:01:45.860 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compaction_filter: None 2024-09-10T10:01:45.860 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T10:01:45.860 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T10:01:45.860 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T10:01:45.860 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T10:01:45.861 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55dc37ed5320) 2024-09-10T10:01:45.861 INFO:journalctl@ceph.mon.b.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-09-10T10:01:45.861 INFO:journalctl@ceph.mon.b.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T10:01:45.861 INFO:journalctl@ceph.mon.b.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T10:01:45.861 INFO:journalctl@ceph.mon.b.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-09-10T10:01:45.861 INFO:journalctl@ceph.mon.b.smithi084.stdout: index_type: 0 2024-09-10T10:01:45.861 INFO:journalctl@ceph.mon.b.smithi084.stdout: data_block_index_type: 0 2024-09-10T10:01:45.861 INFO:journalctl@ceph.mon.b.smithi084.stdout: index_shortening: 1 2024-09-10T10:01:45.861 INFO:journalctl@ceph.mon.b.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T10:01:45.861 INFO:journalctl@ceph.mon.b.smithi084.stdout: checksum: 4 2024-09-10T10:01:45.861 INFO:journalctl@ceph.mon.b.smithi084.stdout: no_block_cache: 0 2024-09-10T10:01:45.861 INFO:journalctl@ceph.mon.b.smithi084.stdout: block_cache: 0x55dc37ec91f0 2024-09-10T10:01:45.861 INFO:journalctl@ceph.mon.b.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-09-10T10:01:45.862 INFO:journalctl@ceph.mon.b.smithi084.stdout: block_cache_options: 2024-09-10T10:01:45.862 INFO:journalctl@ceph.mon.b.smithi084.stdout: capacity : 536870912 2024-09-10T10:01:45.862 INFO:journalctl@ceph.mon.b.smithi084.stdout: num_shard_bits : 4 2024-09-10T10:01:45.862 INFO:journalctl@ceph.mon.b.smithi084.stdout: strict_capacity_limit : 0 2024-09-10T10:01:45.862 INFO:journalctl@ceph.mon.b.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-09-10T10:01:45.862 INFO:journalctl@ceph.mon.b.smithi084.stdout: block_cache_compressed: (nil) 2024-09-10T10:01:45.862 INFO:journalctl@ceph.mon.b.smithi084.stdout: persistent_cache: (nil) 2024-09-10T10:01:45.862 INFO:journalctl@ceph.mon.b.smithi084.stdout: block_size: 4096 2024-09-10T10:01:45.862 INFO:journalctl@ceph.mon.b.smithi084.stdout: block_size_deviation: 10 2024-09-10T10:01:45.862 INFO:journalctl@ceph.mon.b.smithi084.stdout: block_restart_interval: 16 2024-09-10T10:01:45.862 INFO:journalctl@ceph.mon.b.smithi084.stdout: index_block_restart_interval: 1 2024-09-10T10:01:45.862 INFO:journalctl@ceph.mon.b.smithi084.stdout: metadata_block_size: 4096 2024-09-10T10:01:45.863 INFO:journalctl@ceph.mon.b.smithi084.stdout: partition_filters: 0 2024-09-10T10:01:45.863 INFO:journalctl@ceph.mon.b.smithi084.stdout: use_delta_encoding: 1 2024-09-10T10:01:45.863 INFO:journalctl@ceph.mon.b.smithi084.stdout: filter_policy: bloomfilter 2024-09-10T10:01:45.863 INFO:journalctl@ceph.mon.b.smithi084.stdout: whole_key_filtering: 1 2024-09-10T10:01:45.863 INFO:journalctl@ceph.mon.b.smithi084.stdout: verify_compression: 0 2024-09-10T10:01:45.863 INFO:journalctl@ceph.mon.b.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-09-10T10:01:45.863 INFO:journalctl@ceph.mon.b.smithi084.stdout: format_version: 5 2024-09-10T10:01:45.863 INFO:journalctl@ceph.mon.b.smithi084.stdout: enable_index_compression: 1 2024-09-10T10:01:45.863 INFO:journalctl@ceph.mon.b.smithi084.stdout: block_align: 0 2024-09-10T10:01:45.863 INFO:journalctl@ceph.mon.b.smithi084.stdout: max_auto_readahead_size: 262144 2024-09-10T10:01:45.863 INFO:journalctl@ceph.mon.b.smithi084.stdout: prepopulate_block_cache: 0 2024-09-10T10:01:45.863 INFO:journalctl@ceph.mon.b.smithi084.stdout: initial_auto_readahead_size: 8192 2024-09-10T10:01:45.863 INFO:journalctl@ceph.mon.b.smithi084.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compression: NoCompression 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.num_levels: 7 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T10:01:45.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T10:01:45.865 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T10:01:45.865 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T10:01:45.865 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T10:01:45.865 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T10:01:45.865 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T10:01:45.865 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T10:01:45.865 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T10:01:45.865 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T10:01:45.865 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T10:01:45.865 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T10:01:45.865 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T10:01:45.865 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T10:01:45.865 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T10:01:45.866 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T10:01:45.866 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T10:01:45.866 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T10:01:45.866 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T10:01:45.866 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T10:01:45.866 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T10:01:45.866 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T10:01:45.866 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T10:01:45.866 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T10:01:45.866 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T10:01:45.866 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T10:01:45.866 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T10:01:45.866 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T10:01:45.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T10:01:45.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T10:01:45.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T10:01:45.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T10:01:45.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T10:01:45.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T10:01:45.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T10:01:45.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T10:01:45.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T10:01:45.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T10:01:45.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T10:01:45.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T10:01:45.868 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T10:01:45.868 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T10:01:45.868 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T10:01:45.868 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T10:01:45.868 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T10:01:45.868 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T10:01:45.868 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T10:01:45.868 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T10:01:45.868 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T10:01:45.868 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.inplace_update_support: 0 2024-09-10T10:01:45.868 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T10:01:45.868 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T10:01:45.868 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T10:01:45.869 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T10:01:45.869 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.bloom_locality: 0 2024-09-10T10:01:45.869 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.max_successive_merges: 0 2024-09-10T10:01:45.869 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T10:01:45.869 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T10:01:45.869 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T10:01:45.869 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T10:01:45.869 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.ttl: 2592000 2024-09-10T10:01:45.869 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T10:01:45.869 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T10:01:45.869 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T10:01:45.869 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.enable_blob_files: false 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.min_blob_size: 0 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4800f2b9-d39a-4b8e-8bab-8cf5cd2f1f89 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962505536762, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T10:01:45.870 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T10:01:45.871 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962505537169, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725962505, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4800f2b9-d39a-4b8e-8bab-8cf5cd2f1f89", "db_session_id": "5PS5P29314X7LLP5BYQY", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T10:01:45.871 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725962505537260, "job": 1, "event": "recovery_finished"} 2024-09-10T10:01:45.871 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T10:01:45.871 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T10:01:45.871 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55dc37ef6e00 2024-09-10T10:01:45.871 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: DB pointer 0x55dc37ff2000 2024-09-10T10:01:45.871 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T10:01:45.871 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T10:01:45.871 INFO:journalctl@ceph.mon.b.smithi084.stdout: ** DB Stats ** 2024-09-10T10:01:45.871 INFO:journalctl@ceph.mon.b.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T10:01:45.871 INFO:journalctl@ceph.mon.b.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: ** Compaction Stats [default] ** 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: 2024-09-10T10:01:45.872 INFO:journalctl@ceph.mon.b.smithi084.stdout: ** Compaction Stats [default] ** 2024-09-10T10:01:45.873 INFO:journalctl@ceph.mon.b.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T10:01:45.873 INFO:journalctl@ceph.mon.b.smithi084.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T10:01:45.873 INFO:journalctl@ceph.mon.b.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T10:01:45.873 INFO:journalctl@ceph.mon.b.smithi084.stdout: 2024-09-10T10:01:45.873 INFO:journalctl@ceph.mon.b.smithi084.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T10:01:45.873 INFO:journalctl@ceph.mon.b.smithi084.stdout: 2024-09-10T10:01:45.873 INFO:journalctl@ceph.mon.b.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T10:01:45.873 INFO:journalctl@ceph.mon.b.smithi084.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T10:01:45.873 INFO:journalctl@ceph.mon.b.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T10:01:45.873 INFO:journalctl@ceph.mon.b.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T10:01:45.873 INFO:journalctl@ceph.mon.b.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T10:01:45.873 INFO:journalctl@ceph.mon.b.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T10:01:45.873 INFO:journalctl@ceph.mon.b.smithi084.stdout: Cumulative compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T10:01:45.874 INFO:journalctl@ceph.mon.b.smithi084.stdout: Interval compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T10:01:45.874 INFO:journalctl@ceph.mon.b.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T10:01:45.874 INFO:journalctl@ceph.mon.b.smithi084.stdout: Block cache BinnedLRUCache@0x55dc37ec91f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-10T10:01:45.874 INFO:journalctl@ceph.mon.b.smithi084.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T10:01:45.874 INFO:journalctl@ceph.mon.b.smithi084.stdout: 2024-09-10T10:01:45.874 INFO:journalctl@ceph.mon.b.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T10:01:45.874 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-10T10:01:45.874 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: using public_addr v2:172.21.15.84:0/0 -> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] 2024-09-10T10:01:45.874 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: starting mon.b rank -1 at public addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] at bind addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:01:45.874 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(???) e0 preinit fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:01:45.874 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(synchronizing).mds e1 new map 2024-09-10T10:01:45.874 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-10T10:01:45.874 INFO:journalctl@ceph.mon.b.smithi084.stdout: e1 2024-09-10T10:01:45.875 INFO:journalctl@ceph.mon.b.smithi084.stdout: btime 2024-09-10T10:00:05:599805+0000 2024-09-10T10:01:45.875 INFO:journalctl@ceph.mon.b.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:01:45.875 INFO:journalctl@ceph.mon.b.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T10:01:45.875 INFO:journalctl@ceph.mon.b.smithi084.stdout: legacy client fscid: -1 2024-09-10T10:01:45.875 INFO:journalctl@ceph.mon.b.smithi084.stdout: 2024-09-10T10:01:45.875 INFO:journalctl@ceph.mon.b.smithi084.stdout: No filesystems configured 2024-09-10T10:01:45.875 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T10:01:45.875 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T10:01:45.875 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T10:01:45.875 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T10:01:45.875 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T10:01:45.875 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T10:01:45.875 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T10:01:45.876 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:01:45.876 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:01:45.876 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:01:45.876 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:45.876 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: Updating smithi084:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:45.876 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:01:45.876 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: Updating smithi084:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:01:45.876 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: Deploying cephadm binary to smithi189 2024-09-10T10:01:45.876 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:45.876 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.876 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:45.876 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: Added host smithi189 2024-09-10T10:01:45.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:45.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:01:45.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:45.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2167977872' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T10:01:45.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:01:45.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:45.878 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:45.878 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T10:01:45.878 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: Updating smithi189:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:45.878 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:01:45.878 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2167977872' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T10:01:45.878 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:01:45.878 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.878 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.878 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.878 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: Updating smithi189:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:01:45.878 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:45.878 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.878 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:172.21.15.50=a;smithi084:172.21.15.84=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: Saving service mon spec with placement smithi050:172.21.15.50=a;smithi084:172.21.15.84=b;smithi189:172.21.15.189=c;count:3 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: Deploying daemon mon.c on smithi189 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='client.? 172.21.15.189:0/1030195291' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:01:45.879 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:45.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.a calling monitor election 2024-09-10T10:01:45.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:45.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:45.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:45.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.c calling monitor election 2024-09-10T10:01:45.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:45.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:45.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:45.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:45.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:01:45.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: monmap epoch 2 2024-09-10T10:01:45.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:01:45.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: last_changed 2024-09-10T10:01:36.747941+0000 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: created 2024-09-10T10:00:01.957230+0000 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: min_mon_release 19 (squid) 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: election_strategy: 1 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: fsmap 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mgrmap e13: x(active, since 43s) 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: overall HEALTH_OK 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:45.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:45.882 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: Deploying daemon mon.b on smithi084 2024-09-10T10:01:45.882 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:45.882 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:45.882 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: from='client.? 172.21.15.189:0/2266521710' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:01:45.882 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 ceph-mon[34812]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T10:01:45.882 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 bash[34792]: 18af21be624a28f1465def39ec140bb4d6d8fd999f3142226df0bca8d32fd74b 2024-09-10T10:01:45.882 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:45 smithi084 systemd[1]: Started Ceph mon.b for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:01:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:01:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: mon.a calling monitor election 2024-09-10T10:01:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: mon.c calling monitor election 2024-09-10T10:01:50.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:50.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:50.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:50.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:50.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: mon.b calling monitor election 2024-09-10T10:01:50.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:50.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:50.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:50.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:50.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T10:01:50.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: monmap epoch 3 2024-09-10T10:01:50.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:01:50.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: last_changed 2024-09-10T10:01:45.563027+0000 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: created 2024-09-10T10:00:01.957230+0000 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: min_mon_release 19 (squid) 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: election_strategy: 1 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: 2: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: fsmap 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: mgrmap e13: x(active, since 51s) 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: overall HEALTH_OK 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:50.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:01:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: mon.a calling monitor election 2024-09-10T10:01:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: mon.c calling monitor election 2024-09-10T10:01:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: mon.b calling monitor election 2024-09-10T10:01:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: monmap epoch 3 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: last_changed 2024-09-10T10:01:45.563027+0000 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: created 2024-09-10T10:00:01.957230+0000 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: min_mon_release 19 (squid) 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: election_strategy: 1 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: 2: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: fsmap 2024-09-10T10:01:51.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:01:51.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: mgrmap e13: x(active, since 51s) 2024-09-10T10:01:51.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: overall HEALTH_OK 2024-09-10T10:01:51.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:51.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:51.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:51.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:01:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: mon.a calling monitor election 2024-09-10T10:01:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: mon.c calling monitor election 2024-09-10T10:01:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:01:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:51.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:51.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:51.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: mon.b calling monitor election 2024-09-10T10:01:51.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:51.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:51.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:51.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:51.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T10:01:51.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: monmap epoch 3 2024-09-10T10:01:51.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:01:51.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: last_changed 2024-09-10T10:01:45.563027+0000 2024-09-10T10:01:51.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: created 2024-09-10T10:00:01.957230+0000 2024-09-10T10:01:51.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: min_mon_release 19 (squid) 2024-09-10T10:01:51.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: election_strategy: 1 2024-09-10T10:01:51.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-10T10:01:51.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T10:01:51.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: 2: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2024-09-10T10:01:51.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: fsmap 2024-09-10T10:01:51.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:01:51.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: mgrmap e13: x(active, since 51s) 2024-09-10T10:01:51.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: overall HEALTH_OK 2024-09-10T10:01:51.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:51.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:51.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:51.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:51.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:51 smithi050 ceph-mon[30354]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:51.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:51 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:51.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:51 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:52.011 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.009+0000 7fadc72c8640 1 -- 172.21.15.189:0/3315613008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadac0061a0 msgr2=0x7fadac008610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:52.011 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.009+0000 7fadc72c8640 1 --2- 172.21.15.189:0/3315613008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadac0061a0 0x7fadac008610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fadc006a740 tx=0x7fadbc02c1a0 comp rx=0 tx=0).stop 2024-09-10T10:01:52.011 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.009+0000 7fadc72c8640 1 -- 172.21.15.189:0/3315613008 shutdown_connections 2024-09-10T10:01:52.011 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.009+0000 7fadc72c8640 1 --2- 172.21.15.189:0/3315613008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadac0061a0 0x7fadac008610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:52.011 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.009+0000 7fadc72c8640 1 -- 172.21.15.189:0/3315613008 >> 172.21.15.189:0/3315613008 conn(0x7fadc00fc220 msgr2=0x7fadc00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:52.012 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.010+0000 7fadc72c8640 1 -- 172.21.15.189:0/3315613008 shutdown_connections 2024-09-10T10:01:52.012 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.010+0000 7fadc72c8640 1 -- 172.21.15.189:0/3315613008 wait complete. 2024-09-10T10:01:52.012 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:51 smithi189 ceph-mon[34999]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:52.012 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:51 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:52.012 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:51 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:52.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.010+0000 7fadc72c8640 1 Processor -- start 2024-09-10T10:01:52.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.010+0000 7fadc72c8640 1 -- start start 2024-09-10T10:01:52.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.010+0000 7fadc72c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadac0061a0 0x7fadc0100480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:52.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.010+0000 7fadc72c8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadc01009c0 0x7fadc0100e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:52.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.010+0000 7fadc72c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc01a3710 0x7fadc01a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:52.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.010+0000 7fadc72c8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fadc0109730 con 0x7fadac0061a0 2024-09-10T10:01:52.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.010+0000 7fadc72c8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fadc01095b0 con 0x7fadc01a3710 2024-09-10T10:01:52.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.010+0000 7fadc72c8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fadc01098b0 con 0x7fadc01009c0 2024-09-10T10:01:52.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadc4863640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadc01009c0 0x7fadc0100e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:52.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadc4863640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadc01009c0 0x7fadc0100e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:46896/0 (socket says 172.21.15.189:46896) 2024-09-10T10:01:52.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadc4863640 1 -- 172.21.15.189:0/1921237720 learned_addr learned my addr 172.21.15.189:0/1921237720 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T10:01:52.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadc5064640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadac0061a0 0x7fadc0100480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:52.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadc5865640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc01a3710 0x7fadc01a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:52.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadc4863640 1 -- 172.21.15.189:0/1921237720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc01a3710 msgr2=0x7fadc01a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:52.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadc4863640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc01a3710 0x7fadc01a5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:52.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadc4863640 1 -- 172.21.15.189:0/1921237720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadac0061a0 msgr2=0x7fadc0100480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:52.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadc4863640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadac0061a0 0x7fadc0100480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:52.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadc4863640 1 -- 172.21.15.189:0/1921237720 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc01a61d0 con 0x7fadc01009c0 2024-09-10T10:01:52.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadc4863640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadc01009c0 0x7fadc0100e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fadb000b520 tx=0x7fadb000b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:52.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadb67fc640 1 -- 172.21.15.189:0/1921237720 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0004230 con 0x7fadc01009c0 2024-09-10T10:01:52.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadc72c8640 1 -- 172.21.15.189:0/1921237720 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc01a64c0 con 0x7fadc01009c0 2024-09-10T10:01:52.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadb67fc640 1 -- 172.21.15.189:0/1921237720 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadb00043d0 con 0x7fadc01009c0 2024-09-10T10:01:52.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadb67fc640 1 -- 172.21.15.189:0/1921237720 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0003d60 con 0x7fadc01009c0 2024-09-10T10:01:52.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.011+0000 7fadc72c8640 1 -- 172.21.15.189:0/1921237720 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc01a6a00 con 0x7fadc01009c0 2024-09-10T10:01:52.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.012+0000 7fadb67fc640 1 -- 172.21.15.189:0/1921237720 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fadb000e070 con 0x7fadc01009c0 2024-09-10T10:01:52.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.012+0000 7fadb67fc640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fada40394f0 0x7fada403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:52.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.013+0000 7fadb67fc640 1 -- 172.21.15.189:0/1921237720 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fadb004ba50 con 0x7fadc01009c0 2024-09-10T10:01:52.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.013+0000 7fadc72c8640 1 -- 172.21.15.189:0/1921237720 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc010a8a0 con 0x7fadc01009c0 2024-09-10T10:01:52.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.013+0000 7fadc5064640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fada40394f0 0x7fada403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:52.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.013+0000 7fadc5064640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fada40394f0 0x7fada403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fadbc037040 tx=0x7fadbc011040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:52.019 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.018+0000 7fadb67fc640 1 -- 172.21.15.189:0/1921237720 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fadb0014020 con 0x7fadc01009c0 2024-09-10T10:01:52.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:51 smithi084 ceph-mon[34812]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:52.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:51 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:01:52.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:51 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:01:52.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.283+0000 7fadc72c8640 1 -- 172.21.15.189:0/1921237720 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fadc0190ed0 con 0x7fadc01009c0 2024-09-10T10:01:52.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.283+0000 7fadb67fc640 1 -- 172.21.15.189:0/1921237720 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7fadb0020350 con 0x7fadc01009c0 2024-09-10T10:01:52.285 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T10:01:52.285 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":3,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","modified":"2024-09-10T10:01:45.563027Z","created":"2024-09-10T10:00:01.957230Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-10T10:01:52.285 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 3 2024-09-10T10:01:52.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.285+0000 7fadc72c8640 1 -- 172.21.15.189:0/1921237720 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fada40394f0 msgr2=0x7fada403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:52.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.286+0000 7fadc72c8640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fada40394f0 0x7fada403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fadbc037040 tx=0x7fadbc011040 comp rx=0 tx=0).stop 2024-09-10T10:01:52.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.286+0000 7fadc72c8640 1 -- 172.21.15.189:0/1921237720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadc01009c0 msgr2=0x7fadc0100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:52.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.286+0000 7fadc72c8640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadc01009c0 0x7fadc0100e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fadb000b520 tx=0x7fadb000b9e0 comp rx=0 tx=0).stop 2024-09-10T10:01:52.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.286+0000 7fadc72c8640 1 -- 172.21.15.189:0/1921237720 shutdown_connections 2024-09-10T10:01:52.288 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.286+0000 7fadc72c8640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fada40394f0 0x7fada403b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:52.288 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.286+0000 7fadc72c8640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc01a3710 0x7fadc01a5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:52.288 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.286+0000 7fadc72c8640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadc01009c0 0x7fadc0100e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:52.288 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.286+0000 7fadc72c8640 1 --2- 172.21.15.189:0/1921237720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fadac0061a0 0x7fadc0100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:52.288 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.286+0000 7fadc72c8640 1 -- 172.21.15.189:0/1921237720 >> 172.21.15.189:0/1921237720 conn(0x7fadc00fc220 msgr2=0x7fadc0106e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:52.288 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.286+0000 7fadc72c8640 1 -- 172.21.15.189:0/1921237720 shutdown_connections 2024-09-10T10:01:52.288 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:52.286+0000 7fadc72c8640 1 -- 172.21.15.189:0/1921237720 wait complete. 2024-09-10T10:01:52.903 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:52.903 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:52.903 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:52.903 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:52.903 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:52.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:52.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: Updating smithi050:/etc/ceph/ceph.conf 2024-09-10T10:01:52.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-10T10:01:52.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T10:01:52.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: Updating smithi084:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:52.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: Updating smithi189:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:52.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:52.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:52.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:52.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:52.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: Updating smithi050:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:52.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='client.? 172.21.15.189:0/1921237720' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:01:52.905 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:52.905 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:52.905 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:52.906 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T10:01:52.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T10:01:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:53.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:53.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: Updating smithi050:/etc/ceph/ceph.conf 2024-09-10T10:01:53.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-10T10:01:53.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T10:01:53.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: Updating smithi084:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:53.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: Updating smithi189:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:53.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: Updating smithi050:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:53.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='client.? 172.21.15.189:0/1921237720' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:01:53.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:53.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:01:53.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: Updating smithi050:/etc/ceph/ceph.conf 2024-09-10T10:01:53.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-10T10:01:53.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T10:01:53.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: Updating smithi084:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:53.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: Updating smithi189:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:53.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: Updating smithi050:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:01:53.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='client.? 172.21.15.189:0/1921237720' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:01:53.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.307 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:01:53.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:53 smithi050 ceph-mon[30354]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:53.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:53 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:53 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:53 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:53 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:53.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:53 smithi050 ceph-mon[30354]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T10:01:53.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:53 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:53.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:53 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:01:53.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:53 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:53.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:53 smithi050 ceph-mon[30354]: Reconfiguring daemon mon.a on smithi050 2024-09-10T10:01:53.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:53 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:54.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.198+0000 7fd1b8e00640 1 -- 172.21.15.50:0/2612021936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1b4109770 msgr2=0x7fd1b4109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:54.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.198+0000 7fd1b8e00640 1 --2- 172.21.15.50:0/2612021936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1b4109770 0x7fd1b4109b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009880 tx=0x7fd1a402a5d0 comp rx=0 tx=0).stop 2024-09-10T10:01:54.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.198+0000 7fd1b8e00640 1 -- 172.21.15.50:0/2612021936 shutdown_connections 2024-09-10T10:01:54.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.198+0000 7fd1b8e00640 1 --2- 172.21.15.50:0/2612021936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1b4109770 0x7fd1b4109b50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:54.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.198+0000 7fd1b8e00640 1 -- 172.21.15.50:0/2612021936 >> 172.21.15.50:0/2612021936 conn(0x7fd1b40ff450 msgr2=0x7fd1b4101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:54.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.198+0000 7fd1b8e00640 1 -- 172.21.15.50:0/2612021936 shutdown_connections 2024-09-10T10:01:54.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.198+0000 7fd1b8e00640 1 -- 172.21.15.50:0/2612021936 wait complete. 2024-09-10T10:01:54.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.199+0000 7fd1b8e00640 1 Processor -- start 2024-09-10T10:01:54.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.199+0000 7fd1b8e00640 1 -- start start 2024-09-10T10:01:54.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.199+0000 7fd1b8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b4109770 0x7fd1b4199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:54.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b8e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1b4199b70 0x7fd1b419df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b8e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1b419e440 0x7fd1b419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b8e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b410de30 con 0x7fd1b4199b70 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b8e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b410dcb0 con 0x7fd1b4109770 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b8e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b410dfb0 con 0x7fd1b419e440 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1b4199b70 0x7fd1b419df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1b4199b70 0x7fd1b419df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43100/0 (socket says 172.21.15.50:43100) 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b1400640 1 -- 172.21.15.50:0/4194679709 learned_addr learned my addr 172.21.15.50:0/4194679709 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b1e00640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b4109770 0x7fd1b4199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b2800640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1b419e440 0x7fd1b419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b1400640 1 -- 172.21.15.50:0/4194679709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1b419e440 msgr2=0x7fd1b419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b1400640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1b419e440 0x7fd1b419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b1400640 1 -- 172.21.15.50:0/4194679709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b4109770 msgr2=0x7fd1b4199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b1400640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b4109770 0x7fd1b4199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b1400640 1 -- 172.21.15.50:0/4194679709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b41a61b0 con 0x7fd1b4199b70 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b1e00640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b4109770 0x7fd1b4199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.200+0000 7fd1b2800640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1b419e440 0x7fd1b419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.201+0000 7fd1b1400640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1b4199b70 0x7fd1b419df00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000b520 tx=0x7fd1a000b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.201+0000 7fd1aaa00640 1 -- 172.21.15.50:0/4194679709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0004230 con 0x7fd1b4199b70 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.201+0000 7fd1aaa00640 1 -- 172.21.15.50:0/4194679709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1a00043d0 con 0x7fd1b4199b70 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.201+0000 7fd1b8e00640 1 -- 172.21.15.50:0/4194679709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b41a63e0 con 0x7fd1b4199b70 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.201+0000 7fd1aaa00640 1 -- 172.21.15.50:0/4194679709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0003d60 con 0x7fd1b4199b70 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.201+0000 7fd1b8e00640 1 -- 172.21.15.50:0/4194679709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b41a68f0 con 0x7fd1b4199b70 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.202+0000 7fd1aaa00640 1 -- 172.21.15.50:0/4194679709 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fd1a000e070 con 0x7fd1b4199b70 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.202+0000 7fd1b8e00640 1 -- 172.21.15.50:0/4194679709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1b4109bd0 con 0x7fd1b4199b70 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.203+0000 7fd1aaa00640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd1980394f0 0x7fd19803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.203+0000 7fd1aaa00640 1 -- 172.21.15.50:0/4194679709 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd1a004bb20 con 0x7fd1b4199b70 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.203+0000 7fd1b1e00640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd1980394f0 0x7fd19803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.204+0000 7fd1b1e00640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd1980394f0 0x7fd19803b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4000c00 tx=0x7fd1a4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:54.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.208+0000 7fd1aaa00640 1 -- 172.21.15.50:0/4194679709 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1a0014020 con 0x7fd1b4199b70 2024-09-10T10:01:54.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:53 smithi189 ceph-mon[34999]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:54.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:53 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:54.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:53 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:54.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:53 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:54.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:53 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:54.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:53 smithi189 ceph-mon[34999]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T10:01:54.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:53 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:54.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:53 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:01:54.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:53 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:54.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:53 smithi189 ceph-mon[34999]: Reconfiguring daemon mon.a on smithi050 2024-09-10T10:01:54.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:53 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:54.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:53 smithi084 ceph-mon[34812]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:54.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:53 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:54.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:53 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:54.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:53 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:54.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:53 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:54.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:53 smithi084 ceph-mon[34812]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T10:01:54.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:53 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:54.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:53 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:01:54.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:53 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:54.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:53 smithi084 ceph-mon[34812]: Reconfiguring daemon mon.a on smithi050 2024-09-10T10:01:54.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:53 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:54.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.393+0000 7fd1b8e00640 1 -- 172.21.15.50:0/4194679709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fd1b41a6c10 con 0x7fd1b4199b70 2024-09-10T10:01:54.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.394+0000 7fd1aaa00640 1 -- 172.21.15.50:0/4194679709 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7fd1a004b310 con 0x7fd1b4199b70 2024-09-10T10:01:54.395 INFO:teuthology.orchestra.run.smithi050.stdout:# minimal ceph.conf for 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:01:54.395 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-09-10T10:01:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:01:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: mon_host = [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-10T10:01:54.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.397+0000 7fd1b8e00640 1 -- 172.21.15.50:0/4194679709 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd1980394f0 msgr2=0x7fd19803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:54.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.397+0000 7fd1b8e00640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd1980394f0 0x7fd19803b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4000c00 tx=0x7fd1a4005a20 comp rx=0 tx=0).stop 2024-09-10T10:01:54.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.397+0000 7fd1b8e00640 1 -- 172.21.15.50:0/4194679709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1b4199b70 msgr2=0x7fd1b419df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:54.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.397+0000 7fd1b8e00640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1b4199b70 0x7fd1b419df00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000b520 tx=0x7fd1a000b9e0 comp rx=0 tx=0).stop 2024-09-10T10:01:54.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.397+0000 7fd1b8e00640 1 -- 172.21.15.50:0/4194679709 shutdown_connections 2024-09-10T10:01:54.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.397+0000 7fd1b8e00640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd1980394f0 0x7fd19803b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:54.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.397+0000 7fd1b8e00640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1b419e440 0x7fd1b419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:54.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.397+0000 7fd1b8e00640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1b4199b70 0x7fd1b419df00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:54.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.397+0000 7fd1b8e00640 1 --2- 172.21.15.50:0/4194679709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1b4109770 0x7fd1b4199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:54.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.397+0000 7fd1b8e00640 1 -- 172.21.15.50:0/4194679709 >> 172.21.15.50:0/4194679709 conn(0x7fd1b40ff450 msgr2=0x7fd1b4100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:54.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.398+0000 7fd1b8e00640 1 -- 172.21.15.50:0/4194679709 shutdown_connections 2024-09-10T10:01:54.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:01:54.398+0000 7fd1b8e00640 1 -- 172.21.15.50:0/4194679709 wait complete. 2024-09-10T10:01:55.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:54 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4194679709' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:55.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:54 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4194679709' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:55.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:54 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4194679709' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:56.000 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T10:01:56.000 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:01:56.000 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T10:01:56.060 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:01:56.060 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:01:56.156 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T10:01:56.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T10:01:56.179 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:55 smithi084 ceph-mon[34812]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:56.180 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:55 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:56.180 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:55 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:56.180 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:55 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:56.180 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:55 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:01:56.180 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:55 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:56.185 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T10:01:56.185 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:01:56.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:55 smithi050 ceph-mon[30354]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:56.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:55 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:56.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:55 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:56.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:55 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:56.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:55 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:01:56.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:55 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:56.250 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T10:01:56.251 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T10:01:56.278 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:55 smithi189 ceph-mon[34999]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:56.279 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:55 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:56.279 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:55 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:56.279 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:55 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:56.279 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:55 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:01:56.279 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:55 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:56.284 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T10:01:56.284 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:01:56.352 INFO:tasks.cephadm:Adding mgr.x on smithi050 2024-09-10T10:01:56.353 INFO:tasks.cephadm:Adding mgr.y on smithi084 2024-09-10T10:01:56.353 INFO:tasks.cephadm:Adding mgr.z on smithi189 2024-09-10T10:01:56.353 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi050=x;smithi084=y;smithi189=z' 2024-09-10T10:01:56.635 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:01:57.007 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:56 smithi189 ceph-mon[34999]: Reconfiguring mon.b (monmap changed)... 2024-09-10T10:01:57.007 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:56 smithi189 ceph-mon[34999]: Reconfiguring daemon mon.b on smithi084 2024-09-10T10:01:57.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.090+0000 7f4709450640 1 -- 172.21.15.189:0/997282583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47041005f0 msgr2=0x7f47041009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:57.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.090+0000 7f4709450640 1 --2- 172.21.15.189:0/997282583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47041005f0 0x7f47041009f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009880 tx=0x7f46f402a5d0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.098 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.090+0000 7f4709450640 1 -- 172.21.15.189:0/997282583 shutdown_connections 2024-09-10T10:01:57.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.090+0000 7f4709450640 1 --2- 172.21.15.189:0/997282583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47041005f0 0x7f47041009f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.090+0000 7f4709450640 1 -- 172.21.15.189:0/997282583 >> 172.21.15.189:0/997282583 conn(0x7f47040fbda0 msgr2=0x7f47040fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:57.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.090+0000 7f4709450640 1 -- 172.21.15.189:0/997282583 shutdown_connections 2024-09-10T10:01:57.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.090+0000 7f4709450640 1 -- 172.21.15.189:0/997282583 wait complete. 2024-09-10T10:01:57.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.091+0000 7f4709450640 1 Processor -- start 2024-09-10T10:01:57.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.091+0000 7f4709450640 1 -- start start 2024-09-10T10:01:57.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.091+0000 7f4709450640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47041005f0 0x7f4704197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:57.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.091+0000 7f4709450640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4704197560 0x7f470419c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:57.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.091+0000 7f4709450640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47041979e0 0x7f470419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:57.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.091+0000 7f4709450640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f47041066e0 con 0x7f4704197560 2024-09-10T10:01:57.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.091+0000 7f4709450640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4704106560 con 0x7f47041979e0 2024-09-10T10:01:57.099 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.091+0000 7f4709450640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4704106860 con 0x7f47041005f0 2024-09-10T10:01:57.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.091+0000 7f4702ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47041005f0 0x7f4704197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:57.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.091+0000 7f4702ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47041005f0 0x7f4704197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:42806/0 (socket says 172.21.15.189:42806) 2024-09-10T10:01:57.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.091+0000 7f4702ffd640 1 -- 172.21.15.189:0/4157526893 learned_addr learned my addr 172.21.15.189:0/4157526893 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T10:01:57.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.091+0000 7f47027fc640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4704197560 0x7f470419c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:57.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.091+0000 7f47037fe640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47041979e0 0x7f470419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:57.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.092+0000 7f4702ffd640 1 -- 172.21.15.189:0/4157526893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47041979e0 msgr2=0x7f470419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:57.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.092+0000 7f4702ffd640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47041979e0 0x7f470419eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.092+0000 7f4702ffd640 1 -- 172.21.15.189:0/4157526893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4704197560 msgr2=0x7f470419c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:57.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.092+0000 7f4702ffd640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4704197560 0x7f470419c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.092+0000 7f4702ffd640 1 -- 172.21.15.189:0/4157526893 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470419f420 con 0x7f47041005f0 2024-09-10T10:01:57.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.092+0000 7f47037fe640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47041979e0 0x7f470419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:01:57.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.092+0000 7f47027fc640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4704197560 0x7f470419c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:01:57.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.092+0000 7f4702ffd640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47041005f0 0x7f4704197020 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46f4031610 tx=0x7f46f40043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:57.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.092+0000 7f46ebfff640 1 -- 172.21.15.189:0/4157526893 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f403f030 con 0x7f47041005f0 2024-09-10T10:01:57.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.092+0000 7f4709450640 1 -- 172.21.15.189:0/4157526893 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470419f6b0 con 0x7f47041005f0 2024-09-10T10:01:57.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.092+0000 7f46ebfff640 1 -- 172.21.15.189:0/4157526893 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46f4003ce0 con 0x7f47041005f0 2024-09-10T10:01:57.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.092+0000 7f46ebfff640 1 -- 172.21.15.189:0/4157526893 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4035070 con 0x7f47041005f0 2024-09-10T10:01:57.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.092+0000 7f4709450640 1 -- 172.21.15.189:0/4157526893 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f470419fc10 con 0x7f47041005f0 2024-09-10T10:01:57.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.093+0000 7f46ebfff640 1 -- 172.21.15.189:0/4157526893 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f46f4042030 con 0x7f47041005f0 2024-09-10T10:01:57.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.093+0000 7f46ebfff640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f46ec0394f0 0x7f46ec03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:01:57.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.093+0000 7f46ebfff640 1 -- 172.21.15.189:0/4157526893 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f46f406db40 con 0x7f47041005f0 2024-09-10T10:01:57.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.093+0000 7f4709450640 1 -- 172.21.15.189:0/4157526893 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f470419fe70 con 0x7f47041005f0 2024-09-10T10:01:57.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.093+0000 7f47027fc640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f46ec0394f0 0x7f46ec03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:01:57.102 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.094+0000 7f47027fc640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f46ec0394f0 0x7f46ec03b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4704198540 tx=0x7f46f8009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:01:57.102 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.098+0000 7f46ebfff640 1 -- 172.21.15.189:0/4157526893 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f46f403ac70 con 0x7f47041005f0 2024-09-10T10:01:57.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:56 smithi050 ceph-mon[30354]: Reconfiguring mon.b (monmap changed)... 2024-09-10T10:01:57.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:56 smithi050 ceph-mon[30354]: Reconfiguring daemon mon.b on smithi084 2024-09-10T10:01:57.289 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.287+0000 7f4709450640 1 -- 172.21.15.189:0/4157526893 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi084=y;smithi189=z", "target": ["mon-mgr", ""]}) -- 0x7f4704062630 con 0x7f46ec0394f0 2024-09-10T10:01:57.294 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.293+0000 7f46ebfff640 1 -- 172.21.15.189:0/4157526893 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4704062630 con 0x7f46ec0394f0 2024-09-10T10:01:57.295 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mgr update... 2024-09-10T10:01:57.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.295+0000 7f4709450640 1 -- 172.21.15.189:0/4157526893 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f46ec0394f0 msgr2=0x7f46ec03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:57.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.295+0000 7f4709450640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f46ec0394f0 0x7f46ec03b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4704198540 tx=0x7f46f8009190 comp rx=0 tx=0).stop 2024-09-10T10:01:57.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.295+0000 7f4709450640 1 -- 172.21.15.189:0/4157526893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47041005f0 msgr2=0x7f4704197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:01:57.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.295+0000 7f4709450640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47041005f0 0x7f4704197020 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46f4031610 tx=0x7f46f40043c0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.296+0000 7f4709450640 1 -- 172.21.15.189:0/4157526893 shutdown_connections 2024-09-10T10:01:57.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.296+0000 7f4709450640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f46ec0394f0 0x7f46ec03b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.296+0000 7f4709450640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47041979e0 0x7f470419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.296+0000 7f4709450640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4704197560 0x7f470419c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.296+0000 7f4709450640 1 --2- 172.21.15.189:0/4157526893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47041005f0 0x7f4704197020 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:01:57.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.296+0000 7f4709450640 1 -- 172.21.15.189:0/4157526893 >> 172.21.15.189:0/4157526893 conn(0x7f47040fbda0 msgr2=0x7f470406acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:01:57.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.296+0000 7f4709450640 1 -- 172.21.15.189:0/4157526893 shutdown_connections 2024-09-10T10:01:57.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:01:57.296+0000 7f4709450640 1 -- 172.21.15.189:0/4157526893 wait complete. 2024-09-10T10:01:57.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:56 smithi084 ceph-mon[34812]: Reconfiguring mon.b (monmap changed)... 2024-09-10T10:01:57.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:56 smithi084 ceph-mon[34812]: Reconfiguring daemon mon.b on smithi084 2024-09-10T10:01:57.892 DEBUG:teuthology.orchestra.run.smithi084:mgr.y> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T10:01:57.894 DEBUG:teuthology.orchestra.run.smithi189:mgr.z> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T10:01:57.897 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T10:01:57.897 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:01:57.897 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T10:01:57.934 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T10:01:57.934 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-09-10T10:01:58.010 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T10:01:58.010 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:01:58.010 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-09-10T10:01:58.010 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:01:58.010 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:01:58.010 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-10 10:01:11.649352819 +0000 2024-09-10T10:01:58.010 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-10 09:56:44.784911449 +0000 2024-09-10T10:01:58.010 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-10 09:56:44.784911449 +0000 2024-09-10T10:01:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-09-10 09:56:44.784911449 +0000 2024-09-10T10:01:58.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T10:01:58.103 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-10T10:01:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-10T10:01:58.104 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000182286 s, 2.8 MB/s 2024-09-10T10:01:58.106 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T10:01:58.143 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-09-10T10:01:58.219 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T10:01:58.219 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:01:58.220 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-09-10T10:01:58.220 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:01:58.220 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:01:58.220 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-10 10:01:11.689351798 +0000 2024-09-10T10:01:58.220 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-10 09:56:45.242899811 +0000 2024-09-10T10:01:58.220 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-10 09:56:45.242899811 +0000 2024-09-10T10:01:58.220 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-09-10 09:56:45.242899811 +0000 2024-09-10T10:01:58.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T10:01:58.307 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:58 smithi050 ceph-mon[30354]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:58.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:58.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:58.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:58 smithi050 ceph-mon[30354]: Reconfiguring mon.c (monmap changed)... 2024-09-10T10:01:58.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:58.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:01:58.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:58.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:58 smithi050 ceph-mon[30354]: Reconfiguring daemon mon.c on smithi189 2024-09-10T10:01:58.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:58 smithi050 ceph-mon[30354]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi084=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:58.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:58 smithi050 ceph-mon[30354]: Saving service mgr spec with placement smithi050=x;smithi084=y;smithi189=z;count:3 2024-09-10T10:01:58.308 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:58.313 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-10T10:01:58.313 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-10T10:01:58.314 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000190842 s, 2.7 MB/s 2024-09-10T10:01:58.316 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T10:01:58.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:58 smithi189 ceph-mon[34999]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:58.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:58.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:58.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:58 smithi189 ceph-mon[34999]: Reconfiguring mon.c (monmap changed)... 2024-09-10T10:01:58.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:58.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:01:58.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:58.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:58 smithi189 ceph-mon[34999]: Reconfiguring daemon mon.c on smithi189 2024-09-10T10:01:58.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:58 smithi189 ceph-mon[34999]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi084=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:58.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:58 smithi189 ceph-mon[34999]: Saving service mgr spec with placement smithi050=x;smithi084=y;smithi189=z;count:3 2024-09-10T10:01:58.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:58.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:58 smithi084 ceph-mon[34812]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:01:58.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:58.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:58.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:58 smithi084 ceph-mon[34812]: Reconfiguring mon.c (monmap changed)... 2024-09-10T10:01:58.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:01:58.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:01:58.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:01:58.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:58 smithi084 ceph-mon[34812]: Reconfiguring daemon mon.c on smithi189 2024-09-10T10:01:58.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:58 smithi084 ceph-mon[34812]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi084=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:01:58.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:58 smithi084 ceph-mon[34812]: Saving service mgr spec with placement smithi050=x;smithi084=y;smithi189=z;count:3 2024-09-10T10:01:58.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:01:58.353 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-09-10T10:01:58.428 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T10:01:58.428 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:01:58.428 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-09-10T10:01:58.428 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:01:58.428 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:01:58.428 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-10 10:01:11.732350702 +0000 2024-09-10T10:01:58.428 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-10 09:56:45.713887840 +0000 2024-09-10T10:01:58.428 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-10 09:56:45.713887840 +0000 2024-09-10T10:01:58.429 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-09-10 09:56:45.713887840 +0000 2024-09-10T10:01:58.429 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T10:01:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-10T10:01:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-10T10:01:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000178513 s, 2.9 MB/s 2024-09-10T10:01:58.523 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T10:01:58.560 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-09-10T10:01:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T10:01:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:01:58.635 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-09-10T10:01:58.635 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:01:58.635 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:01:58.635 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-10 10:01:11.771349707 +0000 2024-09-10T10:01:58.635 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-10 09:56:46.241874422 +0000 2024-09-10T10:01:58.635 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-10 09:56:46.241874422 +0000 2024-09-10T10:01:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-09-10 09:56:46.241874422 +0000 2024-09-10T10:01:58.636 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T10:01:58.729 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-10T10:01:58.729 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-10T10:01:58.729 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000180534 s, 2.8 MB/s 2024-09-10T10:01:58.732 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T10:01:58.769 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-10T10:01:58.769 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T10:01:58.791 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T10:01:58.791 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-09-10T10:01:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T10:01:58.849 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:01:58.849 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T10:01:58.849 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:01:58.849 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:01:58.849 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-10 10:01:45.015786636 +0000 2024-09-10T10:01:58.849 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-10 09:56:26.477684447 +0000 2024-09-10T10:01:58.850 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-10 09:56:26.477684447 +0000 2024-09-10T10:01:58.850 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-10 09:56:26.477684447 +0000 2024-09-10T10:01:58.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T10:01:58.916 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-10T10:01:58.916 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-10T10:01:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000258443 s, 2.0 MB/s 2024-09-10T10:01:58.918 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T10:01:58.977 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-09-10T10:01:59.034 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T10:01:59.034 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:01:59.034 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-10T10:01:59.034 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:01:59.035 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:01:59.035 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-10 10:01:45.016786617 +0000 2024-09-10T10:01:59.035 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-10 09:56:26.809677973 +0000 2024-09-10T10:01:59.035 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-10 09:56:26.809677973 +0000 2024-09-10T10:01:59.035 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-10 09:56:26.809677973 +0000 2024-09-10T10:01:59.035 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T10:01:59.101 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-10T10:01:59.101 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-10T10:01:59.101 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000246614 s, 2.1 MB/s 2024-09-10T10:01:59.102 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T10:01:59.159 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-09-10T10:01:59.216 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T10:01:59.216 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:01:59.216 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T10:01:59.216 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:01:59.216 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:01:59.217 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-10 10:01:45.016786617 +0000 2024-09-10T10:01:59.217 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-10 09:56:27.135671615 +0000 2024-09-10T10:01:59.217 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-10 09:56:27.135671615 +0000 2024-09-10T10:01:59.217 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-10 09:56:27.135671615 +0000 2024-09-10T10:01:59.217 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T10:01:59.280 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-10T10:01:59.280 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-10T10:01:59.280 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000200026 s, 2.6 MB/s 2024-09-10T10:01:59.282 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T10:01:59.339 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-09-10T10:01:59.394 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T10:01:59.395 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:01:59.395 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T10:01:59.395 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:01:59.395 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:01:59.395 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-10 10:01:45.017786598 +0000 2024-09-10T10:01:59.395 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-10 09:56:27.468665121 +0000 2024-09-10T10:01:59.395 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-10 09:56:27.468665121 +0000 2024-09-10T10:01:59.395 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-10 09:56:27.468665121 +0000 2024-09-10T10:01:59.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T10:01:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-10T10:01:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-10T10:01:59.459 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000217352 s, 2.4 MB/s 2024-09-10T10:01:59.460 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T10:01:59.517 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T10:01:59.517 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T10:01:59.534 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T10:01:59.534 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-09-10T10:01:59.590 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T10:01:59.590 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:01:59.590 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-10T10:01:59.590 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:01:59.590 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:01:59.590 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 10:01:36.175914662 +0000 2024-09-10T10:01:59.590 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 09:56:07.633954310 +0000 2024-09-10T10:01:59.590 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 09:56:07.633954310 +0000 2024-09-10T10:01:59.590 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-10 09:56:07.633954310 +0000 2024-09-10T10:01:59.591 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T10:01:59.654 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T10:01:59.654 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T10:01:59.654 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000248367 s, 2.1 MB/s 2024-09-10T10:01:59.655 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T10:01:59.712 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-09-10T10:01:59.768 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T10:01:59.768 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:01:59.768 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-10T10:01:59.768 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:01:59.768 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:01:59.768 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 10:01:36.175914662 +0000 2024-09-10T10:01:59.768 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 09:56:07.957947522 +0000 2024-09-10T10:01:59.768 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 09:56:07.957947522 +0000 2024-09-10T10:01:59.768 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-10 09:56:07.957947522 +0000 2024-09-10T10:01:59.769 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T10:01:59.831 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T10:01:59.832 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T10:01:59.832 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000175529 s, 2.9 MB/s 2024-09-10T10:01:59.833 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T10:01:59.889 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-09-10T10:01:59.945 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T10:01:59.945 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:01:59.945 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-10T10:01:59.945 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:01:59.945 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:01:59.945 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 10:01:36.176914642 +0000 2024-09-10T10:01:59.945 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 09:56:08.267941028 +0000 2024-09-10T10:01:59.945 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 09:56:08.267941028 +0000 2024-09-10T10:01:59.945 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-10 09:56:08.267941028 +0000 2024-09-10T10:01:59.946 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T10:02:00.009 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T10:02:00.009 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T10:02:00.009 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000243815 s, 2.1 MB/s 2024-09-10T10:02:00.010 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T10:02:00.066 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-09-10T10:02:00.121 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T10:02:00.121 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:02:00.121 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-10T10:02:00.121 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:02:00.121 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:02:00.122 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 10:01:36.176914642 +0000 2024-09-10T10:02:00.122 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 09:56:08.597934114 +0000 2024-09-10T10:02:00.122 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 09:56:08.597934114 +0000 2024-09-10T10:02:00.122 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-10 09:56:08.597934114 +0000 2024-09-10T10:02:00.122 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T10:02:00.182 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:59 smithi189 ceph-mon[34999]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:00.182 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:00.182 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:00.183 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:00.183 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:00.183 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:00.183 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:00.183 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:02:00.183 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:02:00.183 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:02:00.183 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:00.183 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:01:59 smithi189 ceph-mon[34999]: Deploying daemon mgr.z on smithi189 2024-09-10T10:02:00.184 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T10:02:00.185 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T10:02:00.185 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000218991 s, 2.3 MB/s 2024-09-10T10:02:00.186 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T10:02:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:59 smithi050 ceph-mon[30354]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:02:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:02:00.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:02:00.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:00.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:01:59 smithi050 ceph-mon[30354]: Deploying daemon mgr.z on smithi189 2024-09-10T10:02:00.242 INFO:tasks.cephadm:Deploying osd.0 on smithi050 with /dev/vg_nvme/lv_4... 2024-09-10T10:02:00.243 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T10:02:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:59 smithi084 ceph-mon[34812]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:02:00.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:02:00.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:02:00.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:00.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:01:59 smithi084 ceph-mon[34812]: Deploying daemon mgr.z on smithi189 2024-09-10T10:02:00.618 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:02:00.836 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:00 smithi189 systemd[1]: Starting Ceph mgr.z for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:02:01.253 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:00 smithi189 podman[36658]: 2024-09-10 10:02:00.85854627 +0000 UTC m=+0.015878450 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:02:01.253 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:00 smithi189 podman[36658]: 2024-09-10 10:02:00.966666062 +0000 UTC m=+0.123998229 container create c8bd9e304f5e900135e7c06b378bc9727322dc93d37899d18f96ce4dab103cbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:02:01.253 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:01 smithi189 podman[36658]: 2024-09-10 10:02:01.177285002 +0000 UTC m=+0.334617168 container init c8bd9e304f5e900135e7c06b378bc9727322dc93d37899d18f96ce4dab103cbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:02:01.253 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:01 smithi189 podman[36658]: 2024-09-10 10:02:01.180595049 +0000 UTC m=+0.337927215 container start c8bd9e304f5e900135e7c06b378bc9727322dc93d37899d18f96ce4dab103cbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T10:02:01.253 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:01 smithi189 ceph-mgr[36677]: -- 172.21.15.189:0/1601225105 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55742eda90e0 con 0x55742ed86800 2024-09-10T10:02:01.512 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:01 smithi189 bash[36658]: c8bd9e304f5e900135e7c06b378bc9727322dc93d37899d18f96ce4dab103cbe 2024-09-10T10:02:01.512 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:01 smithi189 systemd[1]: Started Ceph mgr.z for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:02:01.512 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:01.302+0000 7f620e7ba040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:02:01.512 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:01.362+0000 7f620e7ba040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:02:01.512 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:01.510+0000 7f620e7ba040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:02:01.835 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:01.576+0000 7f620e7ba040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:02:01.835 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:01.723+0000 7f620e7ba040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:02:02.178 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:01.863+0000 7f620e7ba040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:02:02.179 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:02 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:02.177+0000 7f620e7ba040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:02:02.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:02 smithi084 ceph-mon[34812]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:02.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:02.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:02.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:02.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:02:02.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:02:02.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:02:02.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:02.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:02 smithi084 ceph-mon[34812]: Deploying daemon mgr.y on smithi084 2024-09-10T10:02:02.431 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:02 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:02.237+0000 7f620e7ba040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:02:02.431 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:02 smithi189 ceph-mon[34999]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:02.431 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:02.431 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:02.431 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:02.431 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:02:02.431 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:02:02.432 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:02:02.432 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:02.432 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:02 smithi189 ceph-mon[34999]: Deploying daemon mgr.y on smithi084 2024-09-10T10:02:02.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:02 smithi050 ceph-mon[30354]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:02.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:02.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:02.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:02.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:02:02.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:02:02.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:02:02.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:02.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:02 smithi050 ceph-mon[30354]: Deploying daemon mgr.y on smithi084 2024-09-10T10:02:02.805 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:02 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:02.429+0000 7f620e7ba040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:02:03.341 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:03 smithi084 systemd[1]: Starting Ceph mgr.y for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:02:03.599 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:03 smithi084 podman[36162]: 2024-09-10 10:02:03.340518889 +0000 UTC m=+0.108400518 container create 8942596cc594688f80fbf8a5cc0509605df0a9ca8aee1716ee6f1f40d4e5d316 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T10:02:03.599 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:03 smithi084 podman[36162]: 2024-09-10 10:02:03.247671762 +0000 UTC m=+0.015553391 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:02:03.599 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:03 smithi084 podman[36162]: 2024-09-10 10:02:03.542838952 +0000 UTC m=+0.310720582 container init 8942596cc594688f80fbf8a5cc0509605df0a9ca8aee1716ee6f1f40d4e5d316 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T10:02:03.599 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:03 smithi084 podman[36162]: 2024-09-10 10:02:03.545471127 +0000 UTC m=+0.313352765 container start 8942596cc594688f80fbf8a5cc0509605df0a9ca8aee1716ee6f1f40d4e5d316 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True) 2024-09-10T10:02:03.600 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:03 smithi084 ceph-mgr[36182]: -- 172.21.15.84:0/2977799790 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5583776bb0e0 con 0x558377699000 2024-09-10T10:02:03.824 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:02:03.835 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:03 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:03.370+0000 7f620e7ba040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:02:03.835 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:03 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:03.440+0000 7f620e7ba040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:02:03.855 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_4 2024-09-10T10:02:03.953 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:03 smithi084 bash[36162]: 8942596cc594688f80fbf8a5cc0509605df0a9ca8aee1716ee6f1f40d4e5d316 2024-09-10T10:02:03.953 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:03 smithi084 systemd[1]: Started Ceph mgr.y for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:02:03.953 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:03 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:03.666+0000 7fd916f01040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:02:03.953 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:03 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:03.730+0000 7fd916f01040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:02:03.953 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:03 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:03.882+0000 7fd916f01040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:02:03.954 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:03 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:03.951+0000 7fd916f01040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:02:04.244 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:02:04.265 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:04 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:04.107+0000 7fd916f01040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:02:04.265 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:04 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:04.263+0000 7fd916f01040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:02:04.484 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:04.218+0000 7f620e7ba040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:02:04.484 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:04.351+0000 7f620e7ba040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:02:04.484 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:04 smithi189 ceph-mon[34999]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:04.484 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:04 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:04.485 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:04 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:04.485 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:04 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:04.485 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:04 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:04.485 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:04 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:04.579 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:04 smithi084 ceph-mon[34812]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:04.580 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:04 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:04.580 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:04 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:04.580 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:04 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:04.580 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:04 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:04.580 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:04 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:04.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:04 smithi050 ceph-mon[30354]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:04.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:04 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:04.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:04 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:04.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:04 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:04.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:04 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:04.669 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:04 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:04.792 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:04.499+0000 7f620e7ba040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:02:04.793 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:04.565+0000 7f620e7ba040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:02:04.793 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:04.720+0000 7f620e7ba040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:02:04.793 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:04.791+0000 7f620e7ba040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:02:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.784+0000 7f02ab800640 1 -- 172.21.15.50:0/646004115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02a4076ba0 msgr2=0x7f02a4076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.784+0000 7f02ab800640 1 --2- 172.21.15.50:0/646004115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02a4076ba0 0x7f02a4076fa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0298009900 tx=0x7f029802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:02:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.784+0000 7f02ab800640 1 -- 172.21.15.50:0/646004115 shutdown_connections 2024-09-10T10:02:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.784+0000 7f02ab800640 1 --2- 172.21.15.50:0/646004115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a4078790 0x7f02a4079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.784+0000 7f02ab800640 1 --2- 172.21.15.50:0/646004115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02a4077df0 0x7f02a4078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.784+0000 7f02ab800640 1 --2- 172.21.15.50:0/646004115 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02a4076ba0 0x7f02a4076fa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.784+0000 7f02ab800640 1 -- 172.21.15.50:0/646004115 >> 172.21.15.50:0/646004115 conn(0x7f02a40ff5b0 msgr2=0x7f02a41019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.784+0000 7f02ab800640 1 -- 172.21.15.50:0/646004115 shutdown_connections 2024-09-10T10:02:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.784+0000 7f02ab800640 1 -- 172.21.15.50:0/646004115 wait complete. 2024-09-10T10:02:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.785+0000 7f02ab800640 1 Processor -- start 2024-09-10T10:02:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.785+0000 7f02ab800640 1 -- start start 2024-09-10T10:02:04.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02ab800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02a4076ba0 0x7f02a419e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02ab800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a4077df0 0x7f02a419e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02ab800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02a4078790 0x7f02a41a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02ab800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f02a4113ed0 con 0x7f02a4077df0 2024-09-10T10:02:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02ab800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f02a4113d50 con 0x7f02a4078790 2024-09-10T10:02:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02ab800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02a4114050 con 0x7f02a4076ba0 2024-09-10T10:02:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02a8e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02a4076ba0 0x7f02a419e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02a8e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02a4076ba0 0x7f02a419e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:53150/0 (socket says 172.21.15.50:53150) 2024-09-10T10:02:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02a8e00640 1 -- 172.21.15.50:0/3647043522 learned_addr learned my addr 172.21.15.50:0/3647043522 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:02:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02a3e00640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a4077df0 0x7f02a419e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02a9800640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02a4078790 0x7f02a41a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02a8e00640 1 -- 172.21.15.50:0/3647043522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02a4078790 msgr2=0x7f02a41a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02a8e00640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02a4078790 0x7f02a41a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:04.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02a8e00640 1 -- 172.21.15.50:0/3647043522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a4077df0 msgr2=0x7f02a419e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02a8e00640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a4077df0 0x7f02a419e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.786+0000 7f02a8e00640 1 -- 172.21.15.50:0/3647043522 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a41a60e0 con 0x7f02a4076ba0 2024-09-10T10:02:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.787+0000 7f02a8e00640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02a4076ba0 0x7f02a419e4b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0298031440 tx=0x7f0298032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.787+0000 7f02a1600640 1 -- 172.21.15.50:0/3647043522 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029803f030 con 0x7f02a4076ba0 2024-09-10T10:02:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.787+0000 7f02ab800640 1 -- 172.21.15.50:0/3647043522 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a41a6370 con 0x7f02a4076ba0 2024-09-10T10:02:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.787+0000 7f02a1600640 1 -- 172.21.15.50:0/3647043522 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0298003ce0 con 0x7f02a4076ba0 2024-09-10T10:02:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.787+0000 7f02a1600640 1 -- 172.21.15.50:0/3647043522 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0298035070 con 0x7f02a4076ba0 2024-09-10T10:02:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.787+0000 7f02ab800640 1 -- 172.21.15.50:0/3647043522 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a41a6850 con 0x7f02a4076ba0 2024-09-10T10:02:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.788+0000 7f02a1600640 1 -- 172.21.15.50:0/3647043522 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f0298042030 con 0x7f02a4076ba0 2024-09-10T10:02:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.788+0000 7f02ab800640 1 -- 172.21.15.50:0/3647043522 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a4110780 con 0x7f02a4076ba0 2024-09-10T10:02:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.788+0000 7f02a1600640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f028c0392c0 0x7f028c03b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.789+0000 7f02a1600640 1 -- 172.21.15.50:0/3647043522 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f029806c990 con 0x7f02a4076ba0 2024-09-10T10:02:04.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.789+0000 7f02a3e00640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f028c0392c0 0x7f028c03b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:04.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.789+0000 7f02a3e00640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f028c0392c0 0x7f028c03b780 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f02a419f9d0 tx=0x7f0290005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:04.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.794+0000 7f02a1600640 1 -- 172.21.15.50:0/3647043522 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f029803bcd0 con 0x7f02a4076ba0 2024-09-10T10:02:04.836 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:04 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:04.589+0000 7fd916f01040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:02:04.836 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:04 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:04.649+0000 7fd916f01040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:02:04.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:04.997+0000 7f02ab800640 1 -- 172.21.15.50:0/3647043522 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f02a4062630 con 0x7f028c0392c0 2024-09-10T10:02:05.085 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:04.852+0000 7f620e7ba040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:02:05.085 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:05.020+0000 7f620e7ba040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:02:05.099 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:04 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:04.835+0000 7fd916f01040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:02:05.361 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:05.087+0000 7f620e7ba040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:02:05.361 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:05.158+0000 7f620e7ba040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:02:05.361 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:05.240+0000 7f620e7ba040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:02:05.361 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:05.300+0000 7f620e7ba040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:02:05.361 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:05.359+0000 7f620e7ba040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:02:06.099 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:05.758+0000 7fd916f01040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:02:06.099 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:05.828+0000 7fd916f01040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:02:06.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:06.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:06.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:06.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:06.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:02:06.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:02:06.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:06.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T10:02:06.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:02:06.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:02:06.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:06.101 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:05 smithi084 ceph-mon[34812]: Reconfiguring daemon mgr.x on smithi050 2024-09-10T10:02:06.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:06.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:06.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:06.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:06.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:02:06.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:02:06.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:06.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T10:02:06.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:02:06.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:02:06.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:06.217 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:05 smithi050 ceph-mon[30354]: Reconfiguring daemon mgr.x on smithi050 2024-09-10T10:02:06.335 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:02:06 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z[36673]: 2024-09-10T10:02:06.159+0000 7f620e7ba040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:02:06.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:06.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:06.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:06.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:06.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:06.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:02:06.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:02:06.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:06.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T10:02:06.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:02:06.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:02:06.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:06.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:05 smithi189 ceph-mon[34999]: Reconfiguring daemon mgr.x on smithi050 2024-09-10T10:02:06.599 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:06 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:06.549+0000 7fd916f01040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:02:06.955 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:06 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:06.662+0000 7fd916f01040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:02:06.955 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:06 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:06.801+0000 7fd916f01040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:02:06.955 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:06 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:06.860+0000 7fd916f01040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:02:06.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:06.962+0000 7f02a1600640 1 -- 172.21.15.50:0/3647043522 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f0298003800 con 0x7f02a4076ba0 2024-09-10T10:02:07.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:06 smithi050 ceph-mon[30354]: Standby manager daemon z started 2024-09-10T10:02:07.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:06 smithi050 ceph-mon[30354]: from='mgr.? 172.21.15.189:0/2273417171' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T10:02:07.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:06 smithi050 ceph-mon[30354]: from='mgr.? 172.21.15.189:0/2273417171' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:02:07.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:06 smithi050 ceph-mon[30354]: from='mgr.? 172.21.15.189:0/2273417171' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T10:02:07.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:06 smithi050 ceph-mon[30354]: from='mgr.? 172.21.15.189:0/2273417171' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:02:07.286 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:06 smithi084 ceph-mon[34812]: Standby manager daemon z started 2024-09-10T10:02:07.286 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:06 smithi084 ceph-mon[34812]: from='mgr.? 172.21.15.189:0/2273417171' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T10:02:07.286 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:06 smithi084 ceph-mon[34812]: from='mgr.? 172.21.15.189:0/2273417171' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:02:07.286 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:06 smithi084 ceph-mon[34812]: from='mgr.? 172.21.15.189:0/2273417171' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T10:02:07.287 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:06 smithi084 ceph-mon[34812]: from='mgr.? 172.21.15.189:0/2273417171' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:02:07.287 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:07.007+0000 7fd916f01040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:02:07.287 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:07.073+0000 7fd916f01040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:02:07.287 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:07.131+0000 7fd916f01040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:02:07.287 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:07.285+0000 7fd916f01040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:02:07.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:06 smithi189 ceph-mon[34999]: Standby manager daemon z started 2024-09-10T10:02:07.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:06 smithi189 ceph-mon[34999]: from='mgr.? 172.21.15.189:0/2273417171' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T10:02:07.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:06 smithi189 ceph-mon[34999]: from='mgr.? 172.21.15.189:0/2273417171' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:02:07.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:06 smithi189 ceph-mon[34999]: from='mgr.? 172.21.15.189:0/2273417171' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T10:02:07.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:06 smithi189 ceph-mon[34999]: from='mgr.? 172.21.15.189:0/2273417171' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:02:07.554 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:07.349+0000 7fd916f01040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:02:07.554 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:07.413+0000 7fd916f01040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:02:07.554 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:07.493+0000 7fd916f01040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:02:07.849 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:07.552+0000 7fd916f01040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:02:07.849 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:07.611+0000 7fd916f01040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:02:08.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:07 smithi050 ceph-mon[30354]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:08.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:07 smithi050 ceph-mon[30354]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-10T10:02:08.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:07 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T10:02:08.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:07 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:08.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:07 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:08.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:07 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:08.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:07 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:08.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:07 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:08.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:07 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:08.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:07 smithi189 ceph-mon[34999]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:08.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:07 smithi189 ceph-mon[34999]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-10T10:02:08.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:07 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T10:02:08.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:07 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:08.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:07 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:08.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:07 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:08.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:07 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:08.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:07 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:08.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:07 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:08.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-mon[34812]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:08.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-mon[34812]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-10T10:02:08.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T10:02:08.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:08.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:08.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:08.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:08.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:08.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:07 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:08.849 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:02:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y[36178]: 2024-09-10T10:02:08.390+0000 7fd916f01040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:02:08.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:08.974+0000 7f02a1600640 1 -- 172.21.15.50:0/3647043522 <== mon.1 v2:172.21.15.189:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f029803b460 con 0x7f02a4076ba0 2024-09-10T10:02:09.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:08 smithi050 ceph-mon[30354]: Standby manager daemon y started 2024-09-10T10:02:09.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:08 smithi050 ceph-mon[30354]: from='mgr.? 172.21.15.84:0/427776728' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T10:02:09.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:08 smithi050 ceph-mon[30354]: from='mgr.? 172.21.15.84:0/427776728' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:02:09.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:08 smithi050 ceph-mon[30354]: from='mgr.? 172.21.15.84:0/427776728' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T10:02:09.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:08 smithi050 ceph-mon[30354]: from='mgr.? 172.21.15.84:0/427776728' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:02:09.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:08 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:09.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:08 smithi189 ceph-mon[34999]: Standby manager daemon y started 2024-09-10T10:02:09.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:08 smithi189 ceph-mon[34999]: from='mgr.? 172.21.15.84:0/427776728' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T10:02:09.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:08 smithi189 ceph-mon[34999]: from='mgr.? 172.21.15.84:0/427776728' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:02:09.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:08 smithi189 ceph-mon[34999]: from='mgr.? 172.21.15.84:0/427776728' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T10:02:09.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:08 smithi189 ceph-mon[34999]: from='mgr.? 172.21.15.84:0/427776728' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:02:09.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:08 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:09.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:08 smithi084 ceph-mon[34812]: Standby manager daemon y started 2024-09-10T10:02:09.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:08 smithi084 ceph-mon[34812]: from='mgr.? 172.21.15.84:0/427776728' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T10:02:09.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:08 smithi084 ceph-mon[34812]: from='mgr.? 172.21.15.84:0/427776728' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:02:09.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:08 smithi084 ceph-mon[34812]: from='mgr.? 172.21.15.84:0/427776728' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T10:02:09.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:08 smithi084 ceph-mon[34812]: from='mgr.? 172.21.15.84:0/427776728' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:02:09.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:08 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:10.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:09 smithi050 ceph-mon[30354]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:10.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:09 smithi050 ceph-mon[30354]: mgrmap e15: x(active, since 70s), standbys: z, y 2024-09-10T10:02:10.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:09 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T10:02:10.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:09 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/725578178' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3afef902-c68c-43dc-bc50-62848d35dcc9"}]: dispatch 2024-09-10T10:02:10.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:09 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/725578178' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3afef902-c68c-43dc-bc50-62848d35dcc9"}]': finished 2024-09-10T10:02:10.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:09 smithi050 ceph-mon[30354]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T10:02:10.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:09 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:10.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:09 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/944201541' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:02:10.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:09 smithi189 ceph-mon[34999]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:10.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:09 smithi189 ceph-mon[34999]: mgrmap e15: x(active, since 70s), standbys: z, y 2024-09-10T10:02:10.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:09 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T10:02:10.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:09 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/725578178' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3afef902-c68c-43dc-bc50-62848d35dcc9"}]: dispatch 2024-09-10T10:02:10.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:09 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/725578178' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3afef902-c68c-43dc-bc50-62848d35dcc9"}]': finished 2024-09-10T10:02:10.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:09 smithi189 ceph-mon[34999]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T10:02:10.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:09 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:10.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:09 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/944201541' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:02:10.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:09 smithi084 ceph-mon[34812]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:10.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:09 smithi084 ceph-mon[34812]: mgrmap e15: x(active, since 70s), standbys: z, y 2024-09-10T10:02:10.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:09 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T10:02:10.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:09 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/725578178' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3afef902-c68c-43dc-bc50-62848d35dcc9"}]: dispatch 2024-09-10T10:02:10.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:09 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/725578178' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3afef902-c68c-43dc-bc50-62848d35dcc9"}]': finished 2024-09-10T10:02:10.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:09 smithi084 ceph-mon[34812]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T10:02:10.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:09 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:10.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:09 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/944201541' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:02:12.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:11 smithi189 ceph-mon[34999]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:12.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:11 smithi084 ceph-mon[34812]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:12.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:11 smithi050 ceph-mon[30354]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:14.150 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:13 smithi050 ceph-mon[30354]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:14.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:13 smithi189 ceph-mon[34999]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:14.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:13 smithi084 ceph-mon[34812]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:16.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:15 smithi084 ceph-mon[34812]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:16.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:15 smithi050 ceph-mon[30354]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:16.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:15 smithi189 ceph-mon[34999]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:18.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:17 smithi050 ceph-mon[30354]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:18.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:17 smithi189 ceph-mon[34999]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:18.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:17 smithi084 ceph-mon[34812]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:19.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:18 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T10:02:19.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:18 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:19.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:18 smithi050 ceph-mon[30354]: Deploying daemon osd.0 on smithi050 2024-09-10T10:02:19.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:18 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T10:02:19.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:18 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:19.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:18 smithi189 ceph-mon[34999]: Deploying daemon osd.0 on smithi050 2024-09-10T10:02:19.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:18 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T10:02:19.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:18 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:19.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:18 smithi084 ceph-mon[34812]: Deploying daemon osd.0 on smithi050 2024-09-10T10:02:20.290 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:19 smithi050 ceph-mon[30354]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:20.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:19 smithi189 ceph-mon[34999]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:20.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:19 smithi084 ceph-mon[34812]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:22.276 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:21 smithi050 ceph-mon[30354]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:22.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:21 smithi189 ceph-mon[34999]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:21 smithi084 ceph-mon[34812]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:24.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:23 smithi189 ceph-mon[34999]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:23 smithi084 ceph-mon[34812]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:24.458 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:23 smithi050 ceph-mon[30354]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:26.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:26 smithi050 ceph-mon[30354]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:26.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:26.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:26.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:26.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:26 smithi189 ceph-mon[34999]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:26.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:26.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:26.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:26.352 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:26 smithi084 ceph-mon[34812]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:26.352 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:26.352 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:26.352 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:28.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:28 smithi050 ceph-mon[30354]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:28.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:28 smithi189 ceph-mon[34999]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:28 smithi084 ceph-mon[34812]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:29.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:29.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:29.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:29.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:29.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:29.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:29 smithi050 ceph-mon[30354]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:30.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:30.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:30.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:30.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:30.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:30.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:29 smithi189 ceph-mon[34999]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:30.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:30.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:30.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:30.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:30.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:30.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:29 smithi084 ceph-mon[34812]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:30.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:30.813+0000 7f02a1600640 1 -- 172.21.15.50:0/3647043522 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f02a4062630 con 0x7f028c0392c0 2024-09-10T10:02:30.815 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 0 on host 'smithi050' 2024-09-10T10:02:30.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:30.816+0000 7f02ab800640 1 -- 172.21.15.50:0/3647043522 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f028c0392c0 msgr2=0x7f028c03b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:30.816+0000 7f02ab800640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f028c0392c0 0x7f028c03b780 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f02a419f9d0 tx=0x7f0290005f90 comp rx=0 tx=0).stop 2024-09-10T10:02:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:30.816+0000 7f02ab800640 1 -- 172.21.15.50:0/3647043522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02a4076ba0 msgr2=0x7f02a419e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:30.816+0000 7f02ab800640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02a4076ba0 0x7f02a419e4b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0298031440 tx=0x7f0298032ce0 comp rx=0 tx=0).stop 2024-09-10T10:02:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:30.816+0000 7f02ab800640 1 -- 172.21.15.50:0/3647043522 shutdown_connections 2024-09-10T10:02:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:30.816+0000 7f02ab800640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f028c0392c0 0x7f028c03b780 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:30.816+0000 7f02ab800640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02a4078790 0x7f02a41a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:30.816+0000 7f02ab800640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02a4077df0 0x7f02a419e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:30.816+0000 7f02ab800640 1 --2- 172.21.15.50:0/3647043522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02a4076ba0 0x7f02a419e4b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:30.816+0000 7f02ab800640 1 -- 172.21.15.50:0/3647043522 >> 172.21.15.50:0/3647043522 conn(0x7f02a40ff5b0 msgr2=0x7f02a4101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:30.816+0000 7f02ab800640 1 -- 172.21.15.50:0/3647043522 shutdown_connections 2024-09-10T10:02:30.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:02:30.816+0000 7f02ab800640 1 -- 172.21.15.50:0/3647043522 wait complete. 2024-09-10T10:02:31.489 DEBUG:teuthology.orchestra.run.smithi050:osd.0> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T10:02:31.493 INFO:tasks.cephadm:Deploying osd.1 on smithi084 with /dev/vg_nvme/lv_4... 2024-09-10T10:02:31.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T10:02:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:02:31.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:31 smithi084 ceph-mon[34812]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:31.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:31 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:31.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:31 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:31.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:31 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:31.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:31 smithi084 ceph-mon[34812]: from='osd.0 [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:02:31.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:31 smithi084 ceph-mon[34812]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:02:31.992 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:31 smithi050 ceph-mon[30354]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:31.992 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:31 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:31.992 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:31 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:31.992 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:31 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:31.992 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:31 smithi050 ceph-mon[30354]: from='osd.0 [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:02:31.992 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:31 smithi050 ceph-mon[30354]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:02:32.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:31 smithi189 ceph-mon[34999]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:32.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:31 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:32.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:31 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:32.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:31 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:32.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:31 smithi189 ceph-mon[34999]: from='osd.0 [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:02:32.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:31 smithi189 ceph-mon[34999]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:02:33.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:32 smithi189 ceph-mon[34999]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T10:02:33.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:32 smithi189 ceph-mon[34999]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T10:02:33.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:32 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:33.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:32 smithi189 ceph-mon[34999]: from='osd.0 [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:02:33.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:32 smithi189 ceph-mon[34999]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:02:33.087 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:32 smithi084 ceph-mon[34812]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T10:02:33.087 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:32 smithi084 ceph-mon[34812]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T10:02:33.087 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:32 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:33.087 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:32 smithi084 ceph-mon[34812]: from='osd.0 [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:02:33.087 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:32 smithi084 ceph-mon[34812]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:02:33.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:32 smithi050 ceph-mon[30354]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T10:02:33.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:32 smithi050 ceph-mon[30354]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T10:02:33.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:33.097 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:32 smithi050 ceph-mon[30354]: from='osd.0 [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:02:33.097 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:32 smithi050 ceph-mon[30354]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:02:33.097 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:02:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0[44222]: 2024-09-10T10:02:32.832+0000 7f3fcd200640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T10:02:33.097 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:02:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0[44222]: 2024-09-10T10:02:32.835+0000 7f3fc8200640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:02:34.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:33 smithi189 ceph-mon[34999]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:34.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:33 smithi189 ceph-mon[34999]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-09-10T10:02:34.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:33 smithi189 ceph-mon[34999]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T10:02:34.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:33 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:34.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:33 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:34.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:33 smithi084 ceph-mon[34812]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:34.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:33 smithi084 ceph-mon[34812]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-09-10T10:02:34.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:33 smithi084 ceph-mon[34812]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T10:02:34.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:33 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:34.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:33 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:34.209 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T10:02:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:33 smithi050 ceph-mon[30354]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:33 smithi050 ceph-mon[30354]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-09-10T10:02:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:33 smithi050 ceph-mon[30354]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T10:02:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:33 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:33 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:34.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi084:vg_nvme/lv_4 2024-09-10T10:02:34.486 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:02:34.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.960+0000 7f4d94b4b640 1 -- 172.21.15.84:0/216662578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d901037c0 msgr2=0x7f4d9010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:34.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.960+0000 7f4d94b4b640 1 --2- 172.21.15.84:0/216662578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d901037c0 0x7f4d9010a050 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009900 tx=0x7f4d8802a410 comp rx=0 tx=0).stop 2024-09-10T10:02:34.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.960+0000 7f4d94b4b640 1 -- 172.21.15.84:0/216662578 shutdown_connections 2024-09-10T10:02:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.960+0000 7f4d94b4b640 1 --2- 172.21.15.84:0/216662578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d901037c0 0x7f4d9010a050 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.960+0000 7f4d94b4b640 1 --2- 172.21.15.84:0/216662578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d90102e00 0x7f4d90103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.960+0000 7f4d94b4b640 1 --2- 172.21.15.84:0/216662578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d90101c00 0x7f4d90102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.960+0000 7f4d94b4b640 1 -- 172.21.15.84:0/216662578 >> 172.21.15.84:0/216662578 conn(0x7f4d900fd390 msgr2=0x7f4d900ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.960+0000 7f4d94b4b640 1 -- 172.21.15.84:0/216662578 shutdown_connections 2024-09-10T10:02:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.960+0000 7f4d94b4b640 1 -- 172.21.15.84:0/216662578 wait complete. 2024-09-10T10:02:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.961+0000 7f4d94b4b640 1 Processor -- start 2024-09-10T10:02:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.961+0000 7f4d94b4b640 1 -- start start 2024-09-10T10:02:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.961+0000 7f4d94b4b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d90101c00 0x7f4d90197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.961+0000 7f4d94b4b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d90102e00 0x7f4d90198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:34.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.961+0000 7f4d94b4b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d901037c0 0x7f4d9019f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:34.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.961+0000 7f4d94b4b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9010d900 con 0x7f4d90101c00 2024-09-10T10:02:34.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.961+0000 7f4d94b4b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9010d780 con 0x7f4d901037c0 2024-09-10T10:02:34.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.961+0000 7f4d94b4b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9010da80 con 0x7f4d90102e00 2024-09-10T10:02:34.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.961+0000 7f4d8ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d901037c0 0x7f4d9019f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:34.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.961+0000 7f4d8ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d901037c0 0x7f4d9019f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47186/0 (socket says 172.21.15.84:47186) 2024-09-10T10:02:34.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.961+0000 7f4d8ed9d640 1 -- 172.21.15.84:0/3748729017 learned_addr learned my addr 172.21.15.84:0/3748729017 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T10:02:34.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.962+0000 7f4d8dd9b640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d90102e00 0x7f4d90198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:34.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.962+0000 7f4d8e59c640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d90101c00 0x7f4d90197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:34.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.962+0000 7f4d8ed9d640 1 -- 172.21.15.84:0/3748729017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d90102e00 msgr2=0x7f4d90198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:34.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.962+0000 7f4d8ed9d640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d90102e00 0x7f4d90198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:34.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.962+0000 7f4d8ed9d640 1 -- 172.21.15.84:0/3748729017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d90101c00 msgr2=0x7f4d90197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:34.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.962+0000 7f4d8ed9d640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d90101c00 0x7f4d90197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:34.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.962+0000 7f4d8ed9d640 1 -- 172.21.15.84:0/3748729017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9019fb50 con 0x7f4d901037c0 2024-09-10T10:02:34.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.962+0000 7f4d8ed9d640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d901037c0 0x7f4d9019f4e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4d880314e0 tx=0x7f4d88004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:34.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.962+0000 7f4d877fe640 1 -- 172.21.15.84:0/3748729017 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8803f030 con 0x7f4d901037c0 2024-09-10T10:02:34.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.962+0000 7f4d94b4b640 1 -- 172.21.15.84:0/3748729017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9019fde0 con 0x7f4d901037c0 2024-09-10T10:02:34.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.962+0000 7f4d877fe640 1 -- 172.21.15.84:0/3748729017 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d88003ce0 con 0x7f4d901037c0 2024-09-10T10:02:34.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.962+0000 7f4d877fe640 1 -- 172.21.15.84:0/3748729017 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88035070 con 0x7f4d901037c0 2024-09-10T10:02:34.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.962+0000 7f4d94b4b640 1 -- 172.21.15.84:0/3748729017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d901a0310 con 0x7f4d901037c0 2024-09-10T10:02:34.968 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:34 smithi050 ceph-mon[30354]: purged_snaps scrub starts 2024-09-10T10:02:34.968 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:34 smithi050 ceph-mon[30354]: purged_snaps scrub ok 2024-09-10T10:02:34.968 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:34 smithi050 ceph-mon[30354]: osd.0 [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864] boot 2024-09-10T10:02:34.968 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:34 smithi050 ceph-mon[30354]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T10:02:34.968 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:34 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.964+0000 7f4d94b4b640 1 -- 172.21.15.84:0/3748729017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d90109000 con 0x7f4d901037c0 2024-09-10T10:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.964+0000 7f4d877fe640 1 -- 172.21.15.84:0/3748729017 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f4d88042030 con 0x7f4d901037c0 2024-09-10T10:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.965+0000 7f4d877fe640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4d7c0a2b20 0x7f4d7c0a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.965+0000 7f4d877fe640 1 -- 172.21.15.84:0/3748729017 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f4d880edb80 con 0x7f4d901037c0 2024-09-10T10:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.966+0000 7f4d8e59c640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4d7c0a2b20 0x7f4d7c0a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.966+0000 7f4d8e59c640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4d7c0a2b20 0x7f4d7c0a4fe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d80005c40 tx=0x7f4d80005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:02:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:34.969+0000 7f4d877fe640 1 -- 172.21.15.84:0/3748729017 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d880bc550 con 0x7f4d901037c0 2024-09-10T10:02:35.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:34 smithi189 ceph-mon[34999]: purged_snaps scrub starts 2024-09-10T10:02:35.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:34 smithi189 ceph-mon[34999]: purged_snaps scrub ok 2024-09-10T10:02:35.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:34 smithi189 ceph-mon[34999]: osd.0 [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864] boot 2024-09-10T10:02:35.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:34 smithi189 ceph-mon[34999]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T10:02:35.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:34 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:35.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:34 smithi084 ceph-mon[34812]: purged_snaps scrub starts 2024-09-10T10:02:35.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:34 smithi084 ceph-mon[34812]: purged_snaps scrub ok 2024-09-10T10:02:35.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:34 smithi084 ceph-mon[34812]: osd.0 [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864] boot 2024-09-10T10:02:35.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:34 smithi084 ceph-mon[34812]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T10:02:35.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:34 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:02:35.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:35.167+0000 7f4d94b4b640 1 -- 172.21.15.84:0/3748729017 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4d90062630 con 0x7f4d7c0a2b20 2024-09-10T10:02:36.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:36.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T10:02:36.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:36.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:02:36.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:02:36.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:36.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: Detected new or changed devices on smithi050 2024-09-10T10:02:36.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:36.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:36.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:02:36.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: Adjusting osd_memory_target on smithi050 to 17094M 2024-09-10T10:02:36.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:36.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:36.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:36.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:36.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:36.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T10:02:36.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:36.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:02:36.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:02:36.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:36.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: Detected new or changed devices on smithi050 2024-09-10T10:02:36.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:36.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:36.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:02:36.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: Adjusting osd_memory_target on smithi050 to 17094M 2024-09-10T10:02:36.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:36.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:36.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:36.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:36.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:02:36.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T10:02:36.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:02:36.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:02:36.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:02:36.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:36.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: Detected new or changed devices on smithi050 2024-09-10T10:02:36.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:36.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:36.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:02:36.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: Adjusting osd_memory_target on smithi050 to 17094M 2024-09-10T10:02:36.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:36.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:36.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:36.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:38.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:37 smithi189 ceph-mon[34999]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:38.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:37 smithi189 ceph-mon[34999]: from='client.? 172.21.15.84:0/4249390176' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30da8eb4-6117-4e2c-8dbb-b0da47d30752"}]: dispatch 2024-09-10T10:02:38.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:37 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30da8eb4-6117-4e2c-8dbb-b0da47d30752"}]: dispatch 2024-09-10T10:02:38.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:37 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30da8eb4-6117-4e2c-8dbb-b0da47d30752"}]': finished 2024-09-10T10:02:38.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:37 smithi189 ceph-mon[34999]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T10:02:38.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:37 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:02:38.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:37 smithi084 ceph-mon[34812]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:38.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:37 smithi084 ceph-mon[34812]: from='client.? 172.21.15.84:0/4249390176' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30da8eb4-6117-4e2c-8dbb-b0da47d30752"}]: dispatch 2024-09-10T10:02:38.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:37 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30da8eb4-6117-4e2c-8dbb-b0da47d30752"}]: dispatch 2024-09-10T10:02:38.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:37 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30da8eb4-6117-4e2c-8dbb-b0da47d30752"}]': finished 2024-09-10T10:02:38.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:37 smithi084 ceph-mon[34812]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T10:02:38.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:37 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:02:38.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:37 smithi050 ceph-mon[30354]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:38.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:37 smithi050 ceph-mon[30354]: from='client.? 172.21.15.84:0/4249390176' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30da8eb4-6117-4e2c-8dbb-b0da47d30752"}]: dispatch 2024-09-10T10:02:38.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:37 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30da8eb4-6117-4e2c-8dbb-b0da47d30752"}]: dispatch 2024-09-10T10:02:38.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:37 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30da8eb4-6117-4e2c-8dbb-b0da47d30752"}]': finished 2024-09-10T10:02:38.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:37 smithi050 ceph-mon[30354]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T10:02:38.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:37 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:02:39.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:38 smithi084 ceph-mon[34812]: from='client.? 172.21.15.84:0/193370858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:02:39.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:38 smithi050 ceph-mon[30354]: from='client.? 172.21.15.84:0/193370858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:02:39.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:38 smithi189 ceph-mon[34999]: from='client.? 172.21.15.84:0/193370858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:02:40.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:39 smithi084 ceph-mon[34812]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:40.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:39 smithi050 ceph-mon[30354]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:40.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:39 smithi189 ceph-mon[34999]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:42.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:41 smithi084 ceph-mon[34812]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:41 smithi189 ceph-mon[34999]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:42.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:41 smithi050 ceph-mon[30354]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:44.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:43 smithi084 ceph-mon[34812]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:44.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:43 smithi050 ceph-mon[30354]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:44.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:43 smithi189 ceph-mon[34999]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:46.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:45 smithi084 ceph-mon[34812]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:46.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:45 smithi050 ceph-mon[30354]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:46.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:45 smithi189 ceph-mon[34999]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:47.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T10:02:47.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:47.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:46 smithi050 ceph-mon[30354]: Deploying daemon osd.1 on smithi084 2024-09-10T10:02:47.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T10:02:47.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:47.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:46 smithi189 ceph-mon[34999]: Deploying daemon osd.1 on smithi084 2024-09-10T10:02:47.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T10:02:47.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:47.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:46 smithi084 ceph-mon[34812]: Deploying daemon osd.1 on smithi084 2024-09-10T10:02:48.118 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:47 smithi084 ceph-mon[34812]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:48.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:47 smithi050 ceph-mon[30354]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:48.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:47 smithi189 ceph-mon[34999]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:49.918 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:49 smithi084 ceph-mon[34812]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:50.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:49 smithi050 ceph-mon[30354]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:50.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:49 smithi189 ceph-mon[34999]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:52.098 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:51 smithi084 ceph-mon[34812]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:52.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:51 smithi050 ceph-mon[30354]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:52.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:51 smithi189 ceph-mon[34999]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:53.174 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:53.174 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:53.175 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:53.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:53.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:53.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:53.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:53.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:53.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:54.190 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:53 smithi084 ceph-mon[34812]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:54.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:53 smithi050 ceph-mon[30354]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:54.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:53 smithi189 ceph-mon[34999]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:56.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:56 smithi084 ceph-mon[34812]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:56.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:56.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:56.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:56.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:56.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:56.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:56 smithi050 ceph-mon[30354]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:56.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:56.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:56.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:56.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:56.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:56.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:56 smithi189 ceph-mon[34999]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:56.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:56.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:56.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:02:56.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:02:56.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:57.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:57.013+0000 7f4d877fe640 1 -- 172.21.15.84:0/3748729017 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4d90062630 con 0x7f4d7c0a2b20 2024-09-10T10:02:57.015 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 1 on host 'smithi084' 2024-09-10T10:02:57.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:57.015+0000 7f4d94b4b640 1 -- 172.21.15.84:0/3748729017 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4d7c0a2b20 msgr2=0x7f4d7c0a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:57.015+0000 7f4d94b4b640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4d7c0a2b20 0x7f4d7c0a4fe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d80005c40 tx=0x7f4d80005bd0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:57.015+0000 7f4d94b4b640 1 -- 172.21.15.84:0/3748729017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d901037c0 msgr2=0x7f4d9019f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:02:57.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:57.015+0000 7f4d94b4b640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d901037c0 0x7f4d9019f4e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4d880314e0 tx=0x7f4d88004360 comp rx=0 tx=0).stop 2024-09-10T10:02:57.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:57.015+0000 7f4d94b4b640 1 -- 172.21.15.84:0/3748729017 shutdown_connections 2024-09-10T10:02:57.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:57.015+0000 7f4d94b4b640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4d7c0a2b20 0x7f4d7c0a4fe0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:57.015+0000 7f4d94b4b640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d901037c0 0x7f4d9019f4e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:57.015+0000 7f4d94b4b640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d90102e00 0x7f4d90198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:57.015+0000 7f4d94b4b640 1 --2- 172.21.15.84:0/3748729017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d90101c00 0x7f4d90197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:02:57.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:57.015+0000 7f4d94b4b640 1 -- 172.21.15.84:0/3748729017 >> 172.21.15.84:0/3748729017 conn(0x7f4d900fd390 msgr2=0x7f4d901061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:02:57.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:57.015+0000 7f4d94b4b640 1 -- 172.21.15.84:0/3748729017 shutdown_connections 2024-09-10T10:02:57.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:02:57.016+0000 7f4d94b4b640 1 -- 172.21.15.84:0/3748729017 wait complete. 2024-09-10T10:02:57.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:57 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:57.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:57 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:57.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:57 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:57.787 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:57 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:57.787 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:57 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:57.787 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:57 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:57.813 DEBUG:teuthology.orchestra.run.smithi084:osd.1> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T10:02:57.815 INFO:tasks.cephadm:Deploying osd.2 on smithi189 with /dev/vg_nvme/lv_4... 2024-09-10T10:02:57.816 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T10:02:57.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:57 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:02:57.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:57 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:57.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:57 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:02:58.067 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:02:58.455 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:58 smithi189 ceph-mon[34999]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:58.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:58 smithi050 ceph-mon[30354]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:58.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:58 smithi084 ceph-mon[34812]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:02:58.849 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:02:58 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1[39300]: 2024-09-10T10:02:58.526+0000 7fde35467640 -1 osd.1 0 log_to_monitors true 2024-09-10T10:02:59.499 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:59 smithi189 ceph-mon[34999]: from='osd.1 [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:02:59.499 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:02:59 smithi189 ceph-mon[34999]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:02:59.504 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:59 smithi084 ceph-mon[34812]: from='osd.1 [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:02:59.504 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:02:59 smithi084 ceph-mon[34812]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:02:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:59 smithi050 ceph-mon[30354]: from='osd.1 [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:02:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:02:59 smithi050 ceph-mon[30354]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:03:00.566 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:00 smithi189 ceph-mon[34999]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:03:00.566 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:00 smithi189 ceph-mon[34999]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T10:03:00.566 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:00 smithi189 ceph-mon[34999]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T10:03:00.566 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:00.566 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:00 smithi189 ceph-mon[34999]: from='osd.1 [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:03:00.566 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:00 smithi189 ceph-mon[34999]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:03:00.568 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T10:03:00.594 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_4 2024-09-10T10:03:00.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:00 smithi084 ceph-mon[34812]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:03:00.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:00 smithi084 ceph-mon[34812]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T10:03:00.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:00 smithi084 ceph-mon[34812]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T10:03:00.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:00.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:00 smithi084 ceph-mon[34812]: from='osd.1 [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:03:00.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:00 smithi084 ceph-mon[34812]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:03:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:00 smithi050 ceph-mon[30354]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:03:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:00 smithi050 ceph-mon[30354]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T10:03:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:00 smithi050 ceph-mon[30354]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T10:03:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:00 smithi050 ceph-mon[30354]: from='osd.1 [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:03:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:00 smithi050 ceph-mon[30354]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:03:00.889 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:03:01.099 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:03:00 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1[39300]: 2024-09-10T10:03:00.845+0000 7fde313ea640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T10:03:01.099 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:03:00 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1[39300]: 2024-09-10T10:03:00.849+0000 7fde2920a640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:03:01.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.355+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2789977890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed0100ad0 msgr2=0x7f7ed0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:01.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.355+0000 7f7ed80c7640 1 --2- 172.21.15.189:0/2789977890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed0100ad0 0x7f7ed0100ed0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009ca0 tx=0x7f7ec002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:03:01.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.355+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2789977890 shutdown_connections 2024-09-10T10:03:01.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.355+0000 7f7ed80c7640 1 --2- 172.21.15.189:0/2789977890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ed0102690 0x7f7ed0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:01.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.355+0000 7f7ed80c7640 1 --2- 172.21.15.189:0/2789977890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed0101cd0 0x7f7ed0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:01.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.355+0000 7f7ed80c7640 1 --2- 172.21.15.189:0/2789977890 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed0100ad0 0x7f7ed0100ed0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:01.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.355+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2789977890 >> 172.21.15.189:0/2789977890 conn(0x7f7ed00fc280 msgr2=0x7f7ed00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:01.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.355+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2789977890 shutdown_connections 2024-09-10T10:03:01.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.355+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2789977890 wait complete. 2024-09-10T10:03:01.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed80c7640 1 Processor -- start 2024-09-10T10:03:01.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed80c7640 1 -- start start 2024-09-10T10:03:01.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed80c7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed0100ad0 0x7f7ed006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:01.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed80c7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed0101cd0 0x7f7ed019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:01.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed80c7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ed0102690 0x7f7ed019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:01.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed80c7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed010c830 con 0x7f7ed0100ad0 2024-09-10T10:03:01.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed80c7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed010c6b0 con 0x7f7ed0102690 2024-09-10T10:03:01.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed80c7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed010c9b0 con 0x7f7ed0101cd0 2024-09-10T10:03:01.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed5662640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed0101cd0 0x7f7ed019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:01.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed5662640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed0101cd0 0x7f7ed019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:36048/0 (socket says 172.21.15.189:36048) 2024-09-10T10:03:01.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed5662640 1 -- 172.21.15.189:0/2531476124 learned_addr learned my addr 172.21.15.189:0/2531476124 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T10:03:01.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed6664640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ed0102690 0x7f7ed019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:01.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed5e63640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed0100ad0 0x7f7ed006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:01.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed5662640 1 -- 172.21.15.189:0/2531476124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ed0102690 msgr2=0x7f7ed019f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:01.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed5662640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ed0102690 0x7f7ed019f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:01.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed5662640 1 -- 172.21.15.189:0/2531476124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed0100ad0 msgr2=0x7f7ed006ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:01.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed5662640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed0100ad0 0x7f7ed006ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:01.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed5662640 1 -- 172.21.15.189:0/2531476124 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed019fc70 con 0x7f7ed0101cd0 2024-09-10T10:03:01.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.356+0000 7f7ed5e63640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed0100ad0 0x7f7ed006ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:03:01.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.357+0000 7f7ed5662640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed0101cd0 0x7f7ed019cd60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400b4a0 tx=0x7f7ec400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:01.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.357+0000 7f7eceffd640 1 -- 172.21.15.189:0/2531476124 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec4014070 con 0x7f7ed0101cd0 2024-09-10T10:03:01.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.357+0000 7f7eceffd640 1 -- 172.21.15.189:0/2531476124 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ec4010af0 con 0x7f7ed0101cd0 2024-09-10T10:03:01.363 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.357+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2531476124 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed019ff60 con 0x7f7ed0101cd0 2024-09-10T10:03:01.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.357+0000 7f7eceffd640 1 -- 172.21.15.189:0/2531476124 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec4017d10 con 0x7f7ed0101cd0 2024-09-10T10:03:01.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.357+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2531476124 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed01a04e0 con 0x7f7ed0101cd0 2024-09-10T10:03:01.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.358+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2531476124 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed0107f10 con 0x7f7ed0101cd0 2024-09-10T10:03:01.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.359+0000 7f7eceffd640 1 -- 172.21.15.189:0/2531476124 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f7ec4017070 con 0x7f7ed0101cd0 2024-09-10T10:03:01.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.360+0000 7f7eceffd640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7eb80a2b70 0x7f7eb80a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:01.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.360+0000 7f7eceffd640 1 -- 172.21.15.189:0/2531476124 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f7ec40ccd30 con 0x7f7ed0101cd0 2024-09-10T10:03:01.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.361+0000 7f7ed5e63640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7eb80a2b70 0x7f7eb80a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:01.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.361+0000 7f7ed5e63640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7eb80a2b70 0x7f7eb80a5030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0006010 tx=0x7f7ec00093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:01.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.364+0000 7f7eceffd640 1 -- 172.21.15.189:0/2531476124 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ec409b600 con 0x7f7ed0101cd0 2024-09-10T10:03:01.546 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:01.546+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2531476124 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7ed0062630 con 0x7f7eb80a2b70 2024-09-10T10:03:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:01 smithi050 ceph-mon[30354]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-10T10:03:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:01 smithi050 ceph-mon[30354]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T10:03:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:03:01.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:01.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:01.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:01.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:01.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:01 smithi050 ceph-mon[30354]: from='osd.1 ' entity='osd.1' 2024-09-10T10:03:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:01 smithi189 ceph-mon[34999]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-10T10:03:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:01 smithi189 ceph-mon[34999]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T10:03:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:01 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:01 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:01 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:01 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:01 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:03:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:01 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:01 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:01 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:01 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:01.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:01 smithi189 ceph-mon[34999]: from='osd.1 ' entity='osd.1' 2024-09-10T10:03:01.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:01 smithi084 ceph-mon[34812]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-10T10:03:01.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:01 smithi084 ceph-mon[34812]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T10:03:01.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:01 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:01.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:01 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:01.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:01 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:01.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:01 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:01.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:01 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:03:01.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:01 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:01.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:01 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:01.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:01 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:01.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:01 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:01.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:01 smithi084 ceph-mon[34812]: from='osd.1 ' entity='osd.1' 2024-09-10T10:03:02.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:02 smithi050 ceph-mon[30354]: purged_snaps scrub starts 2024-09-10T10:03:02.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:02 smithi050 ceph-mon[30354]: purged_snaps scrub ok 2024-09-10T10:03:02.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:02 smithi050 ceph-mon[30354]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:03:02.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:02 smithi050 ceph-mon[30354]: Detected new or changed devices on smithi084 2024-09-10T10:03:02.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:02 smithi050 ceph-mon[30354]: Adjusting osd_memory_target on smithi084 to 17088M 2024-09-10T10:03:02.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:02.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:02 smithi050 ceph-mon[30354]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:02.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:03:02.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:03:02.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:02.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:02 smithi050 ceph-mon[30354]: osd.1 [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620] boot 2024-09-10T10:03:02.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:02 smithi050 ceph-mon[30354]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T10:03:02.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:02.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:02 smithi189 ceph-mon[34999]: purged_snaps scrub starts 2024-09-10T10:03:02.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:02 smithi189 ceph-mon[34999]: purged_snaps scrub ok 2024-09-10T10:03:02.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:02 smithi189 ceph-mon[34999]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:03:02.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:02 smithi189 ceph-mon[34999]: Detected new or changed devices on smithi084 2024-09-10T10:03:02.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:02 smithi189 ceph-mon[34999]: Adjusting osd_memory_target on smithi084 to 17088M 2024-09-10T10:03:02.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:02.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:02 smithi189 ceph-mon[34999]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:02.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:03:02.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:03:02.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:02.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:02 smithi189 ceph-mon[34999]: osd.1 [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620] boot 2024-09-10T10:03:02.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:02 smithi189 ceph-mon[34999]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T10:03:02.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:02.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:02 smithi084 ceph-mon[34812]: purged_snaps scrub starts 2024-09-10T10:03:02.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:02 smithi084 ceph-mon[34812]: purged_snaps scrub ok 2024-09-10T10:03:02.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:02 smithi084 ceph-mon[34812]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:03:02.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:02 smithi084 ceph-mon[34812]: Detected new or changed devices on smithi084 2024-09-10T10:03:02.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:02 smithi084 ceph-mon[34812]: Adjusting osd_memory_target on smithi084 to 17088M 2024-09-10T10:03:02.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:02.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:02 smithi084 ceph-mon[34812]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:02.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:03:02.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:03:02.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:02.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:02 smithi084 ceph-mon[34812]: osd.1 [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620] boot 2024-09-10T10:03:02.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:02 smithi084 ceph-mon[34812]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T10:03:02.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:03:04.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:03 smithi189 ceph-mon[34999]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:03 smithi189 ceph-mon[34999]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T10:03:04.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:03 smithi050 ceph-mon[30354]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:04.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:03 smithi050 ceph-mon[30354]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T10:03:04.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:03 smithi084 ceph-mon[34812]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:04.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:03 smithi084 ceph-mon[34812]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T10:03:05.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:04 smithi084 ceph-mon[34812]: from='client.? 172.21.15.189:0/3942590038' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf7e7da7-c81c-420d-884d-ea22de897b36"}]: dispatch 2024-09-10T10:03:05.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:04 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf7e7da7-c81c-420d-884d-ea22de897b36"}]: dispatch 2024-09-10T10:03:05.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:04 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf7e7da7-c81c-420d-884d-ea22de897b36"}]': finished 2024-09-10T10:03:05.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:04 smithi084 ceph-mon[34812]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T10:03:05.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:04 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:05.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:04 smithi084 ceph-mon[34812]: from='client.? 172.21.15.189:0/1023698889' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:03:05.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:04 smithi050 ceph-mon[30354]: from='client.? 172.21.15.189:0/3942590038' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf7e7da7-c81c-420d-884d-ea22de897b36"}]: dispatch 2024-09-10T10:03:05.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:04 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf7e7da7-c81c-420d-884d-ea22de897b36"}]: dispatch 2024-09-10T10:03:05.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:04 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf7e7da7-c81c-420d-884d-ea22de897b36"}]': finished 2024-09-10T10:03:05.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:04 smithi050 ceph-mon[30354]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T10:03:05.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:04 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:05.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:04 smithi050 ceph-mon[30354]: from='client.? 172.21.15.189:0/1023698889' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:03:05.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:04 smithi189 ceph-mon[34999]: from='client.? 172.21.15.189:0/3942590038' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf7e7da7-c81c-420d-884d-ea22de897b36"}]: dispatch 2024-09-10T10:03:05.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:04 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf7e7da7-c81c-420d-884d-ea22de897b36"}]: dispatch 2024-09-10T10:03:05.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:04 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf7e7da7-c81c-420d-884d-ea22de897b36"}]': finished 2024-09-10T10:03:05.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:04 smithi189 ceph-mon[34999]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T10:03:05.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:04 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:05.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:04 smithi189 ceph-mon[34999]: from='client.? 172.21.15.189:0/1023698889' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:03:06.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:05 smithi050 ceph-mon[30354]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:06.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:05 smithi189 ceph-mon[34999]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:06.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:05 smithi084 ceph-mon[34812]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:08.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:07 smithi050 ceph-mon[30354]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:08.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:07 smithi189 ceph-mon[34999]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:08.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:07 smithi084 ceph-mon[34812]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:10.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:09 smithi050 ceph-mon[30354]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:10.226 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:09 smithi189 ceph-mon[34999]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:10.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:09 smithi084 ceph-mon[34812]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:12.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:11 smithi050 ceph-mon[30354]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:12.255 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:11 smithi189 ceph-mon[34999]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:12.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:11 smithi084 ceph-mon[34812]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:12.991 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:12 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T10:03:12.991 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:12 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:12.991 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:12 smithi189 ceph-mon[34999]: Deploying daemon osd.2 on smithi189 2024-09-10T10:03:13.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:12 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T10:03:13.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:12 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:13.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:12 smithi050 ceph-mon[30354]: Deploying daemon osd.2 on smithi189 2024-09-10T10:03:13.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:12 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T10:03:13.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:12 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:13.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:12 smithi084 ceph-mon[34812]: Deploying daemon osd.2 on smithi189 2024-09-10T10:03:14.125 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:13 smithi189 ceph-mon[34999]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:14.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:13 smithi050 ceph-mon[30354]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:14.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:13 smithi084 ceph-mon[34812]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:16.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:15 smithi189 ceph-mon[34999]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:16.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:15 smithi050 ceph-mon[30354]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:16.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:15 smithi084 ceph-mon[34812]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:18.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:17 smithi050 ceph-mon[30354]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:18.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:17 smithi189 ceph-mon[34999]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:18.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:17 smithi084 ceph-mon[34812]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:19.209 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:18 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:19.209 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:18 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:19.209 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:18 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:19.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:18 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:19.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:18 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:19.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:18 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:19.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:18 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:19.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:18 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:19.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:18 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:20.832 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:20 smithi189 ceph-mon[34999]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:20.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:20 smithi084 ceph-mon[34812]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:20.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:20 smithi050 ceph-mon[30354]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:22.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:21 smithi084 ceph-mon[34812]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:22.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:21 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:22.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:21 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:22.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:21 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:22.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:21 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:22.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:21 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:22.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:21 smithi050 ceph-mon[30354]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:22.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:21 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:22.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:21 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:22.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:21 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:22.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:21 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:22.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:21 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:22.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:21 smithi189 ceph-mon[34999]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:22.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:21 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:22.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:21 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:22.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:21 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:22.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:21 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:22.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:21 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:22.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:22.695+0000 7f7eceffd640 1 -- 172.21.15.189:0/2531476124 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7ed0062630 con 0x7f7eb80a2b70 2024-09-10T10:03:22.697 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 2 on host 'smithi189' 2024-09-10T10:03:22.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:22.697+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2531476124 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7eb80a2b70 msgr2=0x7f7eb80a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:22.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:22.697+0000 7f7ed80c7640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7eb80a2b70 0x7f7eb80a5030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0006010 tx=0x7f7ec00093f0 comp rx=0 tx=0).stop 2024-09-10T10:03:22.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:22.697+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2531476124 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed0101cd0 msgr2=0x7f7ed019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:22.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:22.697+0000 7f7ed80c7640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed0101cd0 0x7f7ed019cd60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ec400b4a0 tx=0x7f7ec400b960 comp rx=0 tx=0).stop 2024-09-10T10:03:22.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:22.697+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2531476124 shutdown_connections 2024-09-10T10:03:22.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:22.697+0000 7f7ed80c7640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7eb80a2b70 0x7f7eb80a5030 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:22.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:22.697+0000 7f7ed80c7640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ed0102690 0x7f7ed019f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:22.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:22.697+0000 7f7ed80c7640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7ed0101cd0 0x7f7ed019cd60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:22.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:22.697+0000 7f7ed80c7640 1 --2- 172.21.15.189:0/2531476124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ed0100ad0 0x7f7ed006ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:22.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:22.697+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2531476124 >> 172.21.15.189:0/2531476124 conn(0x7f7ed00fc280 msgr2=0x7f7ed01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:22.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:22.697+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2531476124 shutdown_connections 2024-09-10T10:03:22.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:03:22.697+0000 7f7ed80c7640 1 -- 172.21.15.189:0/2531476124 wait complete. 2024-09-10T10:03:23.025 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:23.025 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:23.025 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:23.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:23.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:23.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:23.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:23.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:23.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:23.386 DEBUG:teuthology.orchestra.run.smithi189:osd.2> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T10:03:23.388 INFO:tasks.cephadm:Deploying osd.3 on smithi050 with /dev/vg_nvme/lv_3... 2024-09-10T10:03:23.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T10:03:23.767 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:03:24.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:23 smithi189 ceph-mon[34999]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:24.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:23 smithi050 ceph-mon[30354]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:23 smithi084 ceph-mon[34812]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:24.801 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:03:24 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2[39843]: 2024-09-10T10:03:24.595+0000 7fb8d1441640 -1 osd.2 0 log_to_monitors true 2024-09-10T10:03:25.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:24 smithi189 ceph-mon[34999]: from='osd.2 [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:03:25.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:24 smithi189 ceph-mon[34999]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:03:25.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:24 smithi050 ceph-mon[30354]: from='osd.2 [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:03:25.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:24 smithi050 ceph-mon[30354]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:03:25.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:24 smithi084 ceph-mon[34812]: from='osd.2 [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:03:25.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:24 smithi084 ceph-mon[34812]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:03:26.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:25 smithi050 ceph-mon[30354]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:26.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:25 smithi050 ceph-mon[30354]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T10:03:26.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:25 smithi050 ceph-mon[30354]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T10:03:26.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:25 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:26.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:25 smithi050 ceph-mon[30354]: from='osd.2 [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:03:26.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:25 smithi050 ceph-mon[30354]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:03:26.189 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:03:25 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2[39843]: 2024-09-10T10:03:25.871+0000 7fb8cd3c4640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T10:03:26.190 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:03:25 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2[39843]: 2024-09-10T10:03:25.875+0000 7fb8c91ec640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:03:26.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:25 smithi189 ceph-mon[34999]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:26.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:25 smithi189 ceph-mon[34999]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T10:03:26.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:25 smithi189 ceph-mon[34999]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T10:03:26.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:25 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:26.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:25 smithi189 ceph-mon[34999]: from='osd.2 [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:03:26.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:25 smithi189 ceph-mon[34999]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:03:26.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:25 smithi084 ceph-mon[34812]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:26.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:25 smithi084 ceph-mon[34812]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T10:03:26.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:25 smithi084 ceph-mon[34812]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T10:03:26.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:25 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:26.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:25 smithi084 ceph-mon[34812]: from='osd.2 [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:03:26.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:25 smithi084 ceph-mon[34812]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:03:27.007 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:03:27.038 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_3 2024-09-10T10:03:27.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:26 smithi050 ceph-mon[30354]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T10:03:27.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:26 smithi050 ceph-mon[30354]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T10:03:27.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:27.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:27.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:26 smithi050 ceph-mon[30354]: Detected new or changed devices on smithi189 2024-09-10T10:03:27.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:27.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:27.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:03:27.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:26 smithi050 ceph-mon[30354]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-10T10:03:27.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:27.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:27.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:27.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:27.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:26 smithi189 ceph-mon[34999]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T10:03:27.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:26 smithi189 ceph-mon[34999]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T10:03:27.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:27.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:27.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:26 smithi189 ceph-mon[34999]: Detected new or changed devices on smithi189 2024-09-10T10:03:27.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:27.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:27.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:03:27.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:26 smithi189 ceph-mon[34999]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-10T10:03:27.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:27.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:27.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:27.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:27.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:26 smithi084 ceph-mon[34812]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T10:03:27.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:26 smithi084 ceph-mon[34812]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T10:03:27.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:27.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:27.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:26 smithi084 ceph-mon[34812]: Detected new or changed devices on smithi189 2024-09-10T10:03:27.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:27.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:27.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:03:27.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:26 smithi084 ceph-mon[34812]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-10T10:03:27.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:27.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:27.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:27.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:27.408 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:03:27.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.937+0000 7fbe33000640 1 -- 172.21.15.50:0/324313294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2c076220 msgr2=0x7fbe2c074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.937+0000 7fbe33000640 1 --2- 172.21.15.50:0/324313294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2c076220 0x7fbe2c074680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009900 tx=0x7fbe1c02a400 comp rx=0 tx=0).stop 2024-09-10T10:03:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.937+0000 7fbe33000640 1 -- 172.21.15.50:0/324313294 shutdown_connections 2024-09-10T10:03:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.937+0000 7fbe33000640 1 --2- 172.21.15.50:0/324313294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe2c109a80 0x7fbe2c10bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.937+0000 7fbe33000640 1 --2- 172.21.15.50:0/324313294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c074c50 0x7fbe2c0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.937+0000 7fbe33000640 1 --2- 172.21.15.50:0/324313294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2c076220 0x7fbe2c074680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.938+0000 7fbe33000640 1 -- 172.21.15.50:0/324313294 >> 172.21.15.50:0/324313294 conn(0x7fbe2c0fd390 msgr2=0x7fbe2c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.938+0000 7fbe33000640 1 -- 172.21.15.50:0/324313294 shutdown_connections 2024-09-10T10:03:27.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.938+0000 7fbe33000640 1 -- 172.21.15.50:0/324313294 wait complete. 2024-09-10T10:03:27.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.939+0000 7fbe33000640 1 Processor -- start 2024-09-10T10:03:27.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.939+0000 7fbe33000640 1 -- start start 2024-09-10T10:03:27.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.939+0000 7fbe33000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c074c50 0x7fbe2c19a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:27.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.939+0000 7fbe33000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe2c076220 0x7fbe2c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:27.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.939+0000 7fbe33000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2c109a80 0x7fbe2c1a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.939+0000 7fbe33000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2c10fab0 con 0x7fbe2c109a80 2024-09-10T10:03:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.939+0000 7fbe33000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2c10f930 con 0x7fbe2c074c50 2024-09-10T10:03:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.939+0000 7fbe33000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2c10fc30 con 0x7fbe2c076220 2024-09-10T10:03:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.940+0000 7fbe2be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c074c50 0x7fbe2c19a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.940+0000 7fbe31000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2c109a80 0x7fbe2c1a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.940+0000 7fbe2be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c074c50 0x7fbe2c19a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:57204/0 (socket says 172.21.15.50:57204) 2024-09-10T10:03:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.940+0000 7fbe2be00640 1 -- 172.21.15.50:0/964111313 learned_addr learned my addr 172.21.15.50:0/964111313 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:03:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.940+0000 7fbe23e00640 1 --2- 172.21.15.50:0/964111313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe2c076220 0x7fbe2c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.940+0000 7fbe2be00640 1 -- 172.21.15.50:0/964111313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe2c076220 msgr2=0x7fbe2c19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.940+0000 7fbe2be00640 1 --2- 172.21.15.50:0/964111313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe2c076220 0x7fbe2c19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.940+0000 7fbe2be00640 1 -- 172.21.15.50:0/964111313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2c109a80 msgr2=0x7fbe2c1a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.940+0000 7fbe2be00640 1 --2- 172.21.15.50:0/964111313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2c109a80 0x7fbe2c1a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:27.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.940+0000 7fbe2be00640 1 -- 172.21.15.50:0/964111313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2c1a1d50 con 0x7fbe2c074c50 2024-09-10T10:03:27.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.941+0000 7fbe2be00640 1 --2- 172.21.15.50:0/964111313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c074c50 0x7fbe2c19a120 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c031440 tx=0x7fbe1c032e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:27.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.941+0000 7fbe29600640 1 -- 172.21.15.50:0/964111313 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c03f030 con 0x7fbe2c074c50 2024-09-10T10:03:27.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.941+0000 7fbe29600640 1 -- 172.21.15.50:0/964111313 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe1c003ce0 con 0x7fbe2c074c50 2024-09-10T10:03:27.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.941+0000 7fbe29600640 1 -- 172.21.15.50:0/964111313 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c035070 con 0x7fbe2c074c50 2024-09-10T10:03:27.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.941+0000 7fbe33000640 1 -- 172.21.15.50:0/964111313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2c1a1fe0 con 0x7fbe2c074c50 2024-09-10T10:03:27.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.941+0000 7fbe33000640 1 -- 172.21.15.50:0/964111313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe2c1a2430 con 0x7fbe2c074c50 2024-09-10T10:03:27.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.942+0000 7fbe33000640 1 -- 172.21.15.50:0/964111313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe2c108800 con 0x7fbe2c074c50 2024-09-10T10:03:27.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.944+0000 7fbe29600640 1 -- 172.21.15.50:0/964111313 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fbe1c042030 con 0x7fbe2c074c50 2024-09-10T10:03:27.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.945+0000 7fbe29600640 1 --2- 172.21.15.50:0/964111313 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbe100a2ba0 0x7fbe100a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:27.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.945+0000 7fbe29600640 1 -- 172.21.15.50:0/964111313 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7fbe1c0ee120 con 0x7fbe2c074c50 2024-09-10T10:03:27.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.945+0000 7fbe23e00640 1 --2- 172.21.15.50:0/964111313 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbe100a2ba0 0x7fbe100a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:27.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.946+0000 7fbe23e00640 1 --2- 172.21.15.50:0/964111313 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbe100a2ba0 0x7fbe100a5060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c19b640 tx=0x7fbe1400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:27.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:27.948+0000 7fbe29600640 1 -- 172.21.15.50:0/964111313 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe1c0bbfc0 con 0x7fbe2c074c50 2024-09-10T10:03:28.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:28.140+0000 7fbe33000640 1 -- 172.21.15.50:0/964111313 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbe2c062630 con 0x7fbe100a2ba0 2024-09-10T10:03:28.142 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:27 smithi050 ceph-mon[30354]: purged_snaps scrub starts 2024-09-10T10:03:28.142 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:27 smithi050 ceph-mon[30354]: purged_snaps scrub ok 2024-09-10T10:03:28.142 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:27 smithi050 ceph-mon[30354]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:28.142 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:27 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:28.142 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:27 smithi050 ceph-mon[30354]: osd.2 [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908] boot 2024-09-10T10:03:28.142 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:27 smithi050 ceph-mon[30354]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T10:03:28.142 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:27 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:28.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:27 smithi189 ceph-mon[34999]: purged_snaps scrub starts 2024-09-10T10:03:28.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:27 smithi189 ceph-mon[34999]: purged_snaps scrub ok 2024-09-10T10:03:28.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:27 smithi189 ceph-mon[34999]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:28.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:27 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:28.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:27 smithi189 ceph-mon[34999]: osd.2 [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908] boot 2024-09-10T10:03:28.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:27 smithi189 ceph-mon[34999]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T10:03:28.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:27 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:27 smithi084 ceph-mon[34812]: purged_snaps scrub starts 2024-09-10T10:03:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:27 smithi084 ceph-mon[34812]: purged_snaps scrub ok 2024-09-10T10:03:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:27 smithi084 ceph-mon[34812]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:03:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:27 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:27 smithi084 ceph-mon[34812]: osd.2 [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908] boot 2024-09-10T10:03:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:27 smithi084 ceph-mon[34812]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T10:03:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:27 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:03:29.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:29 smithi189 ceph-mon[34999]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:29.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:03:29.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:03:29.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:29.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:29 smithi189 ceph-mon[34999]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T10:03:29.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:03:29.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:29 smithi084 ceph-mon[34812]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:29.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:03:29.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:03:29.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:29.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:29 smithi084 ceph-mon[34812]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T10:03:29.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:03:29.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:29 smithi050 ceph-mon[30354]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:29.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:03:29.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:03:29.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:29.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:29 smithi050 ceph-mon[30354]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T10:03:29.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:03:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:30 smithi050 ceph-mon[30354]: pgmap v84: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:30 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T10:03:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:30 smithi050 ceph-mon[30354]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T10:03:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:30 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:03:30.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:30 smithi189 ceph-mon[34999]: pgmap v84: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:30.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:30 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T10:03:30.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:30 smithi189 ceph-mon[34999]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T10:03:30.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:30 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:03:30.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:30 smithi084 ceph-mon[34812]: pgmap v84: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:30.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:30 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T10:03:30.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:30 smithi084 ceph-mon[34812]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T10:03:30.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:30 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:03:31.337 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:03:31 smithi050 sudo[49023]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:03:31.337 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:03:31 smithi050 sudo[49023]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:03:31.337 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:03:31 smithi050 sudo[49023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:03:31.338 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:03:31 smithi050 sudo[49023]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:03:31.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:31.350+0000 7fbe29600640 1 -- 172.21.15.50:0/964111313 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbe1c0b8630 con 0x7fbe2c074c50 2024-09-10T10:03:31.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:31 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:03:31.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:31 smithi084 ceph-mon[34812]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T10:03:31.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:31 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:03:31.636 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:31 smithi050 ceph-mon[30354]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T10:03:31.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:31 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:03:31.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:31 smithi189 ceph-mon[34999]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T10:03:31.965 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:03:31 smithi050 sudo[49061]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:03:31.965 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:03:31 smithi050 sudo[49061]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:03:31.965 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:03:31 smithi050 sudo[49061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:03:31.965 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:03:31 smithi050 sudo[49061]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:03:32.172 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:03:31 smithi084 sudo[43004]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:03:32.173 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:03:31 smithi084 sudo[43004]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:03:32.173 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:03:31 smithi084 sudo[43004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:03:32.173 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:03:31 smithi084 sudo[43004]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:03:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:32 smithi050 ceph-mon[30354]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:32 smithi050 ceph-mon[30354]: osdmap e22: 3 total, 3 up, 3 in 2024-09-10T10:03:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:32 smithi050 ceph-mon[30354]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T10:03:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:32 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1386288881' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e018ffaa-703d-4b65-81d4-0b673271ec13"}]: dispatch 2024-09-10T10:03:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:32 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1386288881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e018ffaa-703d-4b65-81d4-0b673271ec13"}]': finished 2024-09-10T10:03:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:32 smithi050 ceph-mon[30354]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T10:03:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:32 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2626593273' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:03:32.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:32.599 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:03:32 smithi084 sudo[43007]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:03:32.599 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:03:32 smithi084 sudo[43007]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:03:32.599 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:03:32 smithi084 sudo[43007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:03:32.599 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:03:32 smithi084 sudo[43007]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:03:32.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:32 smithi084 ceph-mon[34812]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:32.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:32 smithi084 ceph-mon[34812]: osdmap e22: 3 total, 3 up, 3 in 2024-09-10T10:03:32.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:32 smithi084 ceph-mon[34812]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T10:03:32.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:32 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1386288881' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e018ffaa-703d-4b65-81d4-0b673271ec13"}]: dispatch 2024-09-10T10:03:32.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:32 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1386288881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e018ffaa-703d-4b65-81d4-0b673271ec13"}]': finished 2024-09-10T10:03:32.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:32 smithi084 ceph-mon[34812]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T10:03:32.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:32 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:32.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:32 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:32.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:32 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2626593273' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:03:32.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:32 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:32.695 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:03:32 smithi189 sudo[43448]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:03:32.696 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:03:32 smithi189 sudo[43448]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:03:32.696 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:03:32 smithi189 sudo[43448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:03:32.696 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:03:32 smithi189 sudo[43448]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:03:32.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:32 smithi189 ceph-mon[34999]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:32.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:32 smithi189 ceph-mon[34999]: osdmap e22: 3 total, 3 up, 3 in 2024-09-10T10:03:32.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:32 smithi189 ceph-mon[34999]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T10:03:32.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:32 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1386288881' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e018ffaa-703d-4b65-81d4-0b673271ec13"}]: dispatch 2024-09-10T10:03:32.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:32 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1386288881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e018ffaa-703d-4b65-81d4-0b673271ec13"}]': finished 2024-09-10T10:03:32.697 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:32 smithi189 ceph-mon[34999]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T10:03:32.697 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:32 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:32.697 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:32 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:32.697 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:32 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2626593273' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:03:32.697 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:32 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:33.085 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:03:32 smithi189 sudo[43451]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:03:33.086 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:03:32 smithi189 sudo[43451]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:03:33.086 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:03:32 smithi189 sudo[43451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:03:33.086 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:03:32 smithi189 sudo[43451]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:03:33.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:33 smithi050 sudo[49324]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:03:33.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:33 smithi050 sudo[49324]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:03:33.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:33 smithi050 sudo[49324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:03:33.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:33 smithi050 sudo[49324]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:03:34.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:33 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:34.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:33 smithi189 ceph-mon[34999]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:03:34.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 sudo[43454]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:03:34.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 sudo[43454]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:03:34.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 sudo[43454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:03:34.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 sudo[43454]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:03:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:33 smithi050 sudo[49517]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:03:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:33 smithi050 sudo[49517]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:03:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:33 smithi050 sudo[49517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:03:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:33 smithi050 sudo[49517]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:03:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:33 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:33 smithi050 ceph-mon[30354]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:03:34.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:33 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:34.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:33 smithi084 ceph-mon[34812]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:03:34.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 sudo[43457]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:03:34.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 sudo[43457]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:03:34.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 sudo[43457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:03:34.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 sudo[43457]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:03:34.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 sudo[43010]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:03:34.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 sudo[43010]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:03:34.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 sudo[43010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:03:34.867 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 sudo[43010]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:03:35.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:35.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:03:35.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:03:35.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:03:35.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:03:35.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:03:35.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:03:35.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:03:35.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:03:35.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:03:35.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:03:35.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:03:35.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:03:35.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:03:35.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:34 smithi050 ceph-mon[30354]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:03:35.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:35.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:03:35.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:03:35.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:03:35.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:03:35.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:03:35.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:03:35.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:03:35.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:03:35.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:03:35.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:03:35.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:03:35.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:03:35.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:03:35.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:34 smithi189 ceph-mon[34999]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:03:35.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 sudo[43013]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:03:35.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 sudo[43013]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:03:35.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 sudo[43013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:03:35.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 sudo[43013]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:03:35.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:35.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:03:35.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:03:35.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:03:35.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:03:35.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:03:35.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:03:35.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:03:35.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:03:35.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:03:35.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:03:35.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:03:35.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:03:35.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:03:35.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:34 smithi084 ceph-mon[34812]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:03:36.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:35 smithi050 ceph-mon[30354]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:36.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:35 smithi189 ceph-mon[34999]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:36.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:35 smithi084 ceph-mon[34812]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:38.172 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:37 smithi050 ceph-mon[30354]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:38.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:37 smithi189 ceph-mon[34999]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:38.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:37 smithi084 ceph-mon[34812]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:39.940 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:39 smithi050 ceph-mon[30354]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-10T10:03:40.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:39 smithi189 ceph-mon[34999]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-10T10:03:40.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:39 smithi084 ceph-mon[34812]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-10T10:03:41.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:41 smithi050 ceph-mon[30354]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-10T10:03:41.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T10:03:41.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:41.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:41 smithi050 ceph-mon[30354]: Deploying daemon osd.3 on smithi050 2024-09-10T10:03:42.156 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:41 smithi189 ceph-mon[34999]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-10T10:03:42.157 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T10:03:42.157 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:42.157 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:41 smithi189 ceph-mon[34999]: Deploying daemon osd.3 on smithi050 2024-09-10T10:03:42.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:41 smithi084 ceph-mon[34812]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-10T10:03:42.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:41 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T10:03:42.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:41 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:42.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:41 smithi084 ceph-mon[34812]: Deploying daemon osd.3 on smithi050 2024-09-10T10:03:44.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:43 smithi050 ceph-mon[30354]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-10T10:03:44.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:43 smithi189 ceph-mon[34999]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-10T10:03:44.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:43 smithi084 ceph-mon[34812]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-10T10:03:46.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:45 smithi050 ceph-mon[30354]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T10:03:46.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:45 smithi189 ceph-mon[34999]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T10:03:46.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:45 smithi084 ceph-mon[34812]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T10:03:48.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:47 smithi050 ceph-mon[30354]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T10:03:48.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:47 smithi189 ceph-mon[34999]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T10:03:48.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:47 smithi084 ceph-mon[34812]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T10:03:50.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:49 smithi050 ceph-mon[30354]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T10:03:50.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:49 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:50.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:49 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:50.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:49 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:50.324 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:49 smithi084 ceph-mon[34812]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T10:03:50.325 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:49 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:50.325 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:49 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:50.325 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:49 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:50.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:49 smithi189 ceph-mon[34999]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-10T10:03:50.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:49 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:50.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:49 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:50.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:49 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:51.928 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:51 smithi050 ceph-mon[30354]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:52.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:51 smithi189 ceph-mon[34999]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:52.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:51 smithi084 ceph-mon[34812]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:53.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:53 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:53.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:53 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:53.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:53 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:53.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:53 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:53.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:53 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:53.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:53 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:53.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:53 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:53.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:53 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:53.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:53 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:53.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:53 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:53.371 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:53 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:53.371 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:53 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:53.371 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:53 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:53.371 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:53 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:53.371 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:53 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:53.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:53.742+0000 7fbe29600640 1 -- 172.21.15.50:0/964111313 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbe2c062630 con 0x7fbe100a2ba0 2024-09-10T10:03:53.744 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 3 on host 'smithi050' 2024-09-10T10:03:53.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:53.744+0000 7fbe33000640 1 -- 172.21.15.50:0/964111313 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbe100a2ba0 msgr2=0x7fbe100a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:53.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:53.744+0000 7fbe33000640 1 --2- 172.21.15.50:0/964111313 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbe100a2ba0 0x7fbe100a5060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c19b640 tx=0x7fbe1400b390 comp rx=0 tx=0).stop 2024-09-10T10:03:53.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:53.744+0000 7fbe33000640 1 -- 172.21.15.50:0/964111313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c074c50 msgr2=0x7fbe2c19a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:53.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:53.744+0000 7fbe33000640 1 --2- 172.21.15.50:0/964111313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c074c50 0x7fbe2c19a120 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c031440 tx=0x7fbe1c032e20 comp rx=0 tx=0).stop 2024-09-10T10:03:53.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:53.745+0000 7fbe33000640 1 -- 172.21.15.50:0/964111313 shutdown_connections 2024-09-10T10:03:53.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:53.745+0000 7fbe33000640 1 --2- 172.21.15.50:0/964111313 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbe100a2ba0 0x7fbe100a5060 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:53.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:53.745+0000 7fbe33000640 1 --2- 172.21.15.50:0/964111313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe2c109a80 0x7fbe2c1a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:53.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:53.745+0000 7fbe33000640 1 --2- 172.21.15.50:0/964111313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbe2c076220 0x7fbe2c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:53.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:53.745+0000 7fbe33000640 1 --2- 172.21.15.50:0/964111313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe2c074c50 0x7fbe2c19a120 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:53.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:53.745+0000 7fbe33000640 1 -- 172.21.15.50:0/964111313 >> 172.21.15.50:0/964111313 conn(0x7fbe2c0fd390 msgr2=0x7fbe2c1059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:53.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:53.745+0000 7fbe33000640 1 -- 172.21.15.50:0/964111313 shutdown_connections 2024-09-10T10:03:53.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:03:53.745+0000 7fbe33000640 1 -- 172.21.15.50:0/964111313 wait complete. 2024-09-10T10:03:54.434 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:54 smithi050 ceph-mon[30354]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:54.434 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:54 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:54.434 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:54 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:54.434 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:54 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:54.470 DEBUG:teuthology.orchestra.run.smithi050:osd.3> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T10:03:54.474 INFO:tasks.cephadm:Deploying osd.4 on smithi084 with /dev/vg_nvme/lv_3... 2024-09-10T10:03:54.474 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T10:03:54.502 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:54 smithi084 ceph-mon[34812]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:54.502 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:54 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:54.503 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:54 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:54.503 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:54 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:54.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:54 smithi189 ceph-mon[34999]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:54.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:54 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:03:54.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:54 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:54.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:54 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:54.725 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:03:55.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:55 smithi050 ceph-mon[30354]: from='osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T10:03:55.465 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:03:54 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3[51127]: 2024-09-10T10:03:54.985+0000 7febecc2f640 -1 osd.3 0 log_to_monitors true 2024-09-10T10:03:55.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:55 smithi189 ceph-mon[34999]: from='osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T10:03:55.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:55 smithi084 ceph-mon[34812]: from='osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T10:03:56.224 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:56 smithi084 ceph-mon[34812]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:56.224 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:56 smithi084 ceph-mon[34812]: from='osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T10:03:56.225 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:56 smithi084 ceph-mon[34812]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T10:03:56.225 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:56 smithi084 ceph-mon[34812]: from='osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:03:56.225 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:56.328 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:56 smithi050 ceph-mon[30354]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:56.328 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:56 smithi050 ceph-mon[30354]: from='osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T10:03:56.328 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:56 smithi050 ceph-mon[30354]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T10:03:56.328 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:56 smithi050 ceph-mon[30354]: from='osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:03:56.328 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:56.329 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:03:56 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3[51127]: 2024-09-10T10:03:56.145+0000 7febe7400640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T10:03:56.329 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:03:56 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3[51127]: 2024-09-10T10:03:56.154+0000 7febe2400640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:03:56.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:56 smithi189 ceph-mon[34999]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:56.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:56 smithi189 ceph-mon[34999]: from='osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T10:03:56.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:56 smithi189 ceph-mon[34999]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T10:03:56.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:56 smithi189 ceph-mon[34999]: from='osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:03:56.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:57.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:57 smithi050 ceph-mon[30354]: from='osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-09-10T10:03:57.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:57 smithi050 ceph-mon[30354]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T10:03:57.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:57 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:57.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:57 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:57.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:57 smithi050 ceph-mon[30354]: osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052] boot 2024-09-10T10:03:57.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:57 smithi050 ceph-mon[30354]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T10:03:57.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:57 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:57.531 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:57 smithi084 ceph-mon[34812]: from='osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-09-10T10:03:57.531 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:57 smithi084 ceph-mon[34812]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T10:03:57.531 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:57 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:57.531 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:57 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:57.531 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:57 smithi084 ceph-mon[34812]: osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052] boot 2024-09-10T10:03:57.531 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:57 smithi084 ceph-mon[34812]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T10:03:57.531 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:57 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T10:03:57.561 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi084:vg_nvme/lv_3 2024-09-10T10:03:57.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:57 smithi189 ceph-mon[34999]: from='osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-09-10T10:03:57.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:57 smithi189 ceph-mon[34999]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T10:03:57.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:57 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:57.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:57 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:57.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:57 smithi189 ceph-mon[34999]: osd.3 [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052] boot 2024-09-10T10:03:57.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:57 smithi189 ceph-mon[34999]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T10:03:57.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:57 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:03:57.849 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:03:58.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.384+0000 7f927e731640 1 -- 172.21.15.84:0/3959118203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9278101cd0 msgr2=0x7f9278102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:58.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.384+0000 7f927e731640 1 --2- 172.21.15.84:0/3959118203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9278101cd0 0x7f9278102150 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9260009900 tx=0x7f926002a410 comp rx=0 tx=0).stop 2024-09-10T10:03:58.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.384+0000 7f927e731640 1 -- 172.21.15.84:0/3959118203 shutdown_connections 2024-09-10T10:03:58.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.384+0000 7f927e731640 1 --2- 172.21.15.84:0/3959118203 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9278102690 0x7f9278108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:58.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.384+0000 7f927e731640 1 --2- 172.21.15.84:0/3959118203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9278101cd0 0x7f9278102150 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.384+0000 7f927e731640 1 --2- 172.21.15.84:0/3959118203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278100ad0 0x7f9278100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.384+0000 7f927e731640 1 -- 172.21.15.84:0/3959118203 >> 172.21.15.84:0/3959118203 conn(0x7f92780fc280 msgr2=0x7f92780fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:03:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.384+0000 7f927e731640 1 -- 172.21.15.84:0/3959118203 shutdown_connections 2024-09-10T10:03:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.384+0000 7f927e731640 1 -- 172.21.15.84:0/3959118203 wait complete. 2024-09-10T10:03:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f927e731640 1 Processor -- start 2024-09-10T10:03:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f927e731640 1 -- start start 2024-09-10T10:03:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f927e731640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9278100ad0 0x7f927806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f927e731640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278101cd0 0x7f927819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f927e731640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9278102690 0x7f927819f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f927e731640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f927810c730 con 0x7f9278101cd0 2024-09-10T10:03:58.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f927e731640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f927810c5b0 con 0x7f9278102690 2024-09-10T10:03:58.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f927e731640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f927810c8b0 con 0x7f9278100ad0 2024-09-10T10:03:58.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f927ccce640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9278102690 0x7f927819f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:58.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f927ccce640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9278102690 0x7f927819f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50092/0 (socket says 172.21.15.84:50092) 2024-09-10T10:03:58.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f927ccce640 1 -- 172.21.15.84:0/256023000 learned_addr learned my addr 172.21.15.84:0/256023000 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T10:03:58.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f92777fe640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278101cd0 0x7f927819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:58.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f9277fff640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9278100ad0 0x7f927806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:58.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.385+0000 7f927ccce640 1 -- 172.21.15.84:0/256023000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9278100ad0 msgr2=0x7f927806ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:58.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.386+0000 7f927ccce640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9278100ad0 0x7f927806ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:58.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.386+0000 7f927ccce640 1 -- 172.21.15.84:0/256023000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278101cd0 msgr2=0x7f927819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:03:58.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.386+0000 7f927ccce640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278101cd0 0x7f927819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:03:58.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.386+0000 7f927ccce640 1 -- 172.21.15.84:0/256023000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927819fb40 con 0x7f9278102690 2024-09-10T10:03:58.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.386+0000 7f927ccce640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9278102690 0x7f927819f280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f927000cad0 tx=0x7f927000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:58.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.386+0000 7f92757fa640 1 -- 172.21.15.84:0/256023000 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927000ae20 con 0x7f9278102690 2024-09-10T10:03:58.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.386+0000 7f92757fa640 1 -- 172.21.15.84:0/256023000 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9270005020 con 0x7f9278102690 2024-09-10T10:03:58.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.386+0000 7f927e731640 1 -- 172.21.15.84:0/256023000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f927819fe30 con 0x7f9278102690 2024-09-10T10:03:58.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.386+0000 7f92757fa640 1 -- 172.21.15.84:0/256023000 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927000f6f0 con 0x7f9278102690 2024-09-10T10:03:58.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.386+0000 7f927e731640 1 -- 172.21.15.84:0/256023000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92781a0290 con 0x7f9278102690 2024-09-10T10:03:58.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.387+0000 7f927e731640 1 -- 172.21.15.84:0/256023000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9278107f90 con 0x7f9278102690 2024-09-10T10:03:58.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.388+0000 7f92757fa640 1 -- 172.21.15.84:0/256023000 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f92700051d0 con 0x7f9278102690 2024-09-10T10:03:58.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.389+0000 7f92757fa640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f92640a2b80 0x7f92640a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:03:58.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.389+0000 7f92757fa640 1 -- 172.21.15.84:0/256023000 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3698+0+0 (secure 0 0 0) 0x7f92700cdda0 con 0x7f9278102690 2024-09-10T10:03:58.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.389+0000 7f9277fff640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f92640a2b80 0x7f92640a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:03:58.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.390+0000 7f9277fff640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f92640a2b80 0x7f92640a5040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f927806b050 tx=0x7f926800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:03:58.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.393+0000 7f92757fa640 1 -- 172.21.15.84:0/256023000 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9270014030 con 0x7f9278102690 2024-09-10T10:03:58.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:03:58.634+0000 7f927e731640 1 -- 172.21.15.84:0/256023000 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9278062630 con 0x7f92640a2b80 2024-09-10T10:03:58.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:58 smithi050 ceph-mon[30354]: purged_snaps scrub starts 2024-09-10T10:03:58.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:58 smithi050 ceph-mon[30354]: purged_snaps scrub ok 2024-09-10T10:03:58.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:58 smithi050 ceph-mon[30354]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:58.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:58 smithi050 ceph-mon[30354]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T10:03:58.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:58.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:58.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:03:58.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:03:58.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:58.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:58.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:58.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:58 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:58.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:58 smithi189 ceph-mon[34999]: purged_snaps scrub starts 2024-09-10T10:03:58.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:58 smithi189 ceph-mon[34999]: purged_snaps scrub ok 2024-09-10T10:03:58.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:58 smithi189 ceph-mon[34999]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:58.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:58 smithi189 ceph-mon[34999]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T10:03:58.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:58.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:58.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:03:58.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:03:58.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:58.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:58.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:58.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:58 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:58.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:58 smithi084 ceph-mon[34812]: purged_snaps scrub starts 2024-09-10T10:03:58.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:58 smithi084 ceph-mon[34812]: purged_snaps scrub ok 2024-09-10T10:03:58.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:58 smithi084 ceph-mon[34812]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:03:58.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:58 smithi084 ceph-mon[34812]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T10:03:58.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:58.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:58.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:03:58.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:03:58.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:58.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:58.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:03:58.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:58 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:03:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:59 smithi050 ceph-mon[30354]: Detected new or changed devices on smithi050 2024-09-10T10:03:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:59 smithi050 ceph-mon[30354]: Adjusting osd_memory_target on smithi050 to 8547M 2024-09-10T10:03:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:59 smithi050 ceph-mon[30354]: osdmap e28: 4 total, 4 up, 4 in 2024-09-10T10:03:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:59 smithi050 ceph-mon[30354]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:03:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:03:59.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:03:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:59 smithi189 ceph-mon[34999]: Detected new or changed devices on smithi050 2024-09-10T10:03:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:59 smithi189 ceph-mon[34999]: Adjusting osd_memory_target on smithi050 to 8547M 2024-09-10T10:03:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:59 smithi189 ceph-mon[34999]: osdmap e28: 4 total, 4 up, 4 in 2024-09-10T10:03:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:59 smithi189 ceph-mon[34999]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:03:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:03:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:03:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:03:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:59 smithi084 ceph-mon[34812]: Detected new or changed devices on smithi050 2024-09-10T10:03:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:59 smithi084 ceph-mon[34812]: Adjusting osd_memory_target on smithi050 to 8547M 2024-09-10T10:03:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:59 smithi084 ceph-mon[34812]: osdmap e28: 4 total, 4 up, 4 in 2024-09-10T10:03:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:59 smithi084 ceph-mon[34812]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:03:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:03:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:03:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:03:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:00 smithi050 ceph-mon[30354]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:00 smithi050 ceph-mon[30354]: osdmap e29: 4 total, 4 up, 4 in 2024-09-10T10:04:00.803 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:00 smithi084 ceph-mon[34812]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:00.803 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:00 smithi084 ceph-mon[34812]: osdmap e29: 4 total, 4 up, 4 in 2024-09-10T10:04:00.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:00 smithi189 ceph-mon[34999]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:00.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:00 smithi189 ceph-mon[34999]: osdmap e29: 4 total, 4 up, 4 in 2024-09-10T10:04:01.709 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:01 smithi084 ceph-mon[34812]: osdmap e30: 4 total, 4 up, 4 in 2024-09-10T10:04:01.709 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:01 smithi084 ceph-mon[34812]: from='client.? 172.21.15.84:0/3634329936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e47aaa2b-af6f-495e-a0db-d15709cd9d39"}]: dispatch 2024-09-10T10:04:01.709 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:01 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e47aaa2b-af6f-495e-a0db-d15709cd9d39"}]: dispatch 2024-09-10T10:04:01.709 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:01 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e47aaa2b-af6f-495e-a0db-d15709cd9d39"}]': finished 2024-09-10T10:04:01.709 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:01 smithi084 ceph-mon[34812]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T10:04:01.709 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:01 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:01 smithi050 ceph-mon[30354]: osdmap e30: 4 total, 4 up, 4 in 2024-09-10T10:04:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:01 smithi050 ceph-mon[30354]: from='client.? 172.21.15.84:0/3634329936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e47aaa2b-af6f-495e-a0db-d15709cd9d39"}]: dispatch 2024-09-10T10:04:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:01 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e47aaa2b-af6f-495e-a0db-d15709cd9d39"}]: dispatch 2024-09-10T10:04:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:01 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e47aaa2b-af6f-495e-a0db-d15709cd9d39"}]': finished 2024-09-10T10:04:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:01 smithi050 ceph-mon[30354]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T10:04:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:01.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:01 smithi189 ceph-mon[34999]: osdmap e30: 4 total, 4 up, 4 in 2024-09-10T10:04:01.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:01 smithi189 ceph-mon[34999]: from='client.? 172.21.15.84:0/3634329936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e47aaa2b-af6f-495e-a0db-d15709cd9d39"}]: dispatch 2024-09-10T10:04:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:01 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e47aaa2b-af6f-495e-a0db-d15709cd9d39"}]: dispatch 2024-09-10T10:04:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:01 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e47aaa2b-af6f-495e-a0db-d15709cd9d39"}]': finished 2024-09-10T10:04:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:01 smithi189 ceph-mon[34999]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T10:04:01.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:01 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:02.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:02 smithi050 ceph-mon[30354]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:02.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:02 smithi050 ceph-mon[30354]: from='client.? 172.21.15.84:0/1126402088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:04:02.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:02 smithi189 ceph-mon[34999]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:02.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:02 smithi189 ceph-mon[34999]: from='client.? 172.21.15.84:0/1126402088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:04:02.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:02 smithi084 ceph-mon[34812]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:02.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:02 smithi084 ceph-mon[34812]: from='client.? 172.21.15.84:0/1126402088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:04:04.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:04 smithi189 ceph-mon[34999]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-10T10:04:04.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:04 smithi084 ceph-mon[34812]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-10T10:04:04.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:04 smithi050 ceph-mon[30354]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-10T10:04:06.732 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:06 smithi084 ceph-mon[34812]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:04:06.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:06 smithi189 ceph-mon[34999]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:04:06.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:06 smithi050 ceph-mon[30354]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:04:08.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:08 smithi084 ceph-mon[34812]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T10:04:08.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:08 smithi189 ceph-mon[34999]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T10:04:08.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:08 smithi050 ceph-mon[30354]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-10T10:04:10.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:10 smithi084 ceph-mon[34812]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T10:04:10.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T10:04:10.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:10.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:10 smithi084 ceph-mon[34812]: Deploying daemon osd.4 on smithi084 2024-09-10T10:04:10.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:10 smithi189 ceph-mon[34999]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T10:04:10.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T10:04:10.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:10.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:10 smithi189 ceph-mon[34999]: Deploying daemon osd.4 on smithi084 2024-09-10T10:04:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:10 smithi050 ceph-mon[30354]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T10:04:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T10:04:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:10 smithi050 ceph-mon[30354]: Deploying daemon osd.4 on smithi084 2024-09-10T10:04:12.761 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:12 smithi084 ceph-mon[34812]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:04:12.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:12 smithi189 ceph-mon[34999]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:04:12.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:12 smithi050 ceph-mon[30354]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:04:14.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:14 smithi189 ceph-mon[34999]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T10:04:14.846 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:14 smithi084 ceph-mon[34812]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T10:04:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:14 smithi050 ceph-mon[30354]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T10:04:16.748 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:16 smithi084 ceph-mon[34812]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:16.748 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:16 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:16.748 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:16 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:16.749 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:16 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:16.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:16 smithi189 ceph-mon[34999]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:16.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:16 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:16.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:16 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:16.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:16 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:16 smithi050 ceph-mon[30354]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:16 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:16 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:16 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:18.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:18 smithi084 ceph-mon[34812]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:18.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:18 smithi189 ceph-mon[34999]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:18.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:18 smithi050 ceph-mon[30354]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:04:19.889+0000 7f92757fa640 1 -- 172.21.15.84:0/256023000 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9278062630 con 0x7f92640a2b80 2024-09-10T10:04:19.891 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 4 on host 'smithi084' 2024-09-10T10:04:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:04:19.891+0000 7f927e731640 1 -- 172.21.15.84:0/256023000 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f92640a2b80 msgr2=0x7f92640a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:04:19.891+0000 7f927e731640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f92640a2b80 0x7f92640a5040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f927806b050 tx=0x7f926800b410 comp rx=0 tx=0).stop 2024-09-10T10:04:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:04:19.891+0000 7f927e731640 1 -- 172.21.15.84:0/256023000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9278102690 msgr2=0x7f927819f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:04:19.891+0000 7f927e731640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9278102690 0x7f927819f280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f927000cad0 tx=0x7f927000cf90 comp rx=0 tx=0).stop 2024-09-10T10:04:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:04:19.892+0000 7f927e731640 1 -- 172.21.15.84:0/256023000 shutdown_connections 2024-09-10T10:04:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:04:19.892+0000 7f927e731640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f92640a2b80 0x7f92640a5040 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:04:19.892+0000 7f927e731640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9278102690 0x7f927819f280 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:04:19.892+0000 7f927e731640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278101cd0 0x7f927819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:04:19.892+0000 7f927e731640 1 --2- 172.21.15.84:0/256023000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9278100ad0 0x7f927806ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:04:19.892+0000 7f927e731640 1 -- 172.21.15.84:0/256023000 >> 172.21.15.84:0/256023000 conn(0x7f92780fc280 msgr2=0x7f9278105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:04:19.892+0000 7f927e731640 1 -- 172.21.15.84:0/256023000 shutdown_connections 2024-09-10T10:04:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:04:19.892+0000 7f927e731640 1 -- 172.21.15.84:0/256023000 wait complete. 2024-09-10T10:04:20.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:20 smithi084 ceph-mon[34812]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:20.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:20 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:20 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:20 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:20.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:20 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:20.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:20 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:20 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:20.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:20 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:20 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:20 smithi189 ceph-mon[34999]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:20 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:20 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:20 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:20 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:20 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:20 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:20 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:20 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:20 smithi050 ceph-mon[30354]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:20.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:20 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:20 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:20 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:20.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:20 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:20.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:20 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:20 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:20.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:20 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:20 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:20.595 DEBUG:teuthology.orchestra.run.smithi084:osd.4> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T10:04:20.597 INFO:tasks.cephadm:Deploying osd.5 on smithi189 with /dev/vg_nvme/lv_3... 2024-09-10T10:04:20.597 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T10:04:20.851 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:04:22.016 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:04:21 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4[45745]: 2024-09-10T10:04:21.719+0000 7f2f222be640 -1 osd.4 0 log_to_monitors true 2024-09-10T10:04:22.261 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:22 smithi189 ceph-mon[34999]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:22.262 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:22 smithi189 ceph-mon[34999]: from='osd.4 [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:04:22.262 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:22 smithi189 ceph-mon[34999]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:04:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:22 smithi084 ceph-mon[34812]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:22 smithi084 ceph-mon[34812]: from='osd.4 [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:04:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:22 smithi084 ceph-mon[34812]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:04:22.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:22 smithi050 ceph-mon[30354]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:22.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:22 smithi050 ceph-mon[30354]: from='osd.4 [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:04:22.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:22 smithi050 ceph-mon[30354]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:04:23.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:23 smithi084 ceph-mon[34812]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T10:04:23.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:23 smithi084 ceph-mon[34812]: osdmap e32: 5 total, 4 up, 5 in 2024-09-10T10:04:23.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:23 smithi084 ceph-mon[34812]: from='osd.4 [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:04:23.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:23 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:23.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:23 smithi084 ceph-mon[34812]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:04:23.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:23 smithi084 ceph-mon[34812]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-10T10:04:23.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:23 smithi189 ceph-mon[34999]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T10:04:23.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:23 smithi189 ceph-mon[34999]: osdmap e32: 5 total, 4 up, 5 in 2024-09-10T10:04:23.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:23 smithi189 ceph-mon[34999]: from='osd.4 [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:04:23.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:23 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:23.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:23 smithi189 ceph-mon[34999]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:04:23.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:23 smithi189 ceph-mon[34999]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-10T10:04:23.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:23 smithi050 ceph-mon[30354]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T10:04:23.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:23 smithi050 ceph-mon[30354]: osdmap e32: 5 total, 4 up, 5 in 2024-09-10T10:04:23.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:23 smithi050 ceph-mon[30354]: from='osd.4 [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:04:23.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:23 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:23.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:23 smithi050 ceph-mon[30354]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:04:23.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:23 smithi050 ceph-mon[30354]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-10T10:04:23.512 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T10:04:23.522 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:04:23 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4[45745]: 2024-09-10T10:04:23.407+0000 7f2f1ea55640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T10:04:23.523 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:04:23 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4[45745]: 2024-09-10T10:04:23.412+0000 7f2f16061640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:04:23.539 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_3 2024-09-10T10:04:23.792 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:04:24.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:24.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: osdmap e33: 5 total, 4 up, 5 in 2024-09-10T10:04:24.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:24.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:24.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: from='osd.4 ' entity='osd.4' 2024-09-10T10:04:24.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: Detected new or changed devices on smithi084 2024-09-10T10:04:24.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:24.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:24.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:24.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:24.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: Adjusting osd_memory_target on smithi084 to 8544M 2024-09-10T10:04:24.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:24.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:24.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:24.083 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:24.304 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.287+0000 7ffb5ff19640 1 -- 172.21.15.189:0/2496262429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb58100ad0 msgr2=0x7ffb58100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:24.304 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.287+0000 7ffb5ff19640 1 --2- 172.21.15.189:0/2496262429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb58100ad0 0x7ffb58100ed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009900 tx=0x7ffb5402a410 comp rx=0 tx=0).stop 2024-09-10T10:04:24.304 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.287+0000 7ffb5ff19640 1 -- 172.21.15.189:0/2496262429 shutdown_connections 2024-09-10T10:04:24.304 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.287+0000 7ffb5ff19640 1 --2- 172.21.15.189:0/2496262429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb58102690 0x7ffb58108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:24.304 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.287+0000 7ffb5ff19640 1 --2- 172.21.15.189:0/2496262429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb58101cd0 0x7ffb58102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:24.304 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.287+0000 7ffb5ff19640 1 --2- 172.21.15.189:0/2496262429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb58100ad0 0x7ffb58100ed0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:24.304 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.287+0000 7ffb5ff19640 1 -- 172.21.15.189:0/2496262429 >> 172.21.15.189:0/2496262429 conn(0x7ffb580fc280 msgr2=0x7ffb580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:24.304 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.287+0000 7ffb5ff19640 1 -- 172.21.15.189:0/2496262429 shutdown_connections 2024-09-10T10:04:24.305 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.287+0000 7ffb5ff19640 1 -- 172.21.15.189:0/2496262429 wait complete. 2024-09-10T10:04:24.305 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5ff19640 1 Processor -- start 2024-09-10T10:04:24.305 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5ff19640 1 -- start start 2024-09-10T10:04:24.305 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5ff19640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb58100ad0 0x7ffb58196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:24.305 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5ff19640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb58101cd0 0x7ffb581972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:24.305 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5ff19640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb58102690 0x7ffb5819e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:24.305 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5ff19640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5810c730 con 0x7ffb58101cd0 2024-09-10T10:04:24.305 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5ff19640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5810c5b0 con 0x7ffb58102690 2024-09-10T10:04:24.305 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5ff19640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5810c8b0 con 0x7ffb58100ad0 2024-09-10T10:04:24.305 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5dcb5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb58100ad0 0x7ffb58196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:24.305 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5dcb5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb58100ad0 0x7ffb58196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:54996/0 (socket says 172.21.15.189:54996) 2024-09-10T10:04:24.306 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5dcb5640 1 -- 172.21.15.189:0/3465655121 learned_addr learned my addr 172.21.15.189:0/3465655121 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T10:04:24.306 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5e4b6640 1 --2- 172.21.15.189:0/3465655121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb58102690 0x7ffb5819e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:24.306 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5dcb5640 1 -- 172.21.15.189:0/3465655121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb58102690 msgr2=0x7ffb5819e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:24.306 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5dcb5640 1 --2- 172.21.15.189:0/3465655121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb58102690 0x7ffb5819e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:24.306 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5dcb5640 1 -- 172.21.15.189:0/3465655121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb58101cd0 msgr2=0x7ffb581972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:24.306 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5dcb5640 1 --2- 172.21.15.189:0/3465655121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb58101cd0 0x7ffb581972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:24.306 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.288+0000 7ffb5dcb5640 1 -- 172.21.15.189:0/3465655121 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5819e9c0 con 0x7ffb58100ad0 2024-09-10T10:04:24.306 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.289+0000 7ffb5dcb5640 1 --2- 172.21.15.189:0/3465655121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb58100ad0 0x7ffb58196da0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffb54031610 tx=0x7ffb540043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:24.306 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.289+0000 7ffb4effd640 1 -- 172.21.15.189:0/3465655121 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5403f030 con 0x7ffb58100ad0 2024-09-10T10:04:24.306 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.289+0000 7ffb5ff19640 1 -- 172.21.15.189:0/3465655121 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5819ec50 con 0x7ffb58100ad0 2024-09-10T10:04:24.306 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.289+0000 7ffb4effd640 1 -- 172.21.15.189:0/3465655121 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb54003ce0 con 0x7ffb58100ad0 2024-09-10T10:04:24.306 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.289+0000 7ffb4effd640 1 -- 172.21.15.189:0/3465655121 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb54035070 con 0x7ffb58100ad0 2024-09-10T10:04:24.307 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.289+0000 7ffb5ff19640 1 -- 172.21.15.189:0/3465655121 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb58069f70 con 0x7ffb58100ad0 2024-09-10T10:04:24.307 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.290+0000 7ffb5ff19640 1 -- 172.21.15.189:0/3465655121 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5806a930 con 0x7ffb58100ad0 2024-09-10T10:04:24.307 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.291+0000 7ffb4effd640 1 -- 172.21.15.189:0/3465655121 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ffb54042030 con 0x7ffb58100ad0 2024-09-10T10:04:24.307 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.292+0000 7ffb4effd640 1 --2- 172.21.15.189:0/3465655121 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffb440a4e10 0x7ffb440a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:24.307 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.292+0000 7ffb4effd640 1 -- 172.21.15.189:0/3465655121 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3821+0+0 (secure 0 0 0) 0x7ffb540ee7b0 con 0x7ffb58100ad0 2024-09-10T10:04:24.307 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.292+0000 7ffb5d4b4640 1 --2- 172.21.15.189:0/3465655121 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffb440a4e10 0x7ffb440a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:24.307 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.293+0000 7ffb5d4b4640 1 --2- 172.21.15.189:0/3465655121 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffb440a4e10 0x7ffb440a72d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800a8f0 tx=0x7ffb48005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:24.307 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.299+0000 7ffb4effd640 1 -- 172.21.15.189:0/3465655121 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb540bc8a0 con 0x7ffb58100ad0 2024-09-10T10:04:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: osdmap e33: 5 total, 4 up, 5 in 2024-09-10T10:04:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: from='osd.4 ' entity='osd.4' 2024-09-10T10:04:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: Detected new or changed devices on smithi084 2024-09-10T10:04:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:24.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:24.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:24.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: Adjusting osd_memory_target on smithi084 to 8544M 2024-09-10T10:04:24.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:24.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:24.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:24.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:24.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:24.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: osdmap e33: 5 total, 4 up, 5 in 2024-09-10T10:04:24.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:24.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:24.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: from='osd.4 ' entity='osd.4' 2024-09-10T10:04:24.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: Detected new or changed devices on smithi084 2024-09-10T10:04:24.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:24.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:24.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:24.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:24.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: Adjusting osd_memory_target on smithi084 to 8544M 2024-09-10T10:04:24.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:24.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:24.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:24.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:24.483 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:24.481+0000 7ffb5ff19640 1 -- 172.21.15.189:0/3465655121 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ffb581079d0 con 0x7ffb440a4e10 2024-09-10T10:04:25.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:25 smithi189 ceph-mon[34999]: purged_snaps scrub starts 2024-09-10T10:04:25.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:25 smithi189 ceph-mon[34999]: purged_snaps scrub ok 2024-09-10T10:04:25.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:25 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:25.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:25 smithi189 ceph-mon[34999]: osd.4 [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029] boot 2024-09-10T10:04:25.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:25 smithi189 ceph-mon[34999]: osdmap e34: 5 total, 5 up, 5 in 2024-09-10T10:04:25.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:25 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:25.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:25 smithi189 ceph-mon[34999]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:25.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:25 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:04:25.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:25 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:04:25.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:25 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:25.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:25 smithi084 ceph-mon[34812]: purged_snaps scrub starts 2024-09-10T10:04:25.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:25 smithi084 ceph-mon[34812]: purged_snaps scrub ok 2024-09-10T10:04:25.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:25 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:25.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:25 smithi084 ceph-mon[34812]: osd.4 [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029] boot 2024-09-10T10:04:25.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:25 smithi084 ceph-mon[34812]: osdmap e34: 5 total, 5 up, 5 in 2024-09-10T10:04:25.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:25 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:25.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:25 smithi084 ceph-mon[34812]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:25.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:25 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:04:25.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:25 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:04:25.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:25 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:25.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:25 smithi050 ceph-mon[30354]: purged_snaps scrub starts 2024-09-10T10:04:25.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:25 smithi050 ceph-mon[30354]: purged_snaps scrub ok 2024-09-10T10:04:25.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:25 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:25.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:25 smithi050 ceph-mon[30354]: osd.4 [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029] boot 2024-09-10T10:04:25.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:25 smithi050 ceph-mon[30354]: osdmap e34: 5 total, 5 up, 5 in 2024-09-10T10:04:25.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:25 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:04:25.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:25 smithi050 ceph-mon[30354]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:25.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:25 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:04:25.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:25 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:04:25.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:25 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:26.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:26 smithi189 ceph-mon[34999]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:26.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:26 smithi189 ceph-mon[34999]: osdmap e35: 5 total, 5 up, 5 in 2024-09-10T10:04:26.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:26 smithi050 ceph-mon[30354]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:26.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:26 smithi050 ceph-mon[30354]: osdmap e35: 5 total, 5 up, 5 in 2024-09-10T10:04:26.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:26 smithi084 ceph-mon[34812]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:04:26.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:26 smithi084 ceph-mon[34812]: osdmap e35: 5 total, 5 up, 5 in 2024-09-10T10:04:27.579 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:27 smithi189 ceph-mon[34999]: from='client.? 172.21.15.189:0/2508960844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8272a0aa-9784-4815-87cc-971b69d9fafd"}]: dispatch 2024-09-10T10:04:27.579 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:27 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8272a0aa-9784-4815-87cc-971b69d9fafd"}]: dispatch 2024-09-10T10:04:27.579 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:27 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8272a0aa-9784-4815-87cc-971b69d9fafd"}]': finished 2024-09-10T10:04:27.579 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:27 smithi189 ceph-mon[34999]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T10:04:27.579 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:27 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:27.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:27 smithi050 ceph-mon[30354]: from='client.? 172.21.15.189:0/2508960844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8272a0aa-9784-4815-87cc-971b69d9fafd"}]: dispatch 2024-09-10T10:04:27.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:27 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8272a0aa-9784-4815-87cc-971b69d9fafd"}]: dispatch 2024-09-10T10:04:27.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:27 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8272a0aa-9784-4815-87cc-971b69d9fafd"}]': finished 2024-09-10T10:04:27.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:27 smithi050 ceph-mon[30354]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T10:04:27.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:27 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:27.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:27 smithi084 ceph-mon[34812]: from='client.? 172.21.15.189:0/2508960844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8272a0aa-9784-4815-87cc-971b69d9fafd"}]: dispatch 2024-09-10T10:04:27.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:27 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8272a0aa-9784-4815-87cc-971b69d9fafd"}]: dispatch 2024-09-10T10:04:27.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:27 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8272a0aa-9784-4815-87cc-971b69d9fafd"}]': finished 2024-09-10T10:04:27.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:27 smithi084 ceph-mon[34812]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T10:04:27.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:27 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:28.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:28 smithi050 ceph-mon[30354]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:28.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:28 smithi050 ceph-mon[30354]: from='client.? 172.21.15.189:0/1516358557' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:04:28.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:28 smithi189 ceph-mon[34999]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:28.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:28 smithi189 ceph-mon[34999]: from='client.? 172.21.15.189:0/1516358557' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:04:28.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:28 smithi084 ceph-mon[34812]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:28.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:28 smithi084 ceph-mon[34812]: from='client.? 172.21.15.189:0/1516358557' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:04:30.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:30 smithi050 ceph-mon[30354]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:30.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:30 smithi189 ceph-mon[34999]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:30.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:30 smithi084 ceph-mon[34812]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:32.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:32 smithi050 ceph-mon[30354]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:32.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:32 smithi189 ceph-mon[34999]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:32.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:32 smithi084 ceph-mon[34812]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:34.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:34 smithi189 ceph-mon[34999]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:34.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:34 smithi050 ceph-mon[30354]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:34.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:34 smithi084 ceph-mon[34812]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:36.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:36 smithi189 ceph-mon[34999]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:36.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:04:36.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:36.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:36 smithi189 ceph-mon[34999]: Deploying daemon osd.5 on smithi189 2024-09-10T10:04:36.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:36 smithi050 ceph-mon[30354]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:36.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:04:36.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:36.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:36 smithi050 ceph-mon[30354]: Deploying daemon osd.5 on smithi189 2024-09-10T10:04:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:36 smithi084 ceph-mon[34812]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:04:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:36 smithi084 ceph-mon[34812]: Deploying daemon osd.5 on smithi189 2024-09-10T10:04:38.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:38 smithi189 ceph-mon[34999]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:38.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:38 smithi050 ceph-mon[30354]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:38.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:38 smithi084 ceph-mon[34812]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:40.710 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:40 smithi189 ceph-mon[34999]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:40.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:40 smithi050 ceph-mon[30354]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:40.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:40 smithi084 ceph-mon[34812]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:42 smithi189 ceph-mon[34999]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:42 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:42 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:42 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:42.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:42 smithi050 ceph-mon[30354]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:42.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:42 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:42.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:42 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:42.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:42 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:42.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:42 smithi084 ceph-mon[34812]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:42.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:42 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:42.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:42 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:42.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:42 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:44.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:44 smithi050 ceph-mon[30354]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:44.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:44 smithi189 ceph-mon[34999]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:44.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:44 smithi084 ceph-mon[34812]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:46.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:45 smithi189 ceph-mon[34999]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:46.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:45 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:46.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:45 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:46.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:45 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:46.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:45 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:46.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:45 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:46.151 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:46.149+0000 7ffb4effd640 1 -- 172.21.15.189:0/3465655121 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ffb581079d0 con 0x7ffb440a4e10 2024-09-10T10:04:46.151 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 5 on host 'smithi189' 2024-09-10T10:04:46.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:46.151+0000 7ffb5ff19640 1 -- 172.21.15.189:0/3465655121 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffb440a4e10 msgr2=0x7ffb440a72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:46.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:46.151+0000 7ffb5ff19640 1 --2- 172.21.15.189:0/3465655121 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffb440a4e10 0x7ffb440a72d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800a8f0 tx=0x7ffb48005bf0 comp rx=0 tx=0).stop 2024-09-10T10:04:46.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:46.152+0000 7ffb5ff19640 1 -- 172.21.15.189:0/3465655121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb58100ad0 msgr2=0x7ffb58196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:46.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:46.152+0000 7ffb5ff19640 1 --2- 172.21.15.189:0/3465655121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb58100ad0 0x7ffb58196da0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffb54031610 tx=0x7ffb540043b0 comp rx=0 tx=0).stop 2024-09-10T10:04:46.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:46.152+0000 7ffb5ff19640 1 -- 172.21.15.189:0/3465655121 shutdown_connections 2024-09-10T10:04:46.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:46.152+0000 7ffb5ff19640 1 --2- 172.21.15.189:0/3465655121 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffb440a4e10 0x7ffb440a72d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:46.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:46.152+0000 7ffb5ff19640 1 --2- 172.21.15.189:0/3465655121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb58102690 0x7ffb5819e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:46.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:46.152+0000 7ffb5ff19640 1 --2- 172.21.15.189:0/3465655121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb58101cd0 0x7ffb581972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:46.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:46.152+0000 7ffb5ff19640 1 --2- 172.21.15.189:0/3465655121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb58100ad0 0x7ffb58196da0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:46.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:46.152+0000 7ffb5ff19640 1 -- 172.21.15.189:0/3465655121 >> 172.21.15.189:0/3465655121 conn(0x7ffb580fc280 msgr2=0x7ffb58105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:46.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:46.152+0000 7ffb5ff19640 1 -- 172.21.15.189:0/3465655121 shutdown_connections 2024-09-10T10:04:46.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:04:46.152+0000 7ffb5ff19640 1 -- 172.21.15.189:0/3465655121 wait complete. 2024-09-10T10:04:46.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:45 smithi050 ceph-mon[30354]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:46.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:45 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:46.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:45 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:46.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:45 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:46.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:45 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:46.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:45 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:46.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:45 smithi084 ceph-mon[34812]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:46.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:46.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:46.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:46.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:46.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:46.856 DEBUG:teuthology.orchestra.run.smithi189:osd.5> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T10:04:46.858 INFO:tasks.cephadm:Deploying osd.6 on smithi050 with /dev/vg_nvme/lv_2... 2024-09-10T10:04:46.858 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T10:04:47.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:47.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:47.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:47.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:47.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:47.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:47.241 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:04:47.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:04:47.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:47.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:48.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:48 smithi050 ceph-mon[30354]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:48.273 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:48 smithi189 ceph-mon[34999]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:48.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:04:48 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:04:48.342+0000 7f8fcea44640 -1 osd.5 0 log_to_monitors true 2024-09-10T10:04:48.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:48 smithi084 ceph-mon[34812]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:49.253 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:49 smithi050 ceph-mon[30354]: from='osd.5 [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:04:49.253 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:49 smithi050 ceph-mon[30354]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:04:49.319 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:49 smithi189 ceph-mon[34999]: from='osd.5 [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:04:49.319 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:49 smithi189 ceph-mon[34999]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:04:49.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:49 smithi084 ceph-mon[34812]: from='osd.5 [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:04:49.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:49 smithi084 ceph-mon[34812]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:04:50.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:50.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T10:04:50.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T10:04:50.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:50.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: from='osd.5 [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:04:50.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:04:50.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:50.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:50.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:50.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:50.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:50.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:50.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:50.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:50.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:50.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T10:04:50.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T10:04:50.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:50.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: from='osd.5 [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:04:50.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:04:50.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:50.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:50.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:50.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:50.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:50.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:50.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:50.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:50.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:50.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T10:04:50.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T10:04:50.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:50.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: from='osd.5 [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:04:50.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:04:50.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:50.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:50.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:50.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:04:50.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:50.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:50.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:04:50.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:04:50.835 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:04:50.545+0000 7f8fcb1db640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T10:04:50.836 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:04:50 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:04:50.551+0000 7f8fc27e7640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:04:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:04:50.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_2 2024-09-10T10:04:51.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:51 smithi050 ceph-mon[30354]: Detected new or changed devices on smithi189 2024-09-10T10:04:51.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:51 smithi050 ceph-mon[30354]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-10T10:04:51.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:51 smithi050 ceph-mon[30354]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T10:04:51.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:51 smithi050 ceph-mon[30354]: osdmap e38: 6 total, 5 up, 6 in 2024-09-10T10:04:51.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:51 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:51.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:51 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:51.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:51 smithi050 ceph-mon[30354]: from='osd.5 ' entity='osd.5' 2024-09-10T10:04:51.367 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:04:51.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:51 smithi189 ceph-mon[34999]: Detected new or changed devices on smithi189 2024-09-10T10:04:51.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:51 smithi189 ceph-mon[34999]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-10T10:04:51.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:51 smithi189 ceph-mon[34999]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T10:04:51.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:51 smithi189 ceph-mon[34999]: osdmap e38: 6 total, 5 up, 6 in 2024-09-10T10:04:51.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:51 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:51.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:51 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:51.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:51 smithi189 ceph-mon[34999]: from='osd.5 ' entity='osd.5' 2024-09-10T10:04:51.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:51 smithi084 ceph-mon[34812]: Detected new or changed devices on smithi189 2024-09-10T10:04:51.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:51 smithi084 ceph-mon[34812]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-10T10:04:51.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:51 smithi084 ceph-mon[34812]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T10:04:51.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:51 smithi084 ceph-mon[34812]: osdmap e38: 6 total, 5 up, 6 in 2024-09-10T10:04:51.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:51 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:51.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:51 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:51.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:51 smithi084 ceph-mon[34812]: from='osd.5 ' entity='osd.5' 2024-09-10T10:04:51.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.951+0000 7f2d76400640 1 -- 172.21.15.50:0/1808205093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d70103e00 msgr2=0x7f2d70104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.951+0000 7f2d76400640 1 --2- 172.21.15.50:0/1808205093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d70103e00 0x7f2d70104200 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009900 tx=0x7f2d6002a410 comp rx=0 tx=0).stop 2024-09-10T10:04:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.951+0000 7f2d76400640 1 -- 172.21.15.50:0/1808205093 shutdown_connections 2024-09-10T10:04:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.951+0000 7f2d76400640 1 --2- 172.21.15.50:0/1808205093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d70105920 0x7f2d7010c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.951+0000 7f2d76400640 1 --2- 172.21.15.50:0/1808205093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d70104f60 0x7f2d701053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.951+0000 7f2d76400640 1 --2- 172.21.15.50:0/1808205093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d70103e00 0x7f2d70104200 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.951+0000 7f2d76400640 1 -- 172.21.15.50:0/1808205093 >> 172.21.15.50:0/1808205093 conn(0x7f2d700ff5b0 msgr2=0x7f2d701019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:04:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.951+0000 7f2d76400640 1 -- 172.21.15.50:0/1808205093 shutdown_connections 2024-09-10T10:04:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.951+0000 7f2d76400640 1 -- 172.21.15.50:0/1808205093 wait complete. 2024-09-10T10:04:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.952+0000 7f2d76400640 1 Processor -- start 2024-09-10T10:04:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.952+0000 7f2d76400640 1 -- start start 2024-09-10T10:04:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.952+0000 7f2d76400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d70103e00 0x7f2d7019a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:51.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.952+0000 7f2d76400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d70104f60 0x7f2d7019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.952+0000 7f2d76400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d70105920 0x7f2d701a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.952+0000 7f2d76400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7010fae0 con 0x7f2d70105920 2024-09-10T10:04:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.952+0000 7f2d76400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7010f960 con 0x7f2d70103e00 2024-09-10T10:04:51.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.952+0000 7f2d76400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7010fc60 con 0x7f2d70104f60 2024-09-10T10:04:51.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.953+0000 7f2d6fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d70105920 0x7f2d701a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:51.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.953+0000 7f2d6fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d70105920 0x7f2d701a1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33520/0 (socket says 172.21.15.50:33520) 2024-09-10T10:04:51.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.953+0000 7f2d6fe00640 1 -- 172.21.15.50:0/2962999970 learned_addr learned my addr 172.21.15.50:0/2962999970 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:04:51.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.953+0000 7f2d6f400640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d70103e00 0x7f2d7019a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.953+0000 7f2d67e00640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d70104f60 0x7f2d7019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.953+0000 7f2d6fe00640 1 -- 172.21.15.50:0/2962999970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d70104f60 msgr2=0x7f2d7019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.953+0000 7f2d6fe00640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d70104f60 0x7f2d7019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.953+0000 7f2d6fe00640 1 -- 172.21.15.50:0/2962999970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d70103e00 msgr2=0x7f2d7019a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:04:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.953+0000 7f2d6fe00640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d70103e00 0x7f2d7019a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:04:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.953+0000 7f2d6fe00640 1 -- 172.21.15.50:0/2962999970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d701a1cd0 con 0x7f2d70105920 2024-09-10T10:04:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.953+0000 7f2d6fe00640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d70105920 0x7f2d701a1660 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800eb10 tx=0x7f2d6800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.954+0000 7f2d6cc00640 1 -- 172.21.15.50:0/2962999970 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68004b20 con 0x7f2d70105920 2024-09-10T10:04:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.954+0000 7f2d6cc00640 1 -- 172.21.15.50:0/2962999970 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d68004cc0 con 0x7f2d70105920 2024-09-10T10:04:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.954+0000 7f2d6cc00640 1 -- 172.21.15.50:0/2962999970 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68010760 con 0x7f2d70105920 2024-09-10T10:04:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.954+0000 7f2d76400640 1 -- 172.21.15.50:0/2962999970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d701a1fc0 con 0x7f2d70105920 2024-09-10T10:04:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.954+0000 7f2d76400640 1 -- 172.21.15.50:0/2962999970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d701a2420 con 0x7f2d70105920 2024-09-10T10:04:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.955+0000 7f2d76400640 1 -- 172.21.15.50:0/2962999970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d7010b1a0 con 0x7f2d70105920 2024-09-10T10:04:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.957+0000 7f2d6cc00640 1 -- 172.21.15.50:0/2962999970 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2d68005020 con 0x7f2d70105920 2024-09-10T10:04:51.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.958+0000 7f2d6cc00640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2d540a2c30 0x7f2d540a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:04:51.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.958+0000 7f2d6cc00640 1 -- 172.21.15.50:0/2962999970 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4562+0+0 (secure 0 0 0) 0x7f2d680ce720 con 0x7f2d70105920 2024-09-10T10:04:51.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.958+0000 7f2d6f400640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2d540a2c30 0x7f2d540a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:04:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.959+0000 7f2d6f400640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2d540a2c30 0x7f2d540a50f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2d60031440 tx=0x7f2d600315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:04:51.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:51.963+0000 7f2d6cc00640 1 -- 172.21.15.50:0/2962999970 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d6809c480 con 0x7f2d70105920 2024-09-10T10:04:52.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:04:52.157+0000 7f2d76400640 1 -- 172.21.15.50:0/2962999970 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2d70062630 con 0x7f2d540a2c30 2024-09-10T10:04:52.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:52 smithi050 ceph-mon[30354]: purged_snaps scrub starts 2024-09-10T10:04:52.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:52 smithi050 ceph-mon[30354]: purged_snaps scrub ok 2024-09-10T10:04:52.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:52 smithi050 ceph-mon[30354]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:52.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:52 smithi050 ceph-mon[30354]: osd.5 [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386] boot 2024-09-10T10:04:52.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:52 smithi050 ceph-mon[30354]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T10:04:52.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:52.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:52 smithi050 ceph-mon[30354]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T10:04:52.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:04:52.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:04:52.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:52.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:52 smithi189 ceph-mon[34999]: purged_snaps scrub starts 2024-09-10T10:04:52.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:52 smithi189 ceph-mon[34999]: purged_snaps scrub ok 2024-09-10T10:04:52.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:52 smithi189 ceph-mon[34999]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:52.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:52 smithi189 ceph-mon[34999]: osd.5 [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386] boot 2024-09-10T10:04:52.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:52 smithi189 ceph-mon[34999]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T10:04:52.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:52.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:52 smithi189 ceph-mon[34999]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T10:04:52.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:04:52.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:04:52.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:52.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:52 smithi084 ceph-mon[34812]: purged_snaps scrub starts 2024-09-10T10:04:52.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:52 smithi084 ceph-mon[34812]: purged_snaps scrub ok 2024-09-10T10:04:52.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:52 smithi084 ceph-mon[34812]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:04:52.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:52 smithi084 ceph-mon[34812]: osd.5 [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386] boot 2024-09-10T10:04:52.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:52 smithi084 ceph-mon[34812]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T10:04:52.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:04:52.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:52 smithi084 ceph-mon[34812]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T10:04:52.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:04:52.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:04:52.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:04:53.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:53 smithi050 ceph-mon[30354]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:53.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:53 smithi050 ceph-mon[30354]: osdmap e41: 6 total, 6 up, 6 in 2024-09-10T10:04:53.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:53 smithi189 ceph-mon[34999]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:53.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:53 smithi189 ceph-mon[34999]: osdmap e41: 6 total, 6 up, 6 in 2024-09-10T10:04:53.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:53 smithi084 ceph-mon[34812]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:04:53.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:53 smithi084 ceph-mon[34812]: osdmap e41: 6 total, 6 up, 6 in 2024-09-10T10:04:54.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:54 smithi050 ceph-mon[30354]: pgmap v148: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T10:04:54.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:54 smithi050 ceph-mon[30354]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-10T10:04:54.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:54 smithi050 ceph-mon[30354]: osdmap e42: 6 total, 6 up, 6 in 2024-09-10T10:04:54.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:54 smithi189 ceph-mon[34999]: pgmap v148: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T10:04:54.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:54 smithi189 ceph-mon[34999]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-10T10:04:54.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:54 smithi189 ceph-mon[34999]: osdmap e42: 6 total, 6 up, 6 in 2024-09-10T10:04:54.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:54 smithi084 ceph-mon[34812]: pgmap v148: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T10:04:54.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:54 smithi084 ceph-mon[34812]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-10T10:04:54.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:54 smithi084 ceph-mon[34812]: osdmap e42: 6 total, 6 up, 6 in 2024-09-10T10:04:55.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:55 smithi050 ceph-mon[30354]: osdmap e43: 6 total, 6 up, 6 in 2024-09-10T10:04:55.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:55 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3777822317' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "637fff8d-4b45-4311-871f-c367b574351f"}]: dispatch 2024-09-10T10:04:55.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:55 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3777822317' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "637fff8d-4b45-4311-871f-c367b574351f"}]': finished 2024-09-10T10:04:55.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:55 smithi050 ceph-mon[30354]: osdmap e44: 7 total, 6 up, 7 in 2024-09-10T10:04:55.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:55 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:04:55.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:55 smithi189 ceph-mon[34999]: osdmap e43: 6 total, 6 up, 6 in 2024-09-10T10:04:55.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:55 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3777822317' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "637fff8d-4b45-4311-871f-c367b574351f"}]: dispatch 2024-09-10T10:04:55.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:55 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3777822317' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "637fff8d-4b45-4311-871f-c367b574351f"}]': finished 2024-09-10T10:04:55.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:55 smithi189 ceph-mon[34999]: osdmap e44: 7 total, 6 up, 7 in 2024-09-10T10:04:55.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:55 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:04:55.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:55 smithi084 ceph-mon[34812]: osdmap e43: 6 total, 6 up, 6 in 2024-09-10T10:04:55.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:55 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3777822317' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "637fff8d-4b45-4311-871f-c367b574351f"}]: dispatch 2024-09-10T10:04:55.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:55 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3777822317' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "637fff8d-4b45-4311-871f-c367b574351f"}]': finished 2024-09-10T10:04:55.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:55 smithi084 ceph-mon[34812]: osdmap e44: 7 total, 6 up, 7 in 2024-09-10T10:04:55.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:55 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:04:56.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:56 smithi189 ceph-mon[34999]: pgmap v151: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T10:04:56.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:56 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4187932720' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:04:56.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:56 smithi084 ceph-mon[34812]: pgmap v151: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T10:04:56.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:56 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4187932720' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:04:56.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:56 smithi050 ceph-mon[30354]: pgmap v151: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T10:04:56.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:56 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4187932720' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:04:58.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:58 smithi189 ceph-mon[34999]: pgmap v153: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T10:04:58.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:58 smithi084 ceph-mon[34812]: pgmap v153: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T10:04:58.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:58 smithi050 ceph-mon[30354]: pgmap v153: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T10:04:59.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:59 smithi189 ceph-mon[34999]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-10T10:04:59.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:04:59 smithi189 ceph-mon[34999]: Cluster is now healthy 2024-09-10T10:04:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:59 smithi084 ceph-mon[34812]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-10T10:04:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:04:59 smithi084 ceph-mon[34812]: Cluster is now healthy 2024-09-10T10:04:59.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:59 smithi050 ceph-mon[30354]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-10T10:04:59.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:04:59 smithi050 ceph-mon[30354]: Cluster is now healthy 2024-09-10T10:05:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:00 smithi050 ceph-mon[30354]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:05:00.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:00 smithi189 ceph-mon[34999]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:05:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:00 smithi084 ceph-mon[34812]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:05:02.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:02 smithi189 ceph-mon[34999]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T10:05:02.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:02 smithi084 ceph-mon[34812]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T10:05:02.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:02 smithi050 ceph-mon[30354]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T10:05:04.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:04 smithi050 ceph-mon[30354]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T10:05:04.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:04 smithi189 ceph-mon[34999]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T10:05:04.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:04 smithi084 ceph-mon[34812]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T10:05:05.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T10:05:05.625 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:05.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T10:05:05.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:05.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T10:05:05.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:06 smithi050 ceph-mon[30354]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:05:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:06 smithi050 ceph-mon[30354]: Deploying daemon osd.6 on smithi050 2024-09-10T10:05:06.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:06 smithi189 ceph-mon[34999]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:05:06.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:06 smithi189 ceph-mon[34999]: Deploying daemon osd.6 on smithi050 2024-09-10T10:05:06.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:06 smithi084 ceph-mon[34812]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:05:06.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:06 smithi084 ceph-mon[34812]: Deploying daemon osd.6 on smithi050 2024-09-10T10:05:08.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:08 smithi050 ceph-mon[30354]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T10:05:08.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:08 smithi189 ceph-mon[34999]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T10:05:08.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:08 smithi084 ceph-mon[34812]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T10:05:10.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:10 smithi189 ceph-mon[34999]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:05:10.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:10 smithi084 ceph-mon[34812]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:05:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:10 smithi050 ceph-mon[30354]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:05:12.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:12 smithi050 ceph-mon[30354]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:12.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:12 smithi189 ceph-mon[34999]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:12.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:12 smithi084 ceph-mon[34812]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:13.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:13.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:13.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:13.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:13.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:13.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:13.856 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:13.856 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:13.856 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:14.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:14 smithi050 ceph-mon[30354]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:14.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:14 smithi189 ceph-mon[34999]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:14.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:14 smithi084 ceph-mon[34812]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:16.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:16 smithi189 ceph-mon[34999]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:16.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:16 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:16.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:16 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:16.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:16 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:16.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:16 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:16.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:16 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:16.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:16 smithi084 ceph-mon[34812]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:16.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:16 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:16.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:16 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:16.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:16 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:16.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:16 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:16.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:16 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:16 smithi050 ceph-mon[30354]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:16 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:16 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:16 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:16 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:16 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:17.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:05:17.523+0000 7f2d6cc00640 1 -- 172.21.15.50:0/2962999970 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2d70062630 con 0x7f2d540a2c30 2024-09-10T10:05:17.525 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 6 on host 'smithi050' 2024-09-10T10:05:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:05:17.526+0000 7f2d76400640 1 -- 172.21.15.50:0/2962999970 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2d540a2c30 msgr2=0x7f2d540a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:05:17.526+0000 7f2d76400640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2d540a2c30 0x7f2d540a50f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2d60031440 tx=0x7f2d600315b0 comp rx=0 tx=0).stop 2024-09-10T10:05:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:05:17.526+0000 7f2d76400640 1 -- 172.21.15.50:0/2962999970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d70105920 msgr2=0x7f2d701a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:17.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:05:17.526+0000 7f2d76400640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d70105920 0x7f2d701a1660 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800eb10 tx=0x7f2d6800c2d0 comp rx=0 tx=0).stop 2024-09-10T10:05:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:05:17.526+0000 7f2d76400640 1 -- 172.21.15.50:0/2962999970 shutdown_connections 2024-09-10T10:05:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:05:17.526+0000 7f2d76400640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2d540a2c30 0x7f2d540a50f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:05:17.526+0000 7f2d76400640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d70105920 0x7f2d701a1660 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:05:17.526+0000 7f2d76400640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2d70104f60 0x7f2d7019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:05:17.526+0000 7f2d76400640 1 --2- 172.21.15.50:0/2962999970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d70103e00 0x7f2d7019a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:05:17.526+0000 7f2d76400640 1 -- 172.21.15.50:0/2962999970 >> 172.21.15.50:0/2962999970 conn(0x7f2d700ff5b0 msgr2=0x7f2d70108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:05:17.526+0000 7f2d76400640 1 -- 172.21.15.50:0/2962999970 shutdown_connections 2024-09-10T10:05:17.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:05:17.526+0000 7f2d76400640 1 -- 172.21.15.50:0/2962999970 wait complete. 2024-09-10T10:05:17.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:17 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:17.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:17 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:17.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:17 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:17.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:17 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:17.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:17 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:17.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:17 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:17.927 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:17 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:17.928 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:17 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:17.928 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:17 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:18.326 DEBUG:teuthology.orchestra.run.smithi050:osd.6> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T10:05:18.330 INFO:tasks.cephadm:Deploying osd.7 on smithi084 with /dev/vg_nvme/lv_2... 2024-09-10T10:05:18.330 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T10:05:18.596 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:05:18.716 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:18 smithi084 ceph-mon[34812]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:18.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:18 smithi189 ceph-mon[34999]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:18.865 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:18 smithi050 ceph-mon[30354]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:18.865 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:05:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:05:18.579+0000 7f92ca639640 -1 osd.6 0 log_to_monitors true 2024-09-10T10:05:19.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:19 smithi050 ceph-mon[30354]: from='osd.6 [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T10:05:19.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:19 smithi050 ceph-mon[30354]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T10:05:19.815 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:19 smithi084 ceph-mon[34812]: from='osd.6 [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T10:05:19.815 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:19 smithi084 ceph-mon[34812]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T10:05:19.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:19 smithi189 ceph-mon[34999]: from='osd.6 [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T10:05:19.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:19 smithi189 ceph-mon[34999]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T10:05:20.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:20 smithi050 ceph-mon[30354]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:20.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:20 smithi050 ceph-mon[30354]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T10:05:20.577 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:20 smithi050 ceph-mon[30354]: osdmap e45: 7 total, 6 up, 7 in 2024-09-10T10:05:20.577 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:20 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:20.577 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:20 smithi050 ceph-mon[30354]: from='osd.6 [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:05:20.577 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:20 smithi050 ceph-mon[30354]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:05:20.790 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:20 smithi084 ceph-mon[34812]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:20.791 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:20 smithi084 ceph-mon[34812]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T10:05:20.791 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:20 smithi084 ceph-mon[34812]: osdmap e45: 7 total, 6 up, 7 in 2024-09-10T10:05:20.791 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:20 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:20.791 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:20 smithi084 ceph-mon[34812]: from='osd.6 [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:05:20.791 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:20 smithi084 ceph-mon[34812]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:05:20.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:20 smithi189 ceph-mon[34999]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:20.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:20 smithi189 ceph-mon[34999]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T10:05:20.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:20 smithi189 ceph-mon[34999]: osdmap e45: 7 total, 6 up, 7 in 2024-09-10T10:05:20.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:20 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:20.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:20 smithi189 ceph-mon[34999]: from='osd.6 [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:05:20.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:20 smithi189 ceph-mon[34999]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:05:21.318 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T10:05:21.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi084:vg_nvme/lv_2 2024-09-10T10:05:21.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:05:21 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:05:21.193+0000 7f92c5800640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T10:05:21.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:05:21 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:05:21.223+0000 7f92bae00640 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:05:21.594 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:05:21.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:21 smithi189 ceph-mon[34999]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-09-10T10:05:21.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:21 smithi189 ceph-mon[34999]: osdmap e46: 7 total, 6 up, 7 in 2024-09-10T10:05:21.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:21 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:21.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:21 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:21.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:21 smithi189 ceph-mon[34999]: from='osd.6 ' entity='osd.6' 2024-09-10T10:05:21.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:21 smithi084 ceph-mon[34812]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-09-10T10:05:21.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:21 smithi084 ceph-mon[34812]: osdmap e46: 7 total, 6 up, 7 in 2024-09-10T10:05:21.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:21 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:21.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:21 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:21.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:21 smithi084 ceph-mon[34812]: from='osd.6 ' entity='osd.6' 2024-09-10T10:05:21.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:21 smithi050 ceph-mon[30354]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-09-10T10:05:21.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:21 smithi050 ceph-mon[30354]: osdmap e46: 7 total, 6 up, 7 in 2024-09-10T10:05:21.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:21 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:21.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:21 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:21.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:21 smithi050 ceph-mon[30354]: from='osd.6 ' entity='osd.6' 2024-09-10T10:05:22.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.099+0000 7f5e91754640 1 -- 172.21.15.84:0/3372773378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8c1026d0 msgr2=0x7f5e8c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:22.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.099+0000 7f5e91754640 1 --2- 172.21.15.84:0/3372773378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8c1026d0 0x7f5e8c108f60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009ca0 tx=0x7f5e8402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:05:22.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.099+0000 7f5e91754640 1 -- 172.21.15.84:0/3372773378 shutdown_connections 2024-09-10T10:05:22.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.099+0000 7f5e91754640 1 --2- 172.21.15.84:0/3372773378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8c1026d0 0x7f5e8c108f60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:22.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.099+0000 7f5e91754640 1 --2- 172.21.15.84:0/3372773378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e8c101d10 0x7f5e8c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.099+0000 7f5e91754640 1 --2- 172.21.15.84:0/3372773378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e8c100b10 0x7f5e8c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.099+0000 7f5e91754640 1 -- 172.21.15.84:0/3372773378 >> 172.21.15.84:0/3372773378 conn(0x7f5e8c0fc2a0 msgr2=0x7f5e8c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.099+0000 7f5e91754640 1 -- 172.21.15.84:0/3372773378 shutdown_connections 2024-09-10T10:05:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.099+0000 7f5e91754640 1 -- 172.21.15.84:0/3372773378 wait complete. 2024-09-10T10:05:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e91754640 1 Processor -- start 2024-09-10T10:05:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e91754640 1 -- start start 2024-09-10T10:05:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e91754640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e8c100b10 0x7f5e8c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e91754640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8c101d10 0x7f5e8c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e91754640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e8c1026d0 0x7f5e8c19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e91754640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8c10c840 con 0x7f5e8c100b10 2024-09-10T10:05:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e91754640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8c10c6c0 con 0x7f5e8c101d10 2024-09-10T10:05:22.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e91754640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8c10c9c0 con 0x7f5e8c1026d0 2024-09-10T10:05:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e83fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8c101d10 0x7f5e8c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e83fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8c101d10 0x7f5e8c1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49020/0 (socket says 172.21.15.84:49020) 2024-09-10T10:05:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e83fff640 1 -- 172.21.15.84:0/994950540 learned_addr learned my addr 172.21.15.84:0/994950540 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T10:05:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e8affd640 1 --2- 172.21.15.84:0/994950540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e8c100b10 0x7f5e8c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e83fff640 1 -- 172.21.15.84:0/994950540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e8c1026d0 msgr2=0x7f5e8c19f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e83fff640 1 --2- 172.21.15.84:0/994950540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e8c1026d0 0x7f5e8c19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e83fff640 1 -- 172.21.15.84:0/994950540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e8c100b10 msgr2=0x7f5e8c197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e83fff640 1 --2- 172.21.15.84:0/994950540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e8c100b10 0x7f5e8c197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.100+0000 7f5e83fff640 1 -- 172.21.15.84:0/994950540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8c19fb90 con 0x7f5e8c101d10 2024-09-10T10:05:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.101+0000 7f5e83fff640 1 --2- 172.21.15.84:0/994950540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8c101d10 0x7f5e8c1984a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400d770 tx=0x7f5e7400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.101+0000 7f5e88ff9640 1 -- 172.21.15.84:0/994950540 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74017070 con 0x7f5e8c101d10 2024-09-10T10:05:22.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.101+0000 7f5e91754640 1 -- 172.21.15.84:0/994950540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e8c19fe80 con 0x7f5e8c101d10 2024-09-10T10:05:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.101+0000 7f5e88ff9640 1 -- 172.21.15.84:0/994950540 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e74005500 con 0x7f5e8c101d10 2024-09-10T10:05:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.101+0000 7f5e88ff9640 1 -- 172.21.15.84:0/994950540 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74004e00 con 0x7f5e8c101d10 2024-09-10T10:05:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.101+0000 7f5e91754640 1 -- 172.21.15.84:0/994950540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e8c1a03b0 con 0x7f5e8c101d10 2024-09-10T10:05:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.102+0000 7f5e91754640 1 -- 172.21.15.84:0/994950540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e8c1a0610 con 0x7f5e8c101d10 2024-09-10T10:05:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.103+0000 7f5e88ff9640 1 -- 172.21.15.84:0/994950540 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5e74004fa0 con 0x7f5e8c101d10 2024-09-10T10:05:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.103+0000 7f5e88ff9640 1 --2- 172.21.15.84:0/994950540 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5e780a2bb0 0x7f5e780a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.104+0000 7f5e88ff9640 1 -- 172.21.15.84:0/994950540 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 4685+0+0 (secure 0 0 0) 0x7f5e740cdcb0 con 0x7f5e8c101d10 2024-09-10T10:05:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.104+0000 7f5e8affd640 1 --2- 172.21.15.84:0/994950540 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5e780a2bb0 0x7f5e780a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.104+0000 7f5e8affd640 1 --2- 172.21.15.84:0/994950540 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5e780a2bb0 0x7f5e780a5070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c101b70 tx=0x7f5e7c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:22.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.108+0000 7f5e88ff9640 1 -- 172.21.15.84:0/994950540 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e7409ba40 con 0x7f5e8c101d10 2024-09-10T10:05:22.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:22.283+0000 7f5e91754640 1 -- 172.21.15.84:0/994950540 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5e8c06aea0 con 0x7f5e780a2bb0 2024-09-10T10:05:22.835 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: purged_snaps scrub starts 2024-09-10T10:05:22.835 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: purged_snaps scrub ok 2024-09-10T10:05:22.835 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:22.835 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:22.835 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: osd.6 [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869] boot 2024-09-10T10:05:22.835 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: osdmap e47: 7 total, 7 up, 7 in 2024-09-10T10:05:22.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:22.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:05:22.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:05:22.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:22.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:22.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:22.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:22.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:22.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:22.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:22.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:22.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:22.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:22.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: purged_snaps scrub starts 2024-09-10T10:05:22.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: purged_snaps scrub ok 2024-09-10T10:05:22.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:22.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:22.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: osd.6 [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869] boot 2024-09-10T10:05:22.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: osdmap e47: 7 total, 7 up, 7 in 2024-09-10T10:05:22.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:22.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:05:22.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:05:22.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:22.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:22.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:22.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:22.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:22.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:22.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:22.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:22.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:22.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:22.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: purged_snaps scrub starts 2024-09-10T10:05:22.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: purged_snaps scrub ok 2024-09-10T10:05:22.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:05:22.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:22.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: osd.6 [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869] boot 2024-09-10T10:05:22.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: osdmap e47: 7 total, 7 up, 7 in 2024-09-10T10:05:22.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:05:22.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:05:22.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:05:22.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:22.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:22.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:22.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:22.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:22.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:22.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:22.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:22.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:22.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:23.725 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:23 smithi084 ceph-mon[34812]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:23.725 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:23 smithi084 ceph-mon[34812]: Detected new or changed devices on smithi050 2024-09-10T10:05:23.725 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:23 smithi084 ceph-mon[34812]: Adjusting osd_memory_target on smithi050 to 5698M 2024-09-10T10:05:23.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:23 smithi050 ceph-mon[30354]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:23.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:23 smithi050 ceph-mon[30354]: Detected new or changed devices on smithi050 2024-09-10T10:05:23.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:23 smithi050 ceph-mon[30354]: Adjusting osd_memory_target on smithi050 to 5698M 2024-09-10T10:05:24.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:23 smithi189 ceph-mon[34999]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:24.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:23 smithi189 ceph-mon[34999]: Detected new or changed devices on smithi050 2024-09-10T10:05:24.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:23 smithi189 ceph-mon[34999]: Adjusting osd_memory_target on smithi050 to 5698M 2024-09-10T10:05:24.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:24 smithi084 ceph-mon[34812]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:24.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:24 smithi084 ceph-mon[34812]: osdmap e48: 7 total, 7 up, 7 in 2024-09-10T10:05:24.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:24 smithi050 ceph-mon[30354]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:24.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:24 smithi050 ceph-mon[30354]: osdmap e48: 7 total, 7 up, 7 in 2024-09-10T10:05:25.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:24 smithi189 ceph-mon[34999]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:25.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:24 smithi189 ceph-mon[34999]: osdmap e48: 7 total, 7 up, 7 in 2024-09-10T10:05:25.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:25 smithi084 ceph-mon[34812]: from='client.? 172.21.15.84:0/288861154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fcce770-960b-49a6-9e44-a7acf157afc0"}]: dispatch 2024-09-10T10:05:25.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:25 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fcce770-960b-49a6-9e44-a7acf157afc0"}]: dispatch 2024-09-10T10:05:25.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:25 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0fcce770-960b-49a6-9e44-a7acf157afc0"}]': finished 2024-09-10T10:05:25.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:25 smithi084 ceph-mon[34812]: osdmap e49: 8 total, 7 up, 8 in 2024-09-10T10:05:25.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:25 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:25.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:25 smithi084 ceph-mon[34812]: from='client.? 172.21.15.84:0/2652827534' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:05:25.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:25 smithi050 ceph-mon[30354]: from='client.? 172.21.15.84:0/288861154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fcce770-960b-49a6-9e44-a7acf157afc0"}]: dispatch 2024-09-10T10:05:25.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:25 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fcce770-960b-49a6-9e44-a7acf157afc0"}]: dispatch 2024-09-10T10:05:25.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:25 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0fcce770-960b-49a6-9e44-a7acf157afc0"}]': finished 2024-09-10T10:05:25.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:25 smithi050 ceph-mon[30354]: osdmap e49: 8 total, 7 up, 8 in 2024-09-10T10:05:25.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:25 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:25.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:25 smithi050 ceph-mon[30354]: from='client.? 172.21.15.84:0/2652827534' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:05:26.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:25 smithi189 ceph-mon[34999]: from='client.? 172.21.15.84:0/288861154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fcce770-960b-49a6-9e44-a7acf157afc0"}]: dispatch 2024-09-10T10:05:26.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:25 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fcce770-960b-49a6-9e44-a7acf157afc0"}]: dispatch 2024-09-10T10:05:26.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:25 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0fcce770-960b-49a6-9e44-a7acf157afc0"}]': finished 2024-09-10T10:05:26.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:25 smithi189 ceph-mon[34999]: osdmap e49: 8 total, 7 up, 8 in 2024-09-10T10:05:26.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:25 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:26.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:25 smithi189 ceph-mon[34999]: from='client.? 172.21.15.84:0/2652827534' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:05:26.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:26 smithi084 ceph-mon[34812]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:26.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:26 smithi050 ceph-mon[30354]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:27.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:26 smithi189 ceph-mon[34999]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:28.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:28 smithi084 ceph-mon[34812]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:28.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:28 smithi050 ceph-mon[30354]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:29.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:28 smithi189 ceph-mon[34999]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:30.895 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:30 smithi084 ceph-mon[34812]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:30.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:30 smithi050 ceph-mon[30354]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:31.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:30 smithi189 ceph-mon[34999]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:32.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:32 smithi084 ceph-mon[34812]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:32 smithi050 ceph-mon[30354]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:33.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:32 smithi189 ceph-mon[34999]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:33.725 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:33 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T10:05:33.725 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:33 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:33.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:33 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T10:05:33.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:33 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:34.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:33 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T10:05:34.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:33 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:34.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:34 smithi084 ceph-mon[34812]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:34.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:34 smithi084 ceph-mon[34812]: Deploying daemon osd.7 on smithi084 2024-09-10T10:05:34.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:34 smithi050 ceph-mon[30354]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:34.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:34 smithi050 ceph-mon[30354]: Deploying daemon osd.7 on smithi084 2024-09-10T10:05:35.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:34 smithi189 ceph-mon[34999]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:35.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:34 smithi189 ceph-mon[34999]: Deploying daemon osd.7 on smithi084 2024-09-10T10:05:36.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:36 smithi050 ceph-mon[30354]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:36.967 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:36 smithi084 ceph-mon[34812]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:36 smithi189 ceph-mon[34999]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:38.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:38 smithi050 ceph-mon[30354]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:38.813 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:38 smithi084 ceph-mon[34812]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:39.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:38 smithi189 ceph-mon[34999]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:39.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:39 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:39.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:39 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:39.877 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:39 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:39.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:39 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:39.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:39 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:39.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:39 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:40.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:39 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:40.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:39 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:40.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:39 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:40.909 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:40 smithi084 ceph-mon[34812]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:40.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:40 smithi050 ceph-mon[30354]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:41.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:40 smithi189 ceph-mon[34999]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:42 smithi189 ceph-mon[34999]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:42 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:42 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:42 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:42 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:42 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:42.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:42 smithi050 ceph-mon[30354]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:42.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:42 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:42.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:42 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:42.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:42 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:42.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:42 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:42.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:42 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:42.969 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:42 smithi084 ceph-mon[34812]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:42.969 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:42 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:42.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:42 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:42.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:42 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:42.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:42 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:42.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:42 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:43.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:43.336+0000 7f5e88ff9640 1 -- 172.21.15.84:0/994950540 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5e8c06aea0 con 0x7f5e780a2bb0 2024-09-10T10:05:43.338 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 7 on host 'smithi084' 2024-09-10T10:05:43.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:43.338+0000 7f5e91754640 1 -- 172.21.15.84:0/994950540 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5e780a2bb0 msgr2=0x7f5e780a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:43.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:43.338+0000 7f5e91754640 1 --2- 172.21.15.84:0/994950540 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5e780a2bb0 0x7f5e780a5070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c101b70 tx=0x7f5e7c008040 comp rx=0 tx=0).stop 2024-09-10T10:05:43.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:43.338+0000 7f5e91754640 1 -- 172.21.15.84:0/994950540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8c101d10 msgr2=0x7f5e8c1984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:43.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:43.338+0000 7f5e91754640 1 --2- 172.21.15.84:0/994950540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8c101d10 0x7f5e8c1984a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400d770 tx=0x7f5e7400dc30 comp rx=0 tx=0).stop 2024-09-10T10:05:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:43.338+0000 7f5e91754640 1 -- 172.21.15.84:0/994950540 shutdown_connections 2024-09-10T10:05:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:43.338+0000 7f5e91754640 1 --2- 172.21.15.84:0/994950540 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5e780a2bb0 0x7f5e780a5070 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:43.338+0000 7f5e91754640 1 --2- 172.21.15.84:0/994950540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e8c1026d0 0x7f5e8c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:43.338+0000 7f5e91754640 1 --2- 172.21.15.84:0/994950540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e8c101d10 0x7f5e8c1984a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:43.338+0000 7f5e91754640 1 --2- 172.21.15.84:0/994950540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e8c100b10 0x7f5e8c197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:43.338+0000 7f5e91754640 1 -- 172.21.15.84:0/994950540 >> 172.21.15.84:0/994950540 conn(0x7f5e8c0fc2a0 msgr2=0x7f5e8c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:43.338+0000 7f5e91754640 1 -- 172.21.15.84:0/994950540 shutdown_connections 2024-09-10T10:05:43.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:05:43.338+0000 7f5e91754640 1 -- 172.21.15.84:0/994950540 wait complete. 2024-09-10T10:05:43.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:43 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:43.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:43 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:43.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:43 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:44.033 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:43 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:44.033 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:43 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:44.033 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:43 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:44.064 DEBUG:teuthology.orchestra.run.smithi084:osd.7> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T10:05:44.066 INFO:tasks.cephadm:Deploying osd.8 on smithi189 with /dev/vg_nvme/lv_2... 2024-09-10T10:05:44.066 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T10:05:44.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:43 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:05:44.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:43 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:44.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:43 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:44.323 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:05:44.712 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:44 smithi189 ceph-mon[34999]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:44.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:44 smithi050 ceph-mon[30354]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:45.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:44 smithi084 ceph-mon[34812]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:45.502 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:05:45 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:05:45.210+0000 7f3a3ddf6640 -1 osd.7 0 log_to_monitors true 2024-09-10T10:05:45.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:45 smithi189 ceph-mon[34999]: from='osd.7 [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:05:45.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:45 smithi189 ceph-mon[34999]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:05:45.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:45 smithi084 ceph-mon[34812]: from='osd.7 [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:05:45.836 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:45 smithi084 ceph-mon[34812]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:05:45.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:45 smithi050 ceph-mon[30354]: from='osd.7 [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:05:45.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:45 smithi050 ceph-mon[30354]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:05:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:46 smithi050 ceph-mon[30354]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:46 smithi050 ceph-mon[30354]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T10:05:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:46 smithi050 ceph-mon[30354]: from='osd.7 [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:05:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:46 smithi050 ceph-mon[30354]: osdmap e50: 8 total, 7 up, 8 in 2024-09-10T10:05:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:46 smithi050 ceph-mon[30354]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:05:47.065 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:05:46 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:05:46.649+0000 7f3a39d79640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T10:05:47.065 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:05:46 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:05:46.661+0000 7f3a35ba1640 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:05:47.065 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:46 smithi084 ceph-mon[34812]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:47.066 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:46 smithi084 ceph-mon[34812]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T10:05:47.066 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:46 smithi084 ceph-mon[34812]: from='osd.7 [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:05:47.066 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:46 smithi084 ceph-mon[34812]: osdmap e50: 8 total, 7 up, 8 in 2024-09-10T10:05:47.066 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:47.066 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:46 smithi084 ceph-mon[34812]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:05:47.074 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:46 smithi189 ceph-mon[34999]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:47.074 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:46 smithi189 ceph-mon[34999]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T10:05:47.074 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:46 smithi189 ceph-mon[34999]: from='osd.7 [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:05:47.074 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:46 smithi189 ceph-mon[34999]: osdmap e50: 8 total, 7 up, 8 in 2024-09-10T10:05:47.075 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:47.075 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:46 smithi189 ceph-mon[34999]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:05:47.077 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T10:05:47.106 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_2 2024-09-10T10:05:47.403 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:05:47.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:47 smithi189 ceph-mon[34999]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-10T10:05:47.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:47 smithi189 ceph-mon[34999]: osdmap e51: 8 total, 7 up, 8 in 2024-09-10T10:05:47.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:47 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:47.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:47 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:47.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:47 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:47.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:47 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:47.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:47 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:47.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:47 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:47.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:47 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:47.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:47 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:47.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:47 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:47.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:47 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:47.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:47 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:47.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:47 smithi050 ceph-mon[30354]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-10T10:05:47.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:47 smithi050 ceph-mon[30354]: osdmap e51: 8 total, 7 up, 8 in 2024-09-10T10:05:47.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:47 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:47.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:47 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:47.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:47 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:47.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:47 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:47.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:47 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:47.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:47 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:47.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:47 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:47.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:47 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:47.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:47 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:47.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:47 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:47.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:47 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:47.987 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 -- 172.21.15.189:0/3885369753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f351c100ad0 msgr2=0x7f351c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:47.987 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 --2- 172.21.15.189:0/3885369753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f351c100ad0 0x7f351c100ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3510009900 tx=0x7f351002a410 comp rx=0 tx=0).stop 2024-09-10T10:05:47.987 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 -- 172.21.15.189:0/3885369753 shutdown_connections 2024-09-10T10:05:47.987 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 --2- 172.21.15.189:0/3885369753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351c102690 0x7f351c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:47.988 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 --2- 172.21.15.189:0/3885369753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351c101cd0 0x7f351c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:47.988 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 --2- 172.21.15.189:0/3885369753 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f351c100ad0 0x7f351c100ed0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:47.988 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 -- 172.21.15.189:0/3885369753 >> 172.21.15.189:0/3885369753 conn(0x7f351c0fc280 msgr2=0x7f351c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:05:47.988 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 -- 172.21.15.189:0/3885369753 shutdown_connections 2024-09-10T10:05:47.988 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 -- 172.21.15.189:0/3885369753 wait complete. 2024-09-10T10:05:47.988 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 Processor -- start 2024-09-10T10:05:47.988 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 -- start start 2024-09-10T10:05:47.988 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f351c100ad0 0x7f351c06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:47.988 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351c101cd0 0x7f351c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:47.988 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351c102690 0x7f351c19f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:47.988 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f351c10c7d0 con 0x7f351c101cd0 2024-09-10T10:05:47.988 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f351c10c650 con 0x7f351c102690 2024-09-10T10:05:47.988 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.969+0000 7f35246b0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f351c10c950 con 0x7f351c100ad0 2024-09-10T10:05:47.989 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f352244c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f351c100ad0 0x7f351c06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:47.989 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f352244c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f351c100ad0 0x7f351c06aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:34406/0 (socket says 172.21.15.189:34406) 2024-09-10T10:05:47.989 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f352244c640 1 -- 172.21.15.189:0/3807841587 learned_addr learned my addr 172.21.15.189:0/3807841587 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T10:05:47.989 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f3522c4d640 1 --2- 172.21.15.189:0/3807841587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351c102690 0x7f351c19f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:47.989 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f352244c640 1 -- 172.21.15.189:0/3807841587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351c102690 msgr2=0x7f351c19f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:47.989 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f352244c640 1 --2- 172.21.15.189:0/3807841587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351c102690 0x7f351c19f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:47.989 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f352244c640 1 -- 172.21.15.189:0/3807841587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351c101cd0 msgr2=0x7f351c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:05:47.989 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f352244c640 1 --2- 172.21.15.189:0/3807841587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351c101cd0 0x7f351c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:05:47.989 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f352244c640 1 -- 172.21.15.189:0/3807841587 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351c19fbd0 con 0x7f351c100ad0 2024-09-10T10:05:47.989 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f352244c640 1 --2- 172.21.15.189:0/3807841587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f351c100ad0 0x7f351c06aad0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3510031610 tx=0x7f35100043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:47.989 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f350f7fe640 1 -- 172.21.15.189:0/3807841587 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351003f030 con 0x7f351c100ad0 2024-09-10T10:05:47.989 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f35246b0640 1 -- 172.21.15.189:0/3807841587 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f351c19fe00 con 0x7f351c100ad0 2024-09-10T10:05:47.989 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f350f7fe640 1 -- 172.21.15.189:0/3807841587 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3510003ce0 con 0x7f351c100ad0 2024-09-10T10:05:47.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f350f7fe640 1 -- 172.21.15.189:0/3807841587 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510035070 con 0x7f351c100ad0 2024-09-10T10:05:47.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.970+0000 7f35246b0640 1 -- 172.21.15.189:0/3807841587 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f351c1a0330 con 0x7f351c100ad0 2024-09-10T10:05:47.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.971+0000 7f35246b0640 1 -- 172.21.15.189:0/3807841587 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f351c107ed0 con 0x7f351c100ad0 2024-09-10T10:05:47.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.972+0000 7f350f7fe640 1 -- 172.21.15.189:0/3807841587 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3510042030 con 0x7f351c100ad0 2024-09-10T10:05:47.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.973+0000 7f350f7fe640 1 --2- 172.21.15.189:0/3807841587 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f35080a2b80 0x7f35080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:05:47.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.973+0000 7f350f7fe640 1 -- 172.21.15.189:0/3807841587 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5430+0+0 (secure 0 0 0) 0x7f35100eedc0 con 0x7f351c100ad0 2024-09-10T10:05:47.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.973+0000 7f3521c4b640 1 --2- 172.21.15.189:0/3807841587 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f35080a2b80 0x7f35080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:05:47.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.974+0000 7f3521c4b640 1 --2- 172.21.15.189:0/3807841587 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f35080a2b80 0x7f35080a5040 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f351c06b050 tx=0x7f3518006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:05:47.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:47.976+0000 7f350f7fe640 1 -- 172.21.15.189:0/3807841587 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35100bc860 con 0x7f351c100ad0 2024-09-10T10:05:48.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:47 smithi084 ceph-mon[34812]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-10T10:05:48.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:47 smithi084 ceph-mon[34812]: osdmap e51: 8 total, 7 up, 8 in 2024-09-10T10:05:48.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:47 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:48.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:47 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:48.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:47 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:48.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:47 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:48.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:47 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:48.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:47 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:48.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:47 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:05:48.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:47 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:48.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:47 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:48.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:47 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:05:48.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:47 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:05:48.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:05:48.150+0000 7f35246b0640 1 -- 172.21.15.189:0/3807841587 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f351c062630 con 0x7f35080a2b80 2024-09-10T10:05:48.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:48 smithi189 ceph-mon[34999]: purged_snaps scrub starts 2024-09-10T10:05:48.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:48 smithi189 ceph-mon[34999]: purged_snaps scrub ok 2024-09-10T10:05:48.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:48 smithi189 ceph-mon[34999]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:48.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:48 smithi189 ceph-mon[34999]: Detected new or changed devices on smithi084 2024-09-10T10:05:48.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:48 smithi189 ceph-mon[34999]: Adjusting osd_memory_target on smithi084 to 5696M 2024-09-10T10:05:48.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:48 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:48.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:48 smithi189 ceph-mon[34999]: osd.7 [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103] boot 2024-09-10T10:05:48.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:48 smithi189 ceph-mon[34999]: osdmap e52: 8 total, 8 up, 8 in 2024-09-10T10:05:48.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:48 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:48.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:48 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:05:48.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:48 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:05:48.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:48 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:48.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:48 smithi050 ceph-mon[30354]: purged_snaps scrub starts 2024-09-10T10:05:48.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:48 smithi050 ceph-mon[30354]: purged_snaps scrub ok 2024-09-10T10:05:48.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:48 smithi050 ceph-mon[30354]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:48.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:48 smithi050 ceph-mon[30354]: Detected new or changed devices on smithi084 2024-09-10T10:05:48.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:48 smithi050 ceph-mon[30354]: Adjusting osd_memory_target on smithi084 to 5696M 2024-09-10T10:05:48.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:48 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:48.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:48 smithi050 ceph-mon[30354]: osd.7 [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103] boot 2024-09-10T10:05:48.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:48 smithi050 ceph-mon[30354]: osdmap e52: 8 total, 8 up, 8 in 2024-09-10T10:05:48.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:48 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:48.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:48 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:05:48.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:48 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:05:48.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:48 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:49.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:48 smithi084 ceph-mon[34812]: purged_snaps scrub starts 2024-09-10T10:05:49.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:48 smithi084 ceph-mon[34812]: purged_snaps scrub ok 2024-09-10T10:05:49.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:48 smithi084 ceph-mon[34812]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:05:49.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:48 smithi084 ceph-mon[34812]: Detected new or changed devices on smithi084 2024-09-10T10:05:49.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:48 smithi084 ceph-mon[34812]: Adjusting osd_memory_target on smithi084 to 5696M 2024-09-10T10:05:49.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:48 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:49.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:48 smithi084 ceph-mon[34812]: osd.7 [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103] boot 2024-09-10T10:05:49.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:48 smithi084 ceph-mon[34812]: osdmap e52: 8 total, 8 up, 8 in 2024-09-10T10:05:49.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:48 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:05:49.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:48 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:05:49.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:48 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:05:49.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:48 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:05:49.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:49 smithi189 ceph-mon[34999]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:49.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:49 smithi189 ceph-mon[34999]: osdmap e53: 8 total, 8 up, 8 in 2024-09-10T10:05:49.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:49 smithi050 ceph-mon[30354]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:49.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:49 smithi050 ceph-mon[30354]: osdmap e53: 8 total, 8 up, 8 in 2024-09-10T10:05:50.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:49 smithi084 ceph-mon[34812]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:05:50.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:49 smithi084 ceph-mon[34812]: osdmap e53: 8 total, 8 up, 8 in 2024-09-10T10:05:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:50 smithi050 ceph-mon[30354]: pgmap v188: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:50 smithi050 ceph-mon[30354]: osdmap e54: 8 total, 8 up, 8 in 2024-09-10T10:05:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:50 smithi050 ceph-mon[30354]: from='client.? 172.21.15.189:0/1621174374' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a23d1843-1228-44ab-af7b-209c433b38dd"}]: dispatch 2024-09-10T10:05:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:50 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a23d1843-1228-44ab-af7b-209c433b38dd"}]: dispatch 2024-09-10T10:05:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:50 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a23d1843-1228-44ab-af7b-209c433b38dd"}]': finished 2024-09-10T10:05:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:50 smithi050 ceph-mon[30354]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T10:05:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:50 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:05:50.966 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:50 smithi189 ceph-mon[34999]: pgmap v188: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:50.966 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:50 smithi189 ceph-mon[34999]: osdmap e54: 8 total, 8 up, 8 in 2024-09-10T10:05:50.966 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:50 smithi189 ceph-mon[34999]: from='client.? 172.21.15.189:0/1621174374' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a23d1843-1228-44ab-af7b-209c433b38dd"}]: dispatch 2024-09-10T10:05:50.966 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:50 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a23d1843-1228-44ab-af7b-209c433b38dd"}]: dispatch 2024-09-10T10:05:50.966 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:50 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a23d1843-1228-44ab-af7b-209c433b38dd"}]': finished 2024-09-10T10:05:50.966 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:50 smithi189 ceph-mon[34999]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T10:05:50.966 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:50 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:05:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:50 smithi084 ceph-mon[34812]: pgmap v188: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:50 smithi084 ceph-mon[34812]: osdmap e54: 8 total, 8 up, 8 in 2024-09-10T10:05:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:50 smithi084 ceph-mon[34812]: from='client.? 172.21.15.189:0/1621174374' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a23d1843-1228-44ab-af7b-209c433b38dd"}]: dispatch 2024-09-10T10:05:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:50 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a23d1843-1228-44ab-af7b-209c433b38dd"}]: dispatch 2024-09-10T10:05:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:50 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a23d1843-1228-44ab-af7b-209c433b38dd"}]': finished 2024-09-10T10:05:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:50 smithi084 ceph-mon[34812]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T10:05:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:50 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:05:51.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:51 smithi050 ceph-mon[30354]: from='client.? 172.21.15.189:0/3866058518' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:05:51.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:51 smithi050 ceph-mon[30354]: osdmap e56: 9 total, 8 up, 9 in 2024-09-10T10:05:51.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:51 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:05:52.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:51 smithi189 ceph-mon[34999]: from='client.? 172.21.15.189:0/3866058518' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:05:52.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:51 smithi189 ceph-mon[34999]: osdmap e56: 9 total, 8 up, 9 in 2024-09-10T10:05:52.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:51 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:05:52.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:51 smithi084 ceph-mon[34812]: from='client.? 172.21.15.189:0/3866058518' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:05:52.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:51 smithi084 ceph-mon[34812]: osdmap e56: 9 total, 8 up, 9 in 2024-09-10T10:05:52.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:51 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:05:52.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:52 smithi050 ceph-mon[30354]: pgmap v191: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:52.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:52 smithi050 ceph-mon[30354]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-10T10:05:53.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:52 smithi189 ceph-mon[34999]: pgmap v191: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:53.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:52 smithi189 ceph-mon[34999]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-10T10:05:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:52 smithi084 ceph-mon[34812]: pgmap v191: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:52 smithi084 ceph-mon[34812]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-10T10:05:53.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:53 smithi050 ceph-mon[30354]: pgmap v193: 1 pgs: 1 unknown; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:54.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:53 smithi189 ceph-mon[34999]: pgmap v193: 1 pgs: 1 unknown; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:54.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:53 smithi084 ceph-mon[34812]: pgmap v193: 1 pgs: 1 unknown; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:55.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:54 smithi189 ceph-mon[34999]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-10T10:05:55.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:54 smithi189 ceph-mon[34999]: Cluster is now healthy 2024-09-10T10:05:55.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:54 smithi084 ceph-mon[34812]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-10T10:05:55.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:54 smithi084 ceph-mon[34812]: Cluster is now healthy 2024-09-10T10:05:55.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:54 smithi050 ceph-mon[30354]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-10T10:05:55.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:54 smithi050 ceph-mon[30354]: Cluster is now healthy 2024-09-10T10:05:56.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:55 smithi189 ceph-mon[34999]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:56.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:55 smithi084 ceph-mon[34812]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:56.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:55 smithi050 ceph-mon[30354]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:57.928 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:57 smithi189 ceph-mon[34999]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:58.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:57 smithi084 ceph-mon[34812]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:05:58.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:57 smithi050 ceph-mon[30354]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:00.080 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:59 smithi189 ceph-mon[34999]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:00.081 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T10:06:00.081 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:00.081 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:05:59 smithi189 ceph-mon[34999]: Deploying daemon osd.8 on smithi189 2024-09-10T10:06:00.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:59 smithi084 ceph-mon[34812]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:00.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T10:06:00.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:00.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:05:59 smithi084 ceph-mon[34812]: Deploying daemon osd.8 on smithi189 2024-09-10T10:06:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:59 smithi050 ceph-mon[30354]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T10:06:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:05:59 smithi050 ceph-mon[30354]: Deploying daemon osd.8 on smithi189 2024-09-10T10:06:02.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:01 smithi189 ceph-mon[34999]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:02.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:01 smithi084 ceph-mon[34812]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:02.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:01 smithi050 ceph-mon[30354]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:04.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:03 smithi189 ceph-mon[34999]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:04.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:03 smithi084 ceph-mon[34812]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:04.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:03 smithi050 ceph-mon[30354]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:06.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:05 smithi189 ceph-mon[34999]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:06.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:06.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:06.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:06.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:05 smithi084 ceph-mon[34812]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:06.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:06.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:06.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:06.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:05 smithi050 ceph-mon[30354]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:06.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:06.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:06.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:08.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:07 smithi084 ceph-mon[34812]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:08.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:07 smithi050 ceph-mon[30354]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:08.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:07 smithi189 ceph-mon[34999]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:09.216 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:06:09.213+0000 7f350f7fe640 1 -- 172.21.15.189:0/3807841587 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f351c062630 con 0x7f35080a2b80 2024-09-10T10:06:09.217 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 8 on host 'smithi189' 2024-09-10T10:06:09.217 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:06:09.215+0000 7f35246b0640 1 -- 172.21.15.189:0/3807841587 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f35080a2b80 msgr2=0x7f35080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:09.217 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:06:09.215+0000 7f35246b0640 1 --2- 172.21.15.189:0/3807841587 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f35080a2b80 0x7f35080a5040 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f351c06b050 tx=0x7f3518006c90 comp rx=0 tx=0).stop 2024-09-10T10:06:09.217 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:06:09.215+0000 7f35246b0640 1 -- 172.21.15.189:0/3807841587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f351c100ad0 msgr2=0x7f351c06aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:09.218 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:06:09.215+0000 7f35246b0640 1 --2- 172.21.15.189:0/3807841587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f351c100ad0 0x7f351c06aad0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3510031610 tx=0x7f35100043b0 comp rx=0 tx=0).stop 2024-09-10T10:06:09.218 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:06:09.215+0000 7f35246b0640 1 -- 172.21.15.189:0/3807841587 shutdown_connections 2024-09-10T10:06:09.218 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:06:09.215+0000 7f35246b0640 1 --2- 172.21.15.189:0/3807841587 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f35080a2b80 0x7f35080a5040 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:09.218 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:06:09.215+0000 7f35246b0640 1 --2- 172.21.15.189:0/3807841587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351c102690 0x7f351c19f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:09.218 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:06:09.215+0000 7f35246b0640 1 --2- 172.21.15.189:0/3807841587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f351c101cd0 0x7f351c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:09.218 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:06:09.215+0000 7f35246b0640 1 --2- 172.21.15.189:0/3807841587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f351c100ad0 0x7f351c06aad0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:09.218 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:06:09.215+0000 7f35246b0640 1 -- 172.21.15.189:0/3807841587 >> 172.21.15.189:0/3807841587 conn(0x7f351c0fc280 msgr2=0x7f351c1050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:09.218 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:06:09.215+0000 7f35246b0640 1 -- 172.21.15.189:0/3807841587 shutdown_connections 2024-09-10T10:06:09.218 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:06:09.216+0000 7f35246b0640 1 -- 172.21.15.189:0/3807841587 wait complete. 2024-09-10T10:06:09.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:09 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:09 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:09 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:09.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:09 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:09.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:09 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:09 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:09.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:09 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:09 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:09 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:09 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:09 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:09.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:09 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:09.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:09 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:09 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:09.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:09 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:09 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.944 DEBUG:teuthology.orchestra.run.smithi189:osd.8> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T10:06:09.947 INFO:tasks.cephadm:Deploying osd.9 on smithi050 with /dev/vg_nvme/lv_1... 2024-09-10T10:06:09.947 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T10:06:09.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:09 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:09 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:09 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:09.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:09 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:09.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:09 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:09 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:09.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:09 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:09.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:09 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:10.331 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:06:10.806 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:10 smithi050 ceph-mon[30354]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:10.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:10 smithi084 ceph-mon[34812]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:11.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:10 smithi189 ceph-mon[34999]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:12.086 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:06:11 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:06:11.795+0000 7f598476b640 -1 osd.8 0 log_to_monitors true 2024-09-10T10:06:12.713 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:12 smithi189 ceph-mon[34999]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:12.713 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:12 smithi189 ceph-mon[34999]: from='osd.8 [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:06:12.713 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:12 smithi189 ceph-mon[34999]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:06:12.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:12 smithi084 ceph-mon[34812]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:12.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:12 smithi084 ceph-mon[34812]: from='osd.8 [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:06:12.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:12 smithi084 ceph-mon[34812]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:06:12.905 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:12 smithi050 ceph-mon[30354]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:12.905 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:12 smithi050 ceph-mon[30354]: from='osd.8 [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:06:12.905 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:12 smithi050 ceph-mon[30354]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:06:13.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T10:06:13.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: osdmap e57: 9 total, 8 up, 9 in 2024-09-10T10:06:13.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:13.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: from='osd.8 [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:06:13.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:06:13.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:13.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:13.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:13.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:13.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:13.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:13.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:13.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:13.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:13.845 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:06:13.877 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_1 2024-09-10T10:06:14.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T10:06:14.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: osdmap e57: 9 total, 8 up, 9 in 2024-09-10T10:06:14.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:14.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: from='osd.8 [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:06:14.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:06:14.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:14.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:14.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:14.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:14.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:14.001 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:14.001 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:14.001 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:14.001 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T10:06:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: osdmap e57: 9 total, 8 up, 9 in 2024-09-10T10:06:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: from='osd.8 [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:06:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:06:14.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:14.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:14.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:14.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:14.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:14.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:14.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:14.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:14.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:14.290 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:06:14.335 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:06:13 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:06:13.999+0000 7f5980f02640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T10:06:14.335 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:06:14 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:06:14.008+0000 7f597850e640 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:06:14.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:14 smithi050 ceph-mon[30354]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:14.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:14 smithi050 ceph-mon[30354]: Detected new or changed devices on smithi189 2024-09-10T10:06:14.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:14 smithi050 ceph-mon[30354]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-10T10:06:14.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:14 smithi050 ceph-mon[30354]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T10:06:14.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:14 smithi050 ceph-mon[30354]: osdmap e58: 9 total, 8 up, 9 in 2024-09-10T10:06:14.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:14 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:14.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:14 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:14.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:14 smithi050 ceph-mon[30354]: from='osd.8 ' entity='osd.8' 2024-09-10T10:06:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.791+0000 7f6996400640 1 -- 172.21.15.50:0/4024762602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69901037c0 msgr2=0x7f699010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.791+0000 7f6996400640 1 --2- 172.21.15.50:0/4024762602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69901037c0 0x7f699010a050 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6988009ca0 tx=0x7f698802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:06:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.791+0000 7f6996400640 1 -- 172.21.15.50:0/4024762602 shutdown_connections 2024-09-10T10:06:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.791+0000 7f6996400640 1 --2- 172.21.15.50:0/4024762602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69901037c0 0x7f699010a050 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.791+0000 7f6996400640 1 --2- 172.21.15.50:0/4024762602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6990102e00 0x7f6990103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.791+0000 7f6996400640 1 --2- 172.21.15.50:0/4024762602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6990101c00 0x7f6990102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.791+0000 7f6996400640 1 -- 172.21.15.50:0/4024762602 >> 172.21.15.50:0/4024762602 conn(0x7f69900fd390 msgr2=0x7f69900ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.791+0000 7f6996400640 1 -- 172.21.15.50:0/4024762602 shutdown_connections 2024-09-10T10:06:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.791+0000 7f6996400640 1 -- 172.21.15.50:0/4024762602 wait complete. 2024-09-10T10:06:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.792+0000 7f6996400640 1 Processor -- start 2024-09-10T10:06:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.792+0000 7f6996400640 1 -- start start 2024-09-10T10:06:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f6996400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6990101c00 0x7f699019a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f6996400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6990102e00 0x7f699019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f6996400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69901037c0 0x7f69901a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f6996400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f699010d8b0 con 0x7f6990101c00 2024-09-10T10:06:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f6996400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f699010d730 con 0x7f6990102e00 2024-09-10T10:06:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f6996400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f699010da30 con 0x7f69901037c0 2024-09-10T10:06:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f698f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6990101c00 0x7f699019a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f698f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6990101c00 0x7f699019a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34700/0 (socket says 172.21.15.50:34700) 2024-09-10T10:06:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f698f400640 1 -- 172.21.15.50:0/2810305447 learned_addr learned my addr 172.21.15.50:0/2810305447 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:06:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f698fe00640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69901037c0 0x7f69901a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f698ea00640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6990102e00 0x7f699019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f698f400640 1 -- 172.21.15.50:0/2810305447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69901037c0 msgr2=0x7f69901a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:14.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f698f400640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69901037c0 0x7f69901a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f698f400640 1 -- 172.21.15.50:0/2810305447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6990102e00 msgr2=0x7f699019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f698f400640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6990102e00 0x7f699019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.793+0000 7f698f400640 1 -- 172.21.15.50:0/2810305447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69901a1cb0 con 0x7f6990101c00 2024-09-10T10:06:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.794+0000 7f698f400640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6990101c00 0x7f699019a080 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f698000e9c0 tx=0x7f698000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.794+0000 7f6987e00640 1 -- 172.21.15.50:0/2810305447 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698000cde0 con 0x7f6990101c00 2024-09-10T10:06:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.794+0000 7f6987e00640 1 -- 172.21.15.50:0/2810305447 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6980010910 con 0x7f6990101c00 2024-09-10T10:06:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.794+0000 7f6996400640 1 -- 172.21.15.50:0/2810305447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69901a1fa0 con 0x7f6990101c00 2024-09-10T10:06:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.794+0000 7f6987e00640 1 -- 172.21.15.50:0/2810305447 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6980018a00 con 0x7f6990101c00 2024-09-10T10:06:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.794+0000 7f6996400640 1 -- 172.21.15.50:0/2810305447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69901a2450 con 0x7f6990101c00 2024-09-10T10:06:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.795+0000 7f6996400640 1 -- 172.21.15.50:0/2810305447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69901a26b0 con 0x7f6990101c00 2024-09-10T10:06:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.797+0000 7f6987e00640 1 -- 172.21.15.50:0/2810305447 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f698001f020 con 0x7f6990101c00 2024-09-10T10:06:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.798+0000 7f6987e00640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f69740a2c30 0x7f69740a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.799+0000 7f6987e00640 1 -- 172.21.15.50:0/2810305447 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5862+0+0 (secure 0 0 0) 0x7f69800cee60 con 0x7f6990101c00 2024-09-10T10:06:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.799+0000 7f698ea00640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f69740a2c30 0x7f69740a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.799+0000 7f698ea00640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f69740a2c30 0x7f69740a50f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f699019b5a0 tx=0x7f697c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:14.801+0000 7f6987e00640 1 -- 172.21.15.50:0/2810305447 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f698009c6b0 con 0x7f6990101c00 2024-09-10T10:06:15.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:15.000+0000 7f6996400640 1 -- 172.21.15.50:0/2810305447 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6990075b40 con 0x7f69740a2c30 2024-09-10T10:06:15.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:14 smithi189 ceph-mon[34999]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:15.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:14 smithi189 ceph-mon[34999]: Detected new or changed devices on smithi189 2024-09-10T10:06:15.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:14 smithi189 ceph-mon[34999]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-10T10:06:15.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:14 smithi189 ceph-mon[34999]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T10:06:15.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:14 smithi189 ceph-mon[34999]: osdmap e58: 9 total, 8 up, 9 in 2024-09-10T10:06:15.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:14 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:15.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:14 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:15.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:14 smithi189 ceph-mon[34999]: from='osd.8 ' entity='osd.8' 2024-09-10T10:06:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:14 smithi084 ceph-mon[34812]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:14 smithi084 ceph-mon[34812]: Detected new or changed devices on smithi189 2024-09-10T10:06:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:14 smithi084 ceph-mon[34812]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-10T10:06:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:14 smithi084 ceph-mon[34812]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T10:06:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:14 smithi084 ceph-mon[34812]: osdmap e58: 9 total, 8 up, 9 in 2024-09-10T10:06:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:14 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:14 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:14 smithi084 ceph-mon[34812]: from='osd.8 ' entity='osd.8' 2024-09-10T10:06:15.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:15 smithi050 ceph-mon[30354]: purged_snaps scrub starts 2024-09-10T10:06:15.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:15 smithi050 ceph-mon[30354]: purged_snaps scrub ok 2024-09-10T10:06:15.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:15 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:15.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:15 smithi050 ceph-mon[30354]: osd.8 [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762] boot 2024-09-10T10:06:15.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:15 smithi050 ceph-mon[30354]: osdmap e59: 9 total, 9 up, 9 in 2024-09-10T10:06:15.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:15 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:15.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:15 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:06:15.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:15 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:06:15.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:15 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:16.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:15 smithi189 ceph-mon[34999]: purged_snaps scrub starts 2024-09-10T10:06:16.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:15 smithi189 ceph-mon[34999]: purged_snaps scrub ok 2024-09-10T10:06:16.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:15 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:16.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:15 smithi189 ceph-mon[34999]: osd.8 [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762] boot 2024-09-10T10:06:16.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:15 smithi189 ceph-mon[34999]: osdmap e59: 9 total, 9 up, 9 in 2024-09-10T10:06:16.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:15 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:16.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:15 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:06:16.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:15 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:06:16.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:15 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:16.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:15 smithi084 ceph-mon[34812]: purged_snaps scrub starts 2024-09-10T10:06:16.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:15 smithi084 ceph-mon[34812]: purged_snaps scrub ok 2024-09-10T10:06:16.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:15 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:16.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:15 smithi084 ceph-mon[34812]: osd.8 [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762] boot 2024-09-10T10:06:16.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:15 smithi084 ceph-mon[34812]: osdmap e59: 9 total, 9 up, 9 in 2024-09-10T10:06:16.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:15 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:06:16.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:15 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:06:16.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:15 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:06:16.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:15 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:16.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:16 smithi050 ceph-mon[30354]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:16.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:16 smithi050 ceph-mon[30354]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:16.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:16 smithi050 ceph-mon[30354]: osdmap e60: 9 total, 9 up, 9 in 2024-09-10T10:06:17.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:16 smithi189 ceph-mon[34999]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:17.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:16 smithi189 ceph-mon[34999]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:17.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:16 smithi189 ceph-mon[34999]: osdmap e60: 9 total, 9 up, 9 in 2024-09-10T10:06:17.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:16 smithi084 ceph-mon[34812]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:06:17.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:16 smithi084 ceph-mon[34812]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:17.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:16 smithi084 ceph-mon[34812]: osdmap e60: 9 total, 9 up, 9 in 2024-09-10T10:06:17.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:17 smithi050 ceph-mon[30354]: osdmap e61: 9 total, 9 up, 9 in 2024-09-10T10:06:18.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:17 smithi189 ceph-mon[34999]: osdmap e61: 9 total, 9 up, 9 in 2024-09-10T10:06:18.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:17 smithi084 ceph-mon[34812]: osdmap e61: 9 total, 9 up, 9 in 2024-09-10T10:06:18.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:18 smithi050 ceph-mon[30354]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:18.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:18 smithi050 ceph-mon[30354]: osdmap e62: 9 total, 9 up, 9 in 2024-09-10T10:06:18.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:18 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1974253732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b80673a0-7727-4303-894e-9d056dfd45b4"}]: dispatch 2024-09-10T10:06:18.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:18 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1974253732' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b80673a0-7727-4303-894e-9d056dfd45b4"}]': finished 2024-09-10T10:06:18.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:18 smithi050 ceph-mon[30354]: osdmap e63: 10 total, 9 up, 10 in 2024-09-10T10:06:18.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:18 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:19.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:18 smithi189 ceph-mon[34999]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:19.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:18 smithi189 ceph-mon[34999]: osdmap e62: 9 total, 9 up, 9 in 2024-09-10T10:06:19.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:18 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1974253732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b80673a0-7727-4303-894e-9d056dfd45b4"}]: dispatch 2024-09-10T10:06:19.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:18 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1974253732' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b80673a0-7727-4303-894e-9d056dfd45b4"}]': finished 2024-09-10T10:06:19.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:18 smithi189 ceph-mon[34999]: osdmap e63: 10 total, 9 up, 10 in 2024-09-10T10:06:19.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:18 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:19.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:18 smithi084 ceph-mon[34812]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:19.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:18 smithi084 ceph-mon[34812]: osdmap e62: 9 total, 9 up, 9 in 2024-09-10T10:06:19.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:18 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1974253732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b80673a0-7727-4303-894e-9d056dfd45b4"}]: dispatch 2024-09-10T10:06:19.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:18 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1974253732' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b80673a0-7727-4303-894e-9d056dfd45b4"}]': finished 2024-09-10T10:06:19.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:18 smithi084 ceph-mon[34812]: osdmap e63: 10 total, 9 up, 10 in 2024-09-10T10:06:19.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:18 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:19.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:19 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1418640451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:06:20.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:19 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1418640451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:06:20.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:19 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1418640451' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:06:20.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:20 smithi050 ceph-mon[30354]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T10:06:21.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:20 smithi189 ceph-mon[34999]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T10:06:21.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:20 smithi084 ceph-mon[34812]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T10:06:22.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:22 smithi050 ceph-mon[30354]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-10T10:06:23.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:22 smithi189 ceph-mon[34999]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-10T10:06:23.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:22 smithi084 ceph-mon[34812]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-10T10:06:24.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:24 smithi050 ceph-mon[30354]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-10T10:06:25.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:24 smithi189 ceph-mon[34999]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-10T10:06:25.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:24 smithi084 ceph-mon[34812]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-10T10:06:26.877 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:26 smithi050 ceph-mon[30354]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:06:27.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:26 smithi189 ceph-mon[34999]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:06:27.098 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:26 smithi084 ceph-mon[34812]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:06:27.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:27 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T10:06:27.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:27 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:28.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:27 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T10:06:28.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:27 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:28.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:27 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T10:06:28.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:27 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:28.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:28 smithi050 ceph-mon[30354]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T10:06:28.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:28 smithi050 ceph-mon[30354]: Deploying daemon osd.9 on smithi050 2024-09-10T10:06:29.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:28 smithi189 ceph-mon[34999]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T10:06:29.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:28 smithi189 ceph-mon[34999]: Deploying daemon osd.9 on smithi050 2024-09-10T10:06:29.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:28 smithi084 ceph-mon[34812]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-10T10:06:29.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:28 smithi084 ceph-mon[34812]: Deploying daemon osd.9 on smithi050 2024-09-10T10:06:30.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:30 smithi050 ceph-mon[30354]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T10:06:31.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:30 smithi189 ceph-mon[34999]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T10:06:31.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:30 smithi084 ceph-mon[34812]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T10:06:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:32 smithi050 ceph-mon[30354]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:33.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:32 smithi189 ceph-mon[34999]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:33.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:32 smithi084 ceph-mon[34812]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:34.829 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:34 smithi050 ceph-mon[30354]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:35.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:34 smithi189 ceph-mon[34999]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:35.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:34 smithi084 ceph-mon[34812]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:35.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:35.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:35.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:36.000 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:36.000 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:36.000 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:36.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:36.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:36.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:36.923 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:36 smithi050 ceph-mon[30354]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:37.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:36 smithi189 ceph-mon[34999]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:37.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:36 smithi084 ceph-mon[34812]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:38.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:38 smithi050 ceph-mon[30354]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:39.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:38 smithi189 ceph-mon[34999]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:39.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:38 smithi084 ceph-mon[34812]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:39.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:39.916+0000 7f6987e00640 1 -- 172.21.15.50:0/2810305447 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6990075b40 con 0x7f69740a2c30 2024-09-10T10:06:39.918 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 9 on host 'smithi050' 2024-09-10T10:06:39.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:39.919+0000 7f6996400640 1 -- 172.21.15.50:0/2810305447 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f69740a2c30 msgr2=0x7f69740a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:39.919+0000 7f6996400640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f69740a2c30 0x7f69740a50f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f699019b5a0 tx=0x7f697c005f90 comp rx=0 tx=0).stop 2024-09-10T10:06:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:39.919+0000 7f6996400640 1 -- 172.21.15.50:0/2810305447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6990101c00 msgr2=0x7f699019a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:39.919+0000 7f6996400640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6990101c00 0x7f699019a080 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f698000e9c0 tx=0x7f698000ee80 comp rx=0 tx=0).stop 2024-09-10T10:06:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:39.919+0000 7f6996400640 1 -- 172.21.15.50:0/2810305447 shutdown_connections 2024-09-10T10:06:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:39.919+0000 7f6996400640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f69740a2c30 0x7f69740a50f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:39.919+0000 7f6996400640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69901037c0 0x7f69901a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:39.919+0000 7f6996400640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6990102e00 0x7f699019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:39.919+0000 7f6996400640 1 --2- 172.21.15.50:0/2810305447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6990101c00 0x7f699019a080 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:39.919+0000 7f6996400640 1 -- 172.21.15.50:0/2810305447 >> 172.21.15.50:0/2810305447 conn(0x7f69900fd390 msgr2=0x7f6990074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:39.919+0000 7f6996400640 1 -- 172.21.15.50:0/2810305447 shutdown_connections 2024-09-10T10:06:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:06:39.919+0000 7f6996400640 1 -- 172.21.15.50:0/2810305447 wait complete. 2024-09-10T10:06:40.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:39 smithi189 ceph-mon[34999]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:40.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:39 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:40.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:39 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:40.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:39 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:40.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:39 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:40.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:39 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:40.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:39 smithi084 ceph-mon[34812]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:40.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:39 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:40.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:39 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:40.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:39 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:40.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:39 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:40.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:39 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:40.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:39 smithi050 ceph-mon[30354]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:40.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:39 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:40.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:39 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:40.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:39 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:40.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:39 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:40.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:39 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:40.668 DEBUG:teuthology.orchestra.run.smithi050:osd.9> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T10:06:40.672 INFO:tasks.cephadm:Deploying osd.10 on smithi084 with /dev/vg_nvme/lv_1... 2024-09-10T10:06:40.672 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T10:06:40.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:40 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:40.926 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:40 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:40.927 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:40 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:40.929 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:06:41.049 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:40 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:41.050 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:40 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:41.050 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:40 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:41.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:40 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:06:41.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:40 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:41.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:40 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:41.838 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:06:41 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:06:41.575+0000 7f316b82e640 -1 osd.9 0 log_to_monitors true 2024-09-10T10:06:42.188 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:41 smithi050 ceph-mon[30354]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:42.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:41 smithi050 ceph-mon[30354]: from='osd.9 [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T10:06:42.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:41 smithi050 ceph-mon[30354]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T10:06:42.283 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:41 smithi084 ceph-mon[34812]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:42.283 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:41 smithi084 ceph-mon[34812]: from='osd.9 [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T10:06:42.283 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:41 smithi084 ceph-mon[34812]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T10:06:42.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:41 smithi189 ceph-mon[34999]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:42.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:41 smithi189 ceph-mon[34999]: from='osd.9 [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T10:06:42.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:41 smithi189 ceph-mon[34999]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T10:06:43.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:42 smithi050 ceph-mon[30354]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T10:06:43.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:42 smithi050 ceph-mon[30354]: osdmap e64: 10 total, 9 up, 10 in 2024-09-10T10:06:43.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:42 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:43.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:42 smithi050 ceph-mon[30354]: from='osd.9 [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:06:43.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:42 smithi050 ceph-mon[30354]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:06:43.216 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:06:42 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:06:42.951+0000 7f3166000640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T10:06:43.216 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:06:42 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:06:42.964+0000 7f3161000640 -1 osd.9 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:06:43.237 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:42 smithi189 ceph-mon[34999]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T10:06:43.237 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:42 smithi189 ceph-mon[34999]: osdmap e64: 10 total, 9 up, 10 in 2024-09-10T10:06:43.237 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:42 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:43.237 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:42 smithi189 ceph-mon[34999]: from='osd.9 [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:06:43.237 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:42 smithi189 ceph-mon[34999]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:06:43.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:42 smithi084 ceph-mon[34812]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T10:06:43.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:42 smithi084 ceph-mon[34812]: osdmap e64: 10 total, 9 up, 10 in 2024-09-10T10:06:43.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:42 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:43.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:42 smithi084 ceph-mon[34812]: from='osd.9 [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:06:43.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:42 smithi084 ceph-mon[34812]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]: dispatch 2024-09-10T10:06:43.912 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-10T10:06:43.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi084:vg_nvme/lv_1 2024-09-10T10:06:44.184 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:06:44.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:43 smithi050 ceph-mon[30354]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:44.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:43 smithi050 ceph-mon[30354]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-09-10T10:06:44.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:43 smithi050 ceph-mon[30354]: osdmap e65: 10 total, 9 up, 10 in 2024-09-10T10:06:44.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:43 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:44.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:43 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:44.305 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:43 smithi084 ceph-mon[34812]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:44.305 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:43 smithi084 ceph-mon[34812]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-09-10T10:06:44.305 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:43 smithi084 ceph-mon[34812]: osdmap e65: 10 total, 9 up, 10 in 2024-09-10T10:06:44.305 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:43 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:44.305 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:43 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:44.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:43 smithi189 ceph-mon[34999]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:06:44.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:43 smithi189 ceph-mon[34999]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-09-10T10:06:44.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:43 smithi189 ceph-mon[34999]: osdmap e65: 10 total, 9 up, 10 in 2024-09-10T10:06:44.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:43 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:44.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:43 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.701+0000 7f06aafcb640 1 -- 172.21.15.84:0/3200834330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a4101d10 msgr2=0x7f06a4102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.701+0000 7f06aafcb640 1 --2- 172.21.15.84:0/3200834330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a4101d10 0x7f06a4102190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0694009ca0 tx=0x7f069402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.701+0000 7f06aafcb640 1 -- 172.21.15.84:0/3200834330 shutdown_connections 2024-09-10T10:06:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.701+0000 7f06aafcb640 1 --2- 172.21.15.84:0/3200834330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06a41026d0 0x7f06a4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.701+0000 7f06aafcb640 1 --2- 172.21.15.84:0/3200834330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a4101d10 0x7f06a4102190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.701+0000 7f06aafcb640 1 --2- 172.21.15.84:0/3200834330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06a4100b10 0x7f06a4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.701+0000 7f06aafcb640 1 -- 172.21.15.84:0/3200834330 >> 172.21.15.84:0/3200834330 conn(0x7f06a40fc2a0 msgr2=0x7f06a40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:06:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.701+0000 7f06aafcb640 1 -- 172.21.15.84:0/3200834330 shutdown_connections 2024-09-10T10:06:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.701+0000 7f06aafcb640 1 -- 172.21.15.84:0/3200834330 wait complete. 2024-09-10T10:06:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.701+0000 7f06aafcb640 1 Processor -- start 2024-09-10T10:06:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.701+0000 7f06aafcb640 1 -- start start 2024-09-10T10:06:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06aafcb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a4100b10 0x7f06a406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06aafcb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06a4101d10 0x7f06a419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06aafcb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06a41026d0 0x7f06a419f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06aafcb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f06a410c790 con 0x7f06a4101d10 2024-09-10T10:06:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06aafcb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f06a410c610 con 0x7f06a4100b10 2024-09-10T10:06:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06aafcb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f06a410c910 con 0x7f06a41026d0 2024-09-10T10:06:44.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a8d67640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a4100b10 0x7f06a406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a8d67640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a4100b10 0x7f06a406b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60662/0 (socket says 172.21.15.84:60662) 2024-09-10T10:06:44.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a8d67640 1 -- 172.21.15.84:0/3653648512 learned_addr learned my addr 172.21.15.84:0/3653648512 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-10T10:06:44.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a9568640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06a41026d0 0x7f06a419f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a3fff640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06a4101d10 0x7f06a419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a8d67640 1 -- 172.21.15.84:0/3653648512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06a41026d0 msgr2=0x7f06a419f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a8d67640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06a41026d0 0x7f06a419f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a8d67640 1 -- 172.21.15.84:0/3653648512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06a4101d10 msgr2=0x7f06a419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:06:44.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a8d67640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06a4101d10 0x7f06a419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:06:44.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a8d67640 1 -- 172.21.15.84:0/3653648512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a419fba0 con 0x7f06a4100b10 2024-09-10T10:06:44.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a8d67640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a4100b10 0x7f06a406b2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f068c00d950 tx=0x7f068c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:44.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a1ffb640 1 -- 172.21.15.84:0/3653648512 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c017070 con 0x7f06a4100b10 2024-09-10T10:06:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a1ffb640 1 -- 172.21.15.84:0/3653648512 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f068c009c30 con 0x7f06a4100b10 2024-09-10T10:06:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06aafcb640 1 -- 172.21.15.84:0/3653648512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a419fe30 con 0x7f06a4100b10 2024-09-10T10:06:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.702+0000 7f06a1ffb640 1 -- 172.21.15.84:0/3653648512 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c00f600 con 0x7f06a4100b10 2024-09-10T10:06:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.703+0000 7f06aafcb640 1 -- 172.21.15.84:0/3653648512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a41a0230 con 0x7f06a4100b10 2024-09-10T10:06:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.704+0000 7f06aafcb640 1 -- 172.21.15.84:0/3653648512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a4107f30 con 0x7f06a4100b10 2024-09-10T10:06:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.705+0000 7f06a1ffb640 1 -- 172.21.15.84:0/3653648512 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f068c01a070 con 0x7f06a4100b10 2024-09-10T10:06:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.705+0000 7f06a1ffb640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f06900a2b80 0x7f06900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:06:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.706+0000 7f06a1ffb640 1 -- 172.21.15.84:0/3653648512 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6261+0+0 (secure 0 0 0) 0x7f068c0ce220 con 0x7f06a4100b10 2024-09-10T10:06:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.706+0000 7f06a3fff640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f06900a2b80 0x7f06900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:06:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.706+0000 7f06a3fff640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f06900a2b80 0x7f06900a5040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06a406b070 tx=0x7f0694009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:06:44.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.710+0000 7f06a1ffb640 1 -- 172.21.15.84:0/3653648512 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f068c009de0 con 0x7f06a4100b10 2024-09-10T10:06:44.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:06:44.890+0000 7f06aafcb640 1 -- 172.21.15.84:0/3653648512 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f06a4062630 con 0x7f06900a2b80 2024-09-10T10:06:45.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: purged_snaps scrub starts 2024-09-10T10:06:45.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: purged_snaps scrub ok 2024-09-10T10:06:45.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: osd.9 [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226] boot 2024-09-10T10:06:45.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: osdmap e66: 10 total, 10 up, 10 in 2024-09-10T10:06:45.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:45.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: Detected new or changed devices on smithi050 2024-09-10T10:06:45.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:45.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:45.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:45.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:45.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:45.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:45.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:45.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:45.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:45.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:45.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:06:45.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:06:45.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:45.296 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: purged_snaps scrub starts 2024-09-10T10:06:45.296 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: purged_snaps scrub ok 2024-09-10T10:06:45.296 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: osd.9 [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226] boot 2024-09-10T10:06:45.296 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: osdmap e66: 10 total, 10 up, 10 in 2024-09-10T10:06:45.296 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:45.296 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: Detected new or changed devices on smithi050 2024-09-10T10:06:45.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:45.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:45.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:45.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:45.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:45.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:45.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:45.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:45.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:45.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:45.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:06:45.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:06:45.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:45.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: purged_snaps scrub starts 2024-09-10T10:06:45.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: purged_snaps scrub ok 2024-09-10T10:06:45.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: osd.9 [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226] boot 2024-09-10T10:06:45.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: osdmap e66: 10 total, 10 up, 10 in 2024-09-10T10:06:45.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:06:45.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: Detected new or changed devices on smithi050 2024-09-10T10:06:45.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:45.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:45.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:45.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:45.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:45.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:06:45.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:45.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:45.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:06:45.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:06:45.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:06:45.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:06:45.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:46.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:45 smithi050 ceph-mon[30354]: Adjusting osd_memory_target on smithi050 to 4273M 2024-09-10T10:06:46.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:45 smithi050 ceph-mon[30354]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:46.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:45 smithi050 ceph-mon[30354]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:46.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:45 smithi050 ceph-mon[30354]: osdmap e67: 10 total, 10 up, 10 in 2024-09-10T10:06:46.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:45 smithi189 ceph-mon[34999]: Adjusting osd_memory_target on smithi050 to 4273M 2024-09-10T10:06:46.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:45 smithi189 ceph-mon[34999]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:46.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:45 smithi189 ceph-mon[34999]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:46.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:45 smithi189 ceph-mon[34999]: osdmap e67: 10 total, 10 up, 10 in 2024-09-10T10:06:46.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:45 smithi084 ceph-mon[34812]: Adjusting osd_memory_target on smithi050 to 4273M 2024-09-10T10:06:46.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:45 smithi084 ceph-mon[34812]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:46.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:45 smithi084 ceph-mon[34812]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:06:46.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:45 smithi084 ceph-mon[34812]: osdmap e67: 10 total, 10 up, 10 in 2024-09-10T10:06:48.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:47 smithi084 ceph-mon[34812]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:48.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:47 smithi084 ceph-mon[34812]: from='client.? 172.21.15.84:0/474492457' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0e5ac95-60a0-4425-b069-1c87439d05bc"}]: dispatch 2024-09-10T10:06:48.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:47 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0e5ac95-60a0-4425-b069-1c87439d05bc"}]: dispatch 2024-09-10T10:06:48.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:47 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0e5ac95-60a0-4425-b069-1c87439d05bc"}]': finished 2024-09-10T10:06:48.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:47 smithi084 ceph-mon[34812]: osdmap e68: 11 total, 10 up, 11 in 2024-09-10T10:06:48.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:47 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:06:48.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:47 smithi050 ceph-mon[30354]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:48.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:47 smithi050 ceph-mon[30354]: from='client.? 172.21.15.84:0/474492457' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0e5ac95-60a0-4425-b069-1c87439d05bc"}]: dispatch 2024-09-10T10:06:48.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:47 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0e5ac95-60a0-4425-b069-1c87439d05bc"}]: dispatch 2024-09-10T10:06:48.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:47 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0e5ac95-60a0-4425-b069-1c87439d05bc"}]': finished 2024-09-10T10:06:48.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:47 smithi050 ceph-mon[30354]: osdmap e68: 11 total, 10 up, 11 in 2024-09-10T10:06:48.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:47 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:06:48.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:47 smithi189 ceph-mon[34999]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:48.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:47 smithi189 ceph-mon[34999]: from='client.? 172.21.15.84:0/474492457' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0e5ac95-60a0-4425-b069-1c87439d05bc"}]: dispatch 2024-09-10T10:06:48.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:47 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0e5ac95-60a0-4425-b069-1c87439d05bc"}]: dispatch 2024-09-10T10:06:48.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:47 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0e5ac95-60a0-4425-b069-1c87439d05bc"}]': finished 2024-09-10T10:06:48.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:47 smithi189 ceph-mon[34999]: osdmap e68: 11 total, 10 up, 11 in 2024-09-10T10:06:48.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:47 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:06:49.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:48 smithi050 ceph-mon[30354]: from='client.? 172.21.15.84:0/1940148242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:06:49.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:48 smithi189 ceph-mon[34999]: from='client.? 172.21.15.84:0/1940148242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:06:49.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:48 smithi084 ceph-mon[34812]: from='client.? 172.21.15.84:0/1940148242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:06:50.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:49 smithi050 ceph-mon[30354]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:50.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:49 smithi189 ceph-mon[34999]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:50.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:49 smithi084 ceph-mon[34812]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:52.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:51 smithi050 ceph-mon[30354]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:52.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:51 smithi189 ceph-mon[34999]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:52.346 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:51 smithi084 ceph-mon[34812]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:54.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:53 smithi084 ceph-mon[34812]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:54.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:53 smithi189 ceph-mon[34999]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:54.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:53 smithi050 ceph-mon[30354]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:56.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:55 smithi189 ceph-mon[34999]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:56.348 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:55 smithi084 ceph-mon[34812]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:56.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:55 smithi050 ceph-mon[30354]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:57.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T10:06:57.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:57.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:56 smithi189 ceph-mon[34999]: Deploying daemon osd.10 on smithi084 2024-09-10T10:06:57.343 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T10:06:57.343 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:57.343 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:56 smithi084 ceph-mon[34812]: Deploying daemon osd.10 on smithi084 2024-09-10T10:06:57.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T10:06:57.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:06:57.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:56 smithi050 ceph-mon[30354]: Deploying daemon osd.10 on smithi084 2024-09-10T10:06:58.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:57 smithi084 ceph-mon[34812]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:58.346 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:57 smithi189 ceph-mon[34999]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:06:58.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:57 smithi050 ceph-mon[30354]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:00.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:06:59 smithi084 ceph-mon[34812]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:00.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:06:59 smithi189 ceph-mon[34999]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:00.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:06:59 smithi050 ceph-mon[30354]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:02.257 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:01 smithi084 ceph-mon[34812]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:02.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:01 smithi189 ceph-mon[34999]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:02.464 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:01 smithi050 ceph-mon[30354]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:03.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:03.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:03.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:03.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:03.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:03.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:03.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:03.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:03.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:04.559 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:04 smithi084 ceph-mon[34812]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:04.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:04 smithi189 ceph-mon[34999]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:04.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:04 smithi050 ceph-mon[30354]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:06.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:07:06.059+0000 7f06a1ffb640 1 -- 172.21.15.84:0/3653648512 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f06a4062630 con 0x7f06900a2b80 2024-09-10T10:07:06.060 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 10 on host 'smithi084' 2024-09-10T10:07:06.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:07:06.061+0000 7f06aafcb640 1 -- 172.21.15.84:0/3653648512 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f06900a2b80 msgr2=0x7f06900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:06.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:07:06.061+0000 7f06aafcb640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f06900a2b80 0x7f06900a5040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06a406b070 tx=0x7f0694009360 comp rx=0 tx=0).stop 2024-09-10T10:07:06.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:07:06.061+0000 7f06aafcb640 1 -- 172.21.15.84:0/3653648512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a4100b10 msgr2=0x7f06a406b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:06.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:07:06.061+0000 7f06aafcb640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a4100b10 0x7f06a406b2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f068c00d950 tx=0x7f068c00de10 comp rx=0 tx=0).stop 2024-09-10T10:07:06.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:07:06.061+0000 7f06aafcb640 1 -- 172.21.15.84:0/3653648512 shutdown_connections 2024-09-10T10:07:06.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:07:06.061+0000 7f06aafcb640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f06900a2b80 0x7f06900a5040 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:06.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:07:06.061+0000 7f06aafcb640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06a41026d0 0x7f06a419f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:06.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:07:06.061+0000 7f06aafcb640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06a4101d10 0x7f06a419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:06.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:07:06.061+0000 7f06aafcb640 1 --2- 172.21.15.84:0/3653648512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06a4100b10 0x7f06a406b2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:06.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:07:06.061+0000 7f06aafcb640 1 -- 172.21.15.84:0/3653648512 >> 172.21.15.84:0/3653648512 conn(0x7f06a40fc2a0 msgr2=0x7f06a4105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:06.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:07:06.061+0000 7f06aafcb640 1 -- 172.21.15.84:0/3653648512 shutdown_connections 2024-09-10T10:07:06.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-10T10:07:06.061+0000 7f06aafcb640 1 -- 172.21.15.84:0/3653648512 wait complete. 2024-09-10T10:07:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:06 smithi050 ceph-mon[30354]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:06 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:06 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:06 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:06 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:06 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:06 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:06 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:06 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.783 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:06 smithi084 ceph-mon[34812]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:06.783 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:06 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.783 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:06 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.784 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:06 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:06.784 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:06 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:06.784 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:06 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.784 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:06 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:06.784 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:06 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.784 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:06 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.810 DEBUG:teuthology.orchestra.run.smithi084:osd.10> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T10:07:06.812 INFO:tasks.cephadm:Deploying osd.11 on smithi189 with /dev/vg_nvme/lv_1... 2024-09-10T10:07:06.812 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T10:07:06.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:06 smithi189 ceph-mon[34999]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:06.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:06 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:06 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:06 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:06.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:06 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:06.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:06 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:06 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:06.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:06 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:06.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:06 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:07.070 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:07:08.287 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:07:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:07:08.139+0000 7fbad2d66640 -1 osd.10 0 log_to_monitors true 2024-09-10T10:07:08.470 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:08 smithi050 ceph-mon[30354]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:08.470 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:08 smithi050 ceph-mon[30354]: from='osd.10 [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:07:08.470 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:08 smithi050 ceph-mon[30354]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:07:08.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:08 smithi189 ceph-mon[34999]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:08.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:08 smithi189 ceph-mon[34999]: from='osd.10 [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:07:08.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:08 smithi189 ceph-mon[34999]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:07:08.570 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:08 smithi084 ceph-mon[34812]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:08.571 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:08 smithi084 ceph-mon[34812]: from='osd.10 [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:07:08.571 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:08 smithi084 ceph-mon[34812]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:07:09.516 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:09 smithi084 ceph-mon[34812]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T10:07:09.516 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:09 smithi084 ceph-mon[34812]: osdmap e69: 11 total, 10 up, 11 in 2024-09-10T10:07:09.516 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:09 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:09.516 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:09 smithi084 ceph-mon[34812]: from='osd.10 [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:07:09.516 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:09 smithi084 ceph-mon[34812]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:07:09.712 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:09 smithi189 ceph-mon[34999]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T10:07:09.712 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:09 smithi189 ceph-mon[34999]: osdmap e69: 11 total, 10 up, 11 in 2024-09-10T10:07:09.712 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:09 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:09.712 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:09 smithi189 ceph-mon[34999]: from='osd.10 [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:07:09.712 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:09 smithi189 ceph-mon[34999]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:07:09.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:09 smithi050 ceph-mon[30354]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T10:07:09.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:09 smithi050 ceph-mon[30354]: osdmap e69: 11 total, 10 up, 11 in 2024-09-10T10:07:09.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:09 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:09.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:09 smithi050 ceph-mon[30354]: from='osd.10 [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:07:09.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:09 smithi050 ceph-mon[30354]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-09-10T10:07:10.073 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T10:07:10.099 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_1 2024-09-10T10:07:10.100 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:07:09 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:07:09.782+0000 7fbacece9640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T10:07:10.100 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:07:09 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:07:09.796+0000 7fbac6b09640 -1 osd.10 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:07:10.388 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:07:10.659 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:10.659 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-10T10:07:10.659 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: osdmap e70: 11 total, 10 up, 11 in 2024-09-10T10:07:10.659 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:10.659 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:10.659 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='osd.10 ' entity='osd.10' 2024-09-10T10:07:10.659 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:10.659 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:10.660 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:10.660 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:10.660 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:10.660 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:10.660 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:10.660 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:10.660 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:10.660 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:10.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:10.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-10T10:07:10.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: osdmap e70: 11 total, 10 up, 11 in 2024-09-10T10:07:10.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:10.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:10.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='osd.10 ' entity='osd.10' 2024-09-10T10:07:10.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:10.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:10.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:10.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:10.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:10.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:10.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:10.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:10.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:10.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:10.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:10.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-10T10:07:10.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: osdmap e70: 11 total, 10 up, 11 in 2024-09-10T10:07:10.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:10.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:10.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='osd.10 ' entity='osd.10' 2024-09-10T10:07:10.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:10.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:10.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:10.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:10.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:10.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:10.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:10.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:10.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:10.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:10.931 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.915+0000 7f9db605d640 1 -- 172.21.15.189:0/1020256140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9db0101c10 msgr2=0x7f9db0102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:10.931 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.915+0000 7f9db605d640 1 --2- 172.21.15.189:0/1020256140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9db0101c10 0x7f9db0102010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009900 tx=0x7f9da002a410 comp rx=0 tx=0).stop 2024-09-10T10:07:10.931 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.915+0000 7f9db605d640 1 -- 172.21.15.189:0/1020256140 shutdown_connections 2024-09-10T10:07:10.931 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.915+0000 7f9db605d640 1 --2- 172.21.15.189:0/1020256140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db01037d0 0x7f9db010a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:10.931 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.915+0000 7f9db605d640 1 --2- 172.21.15.189:0/1020256140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db0102e10 0x7f9db0103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:10.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.915+0000 7f9db605d640 1 --2- 172.21.15.189:0/1020256140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9db0101c10 0x7f9db0102010 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:10.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.915+0000 7f9db605d640 1 -- 172.21.15.189:0/1020256140 >> 172.21.15.189:0/1020256140 conn(0x7f9db00fd3c0 msgr2=0x7f9db00ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:10.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.915+0000 7f9db605d640 1 -- 172.21.15.189:0/1020256140 shutdown_connections 2024-09-10T10:07:10.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.915+0000 7f9db605d640 1 -- 172.21.15.189:0/1020256140 wait complete. 2024-09-10T10:07:10.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9db605d640 1 Processor -- start 2024-09-10T10:07:10.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9db605d640 1 -- start start 2024-09-10T10:07:10.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9db605d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0101c10 0x7f9db0197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:10.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9db605d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db0102e10 0x7f9db0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:10.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9db605d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9db01037d0 0x7f9db019f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:10.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9db605d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9db010d910 con 0x7f9db0101c10 2024-09-10T10:07:10.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9db605d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9db010d790 con 0x7f9db0102e10 2024-09-10T10:07:10.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9db605d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9db010da90 con 0x7f9db01037d0 2024-09-10T10:07:10.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9daffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9db01037d0 0x7f9db019f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:10.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9daffff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9db01037d0 0x7f9db019f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:37786/0 (socket says 172.21.15.189:37786) 2024-09-10T10:07:10.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9daffff640 1 -- 172.21.15.189:0/1788705678 learned_addr learned my addr 172.21.15.189:0/1788705678 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T10:07:10.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9daeffd640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db0102e10 0x7f9db0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:10.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9daf7fe640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0101c10 0x7f9db0197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:10.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9daffff640 1 -- 172.21.15.189:0/1788705678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db0102e10 msgr2=0x7f9db0198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:10.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9daffff640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db0102e10 0x7f9db0198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:10.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9daffff640 1 -- 172.21.15.189:0/1788705678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0101c10 msgr2=0x7f9db0197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:10.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.916+0000 7f9daffff640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0101c10 0x7f9db0197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:10.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.917+0000 7f9daffff640 1 -- 172.21.15.189:0/1788705678 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db019fb80 con 0x7f9db01037d0 2024-09-10T10:07:10.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.917+0000 7f9daeffd640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db0102e10 0x7f9db0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:07:10.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.917+0000 7f9daffff640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9db01037d0 0x7f9db019f510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9da800b970 tx=0x7f9da800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:10.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.917+0000 7f9dacff9640 1 -- 172.21.15.189:0/1788705678 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8019070 con 0x7f9db01037d0 2024-09-10T10:07:10.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.917+0000 7f9dacff9640 1 -- 172.21.15.189:0/1788705678 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9da800cb40 con 0x7f9db01037d0 2024-09-10T10:07:10.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.917+0000 7f9db605d640 1 -- 172.21.15.189:0/1788705678 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db019fe70 con 0x7f9db01037d0 2024-09-10T10:07:10.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.917+0000 7f9dacff9640 1 -- 172.21.15.189:0/1788705678 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8007650 con 0x7f9db01037d0 2024-09-10T10:07:10.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.917+0000 7f9db605d640 1 -- 172.21.15.189:0/1788705678 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db01a0350 con 0x7f9db01037d0 2024-09-10T10:07:10.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.918+0000 7f9db605d640 1 -- 172.21.15.189:0/1788705678 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db0108fb0 con 0x7f9db01037d0 2024-09-10T10:07:10.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.919+0000 7f9dacff9640 1 -- 172.21.15.189:0/1788705678 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9da801c070 con 0x7f9db01037d0 2024-09-10T10:07:10.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.920+0000 7f9dacff9640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9d980a2bb0 0x7f9d980a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:10.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.920+0000 7f9dacff9640 1 -- 172.21.15.189:0/1788705678 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6727+0+0 (secure 0 0 0) 0x7f9da80ce050 con 0x7f9db01037d0 2024-09-10T10:07:10.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.920+0000 7f9daf7fe640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9d980a2bb0 0x7f9d980a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:10.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.921+0000 7f9daf7fe640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9d980a2bb0 0x7f9d980a5070 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9da0031610 tx=0x7f9da0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:10.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:10.924+0000 7f9dacff9640 1 -- 172.21.15.189:0/1788705678 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9da809b5e0 con 0x7f9db01037d0 2024-09-10T10:07:11.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:11.100+0000 7f9db605d640 1 -- 172.21.15.189:0/1788705678 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9db0062630 con 0x7f9d980a2bb0 2024-09-10T10:07:11.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:11 smithi189 ceph-mon[34999]: purged_snaps scrub starts 2024-09-10T10:07:11.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:11 smithi189 ceph-mon[34999]: purged_snaps scrub ok 2024-09-10T10:07:11.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:11 smithi189 ceph-mon[34999]: Detected new or changed devices on smithi084 2024-09-10T10:07:11.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:11 smithi189 ceph-mon[34999]: Adjusting osd_memory_target on smithi084 to 4272M 2024-09-10T10:07:11.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:11 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:11.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:11 smithi189 ceph-mon[34999]: osd.10 [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613] boot 2024-09-10T10:07:11.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:11 smithi189 ceph-mon[34999]: osdmap e71: 11 total, 11 up, 11 in 2024-09-10T10:07:11.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:11 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:11.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:11 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:07:11.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:11 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:07:11.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:11 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:11.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:11 smithi050 ceph-mon[30354]: purged_snaps scrub starts 2024-09-10T10:07:11.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:11 smithi050 ceph-mon[30354]: purged_snaps scrub ok 2024-09-10T10:07:11.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:11 smithi050 ceph-mon[30354]: Detected new or changed devices on smithi084 2024-09-10T10:07:11.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:11 smithi050 ceph-mon[30354]: Adjusting osd_memory_target on smithi084 to 4272M 2024-09-10T10:07:11.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:11 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:11.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:11 smithi050 ceph-mon[30354]: osd.10 [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613] boot 2024-09-10T10:07:11.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:11 smithi050 ceph-mon[30354]: osdmap e71: 11 total, 11 up, 11 in 2024-09-10T10:07:11.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:11 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:11.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:11 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:07:11.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:11 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:07:11.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:11 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:11.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:11 smithi084 ceph-mon[34812]: purged_snaps scrub starts 2024-09-10T10:07:11.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:11 smithi084 ceph-mon[34812]: purged_snaps scrub ok 2024-09-10T10:07:11.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:11 smithi084 ceph-mon[34812]: Detected new or changed devices on smithi084 2024-09-10T10:07:11.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:11 smithi084 ceph-mon[34812]: Adjusting osd_memory_target on smithi084 to 4272M 2024-09-10T10:07:11.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:11 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:11.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:11 smithi084 ceph-mon[34812]: osd.10 [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613] boot 2024-09-10T10:07:11.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:11 smithi084 ceph-mon[34812]: osdmap e71: 11 total, 11 up, 11 in 2024-09-10T10:07:11.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:11 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:07:11.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:11 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:07:11.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:11 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:07:11.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:11 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:12.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:12 smithi189 ceph-mon[34999]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:12.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:12 smithi189 ceph-mon[34999]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:12.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:12 smithi189 ceph-mon[34999]: osdmap e72: 11 total, 11 up, 11 in 2024-09-10T10:07:12.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:12 smithi084 ceph-mon[34812]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:12.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:12 smithi084 ceph-mon[34812]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:12.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:12 smithi084 ceph-mon[34812]: osdmap e72: 11 total, 11 up, 11 in 2024-09-10T10:07:12.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:12 smithi050 ceph-mon[30354]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:07:12.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:12 smithi050 ceph-mon[30354]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:12.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:12 smithi050 ceph-mon[30354]: osdmap e72: 11 total, 11 up, 11 in 2024-09-10T10:07:13.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:13 smithi189 ceph-mon[34999]: osdmap e73: 11 total, 11 up, 11 in 2024-09-10T10:07:13.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:13 smithi084 ceph-mon[34812]: osdmap e73: 11 total, 11 up, 11 in 2024-09-10T10:07:13.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:13 smithi050 ceph-mon[30354]: osdmap e73: 11 total, 11 up, 11 in 2024-09-10T10:07:14.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:14 smithi189 ceph-mon[34999]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:14.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:14 smithi189 ceph-mon[34999]: osdmap e74: 11 total, 11 up, 11 in 2024-09-10T10:07:14.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:14 smithi189 ceph-mon[34999]: from='client.? 172.21.15.189:0/1077190315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "613818bd-4319-4c6f-b3a9-2e034bfe1d5c"}]: dispatch 2024-09-10T10:07:14.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:14 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "613818bd-4319-4c6f-b3a9-2e034bfe1d5c"}]: dispatch 2024-09-10T10:07:14.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:14 smithi189 ceph-mon[34999]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "613818bd-4319-4c6f-b3a9-2e034bfe1d5c"}]': finished 2024-09-10T10:07:14.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:14 smithi189 ceph-mon[34999]: osdmap e75: 12 total, 11 up, 12 in 2024-09-10T10:07:14.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:14 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:14.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:14 smithi189 ceph-mon[34999]: from='client.? 172.21.15.189:0/100541775' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:07:14.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:14 smithi084 ceph-mon[34812]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:14.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:14 smithi084 ceph-mon[34812]: osdmap e74: 11 total, 11 up, 11 in 2024-09-10T10:07:14.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:14 smithi084 ceph-mon[34812]: from='client.? 172.21.15.189:0/1077190315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "613818bd-4319-4c6f-b3a9-2e034bfe1d5c"}]: dispatch 2024-09-10T10:07:14.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:14 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "613818bd-4319-4c6f-b3a9-2e034bfe1d5c"}]: dispatch 2024-09-10T10:07:14.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:14 smithi084 ceph-mon[34812]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "613818bd-4319-4c6f-b3a9-2e034bfe1d5c"}]': finished 2024-09-10T10:07:14.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:14 smithi084 ceph-mon[34812]: osdmap e75: 12 total, 11 up, 12 in 2024-09-10T10:07:14.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:14 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:14.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:14 smithi084 ceph-mon[34812]: from='client.? 172.21.15.189:0/100541775' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:07:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:14 smithi050 ceph-mon[30354]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:14 smithi050 ceph-mon[30354]: osdmap e74: 11 total, 11 up, 11 in 2024-09-10T10:07:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:14 smithi050 ceph-mon[30354]: from='client.? 172.21.15.189:0/1077190315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "613818bd-4319-4c6f-b3a9-2e034bfe1d5c"}]: dispatch 2024-09-10T10:07:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:14 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "613818bd-4319-4c6f-b3a9-2e034bfe1d5c"}]: dispatch 2024-09-10T10:07:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:14 smithi050 ceph-mon[30354]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "613818bd-4319-4c6f-b3a9-2e034bfe1d5c"}]': finished 2024-09-10T10:07:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:14 smithi050 ceph-mon[30354]: osdmap e75: 12 total, 11 up, 12 in 2024-09-10T10:07:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:14 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:14.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:14 smithi050 ceph-mon[30354]: from='client.? 172.21.15.189:0/100541775' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:07:16.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:16 smithi189 ceph-mon[34999]: pgmap v253: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-10T10:07:16.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:16 smithi084 ceph-mon[34812]: pgmap v253: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-10T10:07:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:16 smithi050 ceph-mon[30354]: pgmap v253: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-10T10:07:18.816 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:18 smithi189 ceph-mon[34999]: pgmap v254: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T10:07:18.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:18 smithi084 ceph-mon[34812]: pgmap v254: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T10:07:18.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:18 smithi050 ceph-mon[30354]: pgmap v254: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T10:07:20.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:20 smithi189 ceph-mon[34999]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T10:07:20.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:20 smithi084 ceph-mon[34812]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T10:07:20.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:20 smithi050 ceph-mon[30354]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T10:07:22.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:22 smithi189 ceph-mon[34999]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:07:22.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:22 smithi084 ceph-mon[34812]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:07:22.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:22 smithi050 ceph-mon[30354]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:07:23.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:23 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T10:07:23.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:23 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:23.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:23 smithi189 ceph-mon[34999]: Deploying daemon osd.11 on smithi189 2024-09-10T10:07:23.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:23 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T10:07:23.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:23 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:23.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:23 smithi084 ceph-mon[34812]: Deploying daemon osd.11 on smithi189 2024-09-10T10:07:23.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:23 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T10:07:23.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:23 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:23.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:23 smithi050 ceph-mon[30354]: Deploying daemon osd.11 on smithi189 2024-09-10T10:07:24.728 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:24 smithi189 ceph-mon[34999]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T10:07:24.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:24 smithi084 ceph-mon[34812]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T10:07:24.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:24 smithi050 ceph-mon[30354]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T10:07:26.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:26 smithi189 ceph-mon[34999]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T10:07:26.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:26 smithi084 ceph-mon[34812]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T10:07:26.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:26 smithi050 ceph-mon[30354]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T10:07:28.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:28 smithi189 ceph-mon[34999]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:28.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:28 smithi084 ceph-mon[34812]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:28.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:28 smithi050 ceph-mon[30354]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:29.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:29.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:29.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:29.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:29.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:29.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:29.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:29.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:29.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:30.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:30 smithi189 ceph-mon[34999]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:30.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:30 smithi084 ceph-mon[34812]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:30.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:30 smithi050 ceph-mon[30354]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:32.550 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 11 on host 'smithi189' 2024-09-10T10:07:32.551 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:32.548+0000 7f9dacff9640 1 -- 172.21.15.189:0/1788705678 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9db0062630 con 0x7f9d980a2bb0 2024-09-10T10:07:32.552 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:32.551+0000 7f9db605d640 1 -- 172.21.15.189:0/1788705678 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9d980a2bb0 msgr2=0x7f9d980a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:32.552 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:32.551+0000 7f9db605d640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9d980a2bb0 0x7f9d980a5070 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9da0031610 tx=0x7f9da0000bc0 comp rx=0 tx=0).stop 2024-09-10T10:07:32.553 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:32.551+0000 7f9db605d640 1 -- 172.21.15.189:0/1788705678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9db01037d0 msgr2=0x7f9db019f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:32.553 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:32.551+0000 7f9db605d640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9db01037d0 0x7f9db019f510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9da800b970 tx=0x7f9da800be30 comp rx=0 tx=0).stop 2024-09-10T10:07:32.553 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:32.551+0000 7f9db605d640 1 -- 172.21.15.189:0/1788705678 shutdown_connections 2024-09-10T10:07:32.553 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:32.551+0000 7f9db605d640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9d980a2bb0 0x7f9d980a5070 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:32.553 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:32.551+0000 7f9db605d640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9db01037d0 0x7f9db019f510 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:32.553 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:32.551+0000 7f9db605d640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db0102e10 0x7f9db0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:32.553 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:32.551+0000 7f9db605d640 1 --2- 172.21.15.189:0/1788705678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0101c10 0x7f9db0197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:32.553 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:32.551+0000 7f9db605d640 1 -- 172.21.15.189:0/1788705678 >> 172.21.15.189:0/1788705678 conn(0x7f9db00fd3c0 msgr2=0x7f9db0106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:32.553 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:32.551+0000 7f9db605d640 1 -- 172.21.15.189:0/1788705678 shutdown_connections 2024-09-10T10:07:32.553 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:32.551+0000 7f9db605d640 1 -- 172.21.15.189:0/1788705678 wait complete. 2024-09-10T10:07:32.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:32 smithi189 ceph-mon[34999]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:32.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:32 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:32.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:32 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:32.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:32 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:32.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:32 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:32.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:32 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:32.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:32 smithi084 ceph-mon[34812]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:32.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:32 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:32.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:32 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:32.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:32 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:32.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:32 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:32.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:32 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:32 smithi050 ceph-mon[30354]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:33.230 DEBUG:teuthology.orchestra.run.smithi189:osd.11> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T10:07:33.232 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T10:07:33.232 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T10:07:33.620 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:07:33.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:33 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:33.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:33 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:33.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:33 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:33.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:33 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:33.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:33 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:33.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:33 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:33.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:33 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:33.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:33 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:33.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:33 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.188+0000 7f6730a00640 1 -- 172.21.15.50:0/3885351010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f672c104f60 msgr2=0x7f672c1053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.188+0000 7f6730a00640 1 --2- 172.21.15.50:0/3885351010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f672c104f60 0x7f672c1053e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6718009900 tx=0x7f671802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:07:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.188+0000 7f6730a00640 1 -- 172.21.15.50:0/3885351010 shutdown_connections 2024-09-10T10:07:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.188+0000 7f6730a00640 1 --2- 172.21.15.50:0/3885351010 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f672c105920 0x7f672c10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:34.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.188+0000 7f6730a00640 1 --2- 172.21.15.50:0/3885351010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f672c104f60 0x7f672c1053e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.188+0000 7f6730a00640 1 --2- 172.21.15.50:0/3885351010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f672c103e00 0x7f672c104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.188+0000 7f6730a00640 1 -- 172.21.15.50:0/3885351010 >> 172.21.15.50:0/3885351010 conn(0x7f672c0ff5b0 msgr2=0x7f672c1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.188+0000 7f6730a00640 1 -- 172.21.15.50:0/3885351010 shutdown_connections 2024-09-10T10:07:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.188+0000 7f6730a00640 1 -- 172.21.15.50:0/3885351010 wait complete. 2024-09-10T10:07:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.189+0000 7f6730a00640 1 Processor -- start 2024-09-10T10:07:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.189+0000 7f6730a00640 1 -- start start 2024-09-10T10:07:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.190+0000 7f6730a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f672c103e00 0x7f672c19a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.190+0000 7f6730a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f672c104f60 0x7f672c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:34.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.190+0000 7f6730a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f672c105920 0x7f672c1a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:34.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.190+0000 7f6730a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f672c10fa90 con 0x7f672c104f60 2024-09-10T10:07:34.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.190+0000 7f6730a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f672c10f910 con 0x7f672c105920 2024-09-10T10:07:34.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.190+0000 7f6730a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f672c10fc10 con 0x7f672c103e00 2024-09-10T10:07:34.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.190+0000 7f6729400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f672c104f60 0x7f672c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:34.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.190+0000 7f6729e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f672c103e00 0x7f672c19a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:34.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.190+0000 7f6729400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f672c104f60 0x7f672c19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52574/0 (socket says 172.21.15.50:52574) 2024-09-10T10:07:34.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.190+0000 7f6729400640 1 -- 172.21.15.50:0/993448516 learned_addr learned my addr 172.21.15.50:0/993448516 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:07:34.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.190+0000 7f672a800640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f672c105920 0x7f672c1a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:34.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.191+0000 7f6729400640 1 -- 172.21.15.50:0/993448516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f672c103e00 msgr2=0x7f672c19a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.191+0000 7f6729400640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f672c103e00 0x7f672c19a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.191+0000 7f6729400640 1 -- 172.21.15.50:0/993448516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f672c105920 msgr2=0x7f672c1a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.191+0000 7f6729400640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f672c105920 0x7f672c1a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.191+0000 7f6729400640 1 -- 172.21.15.50:0/993448516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672c1a1d50 con 0x7f672c104f60 2024-09-10T10:07:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.191+0000 7f672a800640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f672c105920 0x7f672c1a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:07:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.191+0000 7f6729400640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f672c104f60 0x7f672c19a660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6718031610 tx=0x7f67180043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.191+0000 7f6722a00640 1 -- 172.21.15.50:0/993448516 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671803f030 con 0x7f672c104f60 2024-09-10T10:07:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.191+0000 7f6722a00640 1 -- 172.21.15.50:0/993448516 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6718003ce0 con 0x7f672c104f60 2024-09-10T10:07:34.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.191+0000 7f6722a00640 1 -- 172.21.15.50:0/993448516 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718035070 con 0x7f672c104f60 2024-09-10T10:07:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.191+0000 7f6730a00640 1 -- 172.21.15.50:0/993448516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672c1a1fe0 con 0x7f672c104f60 2024-09-10T10:07:34.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.192+0000 7f6730a00640 1 -- 172.21.15.50:0/993448516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f672c1a23d0 con 0x7f672c104f60 2024-09-10T10:07:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.193+0000 7f6730a00640 1 -- 172.21.15.50:0/993448516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f672c10b1e0 con 0x7f672c104f60 2024-09-10T10:07:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.195+0000 7f6722a00640 1 -- 172.21.15.50:0/993448516 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6718042030 con 0x7f672c104f60 2024-09-10T10:07:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.196+0000 7f6722a00640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f67100a2bb0 0x7f67100a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.196+0000 7f6722a00640 1 -- 172.21.15.50:0/993448516 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6809+0+0 (secure 0 0 0) 0x7f67180ef1c0 con 0x7f672c104f60 2024-09-10T10:07:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.197+0000 7f6729e00640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f67100a2bb0 0x7f67100a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:34.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.197+0000 7f6729e00640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f67100a2bb0 0x7f67100a5070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f671c005d00 tx=0x7f671c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:34.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.199+0000 7f6722a00640 1 -- 172.21.15.50:0/993448516 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f67180bc010 con 0x7f672c104f60 2024-09-10T10:07:34.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.384+0000 7f6730a00640 1 -- 172.21.15.50:0/993448516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f672c02d9c0 con 0x7f672c104f60 2024-09-10T10:07:34.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.384+0000 7f6722a00640 1 -- 172.21.15.50:0/993448516 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f67180c0310 con 0x7f672c104f60 2024-09-10T10:07:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:07:34.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.387+0000 7f6730a00640 1 -- 172.21.15.50:0/993448516 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f67100a2bb0 msgr2=0x7f67100a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:34.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.387+0000 7f6730a00640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f67100a2bb0 0x7f67100a5070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f671c005d00 tx=0x7f671c00b410 comp rx=0 tx=0).stop 2024-09-10T10:07:34.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.387+0000 7f6730a00640 1 -- 172.21.15.50:0/993448516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f672c104f60 msgr2=0x7f672c19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:34.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.387+0000 7f6730a00640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f672c104f60 0x7f672c19a660 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6718031610 tx=0x7f67180043b0 comp rx=0 tx=0).stop 2024-09-10T10:07:34.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.387+0000 7f6730a00640 1 -- 172.21.15.50:0/993448516 shutdown_connections 2024-09-10T10:07:34.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.387+0000 7f6730a00640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f67100a2bb0 0x7f67100a5070 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:34.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.387+0000 7f6730a00640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f672c105920 0x7f672c1a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:34.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.387+0000 7f6730a00640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f672c104f60 0x7f672c19a660 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:34.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.387+0000 7f6730a00640 1 --2- 172.21.15.50:0/993448516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f672c103e00 0x7f672c19a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:34.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.387+0000 7f6730a00640 1 -- 172.21.15.50:0/993448516 >> 172.21.15.50:0/993448516 conn(0x7f672c0ff5b0 msgr2=0x7f672c1083b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:34.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.387+0000 7f6730a00640 1 -- 172.21.15.50:0/993448516 shutdown_connections 2024-09-10T10:07:34.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:34.387+0000 7f6730a00640 1 -- 172.21.15.50:0/993448516 wait complete. 2024-09-10T10:07:34.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:34 smithi050 ceph-mon[30354]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:34.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:34 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/993448516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:07:34.723 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:34 smithi189 ceph-mon[34999]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:34.723 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:34 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/993448516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:07:34.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:34 smithi084 ceph-mon[34812]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:34.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:34 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/993448516' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:07:35.016 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:07:34 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:07:34.808+0000 7faea0691640 -1 osd.11 0 log_to_monitors true 2024-09-10T10:07:35.285 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1725962830,"num_in_osds":12,"osd_in_since":1725962833,"num_remapped_pgs":0} 2024-09-10T10:07:35.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:35 smithi189 ceph-mon[34999]: from='osd.11 [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:07:35.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:35 smithi189 ceph-mon[34999]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:07:35.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:35 smithi084 ceph-mon[34812]: from='osd.11 [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:07:35.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:35 smithi084 ceph-mon[34812]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:07:35.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:35 smithi050 ceph-mon[30354]: from='osd.11 [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:07:35.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:35 smithi050 ceph-mon[30354]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:07:36.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T10:07:36.708 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:07:36.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:07:36.571+0000 7fae9c614640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T10:07:36.837 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:07:36.586+0000 7fae9843c640 -1 osd.11 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:07:36.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:36.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T10:07:36.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: osdmap e76: 12 total, 11 up, 12 in 2024-09-10T10:07:36.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:36.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='osd.11 [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:07:36.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:07:36.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:36.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:36.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:36.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:36.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:36.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:36.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:36.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:36.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:36.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T10:07:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: osdmap e76: 12 total, 11 up, 12 in 2024-09-10T10:07:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='osd.11 [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:07:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:07:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:36.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:36.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:36.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:36.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:36.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:36.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:36.850 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:36.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T10:07:36.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: osdmap e76: 12 total, 11 up, 12 in 2024-09-10T10:07:36.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:36.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='osd.11 [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:07:36.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-09-10T10:07:36.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:36.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:36.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:36.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:36.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:36.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:07:36.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:36.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:36.852 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:36.852 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:37.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.242+0000 7f1b6f200640 1 -- 172.21.15.50:0/4219368242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b68078790 msgr2=0x7f1b68079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:37.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.242+0000 7f1b6f200640 1 --2- 172.21.15.50:0/4219368242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b68078790 0x7f1b68079030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009ca0 tx=0x7f1b6002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:07:37.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.242+0000 7f1b6f200640 1 -- 172.21.15.50:0/4219368242 shutdown_connections 2024-09-10T10:07:37.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.242+0000 7f1b6f200640 1 --2- 172.21.15.50:0/4219368242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b68078790 0x7f1b68079030 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.242+0000 7f1b6f200640 1 --2- 172.21.15.50:0/4219368242 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b68077df0 0x7f1b68078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.242+0000 7f1b6f200640 1 --2- 172.21.15.50:0/4219368242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b68076ba0 0x7f1b68076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.243+0000 7f1b6f200640 1 -- 172.21.15.50:0/4219368242 >> 172.21.15.50:0/4219368242 conn(0x7f1b680ff5b0 msgr2=0x7f1b681019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.243+0000 7f1b6f200640 1 -- 172.21.15.50:0/4219368242 shutdown_connections 2024-09-10T10:07:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.243+0000 7f1b6f200640 1 -- 172.21.15.50:0/4219368242 wait complete. 2024-09-10T10:07:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.244+0000 7f1b6f200640 1 Processor -- start 2024-09-10T10:07:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.244+0000 7f1b6f200640 1 -- start start 2024-09-10T10:07:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.244+0000 7f1b6f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b68076ba0 0x7f1b6819e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.244+0000 7f1b6f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b68077df0 0x7f1b6819e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.244+0000 7f1b6f200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b68078790 0x7f1b681a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.244+0000 7f1b6f200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68113f10 con 0x7f1b68078790 2024-09-10T10:07:37.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.244+0000 7f1b6f200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68113d90 con 0x7f1b68077df0 2024-09-10T10:07:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.244+0000 7f1b6f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68114090 con 0x7f1b68076ba0 2024-09-10T10:07:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.244+0000 7f1b67400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b68077df0 0x7f1b6819e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.244+0000 7f1b6d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b68078790 0x7f1b681a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.245+0000 7f1b67400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b68077df0 0x7f1b6819e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:56646/0 (socket says 172.21.15.50:56646) 2024-09-10T10:07:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.245+0000 7f1b67400640 1 -- 172.21.15.50:0/4103966565 learned_addr learned my addr 172.21.15.50:0/4103966565 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:07:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.245+0000 7f1b67e00640 1 --2- 172.21.15.50:0/4103966565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b68076ba0 0x7f1b6819e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.245+0000 7f1b67400640 1 -- 172.21.15.50:0/4103966565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b68076ba0 msgr2=0x7f1b6819e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.245+0000 7f1b67400640 1 --2- 172.21.15.50:0/4103966565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b68076ba0 0x7f1b6819e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.245+0000 7f1b67400640 1 -- 172.21.15.50:0/4103966565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b68078790 msgr2=0x7f1b681a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.245+0000 7f1b67400640 1 --2- 172.21.15.50:0/4103966565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b68078790 0x7f1b681a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:37.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.245+0000 7f1b67400640 1 -- 172.21.15.50:0/4103966565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b681a60d0 con 0x7f1b68077df0 2024-09-10T10:07:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.245+0000 7f1b67400640 1 --2- 172.21.15.50:0/4103966565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b68077df0 0x7f1b6819e9e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400e9f0 tx=0x7f1b5400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.245+0000 7f1b64c00640 1 -- 172.21.15.50:0/4103966565 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5400cd80 con 0x7f1b68077df0 2024-09-10T10:07:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.245+0000 7f1b64c00640 1 -- 172.21.15.50:0/4103966565 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b54005500 con 0x7f1b68077df0 2024-09-10T10:07:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.245+0000 7f1b64c00640 1 -- 172.21.15.50:0/4103966565 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54010690 con 0x7f1b68077df0 2024-09-10T10:07:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.245+0000 7f1b6f200640 1 -- 172.21.15.50:0/4103966565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b681a63c0 con 0x7f1b68077df0 2024-09-10T10:07:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.246+0000 7f1b6f200640 1 -- 172.21.15.50:0/4103966565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b681a68b0 con 0x7f1b68077df0 2024-09-10T10:07:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.247+0000 7f1b6f200640 1 -- 172.21.15.50:0/4103966565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b68110780 con 0x7f1b68077df0 2024-09-10T10:07:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.249+0000 7f1b64c00640 1 -- 172.21.15.50:0/4103966565 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1b540046c0 con 0x7f1b68077df0 2024-09-10T10:07:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.250+0000 7f1b64c00640 1 --2- 172.21.15.50:0/4103966565 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1b4c0a2bb0 0x7f1b4c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.251+0000 7f1b64c00640 1 -- 172.21.15.50:0/4103966565 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6847+0+0 (secure 0 0 0) 0x7f1b540ceef0 con 0x7f1b68077df0 2024-09-10T10:07:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.251+0000 7f1b67e00640 1 --2- 172.21.15.50:0/4103966565 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1b4c0a2bb0 0x7f1b4c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:37.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.251+0000 7f1b67e00640 1 --2- 172.21.15.50:0/4103966565 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1b4c0a2bb0 0x7f1b4c0a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009bd0 tx=0x7f1b58005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:37.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.254+0000 7f1b64c00640 1 -- 172.21.15.50:0/4103966565 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b5409c370 con 0x7f1b68077df0 2024-09-10T10:07:37.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.440+0000 7f1b6f200640 1 -- 172.21.15.50:0/4103966565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1b68062df0 con 0x7f1b68077df0 2024-09-10T10:07:37.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.441+0000 7f1b64c00640 1 -- 172.21.15.50:0/4103966565 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7f1b5409bc70 con 0x7f1b68077df0 2024-09-10T10:07:37.442 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:07:37.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.444+0000 7f1b6f200640 1 -- 172.21.15.50:0/4103966565 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1b4c0a2bb0 msgr2=0x7f1b4c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:37.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.444+0000 7f1b6f200640 1 --2- 172.21.15.50:0/4103966565 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1b4c0a2bb0 0x7f1b4c0a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009bd0 tx=0x7f1b58005f90 comp rx=0 tx=0).stop 2024-09-10T10:07:37.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.444+0000 7f1b6f200640 1 -- 172.21.15.50:0/4103966565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b68077df0 msgr2=0x7f1b6819e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:37.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.444+0000 7f1b6f200640 1 --2- 172.21.15.50:0/4103966565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b68077df0 0x7f1b6819e9e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400e9f0 tx=0x7f1b5400edf0 comp rx=0 tx=0).stop 2024-09-10T10:07:37.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.444+0000 7f1b6f200640 1 -- 172.21.15.50:0/4103966565 shutdown_connections 2024-09-10T10:07:37.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.444+0000 7f1b6f200640 1 --2- 172.21.15.50:0/4103966565 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1b4c0a2bb0 0x7f1b4c0a5070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:37.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.444+0000 7f1b6f200640 1 --2- 172.21.15.50:0/4103966565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b68078790 0x7f1b681a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:37.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.444+0000 7f1b6f200640 1 --2- 172.21.15.50:0/4103966565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b68077df0 0x7f1b6819e9e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:37.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.444+0000 7f1b6f200640 1 --2- 172.21.15.50:0/4103966565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b68076ba0 0x7f1b6819e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:37.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.444+0000 7f1b6f200640 1 -- 172.21.15.50:0/4103966565 >> 172.21.15.50:0/4103966565 conn(0x7f1b680ff5b0 msgr2=0x7f1b68101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:37.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.444+0000 7f1b6f200640 1 -- 172.21.15.50:0/4103966565 shutdown_connections 2024-09-10T10:07:37.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:37.444+0000 7f1b6f200640 1 -- 172.21.15.50:0/4103966565 wait complete. 2024-09-10T10:07:37.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:37 smithi050 ceph-mon[30354]: Detected new or changed devices on smithi189 2024-09-10T10:07:37.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:37 smithi050 ceph-mon[30354]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-10T10:07:37.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:37 smithi050 ceph-mon[30354]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T10:07:37.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:37 smithi050 ceph-mon[30354]: osdmap e77: 12 total, 11 up, 12 in 2024-09-10T10:07:37.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:37 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:37.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:37 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:37.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:37 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4103966565' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:07:37.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:37 smithi189 ceph-mon[34999]: Detected new or changed devices on smithi189 2024-09-10T10:07:37.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:37 smithi189 ceph-mon[34999]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-10T10:07:37.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:37 smithi189 ceph-mon[34999]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T10:07:37.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:37 smithi189 ceph-mon[34999]: osdmap e77: 12 total, 11 up, 12 in 2024-09-10T10:07:37.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:37 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:37.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:37 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:37.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:37 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4103966565' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:07:37.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:37 smithi084 ceph-mon[34812]: Detected new or changed devices on smithi189 2024-09-10T10:07:37.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:37 smithi084 ceph-mon[34812]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-10T10:07:37.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:37 smithi084 ceph-mon[34812]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T10:07:37.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:37 smithi084 ceph-mon[34812]: osdmap e77: 12 total, 11 up, 12 in 2024-09-10T10:07:37.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:37 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:37.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:37 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:37.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:37 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4103966565' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:07:38.238 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":77,"num_osds":12,"num_up_osds":11,"osd_up_since":1725962830,"num_in_osds":12,"osd_in_since":1725962833,"num_remapped_pgs":0} 2024-09-10T10:07:38.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:38 smithi189 ceph-mon[34999]: purged_snaps scrub starts 2024-09-10T10:07:38.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:38 smithi189 ceph-mon[34999]: purged_snaps scrub ok 2024-09-10T10:07:38.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:38 smithi189 ceph-mon[34999]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:38.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:38 smithi189 ceph-mon[34999]: osd.11 [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841] boot 2024-09-10T10:07:38.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:38 smithi189 ceph-mon[34999]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T10:07:38.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:38 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:38.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:38 smithi084 ceph-mon[34812]: purged_snaps scrub starts 2024-09-10T10:07:38.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:38 smithi084 ceph-mon[34812]: purged_snaps scrub ok 2024-09-10T10:07:38.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:38 smithi084 ceph-mon[34812]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:38.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:38 smithi084 ceph-mon[34812]: osd.11 [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841] boot 2024-09-10T10:07:38.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:38 smithi084 ceph-mon[34812]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T10:07:38.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:38 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:38.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:38 smithi050 ceph-mon[30354]: purged_snaps scrub starts 2024-09-10T10:07:38.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:38 smithi050 ceph-mon[30354]: purged_snaps scrub ok 2024-09-10T10:07:38.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:38 smithi050 ceph-mon[30354]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:07:38.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:38 smithi050 ceph-mon[30354]: osd.11 [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841] boot 2024-09-10T10:07:38.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:38 smithi050 ceph-mon[30354]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T10:07:38.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:38 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:07:39.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T10:07:39.627 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:07:39.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:39 smithi189 ceph-mon[34999]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T10:07:39.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:39 smithi084 ceph-mon[34812]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T10:07:39.922 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:39 smithi050 ceph-mon[30354]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T10:07:40.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.159+0000 7f0f59a00640 1 -- 172.21.15.50:0/1916970997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f54105810 msgr2=0x7f0f5410c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.159+0000 7f0f59a00640 1 --2- 172.21.15.50:0/1916970997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f54105810 0x7f0f5410c0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009ca0 tx=0x7f0f4c02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:07:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.159+0000 7f0f59a00640 1 -- 172.21.15.50:0/1916970997 shutdown_connections 2024-09-10T10:07:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.159+0000 7f0f59a00640 1 --2- 172.21.15.50:0/1916970997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f54105810 0x7f0f5410c0a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.159+0000 7f0f59a00640 1 --2- 172.21.15.50:0/1916970997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f54104e50 0x7f0f541052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.159+0000 7f0f59a00640 1 --2- 172.21.15.50:0/1916970997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54103c50 0x7f0f54104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.159+0000 7f0f59a00640 1 -- 172.21.15.50:0/1916970997 >> 172.21.15.50:0/1916970997 conn(0x7f0f540ff3e0 msgr2=0x7f0f54101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.159+0000 7f0f59a00640 1 -- 172.21.15.50:0/1916970997 shutdown_connections 2024-09-10T10:07:40.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.159+0000 7f0f59a00640 1 -- 172.21.15.50:0/1916970997 wait complete. 2024-09-10T10:07:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.160+0000 7f0f59a00640 1 Processor -- start 2024-09-10T10:07:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.160+0000 7f0f59a00640 1 -- start start 2024-09-10T10:07:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.161+0000 7f0f59a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f54103c50 0x7f0f54199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.161+0000 7f0f59a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54104e50 0x7f0f5419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.161+0000 7f0f59a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f54105810 0x7f0f541a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.161+0000 7f0f59a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5410f8d0 con 0x7f0f54105810 2024-09-10T10:07:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.161+0000 7f0f59a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5410f750 con 0x7f0f54104e50 2024-09-10T10:07:40.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.161+0000 7f0f59a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5410fa50 con 0x7f0f54103c50 2024-09-10T10:07:40.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.161+0000 7f0f59000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f54105810 0x7f0f541a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:40.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.161+0000 7f0f59000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f54105810 0x7f0f541a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43884/0 (socket says 172.21.15.50:43884) 2024-09-10T10:07:40.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.161+0000 7f0f59000640 1 -- 172.21.15.50:0/533101153 learned_addr learned my addr 172.21.15.50:0/533101153 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:07:40.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.161+0000 7f0f53e00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f54103c50 0x7f0f54199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:40.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.161+0000 7f0f4be00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54104e50 0x7f0f5419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:40.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.162+0000 7f0f53e00640 1 -- 172.21.15.50:0/533101153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54104e50 msgr2=0x7f0f5419a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:40.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.162+0000 7f0f53e00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54104e50 0x7f0f5419a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:40.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.162+0000 7f0f53e00640 1 -- 172.21.15.50:0/533101153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f54105810 msgr2=0x7f0f541a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:40.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.162+0000 7f0f53e00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f54105810 0x7f0f541a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:40.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.162+0000 7f0f53e00640 1 -- 172.21.15.50:0/533101153 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f541a1ad0 con 0x7f0f54103c50 2024-09-10T10:07:40.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.162+0000 7f0f4be00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54104e50 0x7f0f5419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:07:40.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.162+0000 7f0f53e00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f54103c50 0x7f0f54199ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400e9c0 tx=0x7f0f4400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:40.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.162+0000 7f0f51600640 1 -- 172.21.15.50:0/533101153 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400ccc0 con 0x7f0f54103c50 2024-09-10T10:07:40.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.162+0000 7f0f51600640 1 -- 172.21.15.50:0/533101153 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f440035f0 con 0x7f0f54103c50 2024-09-10T10:07:40.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.162+0000 7f0f59a00640 1 -- 172.21.15.50:0/533101153 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f541a1dc0 con 0x7f0f54103c50 2024-09-10T10:07:40.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.162+0000 7f0f51600640 1 -- 172.21.15.50:0/533101153 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400ce60 con 0x7f0f54103c50 2024-09-10T10:07:40.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.163+0000 7f0f59a00640 1 -- 172.21.15.50:0/533101153 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f541a2270 con 0x7f0f54103c50 2024-09-10T10:07:40.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.163+0000 7f0f59a00640 1 -- 172.21.15.50:0/533101153 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5410af80 con 0x7f0f54103c50 2024-09-10T10:07:40.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.165+0000 7f0f51600640 1 -- 172.21.15.50:0/533101153 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0f440037a0 con 0x7f0f54103c50 2024-09-10T10:07:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.167+0000 7f0f51600640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0f380a2c30 0x7f0f380a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.167+0000 7f0f51600640 1 -- 172.21.15.50:0/533101153 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f0f440cef10 con 0x7f0f54103c50 2024-09-10T10:07:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.167+0000 7f0f4be00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0f380a2c30 0x7f0f380a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:40.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.167+0000 7f0f4be00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0f380a2c30 0x7f0f380a50f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f5419b3c0 tx=0x7f0f3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:40.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.171+0000 7f0f51600640 1 -- 172.21.15.50:0/533101153 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f4409c270 con 0x7f0f54103c50 2024-09-10T10:07:40.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.359+0000 7f0f59a00640 1 -- 172.21.15.50:0/533101153 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f0f54062f40 con 0x7f0f54103c50 2024-09-10T10:07:40.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.360+0000 7f0f51600640 1 -- 172.21.15.50:0/533101153 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) ==== 74+0+133 (secure 0 0 0) 0x7f0f4409bb70 con 0x7f0f54103c50 2024-09-10T10:07:40.361 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:07:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.362+0000 7f0f59a00640 1 -- 172.21.15.50:0/533101153 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0f380a2c30 msgr2=0x7f0f380a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.362+0000 7f0f59a00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0f380a2c30 0x7f0f380a50f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f5419b3c0 tx=0x7f0f3c005f90 comp rx=0 tx=0).stop 2024-09-10T10:07:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.362+0000 7f0f59a00640 1 -- 172.21.15.50:0/533101153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f54103c50 msgr2=0x7f0f54199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.362+0000 7f0f59a00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f54103c50 0x7f0f54199ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400e9c0 tx=0x7f0f4400ee80 comp rx=0 tx=0).stop 2024-09-10T10:07:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.362+0000 7f0f59a00640 1 -- 172.21.15.50:0/533101153 shutdown_connections 2024-09-10T10:07:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.362+0000 7f0f59a00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0f380a2c30 0x7f0f380a50f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.362+0000 7f0f59a00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0f54105810 0x7f0f541a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.362+0000 7f0f59a00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f54104e50 0x7f0f5419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.362+0000 7f0f59a00640 1 --2- 172.21.15.50:0/533101153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f54103c50 0x7f0f54199ea0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.362+0000 7f0f59a00640 1 -- 172.21.15.50:0/533101153 >> 172.21.15.50:0/533101153 conn(0x7f0f540ff3e0 msgr2=0x7f0f54108150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:40.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.362+0000 7f0f59a00640 1 -- 172.21.15.50:0/533101153 shutdown_connections 2024-09-10T10:07:40.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:40.362+0000 7f0f59a00640 1 -- 172.21.15.50:0/533101153 wait complete. 2024-09-10T10:07:40.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:40 smithi050 ceph-mon[30354]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:40.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:40 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/533101153' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:07:40.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:40 smithi189 ceph-mon[34999]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:40.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:40 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/533101153' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:07:40.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:40 smithi084 ceph-mon[34812]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:40.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:40 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/533101153' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:07:41.080 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":79,"num_osds":12,"num_up_osds":12,"osd_up_since":1725962857,"num_in_osds":12,"osd_in_since":1725962833,"num_remapped_pgs":0} 2024-09-10T10:07:41.081 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:07:41.451 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:07:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.000+0000 7f0069000640 1 -- 172.21.15.50:0/2998360107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0064076720 msgr2=0x7f0064076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.000+0000 7f0069000640 1 --2- 172.21.15.50:0/2998360107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0064076720 0x7f0064076b00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0054009900 tx=0x7f005402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:07:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.000+0000 7f0069000640 1 -- 172.21.15.50:0/2998360107 shutdown_connections 2024-09-10T10:07:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.000+0000 7f0069000640 1 --2- 172.21.15.50:0/2998360107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064112a30 0x7f0064114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.000+0000 7f0069000640 1 --2- 172.21.15.50:0/2998360107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0064077040 0x7f00641124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.000+0000 7f0069000640 1 --2- 172.21.15.50:0/2998360107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0064076720 0x7f0064076b00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.000+0000 7f0069000640 1 -- 172.21.15.50:0/2998360107 >> 172.21.15.50:0/2998360107 conn(0x7f00640ffa90 msgr2=0x7f0064101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:42.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.000+0000 7f0069000640 1 -- 172.21.15.50:0/2998360107 shutdown_connections 2024-09-10T10:07:42.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.000+0000 7f0069000640 1 -- 172.21.15.50:0/2998360107 wait complete. 2024-09-10T10:07:42.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.001+0000 7f0069000640 1 Processor -- start 2024-09-10T10:07:42.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.001+0000 7f0069000640 1 -- start start 2024-09-10T10:07:42.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0069000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064076720 0x7f00641a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:42.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0069000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0064077040 0x7f00641a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:42.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0069000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0064112a30 0x7f006419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:42.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0069000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f00641185f0 con 0x7f0064112a30 2024-09-10T10:07:42.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0069000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0064118470 con 0x7f0064077040 2024-09-10T10:07:42.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0069000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0064118770 con 0x7f0064076720 2024-09-10T10:07:42.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0061e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064076720 0x7f00641a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:42.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0061e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064076720 0x7f00641a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:49428/0 (socket says 172.21.15.50:49428) 2024-09-10T10:07:42.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0061e00640 1 -- 172.21.15.50:0/3043482650 learned_addr learned my addr 172.21.15.50:0/3043482650 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:07:42.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0062800640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0064112a30 0x7f006419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:42.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0061400640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0064077040 0x7f00641a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:42.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0061e00640 1 -- 172.21.15.50:0/3043482650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0064077040 msgr2=0x7f00641a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:42.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0061e00640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0064077040 0x7f00641a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:42.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0061e00640 1 -- 172.21.15.50:0/3043482650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0064112a30 msgr2=0x7f006419e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:42.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0061e00640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0064112a30 0x7f006419e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:42.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0061e00640 1 -- 172.21.15.50:0/3043482650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006419ef90 con 0x7f0064076720 2024-09-10T10:07:42.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.002+0000 7f0062800640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0064112a30 0x7f006419e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:07:42.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.003+0000 7f0061e00640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064076720 0x7f00641a46a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0054004770 tx=0x7f0054003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:42.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.003+0000 7f005aa00640 1 -- 172.21.15.50:0/3043482650 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005403f070 con 0x7f0064076720 2024-09-10T10:07:42.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.003+0000 7f0069000640 1 -- 172.21.15.50:0/3043482650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006419f220 con 0x7f0064076720 2024-09-10T10:07:42.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.003+0000 7f005aa00640 1 -- 172.21.15.50:0/3043482650 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0054031ca0 con 0x7f0064076720 2024-09-10T10:07:42.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.003+0000 7f005aa00640 1 -- 172.21.15.50:0/3043482650 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0054035030 con 0x7f0064076720 2024-09-10T10:07:42.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.003+0000 7f0069000640 1 -- 172.21.15.50:0/3043482650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00641ab570 con 0x7f0064076720 2024-09-10T10:07:42.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.004+0000 7f0069000640 1 -- 172.21.15.50:0/3043482650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0064076b00 con 0x7f0064076720 2024-09-10T10:07:42.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.006+0000 7f005aa00640 1 -- 172.21.15.50:0/3043482650 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0054042070 con 0x7f0064076720 2024-09-10T10:07:42.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.008+0000 7f005aa00640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f00480a2b80 0x7f00480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:42.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.008+0000 7f005aa00640 1 -- 172.21.15.50:0/3043482650 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f00540ef480 con 0x7f0064076720 2024-09-10T10:07:42.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.008+0000 7f0061400640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f00480a2b80 0x7f00480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:42.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.009+0000 7f0061400640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f00480a2b80 0x7f00480a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0064079220 tx=0x7f005000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:42.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.010+0000 7f005aa00640 1 -- 172.21.15.50:0/3043482650 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00540bc190 con 0x7f0064076720 2024-09-10T10:07:42.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.195+0000 7f0069000640 1 -- 172.21.15.50:0/3043482650 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00641ab7a0 con 0x7f0064076720 2024-09-10T10:07:42.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.197+0000 7f005aa00640 1 -- 172.21.15.50:0/3043482650 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+18410 (secure 0 0 0) 0x7f00540c0490 con 0x7f0064076720 2024-09-10T10:07:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:07:42.198 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":79,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:07:38.571415+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:07:42.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.199+0000 7f0069000640 1 -- 172.21.15.50:0/3043482650 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f00480a2b80 msgr2=0x7f00480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.199+0000 7f0069000640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f00480a2b80 0x7f00480a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0064079220 tx=0x7f005000b410 comp rx=0 tx=0).stop 2024-09-10T10:07:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.199+0000 7f0069000640 1 -- 172.21.15.50:0/3043482650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064076720 msgr2=0x7f00641a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.199+0000 7f0069000640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064076720 0x7f00641a46a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0054004770 tx=0x7f0054003c10 comp rx=0 tx=0).stop 2024-09-10T10:07:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.199+0000 7f0069000640 1 -- 172.21.15.50:0/3043482650 shutdown_connections 2024-09-10T10:07:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.199+0000 7f0069000640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f00480a2b80 0x7f00480a5040 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.199+0000 7f0069000640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0064112a30 0x7f006419e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.199+0000 7f0069000640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0064077040 0x7f00641a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.199+0000 7f0069000640 1 --2- 172.21.15.50:0/3043482650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0064076720 0x7f00641a46a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.199+0000 7f0069000640 1 -- 172.21.15.50:0/3043482650 >> 172.21.15.50:0/3043482650 conn(0x7f00640ffa90 msgr2=0x7f0064101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.199+0000 7f0069000640 1 -- 172.21.15.50:0/3043482650 shutdown_connections 2024-09-10T10:07:42.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:42.199+0000 7f0069000640 1 -- 172.21.15.50:0/3043482650 wait complete. 2024-09-10T10:07:42.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:42 smithi084 ceph-mon[34812]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:42.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:42 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3043482650' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:07:42.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:42 smithi050 ceph-mon[30354]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:42.885 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:42 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3043482650' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:07:42.924 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T10:03:29.276863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T10:07:42.924 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T10:07:43.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:42 smithi189 ceph-mon[34999]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:43.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:42 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3043482650' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:07:43.297 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:07:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.856+0000 7f234ba00640 1 -- 172.21.15.50:0/132633613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344101de0 msgr2=0x7f23441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.856+0000 7f234ba00640 1 --2- 172.21.15.50:0/132633613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344101de0 0x7f23441021c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2334009900 tx=0x7f233402a410 comp rx=0 tx=0).stop 2024-09-10T10:07:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.856+0000 7f234ba00640 1 -- 172.21.15.50:0/132633613 shutdown_connections 2024-09-10T10:07:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.856+0000 7f234ba00640 1 --2- 172.21.15.50:0/132633613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2344106f10 0x7f234410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.856+0000 7f234ba00640 1 --2- 172.21.15.50:0/132633613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2344102790 0x7f23441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.856+0000 7f234ba00640 1 --2- 172.21.15.50:0/132633613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344101de0 0x7f23441021c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.856+0000 7f234ba00640 1 -- 172.21.15.50:0/132633613 >> 172.21.15.50:0/132633613 conn(0x7f23440fd8c0 msgr2=0x7f23440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.856+0000 7f234ba00640 1 -- 172.21.15.50:0/132633613 shutdown_connections 2024-09-10T10:07:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.856+0000 7f234ba00640 1 -- 172.21.15.50:0/132633613 wait complete. 2024-09-10T10:07:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.857+0000 7f234ba00640 1 Processor -- start 2024-09-10T10:07:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.857+0000 7f234ba00640 1 -- start start 2024-09-10T10:07:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.857+0000 7f234ba00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344101de0 0x7f234419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.857+0000 7f234ba00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2344102790 0x7f234419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.857+0000 7f234ba00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2344106f10 0x7f234419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.857+0000 7f234ba00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2344111fc0 con 0x7f2344101de0 2024-09-10T10:07:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.857+0000 7f234ba00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2344111e40 con 0x7f2344102790 2024-09-10T10:07:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.858+0000 7f234ba00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2344112140 con 0x7f2344106f10 2024-09-10T10:07:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.858+0000 7f2349000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344101de0 0x7f234419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.858+0000 7f233be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2344102790 0x7f234419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.858+0000 7f2349000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344101de0 0x7f234419a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43908/0 (socket says 172.21.15.50:43908) 2024-09-10T10:07:43.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.858+0000 7f2349000640 1 -- 172.21.15.50:0/754033947 learned_addr learned my addr 172.21.15.50:0/754033947 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:07:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.858+0000 7f2349a00640 1 --2- 172.21.15.50:0/754033947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2344106f10 0x7f234419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.858+0000 7f233be00640 1 -- 172.21.15.50:0/754033947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2344106f10 msgr2=0x7f234419ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.858+0000 7f233be00640 1 --2- 172.21.15.50:0/754033947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2344106f10 0x7f234419ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.858+0000 7f233be00640 1 -- 172.21.15.50:0/754033947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344101de0 msgr2=0x7f234419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.858+0000 7f233be00640 1 --2- 172.21.15.50:0/754033947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344101de0 0x7f234419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.858+0000 7f233be00640 1 -- 172.21.15.50:0/754033947 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234419f630 con 0x7f2344102790 2024-09-10T10:07:43.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.859+0000 7f233be00640 1 --2- 172.21.15.50:0/754033947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2344102790 0x7f234419abc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f232c00e9f0 tx=0x7f232c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.859+0000 7f2342000640 1 -- 172.21.15.50:0/754033947 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c00ccc0 con 0x7f2344102790 2024-09-10T10:07:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.859+0000 7f234ba00640 1 -- 172.21.15.50:0/754033947 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234419f920 con 0x7f2344102790 2024-09-10T10:07:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.859+0000 7f2342000640 1 -- 172.21.15.50:0/754033947 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f232c005020 con 0x7f2344102790 2024-09-10T10:07:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.859+0000 7f2342000640 1 -- 172.21.15.50:0/754033947 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c0049e0 con 0x7f2344102790 2024-09-10T10:07:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.859+0000 7f234ba00640 1 -- 172.21.15.50:0/754033947 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23441a7200 con 0x7f2344102790 2024-09-10T10:07:43.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.860+0000 7f234ba00640 1 -- 172.21.15.50:0/754033947 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23441021c0 con 0x7f2344102790 2024-09-10T10:07:43.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.862+0000 7f2342000640 1 -- 172.21.15.50:0/754033947 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f232c005560 con 0x7f2344102790 2024-09-10T10:07:43.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.863+0000 7f2342000640 1 --2- 172.21.15.50:0/754033947 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f23280a2b80 0x7f23280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:43.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.863+0000 7f2342000640 1 -- 172.21.15.50:0/754033947 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f232c0cec50 con 0x7f2344102790 2024-09-10T10:07:43.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.863+0000 7f2349000640 1 --2- 172.21.15.50:0/754033947 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f23280a2b80 0x7f23280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:43.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.864+0000 7f2349000640 1 --2- 172.21.15.50:0/754033947 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f23280a2b80 0x7f23280a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f23340096c0 tx=0x7f23340046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:43.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:43.866+0000 7f2342000640 1 -- 172.21.15.50:0/754033947 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f232c0051d0 con 0x7f2344102790 2024-09-10T10:07:44.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.049+0000 7f234ba00640 1 -- 172.21.15.50:0/754033947 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f23441a7530 con 0x7f2344102790 2024-09-10T10:07:44.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.050+0000 7f2342000640 1 -- 172.21.15.50:0/754033947 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7f232c09bfb0 con 0x7f2344102790 2024-09-10T10:07:44.051 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-10T10:07:44.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.053+0000 7f234ba00640 1 -- 172.21.15.50:0/754033947 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f23280a2b80 msgr2=0x7f23280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.053+0000 7f234ba00640 1 --2- 172.21.15.50:0/754033947 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f23280a2b80 0x7f23280a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f23340096c0 tx=0x7f23340046c0 comp rx=0 tx=0).stop 2024-09-10T10:07:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.053+0000 7f234ba00640 1 -- 172.21.15.50:0/754033947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2344102790 msgr2=0x7f234419abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.053+0000 7f234ba00640 1 --2- 172.21.15.50:0/754033947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2344102790 0x7f234419abc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f232c00e9f0 tx=0x7f232c00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:07:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.053+0000 7f234ba00640 1 -- 172.21.15.50:0/754033947 shutdown_connections 2024-09-10T10:07:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.053+0000 7f234ba00640 1 --2- 172.21.15.50:0/754033947 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f23280a2b80 0x7f23280a5040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.053+0000 7f234ba00640 1 --2- 172.21.15.50:0/754033947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2344106f10 0x7f234419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.053+0000 7f234ba00640 1 --2- 172.21.15.50:0/754033947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2344102790 0x7f234419abc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.053+0000 7f234ba00640 1 --2- 172.21.15.50:0/754033947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344101de0 0x7f234419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.053+0000 7f234ba00640 1 -- 172.21.15.50:0/754033947 >> 172.21.15.50:0/754033947 conn(0x7f23440fd8c0 msgr2=0x7f23440ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.054+0000 7f234ba00640 1 -- 172.21.15.50:0/754033947 shutdown_connections 2024-09-10T10:07:44.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:44.054+0000 7f234ba00640 1 -- 172.21.15.50:0/754033947 wait complete. 2024-09-10T10:07:44.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:44 smithi050 ceph-mon[30354]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:44.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:44 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/754033947' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:07:44.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:44 smithi084 ceph-mon[34812]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:44.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:44 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/754033947' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:07:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:44 smithi189 ceph-mon[34999]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:44 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/754033947' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:07:44.896 INFO:tasks.cephadm:Adding mds.a on smithi050 2024-09-10T10:07:44.897 INFO:tasks.cephadm:Adding mds.d on smithi050 2024-09-10T10:07:44.897 INFO:tasks.cephadm:Adding mds.g on smithi050 2024-09-10T10:07:44.897 INFO:tasks.cephadm:Adding mds.j on smithi050 2024-09-10T10:07:44.897 INFO:tasks.cephadm:Adding mds.b on smithi084 2024-09-10T10:07:44.897 INFO:tasks.cephadm:Adding mds.e on smithi084 2024-09-10T10:07:44.897 INFO:tasks.cephadm:Adding mds.h on smithi084 2024-09-10T10:07:44.897 INFO:tasks.cephadm:Adding mds.k on smithi084 2024-09-10T10:07:44.897 INFO:tasks.cephadm:Adding mds.c on smithi189 2024-09-10T10:07:44.897 INFO:tasks.cephadm:Adding mds.f on smithi189 2024-09-10T10:07:44.897 INFO:tasks.cephadm:Adding mds.i on smithi189 2024-09-10T10:07:44.897 INFO:tasks.cephadm:Adding mds.l on smithi189 2024-09-10T10:07:44.897 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l' 2024-09-10T10:07:45.170 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:07:45.683 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.667+0000 7f1a0d385640 1 -- 172.21.15.189:0/1920220909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a08102690 msgr2=0x7f1a08108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:45.683 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.667+0000 7f1a0d385640 1 --2- 172.21.15.189:0/1920220909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a08102690 0x7f1a08108f20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009ca0 tx=0x7f1a0002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:07:45.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.667+0000 7f1a0d385640 1 -- 172.21.15.189:0/1920220909 shutdown_connections 2024-09-10T10:07:45.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.667+0000 7f1a0d385640 1 --2- 172.21.15.189:0/1920220909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a08102690 0x7f1a08108f20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:45.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.667+0000 7f1a0d385640 1 --2- 172.21.15.189:0/1920220909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a08101cd0 0x7f1a08102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:45.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.667+0000 7f1a0d385640 1 --2- 172.21.15.189:0/1920220909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a08100ad0 0x7f1a08100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:45.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.667+0000 7f1a0d385640 1 -- 172.21.15.189:0/1920220909 >> 172.21.15.189:0/1920220909 conn(0x7f1a080fc280 msgr2=0x7f1a080fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:45.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.667+0000 7f1a0d385640 1 -- 172.21.15.189:0/1920220909 shutdown_connections 2024-09-10T10:07:45.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.667+0000 7f1a0d385640 1 -- 172.21.15.189:0/1920220909 wait complete. 2024-09-10T10:07:45.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.668+0000 7f1a0d385640 1 Processor -- start 2024-09-10T10:07:45.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.668+0000 7f1a0d385640 1 -- start start 2024-09-10T10:07:45.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.668+0000 7f1a0d385640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a08100ad0 0x7f1a08197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:45.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.668+0000 7f1a0d385640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a08101cd0 0x7f1a08198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:45.684 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.668+0000 7f1a0d385640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a08102690 0x7f1a0819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.668+0000 7f1a0d385640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0810c7b0 con 0x7f1a08100ad0 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.668+0000 7f1a0d385640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0810c630 con 0x7f1a08101cd0 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.668+0000 7f1a0d385640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0810c930 con 0x7f1a08102690 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.668+0000 7f1a077fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a08102690 0x7f1a0819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.668+0000 7f1a077fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a08102690 0x7f1a0819f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:49474/0 (socket says 172.21.15.189:49474) 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.668+0000 7f1a077fe640 1 -- 172.21.15.189:0/2355687878 learned_addr learned my addr 172.21.15.189:0/2355687878 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.668+0000 7f19fe7fc640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a08101cd0 0x7f1a08198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.668+0000 7f1a06ffd640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a08100ad0 0x7f1a08197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.669+0000 7f1a077fe640 1 -- 172.21.15.189:0/2355687878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a08101cd0 msgr2=0x7f1a08198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.669+0000 7f1a077fe640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a08101cd0 0x7f1a08198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.669+0000 7f1a077fe640 1 -- 172.21.15.189:0/2355687878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a08100ad0 msgr2=0x7f1a08197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.669+0000 7f1a077fe640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a08100ad0 0x7f1a08197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.669+0000 7f1a077fe640 1 -- 172.21.15.189:0/2355687878 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0819fb50 con 0x7f1a08102690 2024-09-10T10:07:45.685 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.669+0000 7f1a06ffd640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a08100ad0 0x7f1a08197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:07:45.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.669+0000 7f1a077fe640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a08102690 0x7f1a0819f4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009430 tx=0x7f1a0002f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:45.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.669+0000 7f1a04ff9640 1 -- 172.21.15.189:0/2355687878 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00003b70 con 0x7f1a08102690 2024-09-10T10:07:45.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.669+0000 7f1a0d385640 1 -- 172.21.15.189:0/2355687878 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0819fde0 con 0x7f1a08102690 2024-09-10T10:07:45.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.669+0000 7f1a04ff9640 1 -- 172.21.15.189:0/2355687878 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a00003d10 con 0x7f1a08102690 2024-09-10T10:07:45.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.669+0000 7f1a04ff9640 1 -- 172.21.15.189:0/2355687878 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a000047d0 con 0x7f1a08102690 2024-09-10T10:07:45.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.669+0000 7f1a0d385640 1 -- 172.21.15.189:0/2355687878 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a081a0310 con 0x7f1a08102690 2024-09-10T10:07:45.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.670+0000 7f1a0d385640 1 -- 172.21.15.189:0/2355687878 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a081a05d0 con 0x7f1a08102690 2024-09-10T10:07:45.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.672+0000 7f1a04ff9640 1 -- 172.21.15.189:0/2355687878 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1a0002f800 con 0x7f1a08102690 2024-09-10T10:07:45.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.673+0000 7f1a04ff9640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19f40a2bb0 0x7f19f40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:45.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.673+0000 7f1a04ff9640 1 -- 172.21.15.189:0/2355687878 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f1a000effa0 con 0x7f1a08102690 2024-09-10T10:07:45.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.673+0000 7f1a06ffd640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19f40a2bb0 0x7f19f40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:45.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.674+0000 7f1a06ffd640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19f40a2bb0 0x7f19f40a5070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1a08101b30 tx=0x7f19f800a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:45.686 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.681+0000 7f1a04ff9640 1 -- 172.21.15.189:0/2355687878 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a000bd3a0 con 0x7f1a08102690 2024-09-10T10:07:45.864 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.863+0000 7f1a0d385640 1 -- 172.21.15.189:0/2355687878 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}) -- 0x7f1a080fe450 con 0x7f19f40a2bb0 2024-09-10T10:07:45.872 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.871+0000 7f1a04ff9640 1 -- 172.21.15.189:0/2355687878 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f1a080fe450 con 0x7f19f40a2bb0 2024-09-10T10:07:45.873 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mds.all update... 2024-09-10T10:07:45.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.873+0000 7f1a0d385640 1 -- 172.21.15.189:0/2355687878 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19f40a2bb0 msgr2=0x7f19f40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:45.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.873+0000 7f1a0d385640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19f40a2bb0 0x7f19f40a5070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1a08101b30 tx=0x7f19f800a5e0 comp rx=0 tx=0).stop 2024-09-10T10:07:45.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.873+0000 7f1a0d385640 1 -- 172.21.15.189:0/2355687878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a08102690 msgr2=0x7f1a0819f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:45.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.873+0000 7f1a0d385640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a08102690 0x7f1a0819f4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009430 tx=0x7f1a0002f610 comp rx=0 tx=0).stop 2024-09-10T10:07:45.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.873+0000 7f1a0d385640 1 -- 172.21.15.189:0/2355687878 shutdown_connections 2024-09-10T10:07:45.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.873+0000 7f1a0d385640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19f40a2bb0 0x7f19f40a5070 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:45.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.873+0000 7f1a0d385640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1a08102690 0x7f1a0819f4e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:45.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.873+0000 7f1a0d385640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a08101cd0 0x7f1a08198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:45.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.873+0000 7f1a0d385640 1 --2- 172.21.15.189:0/2355687878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a08100ad0 0x7f1a08197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:45.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.873+0000 7f1a0d385640 1 -- 172.21.15.189:0/2355687878 >> 172.21.15.189:0/2355687878 conn(0x7f1a080fc280 msgr2=0x7f1a080fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:45.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.874+0000 7f1a0d385640 1 -- 172.21.15.189:0/2355687878 shutdown_connections 2024-09-10T10:07:45.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T10:07:45.874+0000 7f1a0d385640 1 -- 172.21.15.189:0/2355687878 wait complete. 2024-09-10T10:07:46.637 DEBUG:teuthology.orchestra.run.smithi050:mds.a> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T10:07:46.642 DEBUG:teuthology.orchestra.run.smithi050:mds.d> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T10:07:46.686 DEBUG:teuthology.orchestra.run.smithi050:mds.g> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T10:07:46.732 DEBUG:teuthology.orchestra.run.smithi050:mds.j> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T10:07:46.776 DEBUG:teuthology.orchestra.run.smithi084:mds.b> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T10:07:46.779 DEBUG:teuthology.orchestra.run.smithi084:mds.e> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T10:07:46.822 DEBUG:teuthology.orchestra.run.smithi084:mds.h> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T10:07:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:46 smithi084 ceph-mon[34812]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:07:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:46.850 DEBUG:teuthology.orchestra.run.smithi084:mds.k> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T10:07:46.892 DEBUG:teuthology.orchestra.run.smithi189:mds.c> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T10:07:46.895 DEBUG:teuthology.orchestra.run.smithi189:mds.f> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T10:07:46.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:46 smithi189 ceph-mon[34999]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:46.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:46.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:46.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:46.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:46.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:46.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:46.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:07:46.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:46.918 DEBUG:teuthology.orchestra.run.smithi189:mds.i> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T10:07:46.961 DEBUG:teuthology.orchestra.run.smithi189:mds.l> sudo journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T10:07:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:46 smithi050 ceph-mon[30354]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:07:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:07:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:07:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:47.004 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T10:07:47.004 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:07:47.396 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:07:47.813 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:47 smithi189 ceph-mon[34999]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:47.813 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:47 smithi189 ceph-mon[34999]: Saving service mds.all spec with placement smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-10T10:07:47.813 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:47 smithi189 ceph-mon[34999]: Deploying daemon mds.l on smithi189 2024-09-10T10:07:47.834 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:47 smithi050 ceph-mon[30354]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:47.834 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:47 smithi050 ceph-mon[30354]: Saving service mds.all spec with placement smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-10T10:07:47.834 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:47 smithi050 ceph-mon[30354]: Deploying daemon mds.l on smithi189 2024-09-10T10:07:47.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:47 smithi084 ceph-mon[34812]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:07:47.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:47 smithi084 ceph-mon[34812]: Saving service mds.all spec with placement smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-10T10:07:47.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:47 smithi084 ceph-mon[34812]: Deploying daemon mds.l on smithi189 2024-09-10T10:07:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.949+0000 7f2b94e00640 1 -- 172.21.15.50:0/1513896532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b90103ff0 msgr2=0x7f2b901043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.949+0000 7f2b94e00640 1 --2- 172.21.15.50:0/1513896532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b90103ff0 0x7f2b901043d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009ca0 tx=0x7f2b8002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.949+0000 7f2b94e00640 1 -- 172.21.15.50:0/1513896532 shutdown_connections 2024-09-10T10:07:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.949+0000 7f2b94e00640 1 --2- 172.21.15.50:0/1513896532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b90109120 0x7f2b90110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.949+0000 7f2b94e00640 1 --2- 172.21.15.50:0/1513896532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b901049a0 0x7f2b901089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.949+0000 7f2b94e00640 1 --2- 172.21.15.50:0/1513896532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b90103ff0 0x7f2b901043d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.949+0000 7f2b94e00640 1 -- 172.21.15.50:0/1513896532 >> 172.21.15.50:0/1513896532 conn(0x7f2b900ffab0 msgr2=0x7f2b90101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.949+0000 7f2b94e00640 1 -- 172.21.15.50:0/1513896532 shutdown_connections 2024-09-10T10:07:47.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.949+0000 7f2b94e00640 1 -- 172.21.15.50:0/1513896532 wait complete. 2024-09-10T10:07:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.951+0000 7f2b94e00640 1 Processor -- start 2024-09-10T10:07:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.951+0000 7f2b94e00640 1 -- start start 2024-09-10T10:07:47.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.951+0000 7f2b94e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b90103ff0 0x7f2b9019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.951+0000 7f2b94e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b901049a0 0x7f2b9019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b94e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b90109120 0x7f2b9019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b94e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90114120 con 0x7f2b901049a0 2024-09-10T10:07:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b94e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90113fa0 con 0x7f2b90103ff0 2024-09-10T10:07:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b94e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2b901142a0 con 0x7f2b90109120 2024-09-10T10:07:47.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b85400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b901049a0 0x7f2b9019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:47.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b85400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b901049a0 0x7f2b9019ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38878/0 (socket says 172.21.15.50:38878) 2024-09-10T10:07:47.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b85400640 1 -- 172.21.15.50:0/3216336944 learned_addr learned my addr 172.21.15.50:0/3216336944 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:07:47.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b8e800640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b90109120 0x7f2b9019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:47.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b8de00640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b90103ff0 0x7f2b9019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:47.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b8e800640 1 -- 172.21.15.50:0/3216336944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b90103ff0 msgr2=0x7f2b9019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:47.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b8e800640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b90103ff0 0x7f2b9019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b8e800640 1 -- 172.21.15.50:0/3216336944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b901049a0 msgr2=0x7f2b9019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:47.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b8e800640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b901049a0 0x7f2b9019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:47.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.952+0000 7f2b8e800640 1 -- 172.21.15.50:0/3216336944 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9019f690 con 0x7f2b90109120 2024-09-10T10:07:47.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.953+0000 7f2b8e800640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b90109120 0x7f2b9019efb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800d680 tx=0x7f2b8800db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:47.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.953+0000 7f2b87400640 1 -- 172.21.15.50:0/3216336944 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88017070 con 0x7f2b90109120 2024-09-10T10:07:47.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.953+0000 7f2b87400640 1 -- 172.21.15.50:0/3216336944 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b88009820 con 0x7f2b90109120 2024-09-10T10:07:47.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.953+0000 7f2b87400640 1 -- 172.21.15.50:0/3216336944 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88004e00 con 0x7f2b90109120 2024-09-10T10:07:47.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.953+0000 7f2b94e00640 1 -- 172.21.15.50:0/3216336944 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9019f980 con 0x7f2b90109120 2024-09-10T10:07:47.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.953+0000 7f2b94e00640 1 -- 172.21.15.50:0/3216336944 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b901a7260 con 0x7f2b90109120 2024-09-10T10:07:47.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.955+0000 7f2b94e00640 1 -- 172.21.15.50:0/3216336944 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b901043d0 con 0x7f2b90109120 2024-09-10T10:07:47.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.957+0000 7f2b87400640 1 -- 172.21.15.50:0/3216336944 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2b880099d0 con 0x7f2b90109120 2024-09-10T10:07:47.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.959+0000 7f2b87400640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2b740a2b80 0x7f2b740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:47.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.959+0000 7f2b87400640 1 -- 172.21.15.50:0/3216336944 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f2b880ce7e0 con 0x7f2b90109120 2024-09-10T10:07:47.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.960+0000 7f2b8de00640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2b740a2b80 0x7f2b740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:47.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.960+0000 7f2b8de00640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2b740a2b80 0x7f2b740a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2b80006010 tx=0x7f2b80009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:47.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:47.964+0000 7f2b87400640 1 -- 172.21.15.50:0/3216336944 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b8809b4f0 con 0x7f2b90109120 2024-09-10T10:07:48.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.207+0000 7f2b94e00640 1 -- 172.21.15.50:0/3216336944 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b9010c300 con 0x7f2b90109120 2024-09-10T10:07:48.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.208+0000 7f2b87400640 1 -- 172.21.15.50:0/3216336944 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f2b8809f7f0 con 0x7f2b90109120 2024-09-10T10:07:48.210 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:07:48.210 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":1,"btime":"2024-09-10T10:00:05:599805+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T10:07:48.210 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 1 2024-09-10T10:07:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.211+0000 7f2b94e00640 1 -- 172.21.15.50:0/3216336944 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2b740a2b80 msgr2=0x7f2b740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.211+0000 7f2b94e00640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2b740a2b80 0x7f2b740a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2b80006010 tx=0x7f2b80009360 comp rx=0 tx=0).stop 2024-09-10T10:07:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.211+0000 7f2b94e00640 1 -- 172.21.15.50:0/3216336944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b90109120 msgr2=0x7f2b9019efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.211+0000 7f2b94e00640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b90109120 0x7f2b9019efb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800d680 tx=0x7f2b8800db40 comp rx=0 tx=0).stop 2024-09-10T10:07:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.211+0000 7f2b94e00640 1 -- 172.21.15.50:0/3216336944 shutdown_connections 2024-09-10T10:07:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.211+0000 7f2b94e00640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2b740a2b80 0x7f2b740a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.211+0000 7f2b94e00640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2b90109120 0x7f2b9019efb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.211+0000 7f2b94e00640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b901049a0 0x7f2b9019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.211+0000 7f2b94e00640 1 --2- 172.21.15.50:0/3216336944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b90103ff0 0x7f2b9019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:48.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.211+0000 7f2b94e00640 1 -- 172.21.15.50:0/3216336944 >> 172.21.15.50:0/3216336944 conn(0x7f2b900ffab0 msgr2=0x7f2b90100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:48.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.211+0000 7f2b94e00640 1 -- 172.21.15.50:0/3216336944 shutdown_connections 2024-09-10T10:07:48.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:48.211+0000 7f2b94e00640 1 -- 172.21.15.50:0/3216336944 wait complete. 2024-09-10T10:07:48.515 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:07:48 smithi189 systemd[1]: Starting Ceph mds.l for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:07:48.768 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:48 smithi189 ceph-mon[34999]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:48.768 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:48 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3216336944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:07:48.768 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:07:48 smithi189 podman[64352]: 2024-09-10 10:07:48.416966484 +0000 UTC m=+0.015773307 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:07:48.768 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:07:48 smithi189 podman[64352]: 2024-09-10 10:07:48.523256855 +0000 UTC m=+0.122063679 container create 79b51ac0a5d9b7c5b710d16e57c155f50bf5ea44b545207c46a2bcc53cd1cff1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-10T10:07:48.897 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:48 smithi050 ceph-mon[30354]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:48.897 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:48 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3216336944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:07:49.085 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:07:48 smithi189 podman[64352]: 2024-09-10 10:07:48.767671801 +0000 UTC m=+0.366478624 container init 79b51ac0a5d9b7c5b710d16e57c155f50bf5ea44b545207c46a2bcc53cd1cff1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T10:07:49.086 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:07:48 smithi189 podman[64352]: 2024-09-10 10:07:48.770616302 +0000 UTC m=+0.369423134 container start 79b51ac0a5d9b7c5b710d16e57c155f50bf5ea44b545207c46a2bcc53cd1cff1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T10:07:49.086 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:07:48 smithi189 ceph-mds[64371]: -- 172.21.15.189:0/2173567787 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b9a211f860 con 0x55b9a20fc800 2024-09-10T10:07:49.086 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:07:48 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-l[64367]: starting mds.l at 2024-09-10T10:07:49.086 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:07:48 smithi189 bash[64352]: 79b51ac0a5d9b7c5b710d16e57c155f50bf5ea44b545207c46a2bcc53cd1cff1 2024-09-10T10:07:49.086 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:07:48 smithi189 systemd[1]: Started Ceph mds.l for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:07:49.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:48 smithi084 ceph-mon[34812]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:49.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:48 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3216336944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:07:50.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:49 smithi189 ceph-mon[34999]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:50.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:49 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.189:6832/3692905441,v1:172.21.15.189:6833/3692905441] up:boot 2024-09-10T10:07:50.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:49 smithi189 ceph-mon[34999]: fsmap 1 up:standby 2024-09-10T10:07:50.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:49 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:07:50.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:49 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:50.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:49 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:50.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:49 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:50.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:49 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:50.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:49 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:07:50.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:49 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:50.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:49 smithi189 ceph-mon[34999]: Deploying daemon mds.k on smithi084 2024-09-10T10:07:50.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:49 smithi084 ceph-mon[34812]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:50.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:49 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.189:6832/3692905441,v1:172.21.15.189:6833/3692905441] up:boot 2024-09-10T10:07:50.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:49 smithi084 ceph-mon[34812]: fsmap 1 up:standby 2024-09-10T10:07:50.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:49 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:07:50.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:49 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:50.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:49 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:50.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:49 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:50.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:49 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:50.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:49 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:07:50.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:49 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:50.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:49 smithi084 ceph-mon[34812]: Deploying daemon mds.k on smithi084 2024-09-10T10:07:50.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:49 smithi050 ceph-mon[30354]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:50.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:49 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.189:6832/3692905441,v1:172.21.15.189:6833/3692905441] up:boot 2024-09-10T10:07:50.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:49 smithi050 ceph-mon[30354]: fsmap 1 up:standby 2024-09-10T10:07:50.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:49 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:07:50.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:49 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:50.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:49 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:50.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:49 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:50.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:49 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:50.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:49 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:07:50.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:49 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:50.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:49 smithi050 ceph-mon[30354]: Deploying daemon mds.k on smithi084 2024-09-10T10:07:50.943 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:07:51.328 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:07:51.329 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:07:51 smithi084 systemd[1]: Starting Ceph mds.k for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:07:51.599 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:07:51 smithi084 podman[63548]: 2024-09-10 10:07:51.230675931 +0000 UTC m=+0.015579935 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:07:51.599 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:07:51 smithi084 podman[63548]: 2024-09-10 10:07:51.340649131 +0000 UTC m=+0.125553136 container create 793e42c7ded8c55964e006e2e5504e2d672d74c515a479c7e58b9e55e9fd0b8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-k, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T10:07:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.928+0000 7f75b9000640 1 -- 172.21.15.50:0/3661513202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b41049a0 msgr2=0x7f75b41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.928+0000 7f75b9000640 1 --2- 172.21.15.50:0/3661513202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b41049a0 0x7f75b41089f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009900 tx=0x7f75a002a410 comp rx=0 tx=0).stop 2024-09-10T10:07:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.928+0000 7f75b9000640 1 -- 172.21.15.50:0/3661513202 shutdown_connections 2024-09-10T10:07:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.928+0000 7f75b9000640 1 --2- 172.21.15.50:0/3661513202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75b4109120 0x7f75b4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.928+0000 7f75b9000640 1 --2- 172.21.15.50:0/3661513202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b41049a0 0x7f75b41089f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.928+0000 7f75b9000640 1 --2- 172.21.15.50:0/3661513202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b4103ff0 0x7f75b41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.928+0000 7f75b9000640 1 -- 172.21.15.50:0/3661513202 >> 172.21.15.50:0/3661513202 conn(0x7f75b40ffa90 msgr2=0x7f75b4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.928+0000 7f75b9000640 1 -- 172.21.15.50:0/3661513202 shutdown_connections 2024-09-10T10:07:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.928+0000 7f75b9000640 1 -- 172.21.15.50:0/3661513202 wait complete. 2024-09-10T10:07:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.929+0000 7f75b9000640 1 Processor -- start 2024-09-10T10:07:51.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.929+0000 7f75b9000640 1 -- start start 2024-09-10T10:07:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b9000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b4103ff0 0x7f75b419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b9000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75b41049a0 0x7f75b419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b9000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b4109120 0x7f75b419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b9000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f75b4114190 con 0x7f75b4103ff0 2024-09-10T10:07:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b9000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f75b4114010 con 0x7f75b4109120 2024-09-10T10:07:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b9000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f75b4114310 con 0x7f75b41049a0 2024-09-10T10:07:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b4103ff0 0x7f75b419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b4109120 0x7f75b419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b4103ff0 0x7f75b419a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38886/0 (socket says 172.21.15.50:38886) 2024-09-10T10:07:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b1e00640 1 -- 172.21.15.50:0/2544651836 learned_addr learned my addr 172.21.15.50:0/2544651836 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:07:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b1400640 1 --2- 172.21.15.50:0/2544651836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75b41049a0 0x7f75b419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:51.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b1e00640 1 -- 172.21.15.50:0/2544651836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75b41049a0 msgr2=0x7f75b419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:51.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b1e00640 1 --2- 172.21.15.50:0/2544651836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75b41049a0 0x7f75b419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:51.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b1e00640 1 -- 172.21.15.50:0/2544651836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b4109120 msgr2=0x7f75b419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:51.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b1e00640 1 --2- 172.21.15.50:0/2544651836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b4109120 0x7f75b419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:51.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.930+0000 7f75b1e00640 1 -- 172.21.15.50:0/2544651836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b419f5a0 con 0x7f75b4103ff0 2024-09-10T10:07:51.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.931+0000 7f75b1e00640 1 --2- 172.21.15.50:0/2544651836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b4103ff0 0x7f75b419a5f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f75a400e9f0 tx=0x7f75a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:51.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.931+0000 7f75aaa00640 1 -- 172.21.15.50:0/2544651836 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a400cd80 con 0x7f75b4103ff0 2024-09-10T10:07:51.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.931+0000 7f75b9000640 1 -- 172.21.15.50:0/2544651836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b419f890 con 0x7f75b4103ff0 2024-09-10T10:07:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.931+0000 7f75aaa00640 1 -- 172.21.15.50:0/2544651836 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75a4010910 con 0x7f75b4103ff0 2024-09-10T10:07:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.931+0000 7f75aaa00640 1 -- 172.21.15.50:0/2544651836 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4018990 con 0x7f75b4103ff0 2024-09-10T10:07:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.931+0000 7f75b9000640 1 -- 172.21.15.50:0/2544651836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b41a7170 con 0x7f75b4103ff0 2024-09-10T10:07:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.932+0000 7f75b9000640 1 -- 172.21.15.50:0/2544651836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75b41043d0 con 0x7f75b4103ff0 2024-09-10T10:07:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.934+0000 7f75aaa00640 1 -- 172.21.15.50:0/2544651836 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f75a4010ac0 con 0x7f75b4103ff0 2024-09-10T10:07:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.935+0000 7f75aaa00640 1 --2- 172.21.15.50:0/2544651836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f75980a2c00 0x7f75980a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.935+0000 7f75aaa00640 1 -- 172.21.15.50:0/2544651836 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f75a40ceeb0 con 0x7f75b4103ff0 2024-09-10T10:07:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.936+0000 7f75b1400640 1 --2- 172.21.15.50:0/2544651836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f75980a2c00 0x7f75980a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.936+0000 7f75b1400640 1 --2- 172.21.15.50:0/2544651836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f75980a2c00 0x7f75980a50c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f75a0000c00 tx=0x7f75a0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:51.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:51.940+0000 7f75aaa00640 1 -- 172.21.15.50:0/2544651836 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75a409bbc0 con 0x7f75b4103ff0 2024-09-10T10:07:52.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:51 smithi189 ceph-mon[34999]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:52.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:51 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:52.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:51 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:52.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:51 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:52.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:51 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:52.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:51 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:07:52.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:51 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:52.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:51 smithi084 ceph-mon[34812]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:52.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:51 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:52.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:51 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:52.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:51 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:52.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:51 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:52.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:51 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:07:52.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:51 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:52.100 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:07:51 smithi084 podman[63548]: 2024-09-10 10:07:51.601458622 +0000 UTC m=+0.386362626 container init 793e42c7ded8c55964e006e2e5504e2d672d74c515a479c7e58b9e55e9fd0b8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T10:07:52.100 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:07:51 smithi084 podman[63548]: 2024-09-10 10:07:51.604237385 +0000 UTC m=+0.389141389 container start 793e42c7ded8c55964e006e2e5504e2d672d74c515a479c7e58b9e55e9fd0b8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-k, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T10:07:52.100 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:07:51 smithi084 ceph-mds[63567]: -- 172.21.15.84:0/628179333 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562b503b7860 con 0x562b50395400 2024-09-10T10:07:52.100 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:07:51 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-k[63563]: starting mds.k at 2024-09-10T10:07:52.100 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:07:51 smithi084 bash[63548]: 793e42c7ded8c55964e006e2e5504e2d672d74c515a479c7e58b9e55e9fd0b8e 2024-09-10T10:07:52.100 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:07:51 smithi084 systemd[1]: Started Ceph mds.k for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:07:52.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.164+0000 7f75b9000640 1 -- 172.21.15.50:0/2544651836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75b41a73a0 con 0x7f75b4103ff0 2024-09-10T10:07:52.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:51 smithi050 ceph-mon[30354]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:52.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:51 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:52.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:51 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:52.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:51 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:52.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:51 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:52.166 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:51 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:07:52.167 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:51 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.165+0000 7f75aaa00640 1 -- 172.21.15.50:0/2544651836 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f75a409fec0 con 0x7f75b4103ff0 2024-09-10T10:07:52.167 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:07:52.167 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"btime":"2024-09-10T10:07:51:804005+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T10:07:52.167 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2024-09-10T10:07:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.167+0000 7f75b9000640 1 -- 172.21.15.50:0/2544651836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f75980a2c00 msgr2=0x7f75980a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.167+0000 7f75b9000640 1 --2- 172.21.15.50:0/2544651836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f75980a2c00 0x7f75980a50c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f75a0000c00 tx=0x7f75a0005b50 comp rx=0 tx=0).stop 2024-09-10T10:07:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.167+0000 7f75b9000640 1 -- 172.21.15.50:0/2544651836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b4103ff0 msgr2=0x7f75b419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.167+0000 7f75b9000640 1 --2- 172.21.15.50:0/2544651836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b4103ff0 0x7f75b419a5f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f75a400e9f0 tx=0x7f75a400eeb0 comp rx=0 tx=0).stop 2024-09-10T10:07:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.168+0000 7f75b9000640 1 -- 172.21.15.50:0/2544651836 shutdown_connections 2024-09-10T10:07:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.168+0000 7f75b9000640 1 --2- 172.21.15.50:0/2544651836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f75980a2c00 0x7f75980a50c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.168+0000 7f75b9000640 1 --2- 172.21.15.50:0/2544651836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b4109120 0x7f75b419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:52.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.168+0000 7f75b9000640 1 --2- 172.21.15.50:0/2544651836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75b41049a0 0x7f75b419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.168+0000 7f75b9000640 1 --2- 172.21.15.50:0/2544651836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75b4103ff0 0x7f75b419a5f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.168+0000 7f75b9000640 1 -- 172.21.15.50:0/2544651836 >> 172.21.15.50:0/2544651836 conn(0x7f75b40ffa90 msgr2=0x7f75b4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.168+0000 7f75b9000640 1 -- 172.21.15.50:0/2544651836 shutdown_connections 2024-09-10T10:07:52.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:52.168+0000 7f75b9000640 1 -- 172.21.15.50:0/2544651836 wait complete. 2024-09-10T10:07:53.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:52 smithi189 ceph-mon[34999]: Deploying daemon mds.j on smithi050 2024-09-10T10:07:53.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:52 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.84:6832/4243926452,v1:172.21.15.84:6833/4243926452] up:boot 2024-09-10T10:07:53.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:52 smithi189 ceph-mon[34999]: fsmap 2 up:standby 2024-09-10T10:07:53.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:52 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:07:53.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:52 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2544651836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:07:53.090 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:52 smithi050 ceph-mon[30354]: Deploying daemon mds.j on smithi050 2024-09-10T10:07:53.090 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:52 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.84:6832/4243926452,v1:172.21.15.84:6833/4243926452] up:boot 2024-09-10T10:07:53.090 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:52 smithi050 ceph-mon[30354]: fsmap 2 up:standby 2024-09-10T10:07:53.090 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:52 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:07:53.090 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:52 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2544651836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:07:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:52 smithi084 ceph-mon[34812]: Deploying daemon mds.j on smithi050 2024-09-10T10:07:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:52 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.84:6832/4243926452,v1:172.21.15.84:6833/4243926452] up:boot 2024-09-10T10:07:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:52 smithi084 ceph-mon[34812]: fsmap 2 up:standby 2024-09-10T10:07:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:52 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:07:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:52 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2544651836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:07:54.029 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:53 smithi084 ceph-mon[34812]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:54.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:53 smithi189 ceph-mon[34999]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:54.148 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:53 smithi050 ceph-mon[30354]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:54.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:07:55.403 INFO:journalctl@ceph.mds.j.smithi050.stdout:Sep 10 10:07:55 smithi050 podman[70034]: 2024-09-10 10:07:55.16613328 +0000 UTC m=+0.158038170 container create f2e0655ccc56e4439b41fe7691e31194ebe340532ae82c2daefcf82930259c86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T10:07:55.403 INFO:journalctl@ceph.mds.j.smithi050.stdout:Sep 10 10:07:55 smithi050 podman[70034]: 2024-09-10 10:07:55.402440119 +0000 UTC m=+0.394345012 container init f2e0655ccc56e4439b41fe7691e31194ebe340532ae82c2daefcf82930259c86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T10:07:55.626 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:07:55.715 INFO:journalctl@ceph.mds.j.smithi050.stdout:Sep 10 10:07:55 smithi050 podman[70034]: 2024-09-10 10:07:55.408777941 +0000 UTC m=+0.400682831 container start f2e0655ccc56e4439b41fe7691e31194ebe340532ae82c2daefcf82930259c86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-j, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T10:07:55.715 INFO:journalctl@ceph.mds.j.smithi050.stdout:Sep 10 10:07:55 smithi050 ceph-mds[70093]: -- 172.21.15.50:0/3925495191 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559af923fc20 con 0x559af921c800 2024-09-10T10:07:55.715 INFO:journalctl@ceph.mds.j.smithi050.stdout:Sep 10 10:07:55 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-j[70079]: starting mds.j at 2024-09-10T10:07:55.715 INFO:journalctl@ceph.mds.j.smithi050.stdout:Sep 10 10:07:55 smithi050 bash[70034]: f2e0655ccc56e4439b41fe7691e31194ebe340532ae82c2daefcf82930259c86 2024-09-10T10:07:55.715 INFO:journalctl@ceph.mds.j.smithi050.stdout:Sep 10 10:07:55 smithi050 systemd[1]: Started Ceph mds.j for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:07:56.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.204+0000 7faaf8e00640 1 -- 172.21.15.50:0/3847293444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf41047e0 msgr2=0x7faaf4108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:56.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.204+0000 7faaf8e00640 1 --2- 172.21.15.50:0/3847293444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf41047e0 0x7faaf4108830 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faadc009900 tx=0x7faadc02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:07:56.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.204+0000 7faaf8e00640 1 -- 172.21.15.50:0/3847293444 shutdown_connections 2024-09-10T10:07:56.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.204+0000 7faaf8e00640 1 --2- 172.21.15.50:0/3847293444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaf4108f60 0x7faaf4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:56.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.204+0000 7faaf8e00640 1 --2- 172.21.15.50:0/3847293444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf41047e0 0x7faaf4108830 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:56.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.204+0000 7faaf8e00640 1 --2- 172.21.15.50:0/3847293444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaf4103e30 0x7faaf4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:56.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.204+0000 7faaf8e00640 1 -- 172.21.15.50:0/3847293444 >> 172.21.15.50:0/3847293444 conn(0x7faaf40ff910 msgr2=0x7faaf4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:56.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.204+0000 7faaf8e00640 1 -- 172.21.15.50:0/3847293444 shutdown_connections 2024-09-10T10:07:56.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.204+0000 7faaf8e00640 1 -- 172.21.15.50:0/3847293444 wait complete. 2024-09-10T10:07:56.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.205+0000 7faaf8e00640 1 Processor -- start 2024-09-10T10:07:56.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.206+0000 7faaf8e00640 1 -- start start 2024-09-10T10:07:56.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.206+0000 7faaf8e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaf4103e30 0x7faaf419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:56.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.206+0000 7faaf8e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf41047e0 0x7faaf419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.206+0000 7faaf8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaf4108f60 0x7faaf419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.206+0000 7faaf8e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faaf4114010 con 0x7faaf41047e0 2024-09-10T10:07:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.206+0000 7faaf8e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faaf4113e90 con 0x7faaf4108f60 2024-09-10T10:07:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.206+0000 7faaf8e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faaf4114190 con 0x7faaf4103e30 2024-09-10T10:07:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.206+0000 7faaebe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf41047e0 0x7faaf419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.206+0000 7faaf3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaf4103e30 0x7faaf419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.206+0000 7faaebe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf41047e0 0x7faaf419aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38926/0 (socket says 172.21.15.50:38926) 2024-09-10T10:07:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.207+0000 7faaebe00640 1 -- 172.21.15.50:0/2309679773 learned_addr learned my addr 172.21.15.50:0/2309679773 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:07:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.207+0000 7faaf3e00640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaf4108f60 0x7faaf419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.207+0000 7faaebe00640 1 -- 172.21.15.50:0/2309679773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaf4103e30 msgr2=0x7faaf419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.207+0000 7faaebe00640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaf4103e30 0x7faaf419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.207+0000 7faaebe00640 1 -- 172.21.15.50:0/2309679773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaf4108f60 msgr2=0x7faaf419eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:56.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.207+0000 7faaebe00640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaf4108f60 0x7faaf419eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:56.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.207+0000 7faaebe00640 1 -- 172.21.15.50:0/2309679773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf419f480 con 0x7faaf41047e0 2024-09-10T10:07:56.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.207+0000 7faaf3400640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaf4103e30 0x7faaf419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:07:56.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.207+0000 7faaebe00640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf41047e0 0x7faaf419aa10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faadc004770 tx=0x7faadc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:56.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.208+0000 7faaf0c00640 1 -- 172.21.15.50:0/2309679773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc03f070 con 0x7faaf41047e0 2024-09-10T10:07:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.208+0000 7faaf0c00640 1 -- 172.21.15.50:0/2309679773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faadc031ca0 con 0x7faaf41047e0 2024-09-10T10:07:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.208+0000 7faaf8e00640 1 -- 172.21.15.50:0/2309679773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf419f710 con 0x7faaf41047e0 2024-09-10T10:07:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.208+0000 7faaf0c00640 1 -- 172.21.15.50:0/2309679773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc035030 con 0x7faaf41047e0 2024-09-10T10:07:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.208+0000 7faaf8e00640 1 -- 172.21.15.50:0/2309679773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf41a7050 con 0x7faaf41047e0 2024-09-10T10:07:56.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.209+0000 7faaf8e00640 1 -- 172.21.15.50:0/2309679773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf4105310 con 0x7faaf41047e0 2024-09-10T10:07:56.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.211+0000 7faaf0c00640 1 -- 172.21.15.50:0/2309679773 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7faadc042070 con 0x7faaf41047e0 2024-09-10T10:07:56.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.212+0000 7faaf0c00640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7faad80a2c00 0x7faad80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:07:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.212+0000 7faaf0c00640 1 -- 172.21.15.50:0/2309679773 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7faadc0ef180 con 0x7faaf41047e0 2024-09-10T10:07:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.213+0000 7faaf3400640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7faad80a2c00 0x7faad80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:07:56.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.213+0000 7faaf3400640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7faad80a2c00 0x7faad80a50c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faae4009fc0 tx=0x7faae4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:07:56.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.216+0000 7faaf0c00640 1 -- 172.21.15.50:0/2309679773 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faadc0bbf50 con 0x7faaf41047e0 2024-09-10T10:07:56.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.451+0000 7faaf8e00640 1 -- 172.21.15.50:0/2309679773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaf410c200 con 0x7faaf41047e0 2024-09-10T10:07:56.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.451+0000 7faaf0c00640 1 -- 172.21.15.50:0/2309679773 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7faadc0c0250 con 0x7faaf41047e0 2024-09-10T10:07:56.453 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:07:56.453 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":4,"btime":"2024-09-10T10:07:55:818566+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T10:07:56.453 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 4 2024-09-10T10:07:56.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.454+0000 7faaf8e00640 1 -- 172.21.15.50:0/2309679773 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7faad80a2c00 msgr2=0x7faad80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:56.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.454+0000 7faaf8e00640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7faad80a2c00 0x7faad80a50c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faae4009fc0 tx=0x7faae4005f90 comp rx=0 tx=0).stop 2024-09-10T10:07:56.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.454+0000 7faaf8e00640 1 -- 172.21.15.50:0/2309679773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf41047e0 msgr2=0x7faaf419aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:07:56.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.454+0000 7faaf8e00640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf41047e0 0x7faaf419aa10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faadc004770 tx=0x7faadc003c10 comp rx=0 tx=0).stop 2024-09-10T10:07:56.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.454+0000 7faaf8e00640 1 -- 172.21.15.50:0/2309679773 shutdown_connections 2024-09-10T10:07:56.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.454+0000 7faaf8e00640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7faad80a2c00 0x7faad80a50c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:56.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.454+0000 7faaf8e00640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaf4108f60 0x7faaf419eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:56.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.454+0000 7faaf8e00640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaf41047e0 0x7faaf419aa10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:56.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.454+0000 7faaf8e00640 1 --2- 172.21.15.50:0/2309679773 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faaf4103e30 0x7faaf419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:07:56.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.454+0000 7faaf8e00640 1 -- 172.21.15.50:0/2309679773 >> 172.21.15.50:0/2309679773 conn(0x7faaf40ff910 msgr2=0x7faaf4100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:07:56.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.454+0000 7faaf8e00640 1 -- 172.21.15.50:0/2309679773 shutdown_connections 2024-09-10T10:07:56.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:07:56.454+0000 7faaf8e00640 1 -- 172.21.15.50:0/2309679773 wait complete. 2024-09-10T10:07:56.705 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:56 smithi050 ceph-mon[30354]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:56.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:56.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:56.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:56.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:56.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:07:56.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:56.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:56 smithi050 ceph-mon[30354]: Deploying daemon mds.d on smithi050 2024-09-10T10:07:56.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:56 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.50:6834/3271446428,v1:172.21.15.50:6835/3271446428] up:boot 2024-09-10T10:07:56.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:56 smithi050 ceph-mon[30354]: fsmap 3 up:standby 2024-09-10T10:07:56.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:56 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T10:07:56.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:56 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2309679773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:07:57.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:56 smithi189 ceph-mon[34999]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:57.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:57.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:57.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:57.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:57.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:07:57.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:57.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:56 smithi189 ceph-mon[34999]: Deploying daemon mds.d on smithi050 2024-09-10T10:07:57.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:56 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.50:6834/3271446428,v1:172.21.15.50:6835/3271446428] up:boot 2024-09-10T10:07:57.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:56 smithi189 ceph-mon[34999]: fsmap 3 up:standby 2024-09-10T10:07:57.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:56 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T10:07:57.087 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:56 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2309679773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:07:57.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:56 smithi084 ceph-mon[34812]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:57.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:57.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:57.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:07:57.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:07:57.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:07:57.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:07:57.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:56 smithi084 ceph-mon[34812]: Deploying daemon mds.d on smithi050 2024-09-10T10:07:57.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:56 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.50:6834/3271446428,v1:172.21.15.50:6835/3271446428] up:boot 2024-09-10T10:07:57.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:56 smithi084 ceph-mon[34812]: fsmap 3 up:standby 2024-09-10T10:07:57.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:56 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T10:07:57.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:56 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2309679773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:07:58.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:07:58 smithi050 ceph-mon[30354]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:59.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:07:58 smithi189 ceph-mon[34999]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:59.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:07:58 smithi084 ceph-mon[34812]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:07:59.306 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:07:58 smithi050 systemd[1]: Starting Ceph mds.d for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:07:59.576 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:07:59 smithi050 podman[70442]: 2024-09-10 10:07:59.21046891 +0000 UTC m=+0.027576838 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:07:59.576 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:07:59 smithi050 podman[70442]: 2024-09-10 10:07:59.322627773 +0000 UTC m=+0.139735691 container create 4a0d96b64f6aaba94a685ff2736ce31215d214da18a268e0a915f0d3783de17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T10:07:59.577 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:07:59 smithi050 podman[70442]: 2024-09-10 10:07:59.575589425 +0000 UTC m=+0.392697353 container init 4a0d96b64f6aaba94a685ff2736ce31215d214da18a268e0a915f0d3783de17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T10:07:59.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:07:59.911 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:07:59 smithi050 podman[70442]: 2024-09-10 10:07:59.582320376 +0000 UTC m=+0.399428294 container start 4a0d96b64f6aaba94a685ff2736ce31215d214da18a268e0a915f0d3783de17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:07:59.912 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:07:59 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-d[70457]: starting mds.d at 2024-09-10T10:07:59.912 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:07:59 smithi050 bash[70442]: 4a0d96b64f6aaba94a685ff2736ce31215d214da18a268e0a915f0d3783de17d 2024-09-10T10:07:59.912 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:07:59 smithi050 systemd[1]: Started Ceph mds.d for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:08:00.241 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:00 smithi050 ceph-mon[30354]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:00.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.835+0000 7fe6d2200640 1 -- 172.21.15.50:0/928579729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc1047e0 msgr2=0x7fe6cc108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:00.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.835+0000 7fe6d2200640 1 --2- 172.21.15.50:0/928579729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc1047e0 0x7fe6cc108830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009860 tx=0x7fe6b802a340 comp rx=0 tx=0).stop 2024-09-10T10:08:00.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.835+0000 7fe6d2200640 1 -- 172.21.15.50:0/928579729 shutdown_connections 2024-09-10T10:08:00.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.835+0000 7fe6d2200640 1 --2- 172.21.15.50:0/928579729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6cc108f60 0x7fe6cc110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:00.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.835+0000 7fe6d2200640 1 --2- 172.21.15.50:0/928579729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc1047e0 0x7fe6cc108830 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:00.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.835+0000 7fe6d2200640 1 --2- 172.21.15.50:0/928579729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6cc103e30 0x7fe6cc104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:00.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.835+0000 7fe6d2200640 1 -- 172.21.15.50:0/928579729 >> 172.21.15.50:0/928579729 conn(0x7fe6cc0ff8d0 msgr2=0x7fe6cc101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:00.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.835+0000 7fe6d2200640 1 -- 172.21.15.50:0/928579729 shutdown_connections 2024-09-10T10:08:00.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.835+0000 7fe6d2200640 1 -- 172.21.15.50:0/928579729 wait complete. 2024-09-10T10:08:00.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.836+0000 7fe6d2200640 1 Processor -- start 2024-09-10T10:08:00.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.836+0000 7fe6d2200640 1 -- start start 2024-09-10T10:08:00.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.837+0000 7fe6d2200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc103e30 0x7fe6cc19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:00.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.837+0000 7fe6d2200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6cc1047e0 0x7fe6cc19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:00.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.837+0000 7fe6d2200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6cc108f60 0x7fe6cc19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:00.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.837+0000 7fe6d2200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc113fc0 con 0x7fe6cc1047e0 2024-09-10T10:08:00.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.837+0000 7fe6d2200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc113e40 con 0x7fe6cc103e30 2024-09-10T10:08:00.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.837+0000 7fe6d2200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc114140 con 0x7fe6cc108f60 2024-09-10T10:08:00.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.837+0000 7fe6d0e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc103e30 0x7fe6cc19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:00.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.837+0000 7fe6d0e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc103e30 0x7fe6cc19a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:42610/0 (socket says 172.21.15.50:42610) 2024-09-10T10:08:00.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.837+0000 7fe6d0e00640 1 -- 172.21.15.50:0/1152758546 learned_addr learned my addr 172.21.15.50:0/1152758546 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:00.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.837+0000 7fe6cbe00640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6cc1047e0 0x7fe6cc19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:00.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.837+0000 7fe6d1800640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6cc108f60 0x7fe6cc19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:00.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.837+0000 7fe6d0e00640 1 -- 172.21.15.50:0/1152758546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6cc108f60 msgr2=0x7fe6cc19ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:00.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.838+0000 7fe6d0e00640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6cc108f60 0x7fe6cc19ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:00.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.838+0000 7fe6d0e00640 1 -- 172.21.15.50:0/1152758546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6cc1047e0 msgr2=0x7fe6cc19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:00.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.838+0000 7fe6d0e00640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6cc1047e0 0x7fe6cc19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:00.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.838+0000 7fe6d0e00640 1 -- 172.21.15.50:0/1152758546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6cc19f440 con 0x7fe6cc103e30 2024-09-10T10:08:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.838+0000 7fe6cbe00640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6cc1047e0 0x7fe6cc19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:08:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.838+0000 7fe6d0e00640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc103e30 0x7fe6cc19a490 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000e9c0 tx=0x7fe6c000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.838+0000 7fe6c9600640 1 -- 172.21.15.50:0/1152758546 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c000cde0 con 0x7fe6cc103e30 2024-09-10T10:08:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.838+0000 7fe6d2200640 1 -- 172.21.15.50:0/1152758546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6cc19f730 con 0x7fe6cc103e30 2024-09-10T10:08:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.838+0000 7fe6c9600640 1 -- 172.21.15.50:0/1152758546 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6c00035f0 con 0x7fe6cc103e30 2024-09-10T10:08:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.838+0000 7fe6c9600640 1 -- 172.21.15.50:0/1152758546 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0010690 con 0x7fe6cc103e30 2024-09-10T10:08:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.838+0000 7fe6d2200640 1 -- 172.21.15.50:0/1152758546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6cc1a7010 con 0x7fe6cc103e30 2024-09-10T10:08:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.839+0000 7fe6d2200640 1 -- 172.21.15.50:0/1152758546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6cc104210 con 0x7fe6cc103e30 2024-09-10T10:08:00.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.841+0000 7fe6c9600640 1 -- 172.21.15.50:0/1152758546 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe6c00037a0 con 0x7fe6cc103e30 2024-09-10T10:08:00.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.843+0000 7fe6c9600640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6b40a2b80 0x7fe6b40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:00.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.843+0000 7fe6c9600640 1 -- 172.21.15.50:0/1152758546 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fe6c00cefe0 con 0x7fe6cc103e30 2024-09-10T10:08:00.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.843+0000 7fe6cbe00640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6b40a2b80 0x7fe6b40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:00.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.843+0000 7fe6cbe00640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6b40a2b80 0x7fe6b40a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6b802a930 tx=0x7fe6b80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:00.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:00.846+0000 7fe6c9600640 1 -- 172.21.15.50:0/1152758546 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe6c009c380 con 0x7fe6cc103e30 2024-09-10T10:08:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:00 smithi084 ceph-mon[34812]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:01.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.068+0000 7fe6d2200640 1 -- 172.21.15.50:0/1152758546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6cc19b7f0 con 0x7fe6cc103e30 2024-09-10T10:08:01.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.069+0000 7fe6c9600640 1 -- 172.21.15.50:0/1152758546 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7fe6c009bc80 con 0x7fe6cc103e30 2024-09-10T10:08:01.071 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:08:01.071 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"btime":"2024-09-10T10:08:00:621066+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T10:08:01.071 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 5 2024-09-10T10:08:01.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.071+0000 7fe6d2200640 1 -- 172.21.15.50:0/1152758546 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6b40a2b80 msgr2=0x7fe6b40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:01.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.071+0000 7fe6d2200640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6b40a2b80 0x7fe6b40a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6b802a930 tx=0x7fe6b80058d0 comp rx=0 tx=0).stop 2024-09-10T10:08:01.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.071+0000 7fe6d2200640 1 -- 172.21.15.50:0/1152758546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc103e30 msgr2=0x7fe6cc19a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:01.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.071+0000 7fe6d2200640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc103e30 0x7fe6cc19a490 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000e9c0 tx=0x7fe6c000ee80 comp rx=0 tx=0).stop 2024-09-10T10:08:01.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.071+0000 7fe6d2200640 1 -- 172.21.15.50:0/1152758546 shutdown_connections 2024-09-10T10:08:01.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.071+0000 7fe6d2200640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6b40a2b80 0x7fe6b40a5040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:01.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.072+0000 7fe6d2200640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe6cc108f60 0x7fe6cc19ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:01.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.072+0000 7fe6d2200640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6cc1047e0 0x7fe6cc19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:01.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.072+0000 7fe6d2200640 1 --2- 172.21.15.50:0/1152758546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6cc103e30 0x7fe6cc19a490 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:01.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.072+0000 7fe6d2200640 1 -- 172.21.15.50:0/1152758546 >> 172.21.15.50:0/1152758546 conn(0x7fe6cc0ff8d0 msgr2=0x7fe6cc100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:01.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.072+0000 7fe6d2200640 1 -- 172.21.15.50:0/1152758546 shutdown_connections 2024-09-10T10:08:01.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:01.072+0000 7fe6d2200640 1 -- 172.21.15.50:0/1152758546 wait complete. 2024-09-10T10:08:01.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:00 smithi189 ceph-mon[34999]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:01.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:01.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:01.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:01.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:01.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:01.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:01 smithi050 ceph-mon[30354]: Deploying daemon mds.e on smithi084 2024-09-10T10:08:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:01 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.50:6836/206120468,v1:172.21.15.50:6837/206120468] up:boot 2024-09-10T10:08:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:01 smithi050 ceph-mon[30354]: fsmap 4 up:standby 2024-09-10T10:08:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:01 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T10:08:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:01 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1152758546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:01.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:01 smithi084 ceph-mon[34812]: Deploying daemon mds.e on smithi084 2024-09-10T10:08:01.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:01 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.50:6836/206120468,v1:172.21.15.50:6837/206120468] up:boot 2024-09-10T10:08:01.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:01 smithi084 ceph-mon[34812]: fsmap 4 up:standby 2024-09-10T10:08:01.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:01 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T10:08:01.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:01 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1152758546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:01.850 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:08:01 smithi084 systemd[1]: Starting Ceph mds.e for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:08:02.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:01 smithi189 ceph-mon[34999]: Deploying daemon mds.e on smithi084 2024-09-10T10:08:02.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:01 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.50:6836/206120468,v1:172.21.15.50:6837/206120468] up:boot 2024-09-10T10:08:02.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:01 smithi189 ceph-mon[34999]: fsmap 4 up:standby 2024-09-10T10:08:02.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:01 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T10:08:02.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:01 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1152758546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:02.315 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:08:01 smithi084 podman[63862]: 2024-09-10 10:08:01.874240682 +0000 UTC m=+0.015941139 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:08:02.315 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:08:02 smithi084 podman[63862]: 2024-09-10 10:08:02.070571409 +0000 UTC m=+0.212271852 container create cd4cd5f71aa4c7c8b1e1a7c090f44d094b063bbd8c03eca55df6171cd06ff536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:08:02.316 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:08:02 smithi084 podman[63862]: 2024-09-10 10:08:02.314885448 +0000 UTC m=+0.456585896 container init cd4cd5f71aa4c7c8b1e1a7c090f44d094b063bbd8c03eca55df6171cd06ff536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T10:08:02.599 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:08:02 smithi084 podman[63862]: 2024-09-10 10:08:02.317762897 +0000 UTC m=+0.459463341 container start cd4cd5f71aa4c7c8b1e1a7c090f44d094b063bbd8c03eca55df6171cd06ff536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:08:02.599 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:08:02 smithi084 ceph-mds[63881]: -- 172.21.15.84:0/3996201606 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55927af13860 con 0x55927aef0800 2024-09-10T10:08:02.599 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:08:02 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-e[63877]: starting mds.e at 2024-09-10T10:08:02.599 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:08:02 smithi084 bash[63862]: cd4cd5f71aa4c7c8b1e1a7c090f44d094b063bbd8c03eca55df6171cd06ff536 2024-09-10T10:08:02.599 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:08:02 smithi084 systemd[1]: Started Ceph mds.e for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:08:02.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:02 smithi189 ceph-mon[34999]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:02.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:02.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:02.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:02.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:02.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:02.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:02 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:02.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:02 smithi050 ceph-mon[30354]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:02.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:02.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:02.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:02.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:02.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:02.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:02 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:03.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:02 smithi084 ceph-mon[34812]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:03.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:03.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:03.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:03.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:03.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:03.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:02 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:03.932 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:08:03.964 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:03 smithi050 ceph-mon[30354]: Deploying daemon mds.f on smithi189 2024-09-10T10:08:03.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:03 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.84:6834/1698924277,v1:172.21.15.84:6835/1698924277] up:boot 2024-09-10T10:08:03.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:03 smithi050 ceph-mon[30354]: fsmap 5 up:standby 2024-09-10T10:08:03.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:03 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:08:03.989 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:03 smithi189 ceph-mon[34999]: Deploying daemon mds.f on smithi189 2024-09-10T10:08:03.989 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:03 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.84:6834/1698924277,v1:172.21.15.84:6835/1698924277] up:boot 2024-09-10T10:08:03.989 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:03 smithi189 ceph-mon[34999]: fsmap 5 up:standby 2024-09-10T10:08:03.989 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:03 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:08:04.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:03 smithi084 ceph-mon[34812]: Deploying daemon mds.f on smithi189 2024-09-10T10:08:04.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:03 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.84:6834/1698924277,v1:172.21.15.84:6835/1698924277] up:boot 2024-09-10T10:08:04.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:03 smithi084 ceph-mon[34812]: fsmap 5 up:standby 2024-09-10T10:08:04.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:03 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:08:04.323 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:04.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:04 smithi050 ceph-mon[30354]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:04.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:04 smithi084 ceph-mon[34812]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.901+0000 7fac74c00640 1 -- 172.21.15.50:0/1745047136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac70103ff0 msgr2=0x7fac701043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.901+0000 7fac74c00640 1 --2- 172.21.15.50:0/1745047136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac70103ff0 0x7fac701043d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac60009900 tx=0x7fac6002a410 comp rx=0 tx=0).stop 2024-09-10T10:08:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.901+0000 7fac74c00640 1 -- 172.21.15.50:0/1745047136 shutdown_connections 2024-09-10T10:08:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.901+0000 7fac74c00640 1 --2- 172.21.15.50:0/1745047136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac70109120 0x7fac70110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.901+0000 7fac74c00640 1 --2- 172.21.15.50:0/1745047136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac701049a0 0x7fac701089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.901+0000 7fac74c00640 1 --2- 172.21.15.50:0/1745047136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac70103ff0 0x7fac701043d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.901+0000 7fac74c00640 1 -- 172.21.15.50:0/1745047136 >> 172.21.15.50:0/1745047136 conn(0x7fac700ffa90 msgr2=0x7fac70101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.901+0000 7fac74c00640 1 -- 172.21.15.50:0/1745047136 shutdown_connections 2024-09-10T10:08:04.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.901+0000 7fac74c00640 1 -- 172.21.15.50:0/1745047136 wait complete. 2024-09-10T10:08:04.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.902+0000 7fac74c00640 1 Processor -- start 2024-09-10T10:08:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.902+0000 7fac74c00640 1 -- start start 2024-09-10T10:08:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.902+0000 7fac74c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac70103ff0 0x7fac7019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.902+0000 7fac74c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac701049a0 0x7fac7019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.902+0000 7fac74c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac70109120 0x7fac7019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.902+0000 7fac74c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fac701141a0 con 0x7fac701049a0 2024-09-10T10:08:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.902+0000 7fac74c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fac70114020 con 0x7fac70103ff0 2024-09-10T10:08:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.902+0000 7fac74c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fac70114320 con 0x7fac70109120 2024-09-10T10:08:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.903+0000 7fac67e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac701049a0 0x7fac7019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.903+0000 7fac6de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac70103ff0 0x7fac7019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.903+0000 7fac6de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac70103ff0 0x7fac7019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:42616/0 (socket says 172.21.15.50:42616) 2024-09-10T10:08:04.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.903+0000 7fac6de00640 1 -- 172.21.15.50:0/4099907147 learned_addr learned my addr 172.21.15.50:0/4099907147 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.903+0000 7fac67e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac701049a0 0x7fac7019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42198/0 (socket says 172.21.15.50:42198) 2024-09-10T10:08:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.903+0000 7fac6e800640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac70109120 0x7fac7019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.903+0000 7fac6e800640 1 -- 172.21.15.50:0/4099907147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac70103ff0 msgr2=0x7fac7019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.903+0000 7fac6e800640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac70103ff0 0x7fac7019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.903+0000 7fac6e800640 1 -- 172.21.15.50:0/4099907147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac701049a0 msgr2=0x7fac7019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.903+0000 7fac6e800640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac701049a0 0x7fac7019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.903+0000 7fac6e800640 1 -- 172.21.15.50:0/4099907147 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7019f5d0 con 0x7fac70109120 2024-09-10T10:08:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.903+0000 7fac6de00640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac70103ff0 0x7fac7019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:08:04.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.904+0000 7fac6e800640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac70109120 0x7fac7019eef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac6800e940 tx=0x7fac6800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.904+0000 7fac66a00640 1 -- 172.21.15.50:0/4099907147 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac68004d20 con 0x7fac70109120 2024-09-10T10:08:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.904+0000 7fac66a00640 1 -- 172.21.15.50:0/4099907147 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac68005020 con 0x7fac70109120 2024-09-10T10:08:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.904+0000 7fac74c00640 1 -- 172.21.15.50:0/4099907147 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7019f8c0 con 0x7fac70109120 2024-09-10T10:08:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.904+0000 7fac66a00640 1 -- 172.21.15.50:0/4099907147 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac680116b0 con 0x7fac70109120 2024-09-10T10:08:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.904+0000 7fac74c00640 1 -- 172.21.15.50:0/4099907147 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac701a71a0 con 0x7fac70109120 2024-09-10T10:08:04.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.905+0000 7fac74c00640 1 -- 172.21.15.50:0/4099907147 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac701043d0 con 0x7fac70109120 2024-09-10T10:08:04.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.907+0000 7fac66a00640 1 -- 172.21.15.50:0/4099907147 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fac680054d0 con 0x7fac70109120 2024-09-10T10:08:04.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.908+0000 7fac66a00640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac540a2c00 0x7fac540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:04.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.909+0000 7fac66a00640 1 -- 172.21.15.50:0/4099907147 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fac680cef10 con 0x7fac70109120 2024-09-10T10:08:04.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.909+0000 7fac6de00640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac540a2c00 0x7fac540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:04.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.909+0000 7fac6de00640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac540a2c00 0x7fac540a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fac600096c0 tx=0x7fac600046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:04.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:04.913+0000 7fac66a00640 1 -- 172.21.15.50:0/4099907147 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac68016030 con 0x7fac70109120 2024-09-10T10:08:05.019 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:04 smithi189 ceph-mon[34999]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:05.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.133+0000 7fac74c00640 1 -- 172.21.15.50:0/4099907147 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac7019b980 con 0x7fac70109120 2024-09-10T10:08:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.134+0000 7fac66a00640 1 -- 172.21.15.50:0/4099907147 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7fac68086070 con 0x7fac70109120 2024-09-10T10:08:05.135 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:08:05.136 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"btime":"2024-09-10T10:08:02:633892+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T10:08:05.136 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2024-09-10T10:08:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.137+0000 7fac74c00640 1 -- 172.21.15.50:0/4099907147 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac540a2c00 msgr2=0x7fac540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.137+0000 7fac74c00640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac540a2c00 0x7fac540a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fac600096c0 tx=0x7fac600046c0 comp rx=0 tx=0).stop 2024-09-10T10:08:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.137+0000 7fac74c00640 1 -- 172.21.15.50:0/4099907147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac70109120 msgr2=0x7fac7019eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.137+0000 7fac74c00640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac70109120 0x7fac7019eef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac6800e940 tx=0x7fac6800ee00 comp rx=0 tx=0).stop 2024-09-10T10:08:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.137+0000 7fac74c00640 1 -- 172.21.15.50:0/4099907147 shutdown_connections 2024-09-10T10:08:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.137+0000 7fac74c00640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac540a2c00 0x7fac540a50c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.137+0000 7fac74c00640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac70109120 0x7fac7019eef0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.137+0000 7fac74c00640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac701049a0 0x7fac7019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.137+0000 7fac74c00640 1 --2- 172.21.15.50:0/4099907147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac70103ff0 0x7fac7019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.137+0000 7fac74c00640 1 -- 172.21.15.50:0/4099907147 >> 172.21.15.50:0/4099907147 conn(0x7fac700ffa90 msgr2=0x7fac70100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.137+0000 7fac74c00640 1 -- 172.21.15.50:0/4099907147 shutdown_connections 2024-09-10T10:08:05.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:05.137+0000 7fac74c00640 1 -- 172.21.15.50:0/4099907147 wait complete. 2024-09-10T10:08:05.335 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 10:08:05 smithi189 systemd[1]: Started Ceph mds.f for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:08:05.852 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:05 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4099907147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:05.852 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:05.852 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:05.852 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:05.852 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:05.852 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:05.852 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:05 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:05.913 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:05 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4099907147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:05.913 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:05.913 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:05.913 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:05.913 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:05.913 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:05.913 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:05 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:06.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:05 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4099907147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:06.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:06.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:06.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:06.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:06.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:06.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:05 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:06.807 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:06 smithi189 ceph-mon[34999]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:06.807 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:06 smithi189 ceph-mon[34999]: Deploying daemon mds.c on smithi189 2024-09-10T10:08:06.807 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:06 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.189:6834/1101442212,v1:172.21.15.189:6835/1101442212] up:boot 2024-09-10T10:08:06.807 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:06 smithi189 ceph-mon[34999]: fsmap 6 up:standby 2024-09-10T10:08:06.807 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:06 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:08:06.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:06 smithi050 ceph-mon[30354]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:06.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:06 smithi050 ceph-mon[30354]: Deploying daemon mds.c on smithi189 2024-09-10T10:08:06.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:06 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.189:6834/1101442212,v1:172.21.15.189:6835/1101442212] up:boot 2024-09-10T10:08:06.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:06 smithi050 ceph-mon[30354]: fsmap 6 up:standby 2024-09-10T10:08:06.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:06 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:08:07.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:06 smithi084 ceph-mon[34812]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:07.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:06 smithi084 ceph-mon[34812]: Deploying daemon mds.c on smithi189 2024-09-10T10:08:07.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:06 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.189:6834/1101442212,v1:172.21.15.189:6835/1101442212] up:boot 2024-09-10T10:08:07.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:06 smithi084 ceph-mon[34812]: fsmap 6 up:standby 2024-09-10T10:08:07.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:06 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:08:07.501 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:08:07 smithi189 systemd[1]: Starting Ceph mds.c for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:08:07.813 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:08:07 smithi189 podman[64956]: 2024-09-10 10:08:07.402520927 +0000 UTC m=+0.015950373 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:08:07.813 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:08:07 smithi189 podman[64956]: 2024-09-10 10:08:07.52619912 +0000 UTC m=+0.139628559 container create 625cc29b25b5d6932153161ae51cc0817149797c70df05eca072b7463e32d097 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-c, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:08:07.813 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:08:07 smithi189 podman[64956]: 2024-09-10 10:08:07.812504337 +0000 UTC m=+0.425933776 container init 625cc29b25b5d6932153161ae51cc0817149797c70df05eca072b7463e32d097 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T10:08:07.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:08:08.086 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:08:07 smithi189 podman[64956]: 2024-09-10 10:08:07.815463323 +0000 UTC m=+0.428892767 container start 625cc29b25b5d6932153161ae51cc0817149797c70df05eca072b7463e32d097 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:08:08.086 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:08:07 smithi189 ceph-mds[64975]: -- 172.21.15.189:0/2977920866 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc9f82b860 con 0x55fc9f809400 2024-09-10T10:08:08.086 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:08:07 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-c[64971]: starting mds.c at 2024-09-10T10:08:08.086 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:08:07 smithi189 bash[64956]: 625cc29b25b5d6932153161ae51cc0817149797c70df05eca072b7463e32d097 2024-09-10T10:08:08.086 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:08:07 smithi189 systemd[1]: Started Ceph mds.c for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:08:08.297 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:08.881 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:08 smithi050 ceph-mon[30354]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:08.881 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:08 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:08.881 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:08 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:08.882 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:08 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:08.882 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:08 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:08.882 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:08 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:08.882 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:08 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.891+0000 7f6e7a600640 1 -- 172.21.15.50:0/2027819268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e74101de0 msgr2=0x7f6e741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.891+0000 7f6e7a600640 1 --2- 172.21.15.50:0/2027819268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e74101de0 0x7f6e741021c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009ca0 tx=0x7f6e6402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:08:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.891+0000 7f6e7a600640 1 -- 172.21.15.50:0/2027819268 shutdown_connections 2024-09-10T10:08:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.891+0000 7f6e7a600640 1 --2- 172.21.15.50:0/2027819268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e74106f10 0x7f6e7410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.891+0000 7f6e7a600640 1 --2- 172.21.15.50:0/2027819268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e74102790 0x7f6e741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.891+0000 7f6e7a600640 1 --2- 172.21.15.50:0/2027819268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e74101de0 0x7f6e741021c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.891+0000 7f6e7a600640 1 -- 172.21.15.50:0/2027819268 >> 172.21.15.50:0/2027819268 conn(0x7f6e740fd8c0 msgr2=0x7f6e740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.891+0000 7f6e7a600640 1 -- 172.21.15.50:0/2027819268 shutdown_connections 2024-09-10T10:08:08.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.891+0000 7f6e7a600640 1 -- 172.21.15.50:0/2027819268 wait complete. 2024-09-10T10:08:08.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.892+0000 7f6e7a600640 1 Processor -- start 2024-09-10T10:08:08.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.893+0000 7f6e7a600640 1 -- start start 2024-09-10T10:08:08.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.893+0000 7f6e7a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e74101de0 0x7f6e7419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:08.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.893+0000 7f6e7a600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e74102790 0x7f6e7419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:08.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.893+0000 7f6e7a600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e74106f10 0x7f6e7419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:08.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.893+0000 7f6e7a600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e74111f70 con 0x7f6e74102790 2024-09-10T10:08:08.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.893+0000 7f6e7a600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6e74111df0 con 0x7f6e74101de0 2024-09-10T10:08:08.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.893+0000 7f6e7a600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e741120f0 con 0x7f6e74106f10 2024-09-10T10:08:08.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.893+0000 7f6e73400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e74101de0 0x7f6e7419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:08.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.893+0000 7f6e6aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e74102790 0x7f6e7419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:08.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.893+0000 7f6e6aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e74102790 0x7f6e7419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54728/0 (socket says 172.21.15.50:54728) 2024-09-10T10:08:08.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.893+0000 7f6e73400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e74101de0 0x7f6e7419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:41644/0 (socket says 172.21.15.50:41644) 2024-09-10T10:08:08.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.893+0000 7f6e6aa00640 1 -- 172.21.15.50:0/179573588 learned_addr learned my addr 172.21.15.50:0/179573588 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:08.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.893+0000 7f6e73e00640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e74106f10 0x7f6e7419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.894+0000 7f6e73400640 1 -- 172.21.15.50:0/179573588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e74106f10 msgr2=0x7f6e7419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.894+0000 7f6e73400640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e74106f10 0x7f6e7419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.894+0000 7f6e73400640 1 -- 172.21.15.50:0/179573588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e74102790 msgr2=0x7f6e7419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.894+0000 7f6e73400640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e74102790 0x7f6e7419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.894+0000 7f6e73400640 1 -- 172.21.15.50:0/179573588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7419f600 con 0x7f6e74101de0 2024-09-10T10:08:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.894+0000 7f6e73e00640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e74106f10 0x7f6e7419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:08:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.894+0000 7f6e73400640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e74101de0 0x7f6e7419a650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e64000f80 tx=0x7f6e640319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.895+0000 7f6e70c00640 1 -- 172.21.15.50:0/179573588 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6402fa20 con 0x7f6e74101de0 2024-09-10T10:08:08.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.895+0000 7f6e70c00640 1 -- 172.21.15.50:0/179573588 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e6402f380 con 0x7f6e74101de0 2024-09-10T10:08:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.895+0000 7f6e70c00640 1 -- 172.21.15.50:0/179573588 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6403a660 con 0x7f6e74101de0 2024-09-10T10:08:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.895+0000 7f6e7a600640 1 -- 172.21.15.50:0/179573588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e7419f890 con 0x7f6e74101de0 2024-09-10T10:08:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.895+0000 7f6e7a600640 1 -- 172.21.15.50:0/179573588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e741a71d0 con 0x7f6e74101de0 2024-09-10T10:08:08.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.896+0000 7f6e7a600640 1 -- 172.21.15.50:0/179573588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e741021c0 con 0x7f6e74101de0 2024-09-10T10:08:08.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.900+0000 7f6e70c00640 1 -- 172.21.15.50:0/179573588 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6e640305c0 con 0x7f6e74101de0 2024-09-10T10:08:08.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.901+0000 7f6e70c00640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e580a2c00 0x7f6e580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:08.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.902+0000 7f6e70c00640 1 -- 172.21.15.50:0/179573588 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f6e640ef6a0 con 0x7f6e74101de0 2024-09-10T10:08:08.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.902+0000 7f6e6aa00640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e580a2c00 0x7f6e580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:08.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.902+0000 7f6e70c00640 1 -- 172.21.15.50:0/179573588 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e640bca00 con 0x7f6e74101de0 2024-09-10T10:08:08.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:08.902+0000 7f6e6aa00640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e580a2c00 0x7f6e580a50c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6e740ff770 tx=0x7f6e5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:09.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:08 smithi189 ceph-mon[34999]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:09.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:08 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:09.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:08 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:09.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:08 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:09.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:08 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:09.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:08 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:09.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:08 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:09.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:08 smithi084 ceph-mon[34812]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:09.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:08 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:09.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:08 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:09.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:08 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:09.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:08 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:09.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:08 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:09.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:08 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.122+0000 7f6e7a600640 1 -- 172.21.15.50:0/179573588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e741a7400 con 0x7f6e74101de0 2024-09-10T10:08:09.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.123+0000 7f6e70c00640 1 -- 172.21.15.50:0/179573588 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6388 (secure 0 0 0) 0x7f6e640bc300 con 0x7f6e74101de0 2024-09-10T10:08:09.125 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:08:09.125 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"btime":"2024-09-10T10:08:08:663738+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-10T10:08:09.125 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2024-09-10T10:08:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.126+0000 7f6e7a600640 1 -- 172.21.15.50:0/179573588 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e580a2c00 msgr2=0x7f6e580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.126+0000 7f6e7a600640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e580a2c00 0x7f6e580a50c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6e740ff770 tx=0x7f6e5c005f90 comp rx=0 tx=0).stop 2024-09-10T10:08:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.126+0000 7f6e7a600640 1 -- 172.21.15.50:0/179573588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e74101de0 msgr2=0x7f6e7419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.126+0000 7f6e7a600640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e74101de0 0x7f6e7419a650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e64000f80 tx=0x7f6e640319f0 comp rx=0 tx=0).stop 2024-09-10T10:08:09.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.126+0000 7f6e7a600640 1 -- 172.21.15.50:0/179573588 shutdown_connections 2024-09-10T10:08:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.126+0000 7f6e7a600640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e580a2c00 0x7f6e580a50c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.126+0000 7f6e7a600640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e74106f10 0x7f6e7419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.126+0000 7f6e7a600640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e74102790 0x7f6e7419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.126+0000 7f6e7a600640 1 --2- 172.21.15.50:0/179573588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e74101de0 0x7f6e7419a650 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.126+0000 7f6e7a600640 1 -- 172.21.15.50:0/179573588 >> 172.21.15.50:0/179573588 conn(0x7f6e740fd8c0 msgr2=0x7f6e740febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.126+0000 7f6e7a600640 1 -- 172.21.15.50:0/179573588 shutdown_connections 2024-09-10T10:08:09.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:09.126+0000 7f6e7a600640 1 -- 172.21.15.50:0/179573588 wait complete. 2024-09-10T10:08:09.732 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:09 smithi084 ceph-mon[34812]: Deploying daemon mds.h on smithi084 2024-09-10T10:08:09.732 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:09 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.189:6836/251140305,v1:172.21.15.189:6837/251140305] up:boot 2024-09-10T10:08:09.732 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:09 smithi084 ceph-mon[34812]: fsmap 7 up:standby 2024-09-10T10:08:09.732 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:09 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:08:09.732 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:09 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/179573588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:09.893 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:09 smithi050 ceph-mon[30354]: Deploying daemon mds.h on smithi084 2024-09-10T10:08:09.893 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:09 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.189:6836/251140305,v1:172.21.15.189:6837/251140305] up:boot 2024-09-10T10:08:09.893 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:09 smithi050 ceph-mon[30354]: fsmap 7 up:standby 2024-09-10T10:08:09.893 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:09 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:08:09.893 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:09 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/179573588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:10.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:09 smithi189 ceph-mon[34999]: Deploying daemon mds.h on smithi084 2024-09-10T10:08:10.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:09 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.189:6836/251140305,v1:172.21.15.189:6837/251140305] up:boot 2024-09-10T10:08:10.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:09 smithi189 ceph-mon[34999]: fsmap 7 up:standby 2024-09-10T10:08:10.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:09 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:08:10.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:09 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/179573588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:10.099 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:08:09 smithi084 systemd[1]: Starting Ceph mds.h for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:08:10.396 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:08:10 smithi084 podman[64181]: 2024-09-10 10:08:10.03040384 +0000 UTC m=+0.015777879 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:08:10.396 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:08:10 smithi084 podman[64181]: 2024-09-10 10:08:10.151248575 +0000 UTC m=+0.136622604 container create 8d1a72c7201873a74fd4d45391aaf7eee1947e3799c66966789d4565ca094322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T10:08:10.396 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:08:10 smithi084 podman[64181]: 2024-09-10 10:08:10.395457695 +0000 UTC m=+0.380831724 container init 8d1a72c7201873a74fd4d45391aaf7eee1947e3799c66966789d4565ca094322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T10:08:10.677 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:08:10 smithi084 podman[64181]: 2024-09-10 10:08:10.398611026 +0000 UTC m=+0.383985056 container start 8d1a72c7201873a74fd4d45391aaf7eee1947e3799c66966789d4565ca094322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T10:08:10.678 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:08:10 smithi084 ceph-mds[64200]: -- 172.21.15.84:0/3299620275 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555d7049d860 con 0x555d7047a800 2024-09-10T10:08:10.678 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:08:10 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-h[64196]: starting mds.h at 2024-09-10T10:08:10.678 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:08:10 smithi084 bash[64181]: 8d1a72c7201873a74fd4d45391aaf7eee1947e3799c66966789d4565ca094322 2024-09-10T10:08:10.678 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:08:10 smithi084 systemd[1]: Started Ceph mds.h for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:08:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:10 smithi050 ceph-mon[30354]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:10.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:10.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:10.985 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:10 smithi189 ceph-mon[34999]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:10.985 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:10.986 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:10.986 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:10.986 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:10.986 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:10.986 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:11.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:10 smithi084 ceph-mon[34812]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:11.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:11.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:11.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:11.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:11.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:11.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:11.935 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:08:11.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:11 smithi050 ceph-mon[30354]: Deploying daemon mds.i on smithi189 2024-09-10T10:08:11.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:11 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] up:boot 2024-09-10T10:08:11.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:11 smithi050 ceph-mon[30354]: fsmap 8 up:standby 2024-09-10T10:08:11.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:11 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:08:12.028 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:11 smithi189 ceph-mon[34999]: Deploying daemon mds.i on smithi189 2024-09-10T10:08:12.028 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:11 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] up:boot 2024-09-10T10:08:12.028 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:11 smithi189 ceph-mon[34999]: fsmap 8 up:standby 2024-09-10T10:08:12.028 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:11 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:08:12.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:11 smithi084 ceph-mon[34812]: Deploying daemon mds.i on smithi189 2024-09-10T10:08:12.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:11 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] up:boot 2024-09-10T10:08:12.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:11 smithi084 ceph-mon[34812]: fsmap 8 up:standby 2024-09-10T10:08:12.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:11 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:08:12.325 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:12.808 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:12 smithi050 ceph-mon[30354]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:12.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.921+0000 7f402a400640 1 -- 172.21.15.50:0/4043573795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4024102360 msgr2=0x7f402410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:12.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.921+0000 7f402a400640 1 --2- 172.21.15.50:0/4043573795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4024102360 0x7f402410e890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f401c009c10 tx=0x7f401c02a6f0 comp rx=0 tx=0).stop 2024-09-10T10:08:12.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.921+0000 7f402a400640 1 -- 172.21.15.50:0/4043573795 shutdown_connections 2024-09-10T10:08:12.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.921+0000 7f402a400640 1 --2- 172.21.15.50:0/4043573795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4024102360 0x7f402410e890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:12.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.921+0000 7f402a400640 1 --2- 172.21.15.50:0/4043573795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40241019c0 0x7f4024101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:12.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.921+0000 7f402a400640 1 --2- 172.21.15.50:0/4043573795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40241079c0 0x7f4024107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:12.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.921+0000 7f402a400640 1 -- 172.21.15.50:0/4043573795 >> 172.21.15.50:0/4043573795 conn(0x7f40240fd740 msgr2=0x7f40240ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:12.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.921+0000 7f402a400640 1 -- 172.21.15.50:0/4043573795 shutdown_connections 2024-09-10T10:08:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.921+0000 7f402a400640 1 -- 172.21.15.50:0/4043573795 wait complete. 2024-09-10T10:08:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.922+0000 7f402a400640 1 Processor -- start 2024-09-10T10:08:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.922+0000 7f402a400640 1 -- start start 2024-09-10T10:08:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.923+0000 7f402a400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40241019c0 0x7f402419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.923+0000 7f402a400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4024102360 0x7f402419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.923+0000 7f402a400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40241079c0 0x7f402419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.923+0000 7f402a400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4024111dc0 con 0x7f40241019c0 2024-09-10T10:08:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.923+0000 7f402a400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4024111c40 con 0x7f40241079c0 2024-09-10T10:08:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.923+0000 7f402a400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4024111f40 con 0x7f4024102360 2024-09-10T10:08:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.923+0000 7f4029000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40241019c0 0x7f402419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.923+0000 7f4023e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4024102360 0x7f402419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:12.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.923+0000 7f4023e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4024102360 0x7f402419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:60026/0 (socket says 172.21.15.50:60026) 2024-09-10T10:08:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.923+0000 7f4023e00640 1 -- 172.21.15.50:0/4034498357 learned_addr learned my addr 172.21.15.50:0/4034498357 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.923+0000 7f4029a00640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40241079c0 0x7f402419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.923+0000 7f4023e00640 1 -- 172.21.15.50:0/4034498357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40241079c0 msgr2=0x7f402419ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.924+0000 7f4023e00640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40241079c0 0x7f402419ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.924+0000 7f4023e00640 1 -- 172.21.15.50:0/4034498357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40241019c0 msgr2=0x7f402419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.924+0000 7f4023e00640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40241019c0 0x7f402419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.924+0000 7f4023e00640 1 -- 172.21.15.50:0/4034498357 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402419f420 con 0x7f4024102360 2024-09-10T10:08:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.924+0000 7f4029000640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40241019c0 0x7f402419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:08:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.924+0000 7f4023e00640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4024102360 0x7f402419a9b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f401000e9c0 tx=0x7f401000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.924+0000 7f4021600640 1 -- 172.21.15.50:0/4034498357 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401000cde0 con 0x7f4024102360 2024-09-10T10:08:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.924+0000 7f4021600640 1 -- 172.21.15.50:0/4034498357 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40100035f0 con 0x7f4024102360 2024-09-10T10:08:12.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.924+0000 7f402a400640 1 -- 172.21.15.50:0/4034498357 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402419f710 con 0x7f4024102360 2024-09-10T10:08:12.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.924+0000 7f4021600640 1 -- 172.21.15.50:0/4034498357 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010010690 con 0x7f4024102360 2024-09-10T10:08:12.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.924+0000 7f402a400640 1 -- 172.21.15.50:0/4034498357 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40241a6ff0 con 0x7f4024102360 2024-09-10T10:08:12.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.925+0000 7f402a400640 1 -- 172.21.15.50:0/4034498357 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4024101e20 con 0x7f4024102360 2024-09-10T10:08:12.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.927+0000 7f4021600640 1 -- 172.21.15.50:0/4034498357 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f40100037a0 con 0x7f4024102360 2024-09-10T10:08:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.929+0000 7f4021600640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f400c0a2c00 0x7f400c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.929+0000 7f4021600640 1 -- 172.21.15.50:0/4034498357 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f40100cefb0 con 0x7f4024102360 2024-09-10T10:08:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.929+0000 7f4029000640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f400c0a2c00 0x7f400c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:12.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.930+0000 7f4029000640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f400c0a2c00 0x7f400c0a50c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4018009f40 tx=0x7f4018005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:12.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:12.931+0000 7f4021600640 1 -- 172.21.15.50:0/4034498357 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f401009c3a0 con 0x7f4024102360 2024-09-10T10:08:13.068 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:12 smithi189 ceph-mon[34999]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:13.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:12 smithi084 ceph-mon[34812]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.149+0000 7f402a400640 1 -- 172.21.15.50:0/4034498357 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40241a7330 con 0x7f4024102360 2024-09-10T10:08:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.151+0000 7f4021600640 1 -- 172.21.15.50:0/4034498357 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7213 (secure 0 0 0) 0x7f401009bca0 con 0x7f4024102360 2024-09-10T10:08:13.152 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:08:13.152 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"btime":"2024-09-10T10:08:10:675648+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24521,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T10:08:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2024-09-10T10:08:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.153+0000 7f402a400640 1 -- 172.21.15.50:0/4034498357 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f400c0a2c00 msgr2=0x7f400c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.153+0000 7f402a400640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f400c0a2c00 0x7f400c0a50c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4018009f40 tx=0x7f4018005f90 comp rx=0 tx=0).stop 2024-09-10T10:08:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.153+0000 7f402a400640 1 -- 172.21.15.50:0/4034498357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4024102360 msgr2=0x7f402419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.153+0000 7f402a400640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4024102360 0x7f402419a9b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f401000e9c0 tx=0x7f401000ee80 comp rx=0 tx=0).stop 2024-09-10T10:08:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.153+0000 7f402a400640 1 -- 172.21.15.50:0/4034498357 shutdown_connections 2024-09-10T10:08:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.153+0000 7f402a400640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f400c0a2c00 0x7f400c0a50c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.153+0000 7f402a400640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40241079c0 0x7f402419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.153+0000 7f402a400640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4024102360 0x7f402419a9b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.153+0000 7f402a400640 1 --2- 172.21.15.50:0/4034498357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40241019c0 0x7f402419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.153+0000 7f402a400640 1 -- 172.21.15.50:0/4034498357 >> 172.21.15.50:0/4034498357 conn(0x7f40240fd740 msgr2=0x7f40240fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.153+0000 7f402a400640 1 -- 172.21.15.50:0/4034498357 shutdown_connections 2024-09-10T10:08:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:13.153+0000 7f402a400640 1 -- 172.21.15.50:0/4034498357 wait complete. 2024-09-10T10:08:13.586 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 10:08:13 smithi189 systemd[1]: Started Ceph mds.i for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:08:13.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:13 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4034498357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:13.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:13.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:13.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:13.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:13.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:13.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:13 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:14.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:13 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4034498357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:14.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:14.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:14.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:14.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:14.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:14.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:13 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:13 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4034498357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:13 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:14 smithi050 ceph-mon[30354]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:14 smithi050 ceph-mon[30354]: Deploying daemon mds.g on smithi050 2024-09-10T10:08:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:14 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] up:boot 2024-09-10T10:08:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:14 smithi050 ceph-mon[30354]: fsmap 9 up:standby 2024-09-10T10:08:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:14 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:08:15.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:14 smithi189 ceph-mon[34999]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:15.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:14 smithi189 ceph-mon[34999]: Deploying daemon mds.g on smithi050 2024-09-10T10:08:15.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:14 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] up:boot 2024-09-10T10:08:15.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:14 smithi189 ceph-mon[34999]: fsmap 9 up:standby 2024-09-10T10:08:15.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:14 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:08:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:14 smithi084 ceph-mon[34812]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:14 smithi084 ceph-mon[34812]: Deploying daemon mds.g on smithi050 2024-09-10T10:08:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:14 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] up:boot 2024-09-10T10:08:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:14 smithi084 ceph-mon[34812]: fsmap 9 up:standby 2024-09-10T10:08:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:14 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:08:15.857 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:15 smithi050 ceph-mon[30354]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:16.025 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:08:16.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:15 smithi189 ceph-mon[34999]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:16.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:15 smithi084 ceph-mon[34812]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:16.465 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:08:16 smithi050 systemd[1]: Starting Ceph mds.g for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:08:16.735 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:08:16 smithi050 podman[71230]: 2024-09-10 10:08:16.372221962 +0000 UTC m=+0.030253700 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:08:16.735 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:08:16 smithi050 podman[71230]: 2024-09-10 10:08:16.481251991 +0000 UTC m=+0.139283729 container create 970e8319604afe9f965c13df2eed600fea7bfbe453b77738b9200c8192940e20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:08:16.735 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:08:16 smithi050 podman[71230]: 2024-09-10 10:08:16.734022327 +0000 UTC m=+0.392054066 container init 970e8319604afe9f965c13df2eed600fea7bfbe453b77738b9200c8192940e20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T10:08:16.905 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:17.048 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:08:16 smithi050 podman[71230]: 2024-09-10 10:08:16.740949447 +0000 UTC m=+0.398981185 container start 970e8319604afe9f965c13df2eed600fea7bfbe453b77738b9200c8192940e20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T10:08:17.048 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:08:16 smithi050 ceph-mds[71265]: -- 172.21.15.50:0/3858819932 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fb87863860 con 0x55fb87841400 2024-09-10T10:08:17.048 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:08:16 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-g[71261]: starting mds.g at 2024-09-10T10:08:17.048 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:08:16 smithi050 bash[71230]: 970e8319604afe9f965c13df2eed600fea7bfbe453b77738b9200c8192940e20 2024-09-10T10:08:17.048 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:08:16 smithi050 systemd[1]: Started Ceph mds.g for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:08:17.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.517+0000 7f2404600640 1 -- 172.21.15.50:0/361227049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc076720 msgr2=0x7f23fc076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:17.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.517+0000 7f2404600640 1 --2- 172.21.15.50:0/361227049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc076720 0x7f23fc076b00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009900 tx=0x7f23f002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:08:17.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.517+0000 7f2404600640 1 -- 172.21.15.50:0/361227049 shutdown_connections 2024-09-10T10:08:17.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.517+0000 7f2404600640 1 --2- 172.21.15.50:0/361227049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc112a30 0x7f23fc114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.517+0000 7f2404600640 1 --2- 172.21.15.50:0/361227049 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23fc077040 0x7f23fc1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.518+0000 7f2404600640 1 --2- 172.21.15.50:0/361227049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc076720 0x7f23fc076b00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.518+0000 7f2404600640 1 -- 172.21.15.50:0/361227049 >> 172.21.15.50:0/361227049 conn(0x7f23fc0ffa90 msgr2=0x7f23fc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.518+0000 7f2404600640 1 -- 172.21.15.50:0/361227049 shutdown_connections 2024-09-10T10:08:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.518+0000 7f2404600640 1 -- 172.21.15.50:0/361227049 wait complete. 2024-09-10T10:08:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.519+0000 7f2404600640 1 Processor -- start 2024-09-10T10:08:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.519+0000 7f2404600640 1 -- start start 2024-09-10T10:08:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.519+0000 7f2404600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23fc076720 0x7f23fc1a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.519+0000 7f2404600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc077040 0x7f23fc1a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.519+0000 7f2404600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc112a30 0x7f23fc19e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.519+0000 7f2404600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1185f0 con 0x7f23fc112a30 2024-09-10T10:08:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.519+0000 7f2404600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc118470 con 0x7f23fc077040 2024-09-10T10:08:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.519+0000 7f2404600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc118770 con 0x7f23fc076720 2024-09-10T10:08:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.519+0000 7f2401c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23fc076720 0x7f23fc1a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.519+0000 7f2401200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc077040 0x7f23fc1a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.519+0000 7f2402600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc112a30 0x7f23fc19e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.519+0000 7f2401c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23fc076720 0x7f23fc1a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:41500/0 (socket says 172.21.15.50:41500) 2024-09-10T10:08:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.520+0000 7f2401c00640 1 -- 172.21.15.50:0/502501328 learned_addr learned my addr 172.21.15.50:0/502501328 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.520+0000 7f2401200640 1 -- 172.21.15.50:0/502501328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23fc076720 msgr2=0x7f23fc1a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.520+0000 7f2401200640 1 --2- 172.21.15.50:0/502501328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23fc076720 0x7f23fc1a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.520+0000 7f2401200640 1 -- 172.21.15.50:0/502501328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc112a30 msgr2=0x7f23fc19e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.520+0000 7f2401200640 1 --2- 172.21.15.50:0/502501328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc112a30 0x7f23fc19e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.520+0000 7f2401200640 1 -- 172.21.15.50:0/502501328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc19eff0 con 0x7f23fc077040 2024-09-10T10:08:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.520+0000 7f2401200640 1 --2- 172.21.15.50:0/502501328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc077040 0x7f23fc1a4c40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f23e8005fd0 tx=0x7f23e800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.520+0000 7f23fa000640 1 -- 172.21.15.50:0/502501328 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8009c30 con 0x7f23fc077040 2024-09-10T10:08:17.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.520+0000 7f2404600640 1 -- 172.21.15.50:0/502501328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23fc19f2e0 con 0x7f23fc077040 2024-09-10T10:08:17.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.520+0000 7f23fa000640 1 -- 172.21.15.50:0/502501328 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23e8009dd0 con 0x7f23fc077040 2024-09-10T10:08:17.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.520+0000 7f23fa000640 1 -- 172.21.15.50:0/502501328 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8010460 con 0x7f23fc077040 2024-09-10T10:08:17.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.521+0000 7f2404600640 1 -- 172.21.15.50:0/502501328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23fc1ab5d0 con 0x7f23fc077040 2024-09-10T10:08:17.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.521+0000 7f2404600640 1 -- 172.21.15.50:0/502501328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23fc076b00 con 0x7f23fc077040 2024-09-10T10:08:17.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.523+0000 7f23fa000640 1 -- 172.21.15.50:0/502501328 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f23e8003f50 con 0x7f23fc077040 2024-09-10T10:08:17.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.525+0000 7f23fa000640 1 --2- 172.21.15.50:0/502501328 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f23e40a2b80 0x7f23e40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:17.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.525+0000 7f23fa000640 1 -- 172.21.15.50:0/502501328 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f23e80ceb30 con 0x7f23fc077040 2024-09-10T10:08:17.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.526+0000 7f2401c00640 1 --2- 172.21.15.50:0/502501328 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f23e40a2b80 0x7f23e40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:17.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.526+0000 7f2401c00640 1 --2- 172.21.15.50:0/502501328 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f23e40a2b80 0x7f23e40a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f23f00096c0 tx=0x7f23f00046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:17.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.527+0000 7f23fa000640 1 -- 172.21.15.50:0/502501328 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23e8017020 con 0x7f23fc077040 2024-09-10T10:08:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.787+0000 7f2404600640 1 -- 172.21.15.50:0/502501328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23fc19fdf0 con 0x7f23fc077040 2024-09-10T10:08:17.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.788+0000 7f23fa000640 1 -- 172.21.15.50:0/502501328 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8869 (secure 0 0 0) 0x7f23fc19fdf0 con 0x7f23fc077040 2024-09-10T10:08:17.790 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:08:17.790 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":11,"btime":"2024-09-10T10:08:16:837865+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24521,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T10:08:17.790 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 11 2024-09-10T10:08:17.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.790+0000 7f2404600640 1 -- 172.21.15.50:0/502501328 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f23e40a2b80 msgr2=0x7f23e40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:17.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.790+0000 7f2404600640 1 --2- 172.21.15.50:0/502501328 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f23e40a2b80 0x7f23e40a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f23f00096c0 tx=0x7f23f00046c0 comp rx=0 tx=0).stop 2024-09-10T10:08:17.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.790+0000 7f2404600640 1 -- 172.21.15.50:0/502501328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc077040 msgr2=0x7f23fc1a4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:17.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.790+0000 7f2404600640 1 --2- 172.21.15.50:0/502501328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc077040 0x7f23fc1a4c40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f23e8005fd0 tx=0x7f23e800dde0 comp rx=0 tx=0).stop 2024-09-10T10:08:17.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.790+0000 7f2404600640 1 -- 172.21.15.50:0/502501328 shutdown_connections 2024-09-10T10:08:17.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.790+0000 7f2404600640 1 --2- 172.21.15.50:0/502501328 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f23e40a2b80 0x7f23e40a5040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:17.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.790+0000 7f2404600640 1 --2- 172.21.15.50:0/502501328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc112a30 0x7f23fc19e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:17.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.790+0000 7f2404600640 1 --2- 172.21.15.50:0/502501328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc077040 0x7f23fc1a4c40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:17.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.790+0000 7f2404600640 1 --2- 172.21.15.50:0/502501328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f23fc076720 0x7f23fc1a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:17.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.790+0000 7f2404600640 1 -- 172.21.15.50:0/502501328 >> 172.21.15.50:0/502501328 conn(0x7f23fc0ffa90 msgr2=0x7f23fc101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:17.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.791+0000 7f2404600640 1 -- 172.21.15.50:0/502501328 shutdown_connections 2024-09-10T10:08:17.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:17.791+0000 7f2404600640 1 -- 172.21.15.50:0/502501328 wait complete. 2024-09-10T10:08:18.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:17 smithi084 ceph-mon[34812]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:18.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:17 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.50:6838/1454697649,v1:172.21.15.50:6839/1454697649] up:boot 2024-09-10T10:08:18.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:17 smithi084 ceph-mon[34812]: fsmap 10 up:standby 2024-09-10T10:08:18.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:17 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:08:18.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:17 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:18.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:17 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:18.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:17 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:18.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:17 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:18.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:17 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:18.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:17 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:18.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:17 smithi084 ceph-mon[34812]: Deploying daemon mds.a on smithi050 2024-09-10T10:08:18.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:17 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/502501328' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:18.168 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:17 smithi050 ceph-mon[30354]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:18.168 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:17 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.50:6838/1454697649,v1:172.21.15.50:6839/1454697649] up:boot 2024-09-10T10:08:18.168 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:17 smithi050 ceph-mon[30354]: fsmap 10 up:standby 2024-09-10T10:08:18.168 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:17 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:08:18.168 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:17 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:18.168 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:17 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:18.168 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:17 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:18.168 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:17 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:18.168 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:17 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:18.168 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:17 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:18.169 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:17 smithi050 ceph-mon[30354]: Deploying daemon mds.a on smithi050 2024-09-10T10:08:18.169 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:17 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/502501328' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:17 smithi189 ceph-mon[34999]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:17 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.50:6838/1454697649,v1:172.21.15.50:6839/1454697649] up:boot 2024-09-10T10:08:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:17 smithi189 ceph-mon[34999]: fsmap 10 up:standby 2024-09-10T10:08:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:17 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:08:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:17 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:17 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:17 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:17 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:17 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:17 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:17 smithi189 ceph-mon[34999]: Deploying daemon mds.a on smithi050 2024-09-10T10:08:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:17 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/502501328' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:20.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:19 smithi084 ceph-mon[34812]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:20.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:19 smithi050 ceph-mon[30354]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:19 smithi189 ceph-mon[34999]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:20.645 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:08:20 smithi050 systemd[1]: Starting Ceph mds.a for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:08:20.942 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:08:20 smithi050 podman[71613]: 2024-09-10 10:08:20.548436495 +0000 UTC m=+0.027561822 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:08:20.942 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:08:20 smithi050 podman[71613]: 2024-09-10 10:08:20.691747331 +0000 UTC m=+0.170872658 container create cb2b790deed878ffd406b948a6ac57cb415d758262bcabc78431383b320039ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T10:08:20.942 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:08:20 smithi050 podman[71613]: 2024-09-10 10:08:20.941478349 +0000 UTC m=+0.420603677 container init cb2b790deed878ffd406b948a6ac57cb415d758262bcabc78431383b320039ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T10:08:21.215 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:08:20 smithi050 podman[71613]: 2024-09-10 10:08:20.948025996 +0000 UTC m=+0.427151323 container start cb2b790deed878ffd406b948a6ac57cb415d758262bcabc78431383b320039ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:08:21.215 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:08:20 smithi050 ceph-mds[71632]: -- 172.21.15.50:0/444307387 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ac119c7860 con 0x55ac119a5000 2024-09-10T10:08:21.216 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:08:20 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-a[71628]: starting mds.a at 2024-09-10T10:08:21.216 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:08:21 smithi050 bash[71613]: cb2b790deed878ffd406b948a6ac57cb415d758262bcabc78431383b320039ab 2024-09-10T10:08:21.216 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:08:21 smithi050 systemd[1]: Started Ceph mds.a for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:08:21.219 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:08:21.601 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.152+0000 7feeecc00640 1 -- 172.21.15.50:0/2495987237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee8074ee0 msgr2=0x7feee810dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.152+0000 7feeecc00640 1 --2- 172.21.15.50:0/2495987237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee8074ee0 0x7feee810dd20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feed0009900 tx=0x7feed002a480 comp rx=0 tx=0).stop 2024-09-10T10:08:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.152+0000 7feeecc00640 1 -- 172.21.15.50:0/2495987237 shutdown_connections 2024-09-10T10:08:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.152+0000 7feeecc00640 1 --2- 172.21.15.50:0/2495987237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee810e260 0x7feee8110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.152+0000 7feeecc00640 1 --2- 172.21.15.50:0/2495987237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee8074ee0 0x7feee810dd20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.152+0000 7feeecc00640 1 --2- 172.21.15.50:0/2495987237 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feee80745c0 0x7feee80749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.152+0000 7feeecc00640 1 -- 172.21.15.50:0/2495987237 >> 172.21.15.50:0/2495987237 conn(0x7feee80fd740 msgr2=0x7feee80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:22.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.152+0000 7feeecc00640 1 -- 172.21.15.50:0/2495987237 shutdown_connections 2024-09-10T10:08:22.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.152+0000 7feeecc00640 1 -- 172.21.15.50:0/2495987237 wait complete. 2024-09-10T10:08:22.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.153+0000 7feeecc00640 1 Processor -- start 2024-09-10T10:08:22.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.153+0000 7feeecc00640 1 -- start start 2024-09-10T10:08:22.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.153+0000 7feeecc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feee80745c0 0x7feee819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:22.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.153+0000 7feeecc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee8074ee0 0x7feee819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:22.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.153+0000 7feeecc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee810e260 0x7feee819edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:22.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.153+0000 7feeecc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feee8114000 con 0x7feee8074ee0 2024-09-10T10:08:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.153+0000 7feeecc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feee8113e80 con 0x7feee810e260 2024-09-10T10:08:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.153+0000 7feeecc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feee8114180 con 0x7feee80745c0 2024-09-10T10:08:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.153+0000 7feedfe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee8074ee0 0x7feee819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.153+0000 7feee7400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feee80745c0 0x7feee819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.154+0000 7feedfe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee8074ee0 0x7feee819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51580/0 (socket says 172.21.15.50:51580) 2024-09-10T10:08:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.154+0000 7feedfe00640 1 -- 172.21.15.50:0/2927520981 learned_addr learned my addr 172.21.15.50:0/2927520981 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.154+0000 7feee7e00640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee810e260 0x7feee819edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.154+0000 7feedfe00640 1 -- 172.21.15.50:0/2927520981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feee80745c0 msgr2=0x7feee819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.154+0000 7feedfe00640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feee80745c0 0x7feee819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.154+0000 7feedfe00640 1 -- 172.21.15.50:0/2927520981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee810e260 msgr2=0x7feee819edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.154+0000 7feedfe00640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee810e260 0x7feee819edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:22.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.154+0000 7feedfe00640 1 -- 172.21.15.50:0/2927520981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee819f4b0 con 0x7feee8074ee0 2024-09-10T10:08:22.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.154+0000 7feee7e00640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee810e260 0x7feee819edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:08:22.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.154+0000 7feedfe00640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee8074ee0 0x7feee819aa40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feed0004770 tx=0x7feed0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:22.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.155+0000 7feee4c00640 1 -- 172.21.15.50:0/2927520981 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed003f070 con 0x7feee8074ee0 2024-09-10T10:08:22.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.155+0000 7feee4c00640 1 -- 172.21.15.50:0/2927520981 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feed0031ca0 con 0x7feee8074ee0 2024-09-10T10:08:22.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.155+0000 7feee4c00640 1 -- 172.21.15.50:0/2927520981 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0035030 con 0x7feee8074ee0 2024-09-10T10:08:22.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.155+0000 7feeecc00640 1 -- 172.21.15.50:0/2927520981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee819f740 con 0x7feee8074ee0 2024-09-10T10:08:22.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.155+0000 7feeecc00640 1 -- 172.21.15.50:0/2927520981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee81a7080 con 0x7feee8074ee0 2024-09-10T10:08:22.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.156+0000 7feeecc00640 1 -- 172.21.15.50:0/2927520981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee80749a0 con 0x7feee8074ee0 2024-09-10T10:08:22.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.158+0000 7feee4c00640 1 -- 172.21.15.50:0/2927520981 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7feed0042070 con 0x7feee8074ee0 2024-09-10T10:08:22.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.159+0000 7feee4c00640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7feecc0a2c00 0x7feecc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:22.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.159+0000 7feee4c00640 1 -- 172.21.15.50:0/2927520981 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7feed00ef180 con 0x7feee8074ee0 2024-09-10T10:08:22.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.159+0000 7feee7400640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7feecc0a2c00 0x7feecc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:22.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.160+0000 7feee7400640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7feecc0a2c00 0x7feecc0a50c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feed8009bd0 tx=0x7feed8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:22.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.163+0000 7feee4c00640 1 -- 172.21.15.50:0/2927520981 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feed00bc4e0 con 0x7feee8074ee0 2024-09-10T10:08:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:22 smithi084 ceph-mon[34812]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:22.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:22.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:22.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:22 smithi084 ceph-mon[34812]: Deploying daemon mds.b on smithi084 2024-09-10T10:08:22.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:22 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.50:6840/1041312964,v1:172.21.15.50:6841/1041312964] up:boot 2024-09-10T10:08:22.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:22 smithi084 ceph-mon[34812]: fsmap 11 up:standby 2024-09-10T10:08:22.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:22 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:08:22.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.385+0000 7feeecc00640 1 -- 172.21.15.50:0/2927520981 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feee819b860 con 0x7feee8074ee0 2024-09-10T10:08:22.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:22 smithi050 ceph-mon[30354]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:22.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:22.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:22.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:22.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:22.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:22.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:22.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:22 smithi050 ceph-mon[30354]: Deploying daemon mds.b on smithi084 2024-09-10T10:08:22.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:22 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.50:6840/1041312964,v1:172.21.15.50:6841/1041312964] up:boot 2024-09-10T10:08:22.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:22 smithi050 ceph-mon[30354]: fsmap 11 up:standby 2024-09-10T10:08:22.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:22 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:08:22.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.386+0000 7feee4c00640 1 -- 172.21.15.50:0/2927520981 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9695 (secure 0 0 0) 0x7feee819b860 con 0x7feee8074ee0 2024-09-10T10:08:22.388 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:08:22.388 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":12,"btime":"2024-09-10T10:08:21:846313+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24521,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T10:08:22.389 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 12 2024-09-10T10:08:22.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.388+0000 7feeecc00640 1 -- 172.21.15.50:0/2927520981 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7feecc0a2c00 msgr2=0x7feecc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.388+0000 7feeecc00640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7feecc0a2c00 0x7feecc0a50c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feed8009bd0 tx=0x7feed8005f90 comp rx=0 tx=0).stop 2024-09-10T10:08:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.388+0000 7feeecc00640 1 -- 172.21.15.50:0/2927520981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee8074ee0 msgr2=0x7feee819aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.388+0000 7feeecc00640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee8074ee0 0x7feee819aa40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feed0004770 tx=0x7feed0003c10 comp rx=0 tx=0).stop 2024-09-10T10:08:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.388+0000 7feeecc00640 1 -- 172.21.15.50:0/2927520981 shutdown_connections 2024-09-10T10:08:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.388+0000 7feeecc00640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7feecc0a2c00 0x7feecc0a50c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.388+0000 7feeecc00640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee810e260 0x7feee819edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.388+0000 7feeecc00640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feee8074ee0 0x7feee819aa40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.388+0000 7feeecc00640 1 --2- 172.21.15.50:0/2927520981 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feee80745c0 0x7feee819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.388+0000 7feeecc00640 1 -- 172.21.15.50:0/2927520981 >> 172.21.15.50:0/2927520981 conn(0x7feee80fd740 msgr2=0x7feee80fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.388+0000 7feeecc00640 1 -- 172.21.15.50:0/2927520981 shutdown_connections 2024-09-10T10:08:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:22.388+0000 7feeecc00640 1 -- 172.21.15.50:0/2927520981 wait complete. 2024-09-10T10:08:22.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:22 smithi189 ceph-mon[34999]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:22.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:22.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:22.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:22.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:08:22.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:08:22.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:22.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:22 smithi189 ceph-mon[34999]: Deploying daemon mds.b on smithi084 2024-09-10T10:08:22.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:22 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.50:6840/1041312964,v1:172.21.15.50:6841/1041312964] up:boot 2024-09-10T10:08:22.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:22 smithi189 ceph-mon[34999]: fsmap 11 up:standby 2024-09-10T10:08:22.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:22 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:08:23.134 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:08:23 smithi084 systemd[1]: Starting Ceph mds.b for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:08:23.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:23 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2927520981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:23.389 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:08:23 smithi084 podman[64485]: 2024-09-10 10:08:23.173232369 +0000 UTC m=+0.015793678 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:08:23.390 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:08:23 smithi084 podman[64485]: 2024-09-10 10:08:23.287086934 +0000 UTC m=+0.129648241 container create 2b5c730304654e6e6689df9a1b823348ab1de11db6209372eae7a54906bebd3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:08:23.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:23 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2927520981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:23.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:23 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2927520981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:23.849 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:08:23 smithi084 podman[64485]: 2024-09-10 10:08:23.489574434 +0000 UTC m=+0.332135733 container init 2b5c730304654e6e6689df9a1b823348ab1de11db6209372eae7a54906bebd3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:08:23.849 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:08:23 smithi084 podman[64485]: 2024-09-10 10:08:23.492366283 +0000 UTC m=+0.334927583 container start 2b5c730304654e6e6689df9a1b823348ab1de11db6209372eae7a54906bebd3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-b, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T10:08:23.849 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:08:23 smithi084 ceph-mds[64504]: -- 172.21.15.84:0/885302456 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f142513860 con 0x55f1424f1000 2024-09-10T10:08:23.849 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:08:23 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-b[64500]: starting mds.b at 2024-09-10T10:08:23.849 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:08:23 smithi084 bash[64485]: 2b5c730304654e6e6689df9a1b823348ab1de11db6209372eae7a54906bebd3a 2024-09-10T10:08:23.849 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:08:23 smithi084 systemd[1]: Started Ceph mds.b for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:08:24.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:24 smithi189 ceph-mon[34999]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:24.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:24.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:24 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] up:boot 2024-09-10T10:08:24.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:24 smithi189 ceph-mon[34999]: fsmap 12 up:standby 2024-09-10T10:08:24.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:24 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:08:24.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:24 smithi084 ceph-mon[34812]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:24.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:24.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:24 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] up:boot 2024-09-10T10:08:24.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:24 smithi084 ceph-mon[34812]: fsmap 12 up:standby 2024-09-10T10:08:24.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:24 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:08:24.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:24 smithi050 ceph-mon[30354]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:24.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:24.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:24.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:24 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] up:boot 2024-09-10T10:08:24.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:24 smithi050 ceph-mon[30354]: fsmap 12 up:standby 2024-09-10T10:08:24.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:24 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:08:25.158 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:08:25.567 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.157+0000 7f2042000640 1 -- 172.21.15.50:0/3617536247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c1019c0 msgr2=0x7f203c101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.157+0000 7f2042000640 1 --2- 172.21.15.50:0/3617536247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c1019c0 0x7f203c101e20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2028009900 tx=0x7f202802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:08:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.157+0000 7f2042000640 1 -- 172.21.15.50:0/3617536247 shutdown_connections 2024-09-10T10:08:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.157+0000 7f2042000640 1 --2- 172.21.15.50:0/3617536247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f203c102360 0x7f203c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.157+0000 7f2042000640 1 --2- 172.21.15.50:0/3617536247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c1019c0 0x7f203c101e20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.157+0000 7f2042000640 1 --2- 172.21.15.50:0/3617536247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f203c1079c0 0x7f203c107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.157+0000 7f2042000640 1 -- 172.21.15.50:0/3617536247 >> 172.21.15.50:0/3617536247 conn(0x7f203c0fd740 msgr2=0x7f203c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.157+0000 7f2042000640 1 -- 172.21.15.50:0/3617536247 shutdown_connections 2024-09-10T10:08:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.157+0000 7f2042000640 1 -- 172.21.15.50:0/3617536247 wait complete. 2024-09-10T10:08:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.158+0000 7f2042000640 1 Processor -- start 2024-09-10T10:08:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.158+0000 7f2042000640 1 -- start start 2024-09-10T10:08:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.158+0000 7f2042000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f203c1019c0 0x7f203c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.158+0000 7f2042000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f203c102360 0x7f203c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.158+0000 7f2042000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c1079c0 0x7f203c19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.158+0000 7f2042000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f203c111e10 con 0x7f203c102360 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.158+0000 7f2042000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f203c111c90 con 0x7f203c1079c0 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.158+0000 7f2042000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f203c111f90 con 0x7f203c1019c0 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.159+0000 7f2041600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c1079c0 0x7f203c19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.159+0000 7f203be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f203c102360 0x7f203c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.159+0000 7f2041600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c1079c0 0x7f203c19ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:53690/0 (socket says 172.21.15.50:53690) 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.159+0000 7f2041600640 1 -- 172.21.15.50:0/429132392 learned_addr learned my addr 172.21.15.50:0/429132392 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.159+0000 7f2040c00640 1 --2- 172.21.15.50:0/429132392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f203c1019c0 0x7f203c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.159+0000 7f2041600640 1 -- 172.21.15.50:0/429132392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f203c1019c0 msgr2=0x7f203c19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.159+0000 7f2041600640 1 --2- 172.21.15.50:0/429132392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f203c1019c0 0x7f203c19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.159+0000 7f2041600640 1 -- 172.21.15.50:0/429132392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f203c102360 msgr2=0x7f203c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.159+0000 7f2041600640 1 --2- 172.21.15.50:0/429132392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f203c102360 0x7f203c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.159+0000 7f2041600640 1 -- 172.21.15.50:0/429132392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203c19f460 con 0x7f203c1079c0 2024-09-10T10:08:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.159+0000 7f2041600640 1 --2- 172.21.15.50:0/429132392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c1079c0 0x7f203c19ed80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f203400eb10 tx=0x7f203400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.160+0000 7f2039600640 1 -- 172.21.15.50:0/429132392 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2034004b20 con 0x7f203c1079c0 2024-09-10T10:08:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.160+0000 7f2039600640 1 -- 172.21.15.50:0/429132392 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2034004cc0 con 0x7f203c1079c0 2024-09-10T10:08:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.160+0000 7f2039600640 1 -- 172.21.15.50:0/429132392 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2034010760 con 0x7f203c1079c0 2024-09-10T10:08:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.160+0000 7f2042000640 1 -- 172.21.15.50:0/429132392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203c19f750 con 0x7f203c1079c0 2024-09-10T10:08:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.160+0000 7f2042000640 1 -- 172.21.15.50:0/429132392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203c1a7030 con 0x7f203c1079c0 2024-09-10T10:08:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.161+0000 7f2042000640 1 -- 172.21.15.50:0/429132392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f203c101e20 con 0x7f203c1079c0 2024-09-10T10:08:26.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.163+0000 7f2039600640 1 -- 172.21.15.50:0/429132392 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2034005020 con 0x7f203c1079c0 2024-09-10T10:08:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.164+0000 7f2039600640 1 --2- 172.21.15.50:0/429132392 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f20240a2c00 0x7f20240a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.164+0000 7f2039600640 1 -- 172.21.15.50:0/429132392 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f20340cf170 con 0x7f203c1079c0 2024-09-10T10:08:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.164+0000 7f2040c00640 1 --2- 172.21.15.50:0/429132392 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f20240a2c00 0x7f20240a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.165+0000 7f2040c00640 1 --2- 172.21.15.50:0/429132392 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f20240a2c00 0x7f20240a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2030009b50 tx=0x7f2030005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:26.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.168+0000 7f2039600640 1 -- 172.21.15.50:0/429132392 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f203409c4d0 con 0x7f203c1079c0 2024-09-10T10:08:26.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.414+0000 7f2042000640 1 -- 172.21.15.50:0/429132392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f203c1a72d0 con 0x7f203c1079c0 2024-09-10T10:08:26.416 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:26 smithi050 ceph-mon[30354]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:26.416 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.416 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.416 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.416 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.416 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.416 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:26 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.414+0000 7f2039600640 1 -- 172.21.15.50:0/429132392 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10521 (secure 0 0 0) 0x7f203409bdd0 con 0x7f203c1079c0 2024-09-10T10:08:26.417 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:08:26.417 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"btime":"2024-09-10T10:08:24:133315+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24521,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-10T10:08:26.418 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2024-09-10T10:08:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.418+0000 7f2042000640 1 -- 172.21.15.50:0/429132392 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f20240a2c00 msgr2=0x7f20240a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:26.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.418+0000 7f2042000640 1 --2- 172.21.15.50:0/429132392 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f20240a2c00 0x7f20240a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2030009b50 tx=0x7f2030005f90 comp rx=0 tx=0).stop 2024-09-10T10:08:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.418+0000 7f2042000640 1 -- 172.21.15.50:0/429132392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c1079c0 msgr2=0x7f203c19ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.418+0000 7f2042000640 1 --2- 172.21.15.50:0/429132392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c1079c0 0x7f203c19ed80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f203400eb10 tx=0x7f203400c2d0 comp rx=0 tx=0).stop 2024-09-10T10:08:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.418+0000 7f2042000640 1 -- 172.21.15.50:0/429132392 shutdown_connections 2024-09-10T10:08:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.418+0000 7f2042000640 1 --2- 172.21.15.50:0/429132392 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f20240a2c00 0x7f20240a50c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.418+0000 7f2042000640 1 --2- 172.21.15.50:0/429132392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c1079c0 0x7f203c19ed80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.418+0000 7f2042000640 1 --2- 172.21.15.50:0/429132392 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f203c102360 0x7f203c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.418+0000 7f2042000640 1 --2- 172.21.15.50:0/429132392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f203c1019c0 0x7f203c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.418+0000 7f2042000640 1 -- 172.21.15.50:0/429132392 >> 172.21.15.50:0/429132392 conn(0x7f203c0fd740 msgr2=0x7f203c0fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.418+0000 7f2042000640 1 -- 172.21.15.50:0/429132392 shutdown_connections 2024-09-10T10:08:26.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:26.418+0000 7f2042000640 1 -- 172.21.15.50:0/429132392 wait complete. 2024-09-10T10:08:26.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:26 smithi189 ceph-mon[34999]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:26.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:26 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:26 smithi084 ceph-mon[34812]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:26.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:26.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:26 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:27.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T10:08:27.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:27 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/429132392' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:27.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:27 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:27.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:27 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:08:27.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:27 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:27.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:27 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:27.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:27 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/429132392' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:27.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:27 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:27.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:27 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:08:27.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:27 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:27.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:27 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:27.677 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:27.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:27 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/429132392' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:27.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:27 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:27.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:27 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:08:27.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:27 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:27.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:27 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:08:28.275 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:28 smithi189 ceph-mon[34999]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:28.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.274+0000 7f18cda00640 1 -- 172.21.15.50:0/3470100805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18c80745c0 msgr2=0x7f18c80749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:28.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.274+0000 7f18cda00640 1 --2- 172.21.15.50:0/3470100805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18c80745c0 0x7f18c80749a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009900 tx=0x7f18b802a480 comp rx=0 tx=0).stop 2024-09-10T10:08:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.274+0000 7f18cda00640 1 -- 172.21.15.50:0/3470100805 shutdown_connections 2024-09-10T10:08:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.274+0000 7f18cda00640 1 --2- 172.21.15.50:0/3470100805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18c810e260 0x7f18c8110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.274+0000 7f18cda00640 1 --2- 172.21.15.50:0/3470100805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18c8074ee0 0x7f18c810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:28.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.274+0000 7f18cda00640 1 --2- 172.21.15.50:0/3470100805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18c80745c0 0x7f18c80749a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.274+0000 7f18cda00640 1 -- 172.21.15.50:0/3470100805 >> 172.21.15.50:0/3470100805 conn(0x7f18c80fd740 msgr2=0x7f18c80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.274+0000 7f18cda00640 1 -- 172.21.15.50:0/3470100805 shutdown_connections 2024-09-10T10:08:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.274+0000 7f18cda00640 1 -- 172.21.15.50:0/3470100805 wait complete. 2024-09-10T10:08:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.275+0000 7f18cda00640 1 Processor -- start 2024-09-10T10:08:28.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.276+0000 7f18cda00640 1 -- start start 2024-09-10T10:08:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.276+0000 7f18cda00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18c80745c0 0x7f18c819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.276+0000 7f18cda00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18c8074ee0 0x7f18c819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.276+0000 7f18cda00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18c810e260 0x7f18c819ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:28.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.276+0000 7f18cda00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f18c8114000 con 0x7f18c810e260 2024-09-10T10:08:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.276+0000 7f18cda00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f18c8113e80 con 0x7f18c80745c0 2024-09-10T10:08:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.276+0000 7f18cda00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f18c8114180 con 0x7f18c8074ee0 2024-09-10T10:08:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.276+0000 7f18c7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18c80745c0 0x7f18c819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:28.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.276+0000 7f18c7400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18c8074ee0 0x7f18c819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.276+0000 7f18c7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18c80745c0 0x7f18c819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:35740/0 (socket says 172.21.15.50:35740) 2024-09-10T10:08:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.276+0000 7f18c7e00640 1 -- 172.21.15.50:0/3697073519 learned_addr learned my addr 172.21.15.50:0/3697073519 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.276+0000 7f18cd000640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18c810e260 0x7f18c819ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.277+0000 7f18c7e00640 1 -- 172.21.15.50:0/3697073519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18c8074ee0 msgr2=0x7f18c819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:28.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.277+0000 7f18c7e00640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18c8074ee0 0x7f18c819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.277+0000 7f18c7e00640 1 -- 172.21.15.50:0/3697073519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18c810e260 msgr2=0x7f18c819ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:28.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.277+0000 7f18c7e00640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18c810e260 0x7f18c819ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.277+0000 7f18c7e00640 1 -- 172.21.15.50:0/3697073519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c819f550 con 0x7f18c80745c0 2024-09-10T10:08:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.277+0000 7f18c7400640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18c8074ee0 0x7f18c819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:08:28.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.277+0000 7f18cd000640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18c810e260 0x7f18c819ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:08:28.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.277+0000 7f18c7e00640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18c80745c0 0x7f18c819a5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f18b8004770 tx=0x7f18b8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:28.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.277+0000 7f18c4c00640 1 -- 172.21.15.50:0/3697073519 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b803f070 con 0x7f18c80745c0 2024-09-10T10:08:28.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.277+0000 7f18c4c00640 1 -- 172.21.15.50:0/3697073519 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18b8031ca0 con 0x7f18c80745c0 2024-09-10T10:08:28.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.277+0000 7f18cda00640 1 -- 172.21.15.50:0/3697073519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c819f7e0 con 0x7f18c80745c0 2024-09-10T10:08:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.277+0000 7f18c4c00640 1 -- 172.21.15.50:0/3697073519 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8035030 con 0x7f18c80745c0 2024-09-10T10:08:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.278+0000 7f18cda00640 1 -- 172.21.15.50:0/3697073519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c81a7120 con 0x7f18c80745c0 2024-09-10T10:08:28.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.279+0000 7f18cda00640 1 -- 172.21.15.50:0/3697073519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c8075c70 con 0x7f18c80745c0 2024-09-10T10:08:28.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.281+0000 7f18c4c00640 1 -- 172.21.15.50:0/3697073519 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f18b8042070 con 0x7f18c80745c0 2024-09-10T10:08:28.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.283+0000 7f18c4c00640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f18ac0a2b80 0x7f18ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:28.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.283+0000 7f18c4c00640 1 -- 172.21.15.50:0/3697073519 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f18b80ef280 con 0x7f18c80745c0 2024-09-10T10:08:28.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.283+0000 7f18c7400640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f18ac0a2b80 0x7f18ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:28.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.284+0000 7f18c7400640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f18ac0a2b80 0x7f18ac0a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f18c810f650 tx=0x7f18b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:28.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.286+0000 7f18c4c00640 1 -- 172.21.15.50:0/3697073519 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18b80bc6a0 con 0x7f18c80745c0 2024-09-10T10:08:28.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:28 smithi050 ceph-mon[30354]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:28.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.475+0000 7f18cda00640 1 -- 172.21.15.50:0/3697073519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f18c81093e0 con 0x7f18c80745c0 2024-09-10T10:08:28.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.475+0000 7f18c4c00640 1 -- 172.21.15.50:0/3697073519 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) ==== 84+0+65 (secure 0 0 0) 0x7f18b80bbfa0 con 0x7f18c80745c0 2024-09-10T10:08:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:08:28.478 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-09-10T10:08:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:08:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-09-10T10:08:28.478 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-09-10T10:08:28.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:08:28.479 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-09-10T10:08:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.478+0000 7f18cda00640 1 -- 172.21.15.50:0/3697073519 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f18ac0a2b80 msgr2=0x7f18ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.478+0000 7f18cda00640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f18ac0a2b80 0x7f18ac0a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f18c810f650 tx=0x7f18b4005f90 comp rx=0 tx=0).stop 2024-09-10T10:08:28.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.478+0000 7f18cda00640 1 -- 172.21.15.50:0/3697073519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18c80745c0 msgr2=0x7f18c819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.478+0000 7f18cda00640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18c80745c0 0x7f18c819a5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f18b8004770 tx=0x7f18b8003c10 comp rx=0 tx=0).stop 2024-09-10T10:08:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.478+0000 7f18cda00640 1 -- 172.21.15.50:0/3697073519 shutdown_connections 2024-09-10T10:08:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.478+0000 7f18cda00640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f18ac0a2b80 0x7f18ac0a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.478+0000 7f18cda00640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18c810e260 0x7f18c819ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:28.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.478+0000 7f18cda00640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f18c8074ee0 0x7f18c819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.478+0000 7f18cda00640 1 --2- 172.21.15.50:0/3697073519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18c80745c0 0x7f18c819a5a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.478+0000 7f18cda00640 1 -- 172.21.15.50:0/3697073519 >> 172.21.15.50:0/3697073519 conn(0x7f18c80fd740 msgr2=0x7f18c80fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.478+0000 7f18cda00640 1 -- 172.21.15.50:0/3697073519 shutdown_connections 2024-09-10T10:08:28.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:28.478+0000 7f18cda00640 1 -- 172.21.15.50:0/3697073519 wait complete. 2024-09-10T10:08:28.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:28 smithi084 ceph-mon[34812]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:29.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:29 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3697073519' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T10:08:29.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:29.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:29.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:29.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:29 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:29.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:29 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3697073519' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T10:08:29.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:29.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:29.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:29.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:29 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:29.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:29 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3697073519' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T10:08:29.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:29.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:29.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:29.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:29 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:29.909 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T10:08:29.910 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T10:08:30.314 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:30.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:30 smithi050 ceph-mon[30354]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:30.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.922+0000 7fb16fc00640 1 -- 172.21.15.50:0/705602396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb168108e00 msgr2=0x7fb16810ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:30.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.922+0000 7fb16fc00640 1 --2- 172.21.15.50:0/705602396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb168108e00 0x7fb16810ce00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb154009900 tx=0x7fb15402a410 comp rx=0 tx=0).stop 2024-09-10T10:08:30.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.922+0000 7fb16fc00640 1 -- 172.21.15.50:0/705602396 shutdown_connections 2024-09-10T10:08:30.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.922+0000 7fb16fc00640 1 --2- 172.21.15.50:0/705602396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb16810d530 0x7fb1681150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.922+0000 7fb16fc00640 1 --2- 172.21.15.50:0/705602396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb168108e00 0x7fb16810ce00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.922+0000 7fb16fc00640 1 --2- 172.21.15.50:0/705602396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb168108450 0x7fb168108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.922+0000 7fb16fc00640 1 -- 172.21.15.50:0/705602396 >> 172.21.15.50:0/705602396 conn(0x7fb168077ba0 msgr2=0x7fb168079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.922+0000 7fb16fc00640 1 -- 172.21.15.50:0/705602396 shutdown_connections 2024-09-10T10:08:30.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.922+0000 7fb16fc00640 1 -- 172.21.15.50:0/705602396 wait complete. 2024-09-10T10:08:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.923+0000 7fb16fc00640 1 Processor -- start 2024-09-10T10:08:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.924+0000 7fb16fc00640 1 -- start start 2024-09-10T10:08:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.924+0000 7fb16fc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb168108450 0x7fb16819eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.924+0000 7fb16fc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb168108e00 0x7fb16819eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.924+0000 7fb16fc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb16810d530 0x7fb1681a33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.924+0000 7fb16fc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb168118530 con 0x7fb168108e00 2024-09-10T10:08:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.924+0000 7fb16fc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb1681183b0 con 0x7fb168108450 2024-09-10T10:08:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.924+0000 7fb16fc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb1681186b0 con 0x7fb16810d530 2024-09-10T10:08:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.924+0000 7fb16d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb168108450 0x7fb16819eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:30.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.924+0000 7fb16d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb168108450 0x7fb16819eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:35756/0 (socket says 172.21.15.50:35756) 2024-09-10T10:08:30.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.924+0000 7fb16d200640 1 -- 172.21.15.50:0/2180903014 learned_addr learned my addr 172.21.15.50:0/2180903014 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:30.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.924+0000 7fb167e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb168108e00 0x7fb16819eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:30.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.925+0000 7fb16dc00640 1 --2- 172.21.15.50:0/2180903014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb16810d530 0x7fb1681a33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:30.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.925+0000 7fb16d200640 1 -- 172.21.15.50:0/2180903014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb16810d530 msgr2=0x7fb1681a33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:30.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.925+0000 7fb16d200640 1 --2- 172.21.15.50:0/2180903014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb16810d530 0x7fb1681a33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:30.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.925+0000 7fb16d200640 1 -- 172.21.15.50:0/2180903014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb168108e00 msgr2=0x7fb16819eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:30.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.925+0000 7fb16d200640 1 --2- 172.21.15.50:0/2180903014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb168108e00 0x7fb16819eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:30.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.925+0000 7fb16d200640 1 -- 172.21.15.50:0/2180903014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1681a3ae0 con 0x7fb168108450 2024-09-10T10:08:30.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.926+0000 7fb16d200640 1 --2- 172.21.15.50:0/2180903014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb168108450 0x7fb16819eab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00e9f0 tx=0x7fb15c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:30.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.926+0000 7fb165600640 1 -- 172.21.15.50:0/2180903014 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00cd80 con 0x7fb168108450 2024-09-10T10:08:30.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.926+0000 7fb16fc00640 1 -- 172.21.15.50:0/2180903014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1681a3dd0 con 0x7fb168108450 2024-09-10T10:08:30.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.926+0000 7fb165600640 1 -- 172.21.15.50:0/2180903014 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c010910 con 0x7fb168108450 2024-09-10T10:08:30.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.926+0000 7fb165600640 1 -- 172.21.15.50:0/2180903014 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0188f0 con 0x7fb168108450 2024-09-10T10:08:30.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.926+0000 7fb16fc00640 1 -- 172.21.15.50:0/2180903014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1681ab660 con 0x7fb168108450 2024-09-10T10:08:30.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.927+0000 7fb16fc00640 1 -- 172.21.15.50:0/2180903014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb168108830 con 0x7fb168108450 2024-09-10T10:08:30.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.929+0000 7fb165600640 1 -- 172.21.15.50:0/2180903014 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb15c010ac0 con 0x7fb168108450 2024-09-10T10:08:30.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.930+0000 7fb165600640 1 --2- 172.21.15.50:0/2180903014 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb1500a2c00 0x7fb1500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.930+0000 7fb165600640 1 -- 172.21.15.50:0/2180903014 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fb15c0cef80 con 0x7fb168108450 2024-09-10T10:08:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.930+0000 7fb167e00640 1 --2- 172.21.15.50:0/2180903014 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb1500a2c00 0x7fb1500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:30.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.931+0000 7fb167e00640 1 --2- 172.21.15.50:0/2180903014 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb1500a2c00 0x7fb1500a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb154009230 tx=0x7fb1540058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:30.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:30.934+0000 7fb165600640 1 -- 172.21.15.50:0/2180903014 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb15c09bc90 con 0x7fb168108450 2024-09-10T10:08:31.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:30 smithi189 ceph-mon[34999]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:31.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:30 smithi084 ceph-mon[34812]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:31.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.122+0000 7fb16fc00640 1 -- 172.21.15.50:0/2180903014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb16819fe10 con 0x7fb168108450 2024-09-10T10:08:31.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.868+0000 7fb165600640 1 -- 172.21.15.50:0/2180903014 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) ==== 138+0+0 (secure 0 0 0) 0x7fb15c09ff90 con 0x7fb168108450 2024-09-10T10:08:31.871 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-09-10T10:08:31.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.873+0000 7fb16fc00640 1 -- 172.21.15.50:0/2180903014 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb1500a2c00 msgr2=0x7fb1500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:31.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.873+0000 7fb16fc00640 1 --2- 172.21.15.50:0/2180903014 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb1500a2c00 0x7fb1500a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb154009230 tx=0x7fb1540058d0 comp rx=0 tx=0).stop 2024-09-10T10:08:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.873+0000 7fb16fc00640 1 -- 172.21.15.50:0/2180903014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb168108450 msgr2=0x7fb16819eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.873+0000 7fb16fc00640 1 --2- 172.21.15.50:0/2180903014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb168108450 0x7fb16819eab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00e9f0 tx=0x7fb15c00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:08:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.873+0000 7fb16fc00640 1 -- 172.21.15.50:0/2180903014 shutdown_connections 2024-09-10T10:08:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.873+0000 7fb16fc00640 1 --2- 172.21.15.50:0/2180903014 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb1500a2c00 0x7fb1500a50c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.873+0000 7fb16fc00640 1 --2- 172.21.15.50:0/2180903014 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb16810d530 0x7fb1681a33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.873+0000 7fb16fc00640 1 --2- 172.21.15.50:0/2180903014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb168108e00 0x7fb16819eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.873+0000 7fb16fc00640 1 --2- 172.21.15.50:0/2180903014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb168108450 0x7fb16819eab0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.873+0000 7fb16fc00640 1 -- 172.21.15.50:0/2180903014 >> 172.21.15.50:0/2180903014 conn(0x7fb168077ba0 msgr2=0x7fb168078ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.873+0000 7fb16fc00640 1 -- 172.21.15.50:0/2180903014 shutdown_connections 2024-09-10T10:08:31.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:31.873+0000 7fb16fc00640 1 -- 172.21.15.50:0/2180903014 wait complete. 2024-09-10T10:08:32.213 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:31 smithi050 ceph-mon[30354]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:32.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:31 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:32.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:31 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:32.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:31 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:32.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:31 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:08:32.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:31 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:32.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:31 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2180903014' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T10:08:32.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:31 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T10:08:32.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:31 smithi189 ceph-mon[34999]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:32.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:31 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:32.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:31 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:32.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:31 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:32.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:31 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:08:32.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:31 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:32.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:31 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2180903014' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T10:08:32.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:31 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T10:08:32.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:31 smithi084 ceph-mon[34812]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:32.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:31 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:32.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:31 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:32.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:31 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:08:32.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:31 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:08:32.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:31 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:08:32.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:31 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2180903014' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T10:08:32.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:31 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T10:08:32.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-10T10:08:32.991 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:33.131 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:32 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T10:08:33.131 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:32 smithi050 ceph-mon[30354]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T10:08:33.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:32 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T10:08:33.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:32 smithi189 ceph-mon[34999]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T10:08:33.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:32 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T10:08:33.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:32 smithi084 ceph-mon[34812]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T10:08:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.602+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3901171640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c076720 msgr2=0x7f6f9c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.602+0000 7f6fa0c00640 1 --2- 172.21.15.50:0/3901171640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c076720 0x7f6f9c076b00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009900 tx=0x7f6f8c02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:08:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.602+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3901171640 shutdown_connections 2024-09-10T10:08:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.602+0000 7f6fa0c00640 1 --2- 172.21.15.50:0/3901171640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f9c112a30 0x7f6f9c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.602+0000 7f6fa0c00640 1 --2- 172.21.15.50:0/3901171640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c077040 0x7f6f9c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.602+0000 7f6fa0c00640 1 --2- 172.21.15.50:0/3901171640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c076720 0x7f6f9c076b00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:33.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.602+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3901171640 >> 172.21.15.50:0/3901171640 conn(0x7f6f9c0ffa90 msgr2=0x7f6f9c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:33.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.602+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3901171640 shutdown_connections 2024-09-10T10:08:33.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.602+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3901171640 wait complete. 2024-09-10T10:08:33.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.603+0000 7f6fa0c00640 1 Processor -- start 2024-09-10T10:08:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.603+0000 7f6fa0c00640 1 -- start start 2024-09-10T10:08:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.604+0000 7f6fa0c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c076720 0x7f6f9c1a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.604+0000 7f6fa0c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f9c077040 0x7f6f9c1a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.604+0000 7f6fa0c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c112a30 0x7f6f9c19e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.604+0000 7f6fa0c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c1185f0 con 0x7f6f9c076720 2024-09-10T10:08:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.604+0000 7f6fa0c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c118470 con 0x7f6f9c112a30 2024-09-10T10:08:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.604+0000 7f6fa0c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c118770 con 0x7f6f9c077040 2024-09-10T10:08:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.604+0000 7f6f99e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c076720 0x7f6f9c1a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.604+0000 7f6f99e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c076720 0x7f6f9c1a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54440/0 (socket says 172.21.15.50:54440) 2024-09-10T10:08:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.604+0000 7f6f99e00640 1 -- 172.21.15.50:0/3679735167 learned_addr learned my addr 172.21.15.50:0/3679735167 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.604+0000 7f6f9a800640 1 --2- 172.21.15.50:0/3679735167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c112a30 0x7f6f9c19e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.605+0000 7f6f99e00640 1 -- 172.21.15.50:0/3679735167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f9c077040 msgr2=0x7f6f9c1a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:33.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.605+0000 7f6f99e00640 1 --2- 172.21.15.50:0/3679735167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f9c077040 0x7f6f9c1a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:33.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.605+0000 7f6f99e00640 1 -- 172.21.15.50:0/3679735167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c112a30 msgr2=0x7f6f9c19e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:33.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.605+0000 7f6f99e00640 1 --2- 172.21.15.50:0/3679735167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c112a30 0x7f6f9c19e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:33.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.605+0000 7f6f99e00640 1 -- 172.21.15.50:0/3679735167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c19efb0 con 0x7f6f9c076720 2024-09-10T10:08:33.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.605+0000 7f6f99e00640 1 --2- 172.21.15.50:0/3679735167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c076720 0x7f6f9c1a46c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c004770 tx=0x7f6f8c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:33.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.605+0000 7f6f92a00640 1 -- 172.21.15.50:0/3679735167 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c03f070 con 0x7f6f9c076720 2024-09-10T10:08:33.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.605+0000 7f6f92a00640 1 -- 172.21.15.50:0/3679735167 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f8c031ca0 con 0x7f6f9c076720 2024-09-10T10:08:33.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.605+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3679735167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9c19f240 con 0x7f6f9c076720 2024-09-10T10:08:33.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.605+0000 7f6f92a00640 1 -- 172.21.15.50:0/3679735167 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c035030 con 0x7f6f9c076720 2024-09-10T10:08:33.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.605+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3679735167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9c1ab590 con 0x7f6f9c076720 2024-09-10T10:08:33.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.607+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3679735167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9c076b00 con 0x7f6f9c076720 2024-09-10T10:08:33.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.609+0000 7f6f92a00640 1 -- 172.21.15.50:0/3679735167 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6f8c042070 con 0x7f6f9c076720 2024-09-10T10:08:33.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.610+0000 7f6f92a00640 1 --2- 172.21.15.50:0/3679735167 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6f800a2b80 0x7f6f800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:33.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.610+0000 7f6f92a00640 1 -- 172.21.15.50:0/3679735167 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7497+0+0 (secure 0 0 0) 0x7f6f8c0efaa0 con 0x7f6f9c076720 2024-09-10T10:08:33.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.610+0000 7f6f93e00640 1 --2- 172.21.15.50:0/3679735167 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6f800a2b80 0x7f6f800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:33.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.611+0000 7f6f93e00640 1 --2- 172.21.15.50:0/3679735167 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6f800a2b80 0x7f6f800a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f840058c0 tx=0x7f6f84005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:33.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.612+0000 7f6f92a00640 1 -- 172.21.15.50:0/3679735167 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f8c0bcc90 con 0x7f6f9c076720 2024-09-10T10:08:33.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:33.797+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3679735167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f6f9c1ab760 con 0x7f6f9c076720 2024-09-10T10:08:34.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:34.337+0000 7f6f92a00640 1 -- 172.21.15.50:0/3679735167 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v82) ==== 171+0+0 (secure 0 0 0) 0x7f6f8c0bc590 con 0x7f6f9c076720 2024-09-10T10:08:34.339 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-09-10T10:08:34.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:34.340+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3679735167 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6f800a2b80 msgr2=0x7f6f800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:34.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:34.340+0000 7f6fa0c00640 1 --2- 172.21.15.50:0/3679735167 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6f800a2b80 0x7f6f800a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f840058c0 tx=0x7f6f84005850 comp rx=0 tx=0).stop 2024-09-10T10:08:34.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:34.340+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3679735167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c076720 msgr2=0x7f6f9c1a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:34.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:34.340+0000 7f6fa0c00640 1 --2- 172.21.15.50:0/3679735167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c076720 0x7f6f9c1a46c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c004770 tx=0x7f6f8c003c10 comp rx=0 tx=0).stop 2024-09-10T10:08:34.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:34.341+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3679735167 shutdown_connections 2024-09-10T10:08:34.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:34.341+0000 7f6fa0c00640 1 --2- 172.21.15.50:0/3679735167 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6f800a2b80 0x7f6f800a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:34.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:34.341+0000 7f6fa0c00640 1 --2- 172.21.15.50:0/3679735167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f9c112a30 0x7f6f9c19e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:34.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:34.341+0000 7f6fa0c00640 1 --2- 172.21.15.50:0/3679735167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6f9c077040 0x7f6f9c1a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:34.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:34.341+0000 7f6fa0c00640 1 --2- 172.21.15.50:0/3679735167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f9c076720 0x7f6f9c1a46c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:34.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:34.341+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3679735167 >> 172.21.15.50:0/3679735167 conn(0x7f6f9c0ffa90 msgr2=0x7f6f9c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:34.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:34.342+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3679735167 shutdown_connections 2024-09-10T10:08:34.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:34.343+0000 7f6fa0c00640 1 -- 172.21.15.50:0/3679735167 wait complete. 2024-09-10T10:08:34.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:34 smithi189 ceph-mon[34999]: pgmap v297: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:34.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:34 smithi189 ceph-mon[34999]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T10:08:34.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:34 smithi189 ceph-mon[34999]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T10:08:34.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:34 smithi084 ceph-mon[34812]: pgmap v297: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:34.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:34 smithi084 ceph-mon[34812]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T10:08:34.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:34 smithi084 ceph-mon[34812]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T10:08:34.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:34 smithi050 ceph-mon[30354]: pgmap v297: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:34.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:34 smithi050 ceph-mon[30354]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T10:08:34.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:34 smithi050 ceph-mon[30354]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T10:08:35.088 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T10:08:35.485 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:35.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:35 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3679735167' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-10T10:08:35.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:35 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3679735167' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-10T10:08:35.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:35 smithi084 ceph-mon[34812]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T10:08:35.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:35 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3679735167' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-10T10:08:35.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:35 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3679735167' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-10T10:08:35.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:35 smithi050 ceph-mon[30354]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T10:08:35.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:35 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3679735167' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-10T10:08:35.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:35 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3679735167' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-10T10:08:35.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:35 smithi189 ceph-mon[34999]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T10:08:36.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.082+0000 7f9a87000640 1 -- 172.21.15.50:0/368873330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a80077040 msgr2=0x7f9a80112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:36.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.082+0000 7f9a87000640 1 --2- 172.21.15.50:0/368873330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a80077040 0x7f9a80112330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009900 tx=0x7f9a6c02a410 comp rx=0 tx=0).stop 2024-09-10T10:08:36.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.082+0000 7f9a87000640 1 -- 172.21.15.50:0/368873330 shutdown_connections 2024-09-10T10:08:36.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.082+0000 7f9a87000640 1 --2- 172.21.15.50:0/368873330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a80112870 0x7f9a80114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:36.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.082+0000 7f9a87000640 1 --2- 172.21.15.50:0/368873330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a80077040 0x7f9a80112330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:36.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.082+0000 7f9a87000640 1 --2- 172.21.15.50:0/368873330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a80076720 0x7f9a80076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.082+0000 7f9a87000640 1 -- 172.21.15.50:0/368873330 >> 172.21.15.50:0/368873330 conn(0x7f9a800ff8d0 msgr2=0x7f9a80101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.082+0000 7f9a87000640 1 -- 172.21.15.50:0/368873330 shutdown_connections 2024-09-10T10:08:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.082+0000 7f9a87000640 1 -- 172.21.15.50:0/368873330 wait complete. 2024-09-10T10:08:36.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.083+0000 7f9a87000640 1 Processor -- start 2024-09-10T10:08:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.083+0000 7f9a87000640 1 -- start start 2024-09-10T10:08:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a87000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a80076720 0x7f9a801a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a87000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a80077040 0x7f9a801a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:36.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a87000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a80112870 0x7f9a8019e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a87000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9a80118430 con 0x7f9a80077040 2024-09-10T10:08:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a87000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9a801182b0 con 0x7f9a80112870 2024-09-10T10:08:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a87000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9a801185b0 con 0x7f9a80076720 2024-09-10T10:08:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a85200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a80077040 0x7f9a801a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a85200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a80077040 0x7f9a801a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54468/0 (socket says 172.21.15.50:54468) 2024-09-10T10:08:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a85200640 1 -- 172.21.15.50:0/1398989118 learned_addr learned my addr 172.21.15.50:0/1398989118 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a86600640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a80112870 0x7f9a8019e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a85c00640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a80076720 0x7f9a801a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a86600640 1 -- 172.21.15.50:0/1398989118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a80076720 msgr2=0x7f9a801a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a86600640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a80076720 0x7f9a801a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a86600640 1 -- 172.21.15.50:0/1398989118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a80077040 msgr2=0x7f9a801a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a86600640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a80077040 0x7f9a801a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:36.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.084+0000 7f9a86600640 1 -- 172.21.15.50:0/1398989118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8019efc0 con 0x7f9a80112870 2024-09-10T10:08:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.085+0000 7f9a86600640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a80112870 0x7f9a8019e750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9a8007aa10 tx=0x7f9a7800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.085+0000 7f9a7e000640 1 -- 172.21.15.50:0/1398989118 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800cdf0 con 0x7f9a80112870 2024-09-10T10:08:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.085+0000 7f9a7e000640 1 -- 172.21.15.50:0/1398989118 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a78005020 con 0x7f9a80112870 2024-09-10T10:08:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.085+0000 7f9a7e000640 1 -- 172.21.15.50:0/1398989118 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78010670 con 0x7f9a80112870 2024-09-10T10:08:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.085+0000 7f9a87000640 1 -- 172.21.15.50:0/1398989118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8019f2b0 con 0x7f9a80112870 2024-09-10T10:08:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.085+0000 7f9a87000640 1 -- 172.21.15.50:0/1398989118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a801ab430 con 0x7f9a80112870 2024-09-10T10:08:36.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.086+0000 7f9a87000640 1 -- 172.21.15.50:0/1398989118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a80077e60 con 0x7f9a80112870 2024-09-10T10:08:36.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.088+0000 7f9a7e000640 1 -- 172.21.15.50:0/1398989118 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9a780054d0 con 0x7f9a80112870 2024-09-10T10:08:36.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.089+0000 7f9a7e000640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9a680a2b80 0x7f9a680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:36.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.090+0000 7f9a7e000640 1 -- 172.21.15.50:0/1398989118 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7879+0+0 (secure 0 0 0) 0x7f9a780cf6a0 con 0x7f9a80112870 2024-09-10T10:08:36.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.090+0000 7f9a85c00640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9a680a2b80 0x7f9a680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:36.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.090+0000 7f9a85c00640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9a680a2b80 0x7f9a680a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9a740095f0 tx=0x7f9a74005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:36.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.091+0000 7f9a7e000640 1 -- 172.21.15.50:0/1398989118 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a7809c710 con 0x7f9a80112870 2024-09-10T10:08:36.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.313+0000 7f9a87000640 1 -- 172.21.15.50:0/1398989118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9a8010d470 con 0x7f9a80112870 2024-09-10T10:08:36.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.357+0000 7f9a7e000640 1 -- 172.21.15.50:0/1398989118 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f9a7809c010 con 0x7f9a80112870 2024-09-10T10:08:36.358 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T10:08:36.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.359+0000 7f9a87000640 1 -- 172.21.15.50:0/1398989118 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9a680a2b80 msgr2=0x7f9a680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:36.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.359+0000 7f9a87000640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9a680a2b80 0x7f9a680a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9a740095f0 tx=0x7f9a74005f90 comp rx=0 tx=0).stop 2024-09-10T10:08:36.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.359+0000 7f9a87000640 1 -- 172.21.15.50:0/1398989118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a80112870 msgr2=0x7f9a8019e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:36.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.359+0000 7f9a87000640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a80112870 0x7f9a8019e750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9a8007aa10 tx=0x7f9a7800ef10 comp rx=0 tx=0).stop 2024-09-10T10:08:36.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.360+0000 7f9a87000640 1 -- 172.21.15.50:0/1398989118 shutdown_connections 2024-09-10T10:08:36.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.360+0000 7f9a87000640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9a680a2b80 0x7f9a680a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:36.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.360+0000 7f9a87000640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a80112870 0x7f9a8019e750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:36.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.360+0000 7f9a87000640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a80077040 0x7f9a801a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:36.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.360+0000 7f9a87000640 1 --2- 172.21.15.50:0/1398989118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9a80076720 0x7f9a801a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:36.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.360+0000 7f9a87000640 1 -- 172.21.15.50:0/1398989118 >> 172.21.15.50:0/1398989118 conn(0x7f9a800ff8d0 msgr2=0x7f9a80101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:36.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.360+0000 7f9a87000640 1 -- 172.21.15.50:0/1398989118 shutdown_connections 2024-09-10T10:08:36.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:36.360+0000 7f9a87000640 1 -- 172.21.15.50:0/1398989118 wait complete. 2024-09-10T10:08:36.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:36 smithi050 ceph-mon[30354]: pgmap v300: 97 pgs: 10 active+clean, 11 creating+peering, 76 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:36.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:36 smithi050 ceph-mon[30354]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T10:08:36.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:36 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1398989118' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T10:08:36.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:36 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T10:08:36.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:36 smithi050 ceph-mon[30354]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T10:08:36.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:36 smithi189 ceph-mon[34999]: pgmap v300: 97 pgs: 10 active+clean, 11 creating+peering, 76 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:36.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:36 smithi189 ceph-mon[34999]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T10:08:36.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:36 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1398989118' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T10:08:36.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:36 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T10:08:36.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:36 smithi189 ceph-mon[34999]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T10:08:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:36 smithi084 ceph-mon[34812]: pgmap v300: 97 pgs: 10 active+clean, 11 creating+peering, 76 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:36 smithi084 ceph-mon[34812]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T10:08:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:36 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1398989118' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T10:08:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:36 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T10:08:36.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:36 smithi084 ceph-mon[34812]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T10:08:37.240 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-10T10:08:37.240 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-10T10:08:37.627 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:37.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:37 smithi050 ceph-mon[30354]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T10:08:37.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:37 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T10:08:37.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:37 smithi050 ceph-mon[30354]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T10:08:37.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:37 smithi050 ceph-mon[30354]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T10:08:37.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:37 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] up:active 2024-09-10T10:08:37.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:37 smithi050 ceph-mon[30354]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:08:37.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:37 smithi189 ceph-mon[34999]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T10:08:37.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:37 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T10:08:37.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:37 smithi189 ceph-mon[34999]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T10:08:37.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:37 smithi189 ceph-mon[34999]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T10:08:37.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:37 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] up:active 2024-09-10T10:08:37.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:37 smithi189 ceph-mon[34999]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:08:37.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:37 smithi084 ceph-mon[34812]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T10:08:37.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:37 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T10:08:37.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:37 smithi084 ceph-mon[34812]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T10:08:37.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:37 smithi084 ceph-mon[34812]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T10:08:37.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:37 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] up:active 2024-09-10T10:08:37.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:37 smithi084 ceph-mon[34812]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:08:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.204+0000 7f9069800640 1 -- 172.21.15.50:0/2815493677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90641049c0 msgr2=0x7f9064108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.204+0000 7f9069800640 1 --2- 172.21.15.50:0/2815493677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90641049c0 0x7f9064108a10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f904c009900 tx=0x7f904c02a410 comp rx=0 tx=0).stop 2024-09-10T10:08:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.204+0000 7f9069800640 1 -- 172.21.15.50:0/2815493677 shutdown_connections 2024-09-10T10:08:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.204+0000 7f9069800640 1 --2- 172.21.15.50:0/2815493677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9064109140 0x7f9064110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.204+0000 7f9069800640 1 --2- 172.21.15.50:0/2815493677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90641049c0 0x7f9064108a10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.204+0000 7f9069800640 1 --2- 172.21.15.50:0/2815493677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9064104010 0x7f90641043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.204+0000 7f9069800640 1 -- 172.21.15.50:0/2815493677 >> 172.21.15.50:0/2815493677 conn(0x7f90640ffa50 msgr2=0x7f9064101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.204+0000 7f9069800640 1 -- 172.21.15.50:0/2815493677 shutdown_connections 2024-09-10T10:08:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.204+0000 7f9069800640 1 -- 172.21.15.50:0/2815493677 wait complete. 2024-09-10T10:08:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.205+0000 7f9069800640 1 Processor -- start 2024-09-10T10:08:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.205+0000 7f9069800640 1 -- start start 2024-09-10T10:08:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.205+0000 7f9069800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9064104010 0x7f906419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.205+0000 7f9069800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90641049c0 0x7f906419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.205+0000 7f9069800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064109140 0x7f906419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.205+0000 7f9069800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f90641141b0 con 0x7f9064109140 2024-09-10T10:08:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.205+0000 7f9069800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9064114030 con 0x7f9064104010 2024-09-10T10:08:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.205+0000 7f9069800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9064114330 con 0x7f90641049c0 2024-09-10T10:08:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.206+0000 7f9062a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9064104010 0x7f906419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.206+0000 7f9063400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064109140 0x7f906419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.206+0000 7f9062a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9064104010 0x7f906419a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:53652/0 (socket says 172.21.15.50:53652) 2024-09-10T10:08:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.206+0000 7f9062a00640 1 -- 172.21.15.50:0/4038128144 learned_addr learned my addr 172.21.15.50:0/4038128144 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.206+0000 7f905be00640 1 --2- 172.21.15.50:0/4038128144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90641049c0 0x7f906419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.206+0000 7f9062a00640 1 -- 172.21.15.50:0/4038128144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90641049c0 msgr2=0x7f906419ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.206+0000 7f9062a00640 1 --2- 172.21.15.50:0/4038128144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90641049c0 0x7f906419ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.206+0000 7f9062a00640 1 -- 172.21.15.50:0/4038128144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064109140 msgr2=0x7f906419efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.206+0000 7f9062a00640 1 --2- 172.21.15.50:0/4038128144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064109140 0x7f906419efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.206+0000 7f9062a00640 1 -- 172.21.15.50:0/4038128144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906419f6c0 con 0x7f9064104010 2024-09-10T10:08:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.206+0000 7f9062a00640 1 --2- 172.21.15.50:0/4038128144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9064104010 0x7f906419a710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f905400d770 tx=0x7f905400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.207+0000 7f905b400640 1 -- 172.21.15.50:0/4038128144 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9054017070 con 0x7f9064104010 2024-09-10T10:08:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.207+0000 7f905b400640 1 -- 172.21.15.50:0/4038128144 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9054005500 con 0x7f9064104010 2024-09-10T10:08:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.207+0000 7f9069800640 1 -- 172.21.15.50:0/4038128144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f906419f9b0 con 0x7f9064104010 2024-09-10T10:08:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.207+0000 7f905b400640 1 -- 172.21.15.50:0/4038128144 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9054004e00 con 0x7f9064104010 2024-09-10T10:08:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.207+0000 7f9069800640 1 -- 172.21.15.50:0/4038128144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90641a7290 con 0x7f9064104010 2024-09-10T10:08:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.208+0000 7f9069800640 1 -- 172.21.15.50:0/4038128144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90641043f0 con 0x7f9064104010 2024-09-10T10:08:38.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.210+0000 7f905b400640 1 -- 172.21.15.50:0/4038128144 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9054004fa0 con 0x7f9064104010 2024-09-10T10:08:38.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.211+0000 7f905b400640 1 --2- 172.21.15.50:0/4038128144 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f90480a2b80 0x7f90480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:38.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.211+0000 7f905b400640 1 -- 172.21.15.50:0/4038128144 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f90540ce9d0 con 0x7f9064104010 2024-09-10T10:08:38.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.211+0000 7f905be00640 1 --2- 172.21.15.50:0/4038128144 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f90480a2b80 0x7f90480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:38.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.212+0000 7f905be00640 1 --2- 172.21.15.50:0/4038128144 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f90480a2b80 0x7f90480a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f904c000c00 tx=0x7f904c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:38.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.213+0000 7f905b400640 1 -- 172.21.15.50:0/4038128144 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f905409b9e0 con 0x7f9064104010 2024-09-10T10:08:38.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:38.411+0000 7f9069800640 1 -- 172.21.15.50:0/4038128144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f906410c380 con 0x7f9064104010 2024-09-10T10:08:38.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:38 smithi050 ceph-mon[30354]: pgmap v303: 97 pgs: 30 active+clean, 21 creating+peering, 46 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-10T10:08:38.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:38 smithi050 ceph-mon[30354]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T10:08:38.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:38 smithi050 ceph-mon[30354]: Cluster is now healthy 2024-09-10T10:08:38.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:38 smithi189 ceph-mon[34999]: pgmap v303: 97 pgs: 30 active+clean, 21 creating+peering, 46 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-10T10:08:38.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:38 smithi189 ceph-mon[34999]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T10:08:38.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:38 smithi189 ceph-mon[34999]: Cluster is now healthy 2024-09-10T10:08:38.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:38 smithi084 ceph-mon[34812]: pgmap v303: 97 pgs: 30 active+clean, 21 creating+peering, 46 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-09-10T10:08:38.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:38 smithi084 ceph-mon[34812]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T10:08:38.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:38 smithi084 ceph-mon[34812]: Cluster is now healthy 2024-09-10T10:08:39.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:39.360+0000 7f905b400640 1 -- 172.21.15.50:0/4038128144 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) ==== 157+0+0 (secure 0 0 0) 0x7f905409b2e0 con 0x7f9064104010 2024-09-10T10:08:39.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:39.364+0000 7f9069800640 1 -- 172.21.15.50:0/4038128144 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f90480a2b80 msgr2=0x7f90480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:39.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:39.364+0000 7f9069800640 1 --2- 172.21.15.50:0/4038128144 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f90480a2b80 0x7f90480a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f904c000c00 tx=0x7f904c005a20 comp rx=0 tx=0).stop 2024-09-10T10:08:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:39.364+0000 7f9069800640 1 -- 172.21.15.50:0/4038128144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9064104010 msgr2=0x7f906419a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:39.364+0000 7f9069800640 1 --2- 172.21.15.50:0/4038128144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9064104010 0x7f906419a710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f905400d770 tx=0x7f905400dc30 comp rx=0 tx=0).stop 2024-09-10T10:08:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:39.364+0000 7f9069800640 1 -- 172.21.15.50:0/4038128144 shutdown_connections 2024-09-10T10:08:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:39.364+0000 7f9069800640 1 --2- 172.21.15.50:0/4038128144 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f90480a2b80 0x7f90480a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:39.364+0000 7f9069800640 1 --2- 172.21.15.50:0/4038128144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9064109140 0x7f906419efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:39.364+0000 7f9069800640 1 --2- 172.21.15.50:0/4038128144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90641049c0 0x7f906419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:39.364+0000 7f9069800640 1 --2- 172.21.15.50:0/4038128144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9064104010 0x7f906419a710 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:39.364+0000 7f9069800640 1 -- 172.21.15.50:0/4038128144 >> 172.21.15.50:0/4038128144 conn(0x7f90640ffa50 msgr2=0x7f9064100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:39.364+0000 7f9069800640 1 -- 172.21.15.50:0/4038128144 shutdown_connections 2024-09-10T10:08:39.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:39.364+0000 7f9069800640 1 -- 172.21.15.50:0/4038128144 wait complete. 2024-09-10T10:08:39.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:39 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4038128144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-10T10:08:39.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:39 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-10T10:08:39.600 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:08:39 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-b[64500]: 2024-09-10T10:08:39.141+0000 7f74a3a2c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T10:08:39.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:39 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4038128144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-10T10:08:39.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:39 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-10T10:08:39.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:39 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4038128144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-10T10:08:39.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:39 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-10T10:08:40.337 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T10:08:40.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:40 smithi050 ceph-mon[30354]: pgmap v304: 97 pgs: 85 active+clean, 10 creating+peering, 2 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 2 op/s 2024-09-10T10:08:40.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:40 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-10T10:08:40.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:40 smithi050 ceph-mon[30354]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T10:08:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:40.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:40 smithi189 ceph-mon[34999]: pgmap v304: 97 pgs: 85 active+clean, 10 creating+peering, 2 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 2 op/s 2024-09-10T10:08:40.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:40 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-10T10:08:40.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:40 smithi189 ceph-mon[34999]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T10:08:40.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:40 smithi084 ceph-mon[34812]: pgmap v304: 97 pgs: 85 active+clean, 10 creating+peering, 2 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 2 op/s 2024-09-10T10:08:40.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:40 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-10T10:08:40.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:40 smithi084 ceph-mon[34812]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T10:08:41.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.273+0000 7f78bf600640 1 -- 172.21.15.50:0/677550451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b810e3c0 msgr2=0x7f78b8110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:41.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.273+0000 7f78bf600640 1 --2- 172.21.15.50:0/677550451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b810e3c0 0x7f78b8110810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009ca0 tx=0x7f78b002a950 comp rx=0 tx=0).stop 2024-09-10T10:08:41.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.273+0000 7f78bf600640 1 -- 172.21.15.50:0/677550451 shutdown_connections 2024-09-10T10:08:41.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.273+0000 7f78bf600640 1 --2- 172.21.15.50:0/677550451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b810e3c0 0x7f78b8110810 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:41.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.273+0000 7f78bf600640 1 --2- 172.21.15.50:0/677550451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b8074f40 0x7f78b810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:41.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.273+0000 7f78bf600640 1 --2- 172.21.15.50:0/677550451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78b8074620 0x7f78b8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:41.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.273+0000 7f78bf600640 1 -- 172.21.15.50:0/677550451 >> 172.21.15.50:0/677550451 conn(0x7f78b80fd8c0 msgr2=0x7f78b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:41.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.273+0000 7f78bf600640 1 -- 172.21.15.50:0/677550451 shutdown_connections 2024-09-10T10:08:41.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.273+0000 7f78bf600640 1 -- 172.21.15.50:0/677550451 wait complete. 2024-09-10T10:08:41.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.274+0000 7f78bf600640 1 Processor -- start 2024-09-10T10:08:41.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.274+0000 7f78bf600640 1 -- start start 2024-09-10T10:08:41.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bf600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b8074620 0x7f78b819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bf600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b8074f40 0x7f78b819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bf600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78b810e3c0 0x7f78b819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bf600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f78b81141c0 con 0x7f78b8074620 2024-09-10T10:08:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bf600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f78b8114040 con 0x7f78b810e3c0 2024-09-10T10:08:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bf600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f78b8114340 con 0x7f78b8074f40 2024-09-10T10:08:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bd600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78b810e3c0 0x7f78b819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bd600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78b810e3c0 0x7f78b819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:53666/0 (socket says 172.21.15.50:53666) 2024-09-10T10:08:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bd600640 1 -- 172.21.15.50:0/1067654229 learned_addr learned my addr 172.21.15.50:0/1067654229 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78afe00640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b8074f40 0x7f78b819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bcc00640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b8074620 0x7f78b819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bd600640 1 -- 172.21.15.50:0/1067654229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b8074f40 msgr2=0x7f78b819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:41.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bd600640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b8074f40 0x7f78b819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bd600640 1 -- 172.21.15.50:0/1067654229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b8074620 msgr2=0x7f78b819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bd600640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b8074620 0x7f78b819a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.275+0000 7f78bd600640 1 -- 172.21.15.50:0/1067654229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b819f610 con 0x7f78b810e3c0 2024-09-10T10:08:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.276+0000 7f78bd600640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78b810e3c0 0x7f78b819ef30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009dc0 tx=0x7f78b0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.276+0000 7f78b6000640 1 -- 172.21.15.50:0/1067654229 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0034040 con 0x7f78b810e3c0 2024-09-10T10:08:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.276+0000 7f78bf600640 1 -- 172.21.15.50:0/1067654229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b819f8a0 con 0x7f78b810e3c0 2024-09-10T10:08:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.276+0000 7f78b6000640 1 -- 172.21.15.50:0/1067654229 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78b002f940 con 0x7f78b810e3c0 2024-09-10T10:08:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.276+0000 7f78b6000640 1 -- 172.21.15.50:0/1067654229 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b00046a0 con 0x7f78b810e3c0 2024-09-10T10:08:41.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.276+0000 7f78bf600640 1 -- 172.21.15.50:0/1067654229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b81a71e0 con 0x7f78b810e3c0 2024-09-10T10:08:41.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.277+0000 7f78bf600640 1 -- 172.21.15.50:0/1067654229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b8075cd0 con 0x7f78b810e3c0 2024-09-10T10:08:41.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.279+0000 7f78b6000640 1 -- 172.21.15.50:0/1067654229 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f78b0037020 con 0x7f78b810e3c0 2024-09-10T10:08:41.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.280+0000 7f78b6000640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f789c0a2b80 0x7f789c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:41.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.281+0000 7f78b6000640 1 -- 172.21.15.50:0/1067654229 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f78b00efe50 con 0x7f78b810e3c0 2024-09-10T10:08:41.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.281+0000 7f78bcc00640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f789c0a2b80 0x7f789c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:41.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.281+0000 7f78bcc00640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f789c0a2b80 0x7f789c0a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009bd0 tx=0x7f78a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:41.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.283+0000 7f78b6000640 1 -- 172.21.15.50:0/1067654229 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f78b00bcdb0 con 0x7f78b810e3c0 2024-09-10T10:08:41.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:41.471+0000 7f78bf600640 1 -- 172.21.15.50:0/1067654229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f78b8109540 con 0x7f78b810e3c0 2024-09-10T10:08:42.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:42 smithi050 ceph-mon[30354]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T10:08:42.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:42 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1067654229' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T10:08:42.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:42 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T10:08:42.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:42 smithi189 ceph-mon[34999]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T10:08:42.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:42 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1067654229' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T10:08:42.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:42 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T10:08:42.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:42 smithi084 ceph-mon[34812]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T10:08:42.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:42 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1067654229' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T10:08:42.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:42 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T10:08:43.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:43.378+0000 7f78b6000640 1 -- 172.21.15.50:0/1067654229 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) ==== 228+0+0 (secure 0 0 0) 0x7f78b00bc6b0 con 0x7f78b810e3c0 2024-09-10T10:08:43.380 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' created 2024-09-10T10:08:43.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:43.384+0000 7f78bf600640 1 -- 172.21.15.50:0/1067654229 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f789c0a2b80 msgr2=0x7f789c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:43.384+0000 7f78bf600640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f789c0a2b80 0x7f789c0a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009bd0 tx=0x7f78a8005f90 comp rx=0 tx=0).stop 2024-09-10T10:08:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:43.384+0000 7f78bf600640 1 -- 172.21.15.50:0/1067654229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78b810e3c0 msgr2=0x7f78b819ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:43.384+0000 7f78bf600640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78b810e3c0 0x7f78b819ef30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009dc0 tx=0x7f78b0003c10 comp rx=0 tx=0).stop 2024-09-10T10:08:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:43.387+0000 7f78bf600640 1 -- 172.21.15.50:0/1067654229 shutdown_connections 2024-09-10T10:08:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:43.387+0000 7f78bf600640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f789c0a2b80 0x7f789c0a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:43.387+0000 7f78bf600640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78b810e3c0 0x7f78b819ef30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:43.387+0000 7f78bf600640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f78b8074f40 0x7f78b819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:43.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:43.387+0000 7f78bf600640 1 --2- 172.21.15.50:0/1067654229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78b8074620 0x7f78b819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:43.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:43.387+0000 7f78bf600640 1 -- 172.21.15.50:0/1067654229 >> 172.21.15.50:0/1067654229 conn(0x7f78b80fd8c0 msgr2=0x7f78b80fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:43.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:43.387+0000 7f78bf600640 1 -- 172.21.15.50:0/1067654229 shutdown_connections 2024-09-10T10:08:43.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:43.387+0000 7f78bf600640 1 -- 172.21.15.50:0/1067654229 wait complete. 2024-09-10T10:08:43.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:43 smithi050 ceph-mon[30354]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T10:08:43.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:43 smithi189 ceph-mon[34999]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T10:08:43.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:43 smithi084 ceph-mon[34812]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T10:08:44.201 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-10T10:08:44.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:44 smithi050 ceph-mon[30354]: pgmap v308: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-10T10:08:44.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:44 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T10:08:44.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:44 smithi050 ceph-mon[30354]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T10:08:44.597 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:44.737 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:44 smithi189 ceph-mon[34999]: pgmap v308: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-10T10:08:44.737 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:44 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T10:08:44.737 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:44 smithi189 ceph-mon[34999]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T10:08:44.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:44 smithi084 ceph-mon[34812]: pgmap v308: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-10T10:08:45.117 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:44 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T10:08:45.117 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:44 smithi084 ceph-mon[34812]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T10:08:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.204+0000 7fc196600640 1 -- 172.21.15.50:0/3900000896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc190077040 msgr2=0x7fc190112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.204+0000 7fc196600640 1 --2- 172.21.15.50:0/3900000896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc190077040 0x7fc190112510 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc178009900 tx=0x7fc17802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:08:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.204+0000 7fc196600640 1 -- 172.21.15.50:0/3900000896 shutdown_connections 2024-09-10T10:08:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.204+0000 7fc196600640 1 --2- 172.21.15.50:0/3900000896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc190112a50 0x7fc190114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.204+0000 7fc196600640 1 --2- 172.21.15.50:0/3900000896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc190077040 0x7fc190112510 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.204+0000 7fc196600640 1 --2- 172.21.15.50:0/3900000896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc190076720 0x7fc190076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.204+0000 7fc196600640 1 -- 172.21.15.50:0/3900000896 >> 172.21.15.50:0/3900000896 conn(0x7fc1900ffa50 msgr2=0x7fc190101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:45.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.204+0000 7fc196600640 1 -- 172.21.15.50:0/3900000896 shutdown_connections 2024-09-10T10:08:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.204+0000 7fc196600640 1 -- 172.21.15.50:0/3900000896 wait complete. 2024-09-10T10:08:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.205+0000 7fc196600640 1 Processor -- start 2024-09-10T10:08:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.205+0000 7fc196600640 1 -- start start 2024-09-10T10:08:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.206+0000 7fc196600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc190076720 0x7fc1901a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:45.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.206+0000 7fc196600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc190077040 0x7fc1901a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.206+0000 7fc196600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc190112a50 0x7fc19019ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:45.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.206+0000 7fc196600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc190118630 con 0x7fc190076720 2024-09-10T10:08:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.206+0000 7fc196600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc1901184b0 con 0x7fc190112a50 2024-09-10T10:08:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.206+0000 7fc196600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc1901187b0 con 0x7fc190077040 2024-09-10T10:08:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.206+0000 7fc187e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc190077040 0x7fc1901a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.206+0000 7fc187e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc190077040 0x7fc1901a4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:59272/0 (socket says 172.21.15.50:59272) 2024-09-10T10:08:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.206+0000 7fc18f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc190076720 0x7fc1901a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.206+0000 7fc187e00640 1 -- 172.21.15.50:0/2682031940 learned_addr learned my addr 172.21.15.50:0/2682031940 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.206+0000 7fc18fe00640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc190112a50 0x7fc19019ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.207+0000 7fc187e00640 1 -- 172.21.15.50:0/2682031940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc190112a50 msgr2=0x7fc19019ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.207+0000 7fc187e00640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc190112a50 0x7fc19019ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.207+0000 7fc187e00640 1 -- 172.21.15.50:0/2682031940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc190076720 msgr2=0x7fc1901a4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.207+0000 7fc187e00640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc190076720 0x7fc1901a4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.207+0000 7fc187e00640 1 -- 172.21.15.50:0/2682031940 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19019f150 con 0x7fc190077040 2024-09-10T10:08:45.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.207+0000 7fc18fe00640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc190112a50 0x7fc19019ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:08:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.207+0000 7fc187e00640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc190077040 0x7fc1901a4da0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc178004770 tx=0x7fc178003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.207+0000 7fc18cc00640 1 -- 172.21.15.50:0/2682031940 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17803f070 con 0x7fc190077040 2024-09-10T10:08:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.207+0000 7fc196600640 1 -- 172.21.15.50:0/2682031940 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19019f3e0 con 0x7fc190077040 2024-09-10T10:08:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.207+0000 7fc18cc00640 1 -- 172.21.15.50:0/2682031940 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc178031ca0 con 0x7fc190077040 2024-09-10T10:08:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.207+0000 7fc18cc00640 1 -- 172.21.15.50:0/2682031940 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc178035030 con 0x7fc190077040 2024-09-10T10:08:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.207+0000 7fc196600640 1 -- 172.21.15.50:0/2682031940 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1901ab730 con 0x7fc190077040 2024-09-10T10:08:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.208+0000 7fc196600640 1 -- 172.21.15.50:0/2682031940 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc190076b00 con 0x7fc190077040 2024-09-10T10:08:45.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.211+0000 7fc18cc00640 1 -- 172.21.15.50:0/2682031940 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc178042070 con 0x7fc190077040 2024-09-10T10:08:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.212+0000 7fc18cc00640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc1740a2b80 0x7fc1740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.212+0000 7fc18cc00640 1 -- 172.21.15.50:0/2682031940 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8770+0+0 (secure 0 0 0) 0x7fc1780effe0 con 0x7fc190077040 2024-09-10T10:08:45.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.212+0000 7fc18f400640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc1740a2b80 0x7fc1740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:45.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.213+0000 7fc18f400640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc1740a2b80 0x7fc1740a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc19019fb60 tx=0x7fc180005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:45.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.214+0000 7fc18cc00640 1 -- 172.21.15.50:0/2682031940 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1780bcce0 con 0x7fc190077040 2024-09-10T10:08:45.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:45.400+0000 7fc196600640 1 -- 172.21.15.50:0/2682031940 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fc19010dbe0 con 0x7fc190077040 2024-09-10T10:08:45.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:45 smithi050 ceph-mon[30354]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T10:08:45.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:45 smithi189 ceph-mon[34999]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T10:08:45.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:45 smithi084 ceph-mon[34812]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T10:08:46.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:46.396+0000 7fc18cc00640 1 -- 172.21.15.50:0/2682031940 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v90) ==== 169+0+0 (secure 0 0 0) 0x7fc1780bc5e0 con 0x7fc190077040 2024-09-10T10:08:46.399 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 4 allow_ec_overwrites to true 2024-09-10T10:08:46.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:46.400+0000 7fc196600640 1 -- 172.21.15.50:0/2682031940 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc1740a2b80 msgr2=0x7fc1740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:46.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:46.400+0000 7fc196600640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc1740a2b80 0x7fc1740a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc19019fb60 tx=0x7fc180005f90 comp rx=0 tx=0).stop 2024-09-10T10:08:46.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:46.400+0000 7fc196600640 1 -- 172.21.15.50:0/2682031940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc190077040 msgr2=0x7fc1901a4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:46.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:46.400+0000 7fc196600640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc190077040 0x7fc1901a4da0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc178004770 tx=0x7fc178003c10 comp rx=0 tx=0).stop 2024-09-10T10:08:46.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:46.400+0000 7fc196600640 1 -- 172.21.15.50:0/2682031940 shutdown_connections 2024-09-10T10:08:46.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:46.400+0000 7fc196600640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc1740a2b80 0x7fc1740a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:46.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:46.400+0000 7fc196600640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc190112a50 0x7fc19019ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:46.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:46.400+0000 7fc196600640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc190077040 0x7fc1901a4da0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:46.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:46.400+0000 7fc196600640 1 --2- 172.21.15.50:0/2682031940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc190076720 0x7fc1901a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:46.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:46.400+0000 7fc196600640 1 -- 172.21.15.50:0/2682031940 >> 172.21.15.50:0/2682031940 conn(0x7fc1900ffa50 msgr2=0x7fc190101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:46.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:46.400+0000 7fc196600640 1 -- 172.21.15.50:0/2682031940 shutdown_connections 2024-09-10T10:08:46.402 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:46.400+0000 7fc196600640 1 -- 172.21.15.50:0/2682031940 wait complete. 2024-09-10T10:08:46.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:46 smithi050 ceph-mon[30354]: pgmap v311: 129 pgs: 8 creating+peering, 24 unknown, 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 189 B/s wr, 4 op/s 2024-09-10T10:08:46.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:46 smithi050 ceph-mon[30354]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T10:08:46.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:46 smithi050 ceph-mon[30354]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T10:08:46.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:46 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2682031940' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-10T10:08:46.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:46 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-10T10:08:46.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:46 smithi189 ceph-mon[34999]: pgmap v311: 129 pgs: 8 creating+peering, 24 unknown, 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 189 B/s wr, 4 op/s 2024-09-10T10:08:46.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:46 smithi189 ceph-mon[34999]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T10:08:46.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:46 smithi189 ceph-mon[34999]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T10:08:46.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:46 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2682031940' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-10T10:08:46.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:46 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-10T10:08:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:46 smithi084 ceph-mon[34812]: pgmap v311: 129 pgs: 8 creating+peering, 24 unknown, 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 189 B/s wr, 4 op/s 2024-09-10T10:08:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:46 smithi084 ceph-mon[34812]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T10:08:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:46 smithi084 ceph-mon[34812]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T10:08:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:46 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2682031940' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-10T10:08:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:46 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-10T10:08:47.140 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-10T10:08:47.526 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:47.666 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:47 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-10T10:08:47.666 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:47 smithi050 ceph-mon[30354]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T10:08:47.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:47 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-10T10:08:47.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:47 smithi189 ceph-mon[34999]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T10:08:47.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:47 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-10T10:08:47.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:47 smithi084 ceph-mon[34812]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T10:08:48.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.129+0000 7fc384400640 1 -- 172.21.15.50:0/2981988450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c104010 msgr2=0x7fc37c1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:48.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.129+0000 7fc384400640 1 --2- 172.21.15.50:0/2981988450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c104010 0x7fc37c1043f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc370009900 tx=0x7fc37002a410 comp rx=0 tx=0).stop 2024-09-10T10:08:48.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.129+0000 7fc384400640 1 -- 172.21.15.50:0/2981988450 shutdown_connections 2024-09-10T10:08:48.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.129+0000 7fc384400640 1 --2- 172.21.15.50:0/2981988450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc37c109140 0x7fc37c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.129+0000 7fc384400640 1 --2- 172.21.15.50:0/2981988450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc37c1049c0 0x7fc37c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.129+0000 7fc384400640 1 --2- 172.21.15.50:0/2981988450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c104010 0x7fc37c1043f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.129+0000 7fc384400640 1 -- 172.21.15.50:0/2981988450 >> 172.21.15.50:0/2981988450 conn(0x7fc37c0ffa50 msgr2=0x7fc37c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.129+0000 7fc384400640 1 -- 172.21.15.50:0/2981988450 shutdown_connections 2024-09-10T10:08:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.129+0000 7fc384400640 1 -- 172.21.15.50:0/2981988450 wait complete. 2024-09-10T10:08:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.130+0000 7fc384400640 1 Processor -- start 2024-09-10T10:08:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.130+0000 7fc384400640 1 -- start start 2024-09-10T10:08:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.130+0000 7fc384400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc37c104010 0x7fc37c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.130+0000 7fc384400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c1049c0 0x7fc37c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.130+0000 7fc384400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc37c109140 0x7fc37c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.130+0000 7fc384400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c1141c0 con 0x7fc37c1049c0 2024-09-10T10:08:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.130+0000 7fc384400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c114040 con 0x7fc37c109140 2024-09-10T10:08:48.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.130+0000 7fc384400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c114340 con 0x7fc37c104010 2024-09-10T10:08:48.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.130+0000 7fc381000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c1049c0 0x7fc37c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:48.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.131+0000 7fc381a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc37c104010 0x7fc37c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:48.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.131+0000 7fc381000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c1049c0 0x7fc37c19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60694/0 (socket says 172.21.15.50:60694) 2024-09-10T10:08:48.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.131+0000 7fc381a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc37c104010 0x7fc37c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:40548/0 (socket says 172.21.15.50:40548) 2024-09-10T10:08:48.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.131+0000 7fc381000640 1 -- 172.21.15.50:0/1072185233 learned_addr learned my addr 172.21.15.50:0/1072185233 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:48.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.131+0000 7fc382400640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc37c109140 0x7fc37c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:48.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.131+0000 7fc381000640 1 -- 172.21.15.50:0/1072185233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc37c104010 msgr2=0x7fc37c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:48.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.131+0000 7fc381000640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc37c104010 0x7fc37c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:48.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.131+0000 7fc381000640 1 -- 172.21.15.50:0/1072185233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc37c109140 msgr2=0x7fc37c19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:48.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.131+0000 7fc381000640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc37c109140 0x7fc37c19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:48.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.131+0000 7fc381000640 1 -- 172.21.15.50:0/1072185233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c19f5f0 con 0x7fc37c1049c0 2024-09-10T10:08:48.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.131+0000 7fc381a00640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc37c104010 0x7fc37c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:08:48.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.131+0000 7fc381000640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c1049c0 0x7fc37c19ab80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc36800d950 tx=0x7fc36800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:48.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.132+0000 7fc37a000640 1 -- 172.21.15.50:0/1072185233 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368017070 con 0x7fc37c1049c0 2024-09-10T10:08:48.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.132+0000 7fc37a000640 1 -- 172.21.15.50:0/1072185233 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc368009c30 con 0x7fc37c1049c0 2024-09-10T10:08:48.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.132+0000 7fc37a000640 1 -- 172.21.15.50:0/1072185233 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36800f6b0 con 0x7fc37c1049c0 2024-09-10T10:08:48.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.132+0000 7fc384400640 1 -- 172.21.15.50:0/1072185233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37c19f8e0 con 0x7fc37c1049c0 2024-09-10T10:08:48.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.132+0000 7fc384400640 1 -- 172.21.15.50:0/1072185233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37c1a71c0 con 0x7fc37c1049c0 2024-09-10T10:08:48.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.133+0000 7fc384400640 1 -- 172.21.15.50:0/1072185233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37c1043f0 con 0x7fc37c1049c0 2024-09-10T10:08:48.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.135+0000 7fc37a000640 1 -- 172.21.15.50:0/1072185233 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc3680109d0 con 0x7fc37c1049c0 2024-09-10T10:08:48.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.137+0000 7fc37a000640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc3640a2c00 0x7fc3640a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:48.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.137+0000 7fc37a000640 1 -- 172.21.15.50:0/1072185233 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8770+0+0 (secure 0 0 0) 0x7fc3680cee00 con 0x7fc37c1049c0 2024-09-10T10:08:48.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.137+0000 7fc381a00640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc3640a2c00 0x7fc3640a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:48.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.138+0000 7fc381a00640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc3640a2c00 0x7fc3640a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc370000c00 tx=0x7fc370031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:48.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.141+0000 7fc37a000640 1 -- 172.21.15.50:0/1072185233 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc368009de0 con 0x7fc37c1049c0 2024-09-10T10:08:48.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.365+0000 7fc384400640 1 -- 172.21.15.50:0/1072185233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fc37c02d7c0 con 0x7fc37c1049c0 2024-09-10T10:08:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.414+0000 7fc37a000640 1 -- 172.21.15.50:0/1072185233 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) ==== 137+0+0 (secure 0 0 0) 0x7fc36809b490 con 0x7fc37c1049c0 2024-09-10T10:08:48.416 INFO:teuthology.orchestra.run.smithi050.stderr:added data pool 4 to fsmap 2024-09-10T10:08:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.418+0000 7fc384400640 1 -- 172.21.15.50:0/1072185233 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc3640a2c00 msgr2=0x7fc3640a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.418+0000 7fc384400640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc3640a2c00 0x7fc3640a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc370000c00 tx=0x7fc370031510 comp rx=0 tx=0).stop 2024-09-10T10:08:48.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.418+0000 7fc384400640 1 -- 172.21.15.50:0/1072185233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c1049c0 msgr2=0x7fc37c19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.418+0000 7fc384400640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c1049c0 0x7fc37c19ab80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc36800d950 tx=0x7fc36800de10 comp rx=0 tx=0).stop 2024-09-10T10:08:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.418+0000 7fc384400640 1 -- 172.21.15.50:0/1072185233 shutdown_connections 2024-09-10T10:08:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.418+0000 7fc384400640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc3640a2c00 0x7fc3640a50c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.418+0000 7fc384400640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc37c109140 0x7fc37c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.418+0000 7fc384400640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc37c1049c0 0x7fc37c19ab80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.418+0000 7fc384400640 1 --2- 172.21.15.50:0/1072185233 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc37c104010 0x7fc37c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.418+0000 7fc384400640 1 -- 172.21.15.50:0/1072185233 >> 172.21.15.50:0/1072185233 conn(0x7fc37c0ffa50 msgr2=0x7fc37c100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.418+0000 7fc384400640 1 -- 172.21.15.50:0/1072185233 shutdown_connections 2024-09-10T10:08:48.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:48.418+0000 7fc384400640 1 -- 172.21.15.50:0/1072185233 wait complete. 2024-09-10T10:08:48.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:48 smithi050 ceph-mon[30354]: pgmap v314: 129 pgs: 8 creating+peering, 14 unknown, 107 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:48.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:48 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1072185233' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-10T10:08:48.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:48 smithi189 ceph-mon[34999]: pgmap v314: 129 pgs: 8 creating+peering, 14 unknown, 107 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:48.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:48 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1072185233' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-10T10:08:48.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:48 smithi084 ceph-mon[34812]: pgmap v314: 129 pgs: 8 creating+peering, 14 unknown, 107 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:48.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:48 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1072185233' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-10T10:08:49.292 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:08:49.671 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:49.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:49 smithi050 ceph-mon[30354]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T10:08:49.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:49 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1072185233' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-10T10:08:49.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:49 smithi050 ceph-mon[30354]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:08:49.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:49 smithi189 ceph-mon[34999]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T10:08:49.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:49 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1072185233' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-10T10:08:49.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:49 smithi189 ceph-mon[34999]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:08:49.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:49 smithi084 ceph-mon[34812]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T10:08:49.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:49 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1072185233' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-10T10:08:49.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:49 smithi084 ceph-mon[34812]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:08:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.221+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2296055898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4adc1049c0 msgr2=0x7f4adc108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.221+0000 7f4ae3a00640 1 --2- 172.21.15.50:0/2296055898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4adc1049c0 0x7f4adc108a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009900 tx=0x7f4ac802a410 comp rx=0 tx=0).stop 2024-09-10T10:08:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.221+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2296055898 shutdown_connections 2024-09-10T10:08:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.221+0000 7f4ae3a00640 1 --2- 172.21.15.50:0/2296055898 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4adc109140 0x7f4adc110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.221+0000 7f4ae3a00640 1 --2- 172.21.15.50:0/2296055898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4adc1049c0 0x7f4adc108a10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.221+0000 7f4ae3a00640 1 --2- 172.21.15.50:0/2296055898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4adc104010 0x7f4adc1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.221+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2296055898 >> 172.21.15.50:0/2296055898 conn(0x7f4adc0ffa50 msgr2=0x7f4adc101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.221+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2296055898 shutdown_connections 2024-09-10T10:08:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.221+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2296055898 wait complete. 2024-09-10T10:08:50.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.222+0000 7f4ae3a00640 1 Processor -- start 2024-09-10T10:08:50.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.223+0000 7f4ae3a00640 1 -- start start 2024-09-10T10:08:50.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.223+0000 7f4ae3a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4adc104010 0x7f4adc19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:50.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.223+0000 7f4ae3a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4adc1049c0 0x7f4adc19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:50.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.223+0000 7f4ae3a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4adc109140 0x7f4adc19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:50.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.223+0000 7f4ae3a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc1141b0 con 0x7f4adc1049c0 2024-09-10T10:08:50.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.223+0000 7f4ae3a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc114030 con 0x7f4adc109140 2024-09-10T10:08:50.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.223+0000 7f4ae3a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc114330 con 0x7f4adc104010 2024-09-10T10:08:50.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.223+0000 7f4ae1000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4adc104010 0x7f4adc19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:50.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.223+0000 7f4adbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4adc1049c0 0x7f4adc19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:50.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.223+0000 7f4ae1000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4adc104010 0x7f4adc19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:40568/0 (socket says 172.21.15.50:40568) 2024-09-10T10:08:50.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.223+0000 7f4ae1000640 1 -- 172.21.15.50:0/2688684997 learned_addr learned my addr 172.21.15.50:0/2688684997 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:50.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.223+0000 7f4ae1a00640 1 --2- 172.21.15.50:0/2688684997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4adc109140 0x7f4adc19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:50.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.224+0000 7f4ae1000640 1 -- 172.21.15.50:0/2688684997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4adc109140 msgr2=0x7f4adc19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:50.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.224+0000 7f4ae1000640 1 --2- 172.21.15.50:0/2688684997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4adc109140 0x7f4adc19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:50.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.224+0000 7f4ae1000640 1 -- 172.21.15.50:0/2688684997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4adc1049c0 msgr2=0x7f4adc19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:50.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.224+0000 7f4ae1000640 1 --2- 172.21.15.50:0/2688684997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4adc1049c0 0x7f4adc19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:50.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.224+0000 7f4ae1000640 1 -- 172.21.15.50:0/2688684997 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc19f660 con 0x7f4adc104010 2024-09-10T10:08:50.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.224+0000 7f4ae1000640 1 --2- 172.21.15.50:0/2688684997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4adc104010 0x7f4adc19a6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000c970 tx=0x7f4ad000cd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.224+0000 7f4ad9600640 1 -- 172.21.15.50:0/2688684997 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0007bb0 con 0x7f4adc104010 2024-09-10T10:08:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.224+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2688684997 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4adc19f950 con 0x7f4adc104010 2024-09-10T10:08:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.224+0000 7f4ad9600640 1 -- 172.21.15.50:0/2688684997 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ad0007d50 con 0x7f4adc104010 2024-09-10T10:08:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.224+0000 7f4ad9600640 1 -- 172.21.15.50:0/2688684997 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000f450 con 0x7f4adc104010 2024-09-10T10:08:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.225+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2688684997 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4adc1a7230 con 0x7f4adc104010 2024-09-10T10:08:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.226+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2688684997 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4adc1043f0 con 0x7f4adc104010 2024-09-10T10:08:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.228+0000 7f4ad9600640 1 -- 172.21.15.50:0/2688684997 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4ad0004f40 con 0x7f4adc104010 2024-09-10T10:08:50.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.229+0000 7f4ad9600640 1 --2- 172.21.15.50:0/2688684997 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4ac40a2b80 0x7f4ac40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:50.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.229+0000 7f4ad9600640 1 -- 172.21.15.50:0/2688684997 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f4ad00cefb0 con 0x7f4adc104010 2024-09-10T10:08:50.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.229+0000 7f4adbe00640 1 --2- 172.21.15.50:0/2688684997 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4ac40a2b80 0x7f4ac40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:50.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.230+0000 7f4adbe00640 1 --2- 172.21.15.50:0/2688684997 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4ac40a2b80 0x7f4ac40a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8000c00 tx=0x7f4ac8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:50.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.233+0000 7f4ad9600640 1 -- 172.21.15.50:0/2688684997 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ad0014030 con 0x7f4adc104010 2024-09-10T10:08:50.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.457+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2688684997 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4adc10c380 con 0x7f4adc104010 2024-09-10T10:08:50.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.458+0000 7f4ad9600640 1 -- 172.21.15.50:0/2688684997 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11839 (secure 0 0 0) 0x7f4ad00bb030 con 0x7f4adc104010 2024-09-10T10:08:50.459 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:08:50.459 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"btime":"2024-09-10T10:08:48:407675+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24521,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:08:48.367274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24560,"qdb_cluster":[24560]},"id":1}]} 2024-09-10T10:08:50.460 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 16 2024-09-10T10:08:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.460+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2688684997 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4ac40a2b80 msgr2=0x7f4ac40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.460+0000 7f4ae3a00640 1 --2- 172.21.15.50:0/2688684997 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4ac40a2b80 0x7f4ac40a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8000c00 tx=0x7f4ac8005b50 comp rx=0 tx=0).stop 2024-09-10T10:08:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.460+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2688684997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4adc104010 msgr2=0x7f4adc19a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:50.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.460+0000 7f4ae3a00640 1 --2- 172.21.15.50:0/2688684997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4adc104010 0x7f4adc19a6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000c970 tx=0x7f4ad000cd70 comp rx=0 tx=0).stop 2024-09-10T10:08:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.460+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2688684997 shutdown_connections 2024-09-10T10:08:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.460+0000 7f4ae3a00640 1 --2- 172.21.15.50:0/2688684997 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4ac40a2b80 0x7f4ac40a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.460+0000 7f4ae3a00640 1 --2- 172.21.15.50:0/2688684997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4adc109140 0x7f4adc19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.460+0000 7f4ae3a00640 1 --2- 172.21.15.50:0/2688684997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4adc1049c0 0x7f4adc19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.460+0000 7f4ae3a00640 1 --2- 172.21.15.50:0/2688684997 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4adc104010 0x7f4adc19a6b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.460+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2688684997 >> 172.21.15.50:0/2688684997 conn(0x7f4adc0ffa50 msgr2=0x7f4adc100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.460+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2688684997 shutdown_connections 2024-09-10T10:08:50.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:50.460+0000 7f4ae3a00640 1 -- 172.21.15.50:0/2688684997 wait complete. 2024-09-10T10:08:50.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:50 smithi050 ceph-mon[30354]: pgmap v316: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:50.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:50 smithi050 ceph-mon[30354]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T10:08:50.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:50 smithi050 ceph-mon[30354]: Cluster is now healthy 2024-09-10T10:08:50.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:50 smithi189 ceph-mon[34999]: pgmap v316: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:50.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:50 smithi189 ceph-mon[34999]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T10:08:50.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:50 smithi189 ceph-mon[34999]: Cluster is now healthy 2024-09-10T10:08:50.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:50 smithi084 ceph-mon[34812]: pgmap v316: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:50.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:50 smithi084 ceph-mon[34812]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-10T10:08:50.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:50 smithi084 ceph-mon[34812]: Cluster is now healthy 2024-09-10T10:08:51.404 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:08:51.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:51 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2688684997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:51.782 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:51.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:51 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2688684997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:51.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:51 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2688684997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.352+0000 7fdd46c00640 1 -- 172.21.15.50:0/2777525600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401049a0 msgr2=0x7fdd401089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.352+0000 7fdd46c00640 1 --2- 172.21.15.50:0/2777525600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401049a0 0x7fdd401089f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009900 tx=0x7fdd2802a410 comp rx=0 tx=0).stop 2024-09-10T10:08:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.352+0000 7fdd46c00640 1 -- 172.21.15.50:0/2777525600 shutdown_connections 2024-09-10T10:08:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.352+0000 7fdd46c00640 1 --2- 172.21.15.50:0/2777525600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd40109120 0x7fdd40110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.352+0000 7fdd46c00640 1 --2- 172.21.15.50:0/2777525600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401049a0 0x7fdd401089f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.352+0000 7fdd46c00640 1 --2- 172.21.15.50:0/2777525600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd40103ff0 0x7fdd401043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.352+0000 7fdd46c00640 1 -- 172.21.15.50:0/2777525600 >> 172.21.15.50:0/2777525600 conn(0x7fdd400ffa90 msgr2=0x7fdd40101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.353+0000 7fdd46c00640 1 -- 172.21.15.50:0/2777525600 shutdown_connections 2024-09-10T10:08:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.353+0000 7fdd46c00640 1 -- 172.21.15.50:0/2777525600 wait complete. 2024-09-10T10:08:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.353+0000 7fdd46c00640 1 Processor -- start 2024-09-10T10:08:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.354+0000 7fdd46c00640 1 -- start start 2024-09-10T10:08:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.354+0000 7fdd46c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd40103ff0 0x7fdd4019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.354+0000 7fdd46c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401049a0 0x7fdd4019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.354+0000 7fdd46c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd40109120 0x7fdd4019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.354+0000 7fdd46c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd40114170 con 0x7fdd401049a0 2024-09-10T10:08:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.354+0000 7fdd46c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdd40113ff0 con 0x7fdd40109120 2024-09-10T10:08:52.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.354+0000 7fdd46c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd401142f0 con 0x7fdd40103ff0 2024-09-10T10:08:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.354+0000 7fdd37400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401049a0 0x7fdd4019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.354+0000 7fdd37400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401049a0 0x7fdd4019ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60736/0 (socket says 172.21.15.50:60736) 2024-09-10T10:08:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.354+0000 7fdd37400640 1 -- 172.21.15.50:0/1296469655 learned_addr learned my addr 172.21.15.50:0/1296469655 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.354+0000 7fdd44c00640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd40109120 0x7fdd4019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.354+0000 7fdd3fe00640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd40103ff0 0x7fdd4019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.355+0000 7fdd37400640 1 -- 172.21.15.50:0/1296469655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd40103ff0 msgr2=0x7fdd4019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.355+0000 7fdd37400640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd40103ff0 0x7fdd4019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.355+0000 7fdd37400640 1 -- 172.21.15.50:0/1296469655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd40109120 msgr2=0x7fdd4019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.355+0000 7fdd37400640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd40109120 0x7fdd4019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.355+0000 7fdd37400640 1 -- 172.21.15.50:0/1296469655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4019f600 con 0x7fdd401049a0 2024-09-10T10:08:52.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.355+0000 7fdd3fe00640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd40103ff0 0x7fdd4019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:08:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.355+0000 7fdd37400640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401049a0 0x7fdd4019ab90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdd28004770 tx=0x7fdd28003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.355+0000 7fdd3d600640 1 -- 172.21.15.50:0/1296469655 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2803f070 con 0x7fdd401049a0 2024-09-10T10:08:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.355+0000 7fdd3d600640 1 -- 172.21.15.50:0/1296469655 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd28031ca0 con 0x7fdd401049a0 2024-09-10T10:08:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.355+0000 7fdd3d600640 1 -- 172.21.15.50:0/1296469655 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28035030 con 0x7fdd401049a0 2024-09-10T10:08:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.355+0000 7fdd46c00640 1 -- 172.21.15.50:0/1296469655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4019f890 con 0x7fdd401049a0 2024-09-10T10:08:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.355+0000 7fdd46c00640 1 -- 172.21.15.50:0/1296469655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd401a71d0 con 0x7fdd401049a0 2024-09-10T10:08:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.357+0000 7fdd46c00640 1 -- 172.21.15.50:0/1296469655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd401043d0 con 0x7fdd401049a0 2024-09-10T10:08:52.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.359+0000 7fdd3d600640 1 -- 172.21.15.50:0/1296469655 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdd28042070 con 0x7fdd401049a0 2024-09-10T10:08:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.360+0000 7fdd3d600640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdd240a2c00 0x7fdd240a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:52.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.360+0000 7fdd3d600640 1 -- 172.21.15.50:0/1296469655 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7fdd280efa30 con 0x7fdd401049a0 2024-09-10T10:08:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.360+0000 7fdd3fe00640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdd240a2c00 0x7fdd240a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.361+0000 7fdd3fe00640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdd240a2c00 0x7fdd240a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd300058c0 tx=0x7fdd30005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:52.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.364+0000 7fdd3d600640 1 -- 172.21.15.50:0/1296469655 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd280bc6f0 con 0x7fdd401049a0 2024-09-10T10:08:52.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.553+0000 7fdd46c00640 1 -- 172.21.15.50:0/1296469655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd4010bdd0 con 0x7fdd401049a0 2024-09-10T10:08:52.555 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:52 smithi050 ceph-mon[30354]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.555+0000 7fdd3d600640 1 -- 172.21.15.50:0/1296469655 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24154 (secure 0 0 0) 0x7fdd280bbff0 con 0x7fdd401049a0 2024-09-10T10:08:52.557 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:08:52.557 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":91,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:08:48.367115+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:08:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.558+0000 7fdd46c00640 1 -- 172.21.15.50:0/1296469655 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdd240a2c00 msgr2=0x7fdd240a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.558+0000 7fdd46c00640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdd240a2c00 0x7fdd240a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd300058c0 tx=0x7fdd30005850 comp rx=0 tx=0).stop 2024-09-10T10:08:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.558+0000 7fdd46c00640 1 -- 172.21.15.50:0/1296469655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401049a0 msgr2=0x7fdd4019ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.558+0000 7fdd46c00640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401049a0 0x7fdd4019ab90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdd28004770 tx=0x7fdd28003c10 comp rx=0 tx=0).stop 2024-09-10T10:08:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.558+0000 7fdd46c00640 1 -- 172.21.15.50:0/1296469655 shutdown_connections 2024-09-10T10:08:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.558+0000 7fdd46c00640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdd240a2c00 0x7fdd240a50c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.558+0000 7fdd46c00640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd40109120 0x7fdd4019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.558+0000 7fdd46c00640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd401049a0 0x7fdd4019ab90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.558+0000 7fdd46c00640 1 --2- 172.21.15.50:0/1296469655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd40103ff0 0x7fdd4019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.558+0000 7fdd46c00640 1 -- 172.21.15.50:0/1296469655 >> 172.21.15.50:0/1296469655 conn(0x7fdd400ffa90 msgr2=0x7fdd40100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.559+0000 7fdd46c00640 1 -- 172.21.15.50:0/1296469655 shutdown_connections 2024-09-10T10:08:52.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:52.559+0000 7fdd46c00640 1 -- 172.21.15.50:0/1296469655 wait complete. 2024-09-10T10:08:52.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:52 smithi189 ceph-mon[34999]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:52.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:52 smithi084 ceph-mon[34812]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:53.427 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:08:53.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:53 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1296469655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:08:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:53.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:53 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1296469655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:08:53.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:53 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1296469655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:08:54.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.383+0000 7fe683200640 1 -- 172.21.15.50:0/767046162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684109090 msgr2=0x7fe684110c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.383+0000 7fe683200640 1 --2- 172.21.15.50:0/767046162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684109090 0x7fe684110c10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe67c009ca0 tx=0x7fe67c02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.383+0000 7fe683200640 1 -- 172.21.15.50:0/767046162 shutdown_connections 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.383+0000 7fe683200640 1 --2- 172.21.15.50:0/767046162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684109090 0x7fe684110c10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.383+0000 7fe683200640 1 --2- 172.21.15.50:0/767046162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe684104800 0x7fe684108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.383+0000 7fe683200640 1 --2- 172.21.15.50:0/767046162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe684103e50 0x7fe684104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.383+0000 7fe683200640 1 -- 172.21.15.50:0/767046162 >> 172.21.15.50:0/767046162 conn(0x7fe6840ff8b0 msgr2=0x7fe684101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.383+0000 7fe683200640 1 -- 172.21.15.50:0/767046162 shutdown_connections 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.383+0000 7fe683200640 1 -- 172.21.15.50:0/767046162 wait complete. 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.384+0000 7fe683200640 1 Processor -- start 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.384+0000 7fe683200640 1 -- start start 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.384+0000 7fe683200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe684103e50 0x7fe68419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.384+0000 7fe683200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe684104800 0x7fe68419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.384+0000 7fe683200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684109090 0x7fe68419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:54.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.384+0000 7fe683200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe684114110 con 0x7fe684109090 2024-09-10T10:08:54.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.384+0000 7fe683200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe684113f90 con 0x7fe684103e50 2024-09-10T10:08:54.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.384+0000 7fe683200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe684114290 con 0x7fe684104800 2024-09-10T10:08:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.385+0000 7fe682800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684109090 0x7fe68419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.385+0000 7fe681e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe684103e50 0x7fe68419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.385+0000 7fe681e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe684103e50 0x7fe68419a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:52166/0 (socket says 172.21.15.50:52166) 2024-09-10T10:08:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.385+0000 7fe681e00640 1 -- 172.21.15.50:0/3861173769 learned_addr learned my addr 172.21.15.50:0/3861173769 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.385+0000 7fe682800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684109090 0x7fe68419ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60750/0 (socket says 172.21.15.50:60750) 2024-09-10T10:08:54.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.385+0000 7fe67be00640 1 --2- 172.21.15.50:0/3861173769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe684104800 0x7fe68419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.385+0000 7fe681e00640 1 -- 172.21.15.50:0/3861173769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe684104800 msgr2=0x7fe68419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.385+0000 7fe681e00640 1 --2- 172.21.15.50:0/3861173769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe684104800 0x7fe68419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.385+0000 7fe681e00640 1 -- 172.21.15.50:0/3861173769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684109090 msgr2=0x7fe68419ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.385+0000 7fe681e00640 1 --2- 172.21.15.50:0/3861173769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684109090 0x7fe68419ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.385+0000 7fe681e00640 1 -- 172.21.15.50:0/3861173769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68419f520 con 0x7fe684103e50 2024-09-10T10:08:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.385+0000 7fe681e00640 1 --2- 172.21.15.50:0/3861173769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe684103e50 0x7fe68419a570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe67400e9f0 tx=0x7fe67400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.386+0000 7fe67aa00640 1 -- 172.21.15.50:0/3861173769 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67400cd80 con 0x7fe684103e50 2024-09-10T10:08:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.386+0000 7fe67aa00640 1 -- 172.21.15.50:0/3861173769 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe674010910 con 0x7fe684103e50 2024-09-10T10:08:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.386+0000 7fe683200640 1 -- 172.21.15.50:0/3861173769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68419f810 con 0x7fe684103e50 2024-09-10T10:08:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.386+0000 7fe67aa00640 1 -- 172.21.15.50:0/3861173769 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674018990 con 0x7fe684103e50 2024-09-10T10:08:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.386+0000 7fe683200640 1 -- 172.21.15.50:0/3861173769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6841a70f0 con 0x7fe684103e50 2024-09-10T10:08:54.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.387+0000 7fe683200640 1 -- 172.21.15.50:0/3861173769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe684105330 con 0x7fe684103e50 2024-09-10T10:08:54.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.389+0000 7fe67aa00640 1 -- 172.21.15.50:0/3861173769 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe674010ac0 con 0x7fe684103e50 2024-09-10T10:08:54.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.390+0000 7fe67aa00640 1 --2- 172.21.15.50:0/3861173769 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6680a2c00 0x7fe6680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:54.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.390+0000 7fe67aa00640 1 -- 172.21.15.50:0/3861173769 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7fe6740cfa20 con 0x7fe684103e50 2024-09-10T10:08:54.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.390+0000 7fe67be00640 1 --2- 172.21.15.50:0/3861173769 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6680a2c00 0x7fe6680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:54.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.391+0000 7fe67be00640 1 --2- 172.21.15.50:0/3861173769 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6680a2c00 0x7fe6680a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe6840ffcd0 tx=0x7fe66c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:54.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.392+0000 7fe67aa00640 1 -- 172.21.15.50:0/3861173769 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe67409c6e0 con 0x7fe684103e50 2024-09-10T10:08:54.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.579+0000 7fe683200640 1 -- 172.21.15.50:0/3861173769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe68410c2d0 con 0x7fe684103e50 2024-09-10T10:08:54.581 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:54 smithi050 ceph-mon[30354]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:54.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.581+0000 7fe67aa00640 1 -- 172.21.15.50:0/3861173769 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24154 (secure 0 0 0) 0x7fe67409bfe0 con 0x7fe684103e50 2024-09-10T10:08:54.583 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:08:54.583 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":91,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:08:48.367115+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:08:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.584+0000 7fe683200640 1 -- 172.21.15.50:0/3861173769 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6680a2c00 msgr2=0x7fe6680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.584+0000 7fe683200640 1 --2- 172.21.15.50:0/3861173769 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6680a2c00 0x7fe6680a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe6840ffcd0 tx=0x7fe66c005f90 comp rx=0 tx=0).stop 2024-09-10T10:08:54.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.584+0000 7fe683200640 1 -- 172.21.15.50:0/3861173769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe684103e50 msgr2=0x7fe68419a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.584+0000 7fe683200640 1 --2- 172.21.15.50:0/3861173769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe684103e50 0x7fe68419a570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe67400e9f0 tx=0x7fe67400eeb0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.584+0000 7fe683200640 1 -- 172.21.15.50:0/3861173769 shutdown_connections 2024-09-10T10:08:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.584+0000 7fe683200640 1 --2- 172.21.15.50:0/3861173769 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6680a2c00 0x7fe6680a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.584+0000 7fe683200640 1 --2- 172.21.15.50:0/3861173769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe684109090 0x7fe68419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.584+0000 7fe683200640 1 --2- 172.21.15.50:0/3861173769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe684104800 0x7fe68419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.584+0000 7fe683200640 1 --2- 172.21.15.50:0/3861173769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe684103e50 0x7fe68419a570 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.584+0000 7fe683200640 1 -- 172.21.15.50:0/3861173769 >> 172.21.15.50:0/3861173769 conn(0x7fe6840ff8b0 msgr2=0x7fe684100ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:54.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.584+0000 7fe683200640 1 -- 172.21.15.50:0/3861173769 shutdown_connections 2024-09-10T10:08:54.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:54.584+0000 7fe683200640 1 -- 172.21.15.50:0/3861173769 wait complete. 2024-09-10T10:08:54.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:54 smithi189 ceph-mon[34999]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:54.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:54 smithi084 ceph-mon[34812]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:55.441 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:08:55.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:55 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3861173769' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:08:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:55.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:55 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3861173769' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:08:55.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:55 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3861173769' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:08:56.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.371+0000 7fd7f0600640 1 -- 172.21.15.50:0/3662629070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e8106f10 msgr2=0x7fd7e810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:56.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.371+0000 7fd7f0600640 1 --2- 172.21.15.50:0/3662629070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e8106f10 0x7fd7e810ea90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009ca0 tx=0x7fd7e002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:08:56.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.371+0000 7fd7f0600640 1 -- 172.21.15.50:0/3662629070 shutdown_connections 2024-09-10T10:08:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.371+0000 7fd7f0600640 1 --2- 172.21.15.50:0/3662629070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e8106f10 0x7fd7e810ea90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.371+0000 7fd7f0600640 1 --2- 172.21.15.50:0/3662629070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e8102790 0x7fd7e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.371+0000 7fd7f0600640 1 --2- 172.21.15.50:0/3662629070 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7e8101de0 0x7fd7e81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.371+0000 7fd7f0600640 1 -- 172.21.15.50:0/3662629070 >> 172.21.15.50:0/3662629070 conn(0x7fd7e80fd8c0 msgr2=0x7fd7e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.371+0000 7fd7f0600640 1 -- 172.21.15.50:0/3662629070 shutdown_connections 2024-09-10T10:08:56.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.371+0000 7fd7f0600640 1 -- 172.21.15.50:0/3662629070 wait complete. 2024-09-10T10:08:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.372+0000 7fd7f0600640 1 Processor -- start 2024-09-10T10:08:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.372+0000 7fd7f0600640 1 -- start start 2024-09-10T10:08:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.372+0000 7fd7f0600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e8101de0 0x7fd7e819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.372+0000 7fd7f0600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7e8102790 0x7fd7e819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.372+0000 7fd7f0600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e8106f10 0x7fd7e819eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7f0600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e8111f70 con 0x7fd7e8106f10 2024-09-10T10:08:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7f0600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e8111df0 con 0x7fd7e8101de0 2024-09-10T10:08:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7f0600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e81120f0 con 0x7fd7e8102790 2024-09-10T10:08:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7edc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e8101de0 0x7fd7e819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7edc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e8101de0 0x7fd7e819a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:52188/0 (socket says 172.21.15.50:52188) 2024-09-10T10:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7edc00640 1 -- 172.21.15.50:0/1202659342 learned_addr learned my addr 172.21.15.50:0/1202659342 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7ed200640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7e8102790 0x7fd7e819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7ee600640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e8106f10 0x7fd7e819eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7edc00640 1 -- 172.21.15.50:0/1202659342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7e8102790 msgr2=0x7fd7e819ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7edc00640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7e8102790 0x7fd7e819ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7edc00640 1 -- 172.21.15.50:0/1202659342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e8106f10 msgr2=0x7fd7e819eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7edc00640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e8106f10 0x7fd7e819eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7edc00640 1 -- 172.21.15.50:0/1202659342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e819f580 con 0x7fd7e8101de0 2024-09-10T10:08:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.373+0000 7fd7ed200640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7e8102790 0x7fd7e819ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:08:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.374+0000 7fd7edc00640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e8101de0 0x7fd7e819a5d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc00e9f0 tx=0x7fd7dc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.374+0000 7fd7e6000640 1 -- 172.21.15.50:0/1202659342 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc00cd80 con 0x7fd7e8101de0 2024-09-10T10:08:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.374+0000 7fd7e6000640 1 -- 172.21.15.50:0/1202659342 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7dc005500 con 0x7fd7e8101de0 2024-09-10T10:08:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.374+0000 7fd7f0600640 1 -- 172.21.15.50:0/1202659342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e819f870 con 0x7fd7e8101de0 2024-09-10T10:08:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.374+0000 7fd7e6000640 1 -- 172.21.15.50:0/1202659342 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc010690 con 0x7fd7e8101de0 2024-09-10T10:08:56.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.374+0000 7fd7f0600640 1 -- 172.21.15.50:0/1202659342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e81a7150 con 0x7fd7e8101de0 2024-09-10T10:08:56.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.375+0000 7fd7f0600640 1 -- 172.21.15.50:0/1202659342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e81021c0 con 0x7fd7e8101de0 2024-09-10T10:08:56.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.377+0000 7fd7e6000640 1 -- 172.21.15.50:0/1202659342 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd7dc0046c0 con 0x7fd7e8101de0 2024-09-10T10:08:56.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.378+0000 7fd7e6000640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7d00a2c00 0x7fd7d00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.378+0000 7fd7e6000640 1 -- 172.21.15.50:0/1202659342 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7fd7dc0cf710 con 0x7fd7e8101de0 2024-09-10T10:08:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.379+0000 7fd7ed200640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7d00a2c00 0x7fd7d00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:56.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.379+0000 7fd7ed200640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7d00a2c00 0x7fd7d00a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd7e810eeb0 tx=0x7fd7d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:56.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.381+0000 7fd7e6000640 1 -- 172.21.15.50:0/1202659342 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7dc09c3d0 con 0x7fd7e8101de0 2024-09-10T10:08:56.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.602+0000 7fd7f0600640 1 -- 172.21.15.50:0/1202659342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7e819b930 con 0x7fd7e8101de0 2024-09-10T10:08:56.604 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:56 smithi050 ceph-mon[30354]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.603+0000 7fd7e6000640 1 -- 172.21.15.50:0/1202659342 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11839 (secure 0 0 0) 0x7fd7dc09bcd0 con 0x7fd7e8101de0 2024-09-10T10:08:56.605 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:08:56.605 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"btime":"2024-09-10T10:08:48:407675+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24521,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:08:48.367274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24560,"qdb_cluster":[24560]},"id":1}]} 2024-09-10T10:08:56.605 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 16 2024-09-10T10:08:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.605+0000 7fd7f0600640 1 -- 172.21.15.50:0/1202659342 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7d00a2c00 msgr2=0x7fd7d00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.605+0000 7fd7f0600640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7d00a2c00 0x7fd7d00a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd7e810eeb0 tx=0x7fd7d4005f90 comp rx=0 tx=0).stop 2024-09-10T10:08:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.605+0000 7fd7f0600640 1 -- 172.21.15.50:0/1202659342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e8101de0 msgr2=0x7fd7e819a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.605+0000 7fd7f0600640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e8101de0 0x7fd7e819a5d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc00e9f0 tx=0x7fd7dc00edf0 comp rx=0 tx=0).stop 2024-09-10T10:08:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.606+0000 7fd7f0600640 1 -- 172.21.15.50:0/1202659342 shutdown_connections 2024-09-10T10:08:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.606+0000 7fd7f0600640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7d00a2c00 0x7fd7d00a50c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.606+0000 7fd7f0600640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e8106f10 0x7fd7e819eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.606+0000 7fd7f0600640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7e8102790 0x7fd7e819ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.606+0000 7fd7f0600640 1 --2- 172.21.15.50:0/1202659342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e8101de0 0x7fd7e819a5d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.606+0000 7fd7f0600640 1 -- 172.21.15.50:0/1202659342 >> 172.21.15.50:0/1202659342 conn(0x7fd7e80fd8c0 msgr2=0x7fd7e80ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.606+0000 7fd7f0600640 1 -- 172.21.15.50:0/1202659342 shutdown_connections 2024-09-10T10:08:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:56.606+0000 7fd7f0600640 1 -- 172.21.15.50:0/1202659342 wait complete. 2024-09-10T10:08:56.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:56 smithi189 ceph-mon[34999]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:56.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:56 smithi084 ceph-mon[34812]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:57.366 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:08:57.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:57 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1202659342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:57.744 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:57.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:57 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1202659342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:57.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:57 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1202659342' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:08:58.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.308+0000 7f0e8f800640 1 -- 172.21.15.50:0/3005094294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e88102790 msgr2=0x7f0e881067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:58.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.308+0000 7f0e8f800640 1 --2- 172.21.15.50:0/3005094294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e88102790 0x7f0e881067e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009900 tx=0x7f0e7002a410 comp rx=0 tx=0).stop 2024-09-10T10:08:58.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.308+0000 7f0e8f800640 1 -- 172.21.15.50:0/3005094294 shutdown_connections 2024-09-10T10:08:58.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.308+0000 7f0e8f800640 1 --2- 172.21.15.50:0/3005094294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e88106f10 0x7f0e8810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:58.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.308+0000 7f0e8f800640 1 --2- 172.21.15.50:0/3005094294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e88102790 0x7f0e881067e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:58.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.308+0000 7f0e8f800640 1 --2- 172.21.15.50:0/3005094294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e88101de0 0x7f0e881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:58.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.308+0000 7f0e8f800640 1 -- 172.21.15.50:0/3005094294 >> 172.21.15.50:0/3005094294 conn(0x7f0e880fd8c0 msgr2=0x7f0e880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:58.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.308+0000 7f0e8f800640 1 -- 172.21.15.50:0/3005094294 shutdown_connections 2024-09-10T10:08:58.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.309+0000 7f0e8f800640 1 -- 172.21.15.50:0/3005094294 wait complete. 2024-09-10T10:08:58.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.309+0000 7f0e8f800640 1 Processor -- start 2024-09-10T10:08:58.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.310+0000 7f0e8f800640 1 -- start start 2024-09-10T10:08:58.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.310+0000 7f0e8f800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e88101de0 0x7f0e8819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:58.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.310+0000 7f0e8f800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e88102790 0x7f0e8819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:58.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.310+0000 7f0e8f800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e88106f10 0x7f0e8819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:58.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.310+0000 7f0e8f800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0e88111f70 con 0x7f0e88106f10 2024-09-10T10:08:58.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.310+0000 7f0e8f800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0e88111df0 con 0x7f0e88101de0 2024-09-10T10:08:58.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.310+0000 7f0e8f800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0e881120f0 con 0x7f0e88102790 2024-09-10T10:08:58.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.310+0000 7f0e7fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e88102790 0x7f0e8819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:58.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.310+0000 7f0e7fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e88102790 0x7f0e8819ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:43396/0 (socket says 172.21.15.50:43396) 2024-09-10T10:08:58.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.310+0000 7f0e7fe00640 1 -- 172.21.15.50:0/2546796401 learned_addr learned my addr 172.21.15.50:0/2546796401 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:08:58.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.310+0000 7f0e8d800640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e88106f10 0x7f0e8819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:58.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.310+0000 7f0e8ce00640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e88101de0 0x7f0e8819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:58.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.311+0000 7f0e7fe00640 1 -- 172.21.15.50:0/2546796401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e88101de0 msgr2=0x7f0e8819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:58.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.311+0000 7f0e7fe00640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e88101de0 0x7f0e8819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:58.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.311+0000 7f0e7fe00640 1 -- 172.21.15.50:0/2546796401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e88106f10 msgr2=0x7f0e8819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:58.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.311+0000 7f0e7fe00640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e88106f10 0x7f0e8819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:58.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.311+0000 7f0e7fe00640 1 -- 172.21.15.50:0/2546796401 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8819f600 con 0x7f0e88102790 2024-09-10T10:08:58.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.311+0000 7f0e8d800640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e88106f10 0x7f0e8819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:08:58.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.311+0000 7f0e7fe00640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e88102790 0x7f0e8819ab90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e70006010 tx=0x7f0e70004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:58.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.312+0000 7f0e86000640 1 -- 172.21.15.50:0/2546796401 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7003f030 con 0x7f0e88102790 2024-09-10T10:08:58.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.312+0000 7f0e8f800640 1 -- 172.21.15.50:0/2546796401 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e8819f890 con 0x7f0e88102790 2024-09-10T10:08:58.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.312+0000 7f0e86000640 1 -- 172.21.15.50:0/2546796401 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e70004440 con 0x7f0e88102790 2024-09-10T10:08:58.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.312+0000 7f0e86000640 1 -- 172.21.15.50:0/2546796401 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e70035070 con 0x7f0e88102790 2024-09-10T10:08:58.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.312+0000 7f0e8f800640 1 -- 172.21.15.50:0/2546796401 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e881a71d0 con 0x7f0e88102790 2024-09-10T10:08:58.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.313+0000 7f0e8f800640 1 -- 172.21.15.50:0/2546796401 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e881021c0 con 0x7f0e88102790 2024-09-10T10:08:58.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.315+0000 7f0e86000640 1 -- 172.21.15.50:0/2546796401 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0e70042030 con 0x7f0e88102790 2024-09-10T10:08:58.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.316+0000 7f0e86000640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0e6c0a2b80 0x7f0e6c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:08:58.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.316+0000 7f0e86000640 1 -- 172.21.15.50:0/2546796401 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f0e700ef860 con 0x7f0e88102790 2024-09-10T10:08:58.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.317+0000 7f0e8ce00640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0e6c0a2b80 0x7f0e6c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:08:58.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.317+0000 7f0e8ce00640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0e6c0a2b80 0x7f0e6c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009bd0 tx=0x7f0e78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:08:58.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.318+0000 7f0e86000640 1 -- 172.21.15.50:0/2546796401 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e700bbed0 con 0x7f0e88102790 2024-09-10T10:08:58.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:58 smithi050 ceph-mon[30354]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:58.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.510+0000 7f0e8f800640 1 -- 172.21.15.50:0/2546796401 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e881a73a0 con 0x7f0e88102790 2024-09-10T10:08:58.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.511+0000 7f0e86000640 1 -- 172.21.15.50:0/2546796401 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24154 (secure 0 0 0) 0x7f0e700c01d0 con 0x7f0e88102790 2024-09-10T10:08:58.513 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:08:58.513 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":91,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:08:48.367115+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:08:58.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.514+0000 7f0e8f800640 1 -- 172.21.15.50:0/2546796401 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0e6c0a2b80 msgr2=0x7f0e6c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:58.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.514+0000 7f0e8f800640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0e6c0a2b80 0x7f0e6c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009bd0 tx=0x7f0e78005f90 comp rx=0 tx=0).stop 2024-09-10T10:08:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.514+0000 7f0e8f800640 1 -- 172.21.15.50:0/2546796401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e88102790 msgr2=0x7f0e8819ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:08:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.514+0000 7f0e8f800640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e88102790 0x7f0e8819ab90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e70006010 tx=0x7f0e70004040 comp rx=0 tx=0).stop 2024-09-10T10:08:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.514+0000 7f0e8f800640 1 -- 172.21.15.50:0/2546796401 shutdown_connections 2024-09-10T10:08:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.514+0000 7f0e8f800640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0e6c0a2b80 0x7f0e6c0a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.514+0000 7f0e8f800640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e88106f10 0x7f0e8819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.514+0000 7f0e8f800640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e88102790 0x7f0e8819ab90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.514+0000 7f0e8f800640 1 --2- 172.21.15.50:0/2546796401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e88101de0 0x7f0e8819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:08:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.514+0000 7f0e8f800640 1 -- 172.21.15.50:0/2546796401 >> 172.21.15.50:0/2546796401 conn(0x7f0e880fd8c0 msgr2=0x7f0e880feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:08:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.514+0000 7f0e8f800640 1 -- 172.21.15.50:0/2546796401 shutdown_connections 2024-09-10T10:08:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:08:58.514+0000 7f0e8f800640 1 -- 172.21.15.50:0/2546796401 wait complete. 2024-09-10T10:08:58.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:58 smithi189 ceph-mon[34999]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:58.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:58 smithi084 ceph-mon[34812]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:08:59.217 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T10:08:36.316040+0000', 'modified': '2024-09-10T10:08:48.367274+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24560}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.84:6839/4235486934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6838', 'nonce': 4235486934}, {'type': 'v1', 'addr': '172.21.15.84:6839', 'nonce': 4235486934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24560, 'qdb_cluster': [24560]} 2024-09-10T10:08:59.217 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T10:08:59.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T10:08:59.608 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:08:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:59 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2546796401' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:08:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-10T10:08:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-10T10:08:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 7]}]: dispatch 2024-09-10T10:08:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-10T10:08:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-10T10:08:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]: dispatch 2024-09-10T10:08:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-10T10:08:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-09-10T10:08:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 10]}]: dispatch 2024-09-10T10:08:59.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:08:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-10T10:08:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:59 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2546796401' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:08:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-10T10:08:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-10T10:08:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 7]}]: dispatch 2024-09-10T10:08:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-10T10:08:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-10T10:08:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]: dispatch 2024-09-10T10:08:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-10T10:08:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-09-10T10:08:59.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 10]}]: dispatch 2024-09-10T10:08:59.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:08:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-10T10:08:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:59 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2546796401' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:08:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-10T10:08:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-10T10:08:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 7]}]: dispatch 2024-09-10T10:08:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-10T10:08:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-10T10:08:59.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]: dispatch 2024-09-10T10:08:59.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-10T10:08:59.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-09-10T10:08:59.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 10]}]: dispatch 2024-09-10T10:08:59.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:08:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-10T10:09:00.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.168+0000 7fd51b400640 1 -- 172.21.15.50:0/2269992150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5141049a0 msgr2=0x7fd5141089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:00.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.168+0000 7fd51b400640 1 --2- 172.21.15.50:0/2269992150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5141049a0 0x7fd5141089f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd500009900 tx=0x7fd50002a410 comp rx=0 tx=0).stop 2024-09-10T10:09:00.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.168+0000 7fd51b400640 1 -- 172.21.15.50:0/2269992150 shutdown_connections 2024-09-10T10:09:00.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.168+0000 7fd51b400640 1 --2- 172.21.15.50:0/2269992150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd514109120 0x7fd514110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.168+0000 7fd51b400640 1 --2- 172.21.15.50:0/2269992150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5141049a0 0x7fd5141089f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.168+0000 7fd51b400640 1 --2- 172.21.15.50:0/2269992150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd514103ff0 0x7fd5141043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.168+0000 7fd51b400640 1 -- 172.21.15.50:0/2269992150 >> 172.21.15.50:0/2269992150 conn(0x7fd5140ffa90 msgr2=0x7fd514101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:00.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.168+0000 7fd51b400640 1 -- 172.21.15.50:0/2269992150 shutdown_connections 2024-09-10T10:09:00.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.168+0000 7fd51b400640 1 -- 172.21.15.50:0/2269992150 wait complete. 2024-09-10T10:09:00.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.169+0000 7fd51b400640 1 Processor -- start 2024-09-10T10:09:00.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.169+0000 7fd51b400640 1 -- start start 2024-09-10T10:09:00.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.169+0000 7fd51b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd514103ff0 0x7fd51419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.169+0000 7fd51b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5141049a0 0x7fd51419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.169+0000 7fd51b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd514109120 0x7fd51419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.169+0000 7fd51b400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd514114140 con 0x7fd5141049a0 2024-09-10T10:09:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.169+0000 7fd51b400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd514113fc0 con 0x7fd514109120 2024-09-10T10:09:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.169+0000 7fd51b400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd5141142c0 con 0x7fd514103ff0 2024-09-10T10:09:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.170+0000 7fd513e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5141049a0 0x7fd51419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.170+0000 7fd513e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5141049a0 0x7fd51419ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58422/0 (socket says 172.21.15.50:58422) 2024-09-10T10:09:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.170+0000 7fd513e00640 1 -- 172.21.15.50:0/697702353 learned_addr learned my addr 172.21.15.50:0/697702353 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.170+0000 7fd518a00640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd514103ff0 0x7fd51419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.170+0000 7fd519400640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd514109120 0x7fd51419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.170+0000 7fd513e00640 1 -- 172.21.15.50:0/697702353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd514103ff0 msgr2=0x7fd51419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.170+0000 7fd513e00640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd514103ff0 0x7fd51419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.170+0000 7fd513e00640 1 -- 172.21.15.50:0/697702353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd514109120 msgr2=0x7fd51419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:00.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.170+0000 7fd513e00640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd514109120 0x7fd51419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.170+0000 7fd513e00640 1 -- 172.21.15.50:0/697702353 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51419f5d0 con 0x7fd5141049a0 2024-09-10T10:09:00.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.170+0000 7fd519400640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd514109120 0x7fd51419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:00.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.171+0000 7fd513e00640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5141049a0 0x7fd51419ab60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd500006010 tx=0x7fd500004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:00.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.171+0000 7fd511600640 1 -- 172.21.15.50:0/697702353 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50003f030 con 0x7fd5141049a0 2024-09-10T10:09:00.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.171+0000 7fd511600640 1 -- 172.21.15.50:0/697702353 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd500004440 con 0x7fd5141049a0 2024-09-10T10:09:00.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.171+0000 7fd51b400640 1 -- 172.21.15.50:0/697702353 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd51419f860 con 0x7fd5141049a0 2024-09-10T10:09:00.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.171+0000 7fd511600640 1 -- 172.21.15.50:0/697702353 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500035070 con 0x7fd5141049a0 2024-09-10T10:09:00.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.171+0000 7fd51b400640 1 -- 172.21.15.50:0/697702353 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5141a71a0 con 0x7fd5141049a0 2024-09-10T10:09:00.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.174+0000 7fd51d9fd740 1 Processor -- start 2024-09-10T10:09:00.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.174+0000 7fd511600640 1 -- 172.21.15.50:0/697702353 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd500042030 con 0x7fd5141049a0 2024-09-10T10:09:00.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.174+0000 7fd51d9fd740 1 -- start start 2024-09-10T10:09:00.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.175+0000 7fd51d9fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916330 0x555e73916710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.175+0000 7fd51d9fd740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916c50 0x555e73920fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.175+0000 7fd51d9fd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73921510 0x555e73923900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.175+0000 7fd51d9fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555e7387c0b0 con 0x555e73916330 2024-09-10T10:09:00.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.175+0000 7fd51d9fd740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555e73823ab0 con 0x555e73916c50 2024-09-10T10:09:00.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.175+0000 7fd51d9fd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555e73878070 con 0x555e73921510 2024-09-10T10:09:00.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.175+0000 7fd519400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916330 0x555e73916710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.175+0000 7fd518a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916c50 0x555e73920fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.175+0000 7fd513e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73921510 0x555e73923900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.175+0000 7fd519400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916330 0x555e73916710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58436/0 (socket says 172.21.15.50:58436) 2024-09-10T10:09:00.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.175+0000 7fd519400640 1 -- 172.21.15.50:0/326117527 learned_addr learned my addr 172.21.15.50:0/326117527 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.176+0000 7fd518a00640 1 -- 172.21.15.50:0/326117527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73921510 msgr2=0x555e73923900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:09:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.176+0000 7fd518a00640 1 --2- 172.21.15.50:0/326117527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73921510 0x555e73923900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.176+0000 7fd518a00640 1 -- 172.21.15.50:0/326117527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916330 msgr2=0x555e73916710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:09:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.176+0000 7fd518a00640 1 --2- 172.21.15.50:0/326117527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916330 0x555e73916710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.176+0000 7fd518a00640 1 -- 172.21.15.50:0/326117527 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e738304a0 con 0x555e73916c50 2024-09-10T10:09:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.176+0000 7fd518a00640 1 --2- 172.21.15.50:0/326117527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916c50 0x555e73920fd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd508009c00 tx=0x7fd508011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b197a66df007439 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.176+0000 7fd505c00640 1 -- 172.21.15.50:0/326117527 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508004230 con 0x555e73916c50 2024-09-10T10:09:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.176+0000 7fd505c00640 1 -- 172.21.15.50:0/326117527 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5080043d0 con 0x555e73916c50 2024-09-10T10:09:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.176+0000 7fd505c00640 1 -- 172.21.15.50:0/326117527 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508004d70 con 0x555e73916c50 2024-09-10T10:09:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.177+0000 7fd511600640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd4fc0a2c00 0x7fd4fc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.177+0000 7fd511600640 1 -- 172.21.15.50:0/697702353 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd5000ef6d0 con 0x7fd5141049a0 2024-09-10T10:09:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.177+0000 7fd51d9fd740 1 -- 172.21.15.50:0/326117527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916c50 msgr2=0x555e73920fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.177+0000 7fd519400640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd4fc0a2c00 0x7fd4fc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.177+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/326117527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916c50 0x555e73920fd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd508009c00 tx=0x7fd508011810 comp rx=0 tx=0).stop 2024-09-10T10:09:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.177+0000 7fd51d9fd740 1 -- 172.21.15.50:0/326117527 shutdown_connections 2024-09-10T10:09:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.177+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/326117527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73921510 0x555e73923900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.177+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/326117527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916c50 0x555e73920fd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.177+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/326117527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916330 0x555e73916710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.177+0000 7fd51d9fd740 1 -- 172.21.15.50:0/326117527 >> 172.21.15.50:0/326117527 conn(0x555e739128c0 msgr2=0x555e73912ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.177+0000 7fd51d9fd740 1 -- 172.21.15.50:0/326117527 shutdown_connections 2024-09-10T10:09:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.177+0000 7fd51d9fd740 1 -- 172.21.15.50:0/326117527 wait complete. 2024-09-10T10:09:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.178+0000 7fd519400640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd4fc0a2c00 0x7fd4fc0a50c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009fd0 tx=0x7fd50c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.178+0000 7fd51d9fd740 1 -- start start 2024-09-10T10:09:00.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.178+0000 7fd51d9fd740 1 Processor -- start 2024-09-10T10:09:00.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd51d9fd740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916330 0x555e7391e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd51d9fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916c50 0x555e7391ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd51d9fd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73921510 0x555e7391efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd51d9fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555e73924060 con 0x555e73916c50 2024-09-10T10:09:00.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd51d9fd740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555e73804920 con 0x555e73916330 2024-09-10T10:09:00.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd51d9fd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555e739241e0 con 0x555e73921510 2024-09-10T10:09:00.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd51d9fd740 10 client.0 _ll_register_callbacks cb 0x555e738288a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:09:00.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd518a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916330 0x555e7391e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd518a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916330 0x555e7391e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:45334/0 (socket says 172.21.15.50:45334) 2024-09-10T10:09:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd518a00640 1 -- 172.21.15.50:0/3282751990 learned_addr learned my addr 172.21.15.50:0/3282751990 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd513e00640 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916c50 0x555e7391ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd519400640 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73921510 0x555e7391efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd518a00640 1 -- 172.21.15.50:0/3282751990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73921510 msgr2=0x555e7391efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:09:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd518a00640 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73921510 0x555e7391efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd518a00640 1 -- 172.21.15.50:0/3282751990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916c50 msgr2=0x555e7391ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:09:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd518a00640 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916c50 0x555e7391ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd518a00640 1 -- 172.21.15.50:0/3282751990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e735ed2b0 con 0x555e73916330 2024-09-10T10:09:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd519400640 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73921510 0x555e7391efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:09:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.179+0000 7fd513e00640 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916c50 0x555e7391ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.180+0000 7fd518a00640 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916330 0x555e7391e530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd5080096e0 tx=0x7fd508019ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e90321e1f557fea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.180+0000 7fd4fa000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:09:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.180+0000 7fd4fa000640 1 -- 172.21.15.50:0/3282751990 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508028020 con 0x555e73916330 2024-09-10T10:09:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.180+0000 7fd51d9fd740 1 -- 172.21.15.50:0/3282751990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5080043d0 con 0x555e73916330 2024-09-10T10:09:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.180+0000 7fd4fa000640 1 -- 172.21.15.50:0/3282751990 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd508024620 con 0x555e73916330 2024-09-10T10:09:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.180+0000 7fd4fa000640 1 -- 172.21.15.50:0/3282751990 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fd508033050 con 0x555e73916330 2024-09-10T10:09:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.180+0000 7fd51d9fd740 10 client.24656 fetch_fsmap learned FSMap version 16 2024-09-10T10:09:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.180+0000 7fd51d9fd740 1 -- 172.21.15.50:0/3282751990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x555e7392fe10 con 0x555e73916330 2024-09-10T10:09:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.180+0000 7fd4fa000640 1 -- 172.21.15.50:0/3282751990 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5080043d0 con 0x555e73916330 2024-09-10T10:09:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.181+0000 7fd4fa000640 1 -- 172.21.15.50:0/3282751990 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7fd508018070 con 0x555e73916330 2024-09-10T10:09:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.181+0000 7fd51d9fd740 10 client.24656 fetch_fsmap finished waiting for FSMap version 16 2024-09-10T10:09:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.181+0000 7fd51d9fd740 10 client.24656 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T10:09:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.181+0000 7fd51d9fd740 20 client.24656 populate_metadata read hostname 'smithi050' 2024-09-10T10:09:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.181+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555e73932270 0x555e739336e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.181+0000 7fd51d9fd740 4 client.24656 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:09:00.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.181+0000 7fd51d9fd740 1 -- 172.21.15.50:0/3282751990 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e73889620 con 0x555e73932270 2024-09-10T10:09:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.181+0000 7fd513e00640 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555e73932270 0x555e739336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.182+0000 7fd513e00640 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555e73932270 0x555e739336e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ed799b1bdfaf1ee server_cookie=4c1dc7773daee212 in_seq=0 out_seq=0 2024-09-10T10:09:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.182+0000 7fd4fa000640 10 client.24656 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:09:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd4fa000640 1 -- 172.21.15.50:0/3282751990 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e73889620 con 0x555e73932270 2024-09-10T10:09:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd4fa000640 10 client.24656 handle_command_reply: tid=0 2024-09-10T10:09:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd51d9fd740 1 client.24656 shutdown 2024-09-10T10:09:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd51d9fd740 1 -- 172.21.15.50:0/3282751990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916330 msgr2=0x555e7391e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916330 0x555e7391e530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd5080096e0 tx=0x7fd508019ad0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd51d9fd740 1 -- 172.21.15.50:0/3282751990 shutdown_connections 2024-09-10T10:09:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555e73932270 0x555e739336e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73921510 0x555e7391efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916c50 0x555e7391ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/3282751990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916330 0x555e7391e530 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd4fa000640 0 client.24656 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:09:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd51d9fd740 1 -- 172.21.15.50:0/3282751990 >> 172.21.15.50:0/3282751990 conn(0x555e739128c0 msgr2=0x555e739185f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:00.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd51d9fd740 1 -- 172.21.15.50:0/3282751990 shutdown_connections 2024-09-10T10:09:00.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd51d9fd740 1 -- 172.21.15.50:0/3282751990 wait complete. 2024-09-10T10:09:00.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.183+0000 7fd51d9fd740 20 client.24656 trim_cache size 0 max 16384 2024-09-10T10:09:00.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.202+0000 7fd51d9fd740 1 Processor -- start 2024-09-10T10:09:00.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.202+0000 7fd51d9fd740 1 -- start start 2024-09-10T10:09:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd51d9fd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73916330 0x555e73933010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd51d9fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916c50 0x555e73918d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd51d9fd740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73921510 0x555e7391ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd51d9fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555e73931a20 con 0x555e73916c50 2024-09-10T10:09:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd51d9fd740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555e739320f0 con 0x555e73921510 2024-09-10T10:09:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd51d9fd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555e739327c0 con 0x555e73916330 2024-09-10T10:09:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd513e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916c50 0x555e73918d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd513e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916c50 0x555e73918d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58452/0 (socket says 172.21.15.50:58452) 2024-09-10T10:09:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd513e00640 1 -- 172.21.15.50:0/2245181104 learned_addr learned my addr 172.21.15.50:0/2245181104 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd519400640 1 --2- 172.21.15.50:0/2245181104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73921510 0x555e7391ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd518a00640 1 --2- 172.21.15.50:0/2245181104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73916330 0x555e73933010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd513e00640 1 -- 172.21.15.50:0/2245181104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73916330 msgr2=0x555e73933010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:09:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd513e00640 1 --2- 172.21.15.50:0/2245181104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73916330 0x555e73933010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd513e00640 1 -- 172.21.15.50:0/2245181104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73921510 msgr2=0x555e7391ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:09:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd513e00640 1 --2- 172.21.15.50:0/2245181104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73921510 0x555e7391ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.203+0000 7fd513e00640 1 -- 172.21.15.50:0/2245181104 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e73933a10 con 0x555e73916c50 2024-09-10T10:09:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.204+0000 7fd513e00640 1 --2- 172.21.15.50:0/2245181104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916c50 0x555e73918d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd5000ece10 tx=0x7fd5000f5530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928278f69d9f7c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.204+0000 7fd505200640 1 -- 172.21.15.50:0/2245181104 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500049040 con 0x555e73916c50 2024-09-10T10:09:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.204+0000 7fd505200640 1 -- 172.21.15.50:0/2245181104 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5000bbc20 con 0x555e73916c50 2024-09-10T10:09:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.204+0000 7fd505200640 1 -- 172.21.15.50:0/2245181104 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5000ecf20 con 0x555e73916c50 2024-09-10T10:09:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.204+0000 7fd51d9fd740 1 -- 172.21.15.50:0/2245181104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916c50 msgr2=0x555e73918d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.204+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/2245181104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916c50 0x555e73918d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd5000ece10 tx=0x7fd5000f5530 comp rx=0 tx=0).stop 2024-09-10T10:09:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.204+0000 7fd51d9fd740 1 -- 172.21.15.50:0/2245181104 shutdown_connections 2024-09-10T10:09:00.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.204+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/2245181104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73921510 0x555e7391ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.204+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/2245181104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73916c50 0x555e73918d90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.204+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/2245181104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73916330 0x555e73933010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.204+0000 7fd51d9fd740 1 -- 172.21.15.50:0/2245181104 >> 172.21.15.50:0/2245181104 conn(0x555e739128c0 msgr2=0x555e73931280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:00.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.205+0000 7fd51d9fd740 1 -- 172.21.15.50:0/2245181104 shutdown_connections 2024-09-10T10:09:00.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.205+0000 7fd51d9fd740 1 -- 172.21.15.50:0/2245181104 wait complete. 2024-09-10T10:09:00.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.205+0000 7fd51d9fd740 1 -- start start 2024-09-10T10:09:00.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.205+0000 7fd51d9fd740 1 Processor -- start 2024-09-10T10:09:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd51d9fd740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916330 0x555e7393a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd51d9fd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73916c50 0x555e7393a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd51d9fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73921510 0x555e73934950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd51d9fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555e73933560 con 0x555e73921510 2024-09-10T10:09:00.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd51d9fd740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555e73932e90 con 0x555e73916330 2024-09-10T10:09:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd51d9fd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555e73933c30 con 0x555e73916c50 2024-09-10T10:09:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd51d9fd740 10 client.0 _ll_register_callbacks cb 0x7fd508009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:09:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd519400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73921510 0x555e73934950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd518a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916330 0x555e7393a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd518a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916330 0x555e7393a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:45346/0 (socket says 172.21.15.50:45346) 2024-09-10T10:09:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd518a00640 1 -- 172.21.15.50:0/1738050592 learned_addr learned my addr 172.21.15.50:0/1738050592 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd519400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73921510 0x555e73934950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58466/0 (socket says 172.21.15.50:58466) 2024-09-10T10:09:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd513e00640 1 --2- 172.21.15.50:0/1738050592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73916c50 0x555e7393a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd519400640 1 -- 172.21.15.50:0/1738050592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73916c50 msgr2=0x555e7393a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:09:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd519400640 1 --2- 172.21.15.50:0/1738050592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73916c50 0x555e7393a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd519400640 1 -- 172.21.15.50:0/1738050592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916330 msgr2=0x555e7393a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:09:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd519400640 1 --2- 172.21.15.50:0/1738050592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916330 0x555e7393a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.206+0000 7fd519400640 1 -- 172.21.15.50:0/1738050592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e7393adf0 con 0x555e73921510 2024-09-10T10:09:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.207+0000 7fd519400640 1 --2- 172.21.15.50:0/1738050592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73921510 0x555e73934950 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd50c005fd0 tx=0x7fd50c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01f6c167d6783da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.207+0000 7fd4fa000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:09:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.207+0000 7fd4fa000640 1 -- 172.21.15.50:0/1738050592 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c02f060 con 0x555e73921510 2024-09-10T10:09:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.207+0000 7fd51d9fd740 1 -- 172.21.15.50:0/1738050592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5000bbc20 con 0x555e73921510 2024-09-10T10:09:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.207+0000 7fd4fa000640 1 -- 172.21.15.50:0/1738050592 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd50c01f420 con 0x555e73921510 2024-09-10T10:09:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.207+0000 7fd4fa000640 1 -- 172.21.15.50:0/1738050592 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fd50c036050 con 0x555e73921510 2024-09-10T10:09:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.207+0000 7fd51d9fd740 10 client.14604 fetch_fsmap learned FSMap version 16 2024-09-10T10:09:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.207+0000 7fd51d9fd740 1 -- 172.21.15.50:0/1738050592 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x555e73939460 con 0x555e73921510 2024-09-10T10:09:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.207+0000 7fd4fa000640 1 -- 172.21.15.50:0/1738050592 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5000bbc20 con 0x555e73921510 2024-09-10T10:09:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.208+0000 7fd4fa000640 1 -- 172.21.15.50:0/1738050592 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7fd50c029070 con 0x555e73921510 2024-09-10T10:09:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.208+0000 7fd51d9fd740 10 client.14604 fetch_fsmap finished waiting for FSMap version 16 2024-09-10T10:09:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.208+0000 7fd51d9fd740 10 client.14604 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T10:09:00.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.208+0000 7fd51d9fd740 20 client.14604 populate_metadata read hostname 'smithi050' 2024-09-10T10:09:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.208+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/1738050592 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555e739a0a20 0x555e7399f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.208+0000 7fd51d9fd740 4 client.14604 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:09:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.208+0000 7fd51d9fd740 1 -- 172.21.15.50:0/1738050592 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "status"}) -- 0x555e73883b30 con 0x555e739a0a20 2024-09-10T10:09:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.208+0000 7fd518a00640 1 --2- 172.21.15.50:0/1738050592 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555e739a0a20 0x555e7399f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd518a00640 1 --2- 172.21.15.50:0/1738050592 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555e739a0a20 0x555e7399f730 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9072051a19d1f48 server_cookie=3845f0870e4d590b in_seq=0 out_seq=0 2024-09-10T10:09:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd4fa000640 10 client.14604 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:09:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd4fa000640 1 -- 172.21.15.50:0/1738050592 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555e73883b30 con 0x555e739a0a20 2024-09-10T10:09:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd4fa000640 10 client.14604 handle_command_reply: tid=0 2024-09-10T10:09:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd51d9fd740 1 client.14604 shutdown 2024-09-10T10:09:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd51d9fd740 1 -- 172.21.15.50:0/1738050592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73921510 msgr2=0x555e73934950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/1738050592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73921510 0x555e73934950 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd50c005fd0 tx=0x7fd50c004ab0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd51d9fd740 1 -- 172.21.15.50:0/1738050592 shutdown_connections 2024-09-10T10:09:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/1738050592 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555e739a0a20 0x555e7399f730 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/1738050592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555e73921510 0x555e73934950 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/1738050592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555e73916c50 0x555e7393a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd51d9fd740 1 --2- 172.21.15.50:0/1738050592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555e73916330 0x555e7393a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd4fa000640 0 client.14604 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:09:00.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.209+0000 7fd51d9fd740 1 -- 172.21.15.50:0/1738050592 >> 172.21.15.50:0/1738050592 conn(0x555e739128c0 msgr2=0x555e7391cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.210+0000 7fd51d9fd740 1 -- 172.21.15.50:0/1738050592 shutdown_connections 2024-09-10T10:09:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.210+0000 7fd51d9fd740 1 -- 172.21.15.50:0/1738050592 wait complete. 2024-09-10T10:09:00.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.210+0000 7fd51d9fd740 20 client.14604 trim_cache size 0 max 16384 2024-09-10T10:09:00.217 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:09:00.217 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "4d54e0f8-6f5b-11ef-bcea-c7b262605968", 2024-09-10T10:09:00.217 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-10T10:09:00.217 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24560, 2024-09-10T10:09:00.217 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-10T10:09:00.218 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-10T10:09:00.218 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-10T10:09:00.218 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 23.853417236999999, 2024-09-10T10:09:00.218 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 16, 2024-09-10T10:09:00.218 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 92, 2024-09-10T10:09:00.218 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 91, 2024-09-10T10:09:00.218 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 36.692110558000003 2024-09-10T10:09:00.218 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:09:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.210+0000 7fd51b400640 1 -- 172.21.15.50:0/697702353 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd4fc0a2c00 msgr2=0x7fd4fc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.210+0000 7fd51b400640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd4fc0a2c00 0x7fd4fc0a50c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009fd0 tx=0x7fd50c009500 comp rx=0 tx=0).stop 2024-09-10T10:09:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.210+0000 7fd51b400640 1 -- 172.21.15.50:0/697702353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5141049a0 msgr2=0x7fd51419ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.210+0000 7fd51b400640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5141049a0 0x7fd51419ab60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd500006010 tx=0x7fd500004040 comp rx=0 tx=0).stop 2024-09-10T10:09:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.210+0000 7fd51b400640 1 -- 172.21.15.50:0/697702353 shutdown_connections 2024-09-10T10:09:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.210+0000 7fd51b400640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd4fc0a2c00 0x7fd4fc0a50c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.210+0000 7fd51b400640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd514109120 0x7fd51419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.210+0000 7fd51b400640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5141049a0 0x7fd51419ab60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.210+0000 7fd51b400640 1 --2- 172.21.15.50:0/697702353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd514103ff0 0x7fd51419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:00.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.210+0000 7fd51b400640 1 -- 172.21.15.50:0/697702353 >> 172.21.15.50:0/697702353 conn(0x7fd5140ffa90 msgr2=0x7fd514100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:00.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.211+0000 7fd51b400640 1 -- 172.21.15.50:0/697702353 shutdown_connections 2024-09-10T10:09:00.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:00.211+0000 7fd51b400640 1 -- 172.21.15.50:0/697702353 wait complete. 2024-09-10T10:09:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:00 smithi050 ceph-mon[30354]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:09:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-10T10:09:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T10:09:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 7]}]': finished 2024-09-10T10:09:00.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T10:09:00.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-10T10:09:00.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-09-10T10:09:00.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-10T10:09:00.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-10T10:09:00.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 10]}]': finished 2024-09-10T10:09:00.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-10T10:09:00.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:00 smithi050 ceph-mon[30354]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T10:09:00.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:00 smithi189 ceph-mon[34999]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:09:00.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-10T10:09:00.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T10:09:00.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 7]}]': finished 2024-09-10T10:09:00.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T10:09:00.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-10T10:09:00.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-09-10T10:09:00.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-10T10:09:00.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-10T10:09:00.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 10]}]': finished 2024-09-10T10:09:00.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-10T10:09:00.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:00 smithi189 ceph-mon[34999]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T10:09:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:00 smithi084 ceph-mon[34812]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:09:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-10T10:09:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T10:09:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 7]}]': finished 2024-09-10T10:09:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T10:09:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-10T10:09:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-09-10T10:09:00.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-10T10:09:00.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-10T10:09:00.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 10]}]': finished 2024-09-10T10:09:00.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-10T10:09:00.850 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:00 smithi084 ceph-mon[34812]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T10:09:00.985 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T10:09:00.985 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T10:09:00.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T10:09:01.364 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:01.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:01 smithi050 ceph-mon[30354]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T10:09:01.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:01 smithi189 ceph-mon[34999]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T10:09:01.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:01 smithi084 ceph-mon[34812]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T10:09:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.969+0000 7f119aa00640 1 -- 172.21.15.50:0/2849994061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109120 msgr2=0x7f1194110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.969+0000 7f119aa00640 1 --2- 172.21.15.50:0/2849994061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109120 0x7f1194110ca0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f118c009ca0 tx=0x7f118c02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:09:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.969+0000 7f119aa00640 1 -- 172.21.15.50:0/2849994061 shutdown_connections 2024-09-10T10:09:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.969+0000 7f119aa00640 1 --2- 172.21.15.50:0/2849994061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109120 0x7f1194110ca0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.969+0000 7f119aa00640 1 --2- 172.21.15.50:0/2849994061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11941049a0 0x7f11941089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.969+0000 7f119aa00640 1 --2- 172.21.15.50:0/2849994061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1194103ff0 0x7f11941043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.969+0000 7f119aa00640 1 -- 172.21.15.50:0/2849994061 >> 172.21.15.50:0/2849994061 conn(0x7f11940ffa90 msgr2=0x7f1194101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.969+0000 7f119aa00640 1 -- 172.21.15.50:0/2849994061 shutdown_connections 2024-09-10T10:09:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.969+0000 7f119aa00640 1 -- 172.21.15.50:0/2849994061 wait complete. 2024-09-10T10:09:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.970+0000 7f119aa00640 1 Processor -- start 2024-09-10T10:09:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.970+0000 7f119aa00640 1 -- start start 2024-09-10T10:09:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.970+0000 7f119aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1194103ff0 0x7f119419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f119aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11941049a0 0x7f119419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f119aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109120 0x7f119419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f119aa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1194114180 con 0x7f1194109120 2024-09-10T10:09:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f119aa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1194114000 con 0x7f11941049a0 2024-09-10T10:09:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f119aa00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1194114300 con 0x7f1194103ff0 2024-09-10T10:09:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f1198a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109120 0x7f119419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f1198a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109120 0x7f119419ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58480/0 (socket says 172.21.15.50:58480) 2024-09-10T10:09:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f1198a00640 1 -- 172.21.15.50:0/964263573 learned_addr learned my addr 172.21.15.50:0/964263573 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f1193400640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11941049a0 0x7f119419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f1193e00640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1194103ff0 0x7f119419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f1193400640 1 -- 172.21.15.50:0/964263573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1194103ff0 msgr2=0x7f119419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:01.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f1193400640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1194103ff0 0x7f119419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:01.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f1193400640 1 -- 172.21.15.50:0/964263573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109120 msgr2=0x7f119419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:01.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f1193400640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109120 0x7f119419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:01.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.971+0000 7f1193400640 1 -- 172.21.15.50:0/964263573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119419f5f0 con 0x7f11941049a0 2024-09-10T10:09:01.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.972+0000 7f1193400640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11941049a0 0x7f119419ab80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f118000e9f0 tx=0x7f118000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.972+0000 7f1190c00640 1 -- 172.21.15.50:0/964263573 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118000ccc0 con 0x7f11941049a0 2024-09-10T10:09:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.972+0000 7f1190c00640 1 -- 172.21.15.50:0/964263573 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1180010910 con 0x7f11941049a0 2024-09-10T10:09:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.972+0000 7f119aa00640 1 -- 172.21.15.50:0/964263573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119419f8e0 con 0x7f11941049a0 2024-09-10T10:09:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.972+0000 7f1190c00640 1 -- 172.21.15.50:0/964263573 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180018960 con 0x7f11941049a0 2024-09-10T10:09:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.972+0000 7f119aa00640 1 -- 172.21.15.50:0/964263573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11941a71c0 con 0x7f11941049a0 2024-09-10T10:09:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.973+0000 7f119aa00640 1 -- 172.21.15.50:0/964263573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11941043d0 con 0x7f11941049a0 2024-09-10T10:09:01.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.975+0000 7f1190c00640 1 -- 172.21.15.50:0/964263573 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1180010ac0 con 0x7f11941049a0 2024-09-10T10:09:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.976+0000 7f1190c00640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f11780a2c00 0x7f11780a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.977+0000 7f1190c00640 1 -- 172.21.15.50:0/964263573 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f11800cfa20 con 0x7f11941049a0 2024-09-10T10:09:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.977+0000 7f1193e00640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f11780a2c00 0x7f11780a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.977+0000 7f1193e00640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f11780a2c00 0x7f11780a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1184005d00 tx=0x7f118400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:01.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:01.978+0000 7f1190c00640 1 -- 172.21.15.50:0/964263573 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f118009bf70 con 0x7f11941049a0 2024-09-10T10:09:02.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.205+0000 7f119aa00640 1 -- 172.21.15.50:0/964263573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f119419b9a0 con 0x7f11941049a0 2024-09-10T10:09:02.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.205+0000 7f1190c00640 1 -- 172.21.15.50:0/964263573 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+88 (secure 0 0 0) 0x7f11800a0270 con 0x7f11941049a0 2024-09-10T10:09:02.207 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T10:09:02.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.207+0000 7f119aa00640 1 -- 172.21.15.50:0/964263573 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f11780a2c00 msgr2=0x7f11780a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:02.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.207+0000 7f119aa00640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f11780a2c00 0x7f11780a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1184005d00 tx=0x7f118400b410 comp rx=0 tx=0).stop 2024-09-10T10:09:02.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.207+0000 7f119aa00640 1 -- 172.21.15.50:0/964263573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11941049a0 msgr2=0x7f119419ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:02.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.207+0000 7f119aa00640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11941049a0 0x7f119419ab80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f118000e9f0 tx=0x7f118000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:09:02.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.208+0000 7f119aa00640 1 -- 172.21.15.50:0/964263573 shutdown_connections 2024-09-10T10:09:02.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.208+0000 7f119aa00640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f11780a2c00 0x7f11780a50c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:02.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.208+0000 7f119aa00640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109120 0x7f119419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:02.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.208+0000 7f119aa00640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11941049a0 0x7f119419ab80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:02.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.208+0000 7f119aa00640 1 --2- 172.21.15.50:0/964263573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1194103ff0 0x7f119419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:02.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.208+0000 7f119aa00640 1 -- 172.21.15.50:0/964263573 >> 172.21.15.50:0/964263573 conn(0x7f11940ffa90 msgr2=0x7f1194100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:02.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.208+0000 7f119aa00640 1 -- 172.21.15.50:0/964263573 shutdown_connections 2024-09-10T10:09:02.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:02.208+0000 7f119aa00640 1 -- 172.21.15.50:0/964263573 wait complete. 2024-09-10T10:09:02.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:02 smithi189 ceph-mon[34999]: pgmap v324: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:09:02.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:02 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/964263573' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T10:09:02.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:02 smithi084 ceph-mon[34812]: pgmap v324: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:09:02.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:02 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/964263573' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T10:09:02.879 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:02 smithi050 ceph-mon[30354]: pgmap v324: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:09:02.879 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:02 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/964263573' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T10:09:02.916 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T10:09:02.916 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T10:09:02.917 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-10T10:09:02.917 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-10T10:09:02.917 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T10:09:02.917 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T10:09:02.917 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T10:09:02.917 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T10:09:02.917 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T10:09:02.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:09:02.917 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-10T10:09:02.953 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T10:09:02.953 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T10:09:02.953 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T10:09:02.954 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:09:02.954 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-10T10:09:02.954 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:09:02.954 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:09:02.954 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:09:02.954 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-10T10:09:02.954 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:09:02.954 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:09:02.954 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-10T10:09:02.954 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T10:09:02.954 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:09:02.954 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-10T10:09:02.955 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T10:09:02.955 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42201sec preferred_lft 42201sec 2024-09-10T10:09:02.955 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-10T10:09:02.955 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:09:02.955 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:09:02.955 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:09:02.955 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-10T10:09:02.956 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T10:09:02.956 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:09:02.956 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-10T10:09:02.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2024-09-10T10:09:02.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2024-09-10T10:09:02.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2024-09-10T10:09:02.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T10:09:02.956 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-10T10:09:03.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:09:03.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:09:03.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:09:03.382 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T10:09:03.442 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-10T10:09:03.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:09:03.446 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-10T10:09:03.501 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-10T10:09:03.502 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T10:09:03.502 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T10:09:03.502 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T10:09:03.502 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T10:09:03.502 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:09:03.503 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-10T10:09:03.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T10:09:03.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T10:09:03.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T10:09:03.503 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-10T10:09:03.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:09:04.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:09:04.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:09:04.361 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-10T10:09:04.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:09:04.398 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2024-09-10T10:09:04.474 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:09:04.474 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-10T10:09:04.474 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T10:09:04.475 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-10T10:09:04.475 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-10T10:09:04.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:09:04.609 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:04 smithi050 ceph-mon[30354]: pgmap v325: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:09:04.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:09:04.653 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-10T10:09:04.654 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:09:04.654 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-10T10:09:04.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-10T10:09:04.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T10:09:04.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-10T10:09:04.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-10T10:09:04.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-10T10:09:04.654 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-10T10:09:04.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:09:04.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:04 smithi189 ceph-mon[34999]: pgmap v325: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:09:04.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:04 smithi084 ceph-mon[34812]: pgmap v325: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:09:04.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:09:04.991 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:09:04.991 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-10T10:09:04.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-10T10:09:04.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T10:09:04.991 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-10T10:09:05.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:09:05.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:09:05.158 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-10T10:09:05.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T10:09:05.159 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-10T10:09:05.194 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T10:09:05.195 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T10:09:05.195 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-10T10:09:05.270 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-09-10T10:09:05.369 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T10:09:05.407 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2024-09-10T10:09:05.407 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2024-09-10T10:09:05.407 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2024-09-10T10:09:05.407 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2024-09-10T10:09:05.407 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2024-09-10T10:09:05.407 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2024-09-10T10:09:05.407 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2024-09-10T10:09:05.407 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2024-09-10T10:09:05.407 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T10:09:05.408 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T10:09:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2024-09-10T10:09:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2024-09-10T10:09:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay 2024-09-10T10:09:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/61b99644290b0c549e72961b531067d0ef84674aa6492b25c82ed113219f0c05/merged 2024-09-10T10:09:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/0950e5722f2fcb6b487156509a557e3910b16535ac67efefc56d53ea584a6694/merged 2024-09-10T10:09:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/0 2024-09-10T10:09:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T10:09:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/01d977a2fef30c346a6317e16ad7a3554ed8c43b442fc81bd8d5c468f29f682c/merged 2024-09-10T10:09:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/20c22f75a980735eba9de5944da73bd08975d4c290f788dc2f1f1582b4c034c3/merged 2024-09-10T10:09:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/7c8a4c9aff6766366de2562e0d4510f639c306a80ebe56e493822594672d4e0d/merged 2024-09-10T10:09:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/1445e51387b6698e833efccfd12c8ed952206d0ba0fc85a25a581d538e4b3b7c/merged 2024-09-10T10:09:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/03fb5c7aaa1fcde0fc127da863442b7ce932c95e1147c03dcaeeecc7dee455e6/merged 2024-09-10T10:09:05.409 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/4eec3fc6708db511f237a60573076f78a63a762e50fc1376206b025db7d91e7e/merged 2024-09-10T10:09:05.410 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/3fe6d9632c62e2b4c5ea63082e8611192ed3b4379bde57b7d066805434724024/merged 2024-09-10T10:09:05.410 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/8f53fb8ca90d6cc3e42b4a0a6e37ce88aaa90e511e41dad72379ceb831b87c7f/merged 2024-09-10T10:09:05.410 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2024-09-10T10:09:05.410 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T10:09:05.410 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T10:09:05.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:09:05.411 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-09-10T10:09:05.487 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T10:09:05.487 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-10T10:09:05.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2024-09-10T10:09:05.588 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T10:09:05.678 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2024-09-10T10:09:05.678 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2024-09-10T10:09:05.678 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2024-09-10T10:09:05.678 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2024-09-10T10:09:05.678 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2024-09-10T10:09:05.678 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2024-09-10T10:09:05.678 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2024-09-10T10:09:05.678 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2024-09-10T10:09:05.678 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2024-09-10T10:09:05.679 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2024-09-10T10:09:05.679 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2024-09-10T10:09:05.679 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2024-09-10T10:09:05.679 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T10:09:05.679 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2024-09-10T10:09:05.679 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2024-09-10T10:09:05.679 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2024-09-10T10:09:05.679 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2024-09-10T10:09:05.679 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2024-09-10T10:09:05.679 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2024-09-10T10:09:05.679 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T10:09:05.679 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T10:09:05.679 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T10:09:05.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T10:09:05.680 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2024-09-10T10:09:05.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2024-09-10T10:09:05.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay 2024-09-10T10:09:05.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/61b99644290b0c549e72961b531067d0ef84674aa6492b25c82ed113219f0c05/merged 2024-09-10T10:09:05.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/0950e5722f2fcb6b487156509a557e3910b16535ac67efefc56d53ea584a6694/merged 2024-09-10T10:09:05.680 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/0 2024-09-10T10:09:05.680 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T10:09:05.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/01d977a2fef30c346a6317e16ad7a3554ed8c43b442fc81bd8d5c468f29f682c/merged 2024-09-10T10:09:05.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/20c22f75a980735eba9de5944da73bd08975d4c290f788dc2f1f1582b4c034c3/merged 2024-09-10T10:09:05.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/7c8a4c9aff6766366de2562e0d4510f639c306a80ebe56e493822594672d4e0d/merged 2024-09-10T10:09:05.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/1445e51387b6698e833efccfd12c8ed952206d0ba0fc85a25a581d538e4b3b7c/merged 2024-09-10T10:09:05.681 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/03fb5c7aaa1fcde0fc127da863442b7ce932c95e1147c03dcaeeecc7dee455e6/merged 2024-09-10T10:09:05.681 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/4eec3fc6708db511f237a60573076f78a63a762e50fc1376206b025db7d91e7e/merged 2024-09-10T10:09:05.681 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/3fe6d9632c62e2b4c5ea63082e8611192ed3b4379bde57b7d066805434724024/merged 2024-09-10T10:09:05.681 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/containers/storage/overlay/8f53fb8ca90d6cc3e42b4a0a6e37ce88aaa90e511e41dad72379ceb831b87c7f/merged 2024-09-10T10:09:05.681 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2024-09-10T10:09:05.681 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T10:09:05.681 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T10:09:05.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:09:05.682 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2024-09-10T10:09:05.698 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:2024-09-10T10:09:05.697+0000 7f79361d6480 -1 init, newargv = 0x56203c220510 newargc=15 2024-09-10T10:09:05.698 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[74868]: starting ceph client 2024-09-10T10:09:05.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[74868]: starting fuse 2024-09-10T10:09:05.735 INFO:teuthology.orchestra.run.smithi050.stdout:120 2024-09-10T10:09:05.735 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-10T10:09:05.735 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2024-09-10T10:09:05.735 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2024-09-10T10:09:05.736 DEBUG:teuthology.orchestra.run.smithi050:> import re 2024-09-10T10:09:05.736 DEBUG:teuthology.orchestra.run.smithi050:> import os 2024-09-10T10:09:05.736 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2024-09-10T10:09:05.736 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-10T10:09:05.736 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2024-09-10T10:09:05.736 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-10T10:09:05.736 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2024-09-10T10:09:05.736 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-10T10:09:05.736 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-10T10:09:05.736 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2024-09-10T10:09:05.736 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2024-09-10T10:09:05.736 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2024-09-10T10:09:05.737 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2024-09-10T10:09:05.737 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-10T10:09:05.737 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2024-09-10T10:09:05.737 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T10:09:05.737 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T10:09:05.737 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T10:09:05.737 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2024-09-10T10:09:05.737 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2024-09-10T10:09:05.737 DEBUG:teuthology.orchestra.run.smithi050:> return f 2024-09-10T10:09:05.737 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T10:09:05.737 DEBUG:teuthology.orchestra.run.smithi050:> 2024-09-10T10:09:05.737 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.admin")) 2024-09-10T10:09:05.737 DEBUG:teuthology.orchestra.run.smithi050:> ' 2024-09-10T10:09:05.901 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.admin.74868.asok 2024-09-10T10:09:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:09:05.915 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.74868.asok 2024-09-10T10:09:05.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:09:05.915 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.74868.asok status 2024-09-10T10:09:06.102 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:09:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2024-09-10T10:09:06.102 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "1cf819b7212a6048e92fc78c4eff963344f6d56b", 2024-09-10T10:09:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T10:09:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "admin", 2024-09-10T10:09:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2024-09-10T10:09:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-10T10:09:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "74868", 2024-09-10T10:09:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2024-09-10T10:09:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:09:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2024-09-10T10:09:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2024-09-10T10:09:06.103 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24652, 2024-09-10T10:09:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2024-09-10T10:09:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2024-09-10T10:09:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2024-09-10T10:09:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 24652 2024-09-10T10:09:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:09:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-09-10T10:09:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-10T10:09:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-09-10T10:09:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1732575317 2024-09-10T10:09:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:09:06.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:09:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2024-09-10T10:09:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-10T10:09:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-09-10T10:09:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1732575317 2024-09-10T10:09:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:09:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.24652 172.21.15.50:0/1732575317", 2024-09-10T10:09:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "172.21.15.50:0/1732575317", 2024-09-10T10:09:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2024-09-10T10:09:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 16, 2024-09-10T10:09:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 93, 2024-09-10T10:09:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2024-09-10T10:09:06.105 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2024-09-10T10:09:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2024-09-10T10:09:06.106 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:09:06.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:09:06.117 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2024-09-10T10:09:06.117 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-10T10:09:06.155 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2024-09-10T10:09:06.155 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-10T10:09:06.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:09:06.155 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-10T10:09:06.257 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-10T10:09:06.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T10:09:06.364 INFO:teuthology.orchestra.run.smithi050.stdout:# file: . 2024-09-10T10:09:06.364 INFO:teuthology.orchestra.run.smithi050.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-10T10:09:06.364 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:09:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:09:06.372 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:09:06.372 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T10:09:06.409 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T10:09:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:06 smithi050 ceph-mon[30354]: pgmap v326: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 objects/s recovering 2024-09-10T10:09:06.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:06 smithi189 ceph-mon[34999]: pgmap v326: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 objects/s recovering 2024-09-10T10:09:06.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:06 smithi084 ceph-mon[34812]: pgmap v326: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2 B/s, 0 objects/s recovering 2024-09-10T10:09:06.861 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:07.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.543+0000 7fe80e800640 1 -- 172.21.15.50:0/3701992624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8081019c0 msgr2=0x7fe808101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:07.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.543+0000 7fe80e800640 1 --2- 172.21.15.50:0/3701992624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8081019c0 0x7fe808101e20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4009930 tx=0x7fe7f402a440 comp rx=0 tx=0).stop 2024-09-10T10:09:07.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.543+0000 7fe80e800640 1 -- 172.21.15.50:0/3701992624 shutdown_connections 2024-09-10T10:09:07.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.543+0000 7fe80e800640 1 --2- 172.21.15.50:0/3701992624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe808102360 0x7fe80810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.543+0000 7fe80e800640 1 --2- 172.21.15.50:0/3701992624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8081019c0 0x7fe808101e20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.543+0000 7fe80e800640 1 --2- 172.21.15.50:0/3701992624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8081079c0 0x7fe808107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.543+0000 7fe80e800640 1 -- 172.21.15.50:0/3701992624 >> 172.21.15.50:0/3701992624 conn(0x7fe8080fd740 msgr2=0x7fe8080ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.543+0000 7fe80e800640 1 -- 172.21.15.50:0/3701992624 shutdown_connections 2024-09-10T10:09:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.543+0000 7fe80e800640 1 -- 172.21.15.50:0/3701992624 wait complete. 2024-09-10T10:09:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.544+0000 7fe80e800640 1 Processor -- start 2024-09-10T10:09:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.544+0000 7fe80e800640 1 -- start start 2024-09-10T10:09:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.545+0000 7fe80e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8081019c0 0x7fe8080744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.545+0000 7fe80e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe808102360 0x7fe808074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.545+0000 7fe80e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8081079c0 0x7fe808074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.545+0000 7fe80e800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe808111dc0 con 0x7fe8081019c0 2024-09-10T10:09:07.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.545+0000 7fe80e800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe808111c40 con 0x7fe808102360 2024-09-10T10:09:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.545+0000 7fe80e800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe808111f40 con 0x7fe8081079c0 2024-09-10T10:09:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.545+0000 7fe80d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8081019c0 0x7fe8080744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.545+0000 7fe80ca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe808102360 0x7fe808074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.545+0000 7fe80d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8081019c0 0x7fe8080744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41408/0 (socket says 172.21.15.50:41408) 2024-09-10T10:09:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.545+0000 7fe80d400640 1 -- 172.21.15.50:0/2859312942 learned_addr learned my addr 172.21.15.50:0/2859312942 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.545+0000 7fe80de00640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8081079c0 0x7fe808074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.546+0000 7fe80ca00640 1 -- 172.21.15.50:0/2859312942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8081079c0 msgr2=0x7fe808074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.546+0000 7fe80ca00640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8081079c0 0x7fe808074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.546+0000 7fe80ca00640 1 -- 172.21.15.50:0/2859312942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8081019c0 msgr2=0x7fe8080744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:07.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.546+0000 7fe80ca00640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8081019c0 0x7fe8080744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:07.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.546+0000 7fe80ca00640 1 -- 172.21.15.50:0/2859312942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8081a6780 con 0x7fe808102360 2024-09-10T10:09:07.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.546+0000 7fe80d400640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8081019c0 0x7fe8080744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:07.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.546+0000 7fe80ca00640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe808102360 0x7fe808074a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4005940 tx=0x7fe7f4031b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:07.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.547+0000 7fe806000640 1 -- 172.21.15.50:0/2859312942 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f403f070 con 0x7fe808102360 2024-09-10T10:09:07.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.547+0000 7fe806000640 1 -- 172.21.15.50:0/2859312942 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7f4003ad0 con 0x7fe808102360 2024-09-10T10:09:07.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.547+0000 7fe80e800640 1 -- 172.21.15.50:0/2859312942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8081a6a10 con 0x7fe808102360 2024-09-10T10:09:07.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.547+0000 7fe806000640 1 -- 172.21.15.50:0/2859312942 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4035070 con 0x7fe808102360 2024-09-10T10:09:07.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.547+0000 7fe80e800640 1 -- 172.21.15.50:0/2859312942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8081a6ef0 con 0x7fe808102360 2024-09-10T10:09:07.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.548+0000 7fe80e800640 1 -- 172.21.15.50:0/2859312942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe808101e20 con 0x7fe808102360 2024-09-10T10:09:07.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.550+0000 7fe806000640 1 -- 172.21.15.50:0/2859312942 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe7f40035f0 con 0x7fe808102360 2024-09-10T10:09:07.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.551+0000 7fe806000640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe7f00a2b80 0x7fe7f00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:07.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.551+0000 7fe806000640 1 -- 172.21.15.50:0/2859312942 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fe7f40ef510 con 0x7fe808102360 2024-09-10T10:09:07.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.552+0000 7fe80d400640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe7f00a2b80 0x7fe7f00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:07.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.552+0000 7fe80d400640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe7f00a2b80 0x7fe7f00a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc011440 tx=0x7fe7fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:07.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.555+0000 7fe806000640 1 -- 172.21.15.50:0/2859312942 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe7f40bba60 con 0x7fe808102360 2024-09-10T10:09:07.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.768+0000 7fe80e800640 1 -- 172.21.15.50:0/2859312942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe8081099a0 con 0x7fe808102360 2024-09-10T10:09:07.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.769+0000 7fe806000640 1 -- 172.21.15.50:0/2859312942 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v93) ==== 81+0+592 (secure 0 0 0) 0x7fe7f40bfd60 con 0x7fe808102360 2024-09-10T10:09:07.770 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/2344357525 2024-09-11T10:00:58.655297+0000 2024-09-10T10:09:07.770 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/2344357525 2024-09-11T10:00:58.655297+0000 2024-09-10T10:09:07.770 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/3762668389 2024-09-11T10:00:58.655297+0000 2024-09-10T10:09:07.771 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/3709959859 2024-09-11T10:00:58.655297+0000 2024-09-10T10:09:07.771 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/3594719218 2024-09-11T10:00:30.124281+0000 2024-09-10T10:09:07.771 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2396848832 2024-09-11T10:00:30.124281+0000 2024-09-10T10:09:07.771 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1220276123 2024-09-11T10:00:30.124281+0000 2024-09-10T10:09:07.771 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2312780179 2024-09-11T10:00:58.655297+0000 2024-09-10T10:09:07.771 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/3083035719 2024-09-11T10:00:30.124281+0000 2024-09-10T10:09:07.771 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/3083035719 2024-09-11T10:00:30.124281+0000 2024-09-10T10:09:07.771 INFO:teuthology.orchestra.run.smithi050.stderr:listed 10 entries 2024-09-10T10:09:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.771+0000 7fe80e800640 1 -- 172.21.15.50:0/2859312942 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe7f00a2b80 msgr2=0x7fe7f00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.771+0000 7fe80e800640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe7f00a2b80 0x7fe7f00a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc011440 tx=0x7fe7fc005f90 comp rx=0 tx=0).stop 2024-09-10T10:09:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.771+0000 7fe80e800640 1 -- 172.21.15.50:0/2859312942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe808102360 msgr2=0x7fe808074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.771+0000 7fe80e800640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe808102360 0x7fe808074a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4005940 tx=0x7fe7f4031b50 comp rx=0 tx=0).stop 2024-09-10T10:09:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.771+0000 7fe80e800640 1 -- 172.21.15.50:0/2859312942 shutdown_connections 2024-09-10T10:09:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.771+0000 7fe80e800640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe7f00a2b80 0x7fe7f00a5040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.771+0000 7fe80e800640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8081079c0 0x7fe808074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.771+0000 7fe80e800640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe808102360 0x7fe808074a30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.771+0000 7fe80e800640 1 --2- 172.21.15.50:0/2859312942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8081019c0 0x7fe8080744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.771+0000 7fe80e800640 1 -- 172.21.15.50:0/2859312942 >> 172.21.15.50:0/2859312942 conn(0x7fe8080fd740 msgr2=0x7fe8080fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.771+0000 7fe80e800640 1 -- 172.21.15.50:0/2859312942 shutdown_connections 2024-09-10T10:09:07.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:07.771+0000 7fe80e800640 1 -- 172.21.15.50:0/2859312942 wait complete. 2024-09-10T10:09:08.530 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:09:08.530 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T10:09:08.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T10:09:08.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:08 smithi189 ceph-mon[34999]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:09:08.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:08 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2859312942' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:09:08.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:08 smithi084 ceph-mon[34812]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:09:08.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:08 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2859312942' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:09:08.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:08 smithi050 ceph-mon[30354]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:09:08.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:08 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2859312942' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:09:08.985 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:09.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.550+0000 7f88ea000640 1 -- 172.21.15.50:0/1256651652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e4103e30 msgr2=0x7f88e4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:09.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.550+0000 7f88ea000640 1 --2- 172.21.15.50:0/1256651652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e4103e30 0x7f88e4104210 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009900 tx=0x7f88d802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:09:09.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.550+0000 7f88ea000640 1 -- 172.21.15.50:0/1256651652 shutdown_connections 2024-09-10T10:09:09.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.550+0000 7f88ea000640 1 --2- 172.21.15.50:0/1256651652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e4108f60 0x7f88e4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:09.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.550+0000 7f88ea000640 1 --2- 172.21.15.50:0/1256651652 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88e41047e0 0x7f88e4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:09.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.550+0000 7f88ea000640 1 --2- 172.21.15.50:0/1256651652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e4103e30 0x7f88e4104210 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:09.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.550+0000 7f88ea000640 1 -- 172.21.15.50:0/1256651652 >> 172.21.15.50:0/1256651652 conn(0x7f88e40ff8d0 msgr2=0x7f88e4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:09.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.550+0000 7f88ea000640 1 -- 172.21.15.50:0/1256651652 shutdown_connections 2024-09-10T10:09:09.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.550+0000 7f88ea000640 1 -- 172.21.15.50:0/1256651652 wait complete. 2024-09-10T10:09:09.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.551+0000 7f88ea000640 1 Processor -- start 2024-09-10T10:09:09.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.551+0000 7f88ea000640 1 -- start start 2024-09-10T10:09:09.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.552+0000 7f88ea000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e4103e30 0x7f88e419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:09.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.552+0000 7f88ea000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88e41047e0 0x7f88e419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:09.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.552+0000 7f88ea000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e4108f60 0x7f88e419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:09.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.552+0000 7f88ea000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88e4113fd0 con 0x7f88e4108f60 2024-09-10T10:09:09.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.552+0000 7f88ea000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f88e4113e50 con 0x7f88e4103e30 2024-09-10T10:09:09.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.552+0000 7f88ea000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f88e4114150 con 0x7f88e41047e0 2024-09-10T10:09:09.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.552+0000 7f88e9600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e4108f60 0x7f88e419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:09.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.552+0000 7f88e3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88e41047e0 0x7f88e419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:09.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.552+0000 7f88e9600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e4108f60 0x7f88e419ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41432/0 (socket says 172.21.15.50:41432) 2024-09-10T10:09:09.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.552+0000 7f88e9600640 1 -- 172.21.15.50:0/4208948094 learned_addr learned my addr 172.21.15.50:0/4208948094 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:09.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.552+0000 7f88e8c00640 1 --2- 172.21.15.50:0/4208948094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e4103e30 0x7f88e419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:09.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.553+0000 7f88e9600640 1 -- 172.21.15.50:0/4208948094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88e41047e0 msgr2=0x7f88e419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:09.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.553+0000 7f88e9600640 1 --2- 172.21.15.50:0/4208948094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88e41047e0 0x7f88e419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:09.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.553+0000 7f88e9600640 1 -- 172.21.15.50:0/4208948094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e4103e30 msgr2=0x7f88e419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:09.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.553+0000 7f88e9600640 1 --2- 172.21.15.50:0/4208948094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e4103e30 0x7f88e419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:09.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.553+0000 7f88e9600640 1 -- 172.21.15.50:0/4208948094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e419f440 con 0x7f88e4108f60 2024-09-10T10:09:09.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.553+0000 7f88e9600640 1 --2- 172.21.15.50:0/4208948094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e4108f60 0x7f88e419ed60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00efd0 tx=0x7f88dc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:09.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.553+0000 7f88e1600640 1 -- 172.21.15.50:0/4208948094 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc003b70 con 0x7f88e4108f60 2024-09-10T10:09:09.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.553+0000 7f88ea000640 1 -- 172.21.15.50:0/4208948094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e419f730 con 0x7f88e4108f60 2024-09-10T10:09:09.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.553+0000 7f88e1600640 1 -- 172.21.15.50:0/4208948094 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88dc003d10 con 0x7f88e4108f60 2024-09-10T10:09:09.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.553+0000 7f88e1600640 1 -- 172.21.15.50:0/4208948094 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0109f0 con 0x7f88e4108f60 2024-09-10T10:09:09.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.553+0000 7f88ea000640 1 -- 172.21.15.50:0/4208948094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e41a7010 con 0x7f88e4108f60 2024-09-10T10:09:09.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.555+0000 7f88ea000640 1 -- 172.21.15.50:0/4208948094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88e4104210 con 0x7f88e4108f60 2024-09-10T10:09:09.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.557+0000 7f88e1600640 1 -- 172.21.15.50:0/4208948094 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f88dc004020 con 0x7f88e4108f60 2024-09-10T10:09:09.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.558+0000 7f88e1600640 1 --2- 172.21.15.50:0/4208948094 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f88cc0a2b80 0x7f88cc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:09.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.558+0000 7f88e1600640 1 -- 172.21.15.50:0/4208948094 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f88dc0cf7a0 con 0x7f88e4108f60 2024-09-10T10:09:09.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.558+0000 7f88e8c00640 1 --2- 172.21.15.50:0/4208948094 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f88cc0a2b80 0x7f88cc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:09.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.559+0000 7f88e8c00640 1 --2- 172.21.15.50:0/4208948094 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f88cc0a2b80 0x7f88cc0a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f88d8000c00 tx=0x7f88d8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:09.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.562+0000 7f88e1600640 1 -- 172.21.15.50:0/4208948094 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f88dc09c340 con 0x7f88e4108f60 2024-09-10T10:09:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.760+0000 7f88ea000640 1 -- 172.21.15.50:0/4208948094 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f88e402d7c0 con 0x7f88e4108f60 2024-09-10T10:09:09.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.760+0000 7f88e1600640 1 -- 172.21.15.50:0/4208948094 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v93) ==== 81+0+592 (secure 0 0 0) 0x7f88dc09bc40 con 0x7f88e4108f60 2024-09-10T10:09:09.762 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/2344357525 2024-09-11T10:00:58.655297+0000 2024-09-10T10:09:09.762 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/2344357525 2024-09-11T10:00:58.655297+0000 2024-09-10T10:09:09.762 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/3762668389 2024-09-11T10:00:58.655297+0000 2024-09-10T10:09:09.762 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/3709959859 2024-09-11T10:00:58.655297+0000 2024-09-10T10:09:09.762 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/3594719218 2024-09-11T10:00:30.124281+0000 2024-09-10T10:09:09.763 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2396848832 2024-09-11T10:00:30.124281+0000 2024-09-10T10:09:09.763 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1220276123 2024-09-11T10:00:30.124281+0000 2024-09-10T10:09:09.763 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2312780179 2024-09-11T10:00:58.655297+0000 2024-09-10T10:09:09.763 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/3083035719 2024-09-11T10:00:30.124281+0000 2024-09-10T10:09:09.763 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/3083035719 2024-09-11T10:00:30.124281+0000 2024-09-10T10:09:09.763 INFO:teuthology.orchestra.run.smithi050.stderr:listed 10 entries 2024-09-10T10:09:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.762+0000 7f88ea000640 1 -- 172.21.15.50:0/4208948094 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f88cc0a2b80 msgr2=0x7f88cc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.762+0000 7f88ea000640 1 --2- 172.21.15.50:0/4208948094 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f88cc0a2b80 0x7f88cc0a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f88d8000c00 tx=0x7f88d8005b50 comp rx=0 tx=0).stop 2024-09-10T10:09:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.762+0000 7f88ea000640 1 -- 172.21.15.50:0/4208948094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e4108f60 msgr2=0x7f88e419ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.762+0000 7f88ea000640 1 --2- 172.21.15.50:0/4208948094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e4108f60 0x7f88e419ed60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00efd0 tx=0x7f88dc00c6a0 comp rx=0 tx=0).stop 2024-09-10T10:09:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.762+0000 7f88ea000640 1 -- 172.21.15.50:0/4208948094 shutdown_connections 2024-09-10T10:09:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.763+0000 7f88ea000640 1 --2- 172.21.15.50:0/4208948094 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f88cc0a2b80 0x7f88cc0a5040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.763+0000 7f88ea000640 1 --2- 172.21.15.50:0/4208948094 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88e4108f60 0x7f88e419ed60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.763+0000 7f88ea000640 1 --2- 172.21.15.50:0/4208948094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88e41047e0 0x7f88e419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:09.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.763+0000 7f88ea000640 1 --2- 172.21.15.50:0/4208948094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88e4103e30 0x7f88e419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.763+0000 7f88ea000640 1 -- 172.21.15.50:0/4208948094 >> 172.21.15.50:0/4208948094 conn(0x7f88e40ff8d0 msgr2=0x7f88e4100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.763+0000 7f88ea000640 1 -- 172.21.15.50:0/4208948094 shutdown_connections 2024-09-10T10:09:09.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:09.763+0000 7f88ea000640 1 -- 172.21.15.50:0/4208948094 wait complete. 2024-09-10T10:09:10.488 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2024-09-10T10:09:10.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:09:10.488 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-10T10:09:10.545 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[74868]: fuse finished with error 0 and tester_r 0 2024-09-10T10:09:10.549 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T10:09:10.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:10 smithi050 ceph-mon[30354]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 439 B/s wr, 0 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:09:10.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:10 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4208948094' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:09:10.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:10 smithi189 ceph-mon[34999]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 439 B/s wr, 0 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:09:10.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:10 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4208948094' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:09:10.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:10 smithi084 ceph-mon[34812]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 439 B/s wr, 0 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:09:10.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:10 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4208948094' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:09:12.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:12 smithi189 ceph-mon[34999]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 397 B/s wr, 0 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:09:12.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:12 smithi084 ceph-mon[34812]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 397 B/s wr, 0 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:09:12.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:12 smithi050 ceph-mon[30354]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 397 B/s wr, 0 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:09:14.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:14 smithi189 ceph-mon[34999]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T10:09:14.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:14 smithi084 ceph-mon[34812]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T10:09:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:14 smithi050 ceph-mon[30354]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T10:09:16.650 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-10T10:09:16.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:09:16.651 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-10T10:09:16.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:09:16.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:16 smithi050 ceph-mon[30354]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T10:09:16.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:16 smithi189 ceph-mon[34999]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T10:09:16.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:16 smithi084 ceph-mon[34812]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T10:09:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:17.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.666+0000 7fdacaa00640 1 -- 172.21.15.50:0/3840370481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac4108f60 msgr2=0x7fdac4110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:17.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.666+0000 7fdacaa00640 1 --2- 172.21.15.50:0/3840370481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac4108f60 0x7fdac4110ae0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009ca0 tx=0x7fdabc02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:09:17.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.666+0000 7fdacaa00640 1 -- 172.21.15.50:0/3840370481 shutdown_connections 2024-09-10T10:09:17.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.666+0000 7fdacaa00640 1 --2- 172.21.15.50:0/3840370481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac4108f60 0x7fdac4110ae0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.666+0000 7fdacaa00640 1 --2- 172.21.15.50:0/3840370481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdac41047e0 0x7fdac4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.666+0000 7fdacaa00640 1 --2- 172.21.15.50:0/3840370481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdac4103e30 0x7fdac4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.666+0000 7fdacaa00640 1 -- 172.21.15.50:0/3840370481 >> 172.21.15.50:0/3840370481 conn(0x7fdac40ff8d0 msgr2=0x7fdac4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.667+0000 7fdacaa00640 1 -- 172.21.15.50:0/3840370481 shutdown_connections 2024-09-10T10:09:17.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.667+0000 7fdacaa00640 1 -- 172.21.15.50:0/3840370481 wait complete. 2024-09-10T10:09:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.668+0000 7fdacaa00640 1 Processor -- start 2024-09-10T10:09:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.668+0000 7fdacaa00640 1 -- start start 2024-09-10T10:09:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.668+0000 7fdacaa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdac4103e30 0x7fdac419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.668+0000 7fdacaa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac41047e0 0x7fdac419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.668+0000 7fdacaa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdac4108f60 0x7fdac419ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.669+0000 7fdacaa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdac4114010 con 0x7fdac41047e0 2024-09-10T10:09:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.669+0000 7fdacaa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdac4113e90 con 0x7fdac4103e30 2024-09-10T10:09:17.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.669+0000 7fdacaa00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdac4114190 con 0x7fdac4108f60 2024-09-10T10:09:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.669+0000 7fdac9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdac4103e30 0x7fdac419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.669+0000 7fdac8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac41047e0 0x7fdac419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.669+0000 7fdac9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdac4103e30 0x7fdac419a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:56828/0 (socket says 172.21.15.50:56828) 2024-09-10T10:09:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.669+0000 7fdac9600640 1 -- 172.21.15.50:0/3338509390 learned_addr learned my addr 172.21.15.50:0/3338509390 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:17.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.669+0000 7fdaca000640 1 --2- 172.21.15.50:0/3338509390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdac4108f60 0x7fdac419ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.669+0000 7fdac9600640 1 -- 172.21.15.50:0/3338509390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdac4108f60 msgr2=0x7fdac419ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.669+0000 7fdac9600640 1 --2- 172.21.15.50:0/3338509390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdac4108f60 0x7fdac419ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.669+0000 7fdac9600640 1 -- 172.21.15.50:0/3338509390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac41047e0 msgr2=0x7fdac419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.669+0000 7fdac9600640 1 --2- 172.21.15.50:0/3338509390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac41047e0 0x7fdac419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.669+0000 7fdac9600640 1 -- 172.21.15.50:0/3338509390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac419f3c0 con 0x7fdac4103e30 2024-09-10T10:09:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.670+0000 7fdac9600640 1 --2- 172.21.15.50:0/3338509390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdac4103e30 0x7fdac419a410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdab800d770 tx=0x7fdab800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.670+0000 7fdac2000640 1 -- 172.21.15.50:0/3338509390 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab8017070 con 0x7fdac4103e30 2024-09-10T10:09:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.670+0000 7fdacaa00640 1 -- 172.21.15.50:0/3338509390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac419f6b0 con 0x7fdac4103e30 2024-09-10T10:09:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.670+0000 7fdac2000640 1 -- 172.21.15.50:0/3338509390 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdab8005500 con 0x7fdac4103e30 2024-09-10T10:09:17.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.670+0000 7fdac2000640 1 -- 172.21.15.50:0/3338509390 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab8020060 con 0x7fdac4103e30 2024-09-10T10:09:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.670+0000 7fdacaa00640 1 -- 172.21.15.50:0/3338509390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac41a6f90 con 0x7fdac4103e30 2024-09-10T10:09:17.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.671+0000 7fdacaa00640 1 -- 172.21.15.50:0/3338509390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac4104210 con 0x7fdac4103e30 2024-09-10T10:09:17.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.673+0000 7fdac2000640 1 -- 172.21.15.50:0/3338509390 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdab8009cc0 con 0x7fdac4103e30 2024-09-10T10:09:17.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.674+0000 7fdac2000640 1 --2- 172.21.15.50:0/3338509390 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdaac0a2c00 0x7fdaac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:17.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.674+0000 7fdac2000640 1 -- 172.21.15.50:0/3338509390 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fdab80cee90 con 0x7fdac4103e30 2024-09-10T10:09:17.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.674+0000 7fdac8c00640 1 --2- 172.21.15.50:0/3338509390 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdaac0a2c00 0x7fdaac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:17.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.675+0000 7fdac8c00640 1 --2- 172.21.15.50:0/3338509390 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdaac0a2c00 0x7fdaac0a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdac41000d0 tx=0x7fdab0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:17.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.678+0000 7fdac2000640 1 -- 172.21.15.50:0/3338509390 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdab809ba30 con 0x7fdac4103e30 2024-09-10T10:09:17.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.864+0000 7fdacaa00640 1 -- 172.21.15.50:0/3338509390 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdac419b770 con 0x7fdac4103e30 2024-09-10T10:09:17.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.866+0000 7fdac2000640 1 -- 172.21.15.50:0/3338509390 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24682 (secure 0 0 0) 0x7fdab809b330 con 0x7fdac4103e30 2024-09-10T10:09:17.868 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:09:17.868 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:09:00.446421+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:09:17.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.868+0000 7fdacaa00640 1 -- 172.21.15.50:0/3338509390 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdaac0a2c00 msgr2=0x7fdaac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:17.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.868+0000 7fdacaa00640 1 --2- 172.21.15.50:0/3338509390 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdaac0a2c00 0x7fdaac0a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdac41000d0 tx=0x7fdab0005f90 comp rx=0 tx=0).stop 2024-09-10T10:09:17.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.868+0000 7fdacaa00640 1 -- 172.21.15.50:0/3338509390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdac4103e30 msgr2=0x7fdac419a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:17.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.868+0000 7fdacaa00640 1 --2- 172.21.15.50:0/3338509390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdac4103e30 0x7fdac419a410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdab800d770 tx=0x7fdab800dc30 comp rx=0 tx=0).stop 2024-09-10T10:09:17.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.869+0000 7fdacaa00640 1 -- 172.21.15.50:0/3338509390 shutdown_connections 2024-09-10T10:09:17.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.869+0000 7fdacaa00640 1 --2- 172.21.15.50:0/3338509390 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdaac0a2c00 0x7fdaac0a50c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:17.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.869+0000 7fdacaa00640 1 --2- 172.21.15.50:0/3338509390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdac4108f60 0x7fdac419ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.869+0000 7fdacaa00640 1 --2- 172.21.15.50:0/3338509390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdac41047e0 0x7fdac419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.869+0000 7fdacaa00640 1 --2- 172.21.15.50:0/3338509390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdac4103e30 0x7fdac419a410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.869+0000 7fdacaa00640 1 -- 172.21.15.50:0/3338509390 >> 172.21.15.50:0/3338509390 conn(0x7fdac40ff8d0 msgr2=0x7fdac4100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.869+0000 7fdacaa00640 1 -- 172.21.15.50:0/3338509390 shutdown_connections 2024-09-10T10:09:17.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:17.869+0000 7fdacaa00640 1 -- 172.21.15.50:0/3338509390 wait complete. 2024-09-10T10:09:18.614 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:09:18.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:18 smithi189 ceph-mon[34999]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T10:09:18.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:18 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3338509390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:18.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:18 smithi084 ceph-mon[34812]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T10:09:18.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:18 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3338509390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:18.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:18 smithi050 ceph-mon[30354]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-10T10:09:18.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:18 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3338509390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:18.994 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.594+0000 7f65dd200640 1 -- 172.21.15.50:0/3231438215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8108e00 msgr2=0x7f65d810ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.594+0000 7f65dd200640 1 --2- 172.21.15.50:0/3231438215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8108e00 0x7f65d810ce00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009900 tx=0x7f65c402a410 comp rx=0 tx=0).stop 2024-09-10T10:09:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.594+0000 7f65dd200640 1 -- 172.21.15.50:0/3231438215 shutdown_connections 2024-09-10T10:09:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.594+0000 7f65dd200640 1 --2- 172.21.15.50:0/3231438215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65d810d530 0x7f65d81150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.594+0000 7f65dd200640 1 --2- 172.21.15.50:0/3231438215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8108e00 0x7f65d810ce00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.594+0000 7f65dd200640 1 --2- 172.21.15.50:0/3231438215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65d8108450 0x7f65d8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.594+0000 7f65dd200640 1 -- 172.21.15.50:0/3231438215 >> 172.21.15.50:0/3231438215 conn(0x7f65d8077ba0 msgr2=0x7f65d8079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.594+0000 7f65dd200640 1 -- 172.21.15.50:0/3231438215 shutdown_connections 2024-09-10T10:09:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.594+0000 7f65dd200640 1 -- 172.21.15.50:0/3231438215 wait complete. 2024-09-10T10:09:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.595+0000 7f65dd200640 1 Processor -- start 2024-09-10T10:09:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.596+0000 7f65dd200640 1 -- start start 2024-09-10T10:09:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.596+0000 7f65dd200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8108450 0x7f65d81a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.596+0000 7f65dd200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65d8108e00 0x7f65d81a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.596+0000 7f65dd200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65d810d530 0x7f65d819e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.596+0000 7f65dd200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f65d8118530 con 0x7f65d8108450 2024-09-10T10:09:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.596+0000 7f65dd200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f65d81183b0 con 0x7f65d8108e00 2024-09-10T10:09:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.596+0000 7f65dd200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f65d81186b0 con 0x7f65d810d530 2024-09-10T10:09:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.596+0000 7f65d5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8108450 0x7f65d81a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.596+0000 7f65d5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8108450 0x7f65d81a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57394/0 (socket says 172.21.15.50:57394) 2024-09-10T10:09:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.596+0000 7f65d5e00640 1 -- 172.21.15.50:0/1236943643 learned_addr learned my addr 172.21.15.50:0/1236943643 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.596+0000 7f65d6800640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65d810d530 0x7f65d819e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.596+0000 7f65d5400640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65d8108e00 0x7f65d81a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.597+0000 7f65d5e00640 1 -- 172.21.15.50:0/1236943643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65d810d530 msgr2=0x7f65d819e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.597+0000 7f65d5e00640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65d810d530 0x7f65d819e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.597+0000 7f65d5e00640 1 -- 172.21.15.50:0/1236943643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65d8108e00 msgr2=0x7f65d81a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.597+0000 7f65d5e00640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65d8108e00 0x7f65d81a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.597+0000 7f65d5e00640 1 -- 172.21.15.50:0/1236943643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d819efb0 con 0x7f65d8108450 2024-09-10T10:09:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.597+0000 7f65d6800640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65d810d530 0x7f65d819e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.597+0000 7f65d5e00640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8108450 0x7f65d81a46c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f65c800d950 tx=0x7f65c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.597+0000 7f65cea00640 1 -- 172.21.15.50:0/1236943643 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8017070 con 0x7f65d8108450 2024-09-10T10:09:19.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.598+0000 7f65cea00640 1 -- 172.21.15.50:0/1236943643 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65c8009c30 con 0x7f65d8108450 2024-09-10T10:09:19.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.598+0000 7f65cea00640 1 -- 172.21.15.50:0/1236943643 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c800f6b0 con 0x7f65d8108450 2024-09-10T10:09:19.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.598+0000 7f65dd200640 1 -- 172.21.15.50:0/1236943643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d819f2a0 con 0x7f65d8108450 2024-09-10T10:09:19.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.598+0000 7f65dd200640 1 -- 172.21.15.50:0/1236943643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d81ab590 con 0x7f65d8108450 2024-09-10T10:09:19.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.599+0000 7f65dd200640 1 -- 172.21.15.50:0/1236943643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d8108830 con 0x7f65d8108450 2024-09-10T10:09:19.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.601+0000 7f65cea00640 1 -- 172.21.15.50:0/1236943643 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f65c80109d0 con 0x7f65d8108450 2024-09-10T10:09:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.602+0000 7f65cea00640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f65bc0a2b80 0x7f65bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.602+0000 7f65cea00640 1 -- 172.21.15.50:0/1236943643 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f65c80cefe0 con 0x7f65d8108450 2024-09-10T10:09:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.602+0000 7f65d5400640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f65bc0a2b80 0x7f65bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.603+0000 7f65d5400640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f65bc0a2b80 0x7f65bc0a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009230 tx=0x7f65c40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:19.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.606+0000 7f65cea00640 1 -- 172.21.15.50:0/1236943643 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f65c8009de0 con 0x7f65d8108450 2024-09-10T10:09:19.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.793+0000 7f65dd200640 1 -- 172.21.15.50:0/1236943643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65d819fdb0 con 0x7f65d8108450 2024-09-10T10:09:19.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.795+0000 7f65cea00640 1 -- 172.21.15.50:0/1236943643 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24682 (secure 0 0 0) 0x7f65c809b530 con 0x7f65d8108450 2024-09-10T10:09:19.797 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:09:19.798 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:09:00.446421+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:09:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.797+0000 7f65dd200640 1 -- 172.21.15.50:0/1236943643 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f65bc0a2b80 msgr2=0x7f65bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.797+0000 7f65dd200640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f65bc0a2b80 0x7f65bc0a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009230 tx=0x7f65c40058d0 comp rx=0 tx=0).stop 2024-09-10T10:09:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.797+0000 7f65dd200640 1 -- 172.21.15.50:0/1236943643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8108450 msgr2=0x7f65d81a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.797+0000 7f65dd200640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8108450 0x7f65d81a46c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f65c800d950 tx=0x7f65c800de10 comp rx=0 tx=0).stop 2024-09-10T10:09:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.797+0000 7f65dd200640 1 -- 172.21.15.50:0/1236943643 shutdown_connections 2024-09-10T10:09:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.797+0000 7f65dd200640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f65bc0a2b80 0x7f65bc0a5040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.797+0000 7f65dd200640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65d810d530 0x7f65d819e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.797+0000 7f65dd200640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65d8108e00 0x7f65d81a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.797+0000 7f65dd200640 1 --2- 172.21.15.50:0/1236943643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65d8108450 0x7f65d81a46c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.797+0000 7f65dd200640 1 -- 172.21.15.50:0/1236943643 >> 172.21.15.50:0/1236943643 conn(0x7f65d8077ba0 msgr2=0x7f65d8078ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.797+0000 7f65dd200640 1 -- 172.21.15.50:0/1236943643 shutdown_connections 2024-09-10T10:09:19.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:19.797+0000 7f65dd200640 1 -- 172.21.15.50:0/1236943643 wait complete. 2024-09-10T10:09:20.528 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T10:09:20.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:20 smithi189 ceph-mon[34999]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T10:09:20.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:20 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1236943643' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:20.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:20 smithi084 ceph-mon[34812]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T10:09:20.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:20 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1236943643' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:20.908 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:20.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:20 smithi050 ceph-mon[30354]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T10:09:20.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:20 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1236943643' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:21.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.476+0000 7f9cba800640 1 -- 172.21.15.50:0/823490750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4109120 msgr2=0x7f9cb4110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:21.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.476+0000 7f9cba800640 1 --2- 172.21.15.50:0/823490750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4109120 0x7f9cb4110ca0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009ca0 tx=0x7f9cac02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:09:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.476+0000 7f9cba800640 1 -- 172.21.15.50:0/823490750 shutdown_connections 2024-09-10T10:09:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.476+0000 7f9cba800640 1 --2- 172.21.15.50:0/823490750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4109120 0x7f9cb4110ca0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.476+0000 7f9cba800640 1 --2- 172.21.15.50:0/823490750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb41049a0 0x7f9cb41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.476+0000 7f9cba800640 1 --2- 172.21.15.50:0/823490750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cb4103ff0 0x7f9cb41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.476+0000 7f9cba800640 1 -- 172.21.15.50:0/823490750 >> 172.21.15.50:0/823490750 conn(0x7f9cb40ffa90 msgr2=0x7f9cb4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.476+0000 7f9cba800640 1 -- 172.21.15.50:0/823490750 shutdown_connections 2024-09-10T10:09:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.476+0000 7f9cba800640 1 -- 172.21.15.50:0/823490750 wait complete. 2024-09-10T10:09:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.477+0000 7f9cba800640 1 Processor -- start 2024-09-10T10:09:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.477+0000 7f9cba800640 1 -- start start 2024-09-10T10:09:21.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.478+0000 7f9cba800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb4103ff0 0x7f9cb419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:21.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.478+0000 7f9cba800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cb41049a0 0x7f9cb419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:21.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.478+0000 7f9cba800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4109120 0x7f9cb419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:21.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.478+0000 7f9cba800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb41141a0 con 0x7f9cb4109120 2024-09-10T10:09:21.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.478+0000 7f9cba800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb4114020 con 0x7f9cb41049a0 2024-09-10T10:09:21.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.478+0000 7f9cba800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb4114320 con 0x7f9cb4103ff0 2024-09-10T10:09:21.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.478+0000 7f9cb3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4109120 0x7f9cb419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:21.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.478+0000 7f9cb3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4109120 0x7f9cb419eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57426/0 (socket says 172.21.15.50:57426) 2024-09-10T10:09:21.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.478+0000 7f9cb2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cb41049a0 0x7f9cb419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:21.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.478+0000 7f9cb3e00640 1 -- 172.21.15.50:0/2028830090 learned_addr learned my addr 172.21.15.50:0/2028830090 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:21.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.478+0000 7f9cb3400640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb4103ff0 0x7f9cb419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:21.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.479+0000 7f9cb2a00640 1 -- 172.21.15.50:0/2028830090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb4103ff0 msgr2=0x7f9cb419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:21.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.479+0000 7f9cb2a00640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb4103ff0 0x7f9cb419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:21.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.479+0000 7f9cb2a00640 1 -- 172.21.15.50:0/2028830090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4109120 msgr2=0x7f9cb419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:21.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.479+0000 7f9cb2a00640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4109120 0x7f9cb419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:21.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.479+0000 7f9cb2a00640 1 -- 172.21.15.50:0/2028830090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb419f590 con 0x7f9cb41049a0 2024-09-10T10:09:21.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.479+0000 7f9cb3400640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb4103ff0 0x7f9cb419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:21.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.479+0000 7f9cb3e00640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4109120 0x7f9cb419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:21.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.479+0000 7f9cb2a00640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cb41049a0 0x7f9cb419ab20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000e9f0 tx=0x7f9ca000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:21.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.479+0000 7f9cabe00640 1 -- 172.21.15.50:0/2028830090 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca000ccc0 con 0x7f9cb41049a0 2024-09-10T10:09:21.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.479+0000 7f9cba800640 1 -- 172.21.15.50:0/2028830090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb419f880 con 0x7f9cb41049a0 2024-09-10T10:09:21.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.479+0000 7f9cabe00640 1 -- 172.21.15.50:0/2028830090 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ca0005020 con 0x7f9cb41049a0 2024-09-10T10:09:21.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.479+0000 7f9cabe00640 1 -- 172.21.15.50:0/2028830090 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00049e0 con 0x7f9cb41049a0 2024-09-10T10:09:21.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.479+0000 7f9cba800640 1 -- 172.21.15.50:0/2028830090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb41a7160 con 0x7f9cb41049a0 2024-09-10T10:09:21.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.480+0000 7f9cba800640 1 -- 172.21.15.50:0/2028830090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb41043d0 con 0x7f9cb41049a0 2024-09-10T10:09:21.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.484+0000 7f9cabe00640 1 -- 172.21.15.50:0/2028830090 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9ca0005560 con 0x7f9cb41049a0 2024-09-10T10:09:21.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.485+0000 7f9cabe00640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9c980a2b80 0x7f9c980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:21.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.485+0000 7f9cabe00640 1 -- 172.21.15.50:0/2028830090 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f9ca00cf3c0 con 0x7f9cb41049a0 2024-09-10T10:09:21.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.485+0000 7f9cb3400640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9c980a2b80 0x7f9c980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.485+0000 7f9cb3400640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9c980a2b80 0x7f9c980a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009fc0 tx=0x7f9ca4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.486+0000 7f9cabe00640 1 -- 172.21.15.50:0/2028830090 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ca00051d0 con 0x7f9cb41049a0 2024-09-10T10:09:21.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:21.710+0000 7f9cba800640 1 -- 172.21.15.50:0/2028830090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9cb41a7490 con 0x7f9cb41049a0 2024-09-10T10:09:22.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:22.500+0000 7f9cabe00640 1 -- 172.21.15.50:0/2028830090 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f9ca009bff0 con 0x7f9cb41049a0 2024-09-10T10:09:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:22.503+0000 7f9cba800640 1 -- 172.21.15.50:0/2028830090 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9c980a2b80 msgr2=0x7f9c980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:22.503+0000 7f9cba800640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9c980a2b80 0x7f9c980a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009fc0 tx=0x7f9ca4005f90 comp rx=0 tx=0).stop 2024-09-10T10:09:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:22.503+0000 7f9cba800640 1 -- 172.21.15.50:0/2028830090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cb41049a0 msgr2=0x7f9cb419ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:22.503+0000 7f9cba800640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cb41049a0 0x7f9cb419ab20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000e9f0 tx=0x7f9ca000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:09:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:22.503+0000 7f9cba800640 1 -- 172.21.15.50:0/2028830090 shutdown_connections 2024-09-10T10:09:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:22.503+0000 7f9cba800640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9c980a2b80 0x7f9c980a5040 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:22.503+0000 7f9cba800640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb4109120 0x7f9cb419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:22.503+0000 7f9cba800640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cb41049a0 0x7f9cb419ab20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:22.503+0000 7f9cba800640 1 --2- 172.21.15.50:0/2028830090 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cb4103ff0 0x7f9cb419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:22.503+0000 7f9cba800640 1 -- 172.21.15.50:0/2028830090 >> 172.21.15.50:0/2028830090 conn(0x7f9cb40ffa90 msgr2=0x7f9cb41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:22.504+0000 7f9cba800640 1 -- 172.21.15.50:0/2028830090 shutdown_connections 2024-09-10T10:09:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:22.504+0000 7f9cba800640 1 -- 172.21.15.50:0/2028830090 wait complete. 2024-09-10T10:09:22.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:22 smithi189 ceph-mon[34999]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T10:09:22.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:22 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2028830090' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T10:09:22.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:22 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T10:09:22.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:22 smithi084 ceph-mon[34812]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T10:09:22.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:22 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2028830090' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T10:09:22.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:22 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T10:09:22.862 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:22 smithi050 ceph-mon[30354]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T10:09:22.862 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:22 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2028830090' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T10:09:22.862 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:22 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T10:09:23.215 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-10T10:09:23.215 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-10T10:09:23.601 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:23.763 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:23 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T10:09:23.764 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:23 smithi050 ceph-mon[30354]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:09:23.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:23 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T10:09:23.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:23 smithi189 ceph-mon[34999]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:09:23.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:23 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T10:09:23.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:23 smithi084 ceph-mon[34812]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:09:24.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.144+0000 7fa768400640 1 -- 172.21.15.50:0/3682815221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa760102790 msgr2=0x7fa7601067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.144+0000 7fa768400640 1 --2- 172.21.15.50:0/3682815221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa760102790 0x7fa7601067e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009900 tx=0x7fa74c02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.144+0000 7fa768400640 1 -- 172.21.15.50:0/3682815221 shutdown_connections 2024-09-10T10:09:24.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.144+0000 7fa768400640 1 --2- 172.21.15.50:0/3682815221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa760106f10 0x7fa76010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.144+0000 7fa768400640 1 --2- 172.21.15.50:0/3682815221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa760102790 0x7fa7601067e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.144+0000 7fa768400640 1 --2- 172.21.15.50:0/3682815221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa760101de0 0x7fa7601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.144+0000 7fa768400640 1 -- 172.21.15.50:0/3682815221 >> 172.21.15.50:0/3682815221 conn(0x7fa7600fd8c0 msgr2=0x7fa7600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.145+0000 7fa768400640 1 -- 172.21.15.50:0/3682815221 shutdown_connections 2024-09-10T10:09:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.145+0000 7fa768400640 1 -- 172.21.15.50:0/3682815221 wait complete. 2024-09-10T10:09:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.145+0000 7fa768400640 1 Processor -- start 2024-09-10T10:09:24.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.146+0000 7fa768400640 1 -- start start 2024-09-10T10:09:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.146+0000 7fa768400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa760101de0 0x7fa7600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.146+0000 7fa768400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa760102790 0x7fa760074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.146+0000 7fa768400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa760106f10 0x7fa760074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.146+0000 7fa768400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa760111fc0 con 0x7fa760106f10 2024-09-10T10:09:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.146+0000 7fa768400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa760111e40 con 0x7fa760101de0 2024-09-10T10:09:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.146+0000 7fa768400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa760112140 con 0x7fa760102790 2024-09-10T10:09:24.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.146+0000 7fa765a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa760101de0 0x7fa7600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:24.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.146+0000 7fa765a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa760101de0 0x7fa7600744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:56892/0 (socket says 172.21.15.50:56892) 2024-09-10T10:09:24.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.146+0000 7fa765a00640 1 -- 172.21.15.50:0/3443779782 learned_addr learned my addr 172.21.15.50:0/3443779782 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:24.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.146+0000 7fa766400640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa760106f10 0x7fa760074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:24.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.147+0000 7fa765000640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa760102790 0x7fa760074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:24.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.147+0000 7fa765a00640 1 -- 172.21.15.50:0/3443779782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa760102790 msgr2=0x7fa760074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.147+0000 7fa765a00640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa760102790 0x7fa760074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.147+0000 7fa765a00640 1 -- 172.21.15.50:0/3443779782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa760106f10 msgr2=0x7fa760074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.147+0000 7fa765a00640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa760106f10 0x7fa760074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.147+0000 7fa765a00640 1 -- 172.21.15.50:0/3443779782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7601a69a0 con 0x7fa760101de0 2024-09-10T10:09:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.147+0000 7fa765a00640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa760101de0 0x7fa7600744f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa75400d770 tx=0x7fa75400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.147+0000 7fa75e000640 1 -- 172.21.15.50:0/3443779782 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa754017070 con 0x7fa760101de0 2024-09-10T10:09:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.147+0000 7fa768400640 1 -- 172.21.15.50:0/3443779782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7601a6c90 con 0x7fa760101de0 2024-09-10T10:09:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.148+0000 7fa75e000640 1 -- 172.21.15.50:0/3443779782 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa754005500 con 0x7fa760101de0 2024-09-10T10:09:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.148+0000 7fa75e000640 1 -- 172.21.15.50:0/3443779782 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa754004e00 con 0x7fa760101de0 2024-09-10T10:09:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.148+0000 7fa768400640 1 -- 172.21.15.50:0/3443779782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7601a71a0 con 0x7fa760101de0 2024-09-10T10:09:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.149+0000 7fa768400640 1 -- 172.21.15.50:0/3443779782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7601021c0 con 0x7fa760101de0 2024-09-10T10:09:24.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.151+0000 7fa75e000640 1 -- 172.21.15.50:0/3443779782 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa754004fa0 con 0x7fa760101de0 2024-09-10T10:09:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.152+0000 7fa75e000640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa7480a2b80 0x7fa7480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.152+0000 7fa75e000640 1 -- 172.21.15.50:0/3443779782 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fa7540ced40 con 0x7fa760101de0 2024-09-10T10:09:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.152+0000 7fa765000640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa7480a2b80 0x7fa7480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.153+0000 7fa765000640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa7480a2b80 0x7fa7480a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa74c000c00 tx=0x7fa74c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:24.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.154+0000 7fa75e000640 1 -- 172.21.15.50:0/3443779782 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa75409b290 con 0x7fa760101de0 2024-09-10T10:09:24.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.377+0000 7fa768400640 1 -- 172.21.15.50:0/3443779782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fa76010a0f0 con 0x7fa760101de0 2024-09-10T10:09:24.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.515+0000 7fa75e000640 1 -- 172.21.15.50:0/3443779782 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fa7540b9e20 con 0x7fa760101de0 2024-09-10T10:09:24.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.518+0000 7fa768400640 1 -- 172.21.15.50:0/3443779782 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa7480a2b80 msgr2=0x7fa7480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.518+0000 7fa768400640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa7480a2b80 0x7fa7480a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa74c000c00 tx=0x7fa74c005b50 comp rx=0 tx=0).stop 2024-09-10T10:09:24.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.518+0000 7fa768400640 1 -- 172.21.15.50:0/3443779782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa760101de0 msgr2=0x7fa7600744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:24.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.518+0000 7fa768400640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa760101de0 0x7fa7600744f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa75400d770 tx=0x7fa75400dc30 comp rx=0 tx=0).stop 2024-09-10T10:09:24.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.518+0000 7fa768400640 1 -- 172.21.15.50:0/3443779782 shutdown_connections 2024-09-10T10:09:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.518+0000 7fa768400640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa7480a2b80 0x7fa7480a5040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.518+0000 7fa768400640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa760106f10 0x7fa760074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.518+0000 7fa768400640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa760102790 0x7fa760074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.518+0000 7fa768400640 1 --2- 172.21.15.50:0/3443779782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa760101de0 0x7fa7600744f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.518+0000 7fa768400640 1 -- 172.21.15.50:0/3443779782 >> 172.21.15.50:0/3443779782 conn(0x7fa7600fd8c0 msgr2=0x7fa7600febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.518+0000 7fa768400640 1 -- 172.21.15.50:0/3443779782 shutdown_connections 2024-09-10T10:09:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:24.518+0000 7fa768400640 1 -- 172.21.15.50:0/3443779782 wait complete. 2024-09-10T10:09:24.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:24 smithi050 ceph-mon[30354]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T10:09:24.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:24 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3443779782' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-10T10:09:24.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:24 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-10T10:09:24.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:24 smithi189 ceph-mon[34999]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T10:09:24.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:24 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3443779782' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-10T10:09:24.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:24 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-10T10:09:24.852 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:24 smithi084 ceph-mon[34812]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-10T10:09:24.853 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:24 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3443779782' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-10T10:09:24.853 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:24 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-10T10:09:25.308 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T10:09:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:25.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:25 smithi050 ceph-mon[30354]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:09:25.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:25 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T10:09:25.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:25 smithi050 ceph-mon[30354]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T10:09:25.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:25 smithi050 ceph-mon[30354]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:09:25.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:25 smithi050 ceph-mon[30354]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T10:09:25.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:25 smithi050 ceph-mon[30354]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T10:09:25.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:25 smithi189 ceph-mon[34999]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:09:25.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:25 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T10:09:25.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:25 smithi189 ceph-mon[34999]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T10:09:25.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:25 smithi189 ceph-mon[34999]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:09:25.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:25 smithi189 ceph-mon[34999]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T10:09:25.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:25 smithi189 ceph-mon[34999]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T10:09:25.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:25 smithi084 ceph-mon[34812]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:09:25.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:25 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T10:09:25.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:25 smithi084 ceph-mon[34812]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T10:09:25.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:25 smithi084 ceph-mon[34812]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T10:09:25.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:25 smithi084 ceph-mon[34812]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T10:09:25.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:25 smithi084 ceph-mon[34812]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T10:09:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.245+0000 7f5f45a00640 1 -- 172.21.15.50:0/2657337043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f40074ee0 msgr2=0x7f5f4010dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.245+0000 7f5f45a00640 1 --2- 172.21.15.50:0/2657337043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f40074ee0 0x7f5f4010dd20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009900 tx=0x7f5f2802a480 comp rx=0 tx=0).stop 2024-09-10T10:09:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.245+0000 7f5f45a00640 1 -- 172.21.15.50:0/2657337043 shutdown_connections 2024-09-10T10:09:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.245+0000 7f5f45a00640 1 --2- 172.21.15.50:0/2657337043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f4010e260 0x7f5f40110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.245+0000 7f5f45a00640 1 --2- 172.21.15.50:0/2657337043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f40074ee0 0x7f5f4010dd20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.245+0000 7f5f45a00640 1 --2- 172.21.15.50:0/2657337043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f400745c0 0x7f5f400749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.245+0000 7f5f45a00640 1 -- 172.21.15.50:0/2657337043 >> 172.21.15.50:0/2657337043 conn(0x7f5f400fd740 msgr2=0x7f5f400ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.245+0000 7f5f45a00640 1 -- 172.21.15.50:0/2657337043 shutdown_connections 2024-09-10T10:09:26.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.245+0000 7f5f45a00640 1 -- 172.21.15.50:0/2657337043 wait complete. 2024-09-10T10:09:26.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.246+0000 7f5f45a00640 1 Processor -- start 2024-09-10T10:09:26.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.246+0000 7f5f45a00640 1 -- start start 2024-09-10T10:09:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.247+0000 7f5f45a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f400745c0 0x7f5f4019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.247+0000 7f5f45a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f40074ee0 0x7f5f4019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.247+0000 7f5f45a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f4010e260 0x7f5f4019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.247+0000 7f5f45a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5f40113fb0 con 0x7f5f400745c0 2024-09-10T10:09:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.247+0000 7f5f45a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f40113e30 con 0x7f5f40074ee0 2024-09-10T10:09:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.247+0000 7f5f45a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5f40114130 con 0x7f5f4010e260 2024-09-10T10:09:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.247+0000 7f5f3fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f400745c0 0x7f5f4019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.247+0000 7f5f3fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f400745c0 0x7f5f4019a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57450/0 (socket says 172.21.15.50:57450) 2024-09-10T10:09:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.247+0000 7f5f37e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f40074ee0 0x7f5f4019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.247+0000 7f5f3fe00640 1 -- 172.21.15.50:0/2149112836 learned_addr learned my addr 172.21.15.50:0/2149112836 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:26.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.247+0000 7f5f45000640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f4010e260 0x7f5f4019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.248+0000 7f5f3fe00640 1 -- 172.21.15.50:0/2149112836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f4010e260 msgr2=0x7f5f4019ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.248+0000 7f5f3fe00640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f4010e260 0x7f5f4019ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.248+0000 7f5f3fe00640 1 -- 172.21.15.50:0/2149112836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f40074ee0 msgr2=0x7f5f4019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.248+0000 7f5f3fe00640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f40074ee0 0x7f5f4019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.248+0000 7f5f3fe00640 1 -- 172.21.15.50:0/2149112836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4019f440 con 0x7f5f400745c0 2024-09-10T10:09:26.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.248+0000 7f5f37e00640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f40074ee0 0x7f5f4019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:26.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.248+0000 7f5f3fe00640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f400745c0 0x7f5f4019a490 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000e9f0 tx=0x7f5f3000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:26.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.248+0000 7f5f3d600640 1 -- 172.21.15.50:0/2149112836 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000cd80 con 0x7f5f400745c0 2024-09-10T10:09:26.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.248+0000 7f5f3d600640 1 -- 172.21.15.50:0/2149112836 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f30010910 con 0x7f5f400745c0 2024-09-10T10:09:26.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.248+0000 7f5f45a00640 1 -- 172.21.15.50:0/2149112836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4019f730 con 0x7f5f400745c0 2024-09-10T10:09:26.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.248+0000 7f5f3d600640 1 -- 172.21.15.50:0/2149112836 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f30018990 con 0x7f5f400745c0 2024-09-10T10:09:26.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.248+0000 7f5f45a00640 1 -- 172.21.15.50:0/2149112836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f401a7010 con 0x7f5f400745c0 2024-09-10T10:09:26.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.249+0000 7f5f45a00640 1 -- 172.21.15.50:0/2149112836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f40075c70 con 0x7f5f400745c0 2024-09-10T10:09:26.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.251+0000 7f5f3d600640 1 -- 172.21.15.50:0/2149112836 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5f30010ac0 con 0x7f5f400745c0 2024-09-10T10:09:26.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.253+0000 7f5f3d600640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f240a2b80 0x7f5f240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:26.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.253+0000 7f5f3d600640 1 -- 172.21.15.50:0/2149112836 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f5f300cfb30 con 0x7f5f400745c0 2024-09-10T10:09:26.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.253+0000 7f5f37e00640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f240a2b80 0x7f5f240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:26.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.254+0000 7f5f37e00640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f240a2b80 0x7f5f240a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009230 tx=0x7f5f280058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:26.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.255+0000 7f5f3d600640 1 -- 172.21.15.50:0/2149112836 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f3009c080 con 0x7f5f400745c0 2024-09-10T10:09:26.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.481+0000 7f5f45a00640 1 -- 172.21.15.50:0/2149112836 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f5f401093e0 con 0x7f5f400745c0 2024-09-10T10:09:26.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.530+0000 7f5f3d600640 1 -- 172.21.15.50:0/2149112836 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f5f300a0380 con 0x7f5f400745c0 2024-09-10T10:09:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.533+0000 7f5f45a00640 1 -- 172.21.15.50:0/2149112836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f240a2b80 msgr2=0x7f5f240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.533+0000 7f5f45a00640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f240a2b80 0x7f5f240a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009230 tx=0x7f5f280058d0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.533+0000 7f5f45a00640 1 -- 172.21.15.50:0/2149112836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f400745c0 msgr2=0x7f5f4019a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.533+0000 7f5f45a00640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f400745c0 0x7f5f4019a490 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000e9f0 tx=0x7f5f3000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.533+0000 7f5f45a00640 1 -- 172.21.15.50:0/2149112836 shutdown_connections 2024-09-10T10:09:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.533+0000 7f5f45a00640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f240a2b80 0x7f5f240a5040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.533+0000 7f5f45a00640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f4010e260 0x7f5f4019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.533+0000 7f5f45a00640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f40074ee0 0x7f5f4019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.533+0000 7f5f45a00640 1 --2- 172.21.15.50:0/2149112836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f400745c0 0x7f5f4019a490 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:26.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.533+0000 7f5f45a00640 1 -- 172.21.15.50:0/2149112836 >> 172.21.15.50:0/2149112836 conn(0x7f5f400fd740 msgr2=0x7f5f400fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:26.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.533+0000 7f5f45a00640 1 -- 172.21.15.50:0/2149112836 shutdown_connections 2024-09-10T10:09:26.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:26.533+0000 7f5f45a00640 1 -- 172.21.15.50:0/2149112836 wait complete. 2024-09-10T10:09:26.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:26 smithi189 ceph-mon[34999]: pgmap v336: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:09:26.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:26 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] up:active 2024-09-10T10:09:26.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:26 smithi189 ceph-mon[34999]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T10:09:26.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:26 smithi189 ceph-mon[34999]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:09:26.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:26 smithi189 ceph-mon[34999]: Cluster is now healthy 2024-09-10T10:09:26.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:26 smithi189 ceph-mon[34999]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T10:09:26.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:26 smithi189 ceph-mon[34999]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-10T10:09:26.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:26 smithi189 ceph-mon[34999]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-10T10:09:26.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:26 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2149112836' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T10:09:26.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:26 smithi084 ceph-mon[34812]: pgmap v336: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:09:26.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:26 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] up:active 2024-09-10T10:09:26.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:26 smithi084 ceph-mon[34812]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T10:09:26.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:26 smithi084 ceph-mon[34812]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:09:26.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:26 smithi084 ceph-mon[34812]: Cluster is now healthy 2024-09-10T10:09:26.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:26 smithi084 ceph-mon[34812]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T10:09:26.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:26 smithi084 ceph-mon[34812]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-10T10:09:26.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:26 smithi084 ceph-mon[34812]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-10T10:09:26.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:26 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2149112836' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T10:09:26.870 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:26 smithi050 ceph-mon[30354]: pgmap v336: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:09:26.870 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:26 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] up:active 2024-09-10T10:09:26.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:26 smithi050 ceph-mon[30354]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T10:09:26.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:26 smithi050 ceph-mon[30354]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:09:26.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:26 smithi050 ceph-mon[30354]: Cluster is now healthy 2024-09-10T10:09:26.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:26 smithi050 ceph-mon[30354]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T10:09:26.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:26 smithi050 ceph-mon[30354]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-10T10:09:26.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:26 smithi050 ceph-mon[30354]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-10T10:09:26.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:26 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2149112836' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T10:09:27.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T10:09:27.659 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:27.798 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:27 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2149112836' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T10:09:27.798 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:27 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] up:active 2024-09-10T10:09:27.798 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:27 smithi050 ceph-mon[30354]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-10T10:09:27.798 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:27 smithi050 ceph-mon[30354]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:09:27.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:27 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2149112836' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T10:09:27.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:27 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] up:active 2024-09-10T10:09:27.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:27 smithi189 ceph-mon[34999]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-10T10:09:27.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:27 smithi189 ceph-mon[34999]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:09:27.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:27 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2149112836' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T10:09:27.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:27 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] up:active 2024-09-10T10:09:27.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:27 smithi084 ceph-mon[34812]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-10T10:09:27.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:27 smithi084 ceph-mon[34812]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:09:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.189+0000 7f2a95200640 1 -- 172.21.15.50:0/3636927196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a901049a0 msgr2=0x7f2a901089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.189+0000 7f2a95200640 1 --2- 172.21.15.50:0/3636927196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a901049a0 0x7f2a901089f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009860 tx=0x7f2a7802a340 comp rx=0 tx=0).stop 2024-09-10T10:09:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.189+0000 7f2a95200640 1 -- 172.21.15.50:0/3636927196 shutdown_connections 2024-09-10T10:09:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.189+0000 7f2a95200640 1 --2- 172.21.15.50:0/3636927196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90109120 0x7f2a90110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.189+0000 7f2a95200640 1 --2- 172.21.15.50:0/3636927196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a901049a0 0x7f2a901089f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.189+0000 7f2a95200640 1 --2- 172.21.15.50:0/3636927196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a90103ff0 0x7f2a901043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.189+0000 7f2a95200640 1 -- 172.21.15.50:0/3636927196 >> 172.21.15.50:0/3636927196 conn(0x7f2a900ffa90 msgr2=0x7f2a90101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.189+0000 7f2a95200640 1 -- 172.21.15.50:0/3636927196 shutdown_connections 2024-09-10T10:09:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.189+0000 7f2a95200640 1 -- 172.21.15.50:0/3636927196 wait complete. 2024-09-10T10:09:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.190+0000 7f2a95200640 1 Processor -- start 2024-09-10T10:09:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.190+0000 7f2a95200640 1 -- start start 2024-09-10T10:09:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.190+0000 7f2a95200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a90103ff0 0x7f2a9019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:28.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.190+0000 7f2a95200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a901049a0 0x7f2a9019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.190+0000 7f2a95200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a90109120 0x7f2a9019df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a95200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2a90114120 con 0x7f2a901049a0 2024-09-10T10:09:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a95200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2a90113fa0 con 0x7f2a90109120 2024-09-10T10:09:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a95200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2a901142a0 con 0x7f2a90103ff0 2024-09-10T10:09:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a8e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a90109120 0x7f2a9019df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a87e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a901049a0 0x7f2a9019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a8e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a90109120 0x7f2a9019df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:33092/0 (socket says 172.21.15.50:33092) 2024-09-10T10:09:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a8e800640 1 -- 172.21.15.50:0/3149591427 learned_addr learned my addr 172.21.15.50:0/3149591427 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a8de00640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a90103ff0 0x7f2a9019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a87e00640 1 -- 172.21.15.50:0/3149591427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a90103ff0 msgr2=0x7f2a9019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a87e00640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a90103ff0 0x7f2a9019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:28.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a87e00640 1 -- 172.21.15.50:0/3149591427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a90109120 msgr2=0x7f2a9019df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a87e00640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a90109120 0x7f2a9019df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a87e00640 1 -- 172.21.15.50:0/3149591427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9019e6b0 con 0x7f2a901049a0 2024-09-10T10:09:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.191+0000 7f2a8e800640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a90109120 0x7f2a9019df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.192+0000 7f2a87e00640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a901049a0 0x7f2a9019aca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2a78035040 tx=0x7f2a78033b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.192+0000 7f2a86a00640 1 -- 172.21.15.50:0/3149591427 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7803f020 con 0x7f2a901049a0 2024-09-10T10:09:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.192+0000 7f2a86a00640 1 -- 172.21.15.50:0/3149591427 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a78030550 con 0x7f2a901049a0 2024-09-10T10:09:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.192+0000 7f2a86a00640 1 -- 172.21.15.50:0/3149591427 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78037040 con 0x7f2a901049a0 2024-09-10T10:09:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.192+0000 7f2a95200640 1 -- 172.21.15.50:0/3149591427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9019e940 con 0x7f2a901049a0 2024-09-10T10:09:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.192+0000 7f2a95200640 1 -- 172.21.15.50:0/3149591427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a901a7310 con 0x7f2a901049a0 2024-09-10T10:09:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.193+0000 7f2a95200640 1 -- 172.21.15.50:0/3149591427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a901043d0 con 0x7f2a901049a0 2024-09-10T10:09:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.195+0000 7f2a86a00640 1 -- 172.21.15.50:0/3149591427 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2a78042020 con 0x7f2a901049a0 2024-09-10T10:09:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.197+0000 7f2a86a00640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2a740a2c00 0x7f2a740a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.197+0000 7f2a86a00640 1 -- 172.21.15.50:0/3149591427 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f2a780ef410 con 0x7f2a901049a0 2024-09-10T10:09:28.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.197+0000 7f2a8de00640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2a740a2c00 0x7f2a740a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:28.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.198+0000 7f2a8de00640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2a740a2c00 0x7f2a740a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009bd0 tx=0x7f2a80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:28.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.201+0000 7f2a86a00640 1 -- 172.21.15.50:0/3149591427 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a78049020 con 0x7f2a901049a0 2024-09-10T10:09:28.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.422+0000 7f2a95200640 1 -- 172.21.15.50:0/3149591427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f2a9010c360 con 0x7f2a901049a0 2024-09-10T10:09:28.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.538+0000 7f2a86a00640 1 -- 172.21.15.50:0/3149591427 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f2a780bbfb0 con 0x7f2a901049a0 2024-09-10T10:09:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.542+0000 7f2a95200640 1 -- 172.21.15.50:0/3149591427 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2a740a2c00 msgr2=0x7f2a740a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.542+0000 7f2a95200640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2a740a2c00 0x7f2a740a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009bd0 tx=0x7f2a80005f90 comp rx=0 tx=0).stop 2024-09-10T10:09:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.542+0000 7f2a95200640 1 -- 172.21.15.50:0/3149591427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a901049a0 msgr2=0x7f2a9019aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:28.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.542+0000 7f2a95200640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a901049a0 0x7f2a9019aca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2a78035040 tx=0x7f2a78033b60 comp rx=0 tx=0).stop 2024-09-10T10:09:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.542+0000 7f2a95200640 1 -- 172.21.15.50:0/3149591427 shutdown_connections 2024-09-10T10:09:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.542+0000 7f2a95200640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2a740a2c00 0x7f2a740a50c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.542+0000 7f2a95200640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a90109120 0x7f2a9019df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.542+0000 7f2a95200640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a901049a0 0x7f2a9019aca0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.542+0000 7f2a95200640 1 --2- 172.21.15.50:0/3149591427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a90103ff0 0x7f2a9019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.542+0000 7f2a95200640 1 -- 172.21.15.50:0/3149591427 >> 172.21.15.50:0/3149591427 conn(0x7f2a900ffa90 msgr2=0x7f2a90100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.542+0000 7f2a95200640 1 -- 172.21.15.50:0/3149591427 shutdown_connections 2024-09-10T10:09:28.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:28.542+0000 7f2a95200640 1 -- 172.21.15.50:0/3149591427 wait complete. 2024-09-10T10:09:28.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:28 smithi050 ceph-mon[30354]: pgmap v337: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 2 op/s 2024-09-10T10:09:28.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:28 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3149591427' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T10:09:28.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:28 smithi189 ceph-mon[34999]: pgmap v337: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 2 op/s 2024-09-10T10:09:28.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:28 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3149591427' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T10:09:28.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:28 smithi084 ceph-mon[34812]: pgmap v337: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 2 op/s 2024-09-10T10:09:28.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:28 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3149591427' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T10:09:29.234 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-10T10:09:29.234 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T10:09:29.613 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:29.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:29 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3149591427' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T10:09:29.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:29 smithi189 ceph-mon[34999]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:09:29.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:29 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3149591427' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T10:09:29.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:29 smithi084 ceph-mon[34812]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:09:29.899 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:29 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3149591427' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T10:09:29.899 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:29 smithi050 ceph-mon[30354]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:09:30.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.200+0000 7f0d8e200640 1 -- 172.21.15.50:0/748111714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d881049a0 msgr2=0x7f0d881089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:30.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.200+0000 7f0d8e200640 1 --2- 172.21.15.50:0/748111714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d881049a0 0x7f0d881089f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009900 tx=0x7f0d7002a410 comp rx=0 tx=0).stop 2024-09-10T10:09:30.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.200+0000 7f0d8e200640 1 -- 172.21.15.50:0/748111714 shutdown_connections 2024-09-10T10:09:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.200+0000 7f0d8e200640 1 --2- 172.21.15.50:0/748111714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d88109120 0x7f0d88110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.200+0000 7f0d8e200640 1 --2- 172.21.15.50:0/748111714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d881049a0 0x7f0d881089f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.200+0000 7f0d8e200640 1 --2- 172.21.15.50:0/748111714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d88103ff0 0x7f0d881043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.200+0000 7f0d8e200640 1 -- 172.21.15.50:0/748111714 >> 172.21.15.50:0/748111714 conn(0x7f0d880ffa90 msgr2=0x7f0d88101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.200+0000 7f0d8e200640 1 -- 172.21.15.50:0/748111714 shutdown_connections 2024-09-10T10:09:30.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.200+0000 7f0d8e200640 1 -- 172.21.15.50:0/748111714 wait complete. 2024-09-10T10:09:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.201+0000 7f0d8e200640 1 Processor -- start 2024-09-10T10:09:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.201+0000 7f0d8e200640 1 -- start start 2024-09-10T10:09:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.201+0000 7f0d8e200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d88103ff0 0x7f0d8819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:30.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.201+0000 7f0d8e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d881049a0 0x7f0d8819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.201+0000 7f0d8e200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d88109120 0x7f0d8819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.201+0000 7f0d8e200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0d88114140 con 0x7f0d88103ff0 2024-09-10T10:09:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.201+0000 7f0d8e200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0d88113fc0 con 0x7f0d881049a0 2024-09-10T10:09:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.201+0000 7f0d8e200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0d881142c0 con 0x7f0d88109120 2024-09-10T10:09:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.201+0000 7f0d87400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d88103ff0 0x7f0d8819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.202+0000 7f0d87400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d88103ff0 0x7f0d8819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39312/0 (socket says 172.21.15.50:39312) 2024-09-10T10:09:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.202+0000 7f0d87400640 1 -- 172.21.15.50:0/3617911908 learned_addr learned my addr 172.21.15.50:0/3617911908 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.202+0000 7f0d7ea00640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d881049a0 0x7f0d8819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.202+0000 7f0d87e00640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d88109120 0x7f0d8819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.202+0000 7f0d7ea00640 1 -- 172.21.15.50:0/3617911908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d88109120 msgr2=0x7f0d8819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.202+0000 7f0d7ea00640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d88109120 0x7f0d8819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.202+0000 7f0d7ea00640 1 -- 172.21.15.50:0/3617911908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d88103ff0 msgr2=0x7f0d8819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:30.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.202+0000 7f0d7ea00640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d88103ff0 0x7f0d8819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.202+0000 7f0d7ea00640 1 -- 172.21.15.50:0/3617911908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8819f650 con 0x7f0d881049a0 2024-09-10T10:09:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.202+0000 7f0d87400640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d88103ff0 0x7f0d8819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.203+0000 7f0d7ea00640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d881049a0 0x7f0d8819abe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d70005940 tx=0x7f0d700040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:30.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.203+0000 7f0d84c00640 1 -- 172.21.15.50:0/3617911908 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7003f030 con 0x7f0d881049a0 2024-09-10T10:09:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.203+0000 7f0d8e200640 1 -- 172.21.15.50:0/3617911908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8819f8e0 con 0x7f0d881049a0 2024-09-10T10:09:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.203+0000 7f0d84c00640 1 -- 172.21.15.50:0/3617911908 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d700044c0 con 0x7f0d881049a0 2024-09-10T10:09:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.203+0000 7f0d84c00640 1 -- 172.21.15.50:0/3617911908 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70035070 con 0x7f0d881049a0 2024-09-10T10:09:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.203+0000 7f0d8e200640 1 -- 172.21.15.50:0/3617911908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d881a7220 con 0x7f0d881049a0 2024-09-10T10:09:30.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.204+0000 7f0d8e200640 1 -- 172.21.15.50:0/3617911908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d881043d0 con 0x7f0d881049a0 2024-09-10T10:09:30.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.206+0000 7f0d84c00640 1 -- 172.21.15.50:0/3617911908 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0d70042030 con 0x7f0d881049a0 2024-09-10T10:09:30.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.207+0000 7f0d84c00640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d6c0a2b80 0x7f0d6c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:30.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.208+0000 7f0d84c00640 1 -- 172.21.15.50:0/3617911908 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f0d700ef950 con 0x7f0d881049a0 2024-09-10T10:09:30.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.208+0000 7f0d87400640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d6c0a2b80 0x7f0d6c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:30.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.208+0000 7f0d87400640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d6c0a2b80 0x7f0d6c0a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0d78011550 tx=0x7f0d78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:30.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.210+0000 7f0d84c00640 1 -- 172.21.15.50:0/3617911908 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d700bbea0 con 0x7f0d881049a0 2024-09-10T10:09:30.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.421+0000 7f0d8e200640 1 -- 172.21.15.50:0/3617911908 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0d8810c390 con 0x7f0d6c0a2b80 2024-09-10T10:09:30.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.453+0000 7f0d84c00640 1 -- 172.21.15.50:0/3617911908 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0d8810c390 con 0x7f0d6c0a2b80 2024-09-10T10:09:30.454 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:09:30 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:09:30.427+0000 7fa53d800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:09:30.454 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:09:30 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:09:30.427+0000 7fa53d800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:09:30.455 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:09:30 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:09:30.427+0000 7fa53d800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:09:30.455 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:09:30 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:09:30.427+0000 7fa53d800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:09:30.455 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:09:30 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:09:30.427+0000 7fa53d800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:09:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.455+0000 7f0d8e200640 1 -- 172.21.15.50:0/3617911908 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d6c0a2b80 msgr2=0x7f0d6c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.455+0000 7f0d8e200640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d6c0a2b80 0x7f0d6c0a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0d78011550 tx=0x7f0d78005f90 comp rx=0 tx=0).stop 2024-09-10T10:09:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.455+0000 7f0d8e200640 1 -- 172.21.15.50:0/3617911908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d881049a0 msgr2=0x7f0d8819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.455+0000 7f0d8e200640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d881049a0 0x7f0d8819abe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d70005940 tx=0x7f0d700040c0 comp rx=0 tx=0).stop 2024-09-10T10:09:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.455+0000 7f0d8e200640 1 -- 172.21.15.50:0/3617911908 shutdown_connections 2024-09-10T10:09:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.455+0000 7f0d8e200640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d6c0a2b80 0x7f0d6c0a5040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.455+0000 7f0d8e200640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d88109120 0x7f0d8819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.455+0000 7f0d8e200640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d881049a0 0x7f0d8819abe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.455+0000 7f0d8e200640 1 --2- 172.21.15.50:0/3617911908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d88103ff0 0x7f0d8819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.455+0000 7f0d8e200640 1 -- 172.21.15.50:0/3617911908 >> 172.21.15.50:0/3617911908 conn(0x7f0d880ffa90 msgr2=0x7f0d88100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.455+0000 7f0d8e200640 1 -- 172.21.15.50:0/3617911908 shutdown_connections 2024-09-10T10:09:30.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:30.456+0000 7f0d8e200640 1 -- 172.21.15.50:0/3617911908 wait complete. 2024-09-10T10:09:30.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:30 smithi050 ceph-mon[30354]: pgmap v338: 129 pgs: 129 active+clean; 583 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-10T10:09:30.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:30 smithi189 ceph-mon[34999]: pgmap v338: 129 pgs: 129 active+clean; 583 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-10T10:09:30.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:30 smithi084 ceph-mon[34812]: pgmap v338: 129 pgs: 129 active+clean; 583 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-10T10:09:31.190 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T10:09:31.612 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:31.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:31 smithi189 ceph-mon[34999]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:31.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:31 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:09:31.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:31 smithi084 ceph-mon[34812]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:31.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:31 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:09:31.928 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:31 smithi050 ceph-mon[30354]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:31.928 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:31 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:09:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.364+0000 7f4ab8c00640 1 -- 172.21.15.50:0/545159709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab41047e0 msgr2=0x7f4ab4108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.364+0000 7f4ab8c00640 1 --2- 172.21.15.50:0/545159709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab41047e0 0x7f4ab4108830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0009900 tx=0x7f4aa002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:09:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.364+0000 7f4ab8c00640 1 -- 172.21.15.50:0/545159709 shutdown_connections 2024-09-10T10:09:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.364+0000 7f4ab8c00640 1 --2- 172.21.15.50:0/545159709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ab4108f60 0x7f4ab4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.364+0000 7f4ab8c00640 1 --2- 172.21.15.50:0/545159709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab41047e0 0x7f4ab4108830 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.364+0000 7f4ab8c00640 1 --2- 172.21.15.50:0/545159709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ab4103e30 0x7f4ab4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.364+0000 7f4ab8c00640 1 -- 172.21.15.50:0/545159709 >> 172.21.15.50:0/545159709 conn(0x7f4ab40ff8d0 msgr2=0x7f4ab4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.364+0000 7f4ab8c00640 1 -- 172.21.15.50:0/545159709 shutdown_connections 2024-09-10T10:09:32.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.364+0000 7f4ab8c00640 1 -- 172.21.15.50:0/545159709 wait complete. 2024-09-10T10:09:32.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.365+0000 7f4ab8c00640 1 Processor -- start 2024-09-10T10:09:32.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.365+0000 7f4ab8c00640 1 -- start start 2024-09-10T10:09:32.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.366+0000 7f4ab8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ab4103e30 0x7f4ab419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.366+0000 7f4ab8c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ab41047e0 0x7f4ab419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.366+0000 7f4ab8c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab4108f60 0x7f4ab419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.366+0000 7f4ab8c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab4114010 con 0x7f4ab4103e30 2024-09-10T10:09:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.366+0000 7f4ab8c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab4113e90 con 0x7f4ab4108f60 2024-09-10T10:09:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.366+0000 7f4ab8c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab4114190 con 0x7f4ab41047e0 2024-09-10T10:09:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.366+0000 7f4ab3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ab4103e30 0x7f4ab419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.366+0000 7f4ab3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab4108f60 0x7f4ab419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.366+0000 7f4ab3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ab4103e30 0x7f4ab419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39340/0 (socket says 172.21.15.50:39340) 2024-09-10T10:09:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.366+0000 7f4ab3400640 1 -- 172.21.15.50:0/3744838613 learned_addr learned my addr 172.21.15.50:0/3744838613 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.366+0000 7f4ab2a00640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ab41047e0 0x7f4ab419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.366+0000 7f4ab3e00640 1 -- 172.21.15.50:0/3744838613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ab41047e0 msgr2=0x7f4ab419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:32.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.366+0000 7f4ab3e00640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ab41047e0 0x7f4ab419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.367+0000 7f4ab3e00640 1 -- 172.21.15.50:0/3744838613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ab4103e30 msgr2=0x7f4ab419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.367+0000 7f4ab3e00640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ab4103e30 0x7f4ab419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.367+0000 7f4ab3e00640 1 -- 172.21.15.50:0/3744838613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab419f440 con 0x7f4ab4108f60 2024-09-10T10:09:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.367+0000 7f4ab2a00640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ab41047e0 0x7f4ab419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:09:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.367+0000 7f4ab3400640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ab4103e30 0x7f4ab419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.367+0000 7f4ab3e00640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab4108f60 0x7f4ab419ed60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009fd0 tx=0x7f4aac00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.367+0000 7f4aabe00640 1 -- 172.21.15.50:0/3744838613 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00ce20 con 0x7f4ab4108f60 2024-09-10T10:09:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.367+0000 7f4aabe00640 1 -- 172.21.15.50:0/3744838613 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4aac005020 con 0x7f4ab4108f60 2024-09-10T10:09:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.367+0000 7f4ab8c00640 1 -- 172.21.15.50:0/3744838613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab419f730 con 0x7f4ab4108f60 2024-09-10T10:09:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.367+0000 7f4aabe00640 1 -- 172.21.15.50:0/3744838613 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac010720 con 0x7f4ab4108f60 2024-09-10T10:09:32.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.367+0000 7f4ab8c00640 1 -- 172.21.15.50:0/3744838613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab41a7010 con 0x7f4ab4108f60 2024-09-10T10:09:32.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.368+0000 7f4ab8c00640 1 -- 172.21.15.50:0/3744838613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab4104210 con 0x7f4ab4108f60 2024-09-10T10:09:32.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.370+0000 7f4aabe00640 1 -- 172.21.15.50:0/3744838613 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4aac005540 con 0x7f4ab4108f60 2024-09-10T10:09:32.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.371+0000 7f4aabe00640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4a980a2c90 0x7f4a980a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:32.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.371+0000 7f4aabe00640 1 -- 172.21.15.50:0/3744838613 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f4aac0cfb30 con 0x7f4ab4108f60 2024-09-10T10:09:32.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.372+0000 7f4ab3400640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4a980a2c90 0x7f4a980a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:32.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.372+0000 7f4ab3400640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4a980a2c90 0x7f4a980a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4011550 tx=0x7f4aa4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:32.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.375+0000 7f4aabe00640 1 -- 172.21.15.50:0/3744838613 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4aac09c570 con 0x7f4ab4108f60 2024-09-10T10:09:32.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.619+0000 7f4ab8c00640 1 -- 172.21.15.50:0/3744838613 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4ab4062630 con 0x7f4a980a2c90 2024-09-10T10:09:32.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.643+0000 7f4aabe00640 1 -- 172.21.15.50:0/3744838613 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4ab4062630 con 0x7f4a980a2c90 2024-09-10T10:09:32.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.645+0000 7f4ab8c00640 1 -- 172.21.15.50:0/3744838613 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4a980a2c90 msgr2=0x7f4a980a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:32.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.645+0000 7f4ab8c00640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4a980a2c90 0x7f4a980a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4011550 tx=0x7f4aa4005f90 comp rx=0 tx=0).stop 2024-09-10T10:09:32.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.645+0000 7f4ab8c00640 1 -- 172.21.15.50:0/3744838613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab4108f60 msgr2=0x7f4ab419ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:32.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.645+0000 7f4ab8c00640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab4108f60 0x7f4ab419ed60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009fd0 tx=0x7f4aac00ef10 comp rx=0 tx=0).stop 2024-09-10T10:09:32.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.645+0000 7f4ab8c00640 1 -- 172.21.15.50:0/3744838613 shutdown_connections 2024-09-10T10:09:32.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.645+0000 7f4ab8c00640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4a980a2c90 0x7f4a980a5150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:32.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.645+0000 7f4ab8c00640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab4108f60 0x7f4ab419ed60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:32.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.645+0000 7f4ab8c00640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ab41047e0 0x7f4ab419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:32.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.645+0000 7f4ab8c00640 1 --2- 172.21.15.50:0/3744838613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ab4103e30 0x7f4ab419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:32.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.645+0000 7f4ab8c00640 1 -- 172.21.15.50:0/3744838613 >> 172.21.15.50:0/3744838613 conn(0x7f4ab40ff8d0 msgr2=0x7f4ab4100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:32.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.645+0000 7f4ab8c00640 1 -- 172.21.15.50:0/3744838613 shutdown_connections 2024-09-10T10:09:32.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:32.646+0000 7f4ab8c00640 1 -- 172.21.15.50:0/3744838613 wait complete. 2024-09-10T10:09:32.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:32 smithi189 ceph-mon[34999]: pgmap v339: 129 pgs: 129 active+clean; 584 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-10T10:09:32.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:32 smithi189 ceph-mon[34999]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-10T10:09:32.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:32 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:32.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:32 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:32.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:32 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:32.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:32 smithi084 ceph-mon[34812]: pgmap v339: 129 pgs: 129 active+clean; 584 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-10T10:09:32.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:32 smithi084 ceph-mon[34812]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-10T10:09:32.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:32 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:32.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:32 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:32.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:32 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:32.964 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:32 smithi050 ceph-mon[30354]: pgmap v339: 129 pgs: 129 active+clean; 584 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-10T10:09:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:32 smithi050 ceph-mon[30354]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-10T10:09:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:32 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:33.641 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T10:09:33.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:33 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:33.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:33 smithi189 ceph-mon[34999]: from='client.24740 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:33.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:33 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:33.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:33 smithi084 ceph-mon[34812]: from='client.24740 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:33.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:33 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:33.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:33 smithi050 ceph-mon[30354]: from='client.24740 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:34.042 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:34.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.624+0000 7f71bfe00640 1 -- 172.21.15.50:0/3279266758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71c0108f60 msgr2=0x7f71c0110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:34.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.624+0000 7f71bfe00640 1 --2- 172.21.15.50:0/3279266758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71c0108f60 0x7f71c0110ae0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009be0 tx=0x7f71b802a6c0 comp rx=0 tx=0).stop 2024-09-10T10:09:34.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.625+0000 7f71bfe00640 1 -- 172.21.15.50:0/3279266758 shutdown_connections 2024-09-10T10:09:34.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.625+0000 7f71bfe00640 1 --2- 172.21.15.50:0/3279266758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71c0108f60 0x7f71c0110ae0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:34.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.625+0000 7f71bfe00640 1 --2- 172.21.15.50:0/3279266758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71c01047e0 0x7f71c0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:34.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.625+0000 7f71bfe00640 1 --2- 172.21.15.50:0/3279266758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71c0103e30 0x7f71c0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:34.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.625+0000 7f71bfe00640 1 -- 172.21.15.50:0/3279266758 >> 172.21.15.50:0/3279266758 conn(0x7f71c00ff910 msgr2=0x7f71c0101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:34.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.625+0000 7f71bfe00640 1 -- 172.21.15.50:0/3279266758 shutdown_connections 2024-09-10T10:09:34.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.625+0000 7f71bfe00640 1 -- 172.21.15.50:0/3279266758 wait complete. 2024-09-10T10:09:34.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.626+0000 7f71bfe00640 1 Processor -- start 2024-09-10T10:09:34.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.626+0000 7f71bfe00640 1 -- start start 2024-09-10T10:09:34.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.626+0000 7f71bfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71c0103e30 0x7f71c019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:34.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.626+0000 7f71bfe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71c01047e0 0x7f71c019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:34.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.626+0000 7f71bfe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71c0108f60 0x7f71c019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:34.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.626+0000 7f71bfe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f71c0113fc0 con 0x7f71c0108f60 2024-09-10T10:09:34.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.626+0000 7f71bfe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f71c0113e40 con 0x7f71c0103e30 2024-09-10T10:09:34.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.626+0000 7f71bfe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f71c0114140 con 0x7f71c01047e0 2024-09-10T10:09:34.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.627+0000 7f71bf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71c0108f60 0x7f71c019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:34.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.627+0000 7f71bf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71c0108f60 0x7f71c019ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39348/0 (socket says 172.21.15.50:39348) 2024-09-10T10:09:34.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.627+0000 7f71bea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71c0103e30 0x7f71c019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:34.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.627+0000 7f71bf400640 1 -- 172.21.15.50:0/1998004852 learned_addr learned my addr 172.21.15.50:0/1998004852 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:34.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.627+0000 7f71be000640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71c01047e0 0x7f71c019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.627+0000 7f71bea00640 1 -- 172.21.15.50:0/1998004852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71c01047e0 msgr2=0x7f71c019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.627+0000 7f71bea00640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71c01047e0 0x7f71c019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.627+0000 7f71bea00640 1 -- 172.21.15.50:0/1998004852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71c0108f60 msgr2=0x7f71c019ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.627+0000 7f71bea00640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71c0108f60 0x7f71c019ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.627+0000 7f71bea00640 1 -- 172.21.15.50:0/1998004852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c019f3b0 con 0x7f71c0103e30 2024-09-10T10:09:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.627+0000 7f71be000640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71c01047e0 0x7f71c019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:09:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.628+0000 7f71bea00640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71c0103e30 0x7f71c019a400 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71b0005fd0 tx=0x7f71b000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.628+0000 7f71b7400640 1 -- 172.21.15.50:0/1998004852 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b000cd00 con 0x7f71c0103e30 2024-09-10T10:09:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.628+0000 7f71b7400640 1 -- 172.21.15.50:0/1998004852 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b00035f0 con 0x7f71c0103e30 2024-09-10T10:09:34.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.628+0000 7f71bfe00640 1 -- 172.21.15.50:0/1998004852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c019f6a0 con 0x7f71c0103e30 2024-09-10T10:09:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.628+0000 7f71b7400640 1 -- 172.21.15.50:0/1998004852 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0010690 con 0x7f71c0103e30 2024-09-10T10:09:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.628+0000 7f71bfe00640 1 -- 172.21.15.50:0/1998004852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c01a6f80 con 0x7f71c0103e30 2024-09-10T10:09:34.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.629+0000 7f71bfe00640 1 -- 172.21.15.50:0/1998004852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c0105310 con 0x7f71c0103e30 2024-09-10T10:09:34.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.633+0000 7f71b7400640 1 -- 172.21.15.50:0/1998004852 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f71b00037a0 con 0x7f71c0103e30 2024-09-10T10:09:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.634+0000 7f71b7400640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f71a40a2c90 0x7f71a40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.634+0000 7f71b7400640 1 -- 172.21.15.50:0/1998004852 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f71b00cf7a0 con 0x7f71c0103e30 2024-09-10T10:09:34.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.634+0000 7f71be000640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f71a40a2c90 0x7f71a40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.635+0000 7f71be000640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f71a40a2c90 0x7f71a40a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f71c00ffd30 tx=0x7f71ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:34.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.638+0000 7f71b7400640 1 -- 172.21.15.50:0/1998004852 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71b0009510 con 0x7f71c0103e30 2024-09-10T10:09:34.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:34 smithi189 ceph-mon[34999]: pgmap v340: 129 pgs: 129 active+clean; 591 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-10T10:09:34.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:34 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:34.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:34 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:34.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:34 smithi084 ceph-mon[34812]: pgmap v340: 129 pgs: 129 active+clean; 591 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-10T10:09:34.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:34 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:34.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:34 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:34.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.854+0000 7f71bfe00640 1 -- 172.21.15.50:0/1998004852 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f71c0062630 con 0x7f71a40a2c90 2024-09-10T10:09:34.856 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:34 smithi050 ceph-mon[30354]: pgmap v340: 129 pgs: 129 active+clean; 591 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-10T10:09:34.856 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:34 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:34.856 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:34 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:34.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.861+0000 7f71b7400640 1 -- 172.21.15.50:0/1998004852 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f71c0062630 con 0x7f71a40a2c90 2024-09-10T10:09:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:/volumes/qa/sv_0/2b5fbb4e-37b1-4a3b-9c47-ebc398d64b89 2024-09-10T10:09:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.864+0000 7f71bfe00640 1 -- 172.21.15.50:0/1998004852 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f71a40a2c90 msgr2=0x7f71a40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.864+0000 7f71bfe00640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f71a40a2c90 0x7f71a40a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f71c00ffd30 tx=0x7f71ac005f90 comp rx=0 tx=0).stop 2024-09-10T10:09:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.864+0000 7f71bfe00640 1 -- 172.21.15.50:0/1998004852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71c0103e30 msgr2=0x7f71c019a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:34.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.864+0000 7f71bfe00640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71c0103e30 0x7f71c019a400 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71b0005fd0 tx=0x7f71b000ee50 comp rx=0 tx=0).stop 2024-09-10T10:09:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.864+0000 7f71bfe00640 1 -- 172.21.15.50:0/1998004852 shutdown_connections 2024-09-10T10:09:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.864+0000 7f71bfe00640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f71a40a2c90 0x7f71a40a5150 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.864+0000 7f71bfe00640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71c0108f60 0x7f71c019ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.864+0000 7f71bfe00640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71c01047e0 0x7f71c019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.864+0000 7f71bfe00640 1 --2- 172.21.15.50:0/1998004852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71c0103e30 0x7f71c019a400 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.864+0000 7f71bfe00640 1 -- 172.21.15.50:0/1998004852 >> 172.21.15.50:0/1998004852 conn(0x7f71c00ff910 msgr2=0x7f71c0100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.864+0000 7f71bfe00640 1 -- 172.21.15.50:0/1998004852 shutdown_connections 2024-09-10T10:09:34.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:34.864+0000 7f71bfe00640 1 -- 172.21.15.50:0/1998004852 wait complete. 2024-09-10T10:09:35.614 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T10:09:35.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:09:35.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:09:35.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:35.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:09:35.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:09:35.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:35.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:09:35.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:09:35.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:09:35.993 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:36.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.575+0000 7f1919c00640 1 -- 172.21.15.50:0/58223024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19141049a0 msgr2=0x7f19141089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:36.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.575+0000 7f1919c00640 1 --2- 172.21.15.50:0/58223024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19141049a0 0x7f19141089f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009900 tx=0x7f18fc02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:09:36.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.575+0000 7f1919c00640 1 -- 172.21.15.50:0/58223024 shutdown_connections 2024-09-10T10:09:36.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.575+0000 7f1919c00640 1 --2- 172.21.15.50:0/58223024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1914109120 0x7f1914110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:36.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.575+0000 7f1919c00640 1 --2- 172.21.15.50:0/58223024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19141049a0 0x7f19141089f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:36.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.575+0000 7f1919c00640 1 --2- 172.21.15.50:0/58223024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1914103ff0 0x7f19141043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:36.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.575+0000 7f1919c00640 1 -- 172.21.15.50:0/58223024 >> 172.21.15.50:0/58223024 conn(0x7f19140ffa90 msgr2=0x7f1914101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:36.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.575+0000 7f1919c00640 1 -- 172.21.15.50:0/58223024 shutdown_connections 2024-09-10T10:09:36.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.575+0000 7f1919c00640 1 -- 172.21.15.50:0/58223024 wait complete. 2024-09-10T10:09:36.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.576+0000 7f1919c00640 1 Processor -- start 2024-09-10T10:09:36.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.576+0000 7f1919c00640 1 -- start start 2024-09-10T10:09:36.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1919c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1914103ff0 0x7f19141a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:36.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1919c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1914109120 0x7f19141a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:36.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1919c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f191419a680 0x7f191419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:36.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1919c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1914114190 con 0x7f1914109120 2024-09-10T10:09:36.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1919c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1914114010 con 0x7f1914103ff0 2024-09-10T10:09:36.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1919c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1914114310 con 0x7f191419a680 2024-09-10T10:09:36.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1912a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1914103ff0 0x7f19141a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f190a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1914109120 0x7f19141a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1912a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1914103ff0 0x7f19141a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:33204/0 (socket says 172.21.15.50:33204) 2024-09-10T10:09:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1912a00640 1 -- 172.21.15.50:0/1836865799 learned_addr learned my addr 172.21.15.50:0/1836865799 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1913400640 1 --2- 172.21.15.50:0/1836865799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f191419a680 0x7f191419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1912a00640 1 -- 172.21.15.50:0/1836865799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f191419a680 msgr2=0x7f191419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1912a00640 1 --2- 172.21.15.50:0/1836865799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f191419a680 0x7f191419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1912a00640 1 -- 172.21.15.50:0/1836865799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1914109120 msgr2=0x7f19141a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1912a00640 1 --2- 172.21.15.50:0/1836865799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1914109120 0x7f19141a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.577+0000 7f1912a00640 1 -- 172.21.15.50:0/1836865799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191419b230 con 0x7f1914103ff0 2024-09-10T10:09:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.578+0000 7f1912a00640 1 --2- 172.21.15.50:0/1836865799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1914103ff0 0x7f19141a05b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f190400e9f0 tx=0x7f190400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:36.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.578+0000 7f190be00640 1 -- 172.21.15.50:0/1836865799 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190400ccc0 con 0x7f1914103ff0 2024-09-10T10:09:36.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.578+0000 7f190be00640 1 -- 172.21.15.50:0/1836865799 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f190400ce60 con 0x7f1914103ff0 2024-09-10T10:09:36.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.578+0000 7f190be00640 1 -- 172.21.15.50:0/1836865799 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904010690 con 0x7f1914103ff0 2024-09-10T10:09:36.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.578+0000 7f1919c00640 1 -- 172.21.15.50:0/1836865799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19141a7360 con 0x7f1914103ff0 2024-09-10T10:09:36.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.578+0000 7f1919c00640 1 -- 172.21.15.50:0/1836865799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19141a7700 con 0x7f1914103ff0 2024-09-10T10:09:36.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.580+0000 7f1919c00640 1 -- 172.21.15.50:0/1836865799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19141054d0 con 0x7f1914103ff0 2024-09-10T10:09:36.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.581+0000 7f190be00640 1 -- 172.21.15.50:0/1836865799 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f19040046c0 con 0x7f1914103ff0 2024-09-10T10:09:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.582+0000 7f190be00640 1 --2- 172.21.15.50:0/1836865799 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f18f80a2c90 0x7f18f80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.583+0000 7f190be00640 1 -- 172.21.15.50:0/1836865799 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f19040cf8f0 con 0x7f1914103ff0 2024-09-10T10:09:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.583+0000 7f190a000640 1 --2- 172.21.15.50:0/1836865799 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f18f80a2c90 0x7f18f80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.583+0000 7f190a000640 1 --2- 172.21.15.50:0/1836865799 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f18f80a2c90 0x7f18f80a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f18fc006010 tx=0x7f18fc0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:36.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.587+0000 7f190be00640 1 -- 172.21.15.50:0/1836865799 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f190409c330 con 0x7f1914103ff0 2024-09-10T10:09:36.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:36 smithi050 ceph-mon[30354]: pgmap v341: 129 pgs: 129 active+clean; 591 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-09-10T10:09:36.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:36 smithi050 ceph-mon[30354]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:36.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.805+0000 7f1919c00640 1 -- 172.21.15.50:0/1836865799 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f191410c3d0 con 0x7f18f80a2c90 2024-09-10T10:09:36.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:36 smithi189 ceph-mon[34999]: pgmap v341: 129 pgs: 129 active+clean; 591 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-09-10T10:09:36.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:36 smithi189 ceph-mon[34999]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:36.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.835+0000 7f190be00640 1 -- 172.21.15.50:0/1836865799 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f18fc004140 con 0x7f18f80a2c90 2024-09-10T10:09:36.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.837+0000 7f1919c00640 1 -- 172.21.15.50:0/1836865799 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f18f80a2c90 msgr2=0x7f18f80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:36.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.837+0000 7f1919c00640 1 --2- 172.21.15.50:0/1836865799 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f18f80a2c90 0x7f18f80a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f18fc006010 tx=0x7f18fc0046c0 comp rx=0 tx=0).stop 2024-09-10T10:09:36.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.837+0000 7f1919c00640 1 -- 172.21.15.50:0/1836865799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1914103ff0 msgr2=0x7f19141a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:36.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.837+0000 7f1919c00640 1 --2- 172.21.15.50:0/1836865799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1914103ff0 0x7f19141a05b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f190400e9f0 tx=0x7f190400edf0 comp rx=0 tx=0).stop 2024-09-10T10:09:36.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.837+0000 7f1919c00640 1 -- 172.21.15.50:0/1836865799 shutdown_connections 2024-09-10T10:09:36.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.837+0000 7f1919c00640 1 --2- 172.21.15.50:0/1836865799 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f18f80a2c90 0x7f18f80a5150 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:36.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.837+0000 7f1919c00640 1 --2- 172.21.15.50:0/1836865799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f191419a680 0x7f191419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:36.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.837+0000 7f1919c00640 1 --2- 172.21.15.50:0/1836865799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1914109120 0x7f19141a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:36.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.837+0000 7f1919c00640 1 --2- 172.21.15.50:0/1836865799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1914103ff0 0x7f19141a05b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:36.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.837+0000 7f1919c00640 1 -- 172.21.15.50:0/1836865799 >> 172.21.15.50:0/1836865799 conn(0x7f19140ffa90 msgr2=0x7f19141002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:36.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.837+0000 7f1919c00640 1 -- 172.21.15.50:0/1836865799 shutdown_connections 2024-09-10T10:09:36.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:36.837+0000 7f1919c00640 1 -- 172.21.15.50:0/1836865799 wait complete. 2024-09-10T10:09:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:36 smithi084 ceph-mon[34812]: pgmap v341: 129 pgs: 129 active+clean; 591 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-09-10T10:09:36.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:36 smithi084 ceph-mon[34812]: from='client.24746 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:37.600 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T10:09:37.997 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:38.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.602+0000 7fa311400640 1 -- 172.21.15.50:0/1774509812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c1047e0 msgr2=0x7fa30c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:38.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.602+0000 7fa311400640 1 --2- 172.21.15.50:0/1774509812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c1047e0 0x7fa30c108830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009900 tx=0x7fa2f402a410 comp rx=0 tx=0).stop 2024-09-10T10:09:38.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.602+0000 7fa311400640 1 -- 172.21.15.50:0/1774509812 shutdown_connections 2024-09-10T10:09:38.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.602+0000 7fa311400640 1 --2- 172.21.15.50:0/1774509812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa30c108f60 0x7fa30c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:38.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.602+0000 7fa311400640 1 --2- 172.21.15.50:0/1774509812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c1047e0 0x7fa30c108830 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:38.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.602+0000 7fa311400640 1 --2- 172.21.15.50:0/1774509812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c103e30 0x7fa30c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:38.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.602+0000 7fa311400640 1 -- 172.21.15.50:0/1774509812 >> 172.21.15.50:0/1774509812 conn(0x7fa30c0ff8d0 msgr2=0x7fa30c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:38.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.602+0000 7fa311400640 1 -- 172.21.15.50:0/1774509812 shutdown_connections 2024-09-10T10:09:38.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.602+0000 7fa311400640 1 -- 172.21.15.50:0/1774509812 wait complete. 2024-09-10T10:09:38.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.603+0000 7fa311400640 1 Processor -- start 2024-09-10T10:09:38.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.603+0000 7fa311400640 1 -- start start 2024-09-10T10:09:38.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.603+0000 7fa311400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c103e30 0x7fa30c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:38.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.603+0000 7fa311400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa30c1047e0 0x7fa30c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:38.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.603+0000 7fa311400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c108f60 0x7fa30c19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:38.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.603+0000 7fa311400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c113fc0 con 0x7fa30c108f60 2024-09-10T10:09:38.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.603+0000 7fa311400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c113e40 con 0x7fa30c1047e0 2024-09-10T10:09:38.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.603+0000 7fa311400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c114140 con 0x7fa30c103e30 2024-09-10T10:09:38.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.604+0000 7fa310a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c108f60 0x7fa30c19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:38.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.604+0000 7fa303400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa30c1047e0 0x7fa30c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:38.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.604+0000 7fa303400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa30c1047e0 0x7fa30c19a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:32894/0 (socket says 172.21.15.50:32894) 2024-09-10T10:09:38.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.604+0000 7fa303400640 1 -- 172.21.15.50:0/3079620285 learned_addr learned my addr 172.21.15.50:0/3079620285 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:38.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.604+0000 7fa310a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c108f60 0x7fa30c19ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49708/0 (socket says 172.21.15.50:49708) 2024-09-10T10:09:38.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.604+0000 7fa30be00640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c103e30 0x7fa30c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:38.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.604+0000 7fa303400640 1 -- 172.21.15.50:0/3079620285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c103e30 msgr2=0x7fa30c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:38.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.604+0000 7fa303400640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c103e30 0x7fa30c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:38.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.604+0000 7fa303400640 1 -- 172.21.15.50:0/3079620285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c108f60 msgr2=0x7fa30c19ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:38.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.604+0000 7fa303400640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c108f60 0x7fa30c19ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:38.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.604+0000 7fa303400640 1 -- 172.21.15.50:0/3079620285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30c19f430 con 0x7fa30c1047e0 2024-09-10T10:09:38.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.604+0000 7fa30be00640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c103e30 0x7fa30c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:09:38.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.604+0000 7fa303400640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa30c1047e0 0x7fa30c19a9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4006010 tx=0x7fa2f40042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.605+0000 7fa309600640 1 -- 172.21.15.50:0/3079620285 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f403f030 con 0x7fa30c1047e0 2024-09-10T10:09:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.605+0000 7fa311400640 1 -- 172.21.15.50:0/3079620285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa30c19f6c0 con 0x7fa30c1047e0 2024-09-10T10:09:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.605+0000 7fa309600640 1 -- 172.21.15.50:0/3079620285 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2f4003ce0 con 0x7fa30c1047e0 2024-09-10T10:09:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.605+0000 7fa311400640 1 -- 172.21.15.50:0/3079620285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa30c1a7000 con 0x7fa30c1047e0 2024-09-10T10:09:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.605+0000 7fa309600640 1 -- 172.21.15.50:0/3079620285 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4035070 con 0x7fa30c1047e0 2024-09-10T10:09:38.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.606+0000 7fa311400640 1 -- 172.21.15.50:0/3079620285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa30c104210 con 0x7fa30c1047e0 2024-09-10T10:09:38.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.608+0000 7fa309600640 1 -- 172.21.15.50:0/3079620285 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa2f4042030 con 0x7fa30c1047e0 2024-09-10T10:09:38.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.609+0000 7fa309600640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa2f00a2c90 0x7fa2f00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:38.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.609+0000 7fa309600640 1 -- 172.21.15.50:0/3079620285 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fa2f40efb20 con 0x7fa30c1047e0 2024-09-10T10:09:38.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.609+0000 7fa30be00640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa2f00a2c90 0x7fa2f00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:38.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.610+0000 7fa30be00640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa2f00a2c90 0x7fa2f00a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0058c0 tx=0x7fa2fc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:38.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.613+0000 7fa309600640 1 -- 172.21.15.50:0/3079620285 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2f40bc620 con 0x7fa30c1047e0 2024-09-10T10:09:38.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:38 smithi050 ceph-mon[30354]: pgmap v342: 129 pgs: 129 active+clean; 609 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-09-10T10:09:38.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:38 smithi050 ceph-mon[30354]: from='client.24752 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.827+0000 7fa311400640 1 -- 172.21.15.50:0/3079620285 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fa30c062630 con 0x7fa2f00a2c90 2024-09-10T10:09:38.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.831+0000 7fa309600640 1 -- 172.21.15.50:0/3079620285 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa30c062630 con 0x7fa2f00a2c90 2024-09-10T10:09:38.833 INFO:teuthology.orchestra.run.smithi050.stdout:/volumes/qa/sv_1/1df80b48-a991-4aee-be18-584505af10da 2024-09-10T10:09:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.834+0000 7fa311400640 1 -- 172.21.15.50:0/3079620285 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa2f00a2c90 msgr2=0x7fa2f00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.834+0000 7fa311400640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa2f00a2c90 0x7fa2f00a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0058c0 tx=0x7fa2fc005850 comp rx=0 tx=0).stop 2024-09-10T10:09:38.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.834+0000 7fa311400640 1 -- 172.21.15.50:0/3079620285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa30c1047e0 msgr2=0x7fa30c19a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.834+0000 7fa311400640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa30c1047e0 0x7fa30c19a9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4006010 tx=0x7fa2f40042f0 comp rx=0 tx=0).stop 2024-09-10T10:09:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.834+0000 7fa311400640 1 -- 172.21.15.50:0/3079620285 shutdown_connections 2024-09-10T10:09:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.834+0000 7fa311400640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa2f00a2c90 0x7fa2f00a5150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.834+0000 7fa311400640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa30c108f60 0x7fa30c19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.834+0000 7fa311400640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa30c1047e0 0x7fa30c19a9c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.834+0000 7fa311400640 1 --2- 172.21.15.50:0/3079620285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa30c103e30 0x7fa30c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.834+0000 7fa311400640 1 -- 172.21.15.50:0/3079620285 >> 172.21.15.50:0/3079620285 conn(0x7fa30c0ff8d0 msgr2=0x7fa30c100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.834+0000 7fa311400640 1 -- 172.21.15.50:0/3079620285 shutdown_connections 2024-09-10T10:09:38.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:38.834+0000 7fa311400640 1 -- 172.21.15.50:0/3079620285 wait complete. 2024-09-10T10:09:38.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:38 smithi189 ceph-mon[34999]: pgmap v342: 129 pgs: 129 active+clean; 609 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-09-10T10:09:38.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:38 smithi189 ceph-mon[34999]: from='client.24752 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:38.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:38 smithi084 ceph-mon[34812]: pgmap v342: 129 pgs: 129 active+clean; 609 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-09-10T10:09:38.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:38 smithi084 ceph-mon[34812]: from='client.24752 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:39.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:09:39.996 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:40.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.557+0000 7f0ce1200640 1 -- 172.21.15.50:0/2149037817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc077040 msgr2=0x7f0cdc112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:40.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.557+0000 7f0ce1200640 1 --2- 172.21.15.50:0/2149037817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc077040 0x7f0cdc112330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4009900 tx=0x7f0cc402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:09:40.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.557+0000 7f0ce1200640 1 -- 172.21.15.50:0/2149037817 shutdown_connections 2024-09-10T10:09:40.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.557+0000 7f0ce1200640 1 --2- 172.21.15.50:0/2149037817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc112870 0x7f0cdc114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:40.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.557+0000 7f0ce1200640 1 --2- 172.21.15.50:0/2149037817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc077040 0x7f0cdc112330 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:40.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.557+0000 7f0ce1200640 1 --2- 172.21.15.50:0/2149037817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cdc076720 0x7f0cdc076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:40.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.557+0000 7f0ce1200640 1 -- 172.21.15.50:0/2149037817 >> 172.21.15.50:0/2149037817 conn(0x7f0cdc0ff8d0 msgr2=0x7f0cdc101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:40.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.557+0000 7f0ce1200640 1 -- 172.21.15.50:0/2149037817 shutdown_connections 2024-09-10T10:09:40.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.557+0000 7f0ce1200640 1 -- 172.21.15.50:0/2149037817 wait complete. 2024-09-10T10:09:40.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.559+0000 7f0ce1200640 1 Processor -- start 2024-09-10T10:09:40.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.559+0000 7f0ce1200640 1 -- start start 2024-09-10T10:09:40.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.559+0000 7f0ce1200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cdc076720 0x7f0cdc1a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:40.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.559+0000 7f0ce1200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc077040 0x7f0cdc1a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:40.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.559+0000 7f0ce1200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc112870 0x7f0cdc19e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:40.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.559+0000 7f0ce1200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0cdc118430 con 0x7f0cdc112870 2024-09-10T10:09:40.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.559+0000 7f0ce1200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0cdc1182b0 con 0x7f0cdc077040 2024-09-10T10:09:40.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.559+0000 7f0ce1200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0cdc1185b0 con 0x7f0cdc076720 2024-09-10T10:09:40.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.560+0000 7f0cd2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc077040 0x7f0cdc1a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:40.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.560+0000 7f0cd2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc077040 0x7f0cdc1a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:32910/0 (socket says 172.21.15.50:32910) 2024-09-10T10:09:40.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.560+0000 7f0cd2a00640 1 -- 172.21.15.50:0/1315087231 learned_addr learned my addr 172.21.15.50:0/1315087231 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:40.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.560+0000 7f0cdbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc112870 0x7f0cdc19e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:40.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.560+0000 7f0cdb400640 1 --2- 172.21.15.50:0/1315087231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cdc076720 0x7f0cdc1a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:40.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.560+0000 7f0cd2a00640 1 -- 172.21.15.50:0/1315087231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cdc076720 msgr2=0x7f0cdc1a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:40.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.560+0000 7f0cd2a00640 1 --2- 172.21.15.50:0/1315087231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cdc076720 0x7f0cdc1a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:40.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.560+0000 7f0cd2a00640 1 -- 172.21.15.50:0/1315087231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc112870 msgr2=0x7f0cdc19e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:40.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.560+0000 7f0cd2a00640 1 --2- 172.21.15.50:0/1315087231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc112870 0x7f0cdc19e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:40.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.560+0000 7f0cd2a00640 1 -- 172.21.15.50:0/1315087231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cdc19efc0 con 0x7f0cdc077040 2024-09-10T10:09:40.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.561+0000 7f0cd2a00640 1 --2- 172.21.15.50:0/1315087231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc077040 0x7f0cdc1a4bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4004770 tx=0x7f0cc4003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:40.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.561+0000 7f0cd8c00640 1 -- 172.21.15.50:0/1315087231 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc403f070 con 0x7f0cdc077040 2024-09-10T10:09:40.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.561+0000 7f0cd8c00640 1 -- 172.21.15.50:0/1315087231 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cc4031ca0 con 0x7f0cdc077040 2024-09-10T10:09:40.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.561+0000 7f0cd8c00640 1 -- 172.21.15.50:0/1315087231 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4035030 con 0x7f0cdc077040 2024-09-10T10:09:40.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.561+0000 7f0ce1200640 1 -- 172.21.15.50:0/1315087231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cdc19f250 con 0x7f0cdc077040 2024-09-10T10:09:40.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.561+0000 7f0ce1200640 1 -- 172.21.15.50:0/1315087231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cdc1ab430 con 0x7f0cdc077040 2024-09-10T10:09:40.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.562+0000 7f0ce1200640 1 -- 172.21.15.50:0/1315087231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cdc077e60 con 0x7f0cdc077040 2024-09-10T10:09:40.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.564+0000 7f0cd8c00640 1 -- 172.21.15.50:0/1315087231 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0cc4042070 con 0x7f0cdc077040 2024-09-10T10:09:40.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.566+0000 7f0cd8c00640 1 --2- 172.21.15.50:0/1315087231 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0cc00a2c10 0x7f0cc00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:40.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.566+0000 7f0cd8c00640 1 -- 172.21.15.50:0/1315087231 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f0cc40f01d0 con 0x7f0cdc077040 2024-09-10T10:09:40.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.566+0000 7f0cdb400640 1 --2- 172.21.15.50:0/1315087231 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0cc00a2c10 0x7f0cc00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:40.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.566+0000 7f0cdb400640 1 --2- 172.21.15.50:0/1315087231 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0cc00a2c10 0x7f0cc00a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc005d00 tx=0x7f0ccc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:40.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.568+0000 7f0cd8c00640 1 -- 172.21.15.50:0/1315087231 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0cc40bc5c0 con 0x7f0cdc077040 2024-09-10T10:09:40.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:40 smithi050 ceph-mon[30354]: pgmap v343: 129 pgs: 129 active+clean; 609 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-09-10T10:09:40.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:40 smithi050 ceph-mon[30354]: from='client.24758 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:40.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.793+0000 7f0ce1200640 1 -- 172.21.15.50:0/1315087231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cdc10da00 con 0x7f0cdc077040 2024-09-10T10:09:40.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.794+0000 7f0cd8c00640 1 -- 172.21.15.50:0/1315087231 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11912 (secure 0 0 0) 0x7f0cc40c08c0 con 0x7f0cdc077040 2024-09-10T10:09:40.796 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:09:40.796 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"btime":"2024-09-10T10:09:28:538200+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:09:28.424047+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24517,24521,24560]},"id":1}]} 2024-09-10T10:09:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2024-09-10T10:09:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.797+0000 7f0ce1200640 1 -- 172.21.15.50:0/1315087231 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0cc00a2c10 msgr2=0x7f0cc00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.797+0000 7f0ce1200640 1 --2- 172.21.15.50:0/1315087231 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0cc00a2c10 0x7f0cc00a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc005d00 tx=0x7f0ccc00b410 comp rx=0 tx=0).stop 2024-09-10T10:09:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.797+0000 7f0ce1200640 1 -- 172.21.15.50:0/1315087231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc077040 msgr2=0x7f0cdc1a4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.797+0000 7f0ce1200640 1 --2- 172.21.15.50:0/1315087231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc077040 0x7f0cdc1a4bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4004770 tx=0x7f0cc4003c10 comp rx=0 tx=0).stop 2024-09-10T10:09:40.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.797+0000 7f0ce1200640 1 -- 172.21.15.50:0/1315087231 shutdown_connections 2024-09-10T10:09:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.797+0000 7f0ce1200640 1 --2- 172.21.15.50:0/1315087231 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0cc00a2c10 0x7f0cc00a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.797+0000 7f0ce1200640 1 --2- 172.21.15.50:0/1315087231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cdc112870 0x7f0cdc19e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.797+0000 7f0ce1200640 1 --2- 172.21.15.50:0/1315087231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cdc077040 0x7f0cdc1a4bc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.797+0000 7f0ce1200640 1 --2- 172.21.15.50:0/1315087231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cdc076720 0x7f0cdc1a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.797+0000 7f0ce1200640 1 -- 172.21.15.50:0/1315087231 >> 172.21.15.50:0/1315087231 conn(0x7f0cdc0ff8d0 msgr2=0x7f0cdc101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.797+0000 7f0ce1200640 1 -- 172.21.15.50:0/1315087231 shutdown_connections 2024-09-10T10:09:40.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:40.797+0000 7f0ce1200640 1 -- 172.21.15.50:0/1315087231 wait complete. 2024-09-10T10:09:40.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:40 smithi189 ceph-mon[34999]: pgmap v343: 129 pgs: 129 active+clean; 609 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-09-10T10:09:40.837 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:40 smithi189 ceph-mon[34999]: from='client.24758 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:40.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:40 smithi084 ceph-mon[34812]: pgmap v343: 129 pgs: 129 active+clean; 609 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-09-10T10:09:40.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:40 smithi084 ceph-mon[34812]: from='client.24758 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:09:41.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:09:41.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:41 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1315087231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:09:41.889 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:41.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:41 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1315087231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:09:42.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:41 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1315087231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:09:42.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.425+0000 7f51eea00640 1 -- 172.21.15.50:0/3049301894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e8103ff0 msgr2=0x7f51e81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:42.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.425+0000 7f51eea00640 1 --2- 172.21.15.50:0/3049301894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e8103ff0 0x7f51e81043d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009900 tx=0x7f51d802a410 comp rx=0 tx=0).stop 2024-09-10T10:09:42.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.425+0000 7f51eea00640 1 -- 172.21.15.50:0/3049301894 shutdown_connections 2024-09-10T10:09:42.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.425+0000 7f51eea00640 1 --2- 172.21.15.50:0/3049301894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51e8109120 0x7f51e8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:42.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.425+0000 7f51eea00640 1 --2- 172.21.15.50:0/3049301894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51e81049a0 0x7f51e81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:42.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.425+0000 7f51eea00640 1 --2- 172.21.15.50:0/3049301894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e8103ff0 0x7f51e81043d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:42.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.425+0000 7f51eea00640 1 -- 172.21.15.50:0/3049301894 >> 172.21.15.50:0/3049301894 conn(0x7f51e80ffa90 msgr2=0x7f51e8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:42.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.426+0000 7f51eea00640 1 -- 172.21.15.50:0/3049301894 shutdown_connections 2024-09-10T10:09:42.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.426+0000 7f51eea00640 1 -- 172.21.15.50:0/3049301894 wait complete. 2024-09-10T10:09:42.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.426+0000 7f51eea00640 1 Processor -- start 2024-09-10T10:09:42.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.427+0000 7f51eea00640 1 -- start start 2024-09-10T10:09:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.427+0000 7f51eea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e8103ff0 0x7f51e819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:42.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.427+0000 7f51eea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51e81049a0 0x7f51e819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:42.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.427+0000 7f51eea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51e8109120 0x7f51e819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:42.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.427+0000 7f51eea00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f51e8114190 con 0x7f51e8103ff0 2024-09-10T10:09:42.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.427+0000 7f51eea00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f51e8114010 con 0x7f51e81049a0 2024-09-10T10:09:42.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.427+0000 7f51eea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f51e8114310 con 0x7f51e8109120 2024-09-10T10:09:42.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.427+0000 7f51e7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e8103ff0 0x7f51e819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:42.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.427+0000 7f51e7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e8103ff0 0x7f51e819a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49738/0 (socket says 172.21.15.50:49738) 2024-09-10T10:09:42.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.427+0000 7f51e7e00640 1 -- 172.21.15.50:0/1614296157 learned_addr learned my addr 172.21.15.50:0/1614296157 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:42.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.427+0000 7f51dfe00640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51e81049a0 0x7f51e819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:42.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.428+0000 7f51eca00640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51e8109120 0x7f51e819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:42.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.428+0000 7f51e7e00640 1 -- 172.21.15.50:0/1614296157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51e8109120 msgr2=0x7f51e819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:42.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.428+0000 7f51e7e00640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51e8109120 0x7f51e819ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:42.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.428+0000 7f51e7e00640 1 -- 172.21.15.50:0/1614296157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51e81049a0 msgr2=0x7f51e819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:42.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.428+0000 7f51e7e00640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51e81049a0 0x7f51e819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:42.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.428+0000 7f51e7e00640 1 -- 172.21.15.50:0/1614296157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e819f640 con 0x7f51e8103ff0 2024-09-10T10:09:42.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.428+0000 7f51e7e00640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e8103ff0 0x7f51e819a690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f51d8004770 tx=0x7f51d8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:42.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.428+0000 7f51e5600640 1 -- 172.21.15.50:0/1614296157 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d803f070 con 0x7f51e8103ff0 2024-09-10T10:09:42.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.428+0000 7f51e5600640 1 -- 172.21.15.50:0/1614296157 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51d8031ca0 con 0x7f51e8103ff0 2024-09-10T10:09:42.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.428+0000 7f51e5600640 1 -- 172.21.15.50:0/1614296157 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d8035030 con 0x7f51e8103ff0 2024-09-10T10:09:42.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.428+0000 7f51eea00640 1 -- 172.21.15.50:0/1614296157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e819f8d0 con 0x7f51e8103ff0 2024-09-10T10:09:42.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.429+0000 7f51eea00640 1 -- 172.21.15.50:0/1614296157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e81a7210 con 0x7f51e8103ff0 2024-09-10T10:09:42.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.430+0000 7f51eea00640 1 -- 172.21.15.50:0/1614296157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e81054d0 con 0x7f51e8103ff0 2024-09-10T10:09:42.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.432+0000 7f51e5600640 1 -- 172.21.15.50:0/1614296157 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f51d8042070 con 0x7f51e8103ff0 2024-09-10T10:09:42.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.433+0000 7f51e5600640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f51cc0a2c10 0x7f51cc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:42.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.433+0000 7f51e5600640 1 -- 172.21.15.50:0/1614296157 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f51d80f0110 con 0x7f51e8103ff0 2024-09-10T10:09:42.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.433+0000 7f51dfe00640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f51cc0a2c10 0x7f51cc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:42.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.434+0000 7f51dfe00640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f51cc0a2c10 0x7f51cc0a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51e80fffb0 tx=0x7f51d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:42.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.436+0000 7f51e5600640 1 -- 172.21.15.50:0/1614296157 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51d80bc5c0 con 0x7f51e8103ff0 2024-09-10T10:09:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.625+0000 7f51eea00640 1 -- 172.21.15.50:0/1614296157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51e810c300 con 0x7f51e8103ff0 2024-09-10T10:09:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.626+0000 7f51e5600640 1 -- 172.21.15.50:0/1614296157 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24682 (secure 0 0 0) 0x7f51d80c08c0 con 0x7f51e8103ff0 2024-09-10T10:09:42.628 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:09:42.628 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:09:00.446421+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:09:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.629+0000 7f51eea00640 1 -- 172.21.15.50:0/1614296157 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f51cc0a2c10 msgr2=0x7f51cc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.629+0000 7f51eea00640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f51cc0a2c10 0x7f51cc0a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51e80fffb0 tx=0x7f51d0005f90 comp rx=0 tx=0).stop 2024-09-10T10:09:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.629+0000 7f51eea00640 1 -- 172.21.15.50:0/1614296157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e8103ff0 msgr2=0x7f51e819a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.629+0000 7f51eea00640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e8103ff0 0x7f51e819a690 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f51d8004770 tx=0x7f51d8003c10 comp rx=0 tx=0).stop 2024-09-10T10:09:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.629+0000 7f51eea00640 1 -- 172.21.15.50:0/1614296157 shutdown_connections 2024-09-10T10:09:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.629+0000 7f51eea00640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f51cc0a2c10 0x7f51cc0a50d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.629+0000 7f51eea00640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f51e8109120 0x7f51e819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.629+0000 7f51eea00640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51e81049a0 0x7f51e819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.629+0000 7f51eea00640 1 --2- 172.21.15.50:0/1614296157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51e8103ff0 0x7f51e819a690 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.629+0000 7f51eea00640 1 -- 172.21.15.50:0/1614296157 >> 172.21.15.50:0/1614296157 conn(0x7f51e80ffa90 msgr2=0x7f51e8100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.629+0000 7f51eea00640 1 -- 172.21.15.50:0/1614296157 shutdown_connections 2024-09-10T10:09:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:42.629+0000 7f51eea00640 1 -- 172.21.15.50:0/1614296157 wait complete. 2024-09-10T10:09:42.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:42 smithi084 ceph-mon[34812]: pgmap v344: 129 pgs: 129 active+clean; 610 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-10T10:09:42.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:42 smithi050 ceph-mon[30354]: pgmap v344: 129 pgs: 129 active+clean; 610 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-10T10:09:43.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:42 smithi189 ceph-mon[34999]: pgmap v344: 129 pgs: 129 active+clean; 610 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-10T10:09:43.307 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T10:09:43.308 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:09:43.684 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:43.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:43 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1614296157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:43.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:43 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1614296157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:44.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:43 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1614296157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.210+0000 7fb686200640 1 -- 172.21.15.50:0/4151432477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb680101df0 msgr2=0x7fb6801021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.210+0000 7fb686200640 1 --2- 172.21.15.50:0/4151432477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb680101df0 0x7fb6801021d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb670009900 tx=0x7fb67002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:09:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.210+0000 7fb686200640 1 -- 172.21.15.50:0/4151432477 shutdown_connections 2024-09-10T10:09:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.210+0000 7fb686200640 1 --2- 172.21.15.50:0/4151432477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680106f20 0x7fb68010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.210+0000 7fb686200640 1 --2- 172.21.15.50:0/4151432477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb6801027a0 0x7fb6801067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.210+0000 7fb686200640 1 --2- 172.21.15.50:0/4151432477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb680101df0 0x7fb6801021d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.210+0000 7fb686200640 1 -- 172.21.15.50:0/4151432477 >> 172.21.15.50:0/4151432477 conn(0x7fb6800fd8b0 msgr2=0x7fb6800ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:44.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.210+0000 7fb686200640 1 -- 172.21.15.50:0/4151432477 shutdown_connections 2024-09-10T10:09:44.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.210+0000 7fb686200640 1 -- 172.21.15.50:0/4151432477 wait complete. 2024-09-10T10:09:44.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.211+0000 7fb686200640 1 Processor -- start 2024-09-10T10:09:44.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.212+0000 7fb686200640 1 -- start start 2024-09-10T10:09:44.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.212+0000 7fb686200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb680101df0 0x7fb68019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:44.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.212+0000 7fb686200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6801027a0 0x7fb68019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:44.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.212+0000 7fb686200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680106f20 0x7fb68019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:44.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.212+0000 7fb686200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb680111fd0 con 0x7fb6801027a0 2024-09-10T10:09:44.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.212+0000 7fb686200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb680111e50 con 0x7fb680106f20 2024-09-10T10:09:44.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.212+0000 7fb686200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb680112150 con 0x7fb680101df0 2024-09-10T10:09:44.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.212+0000 7fb67ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6801027a0 0x7fb68019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:44.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.212+0000 7fb67f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb680101df0 0x7fb68019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:44.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.212+0000 7fb67f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb680101df0 0x7fb68019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:43258/0 (socket says 172.21.15.50:43258) 2024-09-10T10:09:44.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.212+0000 7fb67f400640 1 -- 172.21.15.50:0/140171868 learned_addr learned my addr 172.21.15.50:0/140171868 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:44.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.212+0000 7fb67fe00640 1 --2- 172.21.15.50:0/140171868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680106f20 0x7fb68019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:44.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.213+0000 7fb67ea00640 1 -- 172.21.15.50:0/140171868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb680101df0 msgr2=0x7fb68019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:44.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.213+0000 7fb67ea00640 1 --2- 172.21.15.50:0/140171868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb680101df0 0x7fb68019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:44.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.213+0000 7fb67ea00640 1 -- 172.21.15.50:0/140171868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680106f20 msgr2=0x7fb68019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:44.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.213+0000 7fb67ea00640 1 --2- 172.21.15.50:0/140171868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680106f20 0x7fb68019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:44.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.213+0000 7fb67ea00640 1 -- 172.21.15.50:0/140171868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68019f5f0 con 0x7fb6801027a0 2024-09-10T10:09:44.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.213+0000 7fb67ea00640 1 --2- 172.21.15.50:0/140171868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6801027a0 0x7fb68019ab80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00d720 tx=0x7fb66c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:44.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.213+0000 7fb677e00640 1 -- 172.21.15.50:0/140171868 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c017070 con 0x7fb6801027a0 2024-09-10T10:09:44.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.213+0000 7fb677e00640 1 -- 172.21.15.50:0/140171868 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb66c00de30 con 0x7fb6801027a0 2024-09-10T10:09:44.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.213+0000 7fb686200640 1 -- 172.21.15.50:0/140171868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68019f8e0 con 0x7fb6801027a0 2024-09-10T10:09:44.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.214+0000 7fb677e00640 1 -- 172.21.15.50:0/140171868 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0047a0 con 0x7fb6801027a0 2024-09-10T10:09:44.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.214+0000 7fb686200640 1 -- 172.21.15.50:0/140171868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6801a71c0 con 0x7fb6801027a0 2024-09-10T10:09:44.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.215+0000 7fb686200640 1 -- 172.21.15.50:0/140171868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6801021d0 con 0x7fb6801027a0 2024-09-10T10:09:44.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.217+0000 7fb677e00640 1 -- 172.21.15.50:0/140171868 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb66c0099d0 con 0x7fb6801027a0 2024-09-10T10:09:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.220+0000 7fb677e00640 1 --2- 172.21.15.50:0/140171868 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb6640a2c10 0x7fb6640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.220+0000 7fb677e00640 1 -- 172.21.15.50:0/140171868 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fb66c0cf5b0 con 0x7fb6801027a0 2024-09-10T10:09:44.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.220+0000 7fb67f400640 1 --2- 172.21.15.50:0/140171868 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb6640a2c10 0x7fb6640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.221+0000 7fb67f400640 1 --2- 172.21.15.50:0/140171868 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb6640a2c10 0x7fb6640a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb6700096c0 tx=0x7fb6700046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.222+0000 7fb677e00640 1 -- 172.21.15.50:0/140171868 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb66c020020 con 0x7fb6801027a0 2024-09-10T10:09:44.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.406+0000 7fb686200640 1 -- 172.21.15.50:0/140171868 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb680075430 con 0x7fb6640a2c10 2024-09-10T10:09:44.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.417+0000 7fb677e00640 1 -- 172.21.15.50:0/140171868 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340631 (secure 0 0 0) 0x7fb680075430 con 0x7fb6640a2c10 2024-09-10T10:09:44.423 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:09:44.425 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-10T10:09:44.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.421+0000 7fb686200640 1 -- 172.21.15.50:0/140171868 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb6640a2c10 msgr2=0x7fb6640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:44.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.421+0000 7fb686200640 1 --2- 172.21.15.50:0/140171868 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb6640a2c10 0x7fb6640a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb6700096c0 tx=0x7fb6700046c0 comp rx=0 tx=0).stop 2024-09-10T10:09:44.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.421+0000 7fb686200640 1 -- 172.21.15.50:0/140171868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6801027a0 msgr2=0x7fb68019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:44.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.421+0000 7fb686200640 1 --2- 172.21.15.50:0/140171868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6801027a0 0x7fb68019ab80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00d720 tx=0x7fb66c00dbe0 comp rx=0 tx=0).stop 2024-09-10T10:09:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.422+0000 7fb686200640 1 -- 172.21.15.50:0/140171868 shutdown_connections 2024-09-10T10:09:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.422+0000 7fb686200640 1 --2- 172.21.15.50:0/140171868 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb6640a2c10 0x7fb6640a50d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.422+0000 7fb686200640 1 --2- 172.21.15.50:0/140171868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680106f20 0x7fb68019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.422+0000 7fb686200640 1 --2- 172.21.15.50:0/140171868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6801027a0 0x7fb68019ab80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.422+0000 7fb686200640 1 --2- 172.21.15.50:0/140171868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb680101df0 0x7fb68019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.422+0000 7fb686200640 1 -- 172.21.15.50:0/140171868 >> 172.21.15.50:0/140171868 conn(0x7fb6800fd8b0 msgr2=0x7fb6800feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.422+0000 7fb686200640 1 -- 172.21.15.50:0/140171868 shutdown_connections 2024-09-10T10:09:44.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:44.422+0000 7fb686200640 1 -- 172.21.15.50:0/140171868 wait complete. 2024-09-10T10:09:44.827 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:44 smithi050 ceph-mon[30354]: pgmap v345: 129 pgs: 129 active+clean; 632 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-10T10:09:44.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:44 smithi084 ceph-mon[34812]: pgmap v345: 129 pgs: 129 active+clean; 632 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-10T10:09:44.987 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:44 smithi189 ceph-mon[34999]: pgmap v345: 129 pgs: 129 active+clean; 632 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-10T10:09:45.165 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-09-10T10:09:42.770977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647406,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":244,"num_read_kb":230,"num_write":339,"num_write_kb":3044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361608,"kb_used_data":12360,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580216,"statfs":{"total":1151940427776,"available":1151570141184,"internally_reserved":0,"allocated":12656640,"data_stored":8143109,"data_compressed":426735,"data_compressed_allocated":577536,"data_compressed_original":2654208,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49584,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":101,"num_write":29,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003145"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.543394+0000","last_change":"2024-09-10T10:08:32.889755+0000","last_active":"2024-09-10T10:09:25.543394+0000","last_peered":"2024-09-10T10:09:25.543394+0000","last_clean":"2024-09-10T10:09:25.543394+0000","last_became_active":"2024-09-10T10:08:32.889455+0000","last_became_peered":"2024-09-10T10:08:32.889455+0000","last_unstale":"2024-09-10T10:09:25.543394+0000","last_undegraded":"2024-09-10T10:09:25.543394+0000","last_fullsized":"2024-09-10T10:09:25.543394+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:53.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.450270+0000","last_change":"2024-09-10T10:08:35.367046+0000","last_active":"2024-09-10T10:09:00.450270+0000","last_peered":"2024-09-10T10:09:00.450270+0000","last_clean":"2024-09-10T10:09:00.450270+0000","last_became_active":"2024-09-10T10:08:35.362087+0000","last_became_peered":"2024-09-10T10:08:35.362087+0000","last_unstale":"2024-09-10T10:09:00.450270+0000","last_undegraded":"2024-09-10T10:09:00.450270+0000","last_fullsized":"2024-09-10T10:09:00.450270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:34.428994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.483703+0000","last_change":"2024-09-10T10:08:44.399836+0000","last_active":"2024-09-10T10:09:00.483703+0000","last_peered":"2024-09-10T10:09:00.483703+0000","last_clean":"2024-09-10T10:09:00.483703+0000","last_became_active":"2024-09-10T10:08:44.399510+0000","last_became_peered":"2024-09-10T10:08:44.399510+0000","last_unstale":"2024-09-10T10:09:00.483703+0000","last_undegraded":"2024-09-10T10:09:00.483703+0000","last_fullsized":"2024-09-10T10:09:00.483703+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:47.372690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.450504+0000","last_change":"2024-09-10T10:08:32.887099+0000","last_active":"2024-09-10T10:09:00.450504+0000","last_peered":"2024-09-10T10:09:00.450504+0000","last_clean":"2024-09-10T10:09:00.450504+0000","last_became_active":"2024-09-10T10:08:32.886730+0000","last_became_peered":"2024-09-10T10:08:32.886730+0000","last_unstale":"2024-09-10T10:09:00.450504+0000","last_undegraded":"2024-09-10T10:09:00.450504+0000","last_fullsized":"2024-09-10T10:09:00.450504+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.277241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485089+0000","last_change":"2024-09-10T10:08:35.375494+0000","last_active":"2024-09-10T10:09:00.485089+0000","last_peered":"2024-09-10T10:09:00.485089+0000","last_clean":"2024-09-10T10:09:00.485089+0000","last_became_active":"2024-09-10T10:08:35.373991+0000","last_became_peered":"2024-09-10T10:08:35.373991+0000","last_unstale":"2024-09-10T10:09:00.485089+0000","last_undegraded":"2024-09-10T10:09:00.485089+0000","last_fullsized":"2024-09-10T10:09:00.485089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:25.858163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.457967+0000","last_change":"2024-09-10T10:09:00.457967+0000","last_active":"2024-09-10T10:09:00.457967+0000","last_peered":"2024-09-10T10:09:00.457967+0000","last_clean":"2024-09-10T10:09:00.457967+0000","last_became_active":"2024-09-10T10:09:00.457446+0000","last_became_peered":"2024-09-10T10:09:00.457446+0000","last_unstale":"2024-09-10T10:09:00.457967+0000","last_undegraded":"2024-09-10T10:09:00.457967+0000","last_fullsized":"2024-09-10T10:09:00.457967+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:00.550304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.540590+0000","last_change":"2024-09-10T10:08:32.890270+0000","last_active":"2024-09-10T10:09:25.540590+0000","last_peered":"2024-09-10T10:09:25.540590+0000","last_clean":"2024-09-10T10:09:25.540590+0000","last_became_active":"2024-09-10T10:08:32.889887+0000","last_became_peered":"2024-09-10T10:08:32.889887+0000","last_unstale":"2024-09-10T10:09:25.540590+0000","last_undegraded":"2024-09-10T10:09:25.540590+0000","last_fullsized":"2024-09-10T10:09:25.540590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:39.757510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.457672+0000","last_change":"2024-09-10T10:08:35.357257+0000","last_active":"2024-09-10T10:09:00.457672+0000","last_peered":"2024-09-10T10:09:00.457672+0000","last_clean":"2024-09-10T10:09:00.457672+0000","last_became_active":"2024-09-10T10:08:35.356918+0000","last_became_peered":"2024-09-10T10:08:35.356918+0000","last_unstale":"2024-09-10T10:09:00.457672+0000","last_undegraded":"2024-09-10T10:09:00.457672+0000","last_fullsized":"2024-09-10T10:09:00.457672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:04.387581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.487116+0000","last_change":"2024-09-10T10:09:00.487116+0000","last_active":"2024-09-10T10:09:00.487116+0000","last_peered":"2024-09-10T10:09:00.487116+0000","last_clean":"2024-09-10T10:09:00.487116+0000","last_became_active":"2024-09-10T10:09:00.486646+0000","last_became_peered":"2024-09-10T10:09:00.486646+0000","last_unstale":"2024-09-10T10:09:00.487116+0000","last_undegraded":"2024-09-10T10:09:00.487116+0000","last_fullsized":"2024-09-10T10:09:00.487116+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:40.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.453413+0000","last_change":"2024-09-10T10:08:32.891399+0000","last_active":"2024-09-10T10:09:00.453413+0000","last_peered":"2024-09-10T10:09:00.453413+0000","last_clean":"2024-09-10T10:09:00.453413+0000","last_became_active":"2024-09-10T10:08:32.891022+0000","last_became_peered":"2024-09-10T10:08:32.891022+0000","last_unstale":"2024-09-10T10:09:00.453413+0000","last_undegraded":"2024-09-10T10:09:00.453413+0000","last_fullsized":"2024-09-10T10:09:00.453413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:30.842443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.452062+0000","last_change":"2024-09-10T10:08:35.370630+0000","last_active":"2024-09-10T10:09:00.452062+0000","last_peered":"2024-09-10T10:09:00.452062+0000","last_clean":"2024-09-10T10:09:00.452062+0000","last_became_active":"2024-09-10T10:08:35.370263+0000","last_became_peered":"2024-09-10T10:08:35.370263+0000","last_unstale":"2024-09-10T10:09:00.452062+0000","last_undegraded":"2024-09-10T10:09:00.452062+0000","last_fullsized":"2024-09-10T10:09:00.452062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:41.549815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.453501+0000","last_change":"2024-09-10T10:08:44.405298+0000","last_active":"2024-09-10T10:09:00.453501+0000","last_peered":"2024-09-10T10:09:00.453501+0000","last_clean":"2024-09-10T10:09:00.453501+0000","last_became_active":"2024-09-10T10:08:44.405027+0000","last_became_peered":"2024-09-10T10:08:44.405027+0000","last_unstale":"2024-09-10T10:09:00.453501+0000","last_undegraded":"2024-09-10T10:09:00.453501+0000","last_fullsized":"2024-09-10T10:09:00.453501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:08.486563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484889+0000","last_change":"2024-09-10T10:08:35.369040+0000","last_active":"2024-09-10T10:09:00.484889+0000","last_peered":"2024-09-10T10:09:00.484889+0000","last_clean":"2024-09-10T10:09:00.484889+0000","last_became_active":"2024-09-10T10:08:35.368576+0000","last_became_peered":"2024-09-10T10:08:35.368576+0000","last_unstale":"2024-09-10T10:09:00.484889+0000","last_undegraded":"2024-09-10T10:09:00.484889+0000","last_fullsized":"2024-09-10T10:09:00.484889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:44.887554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.526967+0000","last_change":"2024-09-10T10:08:32.889549+0000","last_active":"2024-09-10T10:09:24.526967+0000","last_peered":"2024-09-10T10:09:24.526967+0000","last_clean":"2024-09-10T10:09:24.526967+0000","last_became_active":"2024-09-10T10:08:32.889197+0000","last_became_peered":"2024-09-10T10:08:32.889197+0000","last_unstale":"2024-09-10T10:09:24.526967+0000","last_undegraded":"2024-09-10T10:09:24.526967+0000","last_fullsized":"2024-09-10T10:09:24.526967+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:53.697069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.453598+0000","last_change":"2024-09-10T10:08:44.929048+0000","last_active":"2024-09-10T10:09:00.453598+0000","last_peered":"2024-09-10T10:09:00.453598+0000","last_clean":"2024-09-10T10:09:00.453598+0000","last_became_active":"2024-09-10T10:08:44.928345+0000","last_became_peered":"2024-09-10T10:08:44.928345+0000","last_unstale":"2024-09-10T10:09:00.453598+0000","last_undegraded":"2024-09-10T10:09:00.453598+0000","last_fullsized":"2024-09-10T10:09:00.453598+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:23.121853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.449883+0000","last_change":"2024-09-10T10:08:35.377385+0000","last_active":"2024-09-10T10:09:00.449883+0000","last_peered":"2024-09-10T10:09:00.449883+0000","last_clean":"2024-09-10T10:09:00.449883+0000","last_became_active":"2024-09-10T10:08:35.377092+0000","last_became_peered":"2024-09-10T10:08:35.377092+0000","last_unstale":"2024-09-10T10:09:00.449883+0000","last_undegraded":"2024-09-10T10:09:00.449883+0000","last_fullsized":"2024-09-10T10:09:00.449883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:23.169370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.483988+0000","last_change":"2024-09-10T10:08:32.891614+0000","last_active":"2024-09-10T10:09:00.483988+0000","last_peered":"2024-09-10T10:09:00.483988+0000","last_clean":"2024-09-10T10:09:00.483988+0000","last_became_active":"2024-09-10T10:08:32.891141+0000","last_became_peered":"2024-09-10T10:08:32.891141+0000","last_unstale":"2024-09-10T10:09:00.483988+0000","last_undegraded":"2024-09-10T10:09:00.483988+0000","last_fullsized":"2024-09-10T10:09:00.483988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:20.258863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454560+0000","last_change":"2024-09-10T10:08:44.401125+0000","last_active":"2024-09-10T10:09:00.454560+0000","last_peered":"2024-09-10T10:09:00.454560+0000","last_clean":"2024-09-10T10:09:00.454560+0000","last_became_active":"2024-09-10T10:08:44.400483+0000","last_became_peered":"2024-09-10T10:08:44.400483+0000","last_unstale":"2024-09-10T10:09:00.454560+0000","last_undegraded":"2024-09-10T10:09:00.454560+0000","last_fullsized":"2024-09-10T10:09:00.454560+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:12.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454464+0000","last_change":"2024-09-10T10:08:35.376806+0000","last_active":"2024-09-10T10:09:00.454464+0000","last_peered":"2024-09-10T10:09:00.454464+0000","last_clean":"2024-09-10T10:09:00.454464+0000","last_became_active":"2024-09-10T10:08:35.376400+0000","last_became_peered":"2024-09-10T10:08:35.376400+0000","last_unstale":"2024-09-10T10:09:00.454464+0000","last_undegraded":"2024-09-10T10:09:00.454464+0000","last_fullsized":"2024-09-10T10:09:00.454464+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:48.303039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.529903+0000","last_change":"2024-09-10T10:08:32.883881+0000","last_active":"2024-09-10T10:09:24.529903+0000","last_peered":"2024-09-10T10:09:24.529903+0000","last_clean":"2024-09-10T10:09:24.529903+0000","last_became_active":"2024-09-10T10:08:32.883540+0000","last_became_peered":"2024-09-10T10:08:32.883540+0000","last_unstale":"2024-09-10T10:09:24.529903+0000","last_undegraded":"2024-09-10T10:09:24.529903+0000","last_fullsized":"2024-09-10T10:09:24.529903+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:57.359729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485315+0000","last_change":"2024-09-10T10:08:44.401548+0000","last_active":"2024-09-10T10:09:00.485315+0000","last_peered":"2024-09-10T10:09:00.485315+0000","last_clean":"2024-09-10T10:09:00.485315+0000","last_became_active":"2024-09-10T10:08:44.401034+0000","last_became_peered":"2024-09-10T10:08:44.401034+0000","last_unstale":"2024-09-10T10:09:00.485315+0000","last_undegraded":"2024-09-10T10:09:00.485315+0000","last_fullsized":"2024-09-10T10:09:00.485315+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:17.292973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.451984+0000","last_change":"2024-09-10T10:08:35.359969+0000","last_active":"2024-09-10T10:09:00.451984+0000","last_peered":"2024-09-10T10:09:00.451984+0000","last_clean":"2024-09-10T10:09:00.451984+0000","last_became_active":"2024-09-10T10:08:35.359599+0000","last_became_peered":"2024-09-10T10:08:35.359599+0000","last_unstale":"2024-09-10T10:09:00.451984+0000","last_undegraded":"2024-09-10T10:09:00.451984+0000","last_fullsized":"2024-09-10T10:09:00.451984+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:00.778269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.527910+0000","last_change":"2024-09-10T10:09:00.487582+0000","last_active":"2024-09-10T10:09:24.527910+0000","last_peered":"2024-09-10T10:09:24.527910+0000","last_clean":"2024-09-10T10:09:24.527910+0000","last_became_active":"2024-09-10T10:09:00.487229+0000","last_became_peered":"2024-09-10T10:09:00.487229+0000","last_unstale":"2024-09-10T10:09:24.527910+0000","last_undegraded":"2024-09-10T10:09:24.527910+0000","last_fullsized":"2024-09-10T10:09:24.527910+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:53.341736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454047+0000","last_change":"2024-09-10T10:08:44.929224+0000","last_active":"2024-09-10T10:09:00.454047+0000","last_peered":"2024-09-10T10:09:00.454047+0000","last_clean":"2024-09-10T10:09:00.454047+0000","last_became_active":"2024-09-10T10:08:44.928640+0000","last_became_peered":"2024-09-10T10:08:44.928640+0000","last_unstale":"2024-09-10T10:09:00.454047+0000","last_undegraded":"2024-09-10T10:09:00.454047+0000","last_fullsized":"2024-09-10T10:09:00.454047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:42.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485754+0000","last_change":"2024-09-10T10:08:35.376585+0000","last_active":"2024-09-10T10:09:00.485754+0000","last_peered":"2024-09-10T10:09:00.485754+0000","last_clean":"2024-09-10T10:09:00.485754+0000","last_became_active":"2024-09-10T10:08:35.375693+0000","last_became_peered":"2024-09-10T10:08:35.375693+0000","last_unstale":"2024-09-10T10:09:00.485754+0000","last_undegraded":"2024-09-10T10:09:00.485754+0000","last_fullsized":"2024-09-10T10:09:00.485754+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:59.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.527606+0000","last_change":"2024-09-10T10:08:32.884542+0000","last_active":"2024-09-10T10:09:24.527606+0000","last_peered":"2024-09-10T10:09:24.527606+0000","last_clean":"2024-09-10T10:09:24.527606+0000","last_became_active":"2024-09-10T10:08:32.884192+0000","last_became_peered":"2024-09-10T10:08:32.884192+0000","last_unstale":"2024-09-10T10:09:24.527606+0000","last_undegraded":"2024-09-10T10:09:24.527606+0000","last_fullsized":"2024-09-10T10:09:24.527606+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:57.756641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.483883+0000","last_change":"2024-09-10T10:08:44.391514+0000","last_active":"2024-09-10T10:09:00.483883+0000","last_peered":"2024-09-10T10:09:00.483883+0000","last_clean":"2024-09-10T10:09:00.483883+0000","last_became_active":"2024-09-10T10:08:44.391116+0000","last_became_peered":"2024-09-10T10:08:44.391116+0000","last_unstale":"2024-09-10T10:09:00.483883+0000","last_undegraded":"2024-09-10T10:09:00.483883+0000","last_fullsized":"2024-09-10T10:09:00.483883+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:41.586014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.450452+0000","last_change":"2024-09-10T10:08:35.365604+0000","last_active":"2024-09-10T10:09:00.450452+0000","last_peered":"2024-09-10T10:09:00.450452+0000","last_clean":"2024-09-10T10:09:00.450452+0000","last_became_active":"2024-09-10T10:08:35.364915+0000","last_became_peered":"2024-09-10T10:08:35.364915+0000","last_unstale":"2024-09-10T10:09:00.450452+0000","last_undegraded":"2024-09-10T10:09:00.450452+0000","last_fullsized":"2024-09-10T10:09:00.450452+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:12.885021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'7","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:34.369854+0000","last_change":"2024-09-10T10:08:32.888223+0000","last_active":"2024-09-10T10:09:34.369854+0000","last_peered":"2024-09-10T10:09:34.369854+0000","last_clean":"2024-09-10T10:09:34.369854+0000","last_became_active":"2024-09-10T10:08:32.887919+0000","last_became_peered":"2024-09-10T10:08:32.887919+0000","last_unstale":"2024-09-10T10:09:34.369854+0000","last_undegraded":"2024-09-10T10:09:34.369854+0000","last_fullsized":"2024-09-10T10:09:34.369854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:19.781337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.449573+0000","last_change":"2024-09-10T10:08:44.929322+0000","last_active":"2024-09-10T10:09:00.449573+0000","last_peered":"2024-09-10T10:09:00.449573+0000","last_clean":"2024-09-10T10:09:00.449573+0000","last_became_active":"2024-09-10T10:08:44.928252+0000","last_became_peered":"2024-09-10T10:08:44.928252+0000","last_unstale":"2024-09-10T10:09:00.449573+0000","last_undegraded":"2024-09-10T10:09:00.449573+0000","last_fullsized":"2024-09-10T10:09:00.449573+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:33.048265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456737+0000","last_change":"2024-09-10T10:08:35.364168+0000","last_active":"2024-09-10T10:09:00.456737+0000","last_peered":"2024-09-10T10:09:00.456737+0000","last_clean":"2024-09-10T10:09:00.456737+0000","last_became_active":"2024-09-10T10:08:35.363739+0000","last_became_peered":"2024-09-10T10:08:35.363739+0000","last_unstale":"2024-09-10T10:09:00.456737+0000","last_undegraded":"2024-09-10T10:09:00.456737+0000","last_fullsized":"2024-09-10T10:09:00.456737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:43.029409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.527374+0000","last_change":"2024-09-10T10:08:32.893021+0000","last_active":"2024-09-10T10:09:24.527374+0000","last_peered":"2024-09-10T10:09:24.527374+0000","last_clean":"2024-09-10T10:09:24.527374+0000","last_became_active":"2024-09-10T10:08:32.892667+0000","last_became_peered":"2024-09-10T10:08:32.892667+0000","last_unstale":"2024-09-10T10:09:24.527374+0000","last_undegraded":"2024-09-10T10:09:24.527374+0000","last_fullsized":"2024-09-10T10:09:24.527374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:52.427489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454857+0000","last_change":"2024-09-10T10:08:44.393831+0000","last_active":"2024-09-10T10:09:00.454857+0000","last_peered":"2024-09-10T10:09:00.454857+0000","last_clean":"2024-09-10T10:09:00.454857+0000","last_became_active":"2024-09-10T10:08:44.393415+0000","last_became_peered":"2024-09-10T10:08:44.393415+0000","last_unstale":"2024-09-10T10:09:00.454857+0000","last_undegraded":"2024-09-10T10:09:00.454857+0000","last_fullsized":"2024-09-10T10:09:00.454857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:52.171292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485475+0000","last_change":"2024-09-10T10:08:35.374787+0000","last_active":"2024-09-10T10:09:00.485475+0000","last_peered":"2024-09-10T10:09:00.485475+0000","last_clean":"2024-09-10T10:09:00.485475+0000","last_became_active":"2024-09-10T10:08:35.374549+0000","last_became_peered":"2024-09-10T10:08:35.374549+0000","last_unstale":"2024-09-10T10:09:00.485475+0000","last_undegraded":"2024-09-10T10:09:00.485475+0000","last_fullsized":"2024-09-10T10:09:00.485475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:58.925515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485060+0000","last_change":"2024-09-10T10:08:32.886267+0000","last_active":"2024-09-10T10:09:00.485060+0000","last_peered":"2024-09-10T10:09:00.485060+0000","last_clean":"2024-09-10T10:09:00.485060+0000","last_became_active":"2024-09-10T10:08:32.885869+0000","last_became_peered":"2024-09-10T10:08:32.885869+0000","last_unstale":"2024-09-10T10:09:00.485060+0000","last_undegraded":"2024-09-10T10:09:00.485060+0000","last_fullsized":"2024-09-10T10:09:00.485060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:06.784839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.486656+0000","last_change":"2024-09-10T10:09:00.486656+0000","last_active":"2024-09-10T10:09:00.486656+0000","last_peered":"2024-09-10T10:09:00.486656+0000","last_clean":"2024-09-10T10:09:00.486656+0000","last_became_active":"2024-09-10T10:09:00.486072+0000","last_became_peered":"2024-09-10T10:09:00.486072+0000","last_unstale":"2024-09-10T10:09:00.486656+0000","last_undegraded":"2024-09-10T10:09:00.486656+0000","last_fullsized":"2024-09-10T10:09:00.486656+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:26.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485219+0000","last_change":"2024-09-10T10:08:35.366130+0000","last_active":"2024-09-10T10:09:00.485219+0000","last_peered":"2024-09-10T10:09:00.485219+0000","last_clean":"2024-09-10T10:09:00.485219+0000","last_became_active":"2024-09-10T10:08:35.365785+0000","last_became_peered":"2024-09-10T10:08:35.365785+0000","last_unstale":"2024-09-10T10:09:00.485219+0000","last_undegraded":"2024-09-10T10:09:00.485219+0000","last_fullsized":"2024-09-10T10:09:00.485219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:35.771767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485112+0000","last_change":"2024-09-10T10:08:32.884113+0000","last_active":"2024-09-10T10:09:00.485112+0000","last_peered":"2024-09-10T10:09:00.485112+0000","last_clean":"2024-09-10T10:09:00.485112+0000","last_became_active":"2024-09-10T10:08:32.883503+0000","last_became_peered":"2024-09-10T10:08:32.883503+0000","last_unstale":"2024-09-10T10:09:00.485112+0000","last_undegraded":"2024-09-10T10:09:00.485112+0000","last_fullsized":"2024-09-10T10:09:00.485112+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:20.513465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456521+0000","last_change":"2024-09-10T10:08:44.400137+0000","last_active":"2024-09-10T10:09:00.456521+0000","last_peered":"2024-09-10T10:09:00.456521+0000","last_clean":"2024-09-10T10:09:00.456521+0000","last_became_active":"2024-09-10T10:08:44.398736+0000","last_became_peered":"2024-09-10T10:08:44.398736+0000","last_unstale":"2024-09-10T10:09:00.456521+0000","last_undegraded":"2024-09-10T10:09:00.456521+0000","last_fullsized":"2024-09-10T10:09:00.456521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:48.922732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.451600+0000","last_change":"2024-09-10T10:08:35.360818+0000","last_active":"2024-09-10T10:09:00.451600+0000","last_peered":"2024-09-10T10:09:00.451600+0000","last_clean":"2024-09-10T10:09:00.451600+0000","last_became_active":"2024-09-10T10:08:35.360504+0000","last_became_peered":"2024-09-10T10:08:35.360504+0000","last_unstale":"2024-09-10T10:09:00.451600+0000","last_undegraded":"2024-09-10T10:09:00.451600+0000","last_fullsized":"2024-09-10T10:09:00.451600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:45.396069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'4","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:41.567422+0000","last_change":"2024-09-10T10:08:32.883915+0000","last_active":"2024-09-10T10:09:41.567422+0000","last_peered":"2024-09-10T10:09:41.567422+0000","last_clean":"2024-09-10T10:09:41.567422+0000","last_became_active":"2024-09-10T10:08:32.883573+0000","last_became_peered":"2024-09-10T10:08:32.883573+0000","last_unstale":"2024-09-10T10:09:41.567422+0000","last_undegraded":"2024-09-10T10:09:41.567422+0000","last_fullsized":"2024-09-10T10:09:41.567422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:56.271267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456731+0000","last_change":"2024-09-10T10:08:44.928968+0000","last_active":"2024-09-10T10:09:00.456731+0000","last_peered":"2024-09-10T10:09:00.456731+0000","last_clean":"2024-09-10T10:09:00.456731+0000","last_became_active":"2024-09-10T10:08:44.928445+0000","last_became_peered":"2024-09-10T10:08:44.928445+0000","last_unstale":"2024-09-10T10:09:00.456731+0000","last_undegraded":"2024-09-10T10:09:00.456731+0000","last_fullsized":"2024-09-10T10:09:00.456731+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:01.799454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456011+0000","last_change":"2024-09-10T10:08:35.369027+0000","last_active":"2024-09-10T10:09:00.456011+0000","last_peered":"2024-09-10T10:09:00.456011+0000","last_clean":"2024-09-10T10:09:00.456011+0000","last_became_active":"2024-09-10T10:08:35.368692+0000","last_became_peered":"2024-09-10T10:08:35.368692+0000","last_unstale":"2024-09-10T10:09:00.456011+0000","last_undegraded":"2024-09-10T10:09:00.456011+0000","last_fullsized":"2024-09-10T10:09:00.456011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:09.500617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.540910+0000","last_change":"2024-09-10T10:08:32.888661+0000","last_active":"2024-09-10T10:09:25.540910+0000","last_peered":"2024-09-10T10:09:25.540910+0000","last_clean":"2024-09-10T10:09:25.540910+0000","last_became_active":"2024-09-10T10:08:32.888312+0000","last_became_peered":"2024-09-10T10:08:32.888312+0000","last_unstale":"2024-09-10T10:09:25.540910+0000","last_undegraded":"2024-09-10T10:09:25.540910+0000","last_fullsized":"2024-09-10T10:09:25.540910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:47.293560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.452230+0000","last_change":"2024-09-10T10:08:44.929512+0000","last_active":"2024-09-10T10:09:00.452230+0000","last_peered":"2024-09-10T10:09:00.452230+0000","last_clean":"2024-09-10T10:09:00.452230+0000","last_became_active":"2024-09-10T10:08:44.928992+0000","last_became_peered":"2024-09-10T10:08:44.928992+0000","last_unstale":"2024-09-10T10:09:00.452230+0000","last_undegraded":"2024-09-10T10:09:00.452230+0000","last_fullsized":"2024-09-10T10:09:00.452230+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:31.827967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.449990+0000","last_change":"2024-09-10T10:08:35.369098+0000","last_active":"2024-09-10T10:09:00.449990+0000","last_peered":"2024-09-10T10:09:00.449990+0000","last_clean":"2024-09-10T10:09:00.449990+0000","last_became_active":"2024-09-10T10:08:35.363112+0000","last_became_peered":"2024-09-10T10:08:35.363112+0000","last_unstale":"2024-09-10T10:09:00.449990+0000","last_undegraded":"2024-09-10T10:09:00.449990+0000","last_fullsized":"2024-09-10T10:09:00.449990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:07.810055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:26.542810+0000","last_change":"2024-09-10T10:08:32.885451+0000","last_active":"2024-09-10T10:09:26.542810+0000","last_peered":"2024-09-10T10:09:26.542810+0000","last_clean":"2024-09-10T10:09:26.542810+0000","last_became_active":"2024-09-10T10:08:32.885102+0000","last_became_peered":"2024-09-10T10:08:32.885102+0000","last_unstale":"2024-09-10T10:09:26.542810+0000","last_undegraded":"2024-09-10T10:09:26.542810+0000","last_fullsized":"2024-09-10T10:09:26.542810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:52.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":351,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485618+0000","last_change":"2024-09-10T10:07:13.661841+0000","last_active":"2024-09-10T10:09:00.485618+0000","last_peered":"2024-09-10T10:09:00.485618+0000","last_clean":"2024-09-10T10:09:00.485618+0000","last_became_active":"2024-09-10T10:07:13.661310+0000","last_became_peered":"2024-09-10T10:07:13.661310+0000","last_unstale":"2024-09-10T10:09:00.485618+0000","last_undegraded":"2024-09-10T10:09:00.485618+0000","last_fullsized":"2024-09-10T10:09:00.485618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_clean_scrub_stamp":"2024-09-10T10:03:29.327083+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:39.414636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485340+0000","last_change":"2024-09-10T10:08:44.391277+0000","last_active":"2024-09-10T10:09:00.485340+0000","last_peered":"2024-09-10T10:09:00.485340+0000","last_clean":"2024-09-10T10:09:00.485340+0000","last_became_active":"2024-09-10T10:08:44.390867+0000","last_became_peered":"2024-09-10T10:08:44.390867+0000","last_unstale":"2024-09-10T10:09:00.485340+0000","last_undegraded":"2024-09-10T10:09:00.485340+0000","last_fullsized":"2024-09-10T10:09:00.485340+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:23.299812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485399+0000","last_change":"2024-09-10T10:08:35.364750+0000","last_active":"2024-09-10T10:09:00.485399+0000","last_peered":"2024-09-10T10:09:00.485399+0000","last_clean":"2024-09-10T10:09:00.485399+0000","last_became_active":"2024-09-10T10:08:35.364034+0000","last_became_peered":"2024-09-10T10:08:35.364034+0000","last_unstale":"2024-09-10T10:09:00.485399+0000","last_undegraded":"2024-09-10T10:09:00.485399+0000","last_fullsized":"2024-09-10T10:09:00.485399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:15.296086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.543399+0000","last_change":"2024-09-10T10:08:32.886884+0000","last_active":"2024-09-10T10:09:25.543399+0000","last_peered":"2024-09-10T10:09:25.543399+0000","last_clean":"2024-09-10T10:09:25.543399+0000","last_became_active":"2024-09-10T10:08:32.886544+0000","last_became_peered":"2024-09-10T10:08:32.886544+0000","last_unstale":"2024-09-10T10:09:25.543399+0000","last_undegraded":"2024-09-10T10:09:25.543399+0000","last_fullsized":"2024-09-10T10:09:25.543399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:30.511881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.457626+0000","last_change":"2024-09-10T10:08:44.390761+0000","last_active":"2024-09-10T10:09:00.457626+0000","last_peered":"2024-09-10T10:09:00.457626+0000","last_clean":"2024-09-10T10:09:00.457626+0000","last_became_active":"2024-09-10T10:08:44.390190+0000","last_became_peered":"2024-09-10T10:08:44.390190+0000","last_unstale":"2024-09-10T10:09:00.457626+0000","last_undegraded":"2024-09-10T10:09:00.457626+0000","last_fullsized":"2024-09-10T10:09:00.457626+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:38.216171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485171+0000","last_change":"2024-09-10T10:08:35.362956+0000","last_active":"2024-09-10T10:09:00.485171+0000","last_peered":"2024-09-10T10:09:00.485171+0000","last_clean":"2024-09-10T10:09:00.485171+0000","last_became_active":"2024-09-10T10:08:35.362623+0000","last_became_peered":"2024-09-10T10:08:35.362623+0000","last_unstale":"2024-09-10T10:09:00.485171+0000","last_undegraded":"2024-09-10T10:09:00.485171+0000","last_fullsized":"2024-09-10T10:09:00.485171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:50.162838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.452390+0000","last_change":"2024-09-10T10:08:32.889741+0000","last_active":"2024-09-10T10:09:00.452390+0000","last_peered":"2024-09-10T10:09:00.452390+0000","last_clean":"2024-09-10T10:09:00.452390+0000","last_became_active":"2024-09-10T10:08:32.889394+0000","last_became_peered":"2024-09-10T10:08:32.889394+0000","last_unstale":"2024-09-10T10:09:00.452390+0000","last_undegraded":"2024-09-10T10:09:00.452390+0000","last_fullsized":"2024-09-10T10:09:00.452390+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:16.845738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484916+0000","last_change":"2024-09-10T10:08:44.403781+0000","last_active":"2024-09-10T10:09:00.484916+0000","last_peered":"2024-09-10T10:09:00.484916+0000","last_clean":"2024-09-10T10:09:00.484916+0000","last_became_active":"2024-09-10T10:08:44.399601+0000","last_became_peered":"2024-09-10T10:08:44.399601+0000","last_unstale":"2024-09-10T10:09:00.484916+0000","last_undegraded":"2024-09-10T10:09:00.484916+0000","last_fullsized":"2024-09-10T10:09:00.484916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:45.587247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485200+0000","last_change":"2024-09-10T10:08:35.367825+0000","last_active":"2024-09-10T10:09:00.485200+0000","last_peered":"2024-09-10T10:09:00.485200+0000","last_clean":"2024-09-10T10:09:00.485200+0000","last_became_active":"2024-09-10T10:08:35.367511+0000","last_became_peered":"2024-09-10T10:08:35.367511+0000","last_unstale":"2024-09-10T10:09:00.485200+0000","last_undegraded":"2024-09-10T10:09:00.485200+0000","last_fullsized":"2024-09-10T10:09:00.485200+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:03.356912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456577+0000","last_change":"2024-09-10T10:08:32.888524+0000","last_active":"2024-09-10T10:09:00.456577+0000","last_peered":"2024-09-10T10:09:00.456577+0000","last_clean":"2024-09-10T10:09:00.456577+0000","last_became_active":"2024-09-10T10:08:32.888148+0000","last_became_peered":"2024-09-10T10:08:32.888148+0000","last_unstale":"2024-09-10T10:09:00.456577+0000","last_undegraded":"2024-09-10T10:09:00.456577+0000","last_fullsized":"2024-09-10T10:09:00.456577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:34.342167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.450915+0000","last_change":"2024-09-10T10:08:44.392952+0000","last_active":"2024-09-10T10:09:00.450915+0000","last_peered":"2024-09-10T10:09:00.450915+0000","last_clean":"2024-09-10T10:09:00.450915+0000","last_became_active":"2024-09-10T10:08:44.392476+0000","last_became_peered":"2024-09-10T10:08:44.392476+0000","last_unstale":"2024-09-10T10:09:00.450915+0000","last_undegraded":"2024-09-10T10:09:00.450915+0000","last_fullsized":"2024-09-10T10:09:00.450915+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:26.530305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.455103+0000","last_change":"2024-09-10T10:08:35.364501+0000","last_active":"2024-09-10T10:09:00.455103+0000","last_peered":"2024-09-10T10:09:00.455103+0000","last_clean":"2024-09-10T10:09:00.455103+0000","last_became_active":"2024-09-10T10:08:35.364102+0000","last_became_peered":"2024-09-10T10:08:35.364102+0000","last_unstale":"2024-09-10T10:09:00.455103+0000","last_undegraded":"2024-09-10T10:09:00.455103+0000","last_fullsized":"2024-09-10T10:09:00.455103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:42.743140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:26.539580+0000","last_change":"2024-09-10T10:09:00.461639+0000","last_active":"2024-09-10T10:09:26.539580+0000","last_peered":"2024-09-10T10:09:26.539580+0000","last_clean":"2024-09-10T10:09:26.539580+0000","last_became_active":"2024-09-10T10:09:00.457246+0000","last_became_peered":"2024-09-10T10:09:00.457246+0000","last_unstale":"2024-09-10T10:09:26.539580+0000","last_undegraded":"2024-09-10T10:09:26.539580+0000","last_fullsized":"2024-09-10T10:09:26.539580+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:30.387035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.451074+0000","last_change":"2024-09-10T10:08:44.401728+0000","last_active":"2024-09-10T10:09:00.451074+0000","last_peered":"2024-09-10T10:09:00.451074+0000","last_clean":"2024-09-10T10:09:00.451074+0000","last_became_active":"2024-09-10T10:08:44.401334+0000","last_became_peered":"2024-09-10T10:08:44.401334+0000","last_unstale":"2024-09-10T10:09:00.451074+0000","last_undegraded":"2024-09-10T10:09:00.451074+0000","last_fullsized":"2024-09-10T10:09:00.451074+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:57.496196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.486353+0000","last_change":"2024-09-10T10:09:00.486353+0000","last_active":"2024-09-10T10:09:00.486353+0000","last_peered":"2024-09-10T10:09:00.486353+0000","last_clean":"2024-09-10T10:09:00.486353+0000","last_became_active":"2024-09-10T10:09:00.485938+0000","last_became_peered":"2024-09-10T10:09:00.485938+0000","last_unstale":"2024-09-10T10:09:00.486353+0000","last_undegraded":"2024-09-10T10:09:00.486353+0000","last_fullsized":"2024-09-10T10:09:00.486353+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:38.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.542717+0000","last_change":"2024-09-10T10:08:32.893278+0000","last_active":"2024-09-10T10:09:25.542717+0000","last_peered":"2024-09-10T10:09:25.542717+0000","last_clean":"2024-09-10T10:09:25.542717+0000","last_became_active":"2024-09-10T10:08:32.892848+0000","last_became_peered":"2024-09-10T10:08:32.892848+0000","last_unstale":"2024-09-10T10:09:25.542717+0000","last_undegraded":"2024-09-10T10:09:25.542717+0000","last_fullsized":"2024-09-10T10:09:25.542717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:09.336253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456576+0000","last_change":"2024-09-10T10:08:44.407213+0000","last_active":"2024-09-10T10:09:00.456576+0000","last_peered":"2024-09-10T10:09:00.456576+0000","last_clean":"2024-09-10T10:09:00.456576+0000","last_became_active":"2024-09-10T10:08:44.405198+0000","last_became_peered":"2024-09-10T10:08:44.405198+0000","last_unstale":"2024-09-10T10:09:00.456576+0000","last_undegraded":"2024-09-10T10:09:00.456576+0000","last_fullsized":"2024-09-10T10:09:00.456576+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:15.921684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485332+0000","last_change":"2024-09-10T10:08:35.362683+0000","last_active":"2024-09-10T10:09:00.485332+0000","last_peered":"2024-09-10T10:09:00.485332+0000","last_clean":"2024-09-10T10:09:00.485332+0000","last_became_active":"2024-09-10T10:08:35.362353+0000","last_became_peered":"2024-09-10T10:08:35.362353+0000","last_unstale":"2024-09-10T10:09:00.485332+0000","last_undegraded":"2024-09-10T10:09:00.485332+0000","last_fullsized":"2024-09-10T10:09:00.485332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.489716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'4","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:38.563568+0000","last_change":"2024-09-10T10:08:32.881024+0000","last_active":"2024-09-10T10:09:38.563568+0000","last_peered":"2024-09-10T10:09:38.563568+0000","last_clean":"2024-09-10T10:09:38.563568+0000","last_became_active":"2024-09-10T10:08:32.880691+0000","last_became_peered":"2024-09-10T10:08:32.880691+0000","last_unstale":"2024-09-10T10:09:38.563568+0000","last_undegraded":"2024-09-10T10:09:38.563568+0000","last_fullsized":"2024-09-10T10:09:38.563568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:15.988063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485410+0000","last_change":"2024-09-10T10:08:44.400509+0000","last_active":"2024-09-10T10:09:00.485410+0000","last_peered":"2024-09-10T10:09:00.485410+0000","last_clean":"2024-09-10T10:09:00.485410+0000","last_became_active":"2024-09-10T10:08:44.400152+0000","last_became_peered":"2024-09-10T10:08:44.400152+0000","last_unstale":"2024-09-10T10:09:00.485410+0000","last_undegraded":"2024-09-10T10:09:00.485410+0000","last_fullsized":"2024-09-10T10:09:00.485410+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:43.550208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484895+0000","last_change":"2024-09-10T10:08:35.364208+0000","last_active":"2024-09-10T10:09:00.484895+0000","last_peered":"2024-09-10T10:09:00.484895+0000","last_clean":"2024-09-10T10:09:00.484895+0000","last_became_active":"2024-09-10T10:08:35.363751+0000","last_became_peered":"2024-09-10T10:08:35.363751+0000","last_unstale":"2024-09-10T10:09:00.484895+0000","last_undegraded":"2024-09-10T10:09:00.484895+0000","last_fullsized":"2024-09-10T10:09:00.484895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:21.791512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.529941+0000","last_change":"2024-09-10T10:08:32.890611+0000","last_active":"2024-09-10T10:09:24.529941+0000","last_peered":"2024-09-10T10:09:24.529941+0000","last_clean":"2024-09-10T10:09:24.529941+0000","last_became_active":"2024-09-10T10:08:32.890296+0000","last_became_peered":"2024-09-10T10:08:32.890296+0000","last_unstale":"2024-09-10T10:09:24.529941+0000","last_undegraded":"2024-09-10T10:09:24.529941+0000","last_fullsized":"2024-09-10T10:09:24.529941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.977575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454631+0000","last_change":"2024-09-10T10:08:44.402607+0000","last_active":"2024-09-10T10:09:00.454631+0000","last_peered":"2024-09-10T10:09:00.454631+0000","last_clean":"2024-09-10T10:09:00.454631+0000","last_became_active":"2024-09-10T10:08:44.401623+0000","last_became_peered":"2024-09-10T10:08:44.401623+0000","last_unstale":"2024-09-10T10:09:00.454631+0000","last_undegraded":"2024-09-10T10:09:00.454631+0000","last_fullsized":"2024-09-10T10:09:00.454631+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:21.105349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456149+0000","last_change":"2024-09-10T10:08:35.360642+0000","last_active":"2024-09-10T10:09:00.456149+0000","last_peered":"2024-09-10T10:09:00.456149+0000","last_clean":"2024-09-10T10:09:00.456149+0000","last_became_active":"2024-09-10T10:08:35.356667+0000","last_became_peered":"2024-09-10T10:08:35.356667+0000","last_unstale":"2024-09-10T10:09:00.456149+0000","last_undegraded":"2024-09-10T10:09:00.456149+0000","last_fullsized":"2024-09-10T10:09:00.456149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:08.404973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.543845+0000","last_change":"2024-09-10T10:08:32.890418+0000","last_active":"2024-09-10T10:09:25.543845+0000","last_peered":"2024-09-10T10:09:25.543845+0000","last_clean":"2024-09-10T10:09:25.543845+0000","last_became_active":"2024-09-10T10:08:32.890081+0000","last_became_peered":"2024-09-10T10:08:32.890081+0000","last_unstale":"2024-09-10T10:09:25.543845+0000","last_undegraded":"2024-09-10T10:09:25.543845+0000","last_fullsized":"2024-09-10T10:09:25.543845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:52.839714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.451961+0000","last_change":"2024-09-10T10:08:44.401322+0000","last_active":"2024-09-10T10:09:00.451961+0000","last_peered":"2024-09-10T10:09:00.451961+0000","last_clean":"2024-09-10T10:09:00.451961+0000","last_became_active":"2024-09-10T10:08:44.400906+0000","last_became_peered":"2024-09-10T10:08:44.400906+0000","last_unstale":"2024-09-10T10:09:00.451961+0000","last_undegraded":"2024-09-10T10:09:00.451961+0000","last_fullsized":"2024-09-10T10:09:00.451961+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:08.616288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.453035+0000","last_change":"2024-09-10T10:08:35.366580+0000","last_active":"2024-09-10T10:09:00.453035+0000","last_peered":"2024-09-10T10:09:00.453035+0000","last_clean":"2024-09-10T10:09:00.453035+0000","last_became_active":"2024-09-10T10:08:35.365943+0000","last_became_peered":"2024-09-10T10:08:35.365943+0000","last_unstale":"2024-09-10T10:09:00.453035+0000","last_undegraded":"2024-09-10T10:09:00.453035+0000","last_fullsized":"2024-09-10T10:09:00.453035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:58.351517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'29","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:40.568697+0000","last_change":"2024-09-10T10:08:32.888411+0000","last_active":"2024-09-10T10:09:40.568697+0000","last_peered":"2024-09-10T10:09:40.568697+0000","last_clean":"2024-09-10T10:09:40.568697+0000","last_became_active":"2024-09-10T10:08:32.888093+0000","last_became_peered":"2024-09-10T10:08:32.888093+0000","last_unstale":"2024-09-10T10:09:40.568697+0000","last_undegraded":"2024-09-10T10:09:40.568697+0000","last_fullsized":"2024-09-10T10:09:40.568697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.532868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52408,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":69,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484671+0000","last_change":"2024-09-10T10:08:44.400432+0000","last_active":"2024-09-10T10:09:00.484671+0000","last_peered":"2024-09-10T10:09:00.484671+0000","last_clean":"2024-09-10T10:09:00.484671+0000","last_became_active":"2024-09-10T10:08:44.399981+0000","last_became_peered":"2024-09-10T10:08:44.399981+0000","last_unstale":"2024-09-10T10:09:00.484671+0000","last_undegraded":"2024-09-10T10:09:00.484671+0000","last_fullsized":"2024-09-10T10:09:00.484671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:57.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.460848+0000","last_change":"2024-09-10T10:09:00.460848+0000","last_active":"2024-09-10T10:09:00.460848+0000","last_peered":"2024-09-10T10:09:00.460848+0000","last_clean":"2024-09-10T10:09:00.460848+0000","last_became_active":"2024-09-10T10:09:00.460459+0000","last_became_peered":"2024-09-10T10:09:00.460459+0000","last_unstale":"2024-09-10T10:09:00.460848+0000","last_undegraded":"2024-09-10T10:09:00.460848+0000","last_fullsized":"2024-09-10T10:09:00.460848+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:06.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.529554+0000","last_change":"2024-09-10T10:08:32.885909+0000","last_active":"2024-09-10T10:09:24.529554+0000","last_peered":"2024-09-10T10:09:24.529554+0000","last_clean":"2024-09-10T10:09:24.529554+0000","last_became_active":"2024-09-10T10:08:32.885512+0000","last_became_peered":"2024-09-10T10:08:32.885512+0000","last_unstale":"2024-09-10T10:09:24.529554+0000","last_undegraded":"2024-09-10T10:09:24.529554+0000","last_fullsized":"2024-09-10T10:09:24.529554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:44.850772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454689+0000","last_change":"2024-09-10T10:08:44.400323+0000","last_active":"2024-09-10T10:09:00.454689+0000","last_peered":"2024-09-10T10:09:00.454689+0000","last_clean":"2024-09-10T10:09:00.454689+0000","last_became_active":"2024-09-10T10:08:44.399923+0000","last_became_peered":"2024-09-10T10:08:44.399923+0000","last_unstale":"2024-09-10T10:09:00.454689+0000","last_undegraded":"2024-09-10T10:09:00.454689+0000","last_fullsized":"2024-09-10T10:09:00.454689+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:45.496392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485181+0000","last_change":"2024-09-10T10:08:35.375543+0000","last_active":"2024-09-10T10:09:00.485181+0000","last_peered":"2024-09-10T10:09:00.485181+0000","last_clean":"2024-09-10T10:09:00.485181+0000","last_became_active":"2024-09-10T10:08:35.374312+0000","last_became_peered":"2024-09-10T10:08:35.374312+0000","last_unstale":"2024-09-10T10:09:00.485181+0000","last_undegraded":"2024-09-10T10:09:00.485181+0000","last_fullsized":"2024-09-10T10:09:00.485181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:34.208716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.526805+0000","last_change":"2024-09-10T10:08:32.888540+0000","last_active":"2024-09-10T10:09:24.526805+0000","last_peered":"2024-09-10T10:09:24.526805+0000","last_clean":"2024-09-10T10:09:24.526805+0000","last_became_active":"2024-09-10T10:08:32.888187+0000","last_became_peered":"2024-09-10T10:08:32.888187+0000","last_unstale":"2024-09-10T10:09:24.526805+0000","last_undegraded":"2024-09-10T10:09:24.526805+0000","last_fullsized":"2024-09-10T10:09:24.526805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:06.694533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484043+0000","last_change":"2024-09-10T10:08:44.397995+0000","last_active":"2024-09-10T10:09:00.484043+0000","last_peered":"2024-09-10T10:09:00.484043+0000","last_clean":"2024-09-10T10:09:00.484043+0000","last_became_active":"2024-09-10T10:08:44.397583+0000","last_became_peered":"2024-09-10T10:08:44.397583+0000","last_unstale":"2024-09-10T10:09:00.484043+0000","last_undegraded":"2024-09-10T10:09:00.484043+0000","last_fullsized":"2024-09-10T10:09:00.484043+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:03.908014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.458298+0000","last_change":"2024-09-10T10:08:35.361053+0000","last_active":"2024-09-10T10:09:00.458298+0000","last_peered":"2024-09-10T10:09:00.458298+0000","last_clean":"2024-09-10T10:09:00.458298+0000","last_became_active":"2024-09-10T10:08:35.360736+0000","last_became_peered":"2024-09-10T10:08:35.360736+0000","last_unstale":"2024-09-10T10:09:00.458298+0000","last_undegraded":"2024-09-10T10:09:00.458298+0000","last_fullsized":"2024-09-10T10:09:00.458298+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:45.435384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'3","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:39.563381+0000","last_change":"2024-09-10T10:08:32.885067+0000","last_active":"2024-09-10T10:09:39.563381+0000","last_peered":"2024-09-10T10:09:39.563381+0000","last_clean":"2024-09-10T10:09:39.563381+0000","last_became_active":"2024-09-10T10:08:32.884676+0000","last_became_peered":"2024-09-10T10:08:32.884676+0000","last_unstale":"2024-09-10T10:09:39.563381+0000","last_undegraded":"2024-09-10T10:09:39.563381+0000","last_fullsized":"2024-09-10T10:09:39.563381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.667680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.450212+0000","last_change":"2024-09-10T10:08:44.395892+0000","last_active":"2024-09-10T10:09:00.450212+0000","last_peered":"2024-09-10T10:09:00.450212+0000","last_clean":"2024-09-10T10:09:00.450212+0000","last_became_active":"2024-09-10T10:08:44.395188+0000","last_became_peered":"2024-09-10T10:08:44.395188+0000","last_unstale":"2024-09-10T10:09:00.450212+0000","last_undegraded":"2024-09-10T10:09:00.450212+0000","last_fullsized":"2024-09-10T10:09:00.450212+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:27.562053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485601+0000","last_change":"2024-09-10T10:08:44.403185+0000","last_active":"2024-09-10T10:09:00.485601+0000","last_peered":"2024-09-10T10:09:00.485601+0000","last_clean":"2024-09-10T10:09:00.485601+0000","last_became_active":"2024-09-10T10:08:44.399943+0000","last_became_peered":"2024-09-10T10:08:44.399943+0000","last_unstale":"2024-09-10T10:09:00.485601+0000","last_undegraded":"2024-09-10T10:09:00.485601+0000","last_fullsized":"2024-09-10T10:09:00.485601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:07.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484396+0000","last_change":"2024-09-10T10:08:35.367552+0000","last_active":"2024-09-10T10:09:00.484396+0000","last_peered":"2024-09-10T10:09:00.484396+0000","last_clean":"2024-09-10T10:09:00.484396+0000","last_became_active":"2024-09-10T10:08:35.367215+0000","last_became_peered":"2024-09-10T10:08:35.367215+0000","last_unstale":"2024-09-10T10:09:00.484396+0000","last_undegraded":"2024-09-10T10:09:00.484396+0000","last_fullsized":"2024-09-10T10:09:00.484396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:28.756769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.451426+0000","last_change":"2024-09-10T10:08:32.885830+0000","last_active":"2024-09-10T10:09:00.451426+0000","last_peered":"2024-09-10T10:09:00.451426+0000","last_clean":"2024-09-10T10:09:00.451426+0000","last_became_active":"2024-09-10T10:08:32.885465+0000","last_became_peered":"2024-09-10T10:08:32.885465+0000","last_unstale":"2024-09-10T10:09:00.451426+0000","last_undegraded":"2024-09-10T10:09:00.451426+0000","last_fullsized":"2024-09-10T10:09:00.451426+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:55.101364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.487666+0000","last_change":"2024-09-10T10:09:00.487666+0000","last_active":"2024-09-10T10:09:00.487666+0000","last_peered":"2024-09-10T10:09:00.487666+0000","last_clean":"2024-09-10T10:09:00.487666+0000","last_became_active":"2024-09-10T10:09:00.487110+0000","last_became_peered":"2024-09-10T10:09:00.487110+0000","last_unstale":"2024-09-10T10:09:00.487666+0000","last_undegraded":"2024-09-10T10:09:00.487666+0000","last_fullsized":"2024-09-10T10:09:00.487666+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:28.817826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.449882+0000","last_change":"2024-09-10T10:08:35.356247+0000","last_active":"2024-09-10T10:09:00.449882+0000","last_peered":"2024-09-10T10:09:00.449882+0000","last_clean":"2024-09-10T10:09:00.449882+0000","last_became_active":"2024-09-10T10:08:35.355953+0000","last_became_peered":"2024-09-10T10:08:35.355953+0000","last_unstale":"2024-09-10T10:09:00.449882+0000","last_undegraded":"2024-09-10T10:09:00.449882+0000","last_fullsized":"2024-09-10T10:09:00.449882+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:24.625382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.544892+0000","last_change":"2024-09-10T10:08:32.882151+0000","last_active":"2024-09-10T10:09:25.544892+0000","last_peered":"2024-09-10T10:09:25.544892+0000","last_clean":"2024-09-10T10:09:25.544892+0000","last_became_active":"2024-09-10T10:08:32.881688+0000","last_became_peered":"2024-09-10T10:08:32.881688+0000","last_unstale":"2024-09-10T10:09:25.544892+0000","last_undegraded":"2024-09-10T10:09:25.544892+0000","last_fullsized":"2024-09-10T10:09:25.544892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:49.186299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.543826+0000","last_change":"2024-09-10T10:08:32.887018+0000","last_active":"2024-09-10T10:09:25.543826+0000","last_peered":"2024-09-10T10:09:25.543826+0000","last_clean":"2024-09-10T10:09:25.543826+0000","last_became_active":"2024-09-10T10:08:32.886636+0000","last_became_peered":"2024-09-10T10:08:32.886636+0000","last_unstale":"2024-09-10T10:09:25.543826+0000","last_undegraded":"2024-09-10T10:09:25.543826+0000","last_fullsized":"2024-09-10T10:09:25.543826+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:24.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.451581+0000","last_change":"2024-09-10T10:08:35.363803+0000","last_active":"2024-09-10T10:09:00.451581+0000","last_peered":"2024-09-10T10:09:00.451581+0000","last_clean":"2024-09-10T10:09:00.451581+0000","last_became_active":"2024-09-10T10:08:35.363442+0000","last_became_peered":"2024-09-10T10:08:35.363442+0000","last_unstale":"2024-09-10T10:09:00.451581+0000","last_undegraded":"2024-09-10T10:09:00.451581+0000","last_fullsized":"2024-09-10T10:09:00.451581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:59.045347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.483895+0000","last_change":"2024-09-10T10:08:44.403970+0000","last_active":"2024-09-10T10:09:00.483895+0000","last_peered":"2024-09-10T10:09:00.483895+0000","last_clean":"2024-09-10T10:09:00.483895+0000","last_became_active":"2024-09-10T10:08:44.403462+0000","last_became_peered":"2024-09-10T10:08:44.403462+0000","last_unstale":"2024-09-10T10:09:00.483895+0000","last_undegraded":"2024-09-10T10:09:00.483895+0000","last_fullsized":"2024-09-10T10:09:00.483895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:09.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:40.565642+0000","last_change":"2024-09-10T10:08:32.893227+0000","last_active":"2024-09-10T10:09:40.565642+0000","last_peered":"2024-09-10T10:09:40.565642+0000","last_clean":"2024-09-10T10:09:40.565642+0000","last_became_active":"2024-09-10T10:08:32.892732+0000","last_became_peered":"2024-09-10T10:08:32.892732+0000","last_unstale":"2024-09-10T10:09:40.565642+0000","last_undegraded":"2024-09-10T10:09:40.565642+0000","last_fullsized":"2024-09-10T10:09:40.565642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:16.933955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.452567+0000","last_change":"2024-09-10T10:08:35.368806+0000","last_active":"2024-09-10T10:09:00.452567+0000","last_peered":"2024-09-10T10:09:00.452567+0000","last_clean":"2024-09-10T10:09:00.452567+0000","last_became_active":"2024-09-10T10:08:35.368397+0000","last_became_peered":"2024-09-10T10:08:35.368397+0000","last_unstale":"2024-09-10T10:09:00.452567+0000","last_undegraded":"2024-09-10T10:09:00.452567+0000","last_fullsized":"2024-09-10T10:09:00.452567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:39.656295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484087+0000","last_change":"2024-09-10T10:08:44.391941+0000","last_active":"2024-09-10T10:09:00.484087+0000","last_peered":"2024-09-10T10:09:00.484087+0000","last_clean":"2024-09-10T10:09:00.484087+0000","last_became_active":"2024-09-10T10:08:44.391553+0000","last_became_peered":"2024-09-10T10:08:44.391553+0000","last_unstale":"2024-09-10T10:09:00.484087+0000","last_undegraded":"2024-09-10T10:09:00.484087+0000","last_fullsized":"2024-09-10T10:09:00.484087+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:34.279772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454411+0000","last_change":"2024-09-10T10:08:35.363192+0000","last_active":"2024-09-10T10:09:00.454411+0000","last_peered":"2024-09-10T10:09:00.454411+0000","last_clean":"2024-09-10T10:09:00.454411+0000","last_became_active":"2024-09-10T10:08:35.362890+0000","last_became_peered":"2024-09-10T10:08:35.362890+0000","last_unstale":"2024-09-10T10:09:00.454411+0000","last_undegraded":"2024-09-10T10:09:00.454411+0000","last_fullsized":"2024-09-10T10:09:00.454411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:07.493539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484080+0000","last_change":"2024-09-10T10:08:35.362471+0000","last_active":"2024-09-10T10:09:00.484080+0000","last_peered":"2024-09-10T10:09:00.484080+0000","last_clean":"2024-09-10T10:09:00.484080+0000","last_became_active":"2024-09-10T10:08:35.361553+0000","last_became_peered":"2024-09-10T10:08:35.361553+0000","last_unstale":"2024-09-10T10:09:00.484080+0000","last_undegraded":"2024-09-10T10:09:00.484080+0000","last_fullsized":"2024-09-10T10:09:00.484080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:24.511901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.483769+0000","last_change":"2024-09-10T10:08:35.371025+0000","last_active":"2024-09-10T10:09:00.483769+0000","last_peered":"2024-09-10T10:09:00.483769+0000","last_clean":"2024-09-10T10:09:00.483769+0000","last_became_active":"2024-09-10T10:08:35.370692+0000","last_became_peered":"2024-09-10T10:08:35.370692+0000","last_unstale":"2024-09-10T10:09:00.483769+0000","last_undegraded":"2024-09-10T10:09:00.483769+0000","last_fullsized":"2024-09-10T10:09:00.483769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:22.289843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485029+0000","last_change":"2024-09-10T10:08:35.373519+0000","last_active":"2024-09-10T10:09:00.485029+0000","last_peered":"2024-09-10T10:09:00.485029+0000","last_clean":"2024-09-10T10:09:00.485029+0000","last_became_active":"2024-09-10T10:08:35.372719+0000","last_became_peered":"2024-09-10T10:08:35.372719+0000","last_unstale":"2024-09-10T10:09:00.485029+0000","last_undegraded":"2024-09-10T10:09:00.485029+0000","last_fullsized":"2024-09-10T10:09:00.485029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:24.530809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.489944+0000","last_change":"2024-09-10T10:09:00.489944+0000","last_active":"2024-09-10T10:09:00.489944+0000","last_peered":"2024-09-10T10:09:00.489944+0000","last_clean":"2024-09-10T10:09:00.489944+0000","last_became_active":"2024-09-10T10:09:00.489269+0000","last_became_peered":"2024-09-10T10:09:00.489269+0000","last_unstale":"2024-09-10T10:09:00.489944+0000","last_undegraded":"2024-09-10T10:09:00.489944+0000","last_fullsized":"2024-09-10T10:09:00.489944+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:46.561078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454964+0000","last_change":"2024-09-10T10:08:35.364779+0000","last_active":"2024-09-10T10:09:00.454964+0000","last_peered":"2024-09-10T10:09:00.454964+0000","last_clean":"2024-09-10T10:09:00.454964+0000","last_became_active":"2024-09-10T10:08:35.364455+0000","last_became_peered":"2024-09-10T10:08:35.364455+0000","last_unstale":"2024-09-10T10:09:00.454964+0000","last_undegraded":"2024-09-10T10:09:00.454964+0000","last_fullsized":"2024-09-10T10:09:00.454964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:08.552218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484237+0000","last_change":"2024-09-10T10:08:35.357147+0000","last_active":"2024-09-10T10:09:00.484237+0000","last_peered":"2024-09-10T10:09:00.484237+0000","last_clean":"2024-09-10T10:09:00.484237+0000","last_became_active":"2024-09-10T10:08:35.356808+0000","last_became_peered":"2024-09-10T10:08:35.356808+0000","last_unstale":"2024-09-10T10:09:00.484237+0000","last_undegraded":"2024-09-10T10:09:00.484237+0000","last_fullsized":"2024-09-10T10:09:00.484237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:35.731496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.450453+0000","last_change":"2024-09-10T10:08:35.365795+0000","last_active":"2024-09-10T10:09:00.450453+0000","last_peered":"2024-09-10T10:09:00.450453+0000","last_clean":"2024-09-10T10:09:00.450453+0000","last_became_active":"2024-09-10T10:08:35.365342+0000","last_became_peered":"2024-09-10T10:08:35.365342+0000","last_unstale":"2024-09-10T10:09:00.450453+0000","last_undegraded":"2024-09-10T10:09:00.450453+0000","last_fullsized":"2024-09-10T10:09:00.450453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:20.012890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.487412+0000","last_change":"2024-09-10T10:09:00.486664+0000","last_active":"2024-09-10T10:09:00.487412+0000","last_peered":"2024-09-10T10:09:00.487412+0000","last_clean":"2024-09-10T10:09:00.487412+0000","last_became_active":"2024-09-10T10:09:00.486239+0000","last_became_peered":"2024-09-10T10:09:00.486239+0000","last_unstale":"2024-09-10T10:09:00.487412+0000","last_undegraded":"2024-09-10T10:09:00.487412+0000","last_fullsized":"2024-09-10T10:09:00.487412+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:47.472245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.449776+0000","last_change":"2024-09-10T10:08:35.367403+0000","last_active":"2024-09-10T10:09:00.449776+0000","last_peered":"2024-09-10T10:09:00.449776+0000","last_clean":"2024-09-10T10:09:00.449776+0000","last_became_active":"2024-09-10T10:08:35.365969+0000","last_became_peered":"2024-09-10T10:08:35.365969+0000","last_unstale":"2024-09-10T10:09:00.449776+0000","last_undegraded":"2024-09-10T10:09:00.449776+0000","last_fullsized":"2024-09-10T10:09:00.449776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:27.657226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.457879+0000","last_change":"2024-09-10T10:08:35.359185+0000","last_active":"2024-09-10T10:09:00.457879+0000","last_peered":"2024-09-10T10:09:00.457879+0000","last_clean":"2024-09-10T10:09:00.457879+0000","last_became_active":"2024-09-10T10:08:35.358825+0000","last_became_peered":"2024-09-10T10:08:35.358825+0000","last_unstale":"2024-09-10T10:09:00.457879+0000","last_undegraded":"2024-09-10T10:09:00.457879+0000","last_fullsized":"2024-09-10T10:09:00.457879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:31.884533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456527+0000","last_change":"2024-09-10T10:08:35.378151+0000","last_active":"2024-09-10T10:09:00.456527+0000","last_peered":"2024-09-10T10:09:00.456527+0000","last_clean":"2024-09-10T10:09:00.456527+0000","last_became_active":"2024-09-10T10:08:35.377784+0000","last_became_peered":"2024-09-10T10:08:35.377784+0000","last_unstale":"2024-09-10T10:09:00.456527+0000","last_undegraded":"2024-09-10T10:09:00.456527+0000","last_fullsized":"2024-09-10T10:09:00.456527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.027310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454760+0000","last_change":"2024-09-10T10:08:35.364550+0000","last_active":"2024-09-10T10:09:00.454760+0000","last_peered":"2024-09-10T10:09:00.454760+0000","last_clean":"2024-09-10T10:09:00.454760+0000","last_became_active":"2024-09-10T10:08:35.364224+0000","last_became_peered":"2024-09-10T10:08:35.364224+0000","last_unstale":"2024-09-10T10:09:00.454760+0000","last_undegraded":"2024-09-10T10:09:00.454760+0000","last_fullsized":"2024-09-10T10:09:00.454760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:38.584494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484240+0000","last_change":"2024-09-10T10:08:35.357333+0000","last_active":"2024-09-10T10:09:00.484240+0000","last_peered":"2024-09-10T10:09:00.484240+0000","last_clean":"2024-09-10T10:09:00.484240+0000","last_became_active":"2024-09-10T10:08:35.356940+0000","last_became_peered":"2024-09-10T10:08:35.356940+0000","last_unstale":"2024-09-10T10:09:00.484240+0000","last_undegraded":"2024-09-10T10:09:00.484240+0000","last_fullsized":"2024-09-10T10:09:00.484240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:40.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485082+0000","last_change":"2024-09-10T10:08:35.367208+0000","last_active":"2024-09-10T10:09:00.485082+0000","last_peered":"2024-09-10T10:09:00.485082+0000","last_clean":"2024-09-10T10:09:00.485082+0000","last_became_active":"2024-09-10T10:08:35.361942+0000","last_became_peered":"2024-09-10T10:08:35.361942+0000","last_unstale":"2024-09-10T10:09:00.485082+0000","last_undegraded":"2024-09-10T10:09:00.485082+0000","last_fullsized":"2024-09-10T10:09:00.485082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:19.030623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.455341+0000","last_change":"2024-09-10T10:08:35.377164+0000","last_active":"2024-09-10T10:09:00.455341+0000","last_peered":"2024-09-10T10:09:00.455341+0000","last_clean":"2024-09-10T10:09:00.455341+0000","last_became_active":"2024-09-10T10:08:35.376457+0000","last_became_peered":"2024-09-10T10:08:35.376457+0000","last_unstale":"2024-09-10T10:09:00.455341+0000","last_undegraded":"2024-09-10T10:09:00.455341+0000","last_fullsized":"2024-09-10T10:09:00.455341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.291635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.457518+0000","last_change":"2024-09-10T10:08:35.365096+0000","last_active":"2024-09-10T10:09:00.457518+0000","last_peered":"2024-09-10T10:09:00.457518+0000","last_clean":"2024-09-10T10:09:00.457518+0000","last_became_active":"2024-09-10T10:08:35.364780+0000","last_became_peered":"2024-09-10T10:08:35.364780+0000","last_unstale":"2024-09-10T10:09:00.457518+0000","last_undegraded":"2024-09-10T10:09:00.457518+0000","last_fullsized":"2024-09-10T10:09:00.457518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:30.177904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485416+0000","last_change":"2024-09-10T10:08:35.377017+0000","last_active":"2024-09-10T10:09:00.485416+0000","last_peered":"2024-09-10T10:09:00.485416+0000","last_clean":"2024-09-10T10:09:00.485416+0000","last_became_active":"2024-09-10T10:08:35.372243+0000","last_became_peered":"2024-09-10T10:08:35.372243+0000","last_unstale":"2024-09-10T10:09:00.485416+0000","last_undegraded":"2024-09-10T10:09:00.485416+0000","last_fullsized":"2024-09-10T10:09:00.485416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:26.105505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484060+0000","last_change":"2024-09-10T10:08:35.379782+0000","last_active":"2024-09-10T10:09:00.484060+0000","last_peered":"2024-09-10T10:09:00.484060+0000","last_clean":"2024-09-10T10:09:00.484060+0000","last_became_active":"2024-09-10T10:08:35.377109+0000","last_became_peered":"2024-09-10T10:08:35.377109+0000","last_unstale":"2024-09-10T10:09:00.484060+0000","last_undegraded":"2024-09-10T10:09:00.484060+0000","last_fullsized":"2024-09-10T10:09:00.484060+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:10.761016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456429+0000","last_change":"2024-09-10T10:08:35.364891+0000","last_active":"2024-09-10T10:09:00.456429+0000","last_peered":"2024-09-10T10:09:00.456429+0000","last_clean":"2024-09-10T10:09:00.456429+0000","last_became_active":"2024-09-10T10:08:35.363845+0000","last_became_peered":"2024-09-10T10:08:35.363845+0000","last_unstale":"2024-09-10T10:09:00.456429+0000","last_undegraded":"2024-09-10T10:09:00.456429+0000","last_fullsized":"2024-09-10T10:09:00.456429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:03.346994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454735+0000","last_change":"2024-09-10T10:08:35.363548+0000","last_active":"2024-09-10T10:09:00.454735+0000","last_peered":"2024-09-10T10:09:00.454735+0000","last_clean":"2024-09-10T10:09:00.454735+0000","last_became_active":"2024-09-10T10:08:35.363229+0000","last_became_peered":"2024-09-10T10:08:35.363229+0000","last_unstale":"2024-09-10T10:09:00.454735+0000","last_undegraded":"2024-09-10T10:09:00.454735+0000","last_fullsized":"2024-09-10T10:09:00.454735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:38.773445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485346+0000","last_change":"2024-09-10T10:08:35.360717+0000","last_active":"2024-09-10T10:09:00.485346+0000","last_peered":"2024-09-10T10:09:00.485346+0000","last_clean":"2024-09-10T10:09:00.485346+0000","last_became_active":"2024-09-10T10:08:35.360410+0000","last_became_peered":"2024-09-10T10:08:35.360410+0000","last_unstale":"2024-09-10T10:09:00.485346+0000","last_undegraded":"2024-09-10T10:09:00.485346+0000","last_fullsized":"2024-09-10T10:09:00.485346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:59.322524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485908+0000","last_change":"2024-09-10T10:08:35.362359+0000","last_active":"2024-09-10T10:09:00.485908+0000","last_peered":"2024-09-10T10:09:00.485908+0000","last_clean":"2024-09-10T10:09:00.485908+0000","last_became_active":"2024-09-10T10:08:35.361580+0000","last_became_peered":"2024-09-10T10:08:35.361580+0000","last_unstale":"2024-09-10T10:09:00.485908+0000","last_undegraded":"2024-09-10T10:09:00.485908+0000","last_fullsized":"2024-09-10T10:09:00.485908+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:23.265237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.458544+0000","last_change":"2024-09-10T10:08:35.367305+0000","last_active":"2024-09-10T10:09:00.458544+0000","last_peered":"2024-09-10T10:09:00.458544+0000","last_clean":"2024-09-10T10:09:00.458544+0000","last_became_active":"2024-09-10T10:08:35.366936+0000","last_became_peered":"2024-09-10T10:08:35.366936+0000","last_unstale":"2024-09-10T10:09:00.458544+0000","last_undegraded":"2024-09-10T10:09:00.458544+0000","last_fullsized":"2024-09-10T10:09:00.458544+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:28.158474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.449779+0000","last_change":"2024-09-10T10:08:35.369983+0000","last_active":"2024-09-10T10:09:00.449779+0000","last_peered":"2024-09-10T10:09:00.449779+0000","last_clean":"2024-09-10T10:09:00.449779+0000","last_became_active":"2024-09-10T10:08:35.367662+0000","last_became_peered":"2024-09-10T10:08:35.367662+0000","last_unstale":"2024-09-10T10:09:00.449779+0000","last_undegraded":"2024-09-10T10:09:00.449779+0000","last_fullsized":"2024-09-10T10:09:00.449779+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484786+0000","last_change":"2024-09-10T10:08:35.369237+0000","last_active":"2024-09-10T10:09:00.484786+0000","last_peered":"2024-09-10T10:09:00.484786+0000","last_clean":"2024-09-10T10:09:00.484786+0000","last_became_active":"2024-09-10T10:08:35.368903+0000","last_became_peered":"2024-09-10T10:08:35.368903+0000","last_unstale":"2024-09-10T10:09:00.484786+0000","last_undegraded":"2024-09-10T10:09:00.484786+0000","last_fullsized":"2024-09-10T10:09:00.484786+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:05.150549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484941+0000","last_change":"2024-09-10T10:08:35.367284+0000","last_active":"2024-09-10T10:09:00.484941+0000","last_peered":"2024-09-10T10:09:00.484941+0000","last_clean":"2024-09-10T10:09:00.484941+0000","last_became_active":"2024-09-10T10:08:35.366969+0000","last_became_peered":"2024-09-10T10:08:35.366969+0000","last_unstale":"2024-09-10T10:09:00.484941+0000","last_undegraded":"2024-09-10T10:09:00.484941+0000","last_fullsized":"2024-09-10T10:09:00.484941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:16.949804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.452034+0000","last_change":"2024-09-10T10:08:35.374559+0000","last_active":"2024-09-10T10:09:00.452034+0000","last_peered":"2024-09-10T10:09:00.452034+0000","last_clean":"2024-09-10T10:09:00.452034+0000","last_became_active":"2024-09-10T10:08:35.374191+0000","last_became_peered":"2024-09-10T10:08:35.374191+0000","last_unstale":"2024-09-10T10:09:00.452034+0000","last_undegraded":"2024-09-10T10:09:00.452034+0000","last_fullsized":"2024-09-10T10:09:00.452034+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:48.292249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454670+0000","last_change":"2024-09-10T10:08:35.368042+0000","last_active":"2024-09-10T10:09:00.454670+0000","last_peered":"2024-09-10T10:09:00.454670+0000","last_clean":"2024-09-10T10:09:00.454670+0000","last_became_active":"2024-09-10T10:08:35.365985+0000","last_became_peered":"2024-09-10T10:08:35.365985+0000","last_unstale":"2024-09-10T10:09:00.454670+0000","last_undegraded":"2024-09-10T10:09:00.454670+0000","last_fullsized":"2024-09-10T10:09:00.454670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:04.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485879+0000","last_change":"2024-09-10T10:08:35.375826+0000","last_active":"2024-09-10T10:09:00.485879+0000","last_peered":"2024-09-10T10:09:00.485879+0000","last_clean":"2024-09-10T10:09:00.485879+0000","last_became_active":"2024-09-10T10:08:35.375485+0000","last_became_peered":"2024-09-10T10:08:35.375485+0000","last_unstale":"2024-09-10T10:09:00.485879+0000","last_undegraded":"2024-09-10T10:09:00.485879+0000","last_fullsized":"2024-09-10T10:09:00.485879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:49.146648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485697+0000","last_change":"2024-09-10T10:08:35.375745+0000","last_active":"2024-09-10T10:09:00.485697+0000","last_peered":"2024-09-10T10:09:00.485697+0000","last_clean":"2024-09-10T10:09:00.485697+0000","last_became_active":"2024-09-10T10:08:35.375427+0000","last_became_peered":"2024-09-10T10:08:35.375427+0000","last_unstale":"2024-09-10T10:09:00.485697+0000","last_undegraded":"2024-09-10T10:09:00.485697+0000","last_fullsized":"2024-09-10T10:09:00.485697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:48.743434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.455230+0000","last_change":"2024-09-10T10:08:35.377092+0000","last_active":"2024-09-10T10:09:00.455230+0000","last_peered":"2024-09-10T10:09:00.455230+0000","last_clean":"2024-09-10T10:09:00.455230+0000","last_became_active":"2024-09-10T10:08:35.376761+0000","last_became_peered":"2024-09-10T10:08:35.376761+0000","last_unstale":"2024-09-10T10:09:00.455230+0000","last_undegraded":"2024-09-10T10:09:00.455230+0000","last_fullsized":"2024-09-10T10:09:00.455230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:58.631742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56804,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":118,"num_read_kb":121,"num_write":156,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":161349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286200,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449114,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":519524,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678049,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32308,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712844,"statfs":{"total":95995035648,"available":95961952256,"internally_reserved":0,"allocated":1150976,"data_stored":1159571,"data_compressed":62856,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841573,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":523834,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070507,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":519636,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299439,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":1115962,"data_compressed":62856,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462967,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":514914,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724605,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1089536,"data_stored":1111157,"data_compressed":62856,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888128,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":519957,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149766,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":515108,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":559912,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":567232,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":516302,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":52408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":45088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:09:45.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:09:45.548 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:45.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:45 smithi050 ceph-mon[30354]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:09:46.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:45 smithi189 ceph-mon[34999]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:09:46.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:45 smithi084 ceph-mon[34812]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:09:46.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.086+0000 7f0b31800640 1 -- 172.21.15.50:0/2517287663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b2c112a30 msgr2=0x7f0b2c114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:46.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.086+0000 7f0b31800640 1 --2- 172.21.15.50:0/2517287663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b2c112a30 0x7f0b2c114e20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009ca0 tx=0x7f0b2402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:09:46.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.086+0000 7f0b31800640 1 -- 172.21.15.50:0/2517287663 shutdown_connections 2024-09-10T10:09:46.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.086+0000 7f0b31800640 1 --2- 172.21.15.50:0/2517287663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b2c112a30 0x7f0b2c114e20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:46.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.086+0000 7f0b31800640 1 --2- 172.21.15.50:0/2517287663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b2c077040 0x7f0b2c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:46.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.086+0000 7f0b31800640 1 --2- 172.21.15.50:0/2517287663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b2c076720 0x7f0b2c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:46.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.086+0000 7f0b31800640 1 -- 172.21.15.50:0/2517287663 >> 172.21.15.50:0/2517287663 conn(0x7f0b2c0ffa90 msgr2=0x7f0b2c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:46.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.086+0000 7f0b31800640 1 -- 172.21.15.50:0/2517287663 shutdown_connections 2024-09-10T10:09:46.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.086+0000 7f0b31800640 1 -- 172.21.15.50:0/2517287663 wait complete. 2024-09-10T10:09:46.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.087+0000 7f0b31800640 1 Processor -- start 2024-09-10T10:09:46.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.087+0000 7f0b31800640 1 -- start start 2024-09-10T10:09:46.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.088+0000 7f0b31800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b2c076720 0x7f0b2c1a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:46.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.088+0000 7f0b31800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b2c077040 0x7f0b2c1a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.088+0000 7f0b31800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b2c112a30 0x7f0b2c19e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.088+0000 7f0b31800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c118580 con 0x7f0b2c112a30 2024-09-10T10:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.088+0000 7f0b31800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c118400 con 0x7f0b2c077040 2024-09-10T10:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.088+0000 7f0b31800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c118700 con 0x7f0b2c076720 2024-09-10T10:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.088+0000 7f0b2aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b2c076720 0x7f0b2c1a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.088+0000 7f0b2aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b2c076720 0x7f0b2c1a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:43270/0 (socket says 172.21.15.50:43270) 2024-09-10T10:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.088+0000 7f0b2aa00640 1 -- 172.21.15.50:0/268575674 learned_addr learned my addr 172.21.15.50:0/268575674 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.088+0000 7f0b2b400640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b2c112a30 0x7f0b2c19e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.088+0000 7f0b23e00640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b2c077040 0x7f0b2c1a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.089+0000 7f0b2b400640 1 -- 172.21.15.50:0/268575674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b2c076720 msgr2=0x7f0b2c1a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.089+0000 7f0b2b400640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b2c076720 0x7f0b2c1a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.089+0000 7f0b2b400640 1 -- 172.21.15.50:0/268575674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b2c077040 msgr2=0x7f0b2c1a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:46.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.089+0000 7f0b2b400640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b2c077040 0x7f0b2c1a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.089+0000 7f0b2b400640 1 -- 172.21.15.50:0/268575674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c19efe0 con 0x7f0b2c112a30 2024-09-10T10:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.089+0000 7f0b2aa00640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b2c076720 0x7f0b2c1a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.089+0000 7f0b23e00640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b2c077040 0x7f0b2c1a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.089+0000 7f0b2b400640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b2c112a30 0x7f0b2c19e840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0b2402ade0 tx=0x7f0b240319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.089+0000 7f0b23400640 1 -- 172.21.15.50:0/268575674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24003b70 con 0x7f0b2c112a30 2024-09-10T10:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.089+0000 7f0b23400640 1 -- 172.21.15.50:0/268575674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b24003d10 con 0x7f0b2c112a30 2024-09-10T10:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.089+0000 7f0b23400640 1 -- 172.21.15.50:0/268575674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2402fc10 con 0x7f0b2c112a30 2024-09-10T10:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.089+0000 7f0b31800640 1 -- 172.21.15.50:0/268575674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2c19f270 con 0x7f0b2c112a30 2024-09-10T10:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.090+0000 7f0b31800640 1 -- 172.21.15.50:0/268575674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2c1ab520 con 0x7f0b2c112a30 2024-09-10T10:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.091+0000 7f0b31800640 1 -- 172.21.15.50:0/268575674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b2c077e60 con 0x7f0b2c112a30 2024-09-10T10:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.092+0000 7f0b23400640 1 -- 172.21.15.50:0/268575674 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0b24004050 con 0x7f0b2c112a30 2024-09-10T10:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.094+0000 7f0b23400640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b100a2c10 0x7f0b100a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:46.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.095+0000 7f0b23400640 1 -- 172.21.15.50:0/268575674 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f0b240f03b0 con 0x7f0b2c112a30 2024-09-10T10:09:46.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.095+0000 7f0b2aa00640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b100a2c10 0x7f0b100a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:46.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.095+0000 7f0b2aa00640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b100a2c10 0x7f0b100a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c011500 tx=0x7f0b1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:46.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.098+0000 7f0b23400640 1 -- 172.21.15.50:0/268575674 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b240bcf00 con 0x7f0b2c112a30 2024-09-10T10:09:46.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.284+0000 7f0b31800640 1 -- 172.21.15.50:0/268575674 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b2c062630 con 0x7f0b100a2c10 2024-09-10T10:09:46.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.293+0000 7f0b23400640 1 -- 172.21.15.50:0/268575674 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340633 (secure 0 0 0) 0x7f0b2c062630 con 0x7f0b100a2c10 2024-09-10T10:09:46.299 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:09:46.300 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-10T10:09:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.297+0000 7f0b31800640 1 -- 172.21.15.50:0/268575674 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b100a2c10 msgr2=0x7f0b100a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.297+0000 7f0b31800640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b100a2c10 0x7f0b100a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c011500 tx=0x7f0b1c005f90 comp rx=0 tx=0).stop 2024-09-10T10:09:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.297+0000 7f0b31800640 1 -- 172.21.15.50:0/268575674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b2c112a30 msgr2=0x7f0b2c19e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.298+0000 7f0b31800640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b2c112a30 0x7f0b2c19e840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0b2402ade0 tx=0x7f0b240319f0 comp rx=0 tx=0).stop 2024-09-10T10:09:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.298+0000 7f0b31800640 1 -- 172.21.15.50:0/268575674 shutdown_connections 2024-09-10T10:09:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.298+0000 7f0b31800640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b100a2c10 0x7f0b100a50d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.298+0000 7f0b31800640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b2c112a30 0x7f0b2c19e840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:46.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.298+0000 7f0b31800640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b2c077040 0x7f0b2c1a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.298+0000 7f0b31800640 1 --2- 172.21.15.50:0/268575674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b2c076720 0x7f0b2c1a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.298+0000 7f0b31800640 1 -- 172.21.15.50:0/268575674 >> 172.21.15.50:0/268575674 conn(0x7f0b2c0ffa90 msgr2=0x7f0b2c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.298+0000 7f0b31800640 1 -- 172.21.15.50:0/268575674 shutdown_connections 2024-09-10T10:09:46.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:46.298+0000 7f0b31800640 1 -- 172.21.15.50:0/268575674 wait complete. 2024-09-10T10:09:46.833 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:46 smithi050 ceph-mon[30354]: pgmap v346: 129 pgs: 129 active+clean; 632 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-10T10:09:47.060 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-09-10T10:09:44.771524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647406,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":244,"num_read_kb":230,"num_write":346,"num_write_kb":3045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361616,"kb_used_data":12368,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580208,"statfs":{"total":1151940427776,"available":1151570132992,"internally_reserved":0,"allocated":12664832,"data_stored":8152172,"data_compressed":426735,"data_compressed_allocated":577536,"data_compressed_original":2654208,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42589,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":73,"num_write":31,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003249"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.543394+0000","last_change":"2024-09-10T10:08:32.889755+0000","last_active":"2024-09-10T10:09:25.543394+0000","last_peered":"2024-09-10T10:09:25.543394+0000","last_clean":"2024-09-10T10:09:25.543394+0000","last_became_active":"2024-09-10T10:08:32.889455+0000","last_became_peered":"2024-09-10T10:08:32.889455+0000","last_unstale":"2024-09-10T10:09:25.543394+0000","last_undegraded":"2024-09-10T10:09:25.543394+0000","last_fullsized":"2024-09-10T10:09:25.543394+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:53.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.450270+0000","last_change":"2024-09-10T10:08:35.367046+0000","last_active":"2024-09-10T10:09:00.450270+0000","last_peered":"2024-09-10T10:09:00.450270+0000","last_clean":"2024-09-10T10:09:00.450270+0000","last_became_active":"2024-09-10T10:08:35.362087+0000","last_became_peered":"2024-09-10T10:08:35.362087+0000","last_unstale":"2024-09-10T10:09:00.450270+0000","last_undegraded":"2024-09-10T10:09:00.450270+0000","last_fullsized":"2024-09-10T10:09:00.450270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:34.428994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.483703+0000","last_change":"2024-09-10T10:08:44.399836+0000","last_active":"2024-09-10T10:09:00.483703+0000","last_peered":"2024-09-10T10:09:00.483703+0000","last_clean":"2024-09-10T10:09:00.483703+0000","last_became_active":"2024-09-10T10:08:44.399510+0000","last_became_peered":"2024-09-10T10:08:44.399510+0000","last_unstale":"2024-09-10T10:09:00.483703+0000","last_undegraded":"2024-09-10T10:09:00.483703+0000","last_fullsized":"2024-09-10T10:09:00.483703+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:47.372690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.450504+0000","last_change":"2024-09-10T10:08:32.887099+0000","last_active":"2024-09-10T10:09:00.450504+0000","last_peered":"2024-09-10T10:09:00.450504+0000","last_clean":"2024-09-10T10:09:00.450504+0000","last_became_active":"2024-09-10T10:08:32.886730+0000","last_became_peered":"2024-09-10T10:08:32.886730+0000","last_unstale":"2024-09-10T10:09:00.450504+0000","last_undegraded":"2024-09-10T10:09:00.450504+0000","last_fullsized":"2024-09-10T10:09:00.450504+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.277241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485089+0000","last_change":"2024-09-10T10:08:35.375494+0000","last_active":"2024-09-10T10:09:00.485089+0000","last_peered":"2024-09-10T10:09:00.485089+0000","last_clean":"2024-09-10T10:09:00.485089+0000","last_became_active":"2024-09-10T10:08:35.373991+0000","last_became_peered":"2024-09-10T10:08:35.373991+0000","last_unstale":"2024-09-10T10:09:00.485089+0000","last_undegraded":"2024-09-10T10:09:00.485089+0000","last_fullsized":"2024-09-10T10:09:00.485089+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:25.858163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.457967+0000","last_change":"2024-09-10T10:09:00.457967+0000","last_active":"2024-09-10T10:09:00.457967+0000","last_peered":"2024-09-10T10:09:00.457967+0000","last_clean":"2024-09-10T10:09:00.457967+0000","last_became_active":"2024-09-10T10:09:00.457446+0000","last_became_peered":"2024-09-10T10:09:00.457446+0000","last_unstale":"2024-09-10T10:09:00.457967+0000","last_undegraded":"2024-09-10T10:09:00.457967+0000","last_fullsized":"2024-09-10T10:09:00.457967+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:00.550304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.540590+0000","last_change":"2024-09-10T10:08:32.890270+0000","last_active":"2024-09-10T10:09:25.540590+0000","last_peered":"2024-09-10T10:09:25.540590+0000","last_clean":"2024-09-10T10:09:25.540590+0000","last_became_active":"2024-09-10T10:08:32.889887+0000","last_became_peered":"2024-09-10T10:08:32.889887+0000","last_unstale":"2024-09-10T10:09:25.540590+0000","last_undegraded":"2024-09-10T10:09:25.540590+0000","last_fullsized":"2024-09-10T10:09:25.540590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:39.757510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.457672+0000","last_change":"2024-09-10T10:08:35.357257+0000","last_active":"2024-09-10T10:09:00.457672+0000","last_peered":"2024-09-10T10:09:00.457672+0000","last_clean":"2024-09-10T10:09:00.457672+0000","last_became_active":"2024-09-10T10:08:35.356918+0000","last_became_peered":"2024-09-10T10:08:35.356918+0000","last_unstale":"2024-09-10T10:09:00.457672+0000","last_undegraded":"2024-09-10T10:09:00.457672+0000","last_fullsized":"2024-09-10T10:09:00.457672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:04.387581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.487116+0000","last_change":"2024-09-10T10:09:00.487116+0000","last_active":"2024-09-10T10:09:00.487116+0000","last_peered":"2024-09-10T10:09:00.487116+0000","last_clean":"2024-09-10T10:09:00.487116+0000","last_became_active":"2024-09-10T10:09:00.486646+0000","last_became_peered":"2024-09-10T10:09:00.486646+0000","last_unstale":"2024-09-10T10:09:00.487116+0000","last_undegraded":"2024-09-10T10:09:00.487116+0000","last_fullsized":"2024-09-10T10:09:00.487116+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:40.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.453413+0000","last_change":"2024-09-10T10:08:32.891399+0000","last_active":"2024-09-10T10:09:00.453413+0000","last_peered":"2024-09-10T10:09:00.453413+0000","last_clean":"2024-09-10T10:09:00.453413+0000","last_became_active":"2024-09-10T10:08:32.891022+0000","last_became_peered":"2024-09-10T10:08:32.891022+0000","last_unstale":"2024-09-10T10:09:00.453413+0000","last_undegraded":"2024-09-10T10:09:00.453413+0000","last_fullsized":"2024-09-10T10:09:00.453413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:30.842443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.452062+0000","last_change":"2024-09-10T10:08:35.370630+0000","last_active":"2024-09-10T10:09:00.452062+0000","last_peered":"2024-09-10T10:09:00.452062+0000","last_clean":"2024-09-10T10:09:00.452062+0000","last_became_active":"2024-09-10T10:08:35.370263+0000","last_became_peered":"2024-09-10T10:08:35.370263+0000","last_unstale":"2024-09-10T10:09:00.452062+0000","last_undegraded":"2024-09-10T10:09:00.452062+0000","last_fullsized":"2024-09-10T10:09:00.452062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:41.549815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.453501+0000","last_change":"2024-09-10T10:08:44.405298+0000","last_active":"2024-09-10T10:09:00.453501+0000","last_peered":"2024-09-10T10:09:00.453501+0000","last_clean":"2024-09-10T10:09:00.453501+0000","last_became_active":"2024-09-10T10:08:44.405027+0000","last_became_peered":"2024-09-10T10:08:44.405027+0000","last_unstale":"2024-09-10T10:09:00.453501+0000","last_undegraded":"2024-09-10T10:09:00.453501+0000","last_fullsized":"2024-09-10T10:09:00.453501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:08.486563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484889+0000","last_change":"2024-09-10T10:08:35.369040+0000","last_active":"2024-09-10T10:09:00.484889+0000","last_peered":"2024-09-10T10:09:00.484889+0000","last_clean":"2024-09-10T10:09:00.484889+0000","last_became_active":"2024-09-10T10:08:35.368576+0000","last_became_peered":"2024-09-10T10:08:35.368576+0000","last_unstale":"2024-09-10T10:09:00.484889+0000","last_undegraded":"2024-09-10T10:09:00.484889+0000","last_fullsized":"2024-09-10T10:09:00.484889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:44.887554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.526967+0000","last_change":"2024-09-10T10:08:32.889549+0000","last_active":"2024-09-10T10:09:24.526967+0000","last_peered":"2024-09-10T10:09:24.526967+0000","last_clean":"2024-09-10T10:09:24.526967+0000","last_became_active":"2024-09-10T10:08:32.889197+0000","last_became_peered":"2024-09-10T10:08:32.889197+0000","last_unstale":"2024-09-10T10:09:24.526967+0000","last_undegraded":"2024-09-10T10:09:24.526967+0000","last_fullsized":"2024-09-10T10:09:24.526967+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:53.697069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.453598+0000","last_change":"2024-09-10T10:08:44.929048+0000","last_active":"2024-09-10T10:09:00.453598+0000","last_peered":"2024-09-10T10:09:00.453598+0000","last_clean":"2024-09-10T10:09:00.453598+0000","last_became_active":"2024-09-10T10:08:44.928345+0000","last_became_peered":"2024-09-10T10:08:44.928345+0000","last_unstale":"2024-09-10T10:09:00.453598+0000","last_undegraded":"2024-09-10T10:09:00.453598+0000","last_fullsized":"2024-09-10T10:09:00.453598+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:23.121853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.449883+0000","last_change":"2024-09-10T10:08:35.377385+0000","last_active":"2024-09-10T10:09:00.449883+0000","last_peered":"2024-09-10T10:09:00.449883+0000","last_clean":"2024-09-10T10:09:00.449883+0000","last_became_active":"2024-09-10T10:08:35.377092+0000","last_became_peered":"2024-09-10T10:08:35.377092+0000","last_unstale":"2024-09-10T10:09:00.449883+0000","last_undegraded":"2024-09-10T10:09:00.449883+0000","last_fullsized":"2024-09-10T10:09:00.449883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:23.169370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.483988+0000","last_change":"2024-09-10T10:08:32.891614+0000","last_active":"2024-09-10T10:09:00.483988+0000","last_peered":"2024-09-10T10:09:00.483988+0000","last_clean":"2024-09-10T10:09:00.483988+0000","last_became_active":"2024-09-10T10:08:32.891141+0000","last_became_peered":"2024-09-10T10:08:32.891141+0000","last_unstale":"2024-09-10T10:09:00.483988+0000","last_undegraded":"2024-09-10T10:09:00.483988+0000","last_fullsized":"2024-09-10T10:09:00.483988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:20.258863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454560+0000","last_change":"2024-09-10T10:08:44.401125+0000","last_active":"2024-09-10T10:09:00.454560+0000","last_peered":"2024-09-10T10:09:00.454560+0000","last_clean":"2024-09-10T10:09:00.454560+0000","last_became_active":"2024-09-10T10:08:44.400483+0000","last_became_peered":"2024-09-10T10:08:44.400483+0000","last_unstale":"2024-09-10T10:09:00.454560+0000","last_undegraded":"2024-09-10T10:09:00.454560+0000","last_fullsized":"2024-09-10T10:09:00.454560+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:12.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454464+0000","last_change":"2024-09-10T10:08:35.376806+0000","last_active":"2024-09-10T10:09:00.454464+0000","last_peered":"2024-09-10T10:09:00.454464+0000","last_clean":"2024-09-10T10:09:00.454464+0000","last_became_active":"2024-09-10T10:08:35.376400+0000","last_became_peered":"2024-09-10T10:08:35.376400+0000","last_unstale":"2024-09-10T10:09:00.454464+0000","last_undegraded":"2024-09-10T10:09:00.454464+0000","last_fullsized":"2024-09-10T10:09:00.454464+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:48.303039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.529903+0000","last_change":"2024-09-10T10:08:32.883881+0000","last_active":"2024-09-10T10:09:24.529903+0000","last_peered":"2024-09-10T10:09:24.529903+0000","last_clean":"2024-09-10T10:09:24.529903+0000","last_became_active":"2024-09-10T10:08:32.883540+0000","last_became_peered":"2024-09-10T10:08:32.883540+0000","last_unstale":"2024-09-10T10:09:24.529903+0000","last_undegraded":"2024-09-10T10:09:24.529903+0000","last_fullsized":"2024-09-10T10:09:24.529903+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:57.359729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485315+0000","last_change":"2024-09-10T10:08:44.401548+0000","last_active":"2024-09-10T10:09:00.485315+0000","last_peered":"2024-09-10T10:09:00.485315+0000","last_clean":"2024-09-10T10:09:00.485315+0000","last_became_active":"2024-09-10T10:08:44.401034+0000","last_became_peered":"2024-09-10T10:08:44.401034+0000","last_unstale":"2024-09-10T10:09:00.485315+0000","last_undegraded":"2024-09-10T10:09:00.485315+0000","last_fullsized":"2024-09-10T10:09:00.485315+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:17.292973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.451984+0000","last_change":"2024-09-10T10:08:35.359969+0000","last_active":"2024-09-10T10:09:00.451984+0000","last_peered":"2024-09-10T10:09:00.451984+0000","last_clean":"2024-09-10T10:09:00.451984+0000","last_became_active":"2024-09-10T10:08:35.359599+0000","last_became_peered":"2024-09-10T10:08:35.359599+0000","last_unstale":"2024-09-10T10:09:00.451984+0000","last_undegraded":"2024-09-10T10:09:00.451984+0000","last_fullsized":"2024-09-10T10:09:00.451984+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:00.778269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.527910+0000","last_change":"2024-09-10T10:09:00.487582+0000","last_active":"2024-09-10T10:09:24.527910+0000","last_peered":"2024-09-10T10:09:24.527910+0000","last_clean":"2024-09-10T10:09:24.527910+0000","last_became_active":"2024-09-10T10:09:00.487229+0000","last_became_peered":"2024-09-10T10:09:00.487229+0000","last_unstale":"2024-09-10T10:09:24.527910+0000","last_undegraded":"2024-09-10T10:09:24.527910+0000","last_fullsized":"2024-09-10T10:09:24.527910+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:53.341736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454047+0000","last_change":"2024-09-10T10:08:44.929224+0000","last_active":"2024-09-10T10:09:00.454047+0000","last_peered":"2024-09-10T10:09:00.454047+0000","last_clean":"2024-09-10T10:09:00.454047+0000","last_became_active":"2024-09-10T10:08:44.928640+0000","last_became_peered":"2024-09-10T10:08:44.928640+0000","last_unstale":"2024-09-10T10:09:00.454047+0000","last_undegraded":"2024-09-10T10:09:00.454047+0000","last_fullsized":"2024-09-10T10:09:00.454047+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:42.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485754+0000","last_change":"2024-09-10T10:08:35.376585+0000","last_active":"2024-09-10T10:09:00.485754+0000","last_peered":"2024-09-10T10:09:00.485754+0000","last_clean":"2024-09-10T10:09:00.485754+0000","last_became_active":"2024-09-10T10:08:35.375693+0000","last_became_peered":"2024-09-10T10:08:35.375693+0000","last_unstale":"2024-09-10T10:09:00.485754+0000","last_undegraded":"2024-09-10T10:09:00.485754+0000","last_fullsized":"2024-09-10T10:09:00.485754+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:59.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.527606+0000","last_change":"2024-09-10T10:08:32.884542+0000","last_active":"2024-09-10T10:09:24.527606+0000","last_peered":"2024-09-10T10:09:24.527606+0000","last_clean":"2024-09-10T10:09:24.527606+0000","last_became_active":"2024-09-10T10:08:32.884192+0000","last_became_peered":"2024-09-10T10:08:32.884192+0000","last_unstale":"2024-09-10T10:09:24.527606+0000","last_undegraded":"2024-09-10T10:09:24.527606+0000","last_fullsized":"2024-09-10T10:09:24.527606+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:57.756641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.483883+0000","last_change":"2024-09-10T10:08:44.391514+0000","last_active":"2024-09-10T10:09:00.483883+0000","last_peered":"2024-09-10T10:09:00.483883+0000","last_clean":"2024-09-10T10:09:00.483883+0000","last_became_active":"2024-09-10T10:08:44.391116+0000","last_became_peered":"2024-09-10T10:08:44.391116+0000","last_unstale":"2024-09-10T10:09:00.483883+0000","last_undegraded":"2024-09-10T10:09:00.483883+0000","last_fullsized":"2024-09-10T10:09:00.483883+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:41.586014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.450452+0000","last_change":"2024-09-10T10:08:35.365604+0000","last_active":"2024-09-10T10:09:00.450452+0000","last_peered":"2024-09-10T10:09:00.450452+0000","last_clean":"2024-09-10T10:09:00.450452+0000","last_became_active":"2024-09-10T10:08:35.364915+0000","last_became_peered":"2024-09-10T10:08:35.364915+0000","last_unstale":"2024-09-10T10:09:00.450452+0000","last_undegraded":"2024-09-10T10:09:00.450452+0000","last_fullsized":"2024-09-10T10:09:00.450452+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:12.885021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'10","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:41.371185+0000","last_change":"2024-09-10T10:08:32.888223+0000","last_active":"2024-09-10T10:09:41.371185+0000","last_peered":"2024-09-10T10:09:41.371185+0000","last_clean":"2024-09-10T10:09:41.371185+0000","last_became_active":"2024-09-10T10:08:32.887919+0000","last_became_peered":"2024-09-10T10:08:32.887919+0000","last_unstale":"2024-09-10T10:09:41.371185+0000","last_undegraded":"2024-09-10T10:09:41.371185+0000","last_fullsized":"2024-09-10T10:09:41.371185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:19.781337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.449573+0000","last_change":"2024-09-10T10:08:44.929322+0000","last_active":"2024-09-10T10:09:00.449573+0000","last_peered":"2024-09-10T10:09:00.449573+0000","last_clean":"2024-09-10T10:09:00.449573+0000","last_became_active":"2024-09-10T10:08:44.928252+0000","last_became_peered":"2024-09-10T10:08:44.928252+0000","last_unstale":"2024-09-10T10:09:00.449573+0000","last_undegraded":"2024-09-10T10:09:00.449573+0000","last_fullsized":"2024-09-10T10:09:00.449573+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:33.048265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456737+0000","last_change":"2024-09-10T10:08:35.364168+0000","last_active":"2024-09-10T10:09:00.456737+0000","last_peered":"2024-09-10T10:09:00.456737+0000","last_clean":"2024-09-10T10:09:00.456737+0000","last_became_active":"2024-09-10T10:08:35.363739+0000","last_became_peered":"2024-09-10T10:08:35.363739+0000","last_unstale":"2024-09-10T10:09:00.456737+0000","last_undegraded":"2024-09-10T10:09:00.456737+0000","last_fullsized":"2024-09-10T10:09:00.456737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:43.029409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.527374+0000","last_change":"2024-09-10T10:08:32.893021+0000","last_active":"2024-09-10T10:09:24.527374+0000","last_peered":"2024-09-10T10:09:24.527374+0000","last_clean":"2024-09-10T10:09:24.527374+0000","last_became_active":"2024-09-10T10:08:32.892667+0000","last_became_peered":"2024-09-10T10:08:32.892667+0000","last_unstale":"2024-09-10T10:09:24.527374+0000","last_undegraded":"2024-09-10T10:09:24.527374+0000","last_fullsized":"2024-09-10T10:09:24.527374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:52.427489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454857+0000","last_change":"2024-09-10T10:08:44.393831+0000","last_active":"2024-09-10T10:09:00.454857+0000","last_peered":"2024-09-10T10:09:00.454857+0000","last_clean":"2024-09-10T10:09:00.454857+0000","last_became_active":"2024-09-10T10:08:44.393415+0000","last_became_peered":"2024-09-10T10:08:44.393415+0000","last_unstale":"2024-09-10T10:09:00.454857+0000","last_undegraded":"2024-09-10T10:09:00.454857+0000","last_fullsized":"2024-09-10T10:09:00.454857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:52.171292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485475+0000","last_change":"2024-09-10T10:08:35.374787+0000","last_active":"2024-09-10T10:09:00.485475+0000","last_peered":"2024-09-10T10:09:00.485475+0000","last_clean":"2024-09-10T10:09:00.485475+0000","last_became_active":"2024-09-10T10:08:35.374549+0000","last_became_peered":"2024-09-10T10:08:35.374549+0000","last_unstale":"2024-09-10T10:09:00.485475+0000","last_undegraded":"2024-09-10T10:09:00.485475+0000","last_fullsized":"2024-09-10T10:09:00.485475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:58.925515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485060+0000","last_change":"2024-09-10T10:08:32.886267+0000","last_active":"2024-09-10T10:09:00.485060+0000","last_peered":"2024-09-10T10:09:00.485060+0000","last_clean":"2024-09-10T10:09:00.485060+0000","last_became_active":"2024-09-10T10:08:32.885869+0000","last_became_peered":"2024-09-10T10:08:32.885869+0000","last_unstale":"2024-09-10T10:09:00.485060+0000","last_undegraded":"2024-09-10T10:09:00.485060+0000","last_fullsized":"2024-09-10T10:09:00.485060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:06.784839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.486656+0000","last_change":"2024-09-10T10:09:00.486656+0000","last_active":"2024-09-10T10:09:00.486656+0000","last_peered":"2024-09-10T10:09:00.486656+0000","last_clean":"2024-09-10T10:09:00.486656+0000","last_became_active":"2024-09-10T10:09:00.486072+0000","last_became_peered":"2024-09-10T10:09:00.486072+0000","last_unstale":"2024-09-10T10:09:00.486656+0000","last_undegraded":"2024-09-10T10:09:00.486656+0000","last_fullsized":"2024-09-10T10:09:00.486656+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:26.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485219+0000","last_change":"2024-09-10T10:08:35.366130+0000","last_active":"2024-09-10T10:09:00.485219+0000","last_peered":"2024-09-10T10:09:00.485219+0000","last_clean":"2024-09-10T10:09:00.485219+0000","last_became_active":"2024-09-10T10:08:35.365785+0000","last_became_peered":"2024-09-10T10:08:35.365785+0000","last_unstale":"2024-09-10T10:09:00.485219+0000","last_undegraded":"2024-09-10T10:09:00.485219+0000","last_fullsized":"2024-09-10T10:09:00.485219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:35.771767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485112+0000","last_change":"2024-09-10T10:08:32.884113+0000","last_active":"2024-09-10T10:09:00.485112+0000","last_peered":"2024-09-10T10:09:00.485112+0000","last_clean":"2024-09-10T10:09:00.485112+0000","last_became_active":"2024-09-10T10:08:32.883503+0000","last_became_peered":"2024-09-10T10:08:32.883503+0000","last_unstale":"2024-09-10T10:09:00.485112+0000","last_undegraded":"2024-09-10T10:09:00.485112+0000","last_fullsized":"2024-09-10T10:09:00.485112+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:20.513465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456521+0000","last_change":"2024-09-10T10:08:44.400137+0000","last_active":"2024-09-10T10:09:00.456521+0000","last_peered":"2024-09-10T10:09:00.456521+0000","last_clean":"2024-09-10T10:09:00.456521+0000","last_became_active":"2024-09-10T10:08:44.398736+0000","last_became_peered":"2024-09-10T10:08:44.398736+0000","last_unstale":"2024-09-10T10:09:00.456521+0000","last_undegraded":"2024-09-10T10:09:00.456521+0000","last_fullsized":"2024-09-10T10:09:00.456521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:48.922732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.451600+0000","last_change":"2024-09-10T10:08:35.360818+0000","last_active":"2024-09-10T10:09:00.451600+0000","last_peered":"2024-09-10T10:09:00.451600+0000","last_clean":"2024-09-10T10:09:00.451600+0000","last_became_active":"2024-09-10T10:08:35.360504+0000","last_became_peered":"2024-09-10T10:08:35.360504+0000","last_unstale":"2024-09-10T10:09:00.451600+0000","last_undegraded":"2024-09-10T10:09:00.451600+0000","last_fullsized":"2024-09-10T10:09:00.451600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:45.396069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'4","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:41.567422+0000","last_change":"2024-09-10T10:08:32.883915+0000","last_active":"2024-09-10T10:09:41.567422+0000","last_peered":"2024-09-10T10:09:41.567422+0000","last_clean":"2024-09-10T10:09:41.567422+0000","last_became_active":"2024-09-10T10:08:32.883573+0000","last_became_peered":"2024-09-10T10:08:32.883573+0000","last_unstale":"2024-09-10T10:09:41.567422+0000","last_undegraded":"2024-09-10T10:09:41.567422+0000","last_fullsized":"2024-09-10T10:09:41.567422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:56.271267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456731+0000","last_change":"2024-09-10T10:08:44.928968+0000","last_active":"2024-09-10T10:09:00.456731+0000","last_peered":"2024-09-10T10:09:00.456731+0000","last_clean":"2024-09-10T10:09:00.456731+0000","last_became_active":"2024-09-10T10:08:44.928445+0000","last_became_peered":"2024-09-10T10:08:44.928445+0000","last_unstale":"2024-09-10T10:09:00.456731+0000","last_undegraded":"2024-09-10T10:09:00.456731+0000","last_fullsized":"2024-09-10T10:09:00.456731+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:01.799454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456011+0000","last_change":"2024-09-10T10:08:35.369027+0000","last_active":"2024-09-10T10:09:00.456011+0000","last_peered":"2024-09-10T10:09:00.456011+0000","last_clean":"2024-09-10T10:09:00.456011+0000","last_became_active":"2024-09-10T10:08:35.368692+0000","last_became_peered":"2024-09-10T10:08:35.368692+0000","last_unstale":"2024-09-10T10:09:00.456011+0000","last_undegraded":"2024-09-10T10:09:00.456011+0000","last_fullsized":"2024-09-10T10:09:00.456011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:09.500617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.540910+0000","last_change":"2024-09-10T10:08:32.888661+0000","last_active":"2024-09-10T10:09:25.540910+0000","last_peered":"2024-09-10T10:09:25.540910+0000","last_clean":"2024-09-10T10:09:25.540910+0000","last_became_active":"2024-09-10T10:08:32.888312+0000","last_became_peered":"2024-09-10T10:08:32.888312+0000","last_unstale":"2024-09-10T10:09:25.540910+0000","last_undegraded":"2024-09-10T10:09:25.540910+0000","last_fullsized":"2024-09-10T10:09:25.540910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:47.293560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.452230+0000","last_change":"2024-09-10T10:08:44.929512+0000","last_active":"2024-09-10T10:09:00.452230+0000","last_peered":"2024-09-10T10:09:00.452230+0000","last_clean":"2024-09-10T10:09:00.452230+0000","last_became_active":"2024-09-10T10:08:44.928992+0000","last_became_peered":"2024-09-10T10:08:44.928992+0000","last_unstale":"2024-09-10T10:09:00.452230+0000","last_undegraded":"2024-09-10T10:09:00.452230+0000","last_fullsized":"2024-09-10T10:09:00.452230+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:31.827967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.449990+0000","last_change":"2024-09-10T10:08:35.369098+0000","last_active":"2024-09-10T10:09:00.449990+0000","last_peered":"2024-09-10T10:09:00.449990+0000","last_clean":"2024-09-10T10:09:00.449990+0000","last_became_active":"2024-09-10T10:08:35.363112+0000","last_became_peered":"2024-09-10T10:08:35.363112+0000","last_unstale":"2024-09-10T10:09:00.449990+0000","last_undegraded":"2024-09-10T10:09:00.449990+0000","last_fullsized":"2024-09-10T10:09:00.449990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:07.810055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:26.542810+0000","last_change":"2024-09-10T10:08:32.885451+0000","last_active":"2024-09-10T10:09:26.542810+0000","last_peered":"2024-09-10T10:09:26.542810+0000","last_clean":"2024-09-10T10:09:26.542810+0000","last_became_active":"2024-09-10T10:08:32.885102+0000","last_became_peered":"2024-09-10T10:08:32.885102+0000","last_unstale":"2024-09-10T10:09:26.542810+0000","last_undegraded":"2024-09-10T10:09:26.542810+0000","last_fullsized":"2024-09-10T10:09:26.542810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:52.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":351,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485618+0000","last_change":"2024-09-10T10:07:13.661841+0000","last_active":"2024-09-10T10:09:00.485618+0000","last_peered":"2024-09-10T10:09:00.485618+0000","last_clean":"2024-09-10T10:09:00.485618+0000","last_became_active":"2024-09-10T10:07:13.661310+0000","last_became_peered":"2024-09-10T10:07:13.661310+0000","last_unstale":"2024-09-10T10:09:00.485618+0000","last_undegraded":"2024-09-10T10:09:00.485618+0000","last_fullsized":"2024-09-10T10:09:00.485618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_clean_scrub_stamp":"2024-09-10T10:03:29.327083+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:39.414636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485340+0000","last_change":"2024-09-10T10:08:44.391277+0000","last_active":"2024-09-10T10:09:00.485340+0000","last_peered":"2024-09-10T10:09:00.485340+0000","last_clean":"2024-09-10T10:09:00.485340+0000","last_became_active":"2024-09-10T10:08:44.390867+0000","last_became_peered":"2024-09-10T10:08:44.390867+0000","last_unstale":"2024-09-10T10:09:00.485340+0000","last_undegraded":"2024-09-10T10:09:00.485340+0000","last_fullsized":"2024-09-10T10:09:00.485340+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:23.299812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485399+0000","last_change":"2024-09-10T10:08:35.364750+0000","last_active":"2024-09-10T10:09:00.485399+0000","last_peered":"2024-09-10T10:09:00.485399+0000","last_clean":"2024-09-10T10:09:00.485399+0000","last_became_active":"2024-09-10T10:08:35.364034+0000","last_became_peered":"2024-09-10T10:08:35.364034+0000","last_unstale":"2024-09-10T10:09:00.485399+0000","last_undegraded":"2024-09-10T10:09:00.485399+0000","last_fullsized":"2024-09-10T10:09:00.485399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:15.296086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.543399+0000","last_change":"2024-09-10T10:08:32.886884+0000","last_active":"2024-09-10T10:09:25.543399+0000","last_peered":"2024-09-10T10:09:25.543399+0000","last_clean":"2024-09-10T10:09:25.543399+0000","last_became_active":"2024-09-10T10:08:32.886544+0000","last_became_peered":"2024-09-10T10:08:32.886544+0000","last_unstale":"2024-09-10T10:09:25.543399+0000","last_undegraded":"2024-09-10T10:09:25.543399+0000","last_fullsized":"2024-09-10T10:09:25.543399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:30.511881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.457626+0000","last_change":"2024-09-10T10:08:44.390761+0000","last_active":"2024-09-10T10:09:00.457626+0000","last_peered":"2024-09-10T10:09:00.457626+0000","last_clean":"2024-09-10T10:09:00.457626+0000","last_became_active":"2024-09-10T10:08:44.390190+0000","last_became_peered":"2024-09-10T10:08:44.390190+0000","last_unstale":"2024-09-10T10:09:00.457626+0000","last_undegraded":"2024-09-10T10:09:00.457626+0000","last_fullsized":"2024-09-10T10:09:00.457626+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:38.216171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485171+0000","last_change":"2024-09-10T10:08:35.362956+0000","last_active":"2024-09-10T10:09:00.485171+0000","last_peered":"2024-09-10T10:09:00.485171+0000","last_clean":"2024-09-10T10:09:00.485171+0000","last_became_active":"2024-09-10T10:08:35.362623+0000","last_became_peered":"2024-09-10T10:08:35.362623+0000","last_unstale":"2024-09-10T10:09:00.485171+0000","last_undegraded":"2024-09-10T10:09:00.485171+0000","last_fullsized":"2024-09-10T10:09:00.485171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:50.162838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.452390+0000","last_change":"2024-09-10T10:08:32.889741+0000","last_active":"2024-09-10T10:09:00.452390+0000","last_peered":"2024-09-10T10:09:00.452390+0000","last_clean":"2024-09-10T10:09:00.452390+0000","last_became_active":"2024-09-10T10:08:32.889394+0000","last_became_peered":"2024-09-10T10:08:32.889394+0000","last_unstale":"2024-09-10T10:09:00.452390+0000","last_undegraded":"2024-09-10T10:09:00.452390+0000","last_fullsized":"2024-09-10T10:09:00.452390+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:16.845738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484916+0000","last_change":"2024-09-10T10:08:44.403781+0000","last_active":"2024-09-10T10:09:00.484916+0000","last_peered":"2024-09-10T10:09:00.484916+0000","last_clean":"2024-09-10T10:09:00.484916+0000","last_became_active":"2024-09-10T10:08:44.399601+0000","last_became_peered":"2024-09-10T10:08:44.399601+0000","last_unstale":"2024-09-10T10:09:00.484916+0000","last_undegraded":"2024-09-10T10:09:00.484916+0000","last_fullsized":"2024-09-10T10:09:00.484916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:45.587247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485200+0000","last_change":"2024-09-10T10:08:35.367825+0000","last_active":"2024-09-10T10:09:00.485200+0000","last_peered":"2024-09-10T10:09:00.485200+0000","last_clean":"2024-09-10T10:09:00.485200+0000","last_became_active":"2024-09-10T10:08:35.367511+0000","last_became_peered":"2024-09-10T10:08:35.367511+0000","last_unstale":"2024-09-10T10:09:00.485200+0000","last_undegraded":"2024-09-10T10:09:00.485200+0000","last_fullsized":"2024-09-10T10:09:00.485200+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:03.356912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456577+0000","last_change":"2024-09-10T10:08:32.888524+0000","last_active":"2024-09-10T10:09:00.456577+0000","last_peered":"2024-09-10T10:09:00.456577+0000","last_clean":"2024-09-10T10:09:00.456577+0000","last_became_active":"2024-09-10T10:08:32.888148+0000","last_became_peered":"2024-09-10T10:08:32.888148+0000","last_unstale":"2024-09-10T10:09:00.456577+0000","last_undegraded":"2024-09-10T10:09:00.456577+0000","last_fullsized":"2024-09-10T10:09:00.456577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:34.342167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.450915+0000","last_change":"2024-09-10T10:08:44.392952+0000","last_active":"2024-09-10T10:09:00.450915+0000","last_peered":"2024-09-10T10:09:00.450915+0000","last_clean":"2024-09-10T10:09:00.450915+0000","last_became_active":"2024-09-10T10:08:44.392476+0000","last_became_peered":"2024-09-10T10:08:44.392476+0000","last_unstale":"2024-09-10T10:09:00.450915+0000","last_undegraded":"2024-09-10T10:09:00.450915+0000","last_fullsized":"2024-09-10T10:09:00.450915+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:26.530305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.455103+0000","last_change":"2024-09-10T10:08:35.364501+0000","last_active":"2024-09-10T10:09:00.455103+0000","last_peered":"2024-09-10T10:09:00.455103+0000","last_clean":"2024-09-10T10:09:00.455103+0000","last_became_active":"2024-09-10T10:08:35.364102+0000","last_became_peered":"2024-09-10T10:08:35.364102+0000","last_unstale":"2024-09-10T10:09:00.455103+0000","last_undegraded":"2024-09-10T10:09:00.455103+0000","last_fullsized":"2024-09-10T10:09:00.455103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:42.743140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:26.539580+0000","last_change":"2024-09-10T10:09:00.461639+0000","last_active":"2024-09-10T10:09:26.539580+0000","last_peered":"2024-09-10T10:09:26.539580+0000","last_clean":"2024-09-10T10:09:26.539580+0000","last_became_active":"2024-09-10T10:09:00.457246+0000","last_became_peered":"2024-09-10T10:09:00.457246+0000","last_unstale":"2024-09-10T10:09:26.539580+0000","last_undegraded":"2024-09-10T10:09:26.539580+0000","last_fullsized":"2024-09-10T10:09:26.539580+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:30.387035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.451074+0000","last_change":"2024-09-10T10:08:44.401728+0000","last_active":"2024-09-10T10:09:00.451074+0000","last_peered":"2024-09-10T10:09:00.451074+0000","last_clean":"2024-09-10T10:09:00.451074+0000","last_became_active":"2024-09-10T10:08:44.401334+0000","last_became_peered":"2024-09-10T10:08:44.401334+0000","last_unstale":"2024-09-10T10:09:00.451074+0000","last_undegraded":"2024-09-10T10:09:00.451074+0000","last_fullsized":"2024-09-10T10:09:00.451074+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:57.496196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.486353+0000","last_change":"2024-09-10T10:09:00.486353+0000","last_active":"2024-09-10T10:09:00.486353+0000","last_peered":"2024-09-10T10:09:00.486353+0000","last_clean":"2024-09-10T10:09:00.486353+0000","last_became_active":"2024-09-10T10:09:00.485938+0000","last_became_peered":"2024-09-10T10:09:00.485938+0000","last_unstale":"2024-09-10T10:09:00.486353+0000","last_undegraded":"2024-09-10T10:09:00.486353+0000","last_fullsized":"2024-09-10T10:09:00.486353+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:38.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.542717+0000","last_change":"2024-09-10T10:08:32.893278+0000","last_active":"2024-09-10T10:09:25.542717+0000","last_peered":"2024-09-10T10:09:25.542717+0000","last_clean":"2024-09-10T10:09:25.542717+0000","last_became_active":"2024-09-10T10:08:32.892848+0000","last_became_peered":"2024-09-10T10:08:32.892848+0000","last_unstale":"2024-09-10T10:09:25.542717+0000","last_undegraded":"2024-09-10T10:09:25.542717+0000","last_fullsized":"2024-09-10T10:09:25.542717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:09.336253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456576+0000","last_change":"2024-09-10T10:08:44.407213+0000","last_active":"2024-09-10T10:09:00.456576+0000","last_peered":"2024-09-10T10:09:00.456576+0000","last_clean":"2024-09-10T10:09:00.456576+0000","last_became_active":"2024-09-10T10:08:44.405198+0000","last_became_peered":"2024-09-10T10:08:44.405198+0000","last_unstale":"2024-09-10T10:09:00.456576+0000","last_undegraded":"2024-09-10T10:09:00.456576+0000","last_fullsized":"2024-09-10T10:09:00.456576+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:15.921684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485332+0000","last_change":"2024-09-10T10:08:35.362683+0000","last_active":"2024-09-10T10:09:00.485332+0000","last_peered":"2024-09-10T10:09:00.485332+0000","last_clean":"2024-09-10T10:09:00.485332+0000","last_became_active":"2024-09-10T10:08:35.362353+0000","last_became_peered":"2024-09-10T10:08:35.362353+0000","last_unstale":"2024-09-10T10:09:00.485332+0000","last_undegraded":"2024-09-10T10:09:00.485332+0000","last_fullsized":"2024-09-10T10:09:00.485332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.489716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'4","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:38.563568+0000","last_change":"2024-09-10T10:08:32.881024+0000","last_active":"2024-09-10T10:09:38.563568+0000","last_peered":"2024-09-10T10:09:38.563568+0000","last_clean":"2024-09-10T10:09:38.563568+0000","last_became_active":"2024-09-10T10:08:32.880691+0000","last_became_peered":"2024-09-10T10:08:32.880691+0000","last_unstale":"2024-09-10T10:09:38.563568+0000","last_undegraded":"2024-09-10T10:09:38.563568+0000","last_fullsized":"2024-09-10T10:09:38.563568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:15.988063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485410+0000","last_change":"2024-09-10T10:08:44.400509+0000","last_active":"2024-09-10T10:09:00.485410+0000","last_peered":"2024-09-10T10:09:00.485410+0000","last_clean":"2024-09-10T10:09:00.485410+0000","last_became_active":"2024-09-10T10:08:44.400152+0000","last_became_peered":"2024-09-10T10:08:44.400152+0000","last_unstale":"2024-09-10T10:09:00.485410+0000","last_undegraded":"2024-09-10T10:09:00.485410+0000","last_fullsized":"2024-09-10T10:09:00.485410+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:43.550208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484895+0000","last_change":"2024-09-10T10:08:35.364208+0000","last_active":"2024-09-10T10:09:00.484895+0000","last_peered":"2024-09-10T10:09:00.484895+0000","last_clean":"2024-09-10T10:09:00.484895+0000","last_became_active":"2024-09-10T10:08:35.363751+0000","last_became_peered":"2024-09-10T10:08:35.363751+0000","last_unstale":"2024-09-10T10:09:00.484895+0000","last_undegraded":"2024-09-10T10:09:00.484895+0000","last_fullsized":"2024-09-10T10:09:00.484895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:21.791512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.529941+0000","last_change":"2024-09-10T10:08:32.890611+0000","last_active":"2024-09-10T10:09:24.529941+0000","last_peered":"2024-09-10T10:09:24.529941+0000","last_clean":"2024-09-10T10:09:24.529941+0000","last_became_active":"2024-09-10T10:08:32.890296+0000","last_became_peered":"2024-09-10T10:08:32.890296+0000","last_unstale":"2024-09-10T10:09:24.529941+0000","last_undegraded":"2024-09-10T10:09:24.529941+0000","last_fullsized":"2024-09-10T10:09:24.529941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.977575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454631+0000","last_change":"2024-09-10T10:08:44.402607+0000","last_active":"2024-09-10T10:09:00.454631+0000","last_peered":"2024-09-10T10:09:00.454631+0000","last_clean":"2024-09-10T10:09:00.454631+0000","last_became_active":"2024-09-10T10:08:44.401623+0000","last_became_peered":"2024-09-10T10:08:44.401623+0000","last_unstale":"2024-09-10T10:09:00.454631+0000","last_undegraded":"2024-09-10T10:09:00.454631+0000","last_fullsized":"2024-09-10T10:09:00.454631+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:21.105349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456149+0000","last_change":"2024-09-10T10:08:35.360642+0000","last_active":"2024-09-10T10:09:00.456149+0000","last_peered":"2024-09-10T10:09:00.456149+0000","last_clean":"2024-09-10T10:09:00.456149+0000","last_became_active":"2024-09-10T10:08:35.356667+0000","last_became_peered":"2024-09-10T10:08:35.356667+0000","last_unstale":"2024-09-10T10:09:00.456149+0000","last_undegraded":"2024-09-10T10:09:00.456149+0000","last_fullsized":"2024-09-10T10:09:00.456149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:08.404973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.543845+0000","last_change":"2024-09-10T10:08:32.890418+0000","last_active":"2024-09-10T10:09:25.543845+0000","last_peered":"2024-09-10T10:09:25.543845+0000","last_clean":"2024-09-10T10:09:25.543845+0000","last_became_active":"2024-09-10T10:08:32.890081+0000","last_became_peered":"2024-09-10T10:08:32.890081+0000","last_unstale":"2024-09-10T10:09:25.543845+0000","last_undegraded":"2024-09-10T10:09:25.543845+0000","last_fullsized":"2024-09-10T10:09:25.543845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:52.839714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.451961+0000","last_change":"2024-09-10T10:08:44.401322+0000","last_active":"2024-09-10T10:09:00.451961+0000","last_peered":"2024-09-10T10:09:00.451961+0000","last_clean":"2024-09-10T10:09:00.451961+0000","last_became_active":"2024-09-10T10:08:44.400906+0000","last_became_peered":"2024-09-10T10:08:44.400906+0000","last_unstale":"2024-09-10T10:09:00.451961+0000","last_undegraded":"2024-09-10T10:09:00.451961+0000","last_fullsized":"2024-09-10T10:09:00.451961+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:08.616288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.453035+0000","last_change":"2024-09-10T10:08:35.366580+0000","last_active":"2024-09-10T10:09:00.453035+0000","last_peered":"2024-09-10T10:09:00.453035+0000","last_clean":"2024-09-10T10:09:00.453035+0000","last_became_active":"2024-09-10T10:08:35.365943+0000","last_became_peered":"2024-09-10T10:08:35.365943+0000","last_unstale":"2024-09-10T10:09:00.453035+0000","last_undegraded":"2024-09-10T10:09:00.453035+0000","last_fullsized":"2024-09-10T10:09:00.453035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:58.351517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'29","reported_seq":101,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:40.568697+0000","last_change":"2024-09-10T10:08:32.888411+0000","last_active":"2024-09-10T10:09:40.568697+0000","last_peered":"2024-09-10T10:09:40.568697+0000","last_clean":"2024-09-10T10:09:40.568697+0000","last_became_active":"2024-09-10T10:08:32.888093+0000","last_became_peered":"2024-09-10T10:08:32.888093+0000","last_unstale":"2024-09-10T10:09:40.568697+0000","last_undegraded":"2024-09-10T10:09:40.568697+0000","last_fullsized":"2024-09-10T10:09:40.568697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.532868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52408,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":69,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484671+0000","last_change":"2024-09-10T10:08:44.400432+0000","last_active":"2024-09-10T10:09:00.484671+0000","last_peered":"2024-09-10T10:09:00.484671+0000","last_clean":"2024-09-10T10:09:00.484671+0000","last_became_active":"2024-09-10T10:08:44.399981+0000","last_became_peered":"2024-09-10T10:08:44.399981+0000","last_unstale":"2024-09-10T10:09:00.484671+0000","last_undegraded":"2024-09-10T10:09:00.484671+0000","last_fullsized":"2024-09-10T10:09:00.484671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:57.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.460848+0000","last_change":"2024-09-10T10:09:00.460848+0000","last_active":"2024-09-10T10:09:00.460848+0000","last_peered":"2024-09-10T10:09:00.460848+0000","last_clean":"2024-09-10T10:09:00.460848+0000","last_became_active":"2024-09-10T10:09:00.460459+0000","last_became_peered":"2024-09-10T10:09:00.460459+0000","last_unstale":"2024-09-10T10:09:00.460848+0000","last_undegraded":"2024-09-10T10:09:00.460848+0000","last_fullsized":"2024-09-10T10:09:00.460848+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:06.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.529554+0000","last_change":"2024-09-10T10:08:32.885909+0000","last_active":"2024-09-10T10:09:24.529554+0000","last_peered":"2024-09-10T10:09:24.529554+0000","last_clean":"2024-09-10T10:09:24.529554+0000","last_became_active":"2024-09-10T10:08:32.885512+0000","last_became_peered":"2024-09-10T10:08:32.885512+0000","last_unstale":"2024-09-10T10:09:24.529554+0000","last_undegraded":"2024-09-10T10:09:24.529554+0000","last_fullsized":"2024-09-10T10:09:24.529554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:44.850772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454689+0000","last_change":"2024-09-10T10:08:44.400323+0000","last_active":"2024-09-10T10:09:00.454689+0000","last_peered":"2024-09-10T10:09:00.454689+0000","last_clean":"2024-09-10T10:09:00.454689+0000","last_became_active":"2024-09-10T10:08:44.399923+0000","last_became_peered":"2024-09-10T10:08:44.399923+0000","last_unstale":"2024-09-10T10:09:00.454689+0000","last_undegraded":"2024-09-10T10:09:00.454689+0000","last_fullsized":"2024-09-10T10:09:00.454689+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:45.496392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485181+0000","last_change":"2024-09-10T10:08:35.375543+0000","last_active":"2024-09-10T10:09:00.485181+0000","last_peered":"2024-09-10T10:09:00.485181+0000","last_clean":"2024-09-10T10:09:00.485181+0000","last_became_active":"2024-09-10T10:08:35.374312+0000","last_became_peered":"2024-09-10T10:08:35.374312+0000","last_unstale":"2024-09-10T10:09:00.485181+0000","last_undegraded":"2024-09-10T10:09:00.485181+0000","last_fullsized":"2024-09-10T10:09:00.485181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:34.208716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:24.526805+0000","last_change":"2024-09-10T10:08:32.888540+0000","last_active":"2024-09-10T10:09:24.526805+0000","last_peered":"2024-09-10T10:09:24.526805+0000","last_clean":"2024-09-10T10:09:24.526805+0000","last_became_active":"2024-09-10T10:08:32.888187+0000","last_became_peered":"2024-09-10T10:08:32.888187+0000","last_unstale":"2024-09-10T10:09:24.526805+0000","last_undegraded":"2024-09-10T10:09:24.526805+0000","last_fullsized":"2024-09-10T10:09:24.526805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:06.694533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484043+0000","last_change":"2024-09-10T10:08:44.397995+0000","last_active":"2024-09-10T10:09:00.484043+0000","last_peered":"2024-09-10T10:09:00.484043+0000","last_clean":"2024-09-10T10:09:00.484043+0000","last_became_active":"2024-09-10T10:08:44.397583+0000","last_became_peered":"2024-09-10T10:08:44.397583+0000","last_unstale":"2024-09-10T10:09:00.484043+0000","last_undegraded":"2024-09-10T10:09:00.484043+0000","last_fullsized":"2024-09-10T10:09:00.484043+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:03.908014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.458298+0000","last_change":"2024-09-10T10:08:35.361053+0000","last_active":"2024-09-10T10:09:00.458298+0000","last_peered":"2024-09-10T10:09:00.458298+0000","last_clean":"2024-09-10T10:09:00.458298+0000","last_became_active":"2024-09-10T10:08:35.360736+0000","last_became_peered":"2024-09-10T10:08:35.360736+0000","last_unstale":"2024-09-10T10:09:00.458298+0000","last_undegraded":"2024-09-10T10:09:00.458298+0000","last_fullsized":"2024-09-10T10:09:00.458298+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:45.435384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'3","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:39.563381+0000","last_change":"2024-09-10T10:08:32.885067+0000","last_active":"2024-09-10T10:09:39.563381+0000","last_peered":"2024-09-10T10:09:39.563381+0000","last_clean":"2024-09-10T10:09:39.563381+0000","last_became_active":"2024-09-10T10:08:32.884676+0000","last_became_peered":"2024-09-10T10:08:32.884676+0000","last_unstale":"2024-09-10T10:09:39.563381+0000","last_undegraded":"2024-09-10T10:09:39.563381+0000","last_fullsized":"2024-09-10T10:09:39.563381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.667680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.450212+0000","last_change":"2024-09-10T10:08:44.395892+0000","last_active":"2024-09-10T10:09:00.450212+0000","last_peered":"2024-09-10T10:09:00.450212+0000","last_clean":"2024-09-10T10:09:00.450212+0000","last_became_active":"2024-09-10T10:08:44.395188+0000","last_became_peered":"2024-09-10T10:08:44.395188+0000","last_unstale":"2024-09-10T10:09:00.450212+0000","last_undegraded":"2024-09-10T10:09:00.450212+0000","last_fullsized":"2024-09-10T10:09:00.450212+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:27.562053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485601+0000","last_change":"2024-09-10T10:08:44.403185+0000","last_active":"2024-09-10T10:09:00.485601+0000","last_peered":"2024-09-10T10:09:00.485601+0000","last_clean":"2024-09-10T10:09:00.485601+0000","last_became_active":"2024-09-10T10:08:44.399943+0000","last_became_peered":"2024-09-10T10:08:44.399943+0000","last_unstale":"2024-09-10T10:09:00.485601+0000","last_undegraded":"2024-09-10T10:09:00.485601+0000","last_fullsized":"2024-09-10T10:09:00.485601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:07.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484396+0000","last_change":"2024-09-10T10:08:35.367552+0000","last_active":"2024-09-10T10:09:00.484396+0000","last_peered":"2024-09-10T10:09:00.484396+0000","last_clean":"2024-09-10T10:09:00.484396+0000","last_became_active":"2024-09-10T10:08:35.367215+0000","last_became_peered":"2024-09-10T10:08:35.367215+0000","last_unstale":"2024-09-10T10:09:00.484396+0000","last_undegraded":"2024-09-10T10:09:00.484396+0000","last_fullsized":"2024-09-10T10:09:00.484396+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:28.756769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.451426+0000","last_change":"2024-09-10T10:08:32.885830+0000","last_active":"2024-09-10T10:09:00.451426+0000","last_peered":"2024-09-10T10:09:00.451426+0000","last_clean":"2024-09-10T10:09:00.451426+0000","last_became_active":"2024-09-10T10:08:32.885465+0000","last_became_peered":"2024-09-10T10:08:32.885465+0000","last_unstale":"2024-09-10T10:09:00.451426+0000","last_undegraded":"2024-09-10T10:09:00.451426+0000","last_fullsized":"2024-09-10T10:09:00.451426+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:55.101364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.487666+0000","last_change":"2024-09-10T10:09:00.487666+0000","last_active":"2024-09-10T10:09:00.487666+0000","last_peered":"2024-09-10T10:09:00.487666+0000","last_clean":"2024-09-10T10:09:00.487666+0000","last_became_active":"2024-09-10T10:09:00.487110+0000","last_became_peered":"2024-09-10T10:09:00.487110+0000","last_unstale":"2024-09-10T10:09:00.487666+0000","last_undegraded":"2024-09-10T10:09:00.487666+0000","last_fullsized":"2024-09-10T10:09:00.487666+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:28.817826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.449882+0000","last_change":"2024-09-10T10:08:35.356247+0000","last_active":"2024-09-10T10:09:00.449882+0000","last_peered":"2024-09-10T10:09:00.449882+0000","last_clean":"2024-09-10T10:09:00.449882+0000","last_became_active":"2024-09-10T10:08:35.355953+0000","last_became_peered":"2024-09-10T10:08:35.355953+0000","last_unstale":"2024-09-10T10:09:00.449882+0000","last_undegraded":"2024-09-10T10:09:00.449882+0000","last_fullsized":"2024-09-10T10:09:00.449882+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:24.625382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.544892+0000","last_change":"2024-09-10T10:08:32.882151+0000","last_active":"2024-09-10T10:09:25.544892+0000","last_peered":"2024-09-10T10:09:25.544892+0000","last_clean":"2024-09-10T10:09:25.544892+0000","last_became_active":"2024-09-10T10:08:32.881688+0000","last_became_peered":"2024-09-10T10:08:32.881688+0000","last_unstale":"2024-09-10T10:09:25.544892+0000","last_undegraded":"2024-09-10T10:09:25.544892+0000","last_fullsized":"2024-09-10T10:09:25.544892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:49.186299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:25.543826+0000","last_change":"2024-09-10T10:08:32.887018+0000","last_active":"2024-09-10T10:09:25.543826+0000","last_peered":"2024-09-10T10:09:25.543826+0000","last_clean":"2024-09-10T10:09:25.543826+0000","last_became_active":"2024-09-10T10:08:32.886636+0000","last_became_peered":"2024-09-10T10:08:32.886636+0000","last_unstale":"2024-09-10T10:09:25.543826+0000","last_undegraded":"2024-09-10T10:09:25.543826+0000","last_fullsized":"2024-09-10T10:09:25.543826+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:24.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.451581+0000","last_change":"2024-09-10T10:08:35.363803+0000","last_active":"2024-09-10T10:09:00.451581+0000","last_peered":"2024-09-10T10:09:00.451581+0000","last_clean":"2024-09-10T10:09:00.451581+0000","last_became_active":"2024-09-10T10:08:35.363442+0000","last_became_peered":"2024-09-10T10:08:35.363442+0000","last_unstale":"2024-09-10T10:09:00.451581+0000","last_undegraded":"2024-09-10T10:09:00.451581+0000","last_fullsized":"2024-09-10T10:09:00.451581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:59.045347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.483895+0000","last_change":"2024-09-10T10:08:44.403970+0000","last_active":"2024-09-10T10:09:00.483895+0000","last_peered":"2024-09-10T10:09:00.483895+0000","last_clean":"2024-09-10T10:09:00.483895+0000","last_became_active":"2024-09-10T10:08:44.403462+0000","last_became_peered":"2024-09-10T10:08:44.403462+0000","last_unstale":"2024-09-10T10:09:00.483895+0000","last_undegraded":"2024-09-10T10:09:00.483895+0000","last_fullsized":"2024-09-10T10:09:00.483895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:09.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:40.565642+0000","last_change":"2024-09-10T10:08:32.893227+0000","last_active":"2024-09-10T10:09:40.565642+0000","last_peered":"2024-09-10T10:09:40.565642+0000","last_clean":"2024-09-10T10:09:40.565642+0000","last_became_active":"2024-09-10T10:08:32.892732+0000","last_became_peered":"2024-09-10T10:08:32.892732+0000","last_unstale":"2024-09-10T10:09:40.565642+0000","last_undegraded":"2024-09-10T10:09:40.565642+0000","last_fullsized":"2024-09-10T10:09:40.565642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:16.933955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.452567+0000","last_change":"2024-09-10T10:08:35.368806+0000","last_active":"2024-09-10T10:09:00.452567+0000","last_peered":"2024-09-10T10:09:00.452567+0000","last_clean":"2024-09-10T10:09:00.452567+0000","last_became_active":"2024-09-10T10:08:35.368397+0000","last_became_peered":"2024-09-10T10:08:35.368397+0000","last_unstale":"2024-09-10T10:09:00.452567+0000","last_undegraded":"2024-09-10T10:09:00.452567+0000","last_fullsized":"2024-09-10T10:09:00.452567+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:39.656295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484087+0000","last_change":"2024-09-10T10:08:44.391941+0000","last_active":"2024-09-10T10:09:00.484087+0000","last_peered":"2024-09-10T10:09:00.484087+0000","last_clean":"2024-09-10T10:09:00.484087+0000","last_became_active":"2024-09-10T10:08:44.391553+0000","last_became_peered":"2024-09-10T10:08:44.391553+0000","last_unstale":"2024-09-10T10:09:00.484087+0000","last_undegraded":"2024-09-10T10:09:00.484087+0000","last_fullsized":"2024-09-10T10:09:00.484087+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:34.279772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454411+0000","last_change":"2024-09-10T10:08:35.363192+0000","last_active":"2024-09-10T10:09:00.454411+0000","last_peered":"2024-09-10T10:09:00.454411+0000","last_clean":"2024-09-10T10:09:00.454411+0000","last_became_active":"2024-09-10T10:08:35.362890+0000","last_became_peered":"2024-09-10T10:08:35.362890+0000","last_unstale":"2024-09-10T10:09:00.454411+0000","last_undegraded":"2024-09-10T10:09:00.454411+0000","last_fullsized":"2024-09-10T10:09:00.454411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:07.493539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484080+0000","last_change":"2024-09-10T10:08:35.362471+0000","last_active":"2024-09-10T10:09:00.484080+0000","last_peered":"2024-09-10T10:09:00.484080+0000","last_clean":"2024-09-10T10:09:00.484080+0000","last_became_active":"2024-09-10T10:08:35.361553+0000","last_became_peered":"2024-09-10T10:08:35.361553+0000","last_unstale":"2024-09-10T10:09:00.484080+0000","last_undegraded":"2024-09-10T10:09:00.484080+0000","last_fullsized":"2024-09-10T10:09:00.484080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:24.511901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.483769+0000","last_change":"2024-09-10T10:08:35.371025+0000","last_active":"2024-09-10T10:09:00.483769+0000","last_peered":"2024-09-10T10:09:00.483769+0000","last_clean":"2024-09-10T10:09:00.483769+0000","last_became_active":"2024-09-10T10:08:35.370692+0000","last_became_peered":"2024-09-10T10:08:35.370692+0000","last_unstale":"2024-09-10T10:09:00.483769+0000","last_undegraded":"2024-09-10T10:09:00.483769+0000","last_fullsized":"2024-09-10T10:09:00.483769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:22.289843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485029+0000","last_change":"2024-09-10T10:08:35.373519+0000","last_active":"2024-09-10T10:09:00.485029+0000","last_peered":"2024-09-10T10:09:00.485029+0000","last_clean":"2024-09-10T10:09:00.485029+0000","last_became_active":"2024-09-10T10:08:35.372719+0000","last_became_peered":"2024-09-10T10:08:35.372719+0000","last_unstale":"2024-09-10T10:09:00.485029+0000","last_undegraded":"2024-09-10T10:09:00.485029+0000","last_fullsized":"2024-09-10T10:09:00.485029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:24.530809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.489944+0000","last_change":"2024-09-10T10:09:00.489944+0000","last_active":"2024-09-10T10:09:00.489944+0000","last_peered":"2024-09-10T10:09:00.489944+0000","last_clean":"2024-09-10T10:09:00.489944+0000","last_became_active":"2024-09-10T10:09:00.489269+0000","last_became_peered":"2024-09-10T10:09:00.489269+0000","last_unstale":"2024-09-10T10:09:00.489944+0000","last_undegraded":"2024-09-10T10:09:00.489944+0000","last_fullsized":"2024-09-10T10:09:00.489944+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:46.561078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454964+0000","last_change":"2024-09-10T10:08:35.364779+0000","last_active":"2024-09-10T10:09:00.454964+0000","last_peered":"2024-09-10T10:09:00.454964+0000","last_clean":"2024-09-10T10:09:00.454964+0000","last_became_active":"2024-09-10T10:08:35.364455+0000","last_became_peered":"2024-09-10T10:08:35.364455+0000","last_unstale":"2024-09-10T10:09:00.454964+0000","last_undegraded":"2024-09-10T10:09:00.454964+0000","last_fullsized":"2024-09-10T10:09:00.454964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:08.552218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484237+0000","last_change":"2024-09-10T10:08:35.357147+0000","last_active":"2024-09-10T10:09:00.484237+0000","last_peered":"2024-09-10T10:09:00.484237+0000","last_clean":"2024-09-10T10:09:00.484237+0000","last_became_active":"2024-09-10T10:08:35.356808+0000","last_became_peered":"2024-09-10T10:08:35.356808+0000","last_unstale":"2024-09-10T10:09:00.484237+0000","last_undegraded":"2024-09-10T10:09:00.484237+0000","last_fullsized":"2024-09-10T10:09:00.484237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:35.731496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.450453+0000","last_change":"2024-09-10T10:08:35.365795+0000","last_active":"2024-09-10T10:09:00.450453+0000","last_peered":"2024-09-10T10:09:00.450453+0000","last_clean":"2024-09-10T10:09:00.450453+0000","last_became_active":"2024-09-10T10:08:35.365342+0000","last_became_peered":"2024-09-10T10:08:35.365342+0000","last_unstale":"2024-09-10T10:09:00.450453+0000","last_undegraded":"2024-09-10T10:09:00.450453+0000","last_fullsized":"2024-09-10T10:09:00.450453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:20.012890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.487412+0000","last_change":"2024-09-10T10:09:00.486664+0000","last_active":"2024-09-10T10:09:00.487412+0000","last_peered":"2024-09-10T10:09:00.487412+0000","last_clean":"2024-09-10T10:09:00.487412+0000","last_became_active":"2024-09-10T10:09:00.486239+0000","last_became_peered":"2024-09-10T10:09:00.486239+0000","last_unstale":"2024-09-10T10:09:00.487412+0000","last_undegraded":"2024-09-10T10:09:00.487412+0000","last_fullsized":"2024-09-10T10:09:00.487412+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:47.472245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.449776+0000","last_change":"2024-09-10T10:08:35.367403+0000","last_active":"2024-09-10T10:09:00.449776+0000","last_peered":"2024-09-10T10:09:00.449776+0000","last_clean":"2024-09-10T10:09:00.449776+0000","last_became_active":"2024-09-10T10:08:35.365969+0000","last_became_peered":"2024-09-10T10:08:35.365969+0000","last_unstale":"2024-09-10T10:09:00.449776+0000","last_undegraded":"2024-09-10T10:09:00.449776+0000","last_fullsized":"2024-09-10T10:09:00.449776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:27.657226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.457879+0000","last_change":"2024-09-10T10:08:35.359185+0000","last_active":"2024-09-10T10:09:00.457879+0000","last_peered":"2024-09-10T10:09:00.457879+0000","last_clean":"2024-09-10T10:09:00.457879+0000","last_became_active":"2024-09-10T10:08:35.358825+0000","last_became_peered":"2024-09-10T10:08:35.358825+0000","last_unstale":"2024-09-10T10:09:00.457879+0000","last_undegraded":"2024-09-10T10:09:00.457879+0000","last_fullsized":"2024-09-10T10:09:00.457879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:31.884533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456527+0000","last_change":"2024-09-10T10:08:35.378151+0000","last_active":"2024-09-10T10:09:00.456527+0000","last_peered":"2024-09-10T10:09:00.456527+0000","last_clean":"2024-09-10T10:09:00.456527+0000","last_became_active":"2024-09-10T10:08:35.377784+0000","last_became_peered":"2024-09-10T10:08:35.377784+0000","last_unstale":"2024-09-10T10:09:00.456527+0000","last_undegraded":"2024-09-10T10:09:00.456527+0000","last_fullsized":"2024-09-10T10:09:00.456527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.027310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454760+0000","last_change":"2024-09-10T10:08:35.364550+0000","last_active":"2024-09-10T10:09:00.454760+0000","last_peered":"2024-09-10T10:09:00.454760+0000","last_clean":"2024-09-10T10:09:00.454760+0000","last_became_active":"2024-09-10T10:08:35.364224+0000","last_became_peered":"2024-09-10T10:08:35.364224+0000","last_unstale":"2024-09-10T10:09:00.454760+0000","last_undegraded":"2024-09-10T10:09:00.454760+0000","last_fullsized":"2024-09-10T10:09:00.454760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:38.584494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484240+0000","last_change":"2024-09-10T10:08:35.357333+0000","last_active":"2024-09-10T10:09:00.484240+0000","last_peered":"2024-09-10T10:09:00.484240+0000","last_clean":"2024-09-10T10:09:00.484240+0000","last_became_active":"2024-09-10T10:08:35.356940+0000","last_became_peered":"2024-09-10T10:08:35.356940+0000","last_unstale":"2024-09-10T10:09:00.484240+0000","last_undegraded":"2024-09-10T10:09:00.484240+0000","last_fullsized":"2024-09-10T10:09:00.484240+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:40.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485082+0000","last_change":"2024-09-10T10:08:35.367208+0000","last_active":"2024-09-10T10:09:00.485082+0000","last_peered":"2024-09-10T10:09:00.485082+0000","last_clean":"2024-09-10T10:09:00.485082+0000","last_became_active":"2024-09-10T10:08:35.361942+0000","last_became_peered":"2024-09-10T10:08:35.361942+0000","last_unstale":"2024-09-10T10:09:00.485082+0000","last_undegraded":"2024-09-10T10:09:00.485082+0000","last_fullsized":"2024-09-10T10:09:00.485082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:19.030623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.455341+0000","last_change":"2024-09-10T10:08:35.377164+0000","last_active":"2024-09-10T10:09:00.455341+0000","last_peered":"2024-09-10T10:09:00.455341+0000","last_clean":"2024-09-10T10:09:00.455341+0000","last_became_active":"2024-09-10T10:08:35.376457+0000","last_became_peered":"2024-09-10T10:08:35.376457+0000","last_unstale":"2024-09-10T10:09:00.455341+0000","last_undegraded":"2024-09-10T10:09:00.455341+0000","last_fullsized":"2024-09-10T10:09:00.455341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.291635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.457518+0000","last_change":"2024-09-10T10:08:35.365096+0000","last_active":"2024-09-10T10:09:00.457518+0000","last_peered":"2024-09-10T10:09:00.457518+0000","last_clean":"2024-09-10T10:09:00.457518+0000","last_became_active":"2024-09-10T10:08:35.364780+0000","last_became_peered":"2024-09-10T10:08:35.364780+0000","last_unstale":"2024-09-10T10:09:00.457518+0000","last_undegraded":"2024-09-10T10:09:00.457518+0000","last_fullsized":"2024-09-10T10:09:00.457518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:30.177904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485416+0000","last_change":"2024-09-10T10:08:35.377017+0000","last_active":"2024-09-10T10:09:00.485416+0000","last_peered":"2024-09-10T10:09:00.485416+0000","last_clean":"2024-09-10T10:09:00.485416+0000","last_became_active":"2024-09-10T10:08:35.372243+0000","last_became_peered":"2024-09-10T10:08:35.372243+0000","last_unstale":"2024-09-10T10:09:00.485416+0000","last_undegraded":"2024-09-10T10:09:00.485416+0000","last_fullsized":"2024-09-10T10:09:00.485416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:26.105505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484060+0000","last_change":"2024-09-10T10:08:35.379782+0000","last_active":"2024-09-10T10:09:00.484060+0000","last_peered":"2024-09-10T10:09:00.484060+0000","last_clean":"2024-09-10T10:09:00.484060+0000","last_became_active":"2024-09-10T10:08:35.377109+0000","last_became_peered":"2024-09-10T10:08:35.377109+0000","last_unstale":"2024-09-10T10:09:00.484060+0000","last_undegraded":"2024-09-10T10:09:00.484060+0000","last_fullsized":"2024-09-10T10:09:00.484060+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:10.761016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.456429+0000","last_change":"2024-09-10T10:08:35.364891+0000","last_active":"2024-09-10T10:09:00.456429+0000","last_peered":"2024-09-10T10:09:00.456429+0000","last_clean":"2024-09-10T10:09:00.456429+0000","last_became_active":"2024-09-10T10:08:35.363845+0000","last_became_peered":"2024-09-10T10:08:35.363845+0000","last_unstale":"2024-09-10T10:09:00.456429+0000","last_undegraded":"2024-09-10T10:09:00.456429+0000","last_fullsized":"2024-09-10T10:09:00.456429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:03.346994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454735+0000","last_change":"2024-09-10T10:08:35.363548+0000","last_active":"2024-09-10T10:09:00.454735+0000","last_peered":"2024-09-10T10:09:00.454735+0000","last_clean":"2024-09-10T10:09:00.454735+0000","last_became_active":"2024-09-10T10:08:35.363229+0000","last_became_peered":"2024-09-10T10:08:35.363229+0000","last_unstale":"2024-09-10T10:09:00.454735+0000","last_undegraded":"2024-09-10T10:09:00.454735+0000","last_fullsized":"2024-09-10T10:09:00.454735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:38.773445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485346+0000","last_change":"2024-09-10T10:08:35.360717+0000","last_active":"2024-09-10T10:09:00.485346+0000","last_peered":"2024-09-10T10:09:00.485346+0000","last_clean":"2024-09-10T10:09:00.485346+0000","last_became_active":"2024-09-10T10:08:35.360410+0000","last_became_peered":"2024-09-10T10:08:35.360410+0000","last_unstale":"2024-09-10T10:09:00.485346+0000","last_undegraded":"2024-09-10T10:09:00.485346+0000","last_fullsized":"2024-09-10T10:09:00.485346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:59.322524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485908+0000","last_change":"2024-09-10T10:08:35.362359+0000","last_active":"2024-09-10T10:09:00.485908+0000","last_peered":"2024-09-10T10:09:00.485908+0000","last_clean":"2024-09-10T10:09:00.485908+0000","last_became_active":"2024-09-10T10:08:35.361580+0000","last_became_peered":"2024-09-10T10:08:35.361580+0000","last_unstale":"2024-09-10T10:09:00.485908+0000","last_undegraded":"2024-09-10T10:09:00.485908+0000","last_fullsized":"2024-09-10T10:09:00.485908+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:23.265237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.458544+0000","last_change":"2024-09-10T10:08:35.367305+0000","last_active":"2024-09-10T10:09:00.458544+0000","last_peered":"2024-09-10T10:09:00.458544+0000","last_clean":"2024-09-10T10:09:00.458544+0000","last_became_active":"2024-09-10T10:08:35.366936+0000","last_became_peered":"2024-09-10T10:08:35.366936+0000","last_unstale":"2024-09-10T10:09:00.458544+0000","last_undegraded":"2024-09-10T10:09:00.458544+0000","last_fullsized":"2024-09-10T10:09:00.458544+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:28.158474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.449779+0000","last_change":"2024-09-10T10:08:35.369983+0000","last_active":"2024-09-10T10:09:00.449779+0000","last_peered":"2024-09-10T10:09:00.449779+0000","last_clean":"2024-09-10T10:09:00.449779+0000","last_became_active":"2024-09-10T10:08:35.367662+0000","last_became_peered":"2024-09-10T10:08:35.367662+0000","last_unstale":"2024-09-10T10:09:00.449779+0000","last_undegraded":"2024-09-10T10:09:00.449779+0000","last_fullsized":"2024-09-10T10:09:00.449779+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484786+0000","last_change":"2024-09-10T10:08:35.369237+0000","last_active":"2024-09-10T10:09:00.484786+0000","last_peered":"2024-09-10T10:09:00.484786+0000","last_clean":"2024-09-10T10:09:00.484786+0000","last_became_active":"2024-09-10T10:08:35.368903+0000","last_became_peered":"2024-09-10T10:08:35.368903+0000","last_unstale":"2024-09-10T10:09:00.484786+0000","last_undegraded":"2024-09-10T10:09:00.484786+0000","last_fullsized":"2024-09-10T10:09:00.484786+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:05.150549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.484941+0000","last_change":"2024-09-10T10:08:35.367284+0000","last_active":"2024-09-10T10:09:00.484941+0000","last_peered":"2024-09-10T10:09:00.484941+0000","last_clean":"2024-09-10T10:09:00.484941+0000","last_became_active":"2024-09-10T10:08:35.366969+0000","last_became_peered":"2024-09-10T10:08:35.366969+0000","last_unstale":"2024-09-10T10:09:00.484941+0000","last_undegraded":"2024-09-10T10:09:00.484941+0000","last_fullsized":"2024-09-10T10:09:00.484941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:16.949804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.452034+0000","last_change":"2024-09-10T10:08:35.374559+0000","last_active":"2024-09-10T10:09:00.452034+0000","last_peered":"2024-09-10T10:09:00.452034+0000","last_clean":"2024-09-10T10:09:00.452034+0000","last_became_active":"2024-09-10T10:08:35.374191+0000","last_became_peered":"2024-09-10T10:08:35.374191+0000","last_unstale":"2024-09-10T10:09:00.452034+0000","last_undegraded":"2024-09-10T10:09:00.452034+0000","last_fullsized":"2024-09-10T10:09:00.452034+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:48.292249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.454670+0000","last_change":"2024-09-10T10:08:35.368042+0000","last_active":"2024-09-10T10:09:00.454670+0000","last_peered":"2024-09-10T10:09:00.454670+0000","last_clean":"2024-09-10T10:09:00.454670+0000","last_became_active":"2024-09-10T10:08:35.365985+0000","last_became_peered":"2024-09-10T10:08:35.365985+0000","last_unstale":"2024-09-10T10:09:00.454670+0000","last_undegraded":"2024-09-10T10:09:00.454670+0000","last_fullsized":"2024-09-10T10:09:00.454670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:04.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485879+0000","last_change":"2024-09-10T10:08:35.375826+0000","last_active":"2024-09-10T10:09:00.485879+0000","last_peered":"2024-09-10T10:09:00.485879+0000","last_clean":"2024-09-10T10:09:00.485879+0000","last_became_active":"2024-09-10T10:08:35.375485+0000","last_became_peered":"2024-09-10T10:08:35.375485+0000","last_unstale":"2024-09-10T10:09:00.485879+0000","last_undegraded":"2024-09-10T10:09:00.485879+0000","last_fullsized":"2024-09-10T10:09:00.485879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:49.146648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.485697+0000","last_change":"2024-09-10T10:08:35.375745+0000","last_active":"2024-09-10T10:09:00.485697+0000","last_peered":"2024-09-10T10:09:00.485697+0000","last_clean":"2024-09-10T10:09:00.485697+0000","last_became_active":"2024-09-10T10:08:35.375427+0000","last_became_peered":"2024-09-10T10:08:35.375427+0000","last_unstale":"2024-09-10T10:09:00.485697+0000","last_undegraded":"2024-09-10T10:09:00.485697+0000","last_fullsized":"2024-09-10T10:09:00.485697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:48.743434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T10:09:00.455230+0000","last_change":"2024-09-10T10:08:35.377092+0000","last_active":"2024-09-10T10:09:00.455230+0000","last_peered":"2024-09-10T10:09:00.455230+0000","last_clean":"2024-09-10T10:09:00.455230+0000","last_became_active":"2024-09-10T10:08:35.376761+0000","last_became_peered":"2024-09-10T10:08:35.376761+0000","last_unstale":"2024-09-10T10:09:00.455230+0000","last_undegraded":"2024-09-10T10:09:00.455230+0000","last_fullsized":"2024-09-10T10:09:00.455230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:58.631742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56804,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":118,"num_read_kb":121,"num_write":163,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":170412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286200,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449115,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":519524,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678049,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32308,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712844,"statfs":{"total":95995035648,"available":95961952256,"internally_reserved":0,"allocated":1150976,"data_stored":1159571,"data_compressed":62856,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841574,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":523834,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070507,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":519636,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299440,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":1115962,"data_compressed":62856,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462967,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":514914,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724605,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1089536,"data_stored":1111157,"data_compressed":62856,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888128,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":519957,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149766,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":515108,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":568975,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":567232,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":516302,"data_compressed":26463,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":52408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":54151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:09:47.065 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T10:09:47.065 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T10:09:47.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T10:09:47.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:46 smithi189 ceph-mon[34999]: pgmap v346: 129 pgs: 129 active+clean; 632 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-10T10:09:47.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:46 smithi084 ceph-mon[34812]: pgmap v346: 129 pgs: 129 active+clean; 632 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-10T10:09:47.448 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:47.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:47 smithi050 ceph-mon[30354]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:09:48.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.064+0000 7f90bec00640 1 -- 172.21.15.50:0/1637162584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90b8105810 msgr2=0x7f90b810c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:48.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.064+0000 7f90bec00640 1 --2- 172.21.15.50:0/1637162584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90b8105810 0x7f90b810c0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009ca0 tx=0x7f90b002a8b0 comp rx=0 tx=0).stop 2024-09-10T10:09:48.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.064+0000 7f90bec00640 1 -- 172.21.15.50:0/1637162584 shutdown_connections 2024-09-10T10:09:48.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.064+0000 7f90bec00640 1 --2- 172.21.15.50:0/1637162584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90b8105810 0x7f90b810c0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:48.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.064+0000 7f90bec00640 1 --2- 172.21.15.50:0/1637162584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b8104e50 0x7f90b81052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:48.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.064+0000 7f90bec00640 1 --2- 172.21.15.50:0/1637162584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90b8103c50 0x7f90b8104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:48.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.064+0000 7f90bec00640 1 -- 172.21.15.50:0/1637162584 >> 172.21.15.50:0/1637162584 conn(0x7f90b80ff3e0 msgr2=0x7f90b8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:48.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.065+0000 7f90bec00640 1 -- 172.21.15.50:0/1637162584 shutdown_connections 2024-09-10T10:09:48.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.065+0000 7f90bec00640 1 -- 172.21.15.50:0/1637162584 wait complete. 2024-09-10T10:09:48.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.065+0000 7f90bec00640 1 Processor -- start 2024-09-10T10:09:48.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.066+0000 7f90bec00640 1 -- start start 2024-09-10T10:09:48.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.066+0000 7f90bec00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b8103c50 0x7f90b8199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:48.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.066+0000 7f90bec00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90b8104e50 0x7f90b819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:48.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.066+0000 7f90bec00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90b8105810 0x7f90b81a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:48.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.066+0000 7f90bec00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f90b810f900 con 0x7f90b8103c50 2024-09-10T10:09:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.066+0000 7f90bec00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f90b810f780 con 0x7f90b8105810 2024-09-10T10:09:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.066+0000 7f90bec00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f90b810fa80 con 0x7f90b8104e50 2024-09-10T10:09:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.066+0000 7f90bd800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b8103c50 0x7f90b8199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.066+0000 7f90bd800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b8103c50 0x7f90b8199de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52028/0 (socket says 172.21.15.50:52028) 2024-09-10T10:09:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.066+0000 7f90bd800640 1 -- 172.21.15.50:0/982075639 learned_addr learned my addr 172.21.15.50:0/982075639 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.066+0000 7f90be200640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90b8105810 0x7f90b81a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.066+0000 7f90bce00640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90b8104e50 0x7f90b819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.067+0000 7f90bd800640 1 -- 172.21.15.50:0/982075639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90b8104e50 msgr2=0x7f90b819a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.067+0000 7f90bd800640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90b8104e50 0x7f90b819a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.067+0000 7f90bd800640 1 -- 172.21.15.50:0/982075639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90b8105810 msgr2=0x7f90b81a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.067+0000 7f90bd800640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90b8105810 0x7f90b81a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:48.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.067+0000 7f90bd800640 1 -- 172.21.15.50:0/982075639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b81a1a10 con 0x7f90b8103c50 2024-09-10T10:09:48.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.067+0000 7f90bd800640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b8103c50 0x7f90b8199de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00c970 tx=0x7f90ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:48.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.067+0000 7f90b6000640 1 -- 172.21.15.50:0/982075639 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac007c10 con 0x7f90b8103c50 2024-09-10T10:09:48.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.067+0000 7f90bec00640 1 -- 172.21.15.50:0/982075639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b81a1d00 con 0x7f90b8103c50 2024-09-10T10:09:48.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.068+0000 7f90b6000640 1 -- 172.21.15.50:0/982075639 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90ac007db0 con 0x7f90b8103c50 2024-09-10T10:09:48.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.068+0000 7f90b6000640 1 -- 172.21.15.50:0/982075639 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00f8a0 con 0x7f90b8103c50 2024-09-10T10:09:48.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.068+0000 7f90bec00640 1 -- 172.21.15.50:0/982075639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b81a21d0 con 0x7f90b8103c50 2024-09-10T10:09:48.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.069+0000 7f90bec00640 1 -- 172.21.15.50:0/982075639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b810aeb0 con 0x7f90b8103c50 2024-09-10T10:09:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.071+0000 7f90b6000640 1 -- 172.21.15.50:0/982075639 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f90ac00fa40 con 0x7f90b8103c50 2024-09-10T10:09:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.072+0000 7f90b6000640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f90a00a2c40 0x7f90a00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.072+0000 7f90b6000640 1 -- 172.21.15.50:0/982075639 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f90ac0cf810 con 0x7f90b8103c50 2024-09-10T10:09:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.072+0000 7f90bce00640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f90a00a2c40 0x7f90a00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:48.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.073+0000 7f90bce00640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f90a00a2c40 0x7f90a00a5100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f90a40095f0 tx=0x7f90a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:48.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.076+0000 7f90b6000640 1 -- 172.21.15.50:0/982075639 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90ac09c2e0 con 0x7f90b8103c50 2024-09-10T10:09:48.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:47 smithi189 ceph-mon[34999]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:09:48.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:47 smithi084 ceph-mon[34812]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:09:48.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.333+0000 7f90bec00640 1 -- 172.21.15.50:0/982075639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f90b802d7c0 con 0x7f90b8103c50 2024-09-10T10:09:48.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.335+0000 7f90b6000640 1 -- 172.21.15.50:0/982075639 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f90b802d7c0 con 0x7f90b8103c50 2024-09-10T10:09:48.337 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-10T10:09:48.337 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQDsGuBmDG3vExAA08L6t0i3sj+smM1Vdt6O2Q== 2024-09-10T10:09:48.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.338+0000 7f90bec00640 1 -- 172.21.15.50:0/982075639 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f90a00a2c40 msgr2=0x7f90a00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:48.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.338+0000 7f90bec00640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f90a00a2c40 0x7f90a00a5100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f90a40095f0 tx=0x7f90a4005f90 comp rx=0 tx=0).stop 2024-09-10T10:09:48.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.338+0000 7f90bec00640 1 -- 172.21.15.50:0/982075639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b8103c50 msgr2=0x7f90b8199de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:48.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.338+0000 7f90bec00640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b8103c50 0x7f90b8199de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00c970 tx=0x7f90ac00ce30 comp rx=0 tx=0).stop 2024-09-10T10:09:48.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.338+0000 7f90bec00640 1 -- 172.21.15.50:0/982075639 shutdown_connections 2024-09-10T10:09:48.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.338+0000 7f90bec00640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f90a00a2c40 0x7f90a00a5100 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:48.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.338+0000 7f90bec00640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90b8105810 0x7f90b81a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:48.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.338+0000 7f90bec00640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f90b8104e50 0x7f90b819a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:48.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.338+0000 7f90bec00640 1 --2- 172.21.15.50:0/982075639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90b8103c50 0x7f90b8199de0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:48.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.338+0000 7f90bec00640 1 -- 172.21.15.50:0/982075639 >> 172.21.15.50:0/982075639 conn(0x7f90b80ff3e0 msgr2=0x7f90b8108080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:48.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.338+0000 7f90bec00640 1 -- 172.21.15.50:0/982075639 shutdown_connections 2024-09-10T10:09:48.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:48.338+0000 7f90bec00640 1 -- 172.21.15.50:0/982075639 wait complete. 2024-09-10T10:09:48.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:48 smithi050 ceph-mon[30354]: pgmap v347: 129 pgs: 129 active+clean; 636 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-10T10:09:48.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:48 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/982075639' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T10:09:48.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:48 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/982075639' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T10:09:49.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:48 smithi189 ceph-mon[34999]: pgmap v347: 129 pgs: 129 active+clean; 636 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-10T10:09:49.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:48 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/982075639' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T10:09:49.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:48 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/982075639' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T10:09:49.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:48 smithi084 ceph-mon[34812]: pgmap v347: 129 pgs: 129 active+clean; 636 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-10T10:09:49.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:48 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/982075639' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T10:09:49.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:48 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/982075639' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T10:09:49.171 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:09:49.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T10:09:49.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T10:09:49.252 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T10:09:49.252 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T10:09:49.252 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T10:09:49.668 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.225+0000 7fd7a0800640 1 -- 172.21.15.50:0/2268402990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7981049c0 msgr2=0x7fd798108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.225+0000 7fd7a0800640 1 --2- 172.21.15.50:0/2268402990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7981049c0 0x7fd798108a10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd788009900 tx=0x7fd78802a410 comp rx=0 tx=0).stop 2024-09-10T10:09:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.225+0000 7fd7a0800640 1 -- 172.21.15.50:0/2268402990 shutdown_connections 2024-09-10T10:09:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.225+0000 7fd7a0800640 1 --2- 172.21.15.50:0/2268402990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd798109140 0x7fd798110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.225+0000 7fd7a0800640 1 --2- 172.21.15.50:0/2268402990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7981049c0 0x7fd798108a10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.225+0000 7fd7a0800640 1 --2- 172.21.15.50:0/2268402990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd798104010 0x7fd7981043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.225+0000 7fd7a0800640 1 -- 172.21.15.50:0/2268402990 >> 172.21.15.50:0/2268402990 conn(0x7fd7980ffa50 msgr2=0x7fd798101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.225+0000 7fd7a0800640 1 -- 172.21.15.50:0/2268402990 shutdown_connections 2024-09-10T10:09:50.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.225+0000 7fd7a0800640 1 -- 172.21.15.50:0/2268402990 wait complete. 2024-09-10T10:09:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.226+0000 7fd7a0800640 1 Processor -- start 2024-09-10T10:09:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.226+0000 7fd7a0800640 1 -- start start 2024-09-10T10:09:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.227+0000 7fd7a0800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd798104010 0x7fd79819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.227+0000 7fd7a0800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7981049c0 0x7fd79819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.227+0000 7fd7a0800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd798109140 0x7fd79819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.227+0000 7fd7a0800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd798114160 con 0x7fd798104010 2024-09-10T10:09:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.227+0000 7fd7a0800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd798113fe0 con 0x7fd798109140 2024-09-10T10:09:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.227+0000 7fd7a0800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd7981142e0 con 0x7fd7981049c0 2024-09-10T10:09:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.227+0000 7fd79de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd798104010 0x7fd79819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.227+0000 7fd79de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd798104010 0x7fd79819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52032/0 (socket says 172.21.15.50:52032) 2024-09-10T10:09:50.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.227+0000 7fd79de00640 1 -- 172.21.15.50:0/3850538912 learned_addr learned my addr 172.21.15.50:0/3850538912 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:50.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.227+0000 7fd79d400640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7981049c0 0x7fd79819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:50.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.227+0000 7fd79e800640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd798109140 0x7fd79819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:50.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.228+0000 7fd79de00640 1 -- 172.21.15.50:0/3850538912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7981049c0 msgr2=0x7fd79819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:50.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.228+0000 7fd79de00640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7981049c0 0x7fd79819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:50.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.228+0000 7fd79de00640 1 -- 172.21.15.50:0/3850538912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd798109140 msgr2=0x7fd79819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:50.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.228+0000 7fd79de00640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd798109140 0x7fd79819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:50.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.228+0000 7fd79de00640 1 -- 172.21.15.50:0/3850538912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79819f610 con 0x7fd798104010 2024-09-10T10:09:50.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.228+0000 7fd79de00640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd798104010 0x7fd79819a660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00d950 tx=0x7fd78c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:50.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.228+0000 7fd792a00640 1 -- 172.21.15.50:0/3850538912 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c017030 con 0x7fd798104010 2024-09-10T10:09:50.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.228+0000 7fd792a00640 1 -- 172.21.15.50:0/3850538912 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd78c004020 con 0x7fd798104010 2024-09-10T10:09:50.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.228+0000 7fd792a00640 1 -- 172.21.15.50:0/3850538912 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0047a0 con 0x7fd798104010 2024-09-10T10:09:50.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.228+0000 7fd7a0800640 1 -- 172.21.15.50:0/3850538912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79819f900 con 0x7fd798104010 2024-09-10T10:09:50.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.229+0000 7fd7a0800640 1 -- 172.21.15.50:0/3850538912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7981a71e0 con 0x7fd798104010 2024-09-10T10:09:50.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.230+0000 7fd7a0800640 1 -- 172.21.15.50:0/3850538912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7981043f0 con 0x7fd798104010 2024-09-10T10:09:50.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.232+0000 7fd792a00640 1 -- 172.21.15.50:0/3850538912 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd78c0041d0 con 0x7fd798104010 2024-09-10T10:09:50.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.233+0000 7fd792a00640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7800a2c10 0x7fd7800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:50.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.233+0000 7fd792a00640 1 -- 172.21.15.50:0/3850538912 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fd78c0ceed0 con 0x7fd798104010 2024-09-10T10:09:50.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.233+0000 7fd79d400640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7800a2c10 0x7fd7800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:50.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.234+0000 7fd79d400640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7800a2c10 0x7fd7800a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd788009230 tx=0x7fd7880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:50.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.237+0000 7fd792a00640 1 -- 172.21.15.50:0/3850538912 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd78c09b910 con 0x7fd798104010 2024-09-10T10:09:50.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.475+0000 7fd7a0800640 1 -- 172.21.15.50:0/3850538912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd79819b9c0 con 0x7fd798104010 2024-09-10T10:09:50.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.481+0000 7fd792a00640 1 -- 172.21.15.50:0/3850538912 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263199 (secure 0 0 0) 0x7fd78c09b210 con 0x7fd798104010 2024-09-10T10:09:50.486 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.485+0000 7fd7a0800640 1 -- 172.21.15.50:0/3850538912 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7800a2c10 msgr2=0x7fd7800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.485+0000 7fd7a0800640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7800a2c10 0x7fd7800a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd788009230 tx=0x7fd7880058d0 comp rx=0 tx=0).stop 2024-09-10T10:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.485+0000 7fd7a0800640 1 -- 172.21.15.50:0/3850538912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd798104010 msgr2=0x7fd79819a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.485+0000 7fd7a0800640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd798104010 0x7fd79819a660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00d950 tx=0x7fd78c00de10 comp rx=0 tx=0).stop 2024-09-10T10:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.485+0000 7fd7a0800640 1 -- 172.21.15.50:0/3850538912 shutdown_connections 2024-09-10T10:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.485+0000 7fd7a0800640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7800a2c10 0x7fd7800a50d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.485+0000 7fd7a0800640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd798109140 0x7fd79819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.485+0000 7fd7a0800640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd7981049c0 0x7fd79819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.485+0000 7fd7a0800640 1 --2- 172.21.15.50:0/3850538912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd798104010 0x7fd79819a660 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.485+0000 7fd7a0800640 1 -- 172.21.15.50:0/3850538912 >> 172.21.15.50:0/3850538912 conn(0x7fd7980ffa50 msgr2=0x7fd798100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.485+0000 7fd7a0800640 1 -- 172.21.15.50:0/3850538912 shutdown_connections 2024-09-10T10:09:50.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:50.485+0000 7fd7a0800640 1 -- 172.21.15.50:0/3850538912 wait complete. 2024-09-10T10:09:50.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:50 smithi050 ceph-mon[30354]: pgmap v348: 129 pgs: 129 active+clean; 636 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T10:09:50.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:50 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3850538912' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T10:09:51.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:50 smithi189 ceph-mon[34999]: pgmap v348: 129 pgs: 129 active+clean; 636 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T10:09:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:50 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3850538912' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T10:09:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:50 smithi084 ceph-mon[34812]: pgmap v348: 129 pgs: 129 active+clean; 636 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T10:09:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:50 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3850538912' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T10:09:51.342 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2546156966},{"type":"v1","addr":"172.21.15.50:6801","nonce":2546156966}]},"active_addr":"172.21.15.50:6801/2546156966","active_change":"2024-09-10T10:00:58.655399+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.50:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":4162959260}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":4041739567}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":938495945}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":910497902}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2868436426}]}]} 2024-09-10T10:09:51.349 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T10:09:51.349 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T10:09:51.349 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:09:51.729 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:52.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.347+0000 7f944be00640 1 -- 172.21.15.50:0/634285532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f944c0745c0 msgr2=0x7f944c0749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:52.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.347+0000 7f944be00640 1 --2- 172.21.15.50:0/634285532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f944c0745c0 0x7f944c0749a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f943c009900 tx=0x7f943c02a480 comp rx=0 tx=0).stop 2024-09-10T10:09:52.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.347+0000 7f944be00640 1 -- 172.21.15.50:0/634285532 shutdown_connections 2024-09-10T10:09:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.347+0000 7f944be00640 1 --2- 172.21.15.50:0/634285532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c10e260 0x7f944c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.347+0000 7f944be00640 1 --2- 172.21.15.50:0/634285532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f944c074ee0 0x7f944c10dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.347+0000 7f944be00640 1 --2- 172.21.15.50:0/634285532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f944c0745c0 0x7f944c0749a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.347+0000 7f944be00640 1 -- 172.21.15.50:0/634285532 >> 172.21.15.50:0/634285532 conn(0x7f944c0fd740 msgr2=0x7f944c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.347+0000 7f944be00640 1 -- 172.21.15.50:0/634285532 shutdown_connections 2024-09-10T10:09:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.348+0000 7f944be00640 1 -- 172.21.15.50:0/634285532 wait complete. 2024-09-10T10:09:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.349+0000 7f944be00640 1 Processor -- start 2024-09-10T10:09:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.349+0000 7f944be00640 1 -- start start 2024-09-10T10:09:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.349+0000 7f944be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f944c0745c0 0x7f944c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.349+0000 7f944be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c074ee0 0x7f944c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.349+0000 7f944be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f944c10e260 0x7f944c19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.349+0000 7f944be00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f944c114000 con 0x7f944c074ee0 2024-09-10T10:09:52.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.349+0000 7f944be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f944c113e80 con 0x7f944c0745c0 2024-09-10T10:09:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.349+0000 7f944be00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f944c114180 con 0x7f944c10e260 2024-09-10T10:09:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.350+0000 7f944a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c074ee0 0x7f944c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.350+0000 7f944aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f944c0745c0 0x7f944c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.350+0000 7f944aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f944c0745c0 0x7f944c19a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:41990/0 (socket says 172.21.15.50:41990) 2024-09-10T10:09:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.350+0000 7f944aa00640 1 -- 172.21.15.50:0/2559872552 learned_addr learned my addr 172.21.15.50:0/2559872552 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.350+0000 7f944a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c074ee0 0x7f944c19aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52050/0 (socket says 172.21.15.50:52050) 2024-09-10T10:09:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.350+0000 7f944b400640 1 --2- 172.21.15.50:0/2559872552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f944c10e260 0x7f944c19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.350+0000 7f944a000640 1 -- 172.21.15.50:0/2559872552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f944c10e260 msgr2=0x7f944c19ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.350+0000 7f944a000640 1 --2- 172.21.15.50:0/2559872552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f944c10e260 0x7f944c19ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.350+0000 7f944a000640 1 -- 172.21.15.50:0/2559872552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f944c0745c0 msgr2=0x7f944c19a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.350+0000 7f944a000640 1 --2- 172.21.15.50:0/2559872552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f944c0745c0 0x7f944c19a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.350+0000 7f944a000640 1 -- 172.21.15.50:0/2559872552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c19f530 con 0x7f944c074ee0 2024-09-10T10:09:52.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.350+0000 7f944a000640 1 --2- 172.21.15.50:0/2559872552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c074ee0 0x7f944c19aac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9438005fd0 tx=0x7f943800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.351+0000 7f9443400640 1 -- 172.21.15.50:0/2559872552 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438009c30 con 0x7f944c074ee0 2024-09-10T10:09:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.351+0000 7f944be00640 1 -- 172.21.15.50:0/2559872552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f944c19f820 con 0x7f944c074ee0 2024-09-10T10:09:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.351+0000 7f9443400640 1 -- 172.21.15.50:0/2559872552 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9438009dd0 con 0x7f944c074ee0 2024-09-10T10:09:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.351+0000 7f9443400640 1 -- 172.21.15.50:0/2559872552 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438010460 con 0x7f944c074ee0 2024-09-10T10:09:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.351+0000 7f944be00640 1 -- 172.21.15.50:0/2559872552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944c1a7100 con 0x7f944c074ee0 2024-09-10T10:09:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.352+0000 7f944be00640 1 -- 172.21.15.50:0/2559872552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f944c0749a0 con 0x7f944c074ee0 2024-09-10T10:09:52.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.354+0000 7f9443400640 1 -- 172.21.15.50:0/2559872552 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9438003f50 con 0x7f944c074ee0 2024-09-10T10:09:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.356+0000 7f9443400640 1 --2- 172.21.15.50:0/2559872552 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f94300a2c10 0x7f94300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.356+0000 7f9443400640 1 -- 172.21.15.50:0/2559872552 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f94380cf0d0 con 0x7f944c074ee0 2024-09-10T10:09:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.356+0000 7f944aa00640 1 --2- 172.21.15.50:0/2559872552 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f94300a2c10 0x7f94300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:52.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.357+0000 7f944aa00640 1 --2- 172.21.15.50:0/2559872552 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f94300a2c10 0x7f94300a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f943c0096c0 tx=0x7f943c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:52.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.360+0000 7f9443400640 1 -- 172.21.15.50:0/2559872552 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9438017020 con 0x7f944c074ee0 2024-09-10T10:09:52.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.550+0000 7f944be00640 1 -- 172.21.15.50:0/2559872552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f944c109410 con 0x7f944c074ee0 2024-09-10T10:09:52.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.552+0000 7f9443400640 1 -- 172.21.15.50:0/2559872552 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24682 (secure 0 0 0) 0x7f943809bb70 con 0x7f944c074ee0 2024-09-10T10:09:52.553 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:09:52.554 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:09:00.446421+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:09:52.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.554+0000 7f944be00640 1 -- 172.21.15.50:0/2559872552 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f94300a2c10 msgr2=0x7f94300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:52.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.554+0000 7f944be00640 1 --2- 172.21.15.50:0/2559872552 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f94300a2c10 0x7f94300a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f943c0096c0 tx=0x7f943c0046c0 comp rx=0 tx=0).stop 2024-09-10T10:09:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.554+0000 7f944be00640 1 -- 172.21.15.50:0/2559872552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c074ee0 msgr2=0x7f944c19aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.554+0000 7f944be00640 1 --2- 172.21.15.50:0/2559872552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c074ee0 0x7f944c19aac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9438005fd0 tx=0x7f943800dde0 comp rx=0 tx=0).stop 2024-09-10T10:09:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.555+0000 7f944be00640 1 -- 172.21.15.50:0/2559872552 shutdown_connections 2024-09-10T10:09:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.555+0000 7f944be00640 1 --2- 172.21.15.50:0/2559872552 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f94300a2c10 0x7f94300a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.555+0000 7f944be00640 1 --2- 172.21.15.50:0/2559872552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f944c10e260 0x7f944c19ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.555+0000 7f944be00640 1 --2- 172.21.15.50:0/2559872552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f944c074ee0 0x7f944c19aac0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.555+0000 7f944be00640 1 --2- 172.21.15.50:0/2559872552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f944c0745c0 0x7f944c19a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:52.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.555+0000 7f944be00640 1 -- 172.21.15.50:0/2559872552 >> 172.21.15.50:0/2559872552 conn(0x7f944c0fd740 msgr2=0x7f944c0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:52.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.555+0000 7f944be00640 1 -- 172.21.15.50:0/2559872552 shutdown_connections 2024-09-10T10:09:52.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:52.555+0000 7f944be00640 1 -- 172.21.15.50:0/2559872552 wait complete. 2024-09-10T10:09:52.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:52 smithi050 ceph-mon[30354]: pgmap v349: 129 pgs: 129 active+clean; 636 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T10:09:52.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:52 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2559872552' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:53.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:52 smithi189 ceph-mon[34999]: pgmap v349: 129 pgs: 129 active+clean; 636 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T10:09:53.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:52 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2559872552' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:52 smithi084 ceph-mon[34812]: pgmap v349: 129 pgs: 129 active+clean; 636 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T10:09:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:52 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2559872552' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:53.552 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T10:09:53.553 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:09:53.931 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:54.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.536+0000 7f1dd0600640 1 -- 172.21.15.50:0/1371906400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc8104010 msgr2=0x7f1dc81043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.536+0000 7f1dd0600640 1 --2- 172.21.15.50:0/1371906400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc8104010 0x7f1dc81043f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009900 tx=0x7f1dbc02a410 comp rx=0 tx=0).stop 2024-09-10T10:09:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.536+0000 7f1dd0600640 1 -- 172.21.15.50:0/1371906400 shutdown_connections 2024-09-10T10:09:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.536+0000 7f1dd0600640 1 --2- 172.21.15.50:0/1371906400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8109140 0x7f1dc8110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.536+0000 7f1dd0600640 1 --2- 172.21.15.50:0/1371906400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dc81049c0 0x7f1dc8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.536+0000 7f1dd0600640 1 --2- 172.21.15.50:0/1371906400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc8104010 0x7f1dc81043f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.536+0000 7f1dd0600640 1 -- 172.21.15.50:0/1371906400 >> 172.21.15.50:0/1371906400 conn(0x7f1dc80ffa50 msgr2=0x7f1dc8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.536+0000 7f1dd0600640 1 -- 172.21.15.50:0/1371906400 shutdown_connections 2024-09-10T10:09:54.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.536+0000 7f1dd0600640 1 -- 172.21.15.50:0/1371906400 wait complete. 2024-09-10T10:09:54.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.537+0000 7f1dd0600640 1 Processor -- start 2024-09-10T10:09:54.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.537+0000 7f1dd0600640 1 -- start start 2024-09-10T10:09:54.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.537+0000 7f1dd0600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc8104010 0x7f1dc819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:54.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.537+0000 7f1dd0600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dc81049c0 0x7f1dc819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:54.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.537+0000 7f1dd0600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8109140 0x7f1dc819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:54.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.537+0000 7f1dd0600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8114190 con 0x7f1dc8104010 2024-09-10T10:09:54.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.537+0000 7f1dd0600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8114010 con 0x7f1dc8109140 2024-09-10T10:09:54.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.537+0000 7f1dd0600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8114310 con 0x7f1dc81049c0 2024-09-10T10:09:54.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.538+0000 7f1dcdc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc8104010 0x7f1dc819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:54.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.538+0000 7f1dcdc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc8104010 0x7f1dc819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52062/0 (socket says 172.21.15.50:52062) 2024-09-10T10:09:54.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.538+0000 7f1dcdc00640 1 -- 172.21.15.50:0/1273415367 learned_addr learned my addr 172.21.15.50:0/1273415367 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:54.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.538+0000 7f1dce600640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8109140 0x7f1dc819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:54.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.538+0000 7f1dcd200640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dc81049c0 0x7f1dc819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:54.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.538+0000 7f1dce600640 1 -- 172.21.15.50:0/1273415367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dc81049c0 msgr2=0x7f1dc819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:54.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.538+0000 7f1dce600640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dc81049c0 0x7f1dc819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:54.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.538+0000 7f1dce600640 1 -- 172.21.15.50:0/1273415367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc8104010 msgr2=0x7f1dc819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:54.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.538+0000 7f1dce600640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc8104010 0x7f1dc819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:54.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.538+0000 7f1dce600640 1 -- 172.21.15.50:0/1273415367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc819f660 con 0x7f1dc8109140 2024-09-10T10:09:54.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.538+0000 7f1dcdc00640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc8104010 0x7f1dc819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:09:54.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.539+0000 7f1dce600640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8109140 0x7f1dc819ef80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009fd0 tx=0x7f1dc000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:54.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.539+0000 7f1dc6000640 1 -- 172.21.15.50:0/1273415367 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000ce20 con 0x7f1dc8109140 2024-09-10T10:09:54.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.539+0000 7f1dd0600640 1 -- 172.21.15.50:0/1273415367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc819f950 con 0x7f1dc8109140 2024-09-10T10:09:54.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.539+0000 7f1dc6000640 1 -- 172.21.15.50:0/1273415367 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc0005020 con 0x7f1dc8109140 2024-09-10T10:09:54.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.539+0000 7f1dc6000640 1 -- 172.21.15.50:0/1273415367 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0010720 con 0x7f1dc8109140 2024-09-10T10:09:54.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.539+0000 7f1dd0600640 1 -- 172.21.15.50:0/1273415367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc81a7230 con 0x7f1dc8109140 2024-09-10T10:09:54.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.540+0000 7f1dd0600640 1 -- 172.21.15.50:0/1273415367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc81043f0 con 0x7f1dc8109140 2024-09-10T10:09:54.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.542+0000 7f1dc6000640 1 -- 172.21.15.50:0/1273415367 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1dc0005540 con 0x7f1dc8109140 2024-09-10T10:09:54.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.543+0000 7f1dc6000640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1db00a2c10 0x7f1db00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:54.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.543+0000 7f1dc6000640 1 -- 172.21.15.50:0/1273415367 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f1dc00cfbd0 con 0x7f1dc8109140 2024-09-10T10:09:54.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.543+0000 7f1dcdc00640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1db00a2c10 0x7f1db00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:54.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.544+0000 7f1dcdc00640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1db00a2c10 0x7f1db00a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0096c0 tx=0x7f1dbc0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:54.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.546+0000 7f1dc6000640 1 -- 172.21.15.50:0/1273415367 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1dc009c610 con 0x7f1dc8109140 2024-09-10T10:09:54.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.737+0000 7f1dd0600640 1 -- 172.21.15.50:0/1273415367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1dc810c380 con 0x7f1dc8109140 2024-09-10T10:09:54.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.739+0000 7f1dc6000640 1 -- 172.21.15.50:0/1273415367 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24682 (secure 0 0 0) 0x7f1dc009bf10 con 0x7f1dc8109140 2024-09-10T10:09:54.741 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:09:54.741 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":93,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:09:00.446421+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:09:54.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.741+0000 7f1dd0600640 1 -- 172.21.15.50:0/1273415367 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1db00a2c10 msgr2=0x7f1db00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:54.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.741+0000 7f1dd0600640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1db00a2c10 0x7f1db00a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0096c0 tx=0x7f1dbc0046c0 comp rx=0 tx=0).stop 2024-09-10T10:09:54.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.741+0000 7f1dd0600640 1 -- 172.21.15.50:0/1273415367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8109140 msgr2=0x7f1dc819ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:54.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.741+0000 7f1dd0600640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8109140 0x7f1dc819ef80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009fd0 tx=0x7f1dc000ef10 comp rx=0 tx=0).stop 2024-09-10T10:09:54.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.741+0000 7f1dd0600640 1 -- 172.21.15.50:0/1273415367 shutdown_connections 2024-09-10T10:09:54.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.741+0000 7f1dd0600640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1db00a2c10 0x7f1db00a50d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:54.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.741+0000 7f1dd0600640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8109140 0x7f1dc819ef80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:54.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.741+0000 7f1dd0600640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dc81049c0 0x7f1dc819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:54.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.741+0000 7f1dd0600640 1 --2- 172.21.15.50:0/1273415367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dc8104010 0x7f1dc819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:54.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.741+0000 7f1dd0600640 1 -- 172.21.15.50:0/1273415367 >> 172.21.15.50:0/1273415367 conn(0x7f1dc80ffa50 msgr2=0x7f1dc8100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:54.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.742+0000 7f1dd0600640 1 -- 172.21.15.50:0/1273415367 shutdown_connections 2024-09-10T10:09:54.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:54.742+0000 7f1dd0600640 1 -- 172.21.15.50:0/1273415367 wait complete. 2024-09-10T10:09:54.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:54 smithi050 ceph-mon[30354]: pgmap v350: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 KiB/s wr, 9 op/s 2024-09-10T10:09:55.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:54 smithi189 ceph-mon[34999]: pgmap v350: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 KiB/s wr, 9 op/s 2024-09-10T10:09:55.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:54 smithi084 ceph-mon[34812]: pgmap v350: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.3 KiB/s wr, 9 op/s 2024-09-10T10:09:55.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T10:09:55.469 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T10:09:55.469 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T10:09:55.469 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T10:09:55.470 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T10:09:55.470 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T10:09:55.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T10:09:55.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T10:09:55.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T10:09:55.472 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T10:09:55.472 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T10:09:55.473 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T10:09:55.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:55 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1273415367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:56.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:55 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1273415367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:56.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:55 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1273415367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:09:56.409 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:56.752 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:56.752 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:56.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:56 smithi050 ceph-mon[30354]: pgmap v351: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-10T10:09:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.068+0000 7fe183200640 1 -- 172.21.15.50:0/2923307334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe18410e280 msgr2=0x7fe184110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.068+0000 7fe183200640 1 --2- 172.21.15.50:0/2923307334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe18410e280 0x7fe184110670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009be0 tx=0x7fe17c02a750 comp rx=0 tx=0).stop 2024-09-10T10:09:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.068+0000 7fe183200640 1 -- 172.21.15.50:0/2923307334 shutdown_connections 2024-09-10T10:09:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.068+0000 7fe183200640 1 --2- 172.21.15.50:0/2923307334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe18410e280 0x7fe184110670 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.068+0000 7fe183200640 1 --2- 172.21.15.50:0/2923307334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe184074e30 0x7fe18410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.068+0000 7fe183200640 1 --2- 172.21.15.50:0/2923307334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe184074510 0x7fe1840748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.068+0000 7fe183200640 1 -- 172.21.15.50:0/2923307334 >> 172.21.15.50:0/2923307334 conn(0x7fe1840fd740 msgr2=0x7fe1840ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:57.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.068+0000 7fe183200640 1 -- 172.21.15.50:0/2923307334 shutdown_connections 2024-09-10T10:09:57.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.068+0000 7fe183200640 1 -- 172.21.15.50:0/2923307334 wait complete. 2024-09-10T10:09:57.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.069+0000 7fe183200640 1 Processor -- start 2024-09-10T10:09:57.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.069+0000 7fe183200640 1 -- start start 2024-09-10T10:09:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.070+0000 7fe183200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe184074510 0x7fe18419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.070+0000 7fe183200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe184074e30 0x7fe18419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.070+0000 7fe183200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe18410e280 0x7fe18419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.070+0000 7fe183200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe184113f20 con 0x7fe18410e280 2024-09-10T10:09:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.070+0000 7fe183200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe184113da0 con 0x7fe184074510 2024-09-10T10:09:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.070+0000 7fe183200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe1841140a0 con 0x7fe184074e30 2024-09-10T10:09:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.070+0000 7fe181e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe184074510 0x7fe18419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.070+0000 7fe181e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe184074510 0x7fe18419a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50874/0 (socket says 172.21.15.50:50874) 2024-09-10T10:09:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.070+0000 7fe181e00640 1 -- 172.21.15.50:0/1391770797 learned_addr learned my addr 172.21.15.50:0/1391770797 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.071+0000 7fe182800640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe18410e280 0x7fe18419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.071+0000 7fe181400640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe184074e30 0x7fe18419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.071+0000 7fe181e00640 1 -- 172.21.15.50:0/1391770797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe184074e30 msgr2=0x7fe18419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.071+0000 7fe181e00640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe184074e30 0x7fe18419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.071+0000 7fe181e00640 1 -- 172.21.15.50:0/1391770797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe18410e280 msgr2=0x7fe18419eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.071+0000 7fe181e00640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe18410e280 0x7fe18419eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.071+0000 7fe181e00640 1 -- 172.21.15.50:0/1391770797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18419f480 con 0x7fe184074510 2024-09-10T10:09:57.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.071+0000 7fe181e00640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe184074510 0x7fe18419a4d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe17400e9c0 tx=0x7fe17400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:57.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.072+0000 7fe17aa00640 1 -- 172.21.15.50:0/1391770797 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17400ccc0 con 0x7fe184074510 2024-09-10T10:09:57.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.072+0000 7fe17aa00640 1 -- 172.21.15.50:0/1391770797 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe174005500 con 0x7fe184074510 2024-09-10T10:09:57.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.072+0000 7fe183200640 1 -- 172.21.15.50:0/1391770797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18419f770 con 0x7fe184074510 2024-09-10T10:09:57.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.072+0000 7fe17aa00640 1 -- 172.21.15.50:0/1391770797 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174010430 con 0x7fe184074510 2024-09-10T10:09:57.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.072+0000 7fe183200640 1 -- 172.21.15.50:0/1391770797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1841a7050 con 0x7fe184074510 2024-09-10T10:09:57.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.073+0000 7fe183200640 1 -- 172.21.15.50:0/1391770797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe184062900 con 0x7fe184074510 2024-09-10T10:09:57.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.075+0000 7fe17aa00640 1 -- 172.21.15.50:0/1391770797 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe1740046c0 con 0x7fe184074510 2024-09-10T10:09:57.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.077+0000 7fe17aa00640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1680a2c10 0x7fe1680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.077+0000 7fe17aa00640 1 -- 172.21.15.50:0/1391770797 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fe1740cfb60 con 0x7fe184074510 2024-09-10T10:09:57.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.078+0000 7fe181400640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1680a2c10 0x7fe1680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.078+0000 7fe17aa00640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052] conn(0x7fe1680adde0 0x7fe1680b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:57.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.078+0000 7fe17aa00640 1 -- 172.21.15.50:0/1391770797 --> [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1680b0950 con 0x7fe1680adde0 2024-09-10T10:09:57.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.078+0000 7fe17aa00640 1 -- 172.21.15.50:0/1391770797 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fe1740cff10 con 0x7fe184074510 2024-09-10T10:09:57.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.078+0000 7fe182800640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052] conn(0x7fe1680adde0 0x7fe1680b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:57.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.079+0000 7fe181400640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1680a2c10 0x7fe1680a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1840ffdd0 tx=0x7fe170005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:57.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.079+0000 7fe182800640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052] conn(0x7fe1680adde0 0x7fe1680b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:57.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.080+0000 7fe17aa00640 1 -- 172.21.15.50:0/1391770797 <== osd.3 v2:172.21.15.50:6810/3341598052 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe1680b0950 con 0x7fe1680adde0 2024-09-10T10:09:57.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:56 smithi189 ceph-mon[34999]: pgmap v351: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-10T10:09:57.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:56 smithi084 ceph-mon[34812]: pgmap v351: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-10T10:09:57.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.100+0000 7fe183200640 1 -- 172.21.15.50:0/1391770797 --> [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe184062d80 con 0x7fe1680adde0 2024-09-10T10:09:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.101+0000 7fe17aa00640 1 -- 172.21.15.50:0/1391770797 <== osd.3 v2:172.21.15.50:6810/3341598052 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe184062d80 con 0x7fe1680adde0 2024-09-10T10:09:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.102+0000 7fe183200640 1 -- 172.21.15.50:0/1391770797 >> [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052] conn(0x7fe1680adde0 msgr2=0x7fe1680b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.102+0000 7fe183200640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052] conn(0x7fe1680adde0 0x7fe1680b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.102+0000 7fe183200640 1 -- 172.21.15.50:0/1391770797 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1680a2c10 msgr2=0x7fe1680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.102+0000 7fe183200640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1680a2c10 0x7fe1680a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe1840ffdd0 tx=0x7fe170005f90 comp rx=0 tx=0).stop 2024-09-10T10:09:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.102+0000 7fe183200640 1 -- 172.21.15.50:0/1391770797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe184074510 msgr2=0x7fe18419a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.102+0000 7fe183200640 1 --2- 172.21.15.50:0/1391770797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe184074510 0x7fe18419a4d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe17400e9c0 tx=0x7fe17400ee80 comp rx=0 tx=0).stop 2024-09-10T10:09:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.102+0000 7fe182800640 1 -- 172.21.15.50:0/1391770797 reap_dead start 2024-09-10T10:09:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.102+0000 7fe183200640 1 -- 172.21.15.50:0/1391770797 shutdown_connections 2024-09-10T10:09:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.102+0000 7fe183200640 1 -- 172.21.15.50:0/1391770797 >> 172.21.15.50:0/1391770797 conn(0x7fe1840fd740 msgr2=0x7fe1840fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.103+0000 7fe183200640 1 -- 172.21.15.50:0/1391770797 shutdown_connections 2024-09-10T10:09:57.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:57.103+0000 7fe183200640 1 -- 172.21.15.50:0/1391770797 wait complete. 2024-09-10T10:09:57.105 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:57.105 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:58.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.173+0000 7fd74b600640 1 -- 172.21.15.50:0/2653617343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7441049a0 msgr2=0x7fd7441089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.173+0000 7fd74b600640 1 --2- 172.21.15.50:0/2653617343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7441049a0 0x7fd7441089f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd730009900 tx=0x7fd73002a400 comp rx=0 tx=0).stop 2024-09-10T10:09:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.173+0000 7fd74b600640 1 -- 172.21.15.50:0/2653617343 shutdown_connections 2024-09-10T10:09:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.173+0000 7fd74b600640 1 --2- 172.21.15.50:0/2653617343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd744109120 0x7fd744110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.173+0000 7fd74b600640 1 --2- 172.21.15.50:0/2653617343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7441049a0 0x7fd7441089f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.173+0000 7fd74b600640 1 --2- 172.21.15.50:0/2653617343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd744103ff0 0x7fd7441043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.173+0000 7fd74b600640 1 -- 172.21.15.50:0/2653617343 >> 172.21.15.50:0/2653617343 conn(0x7fd7440ffa90 msgr2=0x7fd744101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.173+0000 7fd74b600640 1 -- 172.21.15.50:0/2653617343 shutdown_connections 2024-09-10T10:09:58.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.173+0000 7fd74b600640 1 -- 172.21.15.50:0/2653617343 wait complete. 2024-09-10T10:09:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.174+0000 7fd74b600640 1 Processor -- start 2024-09-10T10:09:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.174+0000 7fd74b600640 1 -- start start 2024-09-10T10:09:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.175+0000 7fd74b600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd744103ff0 0x7fd74419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.175+0000 7fd74b600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7441049a0 0x7fd74419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:58.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.175+0000 7fd74b600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd744109120 0x7fd74419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.175+0000 7fd74b600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd744114190 con 0x7fd744103ff0 2024-09-10T10:09:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.175+0000 7fd74b600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd744114010 con 0x7fd7441049a0 2024-09-10T10:09:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.175+0000 7fd74b600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd744114310 con 0x7fd744109120 2024-09-10T10:09:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.175+0000 7fd748c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd744103ff0 0x7fd74419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.175+0000 7fd748c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd744103ff0 0x7fd74419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58328/0 (socket says 172.21.15.50:58328) 2024-09-10T10:09:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.175+0000 7fd748c00640 1 -- 172.21.15.50:0/2374608321 learned_addr learned my addr 172.21.15.50:0/2374608321 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.175+0000 7fd749600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd744109120 0x7fd74419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:58.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.175+0000 7fd743e00640 1 --2- 172.21.15.50:0/2374608321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7441049a0 0x7fd74419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.176+0000 7fd749600640 1 -- 172.21.15.50:0/2374608321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7441049a0 msgr2=0x7fd74419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.176+0000 7fd749600640 1 --2- 172.21.15.50:0/2374608321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7441049a0 0x7fd74419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.176+0000 7fd749600640 1 -- 172.21.15.50:0/2374608321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd744103ff0 msgr2=0x7fd74419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.176+0000 7fd749600640 1 --2- 172.21.15.50:0/2374608321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd744103ff0 0x7fd74419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.176+0000 7fd749600640 1 -- 172.21.15.50:0/2374608321 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74419f620 con 0x7fd744109120 2024-09-10T10:09:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.176+0000 7fd749600640 1 --2- 172.21.15.50:0/2374608321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd744109120 0x7fd74419ef40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009fd0 tx=0x7fd73c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.176+0000 7fd741600640 1 -- 172.21.15.50:0/2374608321 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c00ce20 con 0x7fd744109120 2024-09-10T10:09:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.176+0000 7fd741600640 1 -- 172.21.15.50:0/2374608321 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd73c005020 con 0x7fd744109120 2024-09-10T10:09:58.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.176+0000 7fd74b600640 1 -- 172.21.15.50:0/2374608321 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74419f910 con 0x7fd744109120 2024-09-10T10:09:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.176+0000 7fd741600640 1 -- 172.21.15.50:0/2374608321 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c010720 con 0x7fd744109120 2024-09-10T10:09:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.176+0000 7fd74b600640 1 -- 172.21.15.50:0/2374608321 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7441a71f0 con 0x7fd744109120 2024-09-10T10:09:58.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.177+0000 7fd74b600640 1 -- 172.21.15.50:0/2374608321 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd744062940 con 0x7fd744109120 2024-09-10T10:09:58.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.180+0000 7fd741600640 1 -- 172.21.15.50:0/2374608321 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd73c005540 con 0x7fd744109120 2024-09-10T10:09:58.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.181+0000 7fd741600640 1 --2- 172.21.15.50:0/2374608321 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd72c0a2c10 0x7fd72c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:58.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.181+0000 7fd741600640 1 -- 172.21.15.50:0/2374608321 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fd73c0cfd50 con 0x7fd744109120 2024-09-10T10:09:58.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.181+0000 7fd748c00640 1 --2- 172.21.15.50:0/2374608321 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd72c0a2c10 0x7fd72c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:58.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.182+0000 7fd741600640 1 --2- 172.21.15.50:0/2374608321 >> [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762] conn(0x7fd72c0adde0 0x7fd72c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:58.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.182+0000 7fd741600640 1 -- 172.21.15.50:0/2374608321 --> [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd73c019e50 con 0x7fd72c0adde0 2024-09-10T10:09:58.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.182+0000 7fd741600640 1 -- 172.21.15.50:0/2374608321 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fd73c0d0100 con 0x7fd744109120 2024-09-10T10:09:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.182+0000 7fd743e00640 1 --2- 172.21.15.50:0/2374608321 >> [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762] conn(0x7fd72c0adde0 0x7fd72c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.182+0000 7fd748c00640 1 --2- 172.21.15.50:0/2374608321 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd72c0a2c10 0x7fd72c0a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd738009cd0 tx=0x7fd738005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.182+0000 7fd743e00640 1 --2- 172.21.15.50:0/2374608321 >> [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762] conn(0x7fd72c0adde0 0x7fd72c0b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:58.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.183+0000 7fd741600640 1 -- 172.21.15.50:0/2374608321 <== osd.8 v2:172.21.15.189:6816/2053233762 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd73c019e50 con 0x7fd72c0adde0 2024-09-10T10:09:58.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.198+0000 7fd74b600640 1 -- 172.21.15.50:0/2374608321 --> [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd744062dc0 con 0x7fd72c0adde0 2024-09-10T10:09:58.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.199+0000 7fd741600640 1 -- 172.21.15.50:0/2374608321 <== osd.8 v2:172.21.15.189:6816/2053233762 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd744062dc0 con 0x7fd72c0adde0 2024-09-10T10:09:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.199+0000 7fd74b600640 1 -- 172.21.15.50:0/2374608321 >> [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762] conn(0x7fd72c0adde0 msgr2=0x7fd72c0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.199+0000 7fd74b600640 1 --2- 172.21.15.50:0/2374608321 >> [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762] conn(0x7fd72c0adde0 0x7fd72c0b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.199+0000 7fd74b600640 1 -- 172.21.15.50:0/2374608321 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd72c0a2c10 msgr2=0x7fd72c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.199+0000 7fd74b600640 1 --2- 172.21.15.50:0/2374608321 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd72c0a2c10 0x7fd72c0a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd738009cd0 tx=0x7fd738005f90 comp rx=0 tx=0).stop 2024-09-10T10:09:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.199+0000 7fd74b600640 1 -- 172.21.15.50:0/2374608321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd744109120 msgr2=0x7fd74419ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.199+0000 7fd74b600640 1 --2- 172.21.15.50:0/2374608321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd744109120 0x7fd74419ef40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009fd0 tx=0x7fd73c00ef10 comp rx=0 tx=0).stop 2024-09-10T10:09:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.199+0000 7fd749600640 1 -- 172.21.15.50:0/2374608321 reap_dead start 2024-09-10T10:09:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.199+0000 7fd74b600640 1 -- 172.21.15.50:0/2374608321 shutdown_connections 2024-09-10T10:09:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.199+0000 7fd74b600640 1 -- 172.21.15.50:0/2374608321 >> 172.21.15.50:0/2374608321 conn(0x7fd7440ffa90 msgr2=0x7fd744100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.199+0000 7fd74b600640 1 -- 172.21.15.50:0/2374608321 shutdown_connections 2024-09-10T10:09:58.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.199+0000 7fd74b600640 1 -- 172.21.15.50:0/2374608321 wait complete. 2024-09-10T10:09:58.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.055+0000 7f01c2200640 1 -- 172.21.15.50:0/148116618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01bc1049c0 msgr2=0x7f01bc108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.055+0000 7f01c2200640 1 --2- 172.21.15.50:0/148116618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01bc1049c0 0x7f01bc108a10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009900 tx=0x7f01a802a410 comp rx=0 tx=0).stop 2024-09-10T10:09:58.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.055+0000 7f01c2200640 1 -- 172.21.15.50:0/148116618 shutdown_connections 2024-09-10T10:09:58.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.055+0000 7f01c2200640 1 --2- 172.21.15.50:0/148116618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01bc109140 0x7f01bc110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.055+0000 7f01c2200640 1 --2- 172.21.15.50:0/148116618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01bc1049c0 0x7f01bc108a10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.055+0000 7f01c2200640 1 --2- 172.21.15.50:0/148116618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01bc104010 0x7f01bc1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.055+0000 7f01c2200640 1 -- 172.21.15.50:0/148116618 >> 172.21.15.50:0/148116618 conn(0x7f01bc0ffa50 msgr2=0x7f01bc101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:58.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.055+0000 7f01c2200640 1 -- 172.21.15.50:0/148116618 shutdown_connections 2024-09-10T10:09:58.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.055+0000 7f01c2200640 1 -- 172.21.15.50:0/148116618 wait complete. 2024-09-10T10:09:58.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.056+0000 7f01c2200640 1 Processor -- start 2024-09-10T10:09:58.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.057+0000 7f01c2200640 1 -- start start 2024-09-10T10:09:58.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.057+0000 7f01c2200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01bc104010 0x7f01bc19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.057+0000 7f01c2200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01bc1049c0 0x7f01bc19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.057+0000 7f01c2200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01bc109140 0x7f01bc19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.057+0000 7f01c2200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc114190 con 0x7f01bc1049c0 2024-09-10T10:09:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.057+0000 7f01c2200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc114010 con 0x7f01bc104010 2024-09-10T10:09:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.057+0000 7f01c2200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc114310 con 0x7f01bc109140 2024-09-10T10:09:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.057+0000 7f01baa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01bc1049c0 0x7f01bc19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.057+0000 7f01bb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01bc104010 0x7f01bc19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.057+0000 7f01baa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01bc1049c0 0x7f01bc19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58316/0 (socket says 172.21.15.50:58316) 2024-09-10T10:09:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.057+0000 7f01bb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01bc104010 0x7f01bc19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50890/0 (socket says 172.21.15.50:50890) 2024-09-10T10:09:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.057+0000 7f01baa00640 1 -- 172.21.15.50:0/2813795079 learned_addr learned my addr 172.21.15.50:0/2813795079 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:09:58.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.057+0000 7f01bbe00640 1 --2- 172.21.15.50:0/2813795079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01bc109140 0x7f01bc19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.058+0000 7f01bb400640 1 -- 172.21.15.50:0/2813795079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01bc109140 msgr2=0x7f01bc19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.058+0000 7f01bb400640 1 --2- 172.21.15.50:0/2813795079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f01bc109140 0x7f01bc19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.058+0000 7f01bb400640 1 -- 172.21.15.50:0/2813795079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01bc1049c0 msgr2=0x7f01bc19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.058+0000 7f01bb400640 1 --2- 172.21.15.50:0/2813795079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01bc1049c0 0x7f01bc19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.058+0000 7f01bb400640 1 -- 172.21.15.50:0/2813795079 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01bc19f620 con 0x7f01bc104010 2024-09-10T10:09:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.058+0000 7f01bb400640 1 --2- 172.21.15.50:0/2813795079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01bc104010 0x7f01bc19a670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00e9f0 tx=0x7f01ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.058+0000 7f01b3e00640 1 -- 172.21.15.50:0/2813795079 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac00ccc0 con 0x7f01bc104010 2024-09-10T10:09:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.058+0000 7f01b3e00640 1 -- 172.21.15.50:0/2813795079 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01ac010910 con 0x7f01bc104010 2024-09-10T10:09:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.058+0000 7f01b3e00640 1 -- 172.21.15.50:0/2813795079 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac018960 con 0x7f01bc104010 2024-09-10T10:09:58.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.058+0000 7f01c2200640 1 -- 172.21.15.50:0/2813795079 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01bc19f910 con 0x7f01bc104010 2024-09-10T10:09:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.059+0000 7f01c2200640 1 -- 172.21.15.50:0/2813795079 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01bc1a71f0 con 0x7f01bc104010 2024-09-10T10:09:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.060+0000 7f01c2200640 1 -- 172.21.15.50:0/2813795079 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01bc062980 con 0x7f01bc104010 2024-09-10T10:09:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.062+0000 7f01b3e00640 1 -- 172.21.15.50:0/2813795079 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f01ac010ac0 con 0x7f01bc104010 2024-09-10T10:09:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.063+0000 7f01b3e00640 1 --2- 172.21.15.50:0/2813795079 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f01a00a2c10 0x7f01a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.063+0000 7f01b3e00640 1 -- 172.21.15.50:0/2813795079 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f01ac0d0140 con 0x7f01bc104010 2024-09-10T10:09:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.063+0000 7f01baa00640 1 --2- 172.21.15.50:0/2813795079 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f01a00a2c10 0x7f01a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.063+0000 7f01b3e00640 1 --2- 172.21.15.50:0/2813795079 >> [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386] conn(0x7f01a00adde0 0x7f01a00b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:09:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.064+0000 7f01b3e00640 1 -- 172.21.15.50:0/2813795079 --> [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01ac028ea0 con 0x7f01a00adde0 2024-09-10T10:09:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.064+0000 7f01b3e00640 1 -- 172.21.15.50:0/2813795079 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f01ac0d04f0 con 0x7f01bc104010 2024-09-10T10:09:58.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.064+0000 7f01bbe00640 1 --2- 172.21.15.50:0/2813795079 >> [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386] conn(0x7f01a00adde0 0x7f01a00b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:09:58.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.064+0000 7f01baa00640 1 --2- 172.21.15.50:0/2813795079 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f01a00a2c10 0x7f01a00a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f01a80096c0 tx=0x7f01a80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:58.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.065+0000 7f01bbe00640 1 --2- 172.21.15.50:0/2813795079 >> [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386] conn(0x7f01a00adde0 0x7f01a00b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:09:58.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.066+0000 7f01b3e00640 1 -- 172.21.15.50:0/2813795079 <== osd.5 v2:172.21.15.189:6808/2921666386 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f01ac028ea0 con 0x7f01a00adde0 2024-09-10T10:09:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.095+0000 7f01c2200640 1 -- 172.21.15.50:0/2813795079 --> [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f01bc062d80 con 0x7f01a00adde0 2024-09-10T10:09:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.096+0000 7f01b3e00640 1 -- 172.21.15.50:0/2813795079 <== osd.5 v2:172.21.15.189:6808/2921666386 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f01bc062d80 con 0x7f01a00adde0 2024-09-10T10:09:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.097+0000 7f01c2200640 1 -- 172.21.15.50:0/2813795079 >> [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386] conn(0x7f01a00adde0 msgr2=0x7f01a00b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.097+0000 7f01c2200640 1 --2- 172.21.15.50:0/2813795079 >> [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386] conn(0x7f01a00adde0 0x7f01a00b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.097+0000 7f01c2200640 1 -- 172.21.15.50:0/2813795079 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f01a00a2c10 msgr2=0x7f01a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.097+0000 7f01c2200640 1 --2- 172.21.15.50:0/2813795079 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f01a00a2c10 0x7f01a00a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f01a80096c0 tx=0x7f01a80046c0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.097+0000 7f01c2200640 1 -- 172.21.15.50:0/2813795079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01bc104010 msgr2=0x7f01bc19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:09:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.097+0000 7f01c2200640 1 --2- 172.21.15.50:0/2813795079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01bc104010 0x7f01bc19a670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00e9f0 tx=0x7f01ac00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:09:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.097+0000 7f01bbe00640 1 -- 172.21.15.50:0/2813795079 reap_dead start 2024-09-10T10:09:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.097+0000 7f01c2200640 1 -- 172.21.15.50:0/2813795079 shutdown_connections 2024-09-10T10:09:58.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.097+0000 7f01c2200640 1 -- 172.21.15.50:0/2813795079 >> 172.21.15.50:0/2813795079 conn(0x7f01bc0ffa50 msgr2=0x7f01bc100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:09:58.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.097+0000 7f01c2200640 1 -- 172.21.15.50:0/2813795079 shutdown_connections 2024-09-10T10:09:58.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:09:58.097+0000 7f01c2200640 1 -- 172.21.15.50:0/2813795079 wait complete. 2024-09-10T10:09:58.643 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:58.643 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:58.645 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:58.645 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:58.646 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:58.650 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:58.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:58 smithi050 ceph-mon[30354]: pgmap v352: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-10T10:09:58.990 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:09:59.019 INFO:teuthology.orchestra.run.smithi050.stdout:167503724609 2024-09-10T10:09:59.019 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T10:09:59.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:58 smithi189 ceph-mon[34999]: pgmap v352: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-10T10:09:59.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:58 smithi084 ceph-mon[34812]: pgmap v352: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-10T10:09:59.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-10T10:09:59.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:09:59 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-10T10:10:00.028 INFO:teuthology.orchestra.run.smithi050.stdout:111669149769 2024-09-10T10:10:00.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T10:10:00.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-10T10:10:00.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:09:59 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-10T10:10:00.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-10T10:10:00.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:09:59 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-10T10:10:00.525 INFO:teuthology.orchestra.run.smithi050.stdout:253403070511 2024-09-10T10:10:00.525 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T10:10:00.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.744+0000 7f1f6be00640 1 -- 172.21.15.50:0/4144140768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f6c1079c0 msgr2=0x7f1f6c107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:00.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.744+0000 7f1f6be00640 1 --2- 172.21.15.50:0/4144140768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f6c1079c0 0x7f1f6c107da0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009860 tx=0x7f1f5c02a340 comp rx=0 tx=0).stop 2024-09-10T10:10:00.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.744+0000 7f1f6be00640 1 -- 172.21.15.50:0/4144140768 shutdown_connections 2024-09-10T10:10:00.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.744+0000 7f1f6be00640 1 --2- 172.21.15.50:0/4144140768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f6c102360 0x7f1f6c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:00.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.744+0000 7f1f6be00640 1 --2- 172.21.15.50:0/4144140768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f6c1019c0 0x7f1f6c101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:00.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.744+0000 7f1f6be00640 1 --2- 172.21.15.50:0/4144140768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f6c1079c0 0x7f1f6c107da0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:00.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.744+0000 7f1f6be00640 1 -- 172.21.15.50:0/4144140768 >> 172.21.15.50:0/4144140768 conn(0x7f1f6c0fd740 msgr2=0x7f1f6c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:00.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.745+0000 7f1f6be00640 1 -- 172.21.15.50:0/4144140768 shutdown_connections 2024-09-10T10:10:00.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.745+0000 7f1f6be00640 1 -- 172.21.15.50:0/4144140768 wait complete. 2024-09-10T10:10:00.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.746+0000 7f1f6be00640 1 Processor -- start 2024-09-10T10:10:00.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.746+0000 7f1f6be00640 1 -- start start 2024-09-10T10:10:00.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f6c1019c0 0x7f1f6c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:00.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f6c102360 0x7f1f6c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:00.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f6c1079c0 0x7f1f6c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:00.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6be00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c111dc0 con 0x7f1f6c1079c0 2024-09-10T10:10:00.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c111c40 con 0x7f1f6c102360 2024-09-10T10:10:00.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6be00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c111f40 con 0x7f1f6c1019c0 2024-09-10T10:10:00.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f6c102360 0x7f1f6c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:00.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f6c1079c0 0x7f1f6c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f6c102360 0x7f1f6c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50932/0 (socket says 172.21.15.50:50932) 2024-09-10T10:10:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6a000640 1 -- 172.21.15.50:0/608674904 learned_addr learned my addr 172.21.15.50:0/608674904 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6aa00640 1 --2- 172.21.15.50:0/608674904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f6c1019c0 0x7f1f6c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6a000640 1 -- 172.21.15.50:0/608674904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f6c1019c0 msgr2=0x7f1f6c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6a000640 1 --2- 172.21.15.50:0/608674904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f6c1019c0 0x7f1f6c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6a000640 1 -- 172.21.15.50:0/608674904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f6c1079c0 msgr2=0x7f1f6c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.747+0000 7f1f6a000640 1 --2- 172.21.15.50:0/608674904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f6c1079c0 0x7f1f6c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.748+0000 7f1f6a000640 1 -- 172.21.15.50:0/608674904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6c1a6760 con 0x7f1f6c102360 2024-09-10T10:10:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.748+0000 7f1f6a000640 1 --2- 172.21.15.50:0/608674904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f6c102360 0x7f1f6c074a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800e9f0 tx=0x7f1f5800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.748+0000 7f1f63400640 1 -- 172.21.15.50:0/608674904 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5800cd80 con 0x7f1f6c102360 2024-09-10T10:10:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.748+0000 7f1f6be00640 1 -- 172.21.15.50:0/608674904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6c1a6a50 con 0x7f1f6c102360 2024-09-10T10:10:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.748+0000 7f1f63400640 1 -- 172.21.15.50:0/608674904 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f58005500 con 0x7f1f6c102360 2024-09-10T10:10:00.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.748+0000 7f1f63400640 1 -- 172.21.15.50:0/608674904 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f58010690 con 0x7f1f6c102360 2024-09-10T10:10:00.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.748+0000 7f1f6be00640 1 -- 172.21.15.50:0/608674904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f6c1a6f90 con 0x7f1f6c102360 2024-09-10T10:10:00.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.749+0000 7f1f6be00640 1 -- 172.21.15.50:0/608674904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f6c062900 con 0x7f1f6c102360 2024-09-10T10:10:00.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.752+0000 7f1f63400640 1 -- 172.21.15.50:0/608674904 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1f580046c0 con 0x7f1f6c102360 2024-09-10T10:10:00.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.753+0000 7f1f63400640 1 --2- 172.21.15.50:0/608674904 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1f500a2c10 0x7f1f500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:00.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.753+0000 7f1f63400640 1 -- 172.21.15.50:0/608674904 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f1f580cfff0 con 0x7f1f6c102360 2024-09-10T10:10:00.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.753+0000 7f1f6aa00640 1 --2- 172.21.15.50:0/608674904 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1f500a2c10 0x7f1f500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:00.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.753+0000 7f1f63400640 1 --2- 172.21.15.50:0/608674904 >> [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620] conn(0x7f1f500adee0 0x7f1f500b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:00.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.753+0000 7f1f63400640 1 -- 172.21.15.50:0/608674904 --> [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f500b0a50 con 0x7f1f500adee0 2024-09-10T10:10:00.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.754+0000 7f1f63400640 1 -- 172.21.15.50:0/608674904 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f1f580d03a0 con 0x7f1f6c102360 2024-09-10T10:10:00.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.754+0000 7f1f6b400640 1 --2- 172.21.15.50:0/608674904 >> [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620] conn(0x7f1f500adee0 0x7f1f500b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:00.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.754+0000 7f1f6aa00640 1 --2- 172.21.15.50:0/608674904 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1f500a2c10 0x7f1f500a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c02a930 tx=0x7f1f5c0056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:00.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.754+0000 7f1f6b400640 1 --2- 172.21.15.50:0/608674904 >> [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620] conn(0x7f1f500adee0 0x7f1f500b0380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:00.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.755+0000 7f1f63400640 1 -- 172.21.15.50:0/608674904 <== osd.1 v2:172.21.15.84:6800/139119620 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f500b0a50 con 0x7f1f500adee0 2024-09-10T10:10:00.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.770+0000 7f1f6be00640 1 -- 172.21.15.50:0/608674904 --> [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f6c062d80 con 0x7f1f500adee0 2024-09-10T10:10:00.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.770+0000 7f1f63400640 1 -- 172.21.15.50:0/608674904 <== osd.1 v2:172.21.15.84:6800/139119620 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1f6c062d80 con 0x7f1f500adee0 2024-09-10T10:10:00.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.771+0000 7f1f6be00640 1 -- 172.21.15.50:0/608674904 >> [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620] conn(0x7f1f500adee0 msgr2=0x7f1f500b0380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:00.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.771+0000 7f1f6be00640 1 --2- 172.21.15.50:0/608674904 >> [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620] conn(0x7f1f500adee0 0x7f1f500b0380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.771+0000 7f1f6be00640 1 -- 172.21.15.50:0/608674904 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1f500a2c10 msgr2=0x7f1f500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.771+0000 7f1f6be00640 1 --2- 172.21.15.50:0/608674904 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1f500a2c10 0x7f1f500a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c02a930 tx=0x7f1f5c0056d0 comp rx=0 tx=0).stop 2024-09-10T10:10:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.771+0000 7f1f6be00640 1 -- 172.21.15.50:0/608674904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f6c102360 msgr2=0x7f1f6c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.771+0000 7f1f6be00640 1 --2- 172.21.15.50:0/608674904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f6c102360 0x7f1f6c074a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800e9f0 tx=0x7f1f5800edf0 comp rx=0 tx=0).stop 2024-09-10T10:10:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.771+0000 7f1f6b400640 1 -- 172.21.15.50:0/608674904 reap_dead start 2024-09-10T10:10:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.771+0000 7f1f6be00640 1 -- 172.21.15.50:0/608674904 shutdown_connections 2024-09-10T10:10:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.771+0000 7f1f6be00640 1 -- 172.21.15.50:0/608674904 >> 172.21.15.50:0/608674904 conn(0x7f1f6c0fd740 msgr2=0x7f1f6c0fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.771+0000 7f1f6be00640 1 -- 172.21.15.50:0/608674904 shutdown_connections 2024-09-10T10:10:00.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:00.771+0000 7f1f6be00640 1 -- 172.21.15.50:0/608674904 wait complete. 2024-09-10T10:10:00.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:00 smithi050 ceph-mon[30354]: pgmap v353: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-10T10:10:00.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-10T10:10:00.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:00 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-10T10:10:00.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:00 smithi050 ceph-mon[30354]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T10:10:00.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:00 smithi050 ceph-mon[30354]: overall HEALTH_OK 2024-09-10T10:10:01.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:00 smithi189 ceph-mon[34999]: pgmap v353: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-10T10:10:01.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-10T10:10:01.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:00 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-10T10:10:01.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:00 smithi189 ceph-mon[34999]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T10:10:01.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:00 smithi189 ceph-mon[34999]: overall HEALTH_OK 2024-09-10T10:10:01.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:00 smithi084 ceph-mon[34812]: pgmap v353: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-10T10:10:01.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-10T10:10:01.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:00 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-10T10:10:01.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:00 smithi084 ceph-mon[34812]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T10:10:01.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:00 smithi084 ceph-mon[34812]: overall HEALTH_OK 2024-09-10T10:10:01.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.432+0000 7fe89c800640 1 -- 172.21.15.50:0/3811882156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894101de0 msgr2=0x7fe8941021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:01.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.432+0000 7fe89c800640 1 --2- 172.21.15.50:0/3811882156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894101de0 0x7fe8941021c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe888009900 tx=0x7fe88802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:10:01.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.432+0000 7fe89c800640 1 -- 172.21.15.50:0/3811882156 shutdown_connections 2024-09-10T10:10:01.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.432+0000 7fe89c800640 1 --2- 172.21.15.50:0/3811882156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe894106f10 0x7fe89410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.432+0000 7fe89c800640 1 --2- 172.21.15.50:0/3811882156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe894102790 0x7fe8941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.432+0000 7fe89c800640 1 --2- 172.21.15.50:0/3811882156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894101de0 0x7fe8941021c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.432+0000 7fe89c800640 1 -- 172.21.15.50:0/3811882156 >> 172.21.15.50:0/3811882156 conn(0x7fe8940fd8c0 msgr2=0x7fe8940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.432+0000 7fe89c800640 1 -- 172.21.15.50:0/3811882156 shutdown_connections 2024-09-10T10:10:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.432+0000 7fe89c800640 1 -- 172.21.15.50:0/3811882156 wait complete. 2024-09-10T10:10:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.433+0000 7fe89c800640 1 Processor -- start 2024-09-10T10:10:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.433+0000 7fe89c800640 1 -- start start 2024-09-10T10:10:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe89c800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe894101de0 0x7fe89419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe89c800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe894102790 0x7fe89419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe89c800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894106f10 0x7fe89419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe89c800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe894111fc0 con 0x7fe894106f10 2024-09-10T10:10:01.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe89c800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe894111e40 con 0x7fe894101de0 2024-09-10T10:10:01.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe89c800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe894112140 con 0x7fe894102790 2024-09-10T10:10:01.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe899e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe894101de0 0x7fe89419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:01.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe89a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894106f10 0x7fe89419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:01.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe899e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe894101de0 0x7fe89419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50960/0 (socket says 172.21.15.50:50960) 2024-09-10T10:10:01.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe899e00640 1 -- 172.21.15.50:0/4283288760 learned_addr learned my addr 172.21.15.50:0/4283288760 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:01.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe899400640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe894102790 0x7fe89419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:01.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe899e00640 1 -- 172.21.15.50:0/4283288760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe894102790 msgr2=0x7fe89419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:01.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe899e00640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe894102790 0x7fe89419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:01.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe899e00640 1 -- 172.21.15.50:0/4283288760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894106f10 msgr2=0x7fe89419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:01.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe899e00640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894106f10 0x7fe89419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:01.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe899e00640 1 -- 172.21.15.50:0/4283288760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89419f600 con 0x7fe894101de0 2024-09-10T10:10:01.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.434+0000 7fe89a800640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe894106f10 0x7fe89419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:01.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.435+0000 7fe899e00640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe894101de0 0x7fe89419a650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe888004770 tx=0x7fe888003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:01.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.435+0000 7fe88ea00640 1 -- 172.21.15.50:0/4283288760 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88803f070 con 0x7fe894101de0 2024-09-10T10:10:01.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.435+0000 7fe88ea00640 1 -- 172.21.15.50:0/4283288760 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe888031ca0 con 0x7fe894101de0 2024-09-10T10:10:01.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.435+0000 7fe89c800640 1 -- 172.21.15.50:0/4283288760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe89419f890 con 0x7fe894101de0 2024-09-10T10:10:01.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.435+0000 7fe88ea00640 1 -- 172.21.15.50:0/4283288760 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888035030 con 0x7fe894101de0 2024-09-10T10:10:01.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.435+0000 7fe89c800640 1 -- 172.21.15.50:0/4283288760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8941a71d0 con 0x7fe894101de0 2024-09-10T10:10:01.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.436+0000 7fe89c800640 1 -- 172.21.15.50:0/4283288760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe89410e150 con 0x7fe894101de0 2024-09-10T10:10:01.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.438+0000 7fe88ea00640 1 -- 172.21.15.50:0/4283288760 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe888042070 con 0x7fe894101de0 2024-09-10T10:10:01.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.439+0000 7fe88ea00640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe87c0a2c10 0x7fe87c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:01.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.440+0000 7fe88ea00640 1 -- 172.21.15.50:0/4283288760 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe8880f02a0 con 0x7fe894101de0 2024-09-10T10:10:01.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.440+0000 7fe899400640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe87c0a2c10 0x7fe87c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:01.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.440+0000 7fe88ea00640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841] conn(0x7fe87c0adee0 0x7fe87c0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:01.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.440+0000 7fe88ea00640 1 -- 172.21.15.50:0/4283288760 --> [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe888038e90 con 0x7fe87c0adee0 2024-09-10T10:10:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.440+0000 7fe88ea00640 1 -- 172.21.15.50:0/4283288760 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fe8880f0650 con 0x7fe894101de0 2024-09-10T10:10:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.440+0000 7fe89a800640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841] conn(0x7fe87c0adee0 0x7fe87c0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.441+0000 7fe899400640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe87c0a2c10 0x7fe87c0a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe884005fd0 tx=0x7fe884005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.441+0000 7fe89a800640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841] conn(0x7fe87c0adee0 0x7fe87c0b0380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:01.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.442+0000 7fe88ea00640 1 -- 172.21.15.50:0/4283288760 <== osd.11 v2:172.21.15.189:6824/2433594841 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe888038e90 con 0x7fe87c0adee0 2024-09-10T10:10:01.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.457+0000 7fe89c800640 1 -- 172.21.15.50:0/4283288760 --> [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe8941032c0 con 0x7fe87c0adee0 2024-09-10T10:10:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.458+0000 7fe88ea00640 1 -- 172.21.15.50:0/4283288760 <== osd.11 v2:172.21.15.189:6824/2433594841 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe8941032c0 con 0x7fe87c0adee0 2024-09-10T10:10:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.458+0000 7fe89c800640 1 -- 172.21.15.50:0/4283288760 >> [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841] conn(0x7fe87c0adee0 msgr2=0x7fe87c0b0380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:01.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.458+0000 7fe89c800640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841] conn(0x7fe87c0adee0 0x7fe87c0b0380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.458+0000 7fe89c800640 1 -- 172.21.15.50:0/4283288760 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe87c0a2c10 msgr2=0x7fe87c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.458+0000 7fe89c800640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe87c0a2c10 0x7fe87c0a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe884005fd0 tx=0x7fe884005850 comp rx=0 tx=0).stop 2024-09-10T10:10:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.458+0000 7fe89c800640 1 -- 172.21.15.50:0/4283288760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe894101de0 msgr2=0x7fe89419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.458+0000 7fe89c800640 1 --2- 172.21.15.50:0/4283288760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe894101de0 0x7fe89419a650 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe888004770 tx=0x7fe888003c10 comp rx=0 tx=0).stop 2024-09-10T10:10:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.458+0000 7fe89a800640 1 -- 172.21.15.50:0/4283288760 reap_dead start 2024-09-10T10:10:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.458+0000 7fe89c800640 1 -- 172.21.15.50:0/4283288760 shutdown_connections 2024-09-10T10:10:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.458+0000 7fe89c800640 1 -- 172.21.15.50:0/4283288760 >> 172.21.15.50:0/4283288760 conn(0x7fe8940fd8c0 msgr2=0x7fe8940feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.458+0000 7fe89c800640 1 -- 172.21.15.50:0/4283288760 shutdown_connections 2024-09-10T10:10:01.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.459+0000 7fe89c800640 1 -- 172.21.15.50:0/4283288760 wait complete. 2024-09-10T10:10:01.938 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:01 smithi050 ceph-mon[30354]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T10:10:02.077 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:01 smithi050 ceph-mon[30354]: pgmap v356: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-09-10T10:10:02.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:01 smithi189 ceph-mon[34999]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T10:10:02.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:01 smithi189 ceph-mon[34999]: pgmap v356: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-09-10T10:10:02.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:01 smithi084 ceph-mon[34812]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T10:10:02.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:01 smithi084 ceph-mon[34812]: pgmap v356: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-09-10T10:10:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.518+0000 7fa18f200640 1 -- 172.21.15.50:0/2827561841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa190102b60 msgr2=0x7fa190102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:03.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.518+0000 7fa18f200640 1 --2- 172.21.15.50:0/2827561841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa190102b60 0x7fa190102f40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa180009900 tx=0x7fa18002a480 comp rx=0 tx=0).stop 2024-09-10T10:10:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.519+0000 7fa18f200640 1 -- 172.21.15.50:0/2827561841 shutdown_connections 2024-09-10T10:10:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.519+0000 7fa18f200640 1 --2- 172.21.15.50:0/2827561841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19010bf90 0x7fa19010e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.519+0000 7fa18f200640 1 --2- 172.21.15.50:0/2827561841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa190103480 0x7fa19010b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.519+0000 7fa18f200640 1 --2- 172.21.15.50:0/2827561841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa190102b60 0x7fa190102f40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.519+0000 7fa18f200640 1 -- 172.21.15.50:0/2827561841 >> 172.21.15.50:0/2827561841 conn(0x7fa1900fc5c0 msgr2=0x7fa1900fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.519+0000 7fa18f200640 1 -- 172.21.15.50:0/2827561841 shutdown_connections 2024-09-10T10:10:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.519+0000 7fa18f200640 1 -- 172.21.15.50:0/2827561841 wait complete. 2024-09-10T10:10:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.520+0000 7fa18f200640 1 Processor -- start 2024-09-10T10:10:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.520+0000 7fa18f200640 1 -- start start 2024-09-10T10:10:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.520+0000 7fa18f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa190102b60 0x7fa1901007c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.520+0000 7fa18f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa190103480 0x7fa190100d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.520+0000 7fa18f200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19010bf90 0x7fa190101240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.520+0000 7fa18f200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa190111de0 con 0x7fa19010bf90 2024-09-10T10:10:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.520+0000 7fa18f200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa190111c60 con 0x7fa190102b60 2024-09-10T10:10:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.520+0000 7fa18f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa190111f60 con 0x7fa190103480 2024-09-10T10:10:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.521+0000 7fa18de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa190102b60 0x7fa1901007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.521+0000 7fa18de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa190102b60 0x7fa1901007c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:51008/0 (socket says 172.21.15.50:51008) 2024-09-10T10:10:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.521+0000 7fa18de00640 1 -- 172.21.15.50:0/4021732268 learned_addr learned my addr 172.21.15.50:0/4021732268 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.521+0000 7fa18e800640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19010bf90 0x7fa190101240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.521+0000 7fa18d400640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa190103480 0x7fa190100d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.521+0000 7fa18de00640 1 -- 172.21.15.50:0/4021732268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa190103480 msgr2=0x7fa190100d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.521+0000 7fa18de00640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa190103480 0x7fa190100d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.521+0000 7fa18de00640 1 -- 172.21.15.50:0/4021732268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19010bf90 msgr2=0x7fa190101240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.521+0000 7fa18de00640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19010bf90 0x7fa190101240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.521+0000 7fa18de00640 1 -- 172.21.15.50:0/4021732268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1901a67a0 con 0x7fa190102b60 2024-09-10T10:10:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.521+0000 7fa18de00640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa190102b60 0x7fa1901007c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa180004770 tx=0x7fa180003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.522+0000 7fa186a00640 1 -- 172.21.15.50:0/4021732268 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18003f070 con 0x7fa190102b60 2024-09-10T10:10:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.522+0000 7fa186a00640 1 -- 172.21.15.50:0/4021732268 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa180031ca0 con 0x7fa190102b60 2024-09-10T10:10:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.522+0000 7fa186a00640 1 -- 172.21.15.50:0/4021732268 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa180035030 con 0x7fa190102b60 2024-09-10T10:10:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.522+0000 7fa18f200640 1 -- 172.21.15.50:0/4021732268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1901a6a30 con 0x7fa190102b60 2024-09-10T10:10:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.522+0000 7fa18f200640 1 -- 172.21.15.50:0/4021732268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1901a6ec0 con 0x7fa190102b60 2024-09-10T10:10:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.523+0000 7fa18f200640 1 -- 172.21.15.50:0/4021732268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa190062900 con 0x7fa190102b60 2024-09-10T10:10:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.525+0000 7fa186a00640 1 -- 172.21.15.50:0/4021732268 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa180042070 con 0x7fa190102b60 2024-09-10T10:10:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.527+0000 7fa186a00640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa1740a2c90 0x7fa1740a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.527+0000 7fa186a00640 1 -- 172.21.15.50:0/4021732268 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa1800f0180 con 0x7fa190102b60 2024-09-10T10:10:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.527+0000 7fa18d400640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa1740a2c90 0x7fa1740a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.527+0000 7fa186a00640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103] conn(0x7fa1740ade30 0x7fa1740b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.527+0000 7fa186a00640 1 -- 172.21.15.50:0/4021732268 --> [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1740b09a0 con 0x7fa1740ade30 2024-09-10T10:10:03.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.527+0000 7fa186a00640 1 -- 172.21.15.50:0/4021732268 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fa1800f0530 con 0x7fa190102b60 2024-09-10T10:10:03.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.527+0000 7fa18e800640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103] conn(0x7fa1740ade30 0x7fa1740b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:03.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.528+0000 7fa18d400640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa1740a2c90 0x7fa1740a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa190102250 tx=0x7fa17c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:03.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.528+0000 7fa18e800640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103] conn(0x7fa1740ade30 0x7fa1740b02d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:03.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.529+0000 7fa186a00640 1 -- 172.21.15.50:0/4021732268 <== osd.7 v2:172.21.15.84:6816/3709749103 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa1740b09a0 con 0x7fa1740ade30 2024-09-10T10:10:03.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.543+0000 7fa18f200640 1 -- 172.21.15.50:0/4021732268 --> [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa190062d80 con 0x7fa1740ade30 2024-09-10T10:10:03.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.544+0000 7fa186a00640 1 -- 172.21.15.50:0/4021732268 <== osd.7 v2:172.21.15.84:6816/3709749103 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa190062d80 con 0x7fa1740ade30 2024-09-10T10:10:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.544+0000 7fa18f200640 1 -- 172.21.15.50:0/4021732268 >> [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103] conn(0x7fa1740ade30 msgr2=0x7fa1740b02d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.544+0000 7fa18f200640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103] conn(0x7fa1740ade30 0x7fa1740b02d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.544+0000 7fa18f200640 1 -- 172.21.15.50:0/4021732268 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa1740a2c90 msgr2=0x7fa1740a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.544+0000 7fa18f200640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa1740a2c90 0x7fa1740a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa190102250 tx=0x7fa17c005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.544+0000 7fa18f200640 1 -- 172.21.15.50:0/4021732268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa190102b60 msgr2=0x7fa1901007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.544+0000 7fa18f200640 1 --2- 172.21.15.50:0/4021732268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa190102b60 0x7fa1901007c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa180004770 tx=0x7fa180003c10 comp rx=0 tx=0).stop 2024-09-10T10:10:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.544+0000 7fa18e800640 1 -- 172.21.15.50:0/4021732268 reap_dead start 2024-09-10T10:10:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.545+0000 7fa18f200640 1 -- 172.21.15.50:0/4021732268 shutdown_connections 2024-09-10T10:10:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.545+0000 7fa18f200640 1 -- 172.21.15.50:0/4021732268 >> 172.21.15.50:0/4021732268 conn(0x7fa1900fc5c0 msgr2=0x7fa1900fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:03.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.545+0000 7fa18f200640 1 -- 172.21.15.50:0/4021732268 shutdown_connections 2024-09-10T10:10:03.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.545+0000 7fa18f200640 1 -- 172.21.15.50:0/4021732268 wait complete. 2024-09-10T10:10:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.711+0000 7fe70fe00640 1 -- 172.21.15.50:0/2990862549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7101019d0 msgr2=0x7fe710101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.711+0000 7fe70fe00640 1 --2- 172.21.15.50:0/2990862549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7101019d0 0x7fe710101e30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009930 tx=0x7fe6f802a420 comp rx=0 tx=0).stop 2024-09-10T10:10:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.711+0000 7fe70fe00640 1 -- 172.21.15.50:0/2990862549 shutdown_connections 2024-09-10T10:10:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.711+0000 7fe70fe00640 1 --2- 172.21.15.50:0/2990862549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe710102370 0x7fe71010e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.711+0000 7fe70fe00640 1 --2- 172.21.15.50:0/2990862549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7101019d0 0x7fe710101e30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.711+0000 7fe70fe00640 1 --2- 172.21.15.50:0/2990862549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7101079d0 0x7fe710107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.711+0000 7fe70fe00640 1 -- 172.21.15.50:0/2990862549 >> 172.21.15.50:0/2990862549 conn(0x7fe7100fd710 msgr2=0x7fe7100ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.711+0000 7fe70fe00640 1 -- 172.21.15.50:0/2990862549 shutdown_connections 2024-09-10T10:10:03.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.711+0000 7fe70fe00640 1 -- 172.21.15.50:0/2990862549 wait complete. 2024-09-10T10:10:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.712+0000 7fe70fe00640 1 Processor -- start 2024-09-10T10:10:03.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.712+0000 7fe70fe00640 1 -- start start 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe70fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7101019d0 0x7fe7101982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe70fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe710102370 0x7fe710198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe70fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7101079d0 0x7fe71019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe70fe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe710111e20 con 0x7fe7101079d0 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe70fe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe710111ca0 con 0x7fe710102370 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe70fe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe710111fa0 con 0x7fe7101019d0 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe707e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe710102370 0x7fe710198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe70f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7101079d0 0x7fe71019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe707e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe710102370 0x7fe710198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:51026/0 (socket says 172.21.15.50:51026) 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe707e00640 1 -- 172.21.15.50:0/1479543431 learned_addr learned my addr 172.21.15.50:0/1479543431 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe70ea00640 1 --2- 172.21.15.50:0/1479543431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7101019d0 0x7fe7101982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe707e00640 1 -- 172.21.15.50:0/1479543431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7101019d0 msgr2=0x7fe7101982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe707e00640 1 --2- 172.21.15.50:0/1479543431 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7101019d0 0x7fe7101982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:03.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe707e00640 1 -- 172.21.15.50:0/1479543431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7101079d0 msgr2=0x7fe71019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:03.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe707e00640 1 --2- 172.21.15.50:0/1479543431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7101079d0 0x7fe71019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:03.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.713+0000 7fe707e00640 1 -- 172.21.15.50:0/1479543431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71019d2a0 con 0x7fe710102370 2024-09-10T10:10:03.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.714+0000 7fe707e00640 1 --2- 172.21.15.50:0/1479543431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe710102370 0x7fe710198830 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe6f802a940 tx=0x7fe6f8003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:03.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.714+0000 7fe707400640 1 -- 172.21.15.50:0/1479543431 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f803f070 con 0x7fe710102370 2024-09-10T10:10:03.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.714+0000 7fe707400640 1 -- 172.21.15.50:0/1479543431 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6f8031c90 con 0x7fe710102370 2024-09-10T10:10:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.714+0000 7fe70fe00640 1 -- 172.21.15.50:0/1479543431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71019d530 con 0x7fe710102370 2024-09-10T10:10:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.714+0000 7fe707400640 1 -- 172.21.15.50:0/1479543431 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8035030 con 0x7fe710102370 2024-09-10T10:10:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.714+0000 7fe70fe00640 1 -- 172.21.15.50:0/1479543431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7101a4e70 con 0x7fe710102370 2024-09-10T10:10:03.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.715+0000 7fe70fe00640 1 -- 172.21.15.50:0/1479543431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe710062940 con 0x7fe710102370 2024-09-10T10:10:03.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.717+0000 7fe707400640 1 -- 172.21.15.50:0/1479543431 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe6f8042070 con 0x7fe710102370 2024-09-10T10:10:03.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.718+0000 7fe707400640 1 --2- 172.21.15.50:0/1479543431 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6f40a2c10 0x7fe6f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:03.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.719+0000 7fe707400640 1 -- 172.21.15.50:0/1479543431 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe6f80f0410 con 0x7fe710102370 2024-09-10T10:10:03.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.719+0000 7fe70ea00640 1 --2- 172.21.15.50:0/1479543431 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6f40a2c10 0x7fe6f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:03.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.719+0000 7fe707400640 1 --2- 172.21.15.50:0/1479543431 >> [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869] conn(0x7fe6f40adee0 0x7fe6f40b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:03.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.719+0000 7fe707400640 1 -- 172.21.15.50:0/1479543431 --> [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6f8038e90 con 0x7fe6f40adee0 2024-09-10T10:10:03.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.719+0000 7fe707400640 1 -- 172.21.15.50:0/1479543431 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fe6f80f07c0 con 0x7fe710102370 2024-09-10T10:10:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.719+0000 7fe70f400640 1 --2- 172.21.15.50:0/1479543431 >> [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869] conn(0x7fe6f40adee0 0x7fe6f40b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.720+0000 7fe70ea00640 1 --2- 172.21.15.50:0/1479543431 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6f40a2c10 0x7fe6f40a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe700009ae0 tx=0x7fe700005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:03.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.720+0000 7fe70f400640 1 --2- 172.21.15.50:0/1479543431 >> [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869] conn(0x7fe6f40adee0 0x7fe6f40b0380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.721+0000 7fe707400640 1 -- 172.21.15.50:0/1479543431 <== osd.6 v2:172.21.15.50:6818/335559869 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6f8038e90 con 0x7fe6f40adee0 2024-09-10T10:10:03.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.735+0000 7fe70fe00640 1 -- 172.21.15.50:0/1479543431 --> [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe710062dc0 con 0x7fe6f40adee0 2024-09-10T10:10:03.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.736+0000 7fe707400640 1 -- 172.21.15.50:0/1479543431 <== osd.6 v2:172.21.15.50:6818/335559869 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe710062dc0 con 0x7fe6f40adee0 2024-09-10T10:10:03.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.736+0000 7fe70fe00640 1 -- 172.21.15.50:0/1479543431 >> [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869] conn(0x7fe6f40adee0 msgr2=0x7fe6f40b0380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:03.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.736+0000 7fe70fe00640 1 --2- 172.21.15.50:0/1479543431 >> [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869] conn(0x7fe6f40adee0 0x7fe6f40b0380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:03.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.736+0000 7fe70fe00640 1 -- 172.21.15.50:0/1479543431 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6f40a2c10 msgr2=0x7fe6f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:03.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.736+0000 7fe70fe00640 1 --2- 172.21.15.50:0/1479543431 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6f40a2c10 0x7fe6f40a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe700009ae0 tx=0x7fe700005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:03.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.736+0000 7fe70fe00640 1 -- 172.21.15.50:0/1479543431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe710102370 msgr2=0x7fe710198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:03.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.736+0000 7fe70fe00640 1 --2- 172.21.15.50:0/1479543431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe710102370 0x7fe710198830 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe6f802a940 tx=0x7fe6f8003b20 comp rx=0 tx=0).stop 2024-09-10T10:10:03.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.736+0000 7fe70f400640 1 -- 172.21.15.50:0/1479543431 reap_dead start 2024-09-10T10:10:03.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.736+0000 7fe70fe00640 1 -- 172.21.15.50:0/1479543431 shutdown_connections 2024-09-10T10:10:03.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.736+0000 7fe70fe00640 1 -- 172.21.15.50:0/1479543431 >> 172.21.15.50:0/1479543431 conn(0x7fe7100fd710 msgr2=0x7fe7100fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:03.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.737+0000 7fe70fe00640 1 -- 172.21.15.50:0/1479543431 shutdown_connections 2024-09-10T10:10:03.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.737+0000 7fe70fe00640 1 -- 172.21.15.50:0/1479543431 wait complete. 2024-09-10T10:10:04.002 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:03 smithi050 ceph-mon[30354]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:04.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:03 smithi189 ceph-mon[34999]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:04.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:03 smithi084 ceph-mon[34812]: pgmap v357: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:04.770 INFO:teuthology.orchestra.run.smithi050.stdout:55834574935 2024-09-10T10:10:04.770 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T10:10:04.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.419+0000 7fc0b7e00640 1 -- 172.21.15.50:0/313788173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0b01049a0 msgr2=0x7fc0b01089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:04.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.419+0000 7fc0b7e00640 1 --2- 172.21.15.50:0/313788173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0b01049a0 0x7fc0b01089f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009900 tx=0x7fc09c02a410 comp rx=0 tx=0).stop 2024-09-10T10:10:04.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.419+0000 7fc0b7e00640 1 -- 172.21.15.50:0/313788173 shutdown_connections 2024-09-10T10:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.419+0000 7fc0b7e00640 1 --2- 172.21.15.50:0/313788173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0b0109120 0x7fc0b0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.419+0000 7fc0b7e00640 1 --2- 172.21.15.50:0/313788173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0b01049a0 0x7fc0b01089f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.419+0000 7fc0b7e00640 1 --2- 172.21.15.50:0/313788173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0b0103ff0 0x7fc0b01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.419+0000 7fc0b7e00640 1 -- 172.21.15.50:0/313788173 >> 172.21.15.50:0/313788173 conn(0x7fc0b00ffa90 msgr2=0x7fc0b0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.419+0000 7fc0b7e00640 1 -- 172.21.15.50:0/313788173 shutdown_connections 2024-09-10T10:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.419+0000 7fc0b7e00640 1 -- 172.21.15.50:0/313788173 wait complete. 2024-09-10T10:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.420+0000 7fc0b7e00640 1 Processor -- start 2024-09-10T10:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.420+0000 7fc0b7e00640 1 -- start start 2024-09-10T10:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0b0103ff0 0x7fc0b019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0b01049a0 0x7fc0b019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0b0109120 0x7fc0b019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b7e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b0114170 con 0x7fc0b0109120 2024-09-10T10:10:04.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b7e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b0113ff0 con 0x7fc0b0103ff0 2024-09-10T10:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b7e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b01142f0 con 0x7fc0b01049a0 2024-09-10T10:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0b0103ff0 0x7fc0b019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0b0103ff0 0x7fc0b019a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50978/0 (socket says 172.21.15.50:50978) 2024-09-10T10:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b5400640 1 -- 172.21.15.50:0/3442589178 learned_addr learned my addr 172.21.15.50:0/3442589178 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b5e00640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0b0109120 0x7fc0b019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b4a00640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0b01049a0 0x7fc0b019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b5400640 1 -- 172.21.15.50:0/3442589178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0b01049a0 msgr2=0x7fc0b019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b5400640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0b01049a0 0x7fc0b019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b5400640 1 -- 172.21.15.50:0/3442589178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0b0109120 msgr2=0x7fc0b019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b5400640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0b0109120 0x7fc0b019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.421+0000 7fc0b5400640 1 -- 172.21.15.50:0/3442589178 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b019f5e0 con 0x7fc0b0103ff0 2024-09-10T10:10:04.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.422+0000 7fc0b5400640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0b0103ff0 0x7fc0b019a630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400d950 tx=0x7fc0a400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.422+0000 7fc0ae000640 1 -- 172.21.15.50:0/3442589178 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4017030 con 0x7fc0b0103ff0 2024-09-10T10:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.422+0000 7fc0ae000640 1 -- 172.21.15.50:0/3442589178 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0a4004020 con 0x7fc0b0103ff0 2024-09-10T10:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.422+0000 7fc0ae000640 1 -- 172.21.15.50:0/3442589178 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a40047a0 con 0x7fc0b0103ff0 2024-09-10T10:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.422+0000 7fc0b7e00640 1 -- 172.21.15.50:0/3442589178 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b019f8d0 con 0x7fc0b0103ff0 2024-09-10T10:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.422+0000 7fc0b7e00640 1 -- 172.21.15.50:0/3442589178 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b01a71b0 con 0x7fc0b0103ff0 2024-09-10T10:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.423+0000 7fc0b7e00640 1 -- 172.21.15.50:0/3442589178 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0b0062980 con 0x7fc0b0103ff0 2024-09-10T10:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.425+0000 7fc0ae000640 1 -- 172.21.15.50:0/3442589178 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc0a40041d0 con 0x7fc0b0103ff0 2024-09-10T10:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.426+0000 7fc0ae000640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc0980a2c90 0x7fc0980a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.427+0000 7fc0ae000640 1 -- 172.21.15.50:0/3442589178 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fc0a40cf550 con 0x7fc0b0103ff0 2024-09-10T10:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.427+0000 7fc0b4a00640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc0980a2c90 0x7fc0980a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.427+0000 7fc0ae000640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226] conn(0x7fc0980adf60 0x7fc0980b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.427+0000 7fc0ae000640 1 -- 172.21.15.50:0/3442589178 --> [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0980b0ad0 con 0x7fc0980adf60 2024-09-10T10:10:04.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.427+0000 7fc0ae000640 1 -- 172.21.15.50:0/3442589178 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fc0a40cf900 con 0x7fc0b0103ff0 2024-09-10T10:10:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.427+0000 7fc0b5e00640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226] conn(0x7fc0980adf60 0x7fc0980b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.428+0000 7fc0b4a00640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc0980a2c90 0x7fc0980a5150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc09c000c00 tx=0x7fc09c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.428+0000 7fc0b5e00640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226] conn(0x7fc0980adf60 0x7fc0980b0400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.429+0000 7fc0ae000640 1 -- 172.21.15.50:0/3442589178 <== osd.9 v2:172.21.15.50:6826/471324226 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc0980b0ad0 con 0x7fc0980adf60 2024-09-10T10:10:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.444+0000 7fc0b7e00640 1 -- 172.21.15.50:0/3442589178 --> [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc0b0062e00 con 0x7fc0980adf60 2024-09-10T10:10:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.444+0000 7fc0ae000640 1 -- 172.21.15.50:0/3442589178 <== osd.9 v2:172.21.15.50:6826/471324226 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc0b0062e00 con 0x7fc0980adf60 2024-09-10T10:10:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.444+0000 7fc0b7e00640 1 -- 172.21.15.50:0/3442589178 >> [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226] conn(0x7fc0980adf60 msgr2=0x7fc0980b0400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:04.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.444+0000 7fc0b7e00640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226] conn(0x7fc0980adf60 0x7fc0980b0400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.445+0000 7fc0b7e00640 1 -- 172.21.15.50:0/3442589178 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc0980a2c90 msgr2=0x7fc0980a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.445+0000 7fc0b7e00640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc0980a2c90 0x7fc0980a5150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc09c000c00 tx=0x7fc09c005b50 comp rx=0 tx=0).stop 2024-09-10T10:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.445+0000 7fc0b7e00640 1 -- 172.21.15.50:0/3442589178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0b0103ff0 msgr2=0x7fc0b019a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.445+0000 7fc0b7e00640 1 --2- 172.21.15.50:0/3442589178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0b0103ff0 0x7fc0b019a630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400d950 tx=0x7fc0a400de10 comp rx=0 tx=0).stop 2024-09-10T10:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.445+0000 7fc0b5e00640 1 -- 172.21.15.50:0/3442589178 reap_dead start 2024-09-10T10:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.445+0000 7fc0b7e00640 1 -- 172.21.15.50:0/3442589178 shutdown_connections 2024-09-10T10:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.445+0000 7fc0b7e00640 1 -- 172.21.15.50:0/3442589178 >> 172.21.15.50:0/3442589178 conn(0x7fc0b00ffa90 msgr2=0x7fc0b0100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.445+0000 7fc0b7e00640 1 -- 172.21.15.50:0/3442589178 shutdown_connections 2024-09-10T10:10:04.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:03.445+0000 7fc0b7e00640 1 -- 172.21.15.50:0/3442589178 wait complete. 2024-09-10T10:10:05.684 INFO:teuthology.orchestra.run.smithi050.stdout:283467841578 2024-09-10T10:10:05.685 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T10:10:05.898 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:05 smithi050 ceph-mon[30354]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T10:10:06.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:05 smithi189 ceph-mon[34999]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T10:10:06.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:05 smithi084 ceph-mon[34812]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-10T10:10:06.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.896+0000 7f4280000640 1 -- 172.21.15.50:0/1362542397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42781049c0 msgr2=0x7f4278108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:06.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.896+0000 7f4280000640 1 --2- 172.21.15.50:0/1362542397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42781049c0 0x7f4278108a10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4264009900 tx=0x7f426402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:10:06.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.896+0000 7f4280000640 1 -- 172.21.15.50:0/1362542397 shutdown_connections 2024-09-10T10:10:06.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.896+0000 7f4280000640 1 --2- 172.21.15.50:0/1362542397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4278109140 0x7f4278110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:06.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.896+0000 7f4280000640 1 --2- 172.21.15.50:0/1362542397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42781049c0 0x7f4278108a10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:06.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.896+0000 7f4280000640 1 --2- 172.21.15.50:0/1362542397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4278104010 0x7f42781043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:06.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.896+0000 7f4280000640 1 -- 172.21.15.50:0/1362542397 >> 172.21.15.50:0/1362542397 conn(0x7f42780ffa50 msgr2=0x7f4278101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:06.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.896+0000 7f4280000640 1 -- 172.21.15.50:0/1362542397 shutdown_connections 2024-09-10T10:10:06.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.897+0000 7f4280000640 1 -- 172.21.15.50:0/1362542397 wait complete. 2024-09-10T10:10:06.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.898+0000 7f4280000640 1 Processor -- start 2024-09-10T10:10:06.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.898+0000 7f4280000640 1 -- start start 2024-09-10T10:10:06.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.899+0000 7f4280000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4278104010 0x7f427819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:06.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.899+0000 7f4280000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42781049c0 0x7f427819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:06.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.899+0000 7f4280000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4278109140 0x7f427819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:06.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.899+0000 7f4280000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f42781141b0 con 0x7f4278109140 2024-09-10T10:10:06.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.899+0000 7f4280000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4278114030 con 0x7f42781049c0 2024-09-10T10:10:06.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.899+0000 7f4280000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4278114330 con 0x7f4278104010 2024-09-10T10:10:06.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.899+0000 7f427d600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4278104010 0x7f427819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:06.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.899+0000 7f427cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42781049c0 0x7f427819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:06.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.899+0000 7f427d600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4278104010 0x7f427819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:38284/0 (socket says 172.21.15.50:38284) 2024-09-10T10:10:06.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.899+0000 7f427d600640 1 -- 172.21.15.50:0/1337371025 learned_addr learned my addr 172.21.15.50:0/1337371025 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:06.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.899+0000 7f427e000640 1 --2- 172.21.15.50:0/1337371025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4278109140 0x7f427819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:06.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.900+0000 7f427d600640 1 -- 172.21.15.50:0/1337371025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42781049c0 msgr2=0x7f427819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:06.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.900+0000 7f427d600640 1 --2- 172.21.15.50:0/1337371025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42781049c0 0x7f427819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:06.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.900+0000 7f427d600640 1 -- 172.21.15.50:0/1337371025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4278109140 msgr2=0x7f427819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:06.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.900+0000 7f427d600640 1 --2- 172.21.15.50:0/1337371025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4278109140 0x7f427819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:06.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.900+0000 7f427d600640 1 -- 172.21.15.50:0/1337371025 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427819f660 con 0x7f4278104010 2024-09-10T10:10:06.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.900+0000 7f427d600640 1 --2- 172.21.15.50:0/1337371025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4278104010 0x7f427819a6b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f426c00d950 tx=0x7f426c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:06.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.900+0000 7f4276000640 1 -- 172.21.15.50:0/1337371025 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c017030 con 0x7f4278104010 2024-09-10T10:10:06.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.900+0000 7f4276000640 1 -- 172.21.15.50:0/1337371025 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f426c004020 con 0x7f4278104010 2024-09-10T10:10:06.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.900+0000 7f4276000640 1 -- 172.21.15.50:0/1337371025 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c0047a0 con 0x7f4278104010 2024-09-10T10:10:06.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.901+0000 7f4280000640 1 -- 172.21.15.50:0/1337371025 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427819f950 con 0x7f4278104010 2024-09-10T10:10:06.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.901+0000 7f4280000640 1 -- 172.21.15.50:0/1337371025 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42781a7230 con 0x7f4278104010 2024-09-10T10:10:06.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.901+0000 7f4280000640 1 -- 172.21.15.50:0/1337371025 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4278062900 con 0x7f4278104010 2024-09-10T10:10:06.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.905+0000 7f4276000640 1 -- 172.21.15.50:0/1337371025 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f426c0041d0 con 0x7f4278104010 2024-09-10T10:10:06.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.906+0000 7f4276000640 1 --2- 172.21.15.50:0/1337371025 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f42600a2c10 0x7f42600a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:06.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.907+0000 7f4276000640 1 -- 172.21.15.50:0/1337371025 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f426c0cf550 con 0x7f4278104010 2024-09-10T10:10:06.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.907+0000 7f427cc00640 1 --2- 172.21.15.50:0/1337371025 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f42600a2c10 0x7f42600a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:06.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.907+0000 7f4276000640 1 --2- 172.21.15.50:0/1337371025 >> [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029] conn(0x7f42600adee0 0x7f42600b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:06.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.907+0000 7f4276000640 1 -- 172.21.15.50:0/1337371025 --> [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42600b0a50 con 0x7f42600adee0 2024-09-10T10:10:06.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.907+0000 7f4276000640 1 -- 172.21.15.50:0/1337371025 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f426c0cf990 con 0x7f4278104010 2024-09-10T10:10:06.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.907+0000 7f427e000640 1 --2- 172.21.15.50:0/1337371025 >> [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029] conn(0x7f42600adee0 0x7f42600b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:06.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.908+0000 7f427cc00640 1 --2- 172.21.15.50:0/1337371025 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f42600a2c10 0x7f42600a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4264000c00 tx=0x7f4264005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:06.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.908+0000 7f427e000640 1 --2- 172.21.15.50:0/1337371025 >> [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029] conn(0x7f42600adee0 0x7f42600b0380 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:06.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.909+0000 7f4276000640 1 -- 172.21.15.50:0/1337371025 <== osd.4 v2:172.21.15.84:6808/361197029 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42600b0a50 con 0x7f42600adee0 2024-09-10T10:10:06.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.923+0000 7f4280000640 1 -- 172.21.15.50:0/1337371025 --> [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4278062d80 con 0x7f42600adee0 2024-09-10T10:10:06.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.924+0000 7f4276000640 1 -- 172.21.15.50:0/1337371025 <== osd.4 v2:172.21.15.84:6808/361197029 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4278062d80 con 0x7f42600adee0 2024-09-10T10:10:06.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.924+0000 7f4280000640 1 -- 172.21.15.50:0/1337371025 >> [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029] conn(0x7f42600adee0 msgr2=0x7f42600b0380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:06.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.924+0000 7f4280000640 1 --2- 172.21.15.50:0/1337371025 >> [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029] conn(0x7f42600adee0 0x7f42600b0380 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:06.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.925+0000 7f4280000640 1 -- 172.21.15.50:0/1337371025 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f42600a2c10 msgr2=0x7f42600a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:06.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.925+0000 7f4280000640 1 --2- 172.21.15.50:0/1337371025 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f42600a2c10 0x7f42600a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4264000c00 tx=0x7f4264005b50 comp rx=0 tx=0).stop 2024-09-10T10:10:06.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.925+0000 7f4280000640 1 -- 172.21.15.50:0/1337371025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4278104010 msgr2=0x7f427819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:06.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.925+0000 7f4280000640 1 --2- 172.21.15.50:0/1337371025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4278104010 0x7f427819a6b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f426c00d950 tx=0x7f426c00de10 comp rx=0 tx=0).stop 2024-09-10T10:10:06.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.925+0000 7f427e000640 1 -- 172.21.15.50:0/1337371025 reap_dead start 2024-09-10T10:10:06.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.925+0000 7f4280000640 1 -- 172.21.15.50:0/1337371025 shutdown_connections 2024-09-10T10:10:06.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.925+0000 7f4280000640 1 -- 172.21.15.50:0/1337371025 >> 172.21.15.50:0/1337371025 conn(0x7f42780ffa50 msgr2=0x7f4278100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:06.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.925+0000 7f4280000640 1 -- 172.21.15.50:0/1337371025 shutdown_connections 2024-09-10T10:10:06.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:05.925+0000 7f4280000640 1 -- 172.21.15.50:0/1337371025 wait complete. 2024-09-10T10:10:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.291+0000 7f1944800640 1 -- 172.21.15.50:0/3799117669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f193c077040 msgr2=0x7f193c1124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.291+0000 7f1944800640 1 --2- 172.21.15.50:0/3799117669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f193c077040 0x7f193c1124f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f192c009900 tx=0x7f192c02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:10:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.292+0000 7f1944800640 1 -- 172.21.15.50:0/3799117669 shutdown_connections 2024-09-10T10:10:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.292+0000 7f1944800640 1 --2- 172.21.15.50:0/3799117669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193c112a30 0x7f193c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.292+0000 7f1944800640 1 --2- 172.21.15.50:0/3799117669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f193c077040 0x7f193c1124f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.292+0000 7f1944800640 1 --2- 172.21.15.50:0/3799117669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f193c076720 0x7f193c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.292+0000 7f1944800640 1 -- 172.21.15.50:0/3799117669 >> 172.21.15.50:0/3799117669 conn(0x7f193c0ffa90 msgr2=0x7f193c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.292+0000 7f1944800640 1 -- 172.21.15.50:0/3799117669 shutdown_connections 2024-09-10T10:10:07.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.292+0000 7f1944800640 1 -- 172.21.15.50:0/3799117669 wait complete. 2024-09-10T10:10:07.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.293+0000 7f1944800640 1 Processor -- start 2024-09-10T10:10:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.293+0000 7f1944800640 1 -- start start 2024-09-10T10:10:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.293+0000 7f1944800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f193c076720 0x7f193c1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.293+0000 7f1944800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f193c077040 0x7f193c1a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.293+0000 7f1944800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193c112a30 0x7f193c19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.293+0000 7f1944800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f193c1185a0 con 0x7f193c112a30 2024-09-10T10:10:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.293+0000 7f1944800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f193c118420 con 0x7f193c077040 2024-09-10T10:10:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.293+0000 7f1944800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f193c118720 con 0x7f193c076720 2024-09-10T10:10:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.293+0000 7f1941400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f193c077040 0x7f193c1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.293+0000 7f1941400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f193c077040 0x7f193c1a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:38396/0 (socket says 172.21.15.50:38396) 2024-09-10T10:10:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.293+0000 7f1941400640 1 -- 172.21.15.50:0/2211757953 learned_addr learned my addr 172.21.15.50:0/2211757953 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.293+0000 7f1941e00640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f193c076720 0x7f193c1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:07.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.294+0000 7f1942800640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193c112a30 0x7f193c19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:07.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.294+0000 7f1941400640 1 -- 172.21.15.50:0/2211757953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f193c076720 msgr2=0x7f193c1a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:07.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.294+0000 7f1941400640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f193c076720 0x7f193c1a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:07.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.294+0000 7f1941400640 1 -- 172.21.15.50:0/2211757953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193c112a30 msgr2=0x7f193c19e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:07.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.294+0000 7f1941400640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193c112a30 0x7f193c19e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:07.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.294+0000 7f1941400640 1 -- 172.21.15.50:0/2211757953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193c19efc0 con 0x7f193c077040 2024-09-10T10:10:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.294+0000 7f1941400640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f193c077040 0x7f193c1a4c10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f192c006010 tx=0x7f192c0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.295+0000 7f1936a00640 1 -- 172.21.15.50:0/2211757953 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c03f030 con 0x7f193c077040 2024-09-10T10:10:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.295+0000 7f1936a00640 1 -- 172.21.15.50:0/2211757953 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f192c003ce0 con 0x7f193c077040 2024-09-10T10:10:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.295+0000 7f1936a00640 1 -- 172.21.15.50:0/2211757953 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c035070 con 0x7f193c077040 2024-09-10T10:10:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.295+0000 7f1944800640 1 -- 172.21.15.50:0/2211757953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193c19f250 con 0x7f193c077040 2024-09-10T10:10:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.295+0000 7f1944800640 1 -- 172.21.15.50:0/2211757953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f193c1ab5a0 con 0x7f193c077040 2024-09-10T10:10:07.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.296+0000 7f1944800640 1 -- 172.21.15.50:0/2211757953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f193c1149f0 con 0x7f193c077040 2024-09-10T10:10:07.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.298+0000 7f1936a00640 1 -- 172.21.15.50:0/2211757953 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f192c042030 con 0x7f193c077040 2024-09-10T10:10:07.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.299+0000 7f1936a00640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19240a2c90 0x7f19240a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:07.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.299+0000 7f1936a00640 1 -- 172.21.15.50:0/2211757953 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f192c0f03a0 con 0x7f193c077040 2024-09-10T10:10:07.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.300+0000 7f1941e00640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19240a2c90 0x7f19240a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:07.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.300+0000 7f1936a00640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908] conn(0x7f19240adf60 0x7f19240b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:07.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.300+0000 7f1936a00640 1 -- 172.21.15.50:0/2211757953 --> [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19240b0ad0 con 0x7f19240adf60 2024-09-10T10:10:07.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.300+0000 7f1936a00640 1 -- 172.21.15.50:0/2211757953 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f192c0f0750 con 0x7f193c077040 2024-09-10T10:10:07.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.300+0000 7f1942800640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908] conn(0x7f19240adf60 0x7f19240b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:07.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.300+0000 7f1941e00640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19240a2c90 0x7f19240a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f193c19f9d0 tx=0x7f193000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:07.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.301+0000 7f1942800640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908] conn(0x7f19240adf60 0x7f19240b0400 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:07.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.302+0000 7f1936a00640 1 -- 172.21.15.50:0/2211757953 <== osd.2 v2:172.21.15.189:6800/3611073908 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f19240b0ad0 con 0x7f19240adf60 2024-09-10T10:10:07.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.316+0000 7f1944800640 1 -- 172.21.15.50:0/2211757953 --> [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f193c077e60 con 0x7f19240adf60 2024-09-10T10:10:07.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.317+0000 7f1936a00640 1 -- 172.21.15.50:0/2211757953 <== osd.2 v2:172.21.15.189:6800/3611073908 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f193c077e60 con 0x7f19240adf60 2024-09-10T10:10:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.317+0000 7f1944800640 1 -- 172.21.15.50:0/2211757953 >> [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908] conn(0x7f19240adf60 msgr2=0x7f19240b0400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.317+0000 7f1944800640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908] conn(0x7f19240adf60 0x7f19240b0400 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.317+0000 7f1944800640 1 -- 172.21.15.50:0/2211757953 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19240a2c90 msgr2=0x7f19240a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.317+0000 7f1944800640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19240a2c90 0x7f19240a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f193c19f9d0 tx=0x7f193000b390 comp rx=0 tx=0).stop 2024-09-10T10:10:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.317+0000 7f1944800640 1 -- 172.21.15.50:0/2211757953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f193c077040 msgr2=0x7f193c1a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.317+0000 7f1944800640 1 --2- 172.21.15.50:0/2211757953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f193c077040 0x7f193c1a4c10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f192c006010 tx=0x7f192c0042f0 comp rx=0 tx=0).stop 2024-09-10T10:10:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.317+0000 7f1942800640 1 -- 172.21.15.50:0/2211757953 reap_dead start 2024-09-10T10:10:07.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.318+0000 7f1944800640 1 -- 172.21.15.50:0/2211757953 shutdown_connections 2024-09-10T10:10:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.318+0000 7f1944800640 1 -- 172.21.15.50:0/2211757953 >> 172.21.15.50:0/2211757953 conn(0x7f193c0ffa90 msgr2=0x7f193c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.318+0000 7f1944800640 1 -- 172.21.15.50:0/2211757953 shutdown_connections 2024-09-10T10:10:07.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:07.318+0000 7f1944800640 1 -- 172.21.15.50:0/2211757953 wait complete. 2024-09-10T10:10:07.459 INFO:teuthology.orchestra.run.smithi050.stdout:223338299444 2024-09-10T10:10:07.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T10:10:07.893 INFO:teuthology.orchestra.run.smithi050.stdout:146028888134 2024-09-10T10:10:07.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T10:10:08.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:07 smithi084 ceph-mon[34812]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-10T10:10:08.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:07 smithi050 ceph-mon[30354]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-10T10:10:08.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:07 smithi189 ceph-mon[34999]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-10T10:10:08.407 INFO:teuthology.orchestra.run.smithi050.stdout:201863462972 2024-09-10T10:10:08.408 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T10:10:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.936+0000 7f9746400640 1 -- 172.21.15.50:0/1592102085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9740108f60 msgr2=0x7f9740110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.936+0000 7f9746400640 1 --2- 172.21.15.50:0/1592102085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9740108f60 0x7f9740110ae0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9738009ca0 tx=0x7f973802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:10:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.937+0000 7f9746400640 1 -- 172.21.15.50:0/1592102085 shutdown_connections 2024-09-10T10:10:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.937+0000 7f9746400640 1 --2- 172.21.15.50:0/1592102085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9740108f60 0x7f9740110ae0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.937+0000 7f9746400640 1 --2- 172.21.15.50:0/1592102085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97401047e0 0x7f9740108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.937+0000 7f9746400640 1 --2- 172.21.15.50:0/1592102085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9740103e30 0x7f9740104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.937+0000 7f9746400640 1 -- 172.21.15.50:0/1592102085 >> 172.21.15.50:0/1592102085 conn(0x7f97400ff910 msgr2=0x7f9740101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:08.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.937+0000 7f9746400640 1 -- 172.21.15.50:0/1592102085 shutdown_connections 2024-09-10T10:10:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.937+0000 7f9746400640 1 -- 172.21.15.50:0/1592102085 wait complete. 2024-09-10T10:10:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.938+0000 7f9746400640 1 Processor -- start 2024-09-10T10:10:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.938+0000 7f9746400640 1 -- start start 2024-09-10T10:10:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.938+0000 7f9746400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9740103e30 0x7f974019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.938+0000 7f9746400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97401047e0 0x7f974019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.938+0000 7f9746400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9740108f60 0x7f974019ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.938+0000 7f9746400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9740114010 con 0x7f9740108f60 2024-09-10T10:10:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.938+0000 7f9746400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9740113e90 con 0x7f97401047e0 2024-09-10T10:10:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.938+0000 7f9746400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9740114190 con 0x7f9740103e30 2024-09-10T10:10:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.939+0000 7f9745a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9740108f60 0x7f974019ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.939+0000 7f9745a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9740108f60 0x7f974019ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58378/0 (socket says 172.21.15.50:58378) 2024-09-10T10:10:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.939+0000 7f9745a00640 1 -- 172.21.15.50:0/3370968112 learned_addr learned my addr 172.21.15.50:0/3370968112 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.939+0000 7f9745000640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9740103e30 0x7f974019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.939+0000 7f973fe00640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97401047e0 0x7f974019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.939+0000 7f9745a00640 1 -- 172.21.15.50:0/3370968112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9740103e30 msgr2=0x7f974019a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.939+0000 7f9745a00640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9740103e30 0x7f974019a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.939+0000 7f9745a00640 1 -- 172.21.15.50:0/3370968112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97401047e0 msgr2=0x7f974019a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.939+0000 7f9745a00640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97401047e0 0x7f974019a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.939+0000 7f9745a00640 1 -- 172.21.15.50:0/3370968112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974019f3e0 con 0x7f9740108f60 2024-09-10T10:10:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.939+0000 7f9745000640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9740103e30 0x7f974019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.939+0000 7f973fe00640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97401047e0 0x7f974019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.940+0000 7f9745a00640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9740108f60 0x7f974019ed00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9738005e30 tx=0x7f9738003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.940+0000 7f973d600640 1 -- 172.21.15.50:0/3370968112 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738031650 con 0x7f9740108f60 2024-09-10T10:10:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.940+0000 7f973d600640 1 -- 172.21.15.50:0/3370968112 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97380317f0 con 0x7f9740108f60 2024-09-10T10:10:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.940+0000 7f9746400640 1 -- 172.21.15.50:0/3370968112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974019f670 con 0x7f9740108f60 2024-09-10T10:10:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.940+0000 7f973d600640 1 -- 172.21.15.50:0/3370968112 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973802f9d0 con 0x7f9740108f60 2024-09-10T10:10:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.940+0000 7f9746400640 1 -- 172.21.15.50:0/3370968112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97401a6fb0 con 0x7f9740108f60 2024-09-10T10:10:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.941+0000 7f9746400640 1 -- 172.21.15.50:0/3370968112 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9740100ec0 con 0x7f9740108f60 2024-09-10T10:10:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.943+0000 7f973d600640 1 -- 172.21.15.50:0/3370968112 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f973802fb70 con 0x7f9740108f60 2024-09-10T10:10:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.944+0000 7f973d600640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97280a2c10 0x7f97280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.945+0000 7f973d600640 1 -- 172.21.15.50:0/3370968112 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f97380f0a80 con 0x7f9740108f60 2024-09-10T10:10:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.945+0000 7f9745000640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97280a2c10 0x7f97280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.945+0000 7f973d600640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864] conn(0x7f97280adee0 0x7f97280b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.945+0000 7f973d600640 1 -- 172.21.15.50:0/3370968112 --> [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f973800b150 con 0x7f97280adee0 2024-09-10T10:10:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.945+0000 7f973d600640 1 -- 172.21.15.50:0/3370968112 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f97380f0e30 con 0x7f9740108f60 2024-09-10T10:10:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.945+0000 7f973fe00640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864] conn(0x7f97280adee0 0x7f97280b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.945+0000 7f9745000640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97280a2c10 0x7f97280a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9734009fc0 tx=0x7f9734005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.946+0000 7f973fe00640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864] conn(0x7f97280adee0 0x7f97280b0380 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.947+0000 7f973d600640 1 -- 172.21.15.50:0/3370968112 <== osd.0 v2:172.21.15.50:6802/386458864 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f973800b150 con 0x7f97280adee0 2024-09-10T10:10:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.961+0000 7f9746400640 1 -- 172.21.15.50:0/3370968112 --> [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9740105310 con 0x7f97280adee0 2024-09-10T10:10:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.961+0000 7f973d600640 1 -- 172.21.15.50:0/3370968112 <== osd.0 v2:172.21.15.50:6802/386458864 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9740105310 con 0x7f97280adee0 2024-09-10T10:10:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.962+0000 7f9746400640 1 -- 172.21.15.50:0/3370968112 >> [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864] conn(0x7f97280adee0 msgr2=0x7f97280b0380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.962+0000 7f9746400640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864] conn(0x7f97280adee0 0x7f97280b0380 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.962+0000 7f9746400640 1 -- 172.21.15.50:0/3370968112 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97280a2c10 msgr2=0x7f97280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.962+0000 7f9746400640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97280a2c10 0x7f97280a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9734009fc0 tx=0x7f9734005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.962+0000 7f9746400640 1 -- 172.21.15.50:0/3370968112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9740108f60 msgr2=0x7f974019ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.962+0000 7f9746400640 1 --2- 172.21.15.50:0/3370968112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9740108f60 0x7f974019ed00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9738005e30 tx=0x7f9738003d00 comp rx=0 tx=0).stop 2024-09-10T10:10:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.962+0000 7f9745a00640 1 -- 172.21.15.50:0/3370968112 reap_dead start 2024-09-10T10:10:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.962+0000 7f9746400640 1 -- 172.21.15.50:0/3370968112 shutdown_connections 2024-09-10T10:10:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.962+0000 7f9746400640 1 -- 172.21.15.50:0/3370968112 >> 172.21.15.50:0/3370968112 conn(0x7f97400ff910 msgr2=0x7f9740100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.962+0000 7f9746400640 1 -- 172.21.15.50:0/3370968112 shutdown_connections 2024-09-10T10:10:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:01.962+0000 7f9746400640 1 -- 172.21.15.50:0/3370968112 wait complete. 2024-09-10T10:10:09.305 INFO:teuthology.orchestra.run.smithi050.stdout:34359738461 2024-09-10T10:10:09.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T10:10:09.645 INFO:teuthology.orchestra.run.smithi050.stdout:77309411411 2024-09-10T10:10:09.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T10:10:09.755 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:09.760 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:09.796 INFO:teuthology.orchestra.run.smithi050.stdout:335007449119 2024-09-10T10:10:09.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T10:10:09.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:09 smithi050 ceph-mon[30354]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-10T10:10:10.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:09 smithi084 ceph-mon[34812]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-10T10:10:10.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:09 smithi189 ceph-mon[34999]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-10T10:10:10.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.786+0000 7f526c200640 1 -- 172.21.15.50:0/483153366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5264109140 msgr2=0x7f5264110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:10.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.786+0000 7f526c200640 1 --2- 172.21.15.50:0/483153366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5264109140 0x7f5264110cc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f525c009ca0 tx=0x7f525c02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.786+0000 7f526c200640 1 -- 172.21.15.50:0/483153366 shutdown_connections 2024-09-10T10:10:10.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.786+0000 7f526c200640 1 --2- 172.21.15.50:0/483153366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5264109140 0x7f5264110cc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.786+0000 7f526c200640 1 --2- 172.21.15.50:0/483153366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52641049c0 0x7f5264108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.786+0000 7f526c200640 1 --2- 172.21.15.50:0/483153366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264104010 0x7f52641043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.786+0000 7f526c200640 1 -- 172.21.15.50:0/483153366 >> 172.21.15.50:0/483153366 conn(0x7f52640ffa50 msgr2=0x7f5264101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:10.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.786+0000 7f526c200640 1 -- 172.21.15.50:0/483153366 shutdown_connections 2024-09-10T10:10:10.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.786+0000 7f526c200640 1 -- 172.21.15.50:0/483153366 wait complete. 2024-09-10T10:10:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.787+0000 7f526c200640 1 Processor -- start 2024-09-10T10:10:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.787+0000 7f526c200640 1 -- start start 2024-09-10T10:10:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.788+0000 7f526c200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5264104010 0x7f526419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.788+0000 7f526c200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52641049c0 0x7f526419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.788+0000 7f526c200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264109140 0x7f526419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.788+0000 7f526c200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5264114170 con 0x7f52641049c0 2024-09-10T10:10:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.788+0000 7f526c200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5264113ff0 con 0x7f5264109140 2024-09-10T10:10:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.788+0000 7f526c200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52641142f0 con 0x7f5264104010 2024-09-10T10:10:10.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.788+0000 7f5268e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52641049c0 0x7f526419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.788+0000 7f526a200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264109140 0x7f526419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.788+0000 7f5268e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52641049c0 0x7f526419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38600/0 (socket says 172.21.15.50:38600) 2024-09-10T10:10:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.788+0000 7f5269800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5264104010 0x7f526419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.788+0000 7f5268e00640 1 -- 172.21.15.50:0/542052536 learned_addr learned my addr 172.21.15.50:0/542052536 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.789+0000 7f5268e00640 1 -- 172.21.15.50:0/542052536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5264104010 msgr2=0x7f526419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.789+0000 7f5268e00640 1 --2- 172.21.15.50:0/542052536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5264104010 0x7f526419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.789+0000 7f5268e00640 1 -- 172.21.15.50:0/542052536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264109140 msgr2=0x7f526419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.789+0000 7f5268e00640 1 --2- 172.21.15.50:0/542052536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264109140 0x7f526419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.789+0000 7f5268e00640 1 -- 172.21.15.50:0/542052536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526419f640 con 0x7f52641049c0 2024-09-10T10:10:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.789+0000 7f526a200640 1 --2- 172.21.15.50:0/542052536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264109140 0x7f526419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.789+0000 7f5268e00640 1 --2- 172.21.15.50:0/542052536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52641049c0 0x7f526419abd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f525000e9f0 tx=0x7f525000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:10.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.789+0000 7f5262000640 1 -- 172.21.15.50:0/542052536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525000cd80 con 0x7f52641049c0 2024-09-10T10:10:10.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.789+0000 7f5262000640 1 -- 172.21.15.50:0/542052536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5250005500 con 0x7f52641049c0 2024-09-10T10:10:10.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.789+0000 7f526c200640 1 -- 172.21.15.50:0/542052536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f526419f930 con 0x7f52641049c0 2024-09-10T10:10:10.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.789+0000 7f5262000640 1 -- 172.21.15.50:0/542052536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250010690 con 0x7f52641049c0 2024-09-10T10:10:10.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.789+0000 7f526c200640 1 -- 172.21.15.50:0/542052536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52641a7210 con 0x7f52641049c0 2024-09-10T10:10:10.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.791+0000 7f526c200640 1 -- 172.21.15.50:0/542052536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52641043f0 con 0x7f52641049c0 2024-09-10T10:10:10.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.792+0000 7f5262000640 1 -- 172.21.15.50:0/542052536 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f52500046c0 con 0x7f52641049c0 2024-09-10T10:10:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.794+0000 7f5262000640 1 --2- 172.21.15.50:0/542052536 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f524c0a2c10 0x7f524c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.794+0000 7f5262000640 1 -- 172.21.15.50:0/542052536 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f52500cf960 con 0x7f52641049c0 2024-09-10T10:10:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.794+0000 7f5269800640 1 --2- 172.21.15.50:0/542052536 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f524c0a2c10 0x7f524c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:10.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.795+0000 7f5269800640 1 --2- 172.21.15.50:0/542052536 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f524c0a2c10 0x7f524c0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5258009bd0 tx=0x7f5258005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:10.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.798+0000 7f5262000640 1 -- 172.21.15.50:0/542052536 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f525009c370 con 0x7f52641049c0 2024-09-10T10:10:10.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.986+0000 7f6eeaa00640 1 -- 172.21.15.50:0/1641674354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee41034b0 msgr2=0x7f6ee410b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.986+0000 7f6eeaa00640 1 --2- 172.21.15.50:0/1641674354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee41034b0 0x7f6ee410b9a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009900 tx=0x7f6ed002a480 comp rx=0 tx=0).stop 2024-09-10T10:10:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.986+0000 7f6eeaa00640 1 -- 172.21.15.50:0/1641674354 shutdown_connections 2024-09-10T10:10:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.986+0000 7f6eeaa00640 1 --2- 172.21.15.50:0/1641674354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ee410bfc0 0x7f6ee410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.986+0000 7f6eeaa00640 1 --2- 172.21.15.50:0/1641674354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee41034b0 0x7f6ee410b9a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.986+0000 7f6eeaa00640 1 --2- 172.21.15.50:0/1641674354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ee4102b90 0x7f6ee4102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.986+0000 7f6eeaa00640 1 -- 172.21.15.50:0/1641674354 >> 172.21.15.50:0/1641674354 conn(0x7f6ee40fc610 msgr2=0x7f6ee40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.986+0000 7f6eeaa00640 1 -- 172.21.15.50:0/1641674354 shutdown_connections 2024-09-10T10:10:10.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.986+0000 7f6eeaa00640 1 -- 172.21.15.50:0/1641674354 wait complete. 2024-09-10T10:10:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.987+0000 7f6eeaa00640 1 Processor -- start 2024-09-10T10:10:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.987+0000 7f6eeaa00640 1 -- start start 2024-09-10T10:10:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.988+0000 7f6eeaa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee4102b90 0x7f6ee419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.988+0000 7f6eeaa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ee41034b0 0x7f6ee419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.988+0000 7f6eeaa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ee410bfc0 0x7f6ee419edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.988+0000 7f6eeaa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee4111de0 con 0x7f6ee4102b90 2024-09-10T10:10:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.988+0000 7f6eeaa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee4111c60 con 0x7f6ee410bfc0 2024-09-10T10:10:10.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.988+0000 7f6eeaa00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee4111f60 con 0x7f6ee41034b0 2024-09-10T10:10:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.988+0000 7f6ee9600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee4102b90 0x7f6ee419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.988+0000 7f6ee9600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee4102b90 0x7f6ee419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38616/0 (socket says 172.21.15.50:38616) 2024-09-10T10:10:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.988+0000 7f6ee9600640 1 -- 172.21.15.50:0/2943392301 learned_addr learned my addr 172.21.15.50:0/2943392301 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.988+0000 7f6ee8c00640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ee41034b0 0x7f6ee419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.988+0000 7f6eea000640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ee410bfc0 0x7f6ee419edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.989+0000 7f6ee9600640 1 -- 172.21.15.50:0/2943392301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ee41034b0 msgr2=0x7f6ee419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.989+0000 7f6ee9600640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ee41034b0 0x7f6ee419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.989+0000 7f6ee9600640 1 -- 172.21.15.50:0/2943392301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ee410bfc0 msgr2=0x7f6ee419edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.989+0000 7f6ee9600640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ee410bfc0 0x7f6ee419edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.989+0000 7f6ee9600640 1 -- 172.21.15.50:0/2943392301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee419f4d0 con 0x7f6ee4102b90 2024-09-10T10:10:10.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.989+0000 7f6ee9600640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee4102b90 0x7f6ee419a520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800d950 tx=0x7f6ed800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:10.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.989+0000 7f6ee2000640 1 -- 172.21.15.50:0/2943392301 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8017070 con 0x7f6ee4102b90 2024-09-10T10:10:10.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.990+0000 7f6eeaa00640 1 -- 172.21.15.50:0/2943392301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee419f7c0 con 0x7f6ee4102b90 2024-09-10T10:10:10.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.990+0000 7f6ee2000640 1 -- 172.21.15.50:0/2943392301 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ed800de80 con 0x7f6ee4102b90 2024-09-10T10:10:10.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.990+0000 7f6ee2000640 1 -- 172.21.15.50:0/2943392301 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800f620 con 0x7f6ee4102b90 2024-09-10T10:10:10.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.990+0000 7f6eeaa00640 1 -- 172.21.15.50:0/2943392301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee41a70a0 con 0x7f6ee4102b90 2024-09-10T10:10:10.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.991+0000 7f6eeaa00640 1 -- 172.21.15.50:0/2943392301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ee40fec80 con 0x7f6ee4102b90 2024-09-10T10:10:10.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.993+0000 7f6ee2000640 1 -- 172.21.15.50:0/2943392301 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6ed8009c30 con 0x7f6ee4102b90 2024-09-10T10:10:10.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.994+0000 7f526c200640 1 -- 172.21.15.50:0/542052536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f526410bdf0 con 0x7f52641049c0 2024-09-10T10:10:10.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.994+0000 7f6ee2000640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6ecc0a2c90 0x7f6ecc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:10.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.994+0000 7f6ee2000640 1 -- 172.21.15.50:0/2943392301 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f6ed80cf140 con 0x7f6ee4102b90 2024-09-10T10:10:10.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.994+0000 7f5262000640 1 -- 172.21.15.50:0/542052536 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f525009bc70 con 0x7f52641049c0 2024-09-10T10:10:10.996 INFO:teuthology.orchestra.run.smithi050.stdout:111669149772 2024-09-10T10:10:10.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.994+0000 7f6ee8c00640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6ecc0a2c90 0x7f6ecc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:10.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.995+0000 7f6ee2000640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613] conn(0x7f6ecc0adf60 0x7f6ecc0b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:10.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.995+0000 7f6ee2000640 1 -- 172.21.15.50:0/2943392301 --> [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ed801ee50 con 0x7f6ecc0adf60 2024-09-10T10:10:10.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.995+0000 7f6ee2000640 1 -- 172.21.15.50:0/2943392301 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f6ed80d6050 con 0x7f6ee4102b90 2024-09-10T10:10:10.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.995+0000 7f6eea000640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613] conn(0x7f6ecc0adf60 0x7f6ecc0b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:10.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.995+0000 7f6ee8c00640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6ecc0a2c90 0x7f6ecc0a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009230 tx=0x7f6ed00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:10.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.996+0000 7f6eea000640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613] conn(0x7f6ecc0adf60 0x7f6ecc0b0400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:10.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.997+0000 7f6ee2000640 1 -- 172.21.15.50:0/2943392301 <== osd.10 v2:172.21.15.84:6824/1222120613 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ed801ee50 con 0x7f6ecc0adf60 2024-09-10T10:10:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.997+0000 7f526c200640 1 -- 172.21.15.50:0/542052536 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f524c0a2c10 msgr2=0x7f524c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:10.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.997+0000 7f526c200640 1 --2- 172.21.15.50:0/542052536 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f524c0a2c10 0x7f524c0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5258009bd0 tx=0x7f5258005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.997+0000 7f526c200640 1 -- 172.21.15.50:0/542052536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52641049c0 msgr2=0x7f526419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.997+0000 7f526c200640 1 --2- 172.21.15.50:0/542052536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52641049c0 0x7f526419abd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f525000e9f0 tx=0x7f525000edf0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.997+0000 7f526c200640 1 -- 172.21.15.50:0/542052536 shutdown_connections 2024-09-10T10:10:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.997+0000 7f526c200640 1 --2- 172.21.15.50:0/542052536 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f524c0a2c10 0x7f524c0a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.997+0000 7f526c200640 1 --2- 172.21.15.50:0/542052536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264109140 0x7f526419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.997+0000 7f526c200640 1 --2- 172.21.15.50:0/542052536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52641049c0 0x7f526419abd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.997+0000 7f526c200640 1 --2- 172.21.15.50:0/542052536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5264104010 0x7f526419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.997+0000 7f526c200640 1 -- 172.21.15.50:0/542052536 >> 172.21.15.50:0/542052536 conn(0x7f52640ffa50 msgr2=0x7f5264100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.997+0000 7f526c200640 1 -- 172.21.15.50:0/542052536 shutdown_connections 2024-09-10T10:10:10.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:10.997+0000 7f526c200640 1 -- 172.21.15.50:0/542052536 wait complete. 2024-09-10T10:10:11.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.014+0000 7f6eeaa00640 1 -- 172.21.15.50:0/2943392301 --> [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ee406a850 con 0x7f6ecc0adf60 2024-09-10T10:10:11.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.014+0000 7f6ee2000640 1 -- 172.21.15.50:0/2943392301 <== osd.10 v2:172.21.15.84:6824/1222120613 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6ee406a850 con 0x7f6ecc0adf60 2024-09-10T10:10:11.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.015+0000 7f6eeaa00640 1 -- 172.21.15.50:0/2943392301 >> [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613] conn(0x7f6ecc0adf60 msgr2=0x7f6ecc0b0400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:11.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.015+0000 7f6eeaa00640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613] conn(0x7f6ecc0adf60 0x7f6ecc0b0400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:11.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.015+0000 7f6eeaa00640 1 -- 172.21.15.50:0/2943392301 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6ecc0a2c90 msgr2=0x7f6ecc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:11.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.015+0000 7f6eeaa00640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6ecc0a2c90 0x7f6ecc0a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009230 tx=0x7f6ed00058d0 comp rx=0 tx=0).stop 2024-09-10T10:10:11.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.015+0000 7f6eeaa00640 1 -- 172.21.15.50:0/2943392301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee4102b90 msgr2=0x7f6ee419a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:11.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.015+0000 7f6eeaa00640 1 --2- 172.21.15.50:0/2943392301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee4102b90 0x7f6ee419a520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800d950 tx=0x7f6ed800dd50 comp rx=0 tx=0).stop 2024-09-10T10:10:11.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.015+0000 7f6eea000640 1 -- 172.21.15.50:0/2943392301 reap_dead start 2024-09-10T10:10:11.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.016+0000 7f6eeaa00640 1 -- 172.21.15.50:0/2943392301 shutdown_connections 2024-09-10T10:10:11.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.016+0000 7f6eeaa00640 1 -- 172.21.15.50:0/2943392301 >> 172.21.15.50:0/2943392301 conn(0x7f6ee40fc610 msgr2=0x7f6ee40fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:11.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.016+0000 7f6eeaa00640 1 -- 172.21.15.50:0/2943392301 shutdown_connections 2024-09-10T10:10:11.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.016+0000 7f6eeaa00640 1 -- 172.21.15.50:0/2943392301 wait complete. 2024-09-10T10:10:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.458+0000 7f1c0e400640 1 -- 172.21.15.50:0/1179907475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c081079c0 msgr2=0x7f1c08107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.458+0000 7f1c0e400640 1 --2- 172.21.15.50:0/1179907475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c081079c0 0x7f1c08107da0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009930 tx=0x7f1bfc02a420 comp rx=0 tx=0).stop 2024-09-10T10:10:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.458+0000 7f1c0e400640 1 -- 172.21.15.50:0/1179907475 shutdown_connections 2024-09-10T10:10:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.458+0000 7f1c0e400640 1 --2- 172.21.15.50:0/1179907475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c08102360 0x7f1c0810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.458+0000 7f1c0e400640 1 --2- 172.21.15.50:0/1179907475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c081019c0 0x7f1c08101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.458+0000 7f1c0e400640 1 --2- 172.21.15.50:0/1179907475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c081079c0 0x7f1c08107da0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.458+0000 7f1c0e400640 1 -- 172.21.15.50:0/1179907475 >> 172.21.15.50:0/1179907475 conn(0x7f1c080fd6e0 msgr2=0x7f1c080ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:11.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.458+0000 7f1c0e400640 1 -- 172.21.15.50:0/1179907475 shutdown_connections 2024-09-10T10:10:11.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.459+0000 7f1c0e400640 1 -- 172.21.15.50:0/1179907475 wait complete. 2024-09-10T10:10:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.460+0000 7f1c0e400640 1 Processor -- start 2024-09-10T10:10:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.460+0000 7f1c0e400640 1 -- start start 2024-09-10T10:10:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.460+0000 7f1c0e400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c081019c0 0x7f1c080744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.460+0000 7f1c0e400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c08102360 0x7f1c08074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.460+0000 7f1c0e400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c081079c0 0x7f1c08074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.460+0000 7f1c0e400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1c08111dc0 con 0x7f1c081079c0 2024-09-10T10:10:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.460+0000 7f1c0e400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1c08111c40 con 0x7f1c081019c0 2024-09-10T10:10:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.460+0000 7f1c0e400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c08111f40 con 0x7f1c08102360 2024-09-10T10:10:11.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.461+0000 7f1c0da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c081079c0 0x7f1c08074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.461+0000 7f1c0da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c081079c0 0x7f1c08074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38640/0 (socket says 172.21.15.50:38640) 2024-09-10T10:10:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.461+0000 7f1c0da00640 1 -- 172.21.15.50:0/2784196389 learned_addr learned my addr 172.21.15.50:0/2784196389 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.461+0000 7f1c0d000640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c081019c0 0x7f1c080744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:11.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.461+0000 7f1c07e00640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c08102360 0x7f1c08074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.461+0000 7f1c0d000640 1 -- 172.21.15.50:0/2784196389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c08102360 msgr2=0x7f1c08074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.461+0000 7f1c0d000640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c08102360 0x7f1c08074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.461+0000 7f1c0d000640 1 -- 172.21.15.50:0/2784196389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c081079c0 msgr2=0x7f1c08074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.461+0000 7f1c0d000640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c081079c0 0x7f1c08074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.461+0000 7f1c0d000640 1 -- 172.21.15.50:0/2784196389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c081a6730 con 0x7f1c081019c0 2024-09-10T10:10:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.461+0000 7f1c07e00640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c08102360 0x7f1c08074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.461+0000 7f1c0d000640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c081019c0 0x7f1c080744f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc005940 tx=0x7f1bfc031b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.462+0000 7f1c05600640 1 -- 172.21.15.50:0/2784196389 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc03f070 con 0x7f1c081019c0 2024-09-10T10:10:11.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.462+0000 7f1c0e400640 1 -- 172.21.15.50:0/2784196389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c081a69c0 con 0x7f1c081019c0 2024-09-10T10:10:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.462+0000 7f1c05600640 1 -- 172.21.15.50:0/2784196389 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bfc003ad0 con 0x7f1c081019c0 2024-09-10T10:10:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.462+0000 7f1c05600640 1 -- 172.21.15.50:0/2784196389 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc035070 con 0x7f1c081019c0 2024-09-10T10:10:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.462+0000 7f1c0e400640 1 -- 172.21.15.50:0/2784196389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c081a6ef0 con 0x7f1c081019c0 2024-09-10T10:10:11.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.463+0000 7f1c0e400640 1 -- 172.21.15.50:0/2784196389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c08101e20 con 0x7f1c081019c0 2024-09-10T10:10:11.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.465+0000 7f1c05600640 1 -- 172.21.15.50:0/2784196389 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1bfc0035f0 con 0x7f1c081019c0 2024-09-10T10:10:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.467+0000 7f1c05600640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1bf00a2c90 0x7f1bf00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.467+0000 7f1c05600640 1 -- 172.21.15.50:0/2784196389 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f1bfc0efc10 con 0x7f1c081019c0 2024-09-10T10:10:11.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.467+0000 7f1c07e00640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1bf00a2c90 0x7f1bf00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:11.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.468+0000 7f1c07e00640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1bf00a2c90 0x7f1bf00a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1c08075f80 tx=0x7f1bf4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:11.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.469+0000 7f1c05600640 1 -- 172.21.15.50:0/2784196389 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1bfc0bbfd0 con 0x7f1c081019c0 2024-09-10T10:10:11.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.658+0000 7f1c0e400640 1 -- 172.21.15.50:0/2784196389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1c08109f30 con 0x7f1c081019c0 2024-09-10T10:10:11.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.659+0000 7f1c05600640 1 -- 172.21.15.50:0/2784196389 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1bfc0c02d0 con 0x7f1c081019c0 2024-09-10T10:10:11.661 INFO:teuthology.orchestra.run.smithi050.stdout:167503724611 2024-09-10T10:10:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.661+0000 7f1c0e400640 1 -- 172.21.15.50:0/2784196389 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1bf00a2c90 msgr2=0x7f1bf00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.661+0000 7f1c0e400640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1bf00a2c90 0x7f1bf00a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1c08075f80 tx=0x7f1bf4005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.661+0000 7f1c0e400640 1 -- 172.21.15.50:0/2784196389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c081019c0 msgr2=0x7f1c080744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.661+0000 7f1c0e400640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c081019c0 0x7f1c080744f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc005940 tx=0x7f1bfc031b50 comp rx=0 tx=0).stop 2024-09-10T10:10:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.661+0000 7f1c0e400640 1 -- 172.21.15.50:0/2784196389 shutdown_connections 2024-09-10T10:10:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.661+0000 7f1c0e400640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1bf00a2c90 0x7f1bf00a5150 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.661+0000 7f1c0e400640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c081079c0 0x7f1c08074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.661+0000 7f1c0e400640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c08102360 0x7f1c08074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.661+0000 7f1c0e400640 1 --2- 172.21.15.50:0/2784196389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c081019c0 0x7f1c080744f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.661+0000 7f1c0e400640 1 -- 172.21.15.50:0/2784196389 >> 172.21.15.50:0/2784196389 conn(0x7f1c080fd6e0 msgr2=0x7f1c080fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.662+0000 7f1c0e400640 1 -- 172.21.15.50:0/2784196389 shutdown_connections 2024-09-10T10:10:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:11.662+0000 7f1c0e400640 1 -- 172.21.15.50:0/2784196389 wait complete. 2024-09-10T10:10:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:11.695 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:11.924 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:11.964 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:11 smithi050 ceph-mon[30354]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:10:11.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:11 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/542052536' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T10:10:11.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:11 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2784196389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T10:10:12.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:11 smithi084 ceph-mon[34812]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:10:12.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:11 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/542052536' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T10:10:12.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:11 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2784196389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T10:10:12.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:11 smithi189 ceph-mon[34999]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:10:12.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:11 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/542052536' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T10:10:12.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:11 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2784196389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T10:10:12.663 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724609 got 167503724611 for osd.5 2024-09-10T10:10:12.663 DEBUG:teuthology.parallel:result is None 2024-09-10T10:10:13.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.166+0000 7faffc200640 1 -- 172.21.15.50:0/3431325358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff4104010 msgr2=0x7faff41043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:13.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.166+0000 7faffc200640 1 --2- 172.21.15.50:0/3431325358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff4104010 0x7faff41043f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009900 tx=0x7fafe802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:10:13.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.166+0000 7faffc200640 1 -- 172.21.15.50:0/3431325358 shutdown_connections 2024-09-10T10:10:13.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.166+0000 7faffc200640 1 --2- 172.21.15.50:0/3431325358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faff4109140 0x7faff4110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:13.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.166+0000 7faffc200640 1 --2- 172.21.15.50:0/3431325358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faff41049c0 0x7faff4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:13.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.166+0000 7faffc200640 1 --2- 172.21.15.50:0/3431325358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff4104010 0x7faff41043f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:13.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.166+0000 7faffc200640 1 -- 172.21.15.50:0/3431325358 >> 172.21.15.50:0/3431325358 conn(0x7faff40ffa50 msgr2=0x7faff4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:13.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.166+0000 7faffc200640 1 -- 172.21.15.50:0/3431325358 shutdown_connections 2024-09-10T10:10:13.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.167+0000 7faffc200640 1 -- 172.21.15.50:0/3431325358 wait complete. 2024-09-10T10:10:13.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.168+0000 7faffc200640 1 Processor -- start 2024-09-10T10:10:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.168+0000 7faffc200640 1 -- start start 2024-09-10T10:10:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.169+0000 7faffc200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faff4104010 0x7faff419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.169+0000 7faffc200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faff41049c0 0x7faff419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.169+0000 7faffc200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff4109140 0x7faff419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.169+0000 7faffc200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faff4114140 con 0x7faff4109140 2024-09-10T10:10:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.169+0000 7faffc200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faff4113fc0 con 0x7faff41049c0 2024-09-10T10:10:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.169+0000 7faffc200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faff41142c0 con 0x7faff4104010 2024-09-10T10:10:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.169+0000 7faff8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faff41049c0 0x7faff419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:13.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.169+0000 7faff8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faff41049c0 0x7faff419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:38468/0 (socket says 172.21.15.50:38468) 2024-09-10T10:10:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.169+0000 7faff8e00640 1 -- 172.21.15.50:0/2381781050 learned_addr learned my addr 172.21.15.50:0/2381781050 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.169+0000 7faffa200640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff4109140 0x7faff419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.169+0000 7faff9800640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faff4104010 0x7faff419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.170+0000 7faff8e00640 1 -- 172.21.15.50:0/2381781050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faff4104010 msgr2=0x7faff419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.170+0000 7faff8e00640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faff4104010 0x7faff419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.170+0000 7faff8e00640 1 -- 172.21.15.50:0/2381781050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff4109140 msgr2=0x7faff419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.170+0000 7faff8e00640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff4109140 0x7faff419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.170+0000 7faff8e00640 1 -- 172.21.15.50:0/2381781050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff419f5b0 con 0x7faff41049c0 2024-09-10T10:10:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.170+0000 7faff9800640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faff4104010 0x7faff419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:10:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.170+0000 7faffa200640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff4109140 0x7faff419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:10:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.170+0000 7faff8e00640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faff41049c0 0x7faff419ab40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fafe000d950 tx=0x7fafe000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.171+0000 7faff2000640 1 -- 172.21.15.50:0/2381781050 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe0017030 con 0x7faff41049c0 2024-09-10T10:10:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.171+0000 7faff2000640 1 -- 172.21.15.50:0/2381781050 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafe0004020 con 0x7faff41049c0 2024-09-10T10:10:13.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.171+0000 7faffc200640 1 -- 172.21.15.50:0/2381781050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff419f8a0 con 0x7faff41049c0 2024-09-10T10:10:13.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.171+0000 7faffc200640 1 -- 172.21.15.50:0/2381781050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff41a7180 con 0x7faff41049c0 2024-09-10T10:10:13.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.171+0000 7faff2000640 1 -- 172.21.15.50:0/2381781050 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe00047a0 con 0x7faff41049c0 2024-09-10T10:10:13.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.173+0000 7faffc200640 1 -- 172.21.15.50:0/2381781050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd4005290 con 0x7faff41049c0 2024-09-10T10:10:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.175+0000 7faff2000640 1 -- 172.21.15.50:0/2381781050 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fafe00041d0 con 0x7faff41049c0 2024-09-10T10:10:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.177+0000 7faff2000640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fafdc0a2d60 0x7fafdc0a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:13.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.177+0000 7faff2000640 1 -- 172.21.15.50:0/2381781050 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fafe00cedd0 con 0x7faff41049c0 2024-09-10T10:10:13.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.177+0000 7faff9800640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fafdc0a2d60 0x7fafdc0a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:13.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.178+0000 7faff9800640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fafdc0a2d60 0x7fafdc0a5220 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fafe8005ab0 tx=0x7fafe8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:13.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.180+0000 7faff2000640 1 -- 172.21.15.50:0/2381781050 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fafe009b7e0 con 0x7faff41049c0 2024-09-10T10:10:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.369+0000 7faffc200640 1 -- 172.21.15.50:0/2381781050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fafd4005850 con 0x7faff41049c0 2024-09-10T10:10:13.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.370+0000 7faff2000640 1 -- 172.21.15.50:0/2381781050 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fafe009b0e0 con 0x7faff41049c0 2024-09-10T10:10:13.371 INFO:teuthology.orchestra.run.smithi050.stdout:223338299446 2024-09-10T10:10:13.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.372+0000 7faffc200640 1 -- 172.21.15.50:0/2381781050 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fafdc0a2d60 msgr2=0x7fafdc0a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.372+0000 7faffc200640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fafdc0a2d60 0x7fafdc0a5220 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fafe8005ab0 tx=0x7fafe8005a20 comp rx=0 tx=0).stop 2024-09-10T10:10:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.372+0000 7faffc200640 1 -- 172.21.15.50:0/2381781050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faff41049c0 msgr2=0x7faff419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.372+0000 7faffc200640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faff41049c0 0x7faff419ab40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fafe000d950 tx=0x7fafe000de10 comp rx=0 tx=0).stop 2024-09-10T10:10:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.372+0000 7faffc200640 1 -- 172.21.15.50:0/2381781050 shutdown_connections 2024-09-10T10:10:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.372+0000 7faffc200640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fafdc0a2d60 0x7fafdc0a5220 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.372+0000 7faffc200640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faff4109140 0x7faff419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.372+0000 7faffc200640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faff41049c0 0x7faff419ab40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.372+0000 7faffc200640 1 --2- 172.21.15.50:0/2381781050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faff4104010 0x7faff419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.372+0000 7faffc200640 1 -- 172.21.15.50:0/2381781050 >> 172.21.15.50:0/2381781050 conn(0x7faff40ffa50 msgr2=0x7faff4100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.372+0000 7faffc200640 1 -- 172.21.15.50:0/2381781050 shutdown_connections 2024-09-10T10:10:13.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:13.373+0000 7faffc200640 1 -- 172.21.15.50:0/2381781050 wait complete. 2024-09-10T10:10:13.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:13 smithi050 ceph-mon[30354]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T10:10:13.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:13 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2381781050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T10:10:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:13 smithi084 ceph-mon[34812]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T10:10:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:13 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2381781050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T10:10:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:13 smithi189 ceph-mon[34999]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-10T10:10:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:13 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2381781050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T10:10:14.314 INFO:teuthology.orchestra.run.smithi050.stdout:304942678055 2024-09-10T10:10:14.315 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T10:10:14.603 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149769 got 111669149772 for osd.3 2024-09-10T10:10:14.604 DEBUG:teuthology.parallel:result is None 2024-09-10T10:10:14.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.776+0000 7f92e8800640 1 -- 172.21.15.50:0/22435141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92e0104010 msgr2=0x7f92e01043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.776+0000 7f92e8800640 1 --2- 172.21.15.50:0/22435141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92e0104010 0x7f92e01043f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009900 tx=0x7f92d402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:10:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.777+0000 7f92e8800640 1 -- 172.21.15.50:0/22435141 shutdown_connections 2024-09-10T10:10:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.777+0000 7f92e8800640 1 --2- 172.21.15.50:0/22435141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92e0109140 0x7f92e0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.777+0000 7f92e8800640 1 --2- 172.21.15.50:0/22435141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92e01049c0 0x7f92e0108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.777+0000 7f92e8800640 1 --2- 172.21.15.50:0/22435141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92e0104010 0x7f92e01043f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.777+0000 7f92e8800640 1 -- 172.21.15.50:0/22435141 >> 172.21.15.50:0/22435141 conn(0x7f92e00ffa50 msgr2=0x7f92e0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.777+0000 7f92e8800640 1 -- 172.21.15.50:0/22435141 shutdown_connections 2024-09-10T10:10:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.777+0000 7f92e8800640 1 -- 172.21.15.50:0/22435141 wait complete. 2024-09-10T10:10:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.778+0000 7f92e8800640 1 Processor -- start 2024-09-10T10:10:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.778+0000 7f92e8800640 1 -- start start 2024-09-10T10:10:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.778+0000 7f92e8800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92e0104010 0x7f92e019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.778+0000 7f92e8800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92e01049c0 0x7f92e019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.778+0000 7f92e8800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92e0109140 0x7f92e019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.778+0000 7f92e8800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f92e01141c0 con 0x7f92e0109140 2024-09-10T10:10:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.778+0000 7f92e8800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f92e0114040 con 0x7f92e01049c0 2024-09-10T10:10:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.778+0000 7f92e8800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f92e0114340 con 0x7f92e0104010 2024-09-10T10:10:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.779+0000 7f92e6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92e0109140 0x7f92e019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.779+0000 7f92e6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92e0109140 0x7f92e019eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38688/0 (socket says 172.21.15.50:38688) 2024-09-10T10:10:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.779+0000 7f92e6800640 1 -- 172.21.15.50:0/259688351 learned_addr learned my addr 172.21.15.50:0/259688351 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.779+0000 7f92e5e00640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92e0104010 0x7f92e019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.779+0000 7f92e5400640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92e01049c0 0x7f92e019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.779+0000 7f92e5400640 1 -- 172.21.15.50:0/259688351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92e0104010 msgr2=0x7f92e019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.779+0000 7f92e5400640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92e0104010 0x7f92e019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.779+0000 7f92e5400640 1 -- 172.21.15.50:0/259688351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92e0109140 msgr2=0x7f92e019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.779+0000 7f92e5400640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92e0109140 0x7f92e019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.779+0000 7f92e5400640 1 -- 172.21.15.50:0/259688351 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e019f5d0 con 0x7f92e01049c0 2024-09-10T10:10:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.779+0000 7f92e6800640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92e0109140 0x7f92e019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.779+0000 7f92e5400640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92e01049c0 0x7f92e019ab60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f92d000e9f0 tx=0x7f92d000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.780+0000 7f92daa00640 1 -- 172.21.15.50:0/259688351 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d000cd80 con 0x7f92e01049c0 2024-09-10T10:10:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.780+0000 7f92daa00640 1 -- 172.21.15.50:0/259688351 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92d00035f0 con 0x7f92e01049c0 2024-09-10T10:10:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.780+0000 7f92e8800640 1 -- 172.21.15.50:0/259688351 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e019f8c0 con 0x7f92e01049c0 2024-09-10T10:10:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.780+0000 7f92daa00640 1 -- 172.21.15.50:0/259688351 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0010690 con 0x7f92e01049c0 2024-09-10T10:10:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.780+0000 7f92e8800640 1 -- 172.21.15.50:0/259688351 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e01a71a0 con 0x7f92e01049c0 2024-09-10T10:10:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.781+0000 7f92e8800640 1 -- 172.21.15.50:0/259688351 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e01043f0 con 0x7f92e01049c0 2024-09-10T10:10:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.784+0000 7f92daa00640 1 -- 172.21.15.50:0/259688351 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f92d0003b30 con 0x7f92e01049c0 2024-09-10T10:10:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.785+0000 7f92daa00640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f92c80a2c90 0x7f92c80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.785+0000 7f92daa00640 1 -- 172.21.15.50:0/259688351 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f92d00cf890 con 0x7f92e01049c0 2024-09-10T10:10:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.785+0000 7f92e5e00640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f92c80a2c90 0x7f92c80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.786+0000 7f92e5e00640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f92c80a2c90 0x7f92c80a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f92d4000c00 tx=0x7f92d4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.786+0000 7f92daa00640 1 -- 172.21.15.50:0/259688351 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f92d009c330 con 0x7f92e01049c0 2024-09-10T10:10:14.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.974+0000 7f92e8800640 1 -- 172.21.15.50:0/259688351 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f92e002d7c0 con 0x7f92e01049c0 2024-09-10T10:10:14.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.975+0000 7f92daa00640 1 -- 172.21.15.50:0/259688351 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f92d009bc30 con 0x7f92e01049c0 2024-09-10T10:10:14.976 INFO:teuthology.orchestra.run.smithi050.stdout:283467841581 2024-09-10T10:10:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.977+0000 7f92e8800640 1 -- 172.21.15.50:0/259688351 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f92c80a2c90 msgr2=0x7f92c80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.977+0000 7f92e8800640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f92c80a2c90 0x7f92c80a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f92d4000c00 tx=0x7f92d4005b50 comp rx=0 tx=0).stop 2024-09-10T10:10:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.977+0000 7f92e8800640 1 -- 172.21.15.50:0/259688351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92e01049c0 msgr2=0x7f92e019ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.977+0000 7f92e8800640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92e01049c0 0x7f92e019ab60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f92d000e9f0 tx=0x7f92d000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:10:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.977+0000 7f92e8800640 1 -- 172.21.15.50:0/259688351 shutdown_connections 2024-09-10T10:10:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.977+0000 7f92e8800640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f92c80a2c90 0x7f92c80a5150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.977+0000 7f92e8800640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f92e0109140 0x7f92e019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.977+0000 7f92e8800640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92e01049c0 0x7f92e019ab60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.977+0000 7f92e8800640 1 --2- 172.21.15.50:0/259688351 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f92e0104010 0x7f92e019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.977+0000 7f92e8800640 1 -- 172.21.15.50:0/259688351 >> 172.21.15.50:0/259688351 conn(0x7f92e00ffa50 msgr2=0x7f92e0100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.978+0000 7f92e8800640 1 -- 172.21.15.50:0/259688351 shutdown_connections 2024-09-10T10:10:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:14.978+0000 7f92e8800640 1 -- 172.21.15.50:0/259688351 wait complete. 2024-09-10T10:10:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.467+0000 7fe3c5e00640 1 -- 172.21.15.50:0/965636563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3c01079c0 msgr2=0x7fe3c0107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.467+0000 7fe3c5e00640 1 --2- 172.21.15.50:0/965636563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3c01079c0 0x7fe3c0107da0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009890 tx=0x7fe3b402a380 comp rx=0 tx=0).stop 2024-09-10T10:10:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.467+0000 7fe3c5e00640 1 -- 172.21.15.50:0/965636563 shutdown_connections 2024-09-10T10:10:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.467+0000 7fe3c5e00640 1 --2- 172.21.15.50:0/965636563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c0102360 0x7fe3c010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.467+0000 7fe3c5e00640 1 --2- 172.21.15.50:0/965636563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3c01019c0 0x7fe3c0101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.467+0000 7fe3c5e00640 1 --2- 172.21.15.50:0/965636563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3c01079c0 0x7fe3c0107da0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.467+0000 7fe3c5e00640 1 -- 172.21.15.50:0/965636563 >> 172.21.15.50:0/965636563 conn(0x7fe3c00fd740 msgr2=0x7fe3c00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:15.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.467+0000 7fe3c5e00640 1 -- 172.21.15.50:0/965636563 shutdown_connections 2024-09-10T10:10:15.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.468+0000 7fe3c5e00640 1 -- 172.21.15.50:0/965636563 wait complete. 2024-09-10T10:10:15.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.469+0000 7fe3c5e00640 1 Processor -- start 2024-09-10T10:10:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.469+0000 7fe3c5e00640 1 -- start start 2024-09-10T10:10:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.470+0000 7fe3c5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c01019c0 0x7fe3c01088f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.470+0000 7fe3c5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3c0102360 0x7fe3c0108e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.470+0000 7fe3c5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3c01079c0 0x7fe3c0109370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.470+0000 7fe3c5e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c0111de0 con 0x7fe3c0102360 2024-09-10T10:10:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.470+0000 7fe3c5e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c0111c60 con 0x7fe3c01019c0 2024-09-10T10:10:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.470+0000 7fe3c5e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c0111f60 con 0x7fe3c01079c0 2024-09-10T10:10:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.470+0000 7fe3c4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c01019c0 0x7fe3c01088f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.470+0000 7fe3bfe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3c0102360 0x7fe3c0108e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.470+0000 7fe3c4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c01019c0 0x7fe3c01088f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:38514/0 (socket says 172.21.15.50:38514) 2024-09-10T10:10:15.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.470+0000 7fe3c4a00640 1 -- 172.21.15.50:0/1188233154 learned_addr learned my addr 172.21.15.50:0/1188233154 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.471+0000 7fe3c4a00640 1 -- 172.21.15.50:0/1188233154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3c01079c0 msgr2=0x7fe3c0109370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T10:10:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.471+0000 7fe3c4a00640 1 --2- 172.21.15.50:0/1188233154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3c01079c0 0x7fe3c0109370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.471+0000 7fe3c4a00640 1 -- 172.21.15.50:0/1188233154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3c0102360 msgr2=0x7fe3c0108e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.471+0000 7fe3c4a00640 1 --2- 172.21.15.50:0/1188233154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3c0102360 0x7fe3c0108e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.471+0000 7fe3c4a00640 1 -- 172.21.15.50:0/1188233154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c01aac20 con 0x7fe3c01019c0 2024-09-10T10:10:15.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.471+0000 7fe3c4a00640 1 --2- 172.21.15.50:0/1188233154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c01019c0 0x7fe3c01088f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4033df0 tx=0x7fe3b4033e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:15.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.471+0000 7fe3bd600640 1 -- 172.21.15.50:0/1188233154 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4037040 con 0x7fe3c01019c0 2024-09-10T10:10:15.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.471+0000 7fe3bd600640 1 -- 172.21.15.50:0/1188233154 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3b4040070 con 0x7fe3c01019c0 2024-09-10T10:10:15.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.471+0000 7fe3bd600640 1 -- 172.21.15.50:0/1188233154 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4003a10 con 0x7fe3c01019c0 2024-09-10T10:10:15.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.472+0000 7fe3c5e00640 1 -- 172.21.15.50:0/1188233154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c01aaeb0 con 0x7fe3c01019c0 2024-09-10T10:10:15.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.472+0000 7fe3c5e00640 1 -- 172.21.15.50:0/1188233154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c01ab2b0 con 0x7fe3c01019c0 2024-09-10T10:10:15.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.473+0000 7fe3c5e00640 1 -- 172.21.15.50:0/1188233154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c0103100 con 0x7fe3c01019c0 2024-09-10T10:10:15.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.475+0000 7fe3bd600640 1 -- 172.21.15.50:0/1188233154 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe3b4003bb0 con 0x7fe3c01019c0 2024-09-10T10:10:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.476+0000 7fe3bd600640 1 --2- 172.21.15.50:0/1188233154 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe3a80a2c90 0x7fe3a80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.477+0000 7fe3bd600640 1 -- 172.21.15.50:0/1188233154 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe3b40eff50 con 0x7fe3c01019c0 2024-09-10T10:10:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.477+0000 7fe3bfe00640 1 --2- 172.21.15.50:0/1188233154 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe3a80a2c90 0x7fe3a80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:15.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.478+0000 7fe3bfe00640 1 --2- 172.21.15.50:0/1188233154 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe3a80a2c90 0x7fe3a80a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe3c010a0b0 tx=0x7fe3ac009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:15.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.479+0000 7fe3bd600640 1 -- 172.21.15.50:0/1188233154 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe3b40bca70 con 0x7fe3c01019c0 2024-09-10T10:10:15.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.669+0000 7fe3c5e00640 1 -- 172.21.15.50:0/1188233154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fe3c0109e20 con 0x7fe3c01019c0 2024-09-10T10:10:15.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.670+0000 7fe3bd600640 1 -- 172.21.15.50:0/1188233154 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe3c0109e20 con 0x7fe3c01019c0 2024-09-10T10:10:15.672 INFO:teuthology.orchestra.run.smithi050.stdout:253403070514 2024-09-10T10:10:15.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.672+0000 7fe3c5e00640 1 -- 172.21.15.50:0/1188233154 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe3a80a2c90 msgr2=0x7fe3a80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:15.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.672+0000 7fe3c5e00640 1 --2- 172.21.15.50:0/1188233154 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe3a80a2c90 0x7fe3a80a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe3c010a0b0 tx=0x7fe3ac009110 comp rx=0 tx=0).stop 2024-09-10T10:10:15.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.672+0000 7fe3c5e00640 1 -- 172.21.15.50:0/1188233154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c01019c0 msgr2=0x7fe3c01088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.672+0000 7fe3c5e00640 1 --2- 172.21.15.50:0/1188233154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c01019c0 0x7fe3c01088f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4033df0 tx=0x7fe3b4033e20 comp rx=0 tx=0).stop 2024-09-10T10:10:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.672+0000 7fe3c5e00640 1 -- 172.21.15.50:0/1188233154 shutdown_connections 2024-09-10T10:10:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.672+0000 7fe3c5e00640 1 --2- 172.21.15.50:0/1188233154 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe3a80a2c90 0x7fe3a80a5150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.672+0000 7fe3c5e00640 1 --2- 172.21.15.50:0/1188233154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3c01079c0 0x7fe3c0109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.672+0000 7fe3c5e00640 1 --2- 172.21.15.50:0/1188233154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3c0102360 0x7fe3c0108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.672+0000 7fe3c5e00640 1 --2- 172.21.15.50:0/1188233154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3c01019c0 0x7fe3c01088f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.672+0000 7fe3c5e00640 1 -- 172.21.15.50:0/1188233154 >> 172.21.15.50:0/1188233154 conn(0x7fe3c00fd740 msgr2=0x7fe3c010d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.673+0000 7fe3c5e00640 1 -- 172.21.15.50:0/1188233154 shutdown_connections 2024-09-10T10:10:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.673+0000 7fe3c5e00640 1 -- 172.21.15.50:0/1188233154 wait complete. 2024-09-10T10:10:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.866+0000 7fdbda000640 1 -- 172.21.15.50:0/617532948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd4106f70 msgr2=0x7fdbd410eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.866+0000 7fdbda000640 1 --2- 172.21.15.50:0/617532948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd4106f70 0x7fdbd410eab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009ca0 tx=0x7fdbcc02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.866+0000 7fdbda000640 1 -- 172.21.15.50:0/617532948 shutdown_connections 2024-09-10T10:10:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.866+0000 7fdbda000640 1 --2- 172.21.15.50:0/617532948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd4106f70 0x7fdbd410eab0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.866+0000 7fdbda000640 1 --2- 172.21.15.50:0/617532948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd4100eb0 0x7fdbd4106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.866+0000 7fdbda000640 1 --2- 172.21.15.50:0/617532948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbd4100500 0x7fdbd41008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.866+0000 7fdbda000640 1 -- 172.21.15.50:0/617532948 >> 172.21.15.50:0/617532948 conn(0x7fdbd40fc5c0 msgr2=0x7fdbd40fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.866+0000 7fdbda000640 1 -- 172.21.15.50:0/617532948 shutdown_connections 2024-09-10T10:10:15.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.866+0000 7fdbda000640 1 -- 172.21.15.50:0/617532948 wait complete. 2024-09-10T10:10:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.867+0000 7fdbda000640 1 Processor -- start 2024-09-10T10:10:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.867+0000 7fdbda000640 1 -- start start 2024-09-10T10:10:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.868+0000 7fdbda000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd4100500 0x7fdbd4117230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.868+0000 7fdbda000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbd4100eb0 0x7fdbd4117770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.868+0000 7fdbda000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd4106f70 0x7fdbd4111310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.868+0000 7fdbda000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd410fdd0 con 0x7fdbd4100eb0 2024-09-10T10:10:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.868+0000 7fdbda000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd410fc50 con 0x7fdbd4106f70 2024-09-10T10:10:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.868+0000 7fdbda000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd410ff50 con 0x7fdbd4100500 2024-09-10T10:10:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.868+0000 7fdbd3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd4100500 0x7fdbd4117230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.868+0000 7fdbd3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd4100500 0x7fdbd4117230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:55920/0 (socket says 172.21.15.50:55920) 2024-09-10T10:10:15.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.868+0000 7fdbd3400640 1 -- 172.21.15.50:0/3973599479 learned_addr learned my addr 172.21.15.50:0/3973599479 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.868+0000 7fdbd3e00640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd4106f70 0x7fdbd4111310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.868+0000 7fdbcbe00640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbd4100eb0 0x7fdbd4117770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.869+0000 7fdbd3400640 1 -- 172.21.15.50:0/3973599479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd4106f70 msgr2=0x7fdbd4111310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.869+0000 7fdbd3400640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd4106f70 0x7fdbd4111310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.869+0000 7fdbd3400640 1 -- 172.21.15.50:0/3973599479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbd4100eb0 msgr2=0x7fdbd4117770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.869+0000 7fdbd3400640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbd4100eb0 0x7fdbd4117770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.869+0000 7fdbd3400640 1 -- 172.21.15.50:0/3973599479 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd4111bd0 con 0x7fdbd4100500 2024-09-10T10:10:15.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.869+0000 7fdbcbe00640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbd4100eb0 0x7fdbd4117770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:10:15.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.869+0000 7fdbd3400640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd4100500 0x7fdbd4117230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c970 tx=0x7fdbc400ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:15.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.869+0000 7fdbd0c00640 1 -- 172.21.15.50:0/3973599479 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4007c10 con 0x7fdbd4100500 2024-09-10T10:10:15.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.869+0000 7fdbd0c00640 1 -- 172.21.15.50:0/3973599479 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbc4007db0 con 0x7fdbd4100500 2024-09-10T10:10:15.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.869+0000 7fdbda000640 1 -- 172.21.15.50:0/3973599479 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd4111ec0 con 0x7fdbd4100500 2024-09-10T10:10:15.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.869+0000 7fdbd0c00640 1 -- 172.21.15.50:0/3973599479 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400f940 con 0x7fdbd4100500 2024-09-10T10:10:15.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.870+0000 7fdbda000640 1 -- 172.21.15.50:0/3973599479 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd41b3d30 con 0x7fdbd4100500 2024-09-10T10:10:15.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.871+0000 7fdbda000640 1 -- 172.21.15.50:0/3973599479 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd406a4a0 con 0x7fdbd4100500 2024-09-10T10:10:15.873 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:15.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.873+0000 7fdbd0c00640 1 -- 172.21.15.50:0/3973599479 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdbc400fb40 con 0x7fdbd4100500 2024-09-10T10:10:15.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.874+0000 7fdbd0c00640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdbb80a2c90 0x7fdbb80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:15.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.874+0000 7fdbd0c00640 1 -- 172.21.15.50:0/3973599479 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fdbc40cf920 con 0x7fdbd4100500 2024-09-10T10:10:15.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.874+0000 7fdbcbe00640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdbb80a2c90 0x7fdbb80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:15.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.875+0000 7fdbcbe00640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdbb80a2c90 0x7fdbb80a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc005fd0 tx=0x7fdbbc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:15.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:15.878+0000 7fdbd0c00640 1 -- 172.21.15.50:0/3973599479 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdbc409c3c0 con 0x7fdbd4100500 2024-09-10T10:10:15.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:15 smithi050 ceph-mon[30354]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-10T10:10:15.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:15 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/259688351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T10:10:15.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:15 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1188233154' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T10:10:16.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.068+0000 7fdbda000640 1 -- 172.21.15.50:0/3973599479 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fdbd4109b50 con 0x7fdbd4100500 2024-09-10T10:10:16.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.068+0000 7fdbd0c00640 1 -- 172.21.15.50:0/3973599479 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdbc409bcc0 con 0x7fdbd4100500 2024-09-10T10:10:16.070 INFO:teuthology.orchestra.run.smithi050.stdout:55834574938 2024-09-10T10:10:16.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.071+0000 7fdbda000640 1 -- 172.21.15.50:0/3973599479 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdbb80a2c90 msgr2=0x7fdbb80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:16.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.071+0000 7fdbda000640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdbb80a2c90 0x7fdbb80a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc005fd0 tx=0x7fdbbc005850 comp rx=0 tx=0).stop 2024-09-10T10:10:16.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.071+0000 7fdbda000640 1 -- 172.21.15.50:0/3973599479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd4100500 msgr2=0x7fdbd4117230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:16.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.071+0000 7fdbda000640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd4100500 0x7fdbd4117230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c970 tx=0x7fdbc400ce30 comp rx=0 tx=0).stop 2024-09-10T10:10:16.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.071+0000 7fdbda000640 1 -- 172.21.15.50:0/3973599479 shutdown_connections 2024-09-10T10:10:16.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.071+0000 7fdbda000640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdbb80a2c90 0x7fdbb80a5150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:16.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.071+0000 7fdbda000640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd4106f70 0x7fdbd4111310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:16.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.071+0000 7fdbda000640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbd4100eb0 0x7fdbd4117770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:16.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.071+0000 7fdbda000640 1 --2- 172.21.15.50:0/3973599479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdbd4100500 0x7fdbd4117230 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:16.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.071+0000 7fdbda000640 1 -- 172.21.15.50:0/3973599479 >> 172.21.15.50:0/3973599479 conn(0x7fdbd40fc5c0 msgr2=0x7fdbd4105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:16.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.072+0000 7fdbda000640 1 -- 172.21.15.50:0/3973599479 shutdown_connections 2024-09-10T10:10:16.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:16.072+0000 7fdbda000640 1 -- 172.21.15.50:0/3973599479 wait complete. 2024-09-10T10:10:16.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:15 smithi189 ceph-mon[34999]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-10T10:10:16.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:15 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/259688351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T10:10:16.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:15 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1188233154' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T10:10:16.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:15 smithi084 ceph-mon[34812]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-10T10:10:16.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:15 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/259688351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T10:10:16.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:15 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1188233154' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T10:10:16.980 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070511 got 253403070514 for osd.8 2024-09-10T10:10:16.980 DEBUG:teuthology.parallel:result is None 2024-09-10T10:10:17.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:16 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3973599479' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T10:10:17.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:16 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3973599479' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T10:10:17.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:16 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3973599479' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T10:10:17.379 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299444 got 223338299446 for osd.7 2024-09-10T10:10:17.379 DEBUG:teuthology.parallel:result is None 2024-09-10T10:10:17.543 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:17.543 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:17.544 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:17.874 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841578 got 283467841581 for osd.9 2024-09-10T10:10:17.874 DEBUG:teuthology.parallel:result is None 2024-09-10T10:10:18.117 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:17 smithi050 ceph-mon[30354]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-10T10:10:18.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:17 smithi189 ceph-mon[34999]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-10T10:10:18.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:17 smithi084 ceph-mon[34812]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-10T10:10:18.494 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:18.523 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574935 got 55834574938 for osd.1 2024-09-10T10:10:18.523 DEBUG:teuthology.parallel:result is None 2024-09-10T10:10:19.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.232+0000 7fa837e00640 1 -- 172.21.15.50:0/2796721196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8381047e0 msgr2=0x7fa838108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:19.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.232+0000 7fa837e00640 1 --2- 172.21.15.50:0/2796721196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8381047e0 0x7fa838108830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa820009900 tx=0x7fa82002a410 comp rx=0 tx=0).stop 2024-09-10T10:10:19.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.232+0000 7fa837e00640 1 -- 172.21.15.50:0/2796721196 shutdown_connections 2024-09-10T10:10:19.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.232+0000 7fa837e00640 1 --2- 172.21.15.50:0/2796721196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa838108f60 0x7fa838110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:19.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.232+0000 7fa837e00640 1 --2- 172.21.15.50:0/2796721196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8381047e0 0x7fa838108830 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.232+0000 7fa837e00640 1 --2- 172.21.15.50:0/2796721196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa838103e30 0x7fa838104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.232+0000 7fa837e00640 1 -- 172.21.15.50:0/2796721196 >> 172.21.15.50:0/2796721196 conn(0x7fa8380ff8d0 msgr2=0x7fa838101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.232+0000 7fa837e00640 1 -- 172.21.15.50:0/2796721196 shutdown_connections 2024-09-10T10:10:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.232+0000 7fa837e00640 1 -- 172.21.15.50:0/2796721196 wait complete. 2024-09-10T10:10:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.233+0000 7fa837e00640 1 Processor -- start 2024-09-10T10:10:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.233+0000 7fa837e00640 1 -- start start 2024-09-10T10:10:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.233+0000 7fa837e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa838103e30 0x7fa83819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.233+0000 7fa837e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8381047e0 0x7fa83819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.233+0000 7fa837e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa838108f60 0x7fa83819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.233+0000 7fa837e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa838113f80 con 0x7fa838103e30 2024-09-10T10:10:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.233+0000 7fa837e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa838113e00 con 0x7fa8381047e0 2024-09-10T10:10:19.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.233+0000 7fa837e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa838114100 con 0x7fa838108f60 2024-09-10T10:10:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.234+0000 7fa836a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa838103e30 0x7fa83819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.234+0000 7fa836a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa838103e30 0x7fa83819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57648/0 (socket says 172.21.15.50:57648) 2024-09-10T10:10:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.234+0000 7fa82e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8381047e0 0x7fa83819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.234+0000 7fa836a00640 1 -- 172.21.15.50:0/175234954 learned_addr learned my addr 172.21.15.50:0/175234954 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.234+0000 7fa837400640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa838108f60 0x7fa83819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.234+0000 7fa836a00640 1 -- 172.21.15.50:0/175234954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa838108f60 msgr2=0x7fa83819ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.234+0000 7fa836a00640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa838108f60 0x7fa83819ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.234+0000 7fa836a00640 1 -- 172.21.15.50:0/175234954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8381047e0 msgr2=0x7fa83819a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.234+0000 7fa836a00640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8381047e0 0x7fa83819a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.234+0000 7fa836a00640 1 -- 172.21.15.50:0/175234954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83819f430 con 0x7fa838103e30 2024-09-10T10:10:19.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.234+0000 7fa837400640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa838108f60 0x7fa83819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:10:19.478 INFO:teuthology.orchestra.run.smithi050.stdout:335007449123 2024-09-10T10:10:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.234+0000 7fa836a00640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa838103e30 0x7fa83819a480 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa82800c920 tx=0x7fa82800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.235+0000 7fa82fe00640 1 -- 172.21.15.50:0/175234954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828007c70 con 0x7fa838103e30 2024-09-10T10:10:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.235+0000 7fa82fe00640 1 -- 172.21.15.50:0/175234954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa828007e10 con 0x7fa838103e30 2024-09-10T10:10:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.235+0000 7fa837e00640 1 -- 172.21.15.50:0/175234954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83819f720 con 0x7fa838103e30 2024-09-10T10:10:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.235+0000 7fa82fe00640 1 -- 172.21.15.50:0/175234954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828018890 con 0x7fa838103e30 2024-09-10T10:10:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.235+0000 7fa837e00640 1 -- 172.21.15.50:0/175234954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8381a7000 con 0x7fa838103e30 2024-09-10T10:10:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.236+0000 7fa837e00640 1 -- 172.21.15.50:0/175234954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa838104210 con 0x7fa838103e30 2024-09-10T10:10:19.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.238+0000 7fa82fe00640 1 -- 172.21.15.50:0/175234954 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa828018a70 con 0x7fa838103e30 2024-09-10T10:10:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.239+0000 7fa82fe00640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa81c0a2c10 0x7fa81c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.239+0000 7fa82fe00640 1 -- 172.21.15.50:0/175234954 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa8280cf710 con 0x7fa838103e30 2024-09-10T10:10:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.239+0000 7fa82e000640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa81c0a2c10 0x7fa81c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.240+0000 7fa82e000640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa81c0a2c10 0x7fa81c0a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa820009230 tx=0x7fa8200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.244+0000 7fa82fe00640 1 -- 172.21.15.50:0/175234954 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa828014030 con 0x7fa838103e30 2024-09-10T10:10:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.437+0000 7fa837e00640 1 -- 172.21.15.50:0/175234954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fa83819b7e0 con 0x7fa838103e30 2024-09-10T10:10:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.437+0000 7fa82fe00640 1 -- 172.21.15.50:0/175234954 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa82809c120 con 0x7fa838103e30 2024-09-10T10:10:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.440+0000 7fa837e00640 1 -- 172.21.15.50:0/175234954 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa81c0a2c10 msgr2=0x7fa81c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.440+0000 7fa837e00640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa81c0a2c10 0x7fa81c0a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa820009230 tx=0x7fa8200058d0 comp rx=0 tx=0).stop 2024-09-10T10:10:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.440+0000 7fa837e00640 1 -- 172.21.15.50:0/175234954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa838103e30 msgr2=0x7fa83819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.440+0000 7fa837e00640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa838103e30 0x7fa83819a480 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa82800c920 tx=0x7fa82800cde0 comp rx=0 tx=0).stop 2024-09-10T10:10:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.440+0000 7fa837e00640 1 -- 172.21.15.50:0/175234954 shutdown_connections 2024-09-10T10:10:19.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.440+0000 7fa837e00640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa81c0a2c10 0x7fa81c0a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.440+0000 7fa837e00640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa838108f60 0x7fa83819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.440+0000 7fa837e00640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8381047e0 0x7fa83819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.440+0000 7fa837e00640 1 --2- 172.21.15.50:0/175234954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa838103e30 0x7fa83819a480 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.440+0000 7fa837e00640 1 -- 172.21.15.50:0/175234954 >> 172.21.15.50:0/175234954 conn(0x7fa8380ff8d0 msgr2=0x7fa838100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.440+0000 7fa837e00640 1 -- 172.21.15.50:0/175234954 shutdown_connections 2024-09-10T10:10:19.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:19.440+0000 7fa837e00640 1 -- 172.21.15.50:0/175234954 wait complete. 2024-09-10T10:10:19.905 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:20.100 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:19 smithi050 ceph-mon[30354]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T10:10:20.100 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:19 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/175234954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T10:10:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.110+0000 7f5349200640 1 -- 172.21.15.50:0/1275383853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53441049a0 msgr2=0x7f53441089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.110+0000 7f5349200640 1 --2- 172.21.15.50:0/1275383853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53441049a0 0x7f53441089f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f532c009900 tx=0x7f532c02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.110+0000 7f5349200640 1 -- 172.21.15.50:0/1275383853 shutdown_connections 2024-09-10T10:10:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.110+0000 7f5349200640 1 --2- 172.21.15.50:0/1275383853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5344109120 0x7f5344110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.110+0000 7f5349200640 1 --2- 172.21.15.50:0/1275383853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53441049a0 0x7f53441089f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.110+0000 7f5349200640 1 --2- 172.21.15.50:0/1275383853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5344103ff0 0x7f53441043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.110+0000 7f5349200640 1 -- 172.21.15.50:0/1275383853 >> 172.21.15.50:0/1275383853 conn(0x7f53440ffa90 msgr2=0x7f5344101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.110+0000 7f5349200640 1 -- 172.21.15.50:0/1275383853 shutdown_connections 2024-09-10T10:10:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.110+0000 7f5349200640 1 -- 172.21.15.50:0/1275383853 wait complete. 2024-09-10T10:10:20.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.111+0000 7f5349200640 1 Processor -- start 2024-09-10T10:10:20.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.111+0000 7f5349200640 1 -- start start 2024-09-10T10:10:20.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.111+0000 7f5349200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5344103ff0 0x7f534419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:20.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.111+0000 7f5349200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53441049a0 0x7f534419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:20.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.111+0000 7f5349200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5344109120 0x7f534419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:20.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.112+0000 7f5349200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5344114190 con 0x7f5344109120 2024-09-10T10:10:20.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.112+0000 7f5349200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5344114010 con 0x7f53441049a0 2024-09-10T10:10:20.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.112+0000 7f5349200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5344114310 con 0x7f5344103ff0 2024-09-10T10:10:20.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.112+0000 7f533be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53441049a0 0x7f534419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:20.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.112+0000 7f533be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53441049a0 0x7f534419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:33424/0 (socket says 172.21.15.50:33424) 2024-09-10T10:10:20.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.112+0000 7f533be00640 1 -- 172.21.15.50:0/24458925 learned_addr learned my addr 172.21.15.50:0/24458925 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:20.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.112+0000 7f5341e00640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5344103ff0 0x7f534419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:20.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.112+0000 7f5342800640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5344109120 0x7f534419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:20.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.112+0000 7f533be00640 1 -- 172.21.15.50:0/24458925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5344103ff0 msgr2=0x7f534419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:20.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.112+0000 7f533be00640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5344103ff0 0x7f534419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.112+0000 7f533be00640 1 -- 172.21.15.50:0/24458925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5344109120 msgr2=0x7f534419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:20.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.112+0000 7f533be00640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5344109120 0x7f534419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.112+0000 7f533be00640 1 -- 172.21.15.50:0/24458925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534419f620 con 0x7f53441049a0 2024-09-10T10:10:20.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.113+0000 7f533be00640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53441049a0 0x7f534419abb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f532c004770 tx=0x7f532c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:20.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.113+0000 7f533aa00640 1 -- 172.21.15.50:0/24458925 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c03f070 con 0x7f53441049a0 2024-09-10T10:10:20.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.113+0000 7f533aa00640 1 -- 172.21.15.50:0/24458925 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f532c031ca0 con 0x7f53441049a0 2024-09-10T10:10:20.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.113+0000 7f533aa00640 1 -- 172.21.15.50:0/24458925 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c035030 con 0x7f53441049a0 2024-09-10T10:10:20.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.113+0000 7f5349200640 1 -- 172.21.15.50:0/24458925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534419f8b0 con 0x7f53441049a0 2024-09-10T10:10:20.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.113+0000 7f5349200640 1 -- 172.21.15.50:0/24458925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53441a71f0 con 0x7f53441049a0 2024-09-10T10:10:20.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.115+0000 7f5349200640 1 -- 172.21.15.50:0/24458925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53441054d0 con 0x7f53441049a0 2024-09-10T10:10:20.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.116+0000 7f533aa00640 1 -- 172.21.15.50:0/24458925 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f532c042070 con 0x7f53441049a0 2024-09-10T10:10:20.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.118+0000 7f533aa00640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f53280a2c10 0x7f53280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:20.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.118+0000 7f533aa00640 1 -- 172.21.15.50:0/24458925 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f532c0efb40 con 0x7f53441049a0 2024-09-10T10:10:20.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.118+0000 7f5341e00640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f53280a2c10 0x7f53280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:20.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.119+0000 7f5341e00640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f53280a2c10 0x7f53280a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5334009bd0 tx=0x7f5334005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:20.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.122+0000 7f533aa00640 1 -- 172.21.15.50:0/24458925 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f532c0bc020 con 0x7f53441049a0 2024-09-10T10:10:20.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.311+0000 7f5349200640 1 -- 172.21.15.50:0/24458925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f534410c360 con 0x7f53441049a0 2024-09-10T10:10:20.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.312+0000 7f533aa00640 1 -- 172.21.15.50:0/24458925 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f532c0c0320 con 0x7f53441049a0 2024-09-10T10:10:20.313 INFO:teuthology.orchestra.run.smithi050.stdout:77309411414 2024-09-10T10:10:20.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.314+0000 7f5349200640 1 -- 172.21.15.50:0/24458925 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f53280a2c10 msgr2=0x7f53280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:20.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.314+0000 7f5349200640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f53280a2c10 0x7f53280a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5334009bd0 tx=0x7f5334005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:20.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.314+0000 7f5349200640 1 -- 172.21.15.50:0/24458925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53441049a0 msgr2=0x7f534419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:20.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.314+0000 7f5349200640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53441049a0 0x7f534419abb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f532c004770 tx=0x7f532c003c10 comp rx=0 tx=0).stop 2024-09-10T10:10:20.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.314+0000 7f5349200640 1 -- 172.21.15.50:0/24458925 shutdown_connections 2024-09-10T10:10:20.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.314+0000 7f5349200640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f53280a2c10 0x7f53280a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.314+0000 7f5349200640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5344109120 0x7f534419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.314+0000 7f5349200640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53441049a0 0x7f534419abb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.314+0000 7f5349200640 1 --2- 172.21.15.50:0/24458925 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5344103ff0 0x7f534419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.314+0000 7f5349200640 1 -- 172.21.15.50:0/24458925 >> 172.21.15.50:0/24458925 conn(0x7f53440ffa90 msgr2=0x7f5344100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:20.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.315+0000 7f5349200640 1 -- 172.21.15.50:0/24458925 shutdown_connections 2024-09-10T10:10:20.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.315+0000 7f5349200640 1 -- 172.21.15.50:0/24458925 wait complete. 2024-09-10T10:10:20.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:19 smithi189 ceph-mon[34999]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T10:10:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:19 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/175234954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T10:10:20.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:19 smithi084 ceph-mon[34812]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T10:10:20.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:19 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/175234954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T10:10:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.911+0000 7f71cbe00640 1 -- 172.21.15.50:0/212287619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71cc1047e0 msgr2=0x7f71cc108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.911+0000 7f71cbe00640 1 --2- 172.21.15.50:0/212287619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71cc1047e0 0x7f71cc108830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009900 tx=0x7f71b402a410 comp rx=0 tx=0).stop 2024-09-10T10:10:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.911+0000 7f71cbe00640 1 -- 172.21.15.50:0/212287619 shutdown_connections 2024-09-10T10:10:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.911+0000 7f71cbe00640 1 --2- 172.21.15.50:0/212287619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc108f60 0x7f71cc110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.911+0000 7f71cbe00640 1 --2- 172.21.15.50:0/212287619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71cc1047e0 0x7f71cc108830 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.911+0000 7f71cbe00640 1 --2- 172.21.15.50:0/212287619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71cc103e30 0x7f71cc104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.911+0000 7f71cbe00640 1 -- 172.21.15.50:0/212287619 >> 172.21.15.50:0/212287619 conn(0x7f71cc0ff8d0 msgr2=0x7f71cc101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:20.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.911+0000 7f71cbe00640 1 -- 172.21.15.50:0/212287619 shutdown_connections 2024-09-10T10:10:20.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.911+0000 7f71cbe00640 1 -- 172.21.15.50:0/212287619 wait complete. 2024-09-10T10:10:20.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.913+0000 7f71cbe00640 1 Processor -- start 2024-09-10T10:10:20.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.913+0000 7f71cbe00640 1 -- start start 2024-09-10T10:10:20.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.913+0000 7f71cbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71cc103e30 0x7f71cc19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:20.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.913+0000 7f71cbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71cc1047e0 0x7f71cc19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:20.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.913+0000 7f71cbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc108f60 0x7f71cc19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:20.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.913+0000 7f71cbe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc114010 con 0x7f71cc108f60 2024-09-10T10:10:20.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.913+0000 7f71cbe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc113e90 con 0x7f71cc103e30 2024-09-10T10:10:20.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.913+0000 7f71cbe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc114190 con 0x7f71cc1047e0 2024-09-10T10:10:20.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.914+0000 7f71cb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc108f60 0x7f71cc19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:20.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.914+0000 7f71c2000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71cc1047e0 0x7f71cc19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:20.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.914+0000 7f71caa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71cc103e30 0x7f71cc19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:20.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.914+0000 7f71c2000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71cc1047e0 0x7f71cc19aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:60270/0 (socket says 172.21.15.50:60270) 2024-09-10T10:10:20.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.914+0000 7f71c2000640 1 -- 172.21.15.50:0/2140839626 learned_addr learned my addr 172.21.15.50:0/2140839626 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:20.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.914+0000 7f71c2000640 1 -- 172.21.15.50:0/2140839626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71cc103e30 msgr2=0x7f71cc19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:20.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.914+0000 7f71c2000640 1 --2- 172.21.15.50:0/2140839626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71cc103e30 0x7f71cc19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.914+0000 7f71c2000640 1 -- 172.21.15.50:0/2140839626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc108f60 msgr2=0x7f71cc19ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:20.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.914+0000 7f71c2000640 1 --2- 172.21.15.50:0/2140839626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc108f60 0x7f71cc19ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:20.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.914+0000 7f71c2000640 1 -- 172.21.15.50:0/2140839626 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc19f4c0 con 0x7f71cc1047e0 2024-09-10T10:10:20.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.914+0000 7f71c2000640 1 --2- 172.21.15.50:0/2140839626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71cc1047e0 0x7f71cc19aa50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71b4004770 tx=0x7f71b4003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:20.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.915+0000 7f71c3e00640 1 -- 172.21.15.50:0/2140839626 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b403f070 con 0x7f71cc1047e0 2024-09-10T10:10:20.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.915+0000 7f71cbe00640 1 -- 172.21.15.50:0/2140839626 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71cc19f750 con 0x7f71cc1047e0 2024-09-10T10:10:20.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.915+0000 7f71c3e00640 1 -- 172.21.15.50:0/2140839626 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b4031ca0 con 0x7f71cc1047e0 2024-09-10T10:10:20.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.915+0000 7f71c3e00640 1 -- 172.21.15.50:0/2140839626 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4049060 con 0x7f71cc1047e0 2024-09-10T10:10:20.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.915+0000 7f71cbe00640 1 -- 172.21.15.50:0/2140839626 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71cc1a7090 con 0x7f71cc1047e0 2024-09-10T10:10:20.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.916+0000 7f71cbe00640 1 -- 172.21.15.50:0/2140839626 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71cc104210 con 0x7f71cc1047e0 2024-09-10T10:10:20.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.918+0000 7f71c3e00640 1 -- 172.21.15.50:0/2140839626 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f71b4042070 con 0x7f71cc1047e0 2024-09-10T10:10:20.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.919+0000 7f71c3e00640 1 --2- 172.21.15.50:0/2140839626 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f71b00a2c90 0x7f71b00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:20.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.919+0000 7f71c3e00640 1 -- 172.21.15.50:0/2140839626 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f71b40ef410 con 0x7f71cc1047e0 2024-09-10T10:10:20.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.919+0000 7f71caa00640 1 --2- 172.21.15.50:0/2140839626 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f71b00a2c90 0x7f71b00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:20.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.920+0000 7f71caa00640 1 --2- 172.21.15.50:0/2140839626 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f71b00a2c90 0x7f71b00a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0095f0 tx=0x7f71bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:20.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:20.923+0000 7f71c3e00640 1 -- 172.21.15.50:0/2140839626 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71b40bb8f0 con 0x7f71cc1047e0 2024-09-10T10:10:21.069 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:20 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/24458925' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T10:10:21.071 INFO:tasks.cephadm.ceph_manager.ceph:need seq 335007449119 got 335007449123 for osd.11 2024-09-10T10:10:21.072 DEBUG:teuthology.parallel:result is None 2024-09-10T10:10:21.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.111+0000 7f71cbe00640 1 -- 172.21.15.50:0/2140839626 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f71cc10c1a0 con 0x7f71cc1047e0 2024-09-10T10:10:21.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.112+0000 7f71c3e00640 1 -- 172.21.15.50:0/2140839626 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f71b40bfbf0 con 0x7f71cc1047e0 2024-09-10T10:10:21.113 INFO:teuthology.orchestra.run.smithi050.stdout:201863462975 2024-09-10T10:10:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.114+0000 7f71cbe00640 1 -- 172.21.15.50:0/2140839626 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f71b00a2c90 msgr2=0x7f71b00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.114+0000 7f71cbe00640 1 --2- 172.21.15.50:0/2140839626 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f71b00a2c90 0x7f71b00a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0095f0 tx=0x7f71bc005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.114+0000 7f71cbe00640 1 -- 172.21.15.50:0/2140839626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71cc1047e0 msgr2=0x7f71cc19aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.114+0000 7f71cbe00640 1 --2- 172.21.15.50:0/2140839626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71cc1047e0 0x7f71cc19aa50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71b4004770 tx=0x7f71b4003c10 comp rx=0 tx=0).stop 2024-09-10T10:10:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.114+0000 7f71cbe00640 1 -- 172.21.15.50:0/2140839626 shutdown_connections 2024-09-10T10:10:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.114+0000 7f71cbe00640 1 --2- 172.21.15.50:0/2140839626 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f71b00a2c90 0x7f71b00a5150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.115+0000 7f71cbe00640 1 --2- 172.21.15.50:0/2140839626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71cc108f60 0x7f71cc19ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.115+0000 7f71cbe00640 1 --2- 172.21.15.50:0/2140839626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f71cc1047e0 0x7f71cc19aa50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.115+0000 7f71cbe00640 1 --2- 172.21.15.50:0/2140839626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71cc103e30 0x7f71cc19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.115+0000 7f71cbe00640 1 -- 172.21.15.50:0/2140839626 >> 172.21.15.50:0/2140839626 conn(0x7f71cc0ff8d0 msgr2=0x7f71cc100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:21.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.115+0000 7f71cbe00640 1 -- 172.21.15.50:0/2140839626 shutdown_connections 2024-09-10T10:10:21.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.115+0000 7f71cbe00640 1 -- 172.21.15.50:0/2140839626 wait complete. 2024-09-10T10:10:21.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.263+0000 7f846d000640 1 -- 172.21.15.50:0/109340622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8468109120 msgr2=0x7f8468110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:21.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.263+0000 7f846d000640 1 --2- 172.21.15.50:0/109340622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8468109120 0x7f8468110ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8460009ca0 tx=0x7f846002a8b0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.263+0000 7f846d000640 1 -- 172.21.15.50:0/109340622 shutdown_connections 2024-09-10T10:10:21.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.263+0000 7f846d000640 1 --2- 172.21.15.50:0/109340622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8468109120 0x7f8468110ca0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.263+0000 7f846d000640 1 --2- 172.21.15.50:0/109340622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f84681049a0 0x7f84681089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.263+0000 7f846d000640 1 --2- 172.21.15.50:0/109340622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8468103ff0 0x7f84681043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.263+0000 7f846d000640 1 -- 172.21.15.50:0/109340622 >> 172.21.15.50:0/109340622 conn(0x7f84680ffa90 msgr2=0x7f8468101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:21.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.263+0000 7f846d000640 1 -- 172.21.15.50:0/109340622 shutdown_connections 2024-09-10T10:10:21.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.263+0000 7f846d000640 1 -- 172.21.15.50:0/109340622 wait complete. 2024-09-10T10:10:21.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.264+0000 7f846d000640 1 Processor -- start 2024-09-10T10:10:21.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.264+0000 7f846d000640 1 -- start start 2024-09-10T10:10:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.265+0000 7f846d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8468103ff0 0x7f846819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.265+0000 7f846d000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681049a0 0x7f846819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.265+0000 7f846d000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8468109120 0x7f846819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.265+0000 7f846d000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8468114180 con 0x7f84681049a0 2024-09-10T10:10:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.265+0000 7f846d000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8468114000 con 0x7f8468103ff0 2024-09-10T10:10:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.265+0000 7f846d000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8468114300 con 0x7f8468109120 2024-09-10T10:10:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.265+0000 7f8465400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681049a0 0x7f846819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.265+0000 7f8465e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8468103ff0 0x7f846819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.265+0000 7f8465400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681049a0 0x7f846819ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57686/0 (socket says 172.21.15.50:57686) 2024-09-10T10:10:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.265+0000 7f8465400640 1 -- 172.21.15.50:0/2918993182 learned_addr learned my addr 172.21.15.50:0/2918993182 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.265+0000 7f8466800640 1 --2- 172.21.15.50:0/2918993182 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8468109120 0x7f846819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:21.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.266+0000 7f8465e00640 1 -- 172.21.15.50:0/2918993182 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8468109120 msgr2=0x7f846819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:21.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.266+0000 7f8465e00640 1 --2- 172.21.15.50:0/2918993182 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8468109120 0x7f846819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.266+0000 7f8465e00640 1 -- 172.21.15.50:0/2918993182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681049a0 msgr2=0x7f846819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:21.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.266+0000 7f8465e00640 1 --2- 172.21.15.50:0/2918993182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681049a0 0x7f846819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.266+0000 7f8465e00640 1 -- 172.21.15.50:0/2918993182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846819f5f0 con 0x7f8468103ff0 2024-09-10T10:10:21.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.266+0000 7f8465e00640 1 --2- 172.21.15.50:0/2918993182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8468103ff0 0x7f846819a640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f845800e9f0 tx=0x7f845800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:21.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.266+0000 7f845ea00640 1 -- 172.21.15.50:0/2918993182 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845800ccc0 con 0x7f8468103ff0 2024-09-10T10:10:21.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.266+0000 7f845ea00640 1 -- 172.21.15.50:0/2918993182 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8458010910 con 0x7f8468103ff0 2024-09-10T10:10:21.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.266+0000 7f846d000640 1 -- 172.21.15.50:0/2918993182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846819f8e0 con 0x7f8468103ff0 2024-09-10T10:10:21.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.266+0000 7f845ea00640 1 -- 172.21.15.50:0/2918993182 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458018960 con 0x7f8468103ff0 2024-09-10T10:10:21.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.266+0000 7f846d000640 1 -- 172.21.15.50:0/2918993182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84681a71c0 con 0x7f8468103ff0 2024-09-10T10:10:21.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.268+0000 7f846d000640 1 -- 172.21.15.50:0/2918993182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84681043d0 con 0x7f8468103ff0 2024-09-10T10:10:21.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.269+0000 7f845ea00640 1 -- 172.21.15.50:0/2918993182 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8458010ac0 con 0x7f8468103ff0 2024-09-10T10:10:21.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.271+0000 7f845ea00640 1 --2- 172.21.15.50:0/2918993182 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f844c0a2c90 0x7f844c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.271+0000 7f845ea00640 1 -- 172.21.15.50:0/2918993182 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f84580cf8b0 con 0x7f8468103ff0 2024-09-10T10:10:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.271+0000 7f8465400640 1 --2- 172.21.15.50:0/2918993182 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f844c0a2c90 0x7f844c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.272+0000 7f8465400640 1 --2- 172.21.15.50:0/2918993182 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f844c0a2c90 0x7f844c0a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f846810aa90 tx=0x7f8454005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:21.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.275+0000 7f845ea00640 1 -- 172.21.15.50:0/2918993182 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f845809bc70 con 0x7f8468103ff0 2024-09-10T10:10:21.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:20 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/24458925' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T10:10:21.352 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:20 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/24458925' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T10:10:21.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.463+0000 7f846d000640 1 -- 172.21.15.50:0/2918993182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f84681a73c0 con 0x7f8468103ff0 2024-09-10T10:10:21.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.464+0000 7f845ea00640 1 -- 172.21.15.50:0/2918993182 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f845809ff70 con 0x7f8468103ff0 2024-09-10T10:10:21.465 INFO:teuthology.orchestra.run.smithi050.stdout:304942678057 2024-09-10T10:10:21.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.467+0000 7f846d000640 1 -- 172.21.15.50:0/2918993182 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f844c0a2c90 msgr2=0x7f844c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:21.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.467+0000 7f846d000640 1 --2- 172.21.15.50:0/2918993182 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f844c0a2c90 0x7f844c0a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f846810aa90 tx=0x7f8454005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:21.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.467+0000 7f846d000640 1 -- 172.21.15.50:0/2918993182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8468103ff0 msgr2=0x7f846819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:21.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.467+0000 7f846d000640 1 --2- 172.21.15.50:0/2918993182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8468103ff0 0x7f846819a640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f845800e9f0 tx=0x7f845800eeb0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.467+0000 7f846d000640 1 -- 172.21.15.50:0/2918993182 shutdown_connections 2024-09-10T10:10:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.467+0000 7f846d000640 1 --2- 172.21.15.50:0/2918993182 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f844c0a2c90 0x7f844c0a5150 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.467+0000 7f846d000640 1 --2- 172.21.15.50:0/2918993182 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8468109120 0x7f846819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.467+0000 7f846d000640 1 --2- 172.21.15.50:0/2918993182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681049a0 0x7f846819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.467+0000 7f846d000640 1 --2- 172.21.15.50:0/2918993182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8468103ff0 0x7f846819a640 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.467+0000 7f846d000640 1 -- 172.21.15.50:0/2918993182 >> 172.21.15.50:0/2918993182 conn(0x7f84680ffa90 msgr2=0x7f8468100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.467+0000 7f846d000640 1 -- 172.21.15.50:0/2918993182 shutdown_connections 2024-09-10T10:10:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:21.467+0000 7f846d000640 1 -- 172.21.15.50:0/2918993182 wait complete. 2024-09-10T10:10:22.131 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:21 smithi050 ceph-mon[30354]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:10:22.131 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:21 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2140839626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T10:10:22.131 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:21 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2918993182' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T10:10:22.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:21 smithi189 ceph-mon[34999]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:10:22.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:21 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2140839626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T10:10:22.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:21 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2918993182' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T10:10:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:21 smithi084 ceph-mon[34812]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:10:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:21 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2140839626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T10:10:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:21 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2918993182' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T10:10:22.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.446+0000 7f06e9400640 1 -- 172.21.15.50:0/314369219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e41019c0 msgr2=0x7f06e4101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:22.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.446+0000 7f06e9400640 1 --2- 172.21.15.50:0/314369219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e41019c0 0x7f06e4101e20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009930 tx=0x7f06cc02a420 comp rx=0 tx=0).stop 2024-09-10T10:10:22.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.447+0000 7f06e9400640 1 -- 172.21.15.50:0/314369219 shutdown_connections 2024-09-10T10:10:22.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.447+0000 7f06e9400640 1 --2- 172.21.15.50:0/314369219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06e4102360 0x7f06e410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:22.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.447+0000 7f06e9400640 1 --2- 172.21.15.50:0/314369219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e41019c0 0x7f06e4101e20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:22.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.447+0000 7f06e9400640 1 --2- 172.21.15.50:0/314369219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06e41079c0 0x7f06e4107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.447+0000 7f06e9400640 1 -- 172.21.15.50:0/314369219 >> 172.21.15.50:0/314369219 conn(0x7f06e40fd6e0 msgr2=0x7f06e40ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.447+0000 7f06e9400640 1 -- 172.21.15.50:0/314369219 shutdown_connections 2024-09-10T10:10:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.447+0000 7f06e9400640 1 -- 172.21.15.50:0/314369219 wait complete. 2024-09-10T10:10:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.448+0000 7f06e9400640 1 Processor -- start 2024-09-10T10:10:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.448+0000 7f06e9400640 1 -- start start 2024-09-10T10:10:22.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.448+0000 7f06e9400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06e41019c0 0x7f06e419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:22.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.448+0000 7f06e9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e4102360 0x7f06e419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:22.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.448+0000 7f06e9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06e41079c0 0x7f06e419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:22.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.448+0000 7f06e9400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f06e4111e10 con 0x7f06e4102360 2024-09-10T10:10:22.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.448+0000 7f06e9400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f06e4111c90 con 0x7f06e41079c0 2024-09-10T10:10:22.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.448+0000 7f06e9400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f06e4111f90 con 0x7f06e41019c0 2024-09-10T10:10:22.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.449+0000 7f06e8a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06e41079c0 0x7f06e419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:22.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.449+0000 7f06e3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06e41019c0 0x7f06e419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:22.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.449+0000 7f06e8a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06e41079c0 0x7f06e419ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:33472/0 (socket says 172.21.15.50:33472) 2024-09-10T10:10:22.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.449+0000 7f06e8a00640 1 -- 172.21.15.50:0/2161182119 learned_addr learned my addr 172.21.15.50:0/2161182119 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:22.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.449+0000 7f06db400640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e4102360 0x7f06e419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:22.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.449+0000 7f06e8a00640 1 -- 172.21.15.50:0/2161182119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06e41019c0 msgr2=0x7f06e419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:22.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.449+0000 7f06e8a00640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06e41019c0 0x7f06e419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:22.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.449+0000 7f06e8a00640 1 -- 172.21.15.50:0/2161182119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e4102360 msgr2=0x7f06e419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:22.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.449+0000 7f06e8a00640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e4102360 0x7f06e419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:22.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.449+0000 7f06e8a00640 1 -- 172.21.15.50:0/2161182119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e419f440 con 0x7f06e41079c0 2024-09-10T10:10:22.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.449+0000 7f06e3e00640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06e41019c0 0x7f06e419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:22.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.449+0000 7f06db400640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e4102360 0x7f06e419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:10:22.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.450+0000 7f06e8a00640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06e41079c0 0x7f06e419ed60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00eb10 tx=0x7f06dc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:22.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.450+0000 7f06e1600640 1 -- 172.21.15.50:0/2161182119 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc004b20 con 0x7f06e41079c0 2024-09-10T10:10:22.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.450+0000 7f06e1600640 1 -- 172.21.15.50:0/2161182119 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06dc004cc0 con 0x7f06e41079c0 2024-09-10T10:10:22.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.450+0000 7f06e9400640 1 -- 172.21.15.50:0/2161182119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e419f730 con 0x7f06e41079c0 2024-09-10T10:10:22.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.450+0000 7f06e1600640 1 -- 172.21.15.50:0/2161182119 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc010760 con 0x7f06e41079c0 2024-09-10T10:10:22.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.450+0000 7f06e9400640 1 -- 172.21.15.50:0/2161182119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e41a7010 con 0x7f06e41079c0 2024-09-10T10:10:22.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.452+0000 7f06e9400640 1 -- 172.21.15.50:0/2161182119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e4101e20 con 0x7f06e41079c0 2024-09-10T10:10:22.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.453+0000 7f06e1600640 1 -- 172.21.15.50:0/2161182119 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f06dc005020 con 0x7f06e41079c0 2024-09-10T10:10:22.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.454+0000 7f06e1600640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f06c80a2c90 0x7f06c80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:22.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.455+0000 7f06e1600640 1 -- 172.21.15.50:0/2161182119 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f06dc0cfc90 con 0x7f06e41079c0 2024-09-10T10:10:22.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.455+0000 7f06e3e00640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f06c80a2c90 0x7f06c80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:22.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.455+0000 7f06e3e00640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f06c80a2c90 0x7f06c80a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009f40 tx=0x7f06d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:22.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.458+0000 7f06e1600640 1 -- 172.21.15.50:0/2161182119 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06dc09c6a0 con 0x7f06e41079c0 2024-09-10T10:10:22.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.650+0000 7f06e9400640 1 -- 172.21.15.50:0/2161182119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f06e41a7270 con 0x7f06e41079c0 2024-09-10T10:10:22.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.650+0000 7f06e1600640 1 -- 172.21.15.50:0/2161182119 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f06dc09bfa0 con 0x7f06e41079c0 2024-09-10T10:10:22.652 INFO:teuthology.orchestra.run.smithi050.stdout:146028888137 2024-09-10T10:10:22.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.653+0000 7f06e9400640 1 -- 172.21.15.50:0/2161182119 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f06c80a2c90 msgr2=0x7f06c80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:22.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.653+0000 7f06e9400640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f06c80a2c90 0x7f06c80a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009f40 tx=0x7f06d4005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.653+0000 7f06e9400640 1 -- 172.21.15.50:0/2161182119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06e41079c0 msgr2=0x7f06e419ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.653+0000 7f06e9400640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06e41079c0 0x7f06e419ed60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00eb10 tx=0x7f06dc00c2d0 comp rx=0 tx=0).stop 2024-09-10T10:10:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.653+0000 7f06e9400640 1 -- 172.21.15.50:0/2161182119 shutdown_connections 2024-09-10T10:10:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.653+0000 7f06e9400640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f06c80a2c90 0x7f06c80a5150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.653+0000 7f06e9400640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06e41079c0 0x7f06e419ed60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.653+0000 7f06e9400640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e4102360 0x7f06e419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.653+0000 7f06e9400640 1 --2- 172.21.15.50:0/2161182119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06e41019c0 0x7f06e419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.653+0000 7f06e9400640 1 -- 172.21.15.50:0/2161182119 >> 172.21.15.50:0/2161182119 conn(0x7f06e40fd6e0 msgr2=0x7f06e410d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.653+0000 7f06e9400640 1 -- 172.21.15.50:0/2161182119 shutdown_connections 2024-09-10T10:10:22.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.653+0000 7f06e9400640 1 -- 172.21.15.50:0/2161182119 wait complete. 2024-09-10T10:10:23.081 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:22 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2161182119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T10:10:23.234 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411411 got 77309411414 for osd.2 2024-09-10T10:10:23.234 DEBUG:teuthology.parallel:result is None 2024-09-10T10:10:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.883+0000 7f4480a00640 1 -- 172.21.15.50:0/3970154913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f447c104800 msgr2=0x7f447c108960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.883+0000 7f4480a00640 1 --2- 172.21.15.50:0/3970154913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f447c104800 0x7f447c108960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4464009900 tx=0x7f446402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:10:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.884+0000 7f4480a00640 1 -- 172.21.15.50:0/3970154913 shutdown_connections 2024-09-10T10:10:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.884+0000 7f4480a00640 1 --2- 172.21.15.50:0/3970154913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447c109090 0x7f447c110c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.884+0000 7f4480a00640 1 --2- 172.21.15.50:0/3970154913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f447c104800 0x7f447c108960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.884+0000 7f4480a00640 1 --2- 172.21.15.50:0/3970154913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f447c103e50 0x7f447c104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.884+0000 7f4480a00640 1 -- 172.21.15.50:0/3970154913 >> 172.21.15.50:0/3970154913 conn(0x7f447c0ff8b0 msgr2=0x7f447c101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.884+0000 7f4480a00640 1 -- 172.21.15.50:0/3970154913 shutdown_connections 2024-09-10T10:10:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.884+0000 7f4480a00640 1 -- 172.21.15.50:0/3970154913 wait complete. 2024-09-10T10:10:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.885+0000 7f4480a00640 1 Processor -- start 2024-09-10T10:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.885+0000 7f4480a00640 1 -- start start 2024-09-10T10:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f4480a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f447c103e50 0x7f447c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f4480a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447c104800 0x7f447c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f4480a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f447c109090 0x7f447c19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f4480a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1140e0 con 0x7f447c103e50 2024-09-10T10:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f4480a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f447c113f60 con 0x7f447c104800 2024-09-10T10:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f4480a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f447c114260 con 0x7f447c109090 2024-09-10T10:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f447a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f447c103e50 0x7f447c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f447a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f447c103e50 0x7f447c19a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57722/0 (socket says 172.21.15.50:57722) 2024-09-10T10:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f447a800640 1 -- 172.21.15.50:0/4010381223 learned_addr learned my addr 172.21.15.50:0/4010381223 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f4473e00640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447c104800 0x7f447c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f447b200640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f447c109090 0x7f447c19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f447a800640 1 -- 172.21.15.50:0/4010381223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f447c109090 msgr2=0x7f447c19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f447a800640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f447c109090 0x7f447c19ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f447a800640 1 -- 172.21.15.50:0/4010381223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447c104800 msgr2=0x7f447c19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f447a800640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447c104800 0x7f447c19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f447a800640 1 -- 172.21.15.50:0/4010381223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447c19f570 con 0x7f447c103e50 2024-09-10T10:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.886+0000 7f4473e00640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447c104800 0x7f447c19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.887+0000 7f447a800640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f447c103e50 0x7f447c19a5c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f446c00e9f0 tx=0x7f446c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.887+0000 7f4473400640 1 -- 172.21.15.50:0/4010381223 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c00cd80 con 0x7f447c103e50 2024-09-10T10:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.887+0000 7f4480a00640 1 -- 172.21.15.50:0/4010381223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447c19f860 con 0x7f447c103e50 2024-09-10T10:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.887+0000 7f4473400640 1 -- 172.21.15.50:0/4010381223 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f446c010910 con 0x7f447c103e50 2024-09-10T10:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.887+0000 7f4473400640 1 -- 172.21.15.50:0/4010381223 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c0188f0 con 0x7f447c103e50 2024-09-10T10:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.887+0000 7f4480a00640 1 -- 172.21.15.50:0/4010381223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447c1a7140 con 0x7f447c103e50 2024-09-10T10:10:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.888+0000 7f4480a00640 1 -- 172.21.15.50:0/4010381223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f447c105330 con 0x7f447c103e50 2024-09-10T10:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.891+0000 7f4473400640 1 -- 172.21.15.50:0/4010381223 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f446c010ac0 con 0x7f447c103e50 2024-09-10T10:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.892+0000 7f4473400640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f44600a2c10 0x7f44600a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.892+0000 7f4473400640 1 -- 172.21.15.50:0/4010381223 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f446c0cfd50 con 0x7f447c103e50 2024-09-10T10:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.892+0000 7f4473e00640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f44600a2c10 0x7f44600a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.893+0000 7f4473e00640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f44600a2c10 0x7f44600a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4464000c00 tx=0x7f4464031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:22.894+0000 7f4473400640 1 -- 172.21.15.50:0/4010381223 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f446c09c110 con 0x7f447c103e50 2024-09-10T10:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.079+0000 7f4480a00640 1 -- 172.21.15.50:0/4010381223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f447c10c2d0 con 0x7f447c103e50 2024-09-10T10:10:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.079+0000 7f4473400640 1 -- 172.21.15.50:0/4010381223 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f446c0a0410 con 0x7f447c103e50 2024-09-10T10:10:23.312 INFO:teuthology.orchestra.run.smithi050.stdout:34359738465 2024-09-10T10:10:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.082+0000 7f4480a00640 1 -- 172.21.15.50:0/4010381223 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f44600a2c10 msgr2=0x7f44600a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.082+0000 7f4480a00640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f44600a2c10 0x7f44600a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4464000c00 tx=0x7f4464031510 comp rx=0 tx=0).stop 2024-09-10T10:10:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.082+0000 7f4480a00640 1 -- 172.21.15.50:0/4010381223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f447c103e50 msgr2=0x7f447c19a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.082+0000 7f4480a00640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f447c103e50 0x7f447c19a5c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f446c00e9f0 tx=0x7f446c00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:10:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.082+0000 7f4480a00640 1 -- 172.21.15.50:0/4010381223 shutdown_connections 2024-09-10T10:10:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.082+0000 7f4480a00640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f44600a2c10 0x7f44600a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:23.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.082+0000 7f4480a00640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f447c109090 0x7f447c19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:23.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.082+0000 7f4480a00640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f447c104800 0x7f447c19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:23.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.082+0000 7f4480a00640 1 --2- 172.21.15.50:0/4010381223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f447c103e50 0x7f447c19a5c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:23.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.082+0000 7f4480a00640 1 -- 172.21.15.50:0/4010381223 >> 172.21.15.50:0/4010381223 conn(0x7f447c0ff8b0 msgr2=0x7f447c100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:23.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.082+0000 7f4480a00640 1 -- 172.21.15.50:0/4010381223 shutdown_connections 2024-09-10T10:10:23.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:23.082+0000 7f4480a00640 1 -- 172.21.15.50:0/4010381223 wait complete. 2024-09-10T10:10:23.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:22 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2161182119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T10:10:23.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:22 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2161182119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T10:10:24.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:23 smithi050 ceph-mon[30354]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:24.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:23 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4010381223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T10:10:24.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:23 smithi189 ceph-mon[34999]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:24.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:23 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4010381223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T10:10:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:23 smithi084 ceph-mon[34812]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:23 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4010381223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T10:10:24.712 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738461 got 34359738465 for osd.0 2024-09-10T10:10:24.712 DEBUG:teuthology.parallel:result is None 2024-09-10T10:10:25.049 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888134 got 146028888137 for osd.4 2024-09-10T10:10:25.049 DEBUG:teuthology.parallel:result is None 2024-09-10T10:10:25.191 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678055 got 304942678057 for osd.10 2024-09-10T10:10:25.192 DEBUG:teuthology.parallel:result is None 2024-09-10T10:10:25.646 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462972 got 201863462975 for osd.6 2024-09-10T10:10:25.647 DEBUG:teuthology.parallel:result is None 2024-09-10T10:10:25.647 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T10:10:25.647 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:10:26.025 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:26.165 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:25 smithi050 ceph-mon[30354]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:10:26.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:25 smithi189 ceph-mon[34999]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:10:26.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:25 smithi084 ceph-mon[34812]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.589+0000 7f751f200640 1 -- 172.21.15.50:0/578647515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75181049a0 msgr2=0x7f75181089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.589+0000 7f751f200640 1 --2- 172.21.15.50:0/578647515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75181049a0 0x7f75181089f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7500009900 tx=0x7f750002a410 comp rx=0 tx=0).stop 2024-09-10T10:10:26.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.589+0000 7f751f200640 1 -- 172.21.15.50:0/578647515 shutdown_connections 2024-09-10T10:10:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.589+0000 7f751f200640 1 --2- 172.21.15.50:0/578647515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7518109120 0x7f7518110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.589+0000 7f751f200640 1 --2- 172.21.15.50:0/578647515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75181049a0 0x7f75181089f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.589+0000 7f751f200640 1 --2- 172.21.15.50:0/578647515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7518103ff0 0x7f75181043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.589+0000 7f751f200640 1 -- 172.21.15.50:0/578647515 >> 172.21.15.50:0/578647515 conn(0x7f75180ffa90 msgr2=0x7f7518101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.589+0000 7f751f200640 1 -- 172.21.15.50:0/578647515 shutdown_connections 2024-09-10T10:10:26.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.589+0000 7f751f200640 1 -- 172.21.15.50:0/578647515 wait complete. 2024-09-10T10:10:26.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.590+0000 7f751f200640 1 Processor -- start 2024-09-10T10:10:26.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.590+0000 7f751f200640 1 -- start start 2024-09-10T10:10:26.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.590+0000 7f751f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7518103ff0 0x7f751819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:26.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.590+0000 7f751f200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75181049a0 0x7f751819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.590+0000 7f751f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7518109120 0x7f751819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.590+0000 7f751f200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7518114190 con 0x7f75181049a0 2024-09-10T10:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.590+0000 7f751f200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7518114010 con 0x7f7518109120 2024-09-10T10:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.590+0000 7f751f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7518114310 con 0x7f7518103ff0 2024-09-10T10:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.591+0000 7f750fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75181049a0 0x7f751819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.591+0000 7f750fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75181049a0 0x7f751819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57732/0 (socket says 172.21.15.50:57732) 2024-09-10T10:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.591+0000 7f750fe00640 1 -- 172.21.15.50:0/3168179176 learned_addr learned my addr 172.21.15.50:0/3168179176 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.591+0000 7f751d200640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7518109120 0x7f751819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.591+0000 7f7517e00640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7518103ff0 0x7f751819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.591+0000 7f751d200640 1 -- 172.21.15.50:0/3168179176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7518103ff0 msgr2=0x7f751819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.591+0000 7f751d200640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7518103ff0 0x7f751819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.591+0000 7f751d200640 1 -- 172.21.15.50:0/3168179176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75181049a0 msgr2=0x7f751819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:26.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.591+0000 7f751d200640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75181049a0 0x7f751819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:26.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.591+0000 7f751d200640 1 -- 172.21.15.50:0/3168179176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751819f5a0 con 0x7f7518109120 2024-09-10T10:10:26.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.591+0000 7f750fe00640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75181049a0 0x7f751819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:26.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.591+0000 7f751d200640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7518109120 0x7f751819eec0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7510009fd0 tx=0x7f751000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:26.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.592+0000 7f7515600640 1 -- 172.21.15.50:0/3168179176 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751000ce20 con 0x7f7518109120 2024-09-10T10:10:26.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.592+0000 7f751f200640 1 -- 172.21.15.50:0/3168179176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751819f890 con 0x7f7518109120 2024-09-10T10:10:26.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.592+0000 7f7515600640 1 -- 172.21.15.50:0/3168179176 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7510005020 con 0x7f7518109120 2024-09-10T10:10:26.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.592+0000 7f7515600640 1 -- 172.21.15.50:0/3168179176 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7510010720 con 0x7f7518109120 2024-09-10T10:10:26.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.592+0000 7f751f200640 1 -- 172.21.15.50:0/3168179176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75181a7170 con 0x7f7518109120 2024-09-10T10:10:26.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.593+0000 7f751f200640 1 -- 172.21.15.50:0/3168179176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75181043d0 con 0x7f7518109120 2024-09-10T10:10:26.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.595+0000 7f7515600640 1 -- 172.21.15.50:0/3168179176 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7510005540 con 0x7f7518109120 2024-09-10T10:10:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.596+0000 7f7515600640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f74fc0a2c10 0x7f74fc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.597+0000 7f7515600640 1 -- 172.21.15.50:0/3168179176 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f75100cfc20 con 0x7f7518109120 2024-09-10T10:10:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.597+0000 7f7517e00640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f74fc0a2c10 0x7f74fc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:26.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.597+0000 7f7517e00640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f74fc0a2c10 0x7f74fc0a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7508009bd0 tx=0x7f7508005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:26.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.598+0000 7f7515600640 1 -- 172.21.15.50:0/3168179176 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f751009c6c0 con 0x7f7518109120 2024-09-10T10:10:26.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.781+0000 7f751f200640 1 -- 172.21.15.50:0/3168179176 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7518100da0 con 0x7f74fc0a2c10 2024-09-10T10:10:26.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.790+0000 7f7515600640 1 -- 172.21.15.50:0/3168179176 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340635 (secure 0 0 0) 0x7f7518100da0 con 0x7f74fc0a2c10 2024-09-10T10:10:26.797 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:10:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-10T10:10:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.795+0000 7f751f200640 1 -- 172.21.15.50:0/3168179176 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f74fc0a2c10 msgr2=0x7f74fc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.795+0000 7f751f200640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f74fc0a2c10 0x7f74fc0a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7508009bd0 tx=0x7f7508005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.795+0000 7f751f200640 1 -- 172.21.15.50:0/3168179176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7518109120 msgr2=0x7f751819eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.795+0000 7f751f200640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7518109120 0x7f751819eec0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7510009fd0 tx=0x7f751000ef10 comp rx=0 tx=0).stop 2024-09-10T10:10:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.795+0000 7f751f200640 1 -- 172.21.15.50:0/3168179176 shutdown_connections 2024-09-10T10:10:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.795+0000 7f751f200640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f74fc0a2c10 0x7f74fc0a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:26.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.795+0000 7f751f200640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7518109120 0x7f751819eec0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:26.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.795+0000 7f751f200640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75181049a0 0x7f751819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:26.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.795+0000 7f751f200640 1 --2- 172.21.15.50:0/3168179176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7518103ff0 0x7f751819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:26.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.796+0000 7f751f200640 1 -- 172.21.15.50:0/3168179176 >> 172.21.15.50:0/3168179176 conn(0x7f75180ffa90 msgr2=0x7f7518101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:26.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.796+0000 7f751f200640 1 -- 172.21.15.50:0/3168179176 shutdown_connections 2024-09-10T10:10:26.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:26.796+0000 7f751f200640 1 -- 172.21.15.50:0/3168179176 wait complete. 2024-09-10T10:10:27.530 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2024-09-10T10:10:24.782818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657074,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":485,"num_read_kb":360,"num_write":352,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":283,"ondisk_log_size":283,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361996,"kb_used_data":12680,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579828,"statfs":{"total":1151940427776,"available":1151569743872,"internally_reserved":0,"allocated":12984320,"data_stored":8406368,"data_compressed":498339,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003697"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724596+0000","last_change":"2024-09-10T10:08:32.889755+0000","last_active":"2024-09-10T10:10:00.724596+0000","last_peered":"2024-09-10T10:10:00.724596+0000","last_clean":"2024-09-10T10:10:00.724596+0000","last_became_active":"2024-09-10T10:08:32.889455+0000","last_became_peered":"2024-09-10T10:08:32.889455+0000","last_unstale":"2024-09-10T10:10:00.724596+0000","last_undegraded":"2024-09-10T10:10:00.724596+0000","last_fullsized":"2024-09-10T10:10:00.724596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:53.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.974619+0000","last_change":"2024-09-10T10:10:00.974216+0000","last_active":"2024-09-10T10:10:00.974619+0000","last_peered":"2024-09-10T10:10:00.974619+0000","last_clean":"2024-09-10T10:10:00.974619+0000","last_became_active":"2024-09-10T10:10:00.973841+0000","last_became_peered":"2024-09-10T10:10:00.973841+0000","last_unstale":"2024-09-10T10:10:00.974619+0000","last_undegraded":"2024-09-10T10:10:00.974619+0000","last_fullsized":"2024-09-10T10:10:00.974619+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:30.575610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972464+0000","last_change":"2024-09-10T10:08:44.399836+0000","last_active":"2024-09-10T10:10:00.972464+0000","last_peered":"2024-09-10T10:10:00.972464+0000","last_clean":"2024-09-10T10:10:00.972464+0000","last_became_active":"2024-09-10T10:08:44.399510+0000","last_became_peered":"2024-09-10T10:08:44.399510+0000","last_unstale":"2024-09-10T10:10:00.972464+0000","last_undegraded":"2024-09-10T10:10:00.972464+0000","last_fullsized":"2024-09-10T10:10:00.972464+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:47.372690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722195+0000","last_change":"2024-09-10T10:08:32.887099+0000","last_active":"2024-09-10T10:10:00.722195+0000","last_peered":"2024-09-10T10:10:00.722195+0000","last_clean":"2024-09-10T10:10:00.722195+0000","last_became_active":"2024-09-10T10:08:32.886730+0000","last_became_peered":"2024-09-10T10:08:32.886730+0000","last_unstale":"2024-09-10T10:10:00.722195+0000","last_undegraded":"2024-09-10T10:10:00.722195+0000","last_fullsized":"2024-09-10T10:10:00.722195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.277241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.939029+0000","last_change":"2024-09-10T10:08:35.375494+0000","last_active":"2024-09-10T10:10:00.939029+0000","last_peered":"2024-09-10T10:10:00.939029+0000","last_clean":"2024-09-10T10:10:00.939029+0000","last_became_active":"2024-09-10T10:08:35.373991+0000","last_became_peered":"2024-09-10T10:08:35.373991+0000","last_unstale":"2024-09-10T10:10:00.939029+0000","last_undegraded":"2024-09-10T10:10:00.939029+0000","last_fullsized":"2024-09-10T10:10:00.939029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:25.858163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721497+0000","last_change":"2024-09-10T10:09:00.457967+0000","last_active":"2024-09-10T10:10:00.721497+0000","last_peered":"2024-09-10T10:10:00.721497+0000","last_clean":"2024-09-10T10:10:00.721497+0000","last_became_active":"2024-09-10T10:09:00.457446+0000","last_became_peered":"2024-09-10T10:09:00.457446+0000","last_unstale":"2024-09-10T10:10:00.721497+0000","last_undegraded":"2024-09-10T10:10:00.721497+0000","last_fullsized":"2024-09-10T10:10:00.721497+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:00.550304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722766+0000","last_change":"2024-09-10T10:08:32.890270+0000","last_active":"2024-09-10T10:10:00.722766+0000","last_peered":"2024-09-10T10:10:00.722766+0000","last_clean":"2024-09-10T10:10:00.722766+0000","last_became_active":"2024-09-10T10:08:32.889887+0000","last_became_peered":"2024-09-10T10:08:32.889887+0000","last_unstale":"2024-09-10T10:10:00.722766+0000","last_undegraded":"2024-09-10T10:10:00.722766+0000","last_fullsized":"2024-09-10T10:10:00.722766+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:39.757510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862316+0000","last_change":"2024-09-10T10:08:35.357257+0000","last_active":"2024-09-10T10:10:00.862316+0000","last_peered":"2024-09-10T10:10:00.862316+0000","last_clean":"2024-09-10T10:10:00.862316+0000","last_became_active":"2024-09-10T10:08:35.356918+0000","last_became_peered":"2024-09-10T10:08:35.356918+0000","last_unstale":"2024-09-10T10:10:00.862316+0000","last_undegraded":"2024-09-10T10:10:00.862316+0000","last_fullsized":"2024-09-10T10:10:00.862316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:04.387581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721937+0000","last_change":"2024-09-10T10:09:00.487116+0000","last_active":"2024-09-10T10:10:00.721937+0000","last_peered":"2024-09-10T10:10:00.721937+0000","last_clean":"2024-09-10T10:10:00.721937+0000","last_became_active":"2024-09-10T10:09:00.486646+0000","last_became_peered":"2024-09-10T10:09:00.486646+0000","last_unstale":"2024-09-10T10:10:00.721937+0000","last_undegraded":"2024-09-10T10:10:00.721937+0000","last_fullsized":"2024-09-10T10:10:00.721937+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:40.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722841+0000","last_change":"2024-09-10T10:08:32.891399+0000","last_active":"2024-09-10T10:10:00.722841+0000","last_peered":"2024-09-10T10:10:00.722841+0000","last_clean":"2024-09-10T10:10:00.722841+0000","last_became_active":"2024-09-10T10:08:32.891022+0000","last_became_peered":"2024-09-10T10:08:32.891022+0000","last_unstale":"2024-09-10T10:10:00.722841+0000","last_undegraded":"2024-09-10T10:10:00.722841+0000","last_fullsized":"2024-09-10T10:10:00.722841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:30.842443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840315+0000","last_change":"2024-09-10T10:08:35.370630+0000","last_active":"2024-09-10T10:10:00.840315+0000","last_peered":"2024-09-10T10:10:00.840315+0000","last_clean":"2024-09-10T10:10:00.840315+0000","last_became_active":"2024-09-10T10:08:35.370263+0000","last_became_peered":"2024-09-10T10:08:35.370263+0000","last_unstale":"2024-09-10T10:10:00.840315+0000","last_undegraded":"2024-09-10T10:10:00.840315+0000","last_fullsized":"2024-09-10T10:10:00.840315+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:41.549815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721632+0000","last_change":"2024-09-10T10:08:44.405298+0000","last_active":"2024-09-10T10:10:00.721632+0000","last_peered":"2024-09-10T10:10:00.721632+0000","last_clean":"2024-09-10T10:10:00.721632+0000","last_became_active":"2024-09-10T10:08:44.405027+0000","last_became_peered":"2024-09-10T10:08:44.405027+0000","last_unstale":"2024-09-10T10:10:00.721632+0000","last_undegraded":"2024-09-10T10:10:00.721632+0000","last_fullsized":"2024-09-10T10:10:00.721632+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:08.486563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185348+0000","last_change":"2024-09-10T10:08:35.369040+0000","last_active":"2024-09-10T10:10:01.185348+0000","last_peered":"2024-09-10T10:10:01.185348+0000","last_clean":"2024-09-10T10:10:01.185348+0000","last_became_active":"2024-09-10T10:08:35.368576+0000","last_became_peered":"2024-09-10T10:08:35.368576+0000","last_unstale":"2024-09-10T10:10:01.185348+0000","last_undegraded":"2024-09-10T10:10:01.185348+0000","last_fullsized":"2024-09-10T10:10:01.185348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:44.887554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722320+0000","last_change":"2024-09-10T10:08:32.889549+0000","last_active":"2024-09-10T10:10:00.722320+0000","last_peered":"2024-09-10T10:10:00.722320+0000","last_clean":"2024-09-10T10:10:00.722320+0000","last_became_active":"2024-09-10T10:08:32.889197+0000","last_became_peered":"2024-09-10T10:08:32.889197+0000","last_unstale":"2024-09-10T10:10:00.722320+0000","last_undegraded":"2024-09-10T10:10:00.722320+0000","last_fullsized":"2024-09-10T10:10:00.722320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:53.697069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721918+0000","last_change":"2024-09-10T10:08:44.929048+0000","last_active":"2024-09-10T10:10:00.721918+0000","last_peered":"2024-09-10T10:10:00.721918+0000","last_clean":"2024-09-10T10:10:00.721918+0000","last_became_active":"2024-09-10T10:08:44.928345+0000","last_became_peered":"2024-09-10T10:08:44.928345+0000","last_unstale":"2024-09-10T10:10:00.721918+0000","last_undegraded":"2024-09-10T10:10:00.721918+0000","last_fullsized":"2024-09-10T10:10:00.721918+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:23.121853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721372+0000","last_change":"2024-09-10T10:08:35.377385+0000","last_active":"2024-09-10T10:10:00.721372+0000","last_peered":"2024-09-10T10:10:00.721372+0000","last_clean":"2024-09-10T10:10:00.721372+0000","last_became_active":"2024-09-10T10:08:35.377092+0000","last_became_peered":"2024-09-10T10:08:35.377092+0000","last_unstale":"2024-09-10T10:10:00.721372+0000","last_undegraded":"2024-09-10T10:10:00.721372+0000","last_fullsized":"2024-09-10T10:10:00.721372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:23.169370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972261+0000","last_change":"2024-09-10T10:08:32.891614+0000","last_active":"2024-09-10T10:10:00.972261+0000","last_peered":"2024-09-10T10:10:00.972261+0000","last_clean":"2024-09-10T10:10:00.972261+0000","last_became_active":"2024-09-10T10:08:32.891141+0000","last_became_peered":"2024-09-10T10:08:32.891141+0000","last_unstale":"2024-09-10T10:10:00.972261+0000","last_undegraded":"2024-09-10T10:10:00.972261+0000","last_fullsized":"2024-09-10T10:10:00.972261+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:20.258863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721871+0000","last_change":"2024-09-10T10:08:44.401125+0000","last_active":"2024-09-10T10:10:00.721871+0000","last_peered":"2024-09-10T10:10:00.721871+0000","last_clean":"2024-09-10T10:10:00.721871+0000","last_became_active":"2024-09-10T10:08:44.400483+0000","last_became_peered":"2024-09-10T10:08:44.400483+0000","last_unstale":"2024-09-10T10:10:00.721871+0000","last_undegraded":"2024-09-10T10:10:00.721871+0000","last_fullsized":"2024-09-10T10:10:00.721871+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:12.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185284+0000","last_change":"2024-09-10T10:08:35.376806+0000","last_active":"2024-09-10T10:10:01.185284+0000","last_peered":"2024-09-10T10:10:01.185284+0000","last_clean":"2024-09-10T10:10:01.185284+0000","last_became_active":"2024-09-10T10:08:35.376400+0000","last_became_peered":"2024-09-10T10:08:35.376400+0000","last_unstale":"2024-09-10T10:10:01.185284+0000","last_undegraded":"2024-09-10T10:10:01.185284+0000","last_fullsized":"2024-09-10T10:10:01.185284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:48.303039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721519+0000","last_change":"2024-09-10T10:08:32.883881+0000","last_active":"2024-09-10T10:10:00.721519+0000","last_peered":"2024-09-10T10:10:00.721519+0000","last_clean":"2024-09-10T10:10:00.721519+0000","last_became_active":"2024-09-10T10:08:32.883540+0000","last_became_peered":"2024-09-10T10:08:32.883540+0000","last_unstale":"2024-09-10T10:10:00.721519+0000","last_undegraded":"2024-09-10T10:10:00.721519+0000","last_fullsized":"2024-09-10T10:10:00.721519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:57.359729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724274+0000","last_change":"2024-09-10T10:08:44.401548+0000","last_active":"2024-09-10T10:10:00.724274+0000","last_peered":"2024-09-10T10:10:00.724274+0000","last_clean":"2024-09-10T10:10:00.724274+0000","last_became_active":"2024-09-10T10:08:44.401034+0000","last_became_peered":"2024-09-10T10:08:44.401034+0000","last_unstale":"2024-09-10T10:10:00.724274+0000","last_undegraded":"2024-09-10T10:10:00.724274+0000","last_fullsized":"2024-09-10T10:10:00.724274+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:17.292973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722142+0000","last_change":"2024-09-10T10:08:35.359969+0000","last_active":"2024-09-10T10:10:00.722142+0000","last_peered":"2024-09-10T10:10:00.722142+0000","last_clean":"2024-09-10T10:10:00.722142+0000","last_became_active":"2024-09-10T10:08:35.359599+0000","last_became_peered":"2024-09-10T10:08:35.359599+0000","last_unstale":"2024-09-10T10:10:00.722142+0000","last_undegraded":"2024-09-10T10:10:00.722142+0000","last_fullsized":"2024-09-10T10:10:00.722142+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:00.778269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862109+0000","last_change":"2024-09-10T10:09:00.487582+0000","last_active":"2024-09-10T10:10:00.862109+0000","last_peered":"2024-09-10T10:10:00.862109+0000","last_clean":"2024-09-10T10:10:00.862109+0000","last_became_active":"2024-09-10T10:09:00.487229+0000","last_became_peered":"2024-09-10T10:09:00.487229+0000","last_unstale":"2024-09-10T10:10:00.862109+0000","last_undegraded":"2024-09-10T10:10:00.862109+0000","last_fullsized":"2024-09-10T10:10:00.862109+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:53.341736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722009+0000","last_change":"2024-09-10T10:08:44.929224+0000","last_active":"2024-09-10T10:10:00.722009+0000","last_peered":"2024-09-10T10:10:00.722009+0000","last_clean":"2024-09-10T10:10:00.722009+0000","last_became_active":"2024-09-10T10:08:44.928640+0000","last_became_peered":"2024-09-10T10:08:44.928640+0000","last_unstale":"2024-09-10T10:10:00.722009+0000","last_undegraded":"2024-09-10T10:10:00.722009+0000","last_fullsized":"2024-09-10T10:10:00.722009+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:42.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938766+0000","last_change":"2024-09-10T10:08:35.376585+0000","last_active":"2024-09-10T10:10:00.938766+0000","last_peered":"2024-09-10T10:10:00.938766+0000","last_clean":"2024-09-10T10:10:00.938766+0000","last_became_active":"2024-09-10T10:08:35.375693+0000","last_became_peered":"2024-09-10T10:08:35.375693+0000","last_unstale":"2024-09-10T10:10:00.938766+0000","last_undegraded":"2024-09-10T10:10:00.938766+0000","last_fullsized":"2024-09-10T10:10:00.938766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:59.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722265+0000","last_change":"2024-09-10T10:08:32.884542+0000","last_active":"2024-09-10T10:10:00.722265+0000","last_peered":"2024-09-10T10:10:00.722265+0000","last_clean":"2024-09-10T10:10:00.722265+0000","last_became_active":"2024-09-10T10:08:32.884192+0000","last_became_peered":"2024-09-10T10:08:32.884192+0000","last_unstale":"2024-09-10T10:10:00.722265+0000","last_undegraded":"2024-09-10T10:10:00.722265+0000","last_fullsized":"2024-09-10T10:10:00.722265+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:57.756641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972592+0000","last_change":"2024-09-10T10:08:44.391514+0000","last_active":"2024-09-10T10:10:00.972592+0000","last_peered":"2024-09-10T10:10:00.972592+0000","last_clean":"2024-09-10T10:10:00.972592+0000","last_became_active":"2024-09-10T10:08:44.391116+0000","last_became_peered":"2024-09-10T10:08:44.391116+0000","last_unstale":"2024-09-10T10:10:00.972592+0000","last_undegraded":"2024-09-10T10:10:00.972592+0000","last_fullsized":"2024-09-10T10:10:00.972592+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:41.586014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722193+0000","last_change":"2024-09-10T10:08:35.365604+0000","last_active":"2024-09-10T10:10:00.722193+0000","last_peered":"2024-09-10T10:10:00.722193+0000","last_clean":"2024-09-10T10:10:00.722193+0000","last_became_active":"2024-09-10T10:08:35.364915+0000","last_became_peered":"2024-09-10T10:08:35.364915+0000","last_unstale":"2024-09-10T10:10:00.722193+0000","last_undegraded":"2024-09-10T10:10:00.722193+0000","last_fullsized":"2024-09-10T10:10:00.722193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:12.885021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'11","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724849+0000","last_change":"2024-09-10T10:08:32.888223+0000","last_active":"2024-09-10T10:10:00.724849+0000","last_peered":"2024-09-10T10:10:00.724849+0000","last_clean":"2024-09-10T10:10:00.724849+0000","last_became_active":"2024-09-10T10:08:32.887919+0000","last_became_peered":"2024-09-10T10:08:32.887919+0000","last_unstale":"2024-09-10T10:10:00.724849+0000","last_undegraded":"2024-09-10T10:10:00.724849+0000","last_fullsized":"2024-09-10T10:10:00.724849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:19.781337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721010+0000","last_change":"2024-09-10T10:08:44.929322+0000","last_active":"2024-09-10T10:10:00.721010+0000","last_peered":"2024-09-10T10:10:00.721010+0000","last_clean":"2024-09-10T10:10:00.721010+0000","last_became_active":"2024-09-10T10:08:44.928252+0000","last_became_peered":"2024-09-10T10:08:44.928252+0000","last_unstale":"2024-09-10T10:10:00.721010+0000","last_undegraded":"2024-09-10T10:10:00.721010+0000","last_fullsized":"2024-09-10T10:10:00.721010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:33.048265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040381+0000","last_change":"2024-09-10T10:08:35.364168+0000","last_active":"2024-09-10T10:10:01.040381+0000","last_peered":"2024-09-10T10:10:01.040381+0000","last_clean":"2024-09-10T10:10:01.040381+0000","last_became_active":"2024-09-10T10:08:35.363739+0000","last_became_peered":"2024-09-10T10:08:35.363739+0000","last_unstale":"2024-09-10T10:10:01.040381+0000","last_undegraded":"2024-09-10T10:10:01.040381+0000","last_fullsized":"2024-09-10T10:10:01.040381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:43.029409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722777+0000","last_change":"2024-09-10T10:08:32.893021+0000","last_active":"2024-09-10T10:10:00.722777+0000","last_peered":"2024-09-10T10:10:00.722777+0000","last_clean":"2024-09-10T10:10:00.722777+0000","last_became_active":"2024-09-10T10:08:32.892667+0000","last_became_peered":"2024-09-10T10:08:32.892667+0000","last_unstale":"2024-09-10T10:10:00.722777+0000","last_undegraded":"2024-09-10T10:10:00.722777+0000","last_fullsized":"2024-09-10T10:10:00.722777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:52.427489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185519+0000","last_change":"2024-09-10T10:08:44.393831+0000","last_active":"2024-09-10T10:10:01.185519+0000","last_peered":"2024-09-10T10:10:01.185519+0000","last_clean":"2024-09-10T10:10:01.185519+0000","last_became_active":"2024-09-10T10:08:44.393415+0000","last_became_peered":"2024-09-10T10:08:44.393415+0000","last_unstale":"2024-09-10T10:10:01.185519+0000","last_undegraded":"2024-09-10T10:10:01.185519+0000","last_fullsized":"2024-09-10T10:10:01.185519+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:52.171292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.110344+0000","last_change":"2024-09-10T10:08:35.374787+0000","last_active":"2024-09-10T10:10:01.110344+0000","last_peered":"2024-09-10T10:10:01.110344+0000","last_clean":"2024-09-10T10:10:01.110344+0000","last_became_active":"2024-09-10T10:08:35.374549+0000","last_became_peered":"2024-09-10T10:08:35.374549+0000","last_unstale":"2024-09-10T10:10:01.110344+0000","last_undegraded":"2024-09-10T10:10:01.110344+0000","last_fullsized":"2024-09-10T10:10:01.110344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:58.925515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724378+0000","last_change":"2024-09-10T10:08:32.886267+0000","last_active":"2024-09-10T10:10:00.724378+0000","last_peered":"2024-09-10T10:10:00.724378+0000","last_clean":"2024-09-10T10:10:00.724378+0000","last_became_active":"2024-09-10T10:08:32.885869+0000","last_became_peered":"2024-09-10T10:08:32.885869+0000","last_unstale":"2024-09-10T10:10:00.724378+0000","last_undegraded":"2024-09-10T10:10:00.724378+0000","last_fullsized":"2024-09-10T10:10:00.724378+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:06.784839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722177+0000","last_change":"2024-09-10T10:09:00.486656+0000","last_active":"2024-09-10T10:10:00.722177+0000","last_peered":"2024-09-10T10:10:00.722177+0000","last_clean":"2024-09-10T10:10:00.722177+0000","last_became_active":"2024-09-10T10:09:00.486072+0000","last_became_peered":"2024-09-10T10:09:00.486072+0000","last_unstale":"2024-09-10T10:10:00.722177+0000","last_undegraded":"2024-09-10T10:10:00.722177+0000","last_fullsized":"2024-09-10T10:10:00.722177+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:26.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.110279+0000","last_change":"2024-09-10T10:08:35.366130+0000","last_active":"2024-09-10T10:10:01.110279+0000","last_peered":"2024-09-10T10:10:01.110279+0000","last_clean":"2024-09-10T10:10:01.110279+0000","last_became_active":"2024-09-10T10:08:35.365785+0000","last_became_peered":"2024-09-10T10:08:35.365785+0000","last_unstale":"2024-09-10T10:10:01.110279+0000","last_undegraded":"2024-09-10T10:10:01.110279+0000","last_fullsized":"2024-09-10T10:10:01.110279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:35.771767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184895+0000","last_change":"2024-09-10T10:08:32.884113+0000","last_active":"2024-09-10T10:10:01.184895+0000","last_peered":"2024-09-10T10:10:01.184895+0000","last_clean":"2024-09-10T10:10:01.184895+0000","last_became_active":"2024-09-10T10:08:32.883503+0000","last_became_peered":"2024-09-10T10:08:32.883503+0000","last_unstale":"2024-09-10T10:10:01.184895+0000","last_undegraded":"2024-09-10T10:10:01.184895+0000","last_fullsized":"2024-09-10T10:10:01.184895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:20.513465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040223+0000","last_change":"2024-09-10T10:08:44.400137+0000","last_active":"2024-09-10T10:10:01.040223+0000","last_peered":"2024-09-10T10:10:01.040223+0000","last_clean":"2024-09-10T10:10:01.040223+0000","last_became_active":"2024-09-10T10:08:44.398736+0000","last_became_peered":"2024-09-10T10:08:44.398736+0000","last_unstale":"2024-09-10T10:10:01.040223+0000","last_undegraded":"2024-09-10T10:10:01.040223+0000","last_fullsized":"2024-09-10T10:10:01.040223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:48.922732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839789+0000","last_change":"2024-09-10T10:08:35.360818+0000","last_active":"2024-09-10T10:10:00.839789+0000","last_peered":"2024-09-10T10:10:00.839789+0000","last_clean":"2024-09-10T10:10:00.839789+0000","last_became_active":"2024-09-10T10:08:35.360504+0000","last_became_peered":"2024-09-10T10:08:35.360504+0000","last_unstale":"2024-09-10T10:10:00.839789+0000","last_undegraded":"2024-09-10T10:10:00.839789+0000","last_fullsized":"2024-09-10T10:10:00.839789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:45.396069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'4","reported_seq":100,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:20.621422+0000","last_change":"2024-09-10T10:08:32.883915+0000","last_active":"2024-09-10T10:10:20.621422+0000","last_peered":"2024-09-10T10:10:20.621422+0000","last_clean":"2024-09-10T10:10:20.621422+0000","last_became_active":"2024-09-10T10:08:32.883573+0000","last_became_peered":"2024-09-10T10:08:32.883573+0000","last_unstale":"2024-09-10T10:10:20.621422+0000","last_undegraded":"2024-09-10T10:10:20.621422+0000","last_fullsized":"2024-09-10T10:10:20.621422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:56.271267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040548+0000","last_change":"2024-09-10T10:08:44.928968+0000","last_active":"2024-09-10T10:10:01.040548+0000","last_peered":"2024-09-10T10:10:01.040548+0000","last_clean":"2024-09-10T10:10:01.040548+0000","last_became_active":"2024-09-10T10:08:44.928445+0000","last_became_peered":"2024-09-10T10:08:44.928445+0000","last_unstale":"2024-09-10T10:10:01.040548+0000","last_undegraded":"2024-09-10T10:10:01.040548+0000","last_fullsized":"2024-09-10T10:10:01.040548+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:01.799454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039913+0000","last_change":"2024-09-10T10:08:35.369027+0000","last_active":"2024-09-10T10:10:01.039913+0000","last_peered":"2024-09-10T10:10:01.039913+0000","last_clean":"2024-09-10T10:10:01.039913+0000","last_became_active":"2024-09-10T10:08:35.368692+0000","last_became_peered":"2024-09-10T10:08:35.368692+0000","last_unstale":"2024-09-10T10:10:01.039913+0000","last_undegraded":"2024-09-10T10:10:01.039913+0000","last_fullsized":"2024-09-10T10:10:01.039913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:09.500617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184735+0000","last_change":"2024-09-10T10:08:32.888661+0000","last_active":"2024-09-10T10:10:01.184735+0000","last_peered":"2024-09-10T10:10:01.184735+0000","last_clean":"2024-09-10T10:10:01.184735+0000","last_became_active":"2024-09-10T10:08:32.888312+0000","last_became_peered":"2024-09-10T10:08:32.888312+0000","last_unstale":"2024-09-10T10:10:01.184735+0000","last_undegraded":"2024-09-10T10:10:01.184735+0000","last_fullsized":"2024-09-10T10:10:01.184735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:47.293560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840320+0000","last_change":"2024-09-10T10:08:44.929512+0000","last_active":"2024-09-10T10:10:00.840320+0000","last_peered":"2024-09-10T10:10:00.840320+0000","last_clean":"2024-09-10T10:10:00.840320+0000","last_became_active":"2024-09-10T10:08:44.928992+0000","last_became_peered":"2024-09-10T10:08:44.928992+0000","last_unstale":"2024-09-10T10:10:00.840320+0000","last_undegraded":"2024-09-10T10:10:00.840320+0000","last_fullsized":"2024-09-10T10:10:00.840320+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:31.827967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.863799+0000","last_change":"2024-09-10T10:10:00.863430+0000","last_active":"2024-09-10T10:10:00.863799+0000","last_peered":"2024-09-10T10:10:00.863799+0000","last_clean":"2024-09-10T10:10:00.863799+0000","last_became_active":"2024-09-10T10:10:00.863082+0000","last_became_peered":"2024-09-10T10:10:00.863082+0000","last_unstale":"2024-09-10T10:10:00.863799+0000","last_undegraded":"2024-09-10T10:10:00.863799+0000","last_fullsized":"2024-09-10T10:10:00.863799+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:24.848797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722200+0000","last_change":"2024-09-10T10:08:32.885451+0000","last_active":"2024-09-10T10:10:00.722200+0000","last_peered":"2024-09-10T10:10:00.722200+0000","last_clean":"2024-09-10T10:10:00.722200+0000","last_became_active":"2024-09-10T10:08:32.885102+0000","last_became_peered":"2024-09-10T10:08:32.885102+0000","last_unstale":"2024-09-10T10:10:00.722200+0000","last_undegraded":"2024-09-10T10:10:00.722200+0000","last_fullsized":"2024-09-10T10:10:00.722200+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:52.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":356,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185287+0000","last_change":"2024-09-10T10:07:13.661841+0000","last_active":"2024-09-10T10:10:01.185287+0000","last_peered":"2024-09-10T10:10:01.185287+0000","last_clean":"2024-09-10T10:10:01.185287+0000","last_became_active":"2024-09-10T10:07:13.661310+0000","last_became_peered":"2024-09-10T10:07:13.661310+0000","last_unstale":"2024-09-10T10:10:01.185287+0000","last_undegraded":"2024-09-10T10:10:01.185287+0000","last_fullsized":"2024-09-10T10:10:01.185287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_clean_scrub_stamp":"2024-09-10T10:03:29.327083+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:39.414636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185574+0000","last_change":"2024-09-10T10:08:44.391277+0000","last_active":"2024-09-10T10:10:01.185574+0000","last_peered":"2024-09-10T10:10:01.185574+0000","last_clean":"2024-09-10T10:10:01.185574+0000","last_became_active":"2024-09-10T10:08:44.390867+0000","last_became_peered":"2024-09-10T10:08:44.390867+0000","last_unstale":"2024-09-10T10:10:01.185574+0000","last_undegraded":"2024-09-10T10:10:01.185574+0000","last_fullsized":"2024-09-10T10:10:01.185574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:23.299812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185722+0000","last_change":"2024-09-10T10:08:35.364750+0000","last_active":"2024-09-10T10:10:01.185722+0000","last_peered":"2024-09-10T10:10:01.185722+0000","last_clean":"2024-09-10T10:10:01.185722+0000","last_became_active":"2024-09-10T10:08:35.364034+0000","last_became_peered":"2024-09-10T10:08:35.364034+0000","last_unstale":"2024-09-10T10:10:01.185722+0000","last_undegraded":"2024-09-10T10:10:01.185722+0000","last_fullsized":"2024-09-10T10:10:01.185722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:15.296086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973319+0000","last_change":"2024-09-10T10:08:32.886884+0000","last_active":"2024-09-10T10:10:00.973319+0000","last_peered":"2024-09-10T10:10:00.973319+0000","last_clean":"2024-09-10T10:10:00.973319+0000","last_became_active":"2024-09-10T10:08:32.886544+0000","last_became_peered":"2024-09-10T10:08:32.886544+0000","last_unstale":"2024-09-10T10:10:00.973319+0000","last_undegraded":"2024-09-10T10:10:00.973319+0000","last_fullsized":"2024-09-10T10:10:00.973319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:30.511881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862190+0000","last_change":"2024-09-10T10:08:44.390761+0000","last_active":"2024-09-10T10:10:00.862190+0000","last_peered":"2024-09-10T10:10:00.862190+0000","last_clean":"2024-09-10T10:10:00.862190+0000","last_became_active":"2024-09-10T10:08:44.390190+0000","last_became_peered":"2024-09-10T10:08:44.390190+0000","last_unstale":"2024-09-10T10:10:00.862190+0000","last_undegraded":"2024-09-10T10:10:00.862190+0000","last_fullsized":"2024-09-10T10:10:00.862190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:38.216171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185602+0000","last_change":"2024-09-10T10:08:35.362956+0000","last_active":"2024-09-10T10:10:01.185602+0000","last_peered":"2024-09-10T10:10:01.185602+0000","last_clean":"2024-09-10T10:10:01.185602+0000","last_became_active":"2024-09-10T10:08:35.362623+0000","last_became_peered":"2024-09-10T10:08:35.362623+0000","last_unstale":"2024-09-10T10:10:01.185602+0000","last_undegraded":"2024-09-10T10:10:01.185602+0000","last_fullsized":"2024-09-10T10:10:01.185602+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:50.162838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840512+0000","last_change":"2024-09-10T10:08:32.889741+0000","last_active":"2024-09-10T10:10:00.840512+0000","last_peered":"2024-09-10T10:10:00.840512+0000","last_clean":"2024-09-10T10:10:00.840512+0000","last_became_active":"2024-09-10T10:08:32.889394+0000","last_became_peered":"2024-09-10T10:08:32.889394+0000","last_unstale":"2024-09-10T10:10:00.840512+0000","last_undegraded":"2024-09-10T10:10:00.840512+0000","last_fullsized":"2024-09-10T10:10:00.840512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:16.845738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938245+0000","last_change":"2024-09-10T10:08:44.403781+0000","last_active":"2024-09-10T10:10:00.938245+0000","last_peered":"2024-09-10T10:10:00.938245+0000","last_clean":"2024-09-10T10:10:00.938245+0000","last_became_active":"2024-09-10T10:08:44.399601+0000","last_became_peered":"2024-09-10T10:08:44.399601+0000","last_unstale":"2024-09-10T10:10:00.938245+0000","last_undegraded":"2024-09-10T10:10:00.938245+0000","last_fullsized":"2024-09-10T10:10:00.938245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:45.587247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185766+0000","last_change":"2024-09-10T10:08:35.367825+0000","last_active":"2024-09-10T10:10:01.185766+0000","last_peered":"2024-09-10T10:10:01.185766+0000","last_clean":"2024-09-10T10:10:01.185766+0000","last_became_active":"2024-09-10T10:08:35.367511+0000","last_became_peered":"2024-09-10T10:08:35.367511+0000","last_unstale":"2024-09-10T10:10:01.185766+0000","last_undegraded":"2024-09-10T10:10:01.185766+0000","last_fullsized":"2024-09-10T10:10:01.185766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:03.356912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039709+0000","last_change":"2024-09-10T10:08:32.888524+0000","last_active":"2024-09-10T10:10:01.039709+0000","last_peered":"2024-09-10T10:10:01.039709+0000","last_clean":"2024-09-10T10:10:01.039709+0000","last_became_active":"2024-09-10T10:08:32.888148+0000","last_became_peered":"2024-09-10T10:08:32.888148+0000","last_unstale":"2024-09-10T10:10:01.039709+0000","last_undegraded":"2024-09-10T10:10:01.039709+0000","last_fullsized":"2024-09-10T10:10:01.039709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:34.342167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839505+0000","last_change":"2024-09-10T10:08:44.392952+0000","last_active":"2024-09-10T10:10:00.839505+0000","last_peered":"2024-09-10T10:10:00.839505+0000","last_clean":"2024-09-10T10:10:00.839505+0000","last_became_active":"2024-09-10T10:08:44.392476+0000","last_became_peered":"2024-09-10T10:08:44.392476+0000","last_unstale":"2024-09-10T10:10:00.839505+0000","last_undegraded":"2024-09-10T10:10:00.839505+0000","last_fullsized":"2024-09-10T10:10:00.839505+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:26.530305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185541+0000","last_change":"2024-09-10T10:08:35.364501+0000","last_active":"2024-09-10T10:10:01.185541+0000","last_peered":"2024-09-10T10:10:01.185541+0000","last_clean":"2024-09-10T10:10:01.185541+0000","last_became_active":"2024-09-10T10:08:35.364102+0000","last_became_peered":"2024-09-10T10:08:35.364102+0000","last_unstale":"2024-09-10T10:10:01.185541+0000","last_undegraded":"2024-09-10T10:10:01.185541+0000","last_fullsized":"2024-09-10T10:10:01.185541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:42.743140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":21,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185836+0000","last_change":"2024-09-10T10:09:00.461639+0000","last_active":"2024-09-10T10:10:01.185836+0000","last_peered":"2024-09-10T10:10:01.185836+0000","last_clean":"2024-09-10T10:10:01.185836+0000","last_became_active":"2024-09-10T10:09:00.457246+0000","last_became_peered":"2024-09-10T10:09:00.457246+0000","last_unstale":"2024-09-10T10:10:01.185836+0000","last_undegraded":"2024-09-10T10:10:01.185836+0000","last_fullsized":"2024-09-10T10:10:01.185836+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:30.387035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839839+0000","last_change":"2024-09-10T10:08:44.401728+0000","last_active":"2024-09-10T10:10:00.839839+0000","last_peered":"2024-09-10T10:10:00.839839+0000","last_clean":"2024-09-10T10:10:00.839839+0000","last_became_active":"2024-09-10T10:08:44.401334+0000","last_became_peered":"2024-09-10T10:08:44.401334+0000","last_unstale":"2024-09-10T10:10:00.839839+0000","last_undegraded":"2024-09-10T10:10:00.839839+0000","last_fullsized":"2024-09-10T10:10:00.839839+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:57.496196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839806+0000","last_change":"2024-09-10T10:09:00.486353+0000","last_active":"2024-09-10T10:10:00.839806+0000","last_peered":"2024-09-10T10:10:00.839806+0000","last_clean":"2024-09-10T10:10:00.839806+0000","last_became_active":"2024-09-10T10:09:00.485938+0000","last_became_peered":"2024-09-10T10:09:00.485938+0000","last_unstale":"2024-09-10T10:10:00.839806+0000","last_undegraded":"2024-09-10T10:10:00.839806+0000","last_fullsized":"2024-09-10T10:10:00.839806+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:38.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722275+0000","last_change":"2024-09-10T10:08:32.893278+0000","last_active":"2024-09-10T10:10:00.722275+0000","last_peered":"2024-09-10T10:10:00.722275+0000","last_clean":"2024-09-10T10:10:00.722275+0000","last_became_active":"2024-09-10T10:08:32.892848+0000","last_became_peered":"2024-09-10T10:08:32.892848+0000","last_unstale":"2024-09-10T10:10:00.722275+0000","last_undegraded":"2024-09-10T10:10:00.722275+0000","last_fullsized":"2024-09-10T10:10:00.722275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:09.336253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040433+0000","last_change":"2024-09-10T10:08:44.407213+0000","last_active":"2024-09-10T10:10:01.040433+0000","last_peered":"2024-09-10T10:10:01.040433+0000","last_clean":"2024-09-10T10:10:01.040433+0000","last_became_active":"2024-09-10T10:08:44.405198+0000","last_became_peered":"2024-09-10T10:08:44.405198+0000","last_unstale":"2024-09-10T10:10:01.040433+0000","last_undegraded":"2024-09-10T10:10:01.040433+0000","last_fullsized":"2024-09-10T10:10:01.040433+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:15.921684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185154+0000","last_change":"2024-09-10T10:08:35.362683+0000","last_active":"2024-09-10T10:10:01.185154+0000","last_peered":"2024-09-10T10:10:01.185154+0000","last_clean":"2024-09-10T10:10:01.185154+0000","last_became_active":"2024-09-10T10:08:35.362353+0000","last_became_peered":"2024-09-10T10:08:35.362353+0000","last_unstale":"2024-09-10T10:10:01.185154+0000","last_undegraded":"2024-09-10T10:10:01.185154+0000","last_fullsized":"2024-09-10T10:10:01.185154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.489716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'4","reported_seq":101,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:18.619094+0000","last_change":"2024-09-10T10:08:32.881024+0000","last_active":"2024-09-10T10:10:18.619094+0000","last_peered":"2024-09-10T10:10:18.619094+0000","last_clean":"2024-09-10T10:10:18.619094+0000","last_became_active":"2024-09-10T10:08:32.880691+0000","last_became_peered":"2024-09-10T10:08:32.880691+0000","last_unstale":"2024-09-10T10:10:18.619094+0000","last_undegraded":"2024-09-10T10:10:18.619094+0000","last_fullsized":"2024-09-10T10:10:18.619094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:15.988063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724379+0000","last_change":"2024-09-10T10:08:44.400509+0000","last_active":"2024-09-10T10:10:00.724379+0000","last_peered":"2024-09-10T10:10:00.724379+0000","last_clean":"2024-09-10T10:10:00.724379+0000","last_became_active":"2024-09-10T10:08:44.400152+0000","last_became_peered":"2024-09-10T10:08:44.400152+0000","last_unstale":"2024-09-10T10:10:00.724379+0000","last_undegraded":"2024-09-10T10:10:00.724379+0000","last_fullsized":"2024-09-10T10:10:00.724379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:43.550208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185438+0000","last_change":"2024-09-10T10:08:35.364208+0000","last_active":"2024-09-10T10:10:01.185438+0000","last_peered":"2024-09-10T10:10:01.185438+0000","last_clean":"2024-09-10T10:10:01.185438+0000","last_became_active":"2024-09-10T10:08:35.363751+0000","last_became_peered":"2024-09-10T10:08:35.363751+0000","last_unstale":"2024-09-10T10:10:01.185438+0000","last_undegraded":"2024-09-10T10:10:01.185438+0000","last_fullsized":"2024-09-10T10:10:01.185438+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:21.791512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840142+0000","last_change":"2024-09-10T10:08:32.890611+0000","last_active":"2024-09-10T10:10:00.840142+0000","last_peered":"2024-09-10T10:10:00.840142+0000","last_clean":"2024-09-10T10:10:00.840142+0000","last_became_active":"2024-09-10T10:08:32.890296+0000","last_became_peered":"2024-09-10T10:08:32.890296+0000","last_unstale":"2024-09-10T10:10:00.840142+0000","last_undegraded":"2024-09-10T10:10:00.840142+0000","last_fullsized":"2024-09-10T10:10:00.840142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.977575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185554+0000","last_change":"2024-09-10T10:08:44.402607+0000","last_active":"2024-09-10T10:10:01.185554+0000","last_peered":"2024-09-10T10:10:01.185554+0000","last_clean":"2024-09-10T10:10:01.185554+0000","last_became_active":"2024-09-10T10:08:44.401623+0000","last_became_peered":"2024-09-10T10:08:44.401623+0000","last_unstale":"2024-09-10T10:10:01.185554+0000","last_undegraded":"2024-09-10T10:10:01.185554+0000","last_fullsized":"2024-09-10T10:10:01.185554+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:21.105349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040010+0000","last_change":"2024-09-10T10:08:35.360642+0000","last_active":"2024-09-10T10:10:01.040010+0000","last_peered":"2024-09-10T10:10:01.040010+0000","last_clean":"2024-09-10T10:10:01.040010+0000","last_became_active":"2024-09-10T10:08:35.356667+0000","last_became_peered":"2024-09-10T10:08:35.356667+0000","last_unstale":"2024-09-10T10:10:01.040010+0000","last_undegraded":"2024-09-10T10:10:01.040010+0000","last_fullsized":"2024-09-10T10:10:01.040010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:08.404973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972303+0000","last_change":"2024-09-10T10:08:32.890418+0000","last_active":"2024-09-10T10:10:00.972303+0000","last_peered":"2024-09-10T10:10:00.972303+0000","last_clean":"2024-09-10T10:10:00.972303+0000","last_became_active":"2024-09-10T10:08:32.890081+0000","last_became_peered":"2024-09-10T10:08:32.890081+0000","last_unstale":"2024-09-10T10:10:00.972303+0000","last_undegraded":"2024-09-10T10:10:00.972303+0000","last_fullsized":"2024-09-10T10:10:00.972303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:52.839714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840304+0000","last_change":"2024-09-10T10:08:44.401322+0000","last_active":"2024-09-10T10:10:00.840304+0000","last_peered":"2024-09-10T10:10:00.840304+0000","last_clean":"2024-09-10T10:10:00.840304+0000","last_became_active":"2024-09-10T10:08:44.400906+0000","last_became_peered":"2024-09-10T10:08:44.400906+0000","last_unstale":"2024-09-10T10:10:00.840304+0000","last_undegraded":"2024-09-10T10:10:00.840304+0000","last_fullsized":"2024-09-10T10:10:00.840304+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:08.616288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722616+0000","last_change":"2024-09-10T10:08:35.366580+0000","last_active":"2024-09-10T10:10:00.722616+0000","last_peered":"2024-09-10T10:10:00.722616+0000","last_clean":"2024-09-10T10:10:00.722616+0000","last_became_active":"2024-09-10T10:08:35.365943+0000","last_became_peered":"2024-09-10T10:08:35.365943+0000","last_unstale":"2024-09-10T10:10:00.722616+0000","last_undegraded":"2024-09-10T10:10:00.722616+0000","last_fullsized":"2024-09-10T10:10:00.722616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:58.351517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'33","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:20.621315+0000","last_change":"2024-09-10T10:08:32.888411+0000","last_active":"2024-09-10T10:10:20.621315+0000","last_peered":"2024-09-10T10:10:20.621315+0000","last_clean":"2024-09-10T10:10:20.621315+0000","last_became_active":"2024-09-10T10:08:32.888093+0000","last_became_peered":"2024-09-10T10:08:32.888093+0000","last_unstale":"2024-09-10T10:10:20.621315+0000","last_undegraded":"2024-09-10T10:10:20.621315+0000","last_fullsized":"2024-09-10T10:10:20.621315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.532868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62076,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":118,"num_read_kb":120,"num_write":34,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724398+0000","last_change":"2024-09-10T10:08:44.400432+0000","last_active":"2024-09-10T10:10:00.724398+0000","last_peered":"2024-09-10T10:10:00.724398+0000","last_clean":"2024-09-10T10:10:00.724398+0000","last_became_active":"2024-09-10T10:08:44.399981+0000","last_became_peered":"2024-09-10T10:08:44.399981+0000","last_unstale":"2024-09-10T10:10:00.724398+0000","last_undegraded":"2024-09-10T10:10:00.724398+0000","last_fullsized":"2024-09-10T10:10:00.724398+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:57.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862321+0000","last_change":"2024-09-10T10:09:00.460848+0000","last_active":"2024-09-10T10:10:00.862321+0000","last_peered":"2024-09-10T10:10:00.862321+0000","last_clean":"2024-09-10T10:10:00.862321+0000","last_became_active":"2024-09-10T10:09:00.460459+0000","last_became_peered":"2024-09-10T10:09:00.460459+0000","last_unstale":"2024-09-10T10:10:00.862321+0000","last_undegraded":"2024-09-10T10:10:00.862321+0000","last_fullsized":"2024-09-10T10:10:00.862321+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:06.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840490+0000","last_change":"2024-09-10T10:08:32.885909+0000","last_active":"2024-09-10T10:10:00.840490+0000","last_peered":"2024-09-10T10:10:00.840490+0000","last_clean":"2024-09-10T10:10:00.840490+0000","last_became_active":"2024-09-10T10:08:32.885512+0000","last_became_peered":"2024-09-10T10:08:32.885512+0000","last_unstale":"2024-09-10T10:10:00.840490+0000","last_undegraded":"2024-09-10T10:10:00.840490+0000","last_fullsized":"2024-09-10T10:10:00.840490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:44.850772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721837+0000","last_change":"2024-09-10T10:08:44.400323+0000","last_active":"2024-09-10T10:10:00.721837+0000","last_peered":"2024-09-10T10:10:00.721837+0000","last_clean":"2024-09-10T10:10:00.721837+0000","last_became_active":"2024-09-10T10:08:44.399923+0000","last_became_peered":"2024-09-10T10:08:44.399923+0000","last_unstale":"2024-09-10T10:10:00.721837+0000","last_undegraded":"2024-09-10T10:10:00.721837+0000","last_fullsized":"2024-09-10T10:10:00.721837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:45.496392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.939070+0000","last_change":"2024-09-10T10:08:35.375543+0000","last_active":"2024-09-10T10:10:00.939070+0000","last_peered":"2024-09-10T10:10:00.939070+0000","last_clean":"2024-09-10T10:10:00.939070+0000","last_became_active":"2024-09-10T10:08:35.374312+0000","last_became_peered":"2024-09-10T10:08:35.374312+0000","last_unstale":"2024-09-10T10:10:00.939070+0000","last_undegraded":"2024-09-10T10:10:00.939070+0000","last_fullsized":"2024-09-10T10:10:00.939070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:34.208716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184817+0000","last_change":"2024-09-10T10:08:32.888540+0000","last_active":"2024-09-10T10:10:01.184817+0000","last_peered":"2024-09-10T10:10:01.184817+0000","last_clean":"2024-09-10T10:10:01.184817+0000","last_became_active":"2024-09-10T10:08:32.888187+0000","last_became_peered":"2024-09-10T10:08:32.888187+0000","last_unstale":"2024-09-10T10:10:01.184817+0000","last_undegraded":"2024-09-10T10:10:01.184817+0000","last_fullsized":"2024-09-10T10:10:01.184817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:06.694533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.723660+0000","last_change":"2024-09-10T10:08:44.397995+0000","last_active":"2024-09-10T10:10:00.723660+0000","last_peered":"2024-09-10T10:10:00.723660+0000","last_clean":"2024-09-10T10:10:00.723660+0000","last_became_active":"2024-09-10T10:08:44.397583+0000","last_became_peered":"2024-09-10T10:08:44.397583+0000","last_unstale":"2024-09-10T10:10:00.723660+0000","last_undegraded":"2024-09-10T10:10:00.723660+0000","last_fullsized":"2024-09-10T10:10:00.723660+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:03.908014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862695+0000","last_change":"2024-09-10T10:08:35.361053+0000","last_active":"2024-09-10T10:10:00.862695+0000","last_peered":"2024-09-10T10:10:00.862695+0000","last_clean":"2024-09-10T10:10:00.862695+0000","last_became_active":"2024-09-10T10:08:35.360736+0000","last_became_peered":"2024-09-10T10:08:35.360736+0000","last_unstale":"2024-09-10T10:10:00.862695+0000","last_undegraded":"2024-09-10T10:10:00.862695+0000","last_fullsized":"2024-09-10T10:10:00.862695+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:45.435384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'3","reported_seq":98,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:19.619645+0000","last_change":"2024-09-10T10:08:32.885067+0000","last_active":"2024-09-10T10:10:19.619645+0000","last_peered":"2024-09-10T10:10:19.619645+0000","last_clean":"2024-09-10T10:10:19.619645+0000","last_became_active":"2024-09-10T10:08:32.884676+0000","last_became_peered":"2024-09-10T10:08:32.884676+0000","last_unstale":"2024-09-10T10:10:19.619645+0000","last_undegraded":"2024-09-10T10:10:19.619645+0000","last_fullsized":"2024-09-10T10:10:19.619645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.667680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721159+0000","last_change":"2024-09-10T10:08:44.395892+0000","last_active":"2024-09-10T10:10:00.721159+0000","last_peered":"2024-09-10T10:10:00.721159+0000","last_clean":"2024-09-10T10:10:00.721159+0000","last_became_active":"2024-09-10T10:08:44.395188+0000","last_became_peered":"2024-09-10T10:08:44.395188+0000","last_unstale":"2024-09-10T10:10:00.721159+0000","last_undegraded":"2024-09-10T10:10:00.721159+0000","last_fullsized":"2024-09-10T10:10:00.721159+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:27.562053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.939159+0000","last_change":"2024-09-10T10:08:44.403185+0000","last_active":"2024-09-10T10:10:00.939159+0000","last_peered":"2024-09-10T10:10:00.939159+0000","last_clean":"2024-09-10T10:10:00.939159+0000","last_became_active":"2024-09-10T10:08:44.399943+0000","last_became_peered":"2024-09-10T10:08:44.399943+0000","last_unstale":"2024-09-10T10:10:00.939159+0000","last_undegraded":"2024-09-10T10:10:00.939159+0000","last_fullsized":"2024-09-10T10:10:00.939159+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:07.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.723795+0000","last_change":"2024-09-10T10:08:35.367552+0000","last_active":"2024-09-10T10:10:00.723795+0000","last_peered":"2024-09-10T10:10:00.723795+0000","last_clean":"2024-09-10T10:10:00.723795+0000","last_became_active":"2024-09-10T10:08:35.367215+0000","last_became_peered":"2024-09-10T10:08:35.367215+0000","last_unstale":"2024-09-10T10:10:00.723795+0000","last_undegraded":"2024-09-10T10:10:00.723795+0000","last_fullsized":"2024-09-10T10:10:00.723795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:28.756769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839931+0000","last_change":"2024-09-10T10:08:32.885830+0000","last_active":"2024-09-10T10:10:00.839931+0000","last_peered":"2024-09-10T10:10:00.839931+0000","last_clean":"2024-09-10T10:10:00.839931+0000","last_became_active":"2024-09-10T10:08:32.885465+0000","last_became_peered":"2024-09-10T10:08:32.885465+0000","last_unstale":"2024-09-10T10:10:00.839931+0000","last_undegraded":"2024-09-10T10:10:00.839931+0000","last_fullsized":"2024-09-10T10:10:00.839931+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:55.101364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185725+0000","last_change":"2024-09-10T10:09:00.487666+0000","last_active":"2024-09-10T10:10:01.185725+0000","last_peered":"2024-09-10T10:10:01.185725+0000","last_clean":"2024-09-10T10:10:01.185725+0000","last_became_active":"2024-09-10T10:09:00.487110+0000","last_became_peered":"2024-09-10T10:09:00.487110+0000","last_unstale":"2024-09-10T10:10:01.185725+0000","last_undegraded":"2024-09-10T10:10:01.185725+0000","last_fullsized":"2024-09-10T10:10:01.185725+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:28.817826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721165+0000","last_change":"2024-09-10T10:08:35.356247+0000","last_active":"2024-09-10T10:10:00.721165+0000","last_peered":"2024-09-10T10:10:00.721165+0000","last_clean":"2024-09-10T10:10:00.721165+0000","last_became_active":"2024-09-10T10:08:35.355953+0000","last_became_peered":"2024-09-10T10:08:35.355953+0000","last_unstale":"2024-09-10T10:10:00.721165+0000","last_undegraded":"2024-09-10T10:10:00.721165+0000","last_fullsized":"2024-09-10T10:10:00.721165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:24.625382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039720+0000","last_change":"2024-09-10T10:08:32.882151+0000","last_active":"2024-09-10T10:10:01.039720+0000","last_peered":"2024-09-10T10:10:01.039720+0000","last_clean":"2024-09-10T10:10:01.039720+0000","last_became_active":"2024-09-10T10:08:32.881688+0000","last_became_peered":"2024-09-10T10:08:32.881688+0000","last_unstale":"2024-09-10T10:10:01.039720+0000","last_undegraded":"2024-09-10T10:10:01.039720+0000","last_fullsized":"2024-09-10T10:10:01.039720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:49.186299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.109606+0000","last_change":"2024-09-10T10:08:32.887018+0000","last_active":"2024-09-10T10:10:01.109606+0000","last_peered":"2024-09-10T10:10:01.109606+0000","last_clean":"2024-09-10T10:10:01.109606+0000","last_became_active":"2024-09-10T10:08:32.886636+0000","last_became_peered":"2024-09-10T10:08:32.886636+0000","last_unstale":"2024-09-10T10:10:01.109606+0000","last_undegraded":"2024-09-10T10:10:01.109606+0000","last_fullsized":"2024-09-10T10:10:01.109606+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:24.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839937+0000","last_change":"2024-09-10T10:08:35.363803+0000","last_active":"2024-09-10T10:10:00.839937+0000","last_peered":"2024-09-10T10:10:00.839937+0000","last_clean":"2024-09-10T10:10:00.839937+0000","last_became_active":"2024-09-10T10:08:35.363442+0000","last_became_peered":"2024-09-10T10:08:35.363442+0000","last_unstale":"2024-09-10T10:10:00.839937+0000","last_undegraded":"2024-09-10T10:10:00.839937+0000","last_fullsized":"2024-09-10T10:10:00.839937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:59.045347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972887+0000","last_change":"2024-09-10T10:08:44.403970+0000","last_active":"2024-09-10T10:10:00.972887+0000","last_peered":"2024-09-10T10:10:00.972887+0000","last_clean":"2024-09-10T10:10:00.972887+0000","last_became_active":"2024-09-10T10:08:44.403462+0000","last_became_peered":"2024-09-10T10:08:44.403462+0000","last_unstale":"2024-09-10T10:10:00.972887+0000","last_undegraded":"2024-09-10T10:10:00.972887+0000","last_fullsized":"2024-09-10T10:10:00.972887+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:09.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":105,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:20.621696+0000","last_change":"2024-09-10T10:08:32.893227+0000","last_active":"2024-09-10T10:10:20.621696+0000","last_peered":"2024-09-10T10:10:20.621696+0000","last_clean":"2024-09-10T10:10:20.621696+0000","last_became_active":"2024-09-10T10:08:32.892732+0000","last_became_peered":"2024-09-10T10:08:32.892732+0000","last_unstale":"2024-09-10T10:10:20.621696+0000","last_undegraded":"2024-09-10T10:10:20.621696+0000","last_fullsized":"2024-09-10T10:10:20.621696+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:16.933955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722295+0000","last_change":"2024-09-10T10:08:35.368806+0000","last_active":"2024-09-10T10:10:00.722295+0000","last_peered":"2024-09-10T10:10:00.722295+0000","last_clean":"2024-09-10T10:10:00.722295+0000","last_became_active":"2024-09-10T10:08:35.368397+0000","last_became_peered":"2024-09-10T10:08:35.368397+0000","last_unstale":"2024-09-10T10:10:00.722295+0000","last_undegraded":"2024-09-10T10:10:00.722295+0000","last_fullsized":"2024-09-10T10:10:00.722295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:39.656295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973037+0000","last_change":"2024-09-10T10:08:44.391941+0000","last_active":"2024-09-10T10:10:00.973037+0000","last_peered":"2024-09-10T10:10:00.973037+0000","last_clean":"2024-09-10T10:10:00.973037+0000","last_became_active":"2024-09-10T10:08:44.391553+0000","last_became_peered":"2024-09-10T10:08:44.391553+0000","last_unstale":"2024-09-10T10:10:00.973037+0000","last_undegraded":"2024-09-10T10:10:00.973037+0000","last_fullsized":"2024-09-10T10:10:00.973037+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:34.279772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185333+0000","last_change":"2024-09-10T10:08:35.363192+0000","last_active":"2024-09-10T10:10:01.185333+0000","last_peered":"2024-09-10T10:10:01.185333+0000","last_clean":"2024-09-10T10:10:01.185333+0000","last_became_active":"2024-09-10T10:08:35.362890+0000","last_became_peered":"2024-09-10T10:08:35.362890+0000","last_unstale":"2024-09-10T10:10:01.185333+0000","last_undegraded":"2024-09-10T10:10:01.185333+0000","last_fullsized":"2024-09-10T10:10:01.185333+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:07.493539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972754+0000","last_change":"2024-09-10T10:08:35.362471+0000","last_active":"2024-09-10T10:10:00.972754+0000","last_peered":"2024-09-10T10:10:00.972754+0000","last_clean":"2024-09-10T10:10:00.972754+0000","last_became_active":"2024-09-10T10:08:35.361553+0000","last_became_peered":"2024-09-10T10:08:35.361553+0000","last_unstale":"2024-09-10T10:10:00.972754+0000","last_undegraded":"2024-09-10T10:10:00.972754+0000","last_fullsized":"2024-09-10T10:10:00.972754+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:24.511901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972544+0000","last_change":"2024-09-10T10:08:35.371025+0000","last_active":"2024-09-10T10:10:00.972544+0000","last_peered":"2024-09-10T10:10:00.972544+0000","last_clean":"2024-09-10T10:10:00.972544+0000","last_became_active":"2024-09-10T10:08:35.370692+0000","last_became_peered":"2024-09-10T10:08:35.370692+0000","last_unstale":"2024-09-10T10:10:00.972544+0000","last_undegraded":"2024-09-10T10:10:00.972544+0000","last_fullsized":"2024-09-10T10:10:00.972544+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:22.289843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938270+0000","last_change":"2024-09-10T10:08:35.373519+0000","last_active":"2024-09-10T10:10:00.938270+0000","last_peered":"2024-09-10T10:10:00.938270+0000","last_clean":"2024-09-10T10:10:00.938270+0000","last_became_active":"2024-09-10T10:08:35.372719+0000","last_became_peered":"2024-09-10T10:08:35.372719+0000","last_unstale":"2024-09-10T10:10:00.938270+0000","last_undegraded":"2024-09-10T10:10:00.938270+0000","last_fullsized":"2024-09-10T10:10:00.938270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:24.530809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040368+0000","last_change":"2024-09-10T10:09:00.489944+0000","last_active":"2024-09-10T10:10:01.040368+0000","last_peered":"2024-09-10T10:10:01.040368+0000","last_clean":"2024-09-10T10:10:01.040368+0000","last_became_active":"2024-09-10T10:09:00.489269+0000","last_became_peered":"2024-09-10T10:09:00.489269+0000","last_unstale":"2024-09-10T10:10:01.040368+0000","last_undegraded":"2024-09-10T10:10:01.040368+0000","last_fullsized":"2024-09-10T10:10:01.040368+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:46.561078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185737+0000","last_change":"2024-09-10T10:08:35.364779+0000","last_active":"2024-09-10T10:10:01.185737+0000","last_peered":"2024-09-10T10:10:01.185737+0000","last_clean":"2024-09-10T10:10:01.185737+0000","last_became_active":"2024-09-10T10:08:35.364455+0000","last_became_peered":"2024-09-10T10:08:35.364455+0000","last_unstale":"2024-09-10T10:10:01.185737+0000","last_undegraded":"2024-09-10T10:10:01.185737+0000","last_fullsized":"2024-09-10T10:10:01.185737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:08.552218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973001+0000","last_change":"2024-09-10T10:08:35.357147+0000","last_active":"2024-09-10T10:10:00.973001+0000","last_peered":"2024-09-10T10:10:00.973001+0000","last_clean":"2024-09-10T10:10:00.973001+0000","last_became_active":"2024-09-10T10:08:35.356808+0000","last_became_peered":"2024-09-10T10:08:35.356808+0000","last_unstale":"2024-09-10T10:10:00.973001+0000","last_undegraded":"2024-09-10T10:10:00.973001+0000","last_fullsized":"2024-09-10T10:10:00.973001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:35.731496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721990+0000","last_change":"2024-09-10T10:08:35.365795+0000","last_active":"2024-09-10T10:10:00.721990+0000","last_peered":"2024-09-10T10:10:00.721990+0000","last_clean":"2024-09-10T10:10:00.721990+0000","last_became_active":"2024-09-10T10:08:35.365342+0000","last_became_peered":"2024-09-10T10:08:35.365342+0000","last_unstale":"2024-09-10T10:10:00.721990+0000","last_undegraded":"2024-09-10T10:10:00.721990+0000","last_fullsized":"2024-09-10T10:10:00.721990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:20.012890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722126+0000","last_change":"2024-09-10T10:09:00.486664+0000","last_active":"2024-09-10T10:10:00.722126+0000","last_peered":"2024-09-10T10:10:00.722126+0000","last_clean":"2024-09-10T10:10:00.722126+0000","last_became_active":"2024-09-10T10:09:00.486239+0000","last_became_peered":"2024-09-10T10:09:00.486239+0000","last_unstale":"2024-09-10T10:10:00.722126+0000","last_undegraded":"2024-09-10T10:10:00.722126+0000","last_fullsized":"2024-09-10T10:10:00.722126+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:47.472245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721352+0000","last_change":"2024-09-10T10:08:35.367403+0000","last_active":"2024-09-10T10:10:00.721352+0000","last_peered":"2024-09-10T10:10:00.721352+0000","last_clean":"2024-09-10T10:10:00.721352+0000","last_became_active":"2024-09-10T10:08:35.365969+0000","last_became_peered":"2024-09-10T10:08:35.365969+0000","last_unstale":"2024-09-10T10:10:00.721352+0000","last_undegraded":"2024-09-10T10:10:00.721352+0000","last_fullsized":"2024-09-10T10:10:00.721352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:27.657226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862371+0000","last_change":"2024-09-10T10:08:35.359185+0000","last_active":"2024-09-10T10:10:00.862371+0000","last_peered":"2024-09-10T10:10:00.862371+0000","last_clean":"2024-09-10T10:10:00.862371+0000","last_became_active":"2024-09-10T10:08:35.358825+0000","last_became_peered":"2024-09-10T10:08:35.358825+0000","last_unstale":"2024-09-10T10:10:00.862371+0000","last_undegraded":"2024-09-10T10:10:00.862371+0000","last_fullsized":"2024-09-10T10:10:00.862371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:31.884533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040223+0000","last_change":"2024-09-10T10:08:35.378151+0000","last_active":"2024-09-10T10:10:01.040223+0000","last_peered":"2024-09-10T10:10:01.040223+0000","last_clean":"2024-09-10T10:10:01.040223+0000","last_became_active":"2024-09-10T10:08:35.377784+0000","last_became_peered":"2024-09-10T10:08:35.377784+0000","last_unstale":"2024-09-10T10:10:01.040223+0000","last_undegraded":"2024-09-10T10:10:01.040223+0000","last_fullsized":"2024-09-10T10:10:01.040223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.027310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185581+0000","last_change":"2024-09-10T10:08:35.364550+0000","last_active":"2024-09-10T10:10:01.185581+0000","last_peered":"2024-09-10T10:10:01.185581+0000","last_clean":"2024-09-10T10:10:01.185581+0000","last_became_active":"2024-09-10T10:08:35.364224+0000","last_became_peered":"2024-09-10T10:08:35.364224+0000","last_unstale":"2024-09-10T10:10:01.185581+0000","last_undegraded":"2024-09-10T10:10:01.185581+0000","last_fullsized":"2024-09-10T10:10:01.185581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:38.584494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973205+0000","last_change":"2024-09-10T10:08:35.357333+0000","last_active":"2024-09-10T10:10:00.973205+0000","last_peered":"2024-09-10T10:10:00.973205+0000","last_clean":"2024-09-10T10:10:00.973205+0000","last_became_active":"2024-09-10T10:08:35.356940+0000","last_became_peered":"2024-09-10T10:08:35.356940+0000","last_unstale":"2024-09-10T10:10:00.973205+0000","last_undegraded":"2024-09-10T10:10:00.973205+0000","last_fullsized":"2024-09-10T10:10:00.973205+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:40.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724816+0000","last_change":"2024-09-10T10:08:35.367208+0000","last_active":"2024-09-10T10:10:00.724816+0000","last_peered":"2024-09-10T10:10:00.724816+0000","last_clean":"2024-09-10T10:10:00.724816+0000","last_became_active":"2024-09-10T10:08:35.361942+0000","last_became_peered":"2024-09-10T10:08:35.361942+0000","last_unstale":"2024-09-10T10:10:00.724816+0000","last_undegraded":"2024-09-10T10:10:00.724816+0000","last_fullsized":"2024-09-10T10:10:00.724816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:19.030623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185952+0000","last_change":"2024-09-10T10:08:35.377164+0000","last_active":"2024-09-10T10:10:01.185952+0000","last_peered":"2024-09-10T10:10:01.185952+0000","last_clean":"2024-09-10T10:10:01.185952+0000","last_became_active":"2024-09-10T10:08:35.376457+0000","last_became_peered":"2024-09-10T10:08:35.376457+0000","last_unstale":"2024-09-10T10:10:01.185952+0000","last_undegraded":"2024-09-10T10:10:01.185952+0000","last_fullsized":"2024-09-10T10:10:01.185952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.291635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.861984+0000","last_change":"2024-09-10T10:08:35.365096+0000","last_active":"2024-09-10T10:10:00.861984+0000","last_peered":"2024-09-10T10:10:00.861984+0000","last_clean":"2024-09-10T10:10:00.861984+0000","last_became_active":"2024-09-10T10:08:35.364780+0000","last_became_peered":"2024-09-10T10:08:35.364780+0000","last_unstale":"2024-09-10T10:10:00.861984+0000","last_undegraded":"2024-09-10T10:10:00.861984+0000","last_fullsized":"2024-09-10T10:10:00.861984+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:30.177904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938000+0000","last_change":"2024-09-10T10:08:35.377017+0000","last_active":"2024-09-10T10:10:00.938000+0000","last_peered":"2024-09-10T10:10:00.938000+0000","last_clean":"2024-09-10T10:10:00.938000+0000","last_became_active":"2024-09-10T10:08:35.372243+0000","last_became_peered":"2024-09-10T10:08:35.372243+0000","last_unstale":"2024-09-10T10:10:00.938000+0000","last_undegraded":"2024-09-10T10:10:00.938000+0000","last_fullsized":"2024-09-10T10:10:00.938000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:26.105505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938292+0000","last_change":"2024-09-10T10:08:35.379782+0000","last_active":"2024-09-10T10:10:00.938292+0000","last_peered":"2024-09-10T10:10:00.938292+0000","last_clean":"2024-09-10T10:10:00.938292+0000","last_became_active":"2024-09-10T10:08:35.377109+0000","last_became_peered":"2024-09-10T10:08:35.377109+0000","last_unstale":"2024-09-10T10:10:00.938292+0000","last_undegraded":"2024-09-10T10:10:00.938292+0000","last_fullsized":"2024-09-10T10:10:00.938292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:10.761016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040219+0000","last_change":"2024-09-10T10:08:35.364891+0000","last_active":"2024-09-10T10:10:01.040219+0000","last_peered":"2024-09-10T10:10:01.040219+0000","last_clean":"2024-09-10T10:10:01.040219+0000","last_became_active":"2024-09-10T10:08:35.363845+0000","last_became_peered":"2024-09-10T10:08:35.363845+0000","last_unstale":"2024-09-10T10:10:01.040219+0000","last_undegraded":"2024-09-10T10:10:01.040219+0000","last_fullsized":"2024-09-10T10:10:01.040219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:03.346994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722141+0000","last_change":"2024-09-10T10:08:35.363548+0000","last_active":"2024-09-10T10:10:00.722141+0000","last_peered":"2024-09-10T10:10:00.722141+0000","last_clean":"2024-09-10T10:10:00.722141+0000","last_became_active":"2024-09-10T10:08:35.363229+0000","last_became_peered":"2024-09-10T10:08:35.363229+0000","last_unstale":"2024-09-10T10:10:00.722141+0000","last_undegraded":"2024-09-10T10:10:00.722141+0000","last_fullsized":"2024-09-10T10:10:00.722141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:38.773445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185717+0000","last_change":"2024-09-10T10:08:35.360717+0000","last_active":"2024-09-10T10:10:01.185717+0000","last_peered":"2024-09-10T10:10:01.185717+0000","last_clean":"2024-09-10T10:10:01.185717+0000","last_became_active":"2024-09-10T10:08:35.360410+0000","last_became_peered":"2024-09-10T10:08:35.360410+0000","last_unstale":"2024-09-10T10:10:01.185717+0000","last_undegraded":"2024-09-10T10:10:01.185717+0000","last_fullsized":"2024-09-10T10:10:01.185717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:59.322524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.110560+0000","last_change":"2024-09-10T10:08:35.362359+0000","last_active":"2024-09-10T10:10:01.110560+0000","last_peered":"2024-09-10T10:10:01.110560+0000","last_clean":"2024-09-10T10:10:01.110560+0000","last_became_active":"2024-09-10T10:08:35.361580+0000","last_became_peered":"2024-09-10T10:08:35.361580+0000","last_unstale":"2024-09-10T10:10:01.110560+0000","last_undegraded":"2024-09-10T10:10:01.110560+0000","last_fullsized":"2024-09-10T10:10:01.110560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:23.265237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862689+0000","last_change":"2024-09-10T10:08:35.367305+0000","last_active":"2024-09-10T10:10:00.862689+0000","last_peered":"2024-09-10T10:10:00.862689+0000","last_clean":"2024-09-10T10:10:00.862689+0000","last_became_active":"2024-09-10T10:08:35.366936+0000","last_became_peered":"2024-09-10T10:08:35.366936+0000","last_unstale":"2024-09-10T10:10:00.862689+0000","last_undegraded":"2024-09-10T10:10:00.862689+0000","last_fullsized":"2024-09-10T10:10:00.862689+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:28.158474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721162+0000","last_change":"2024-09-10T10:08:35.369983+0000","last_active":"2024-09-10T10:10:00.721162+0000","last_peered":"2024-09-10T10:10:00.721162+0000","last_clean":"2024-09-10T10:10:00.721162+0000","last_became_active":"2024-09-10T10:08:35.367662+0000","last_became_peered":"2024-09-10T10:08:35.367662+0000","last_unstale":"2024-09-10T10:10:00.721162+0000","last_undegraded":"2024-09-10T10:10:00.721162+0000","last_fullsized":"2024-09-10T10:10:00.721162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185200+0000","last_change":"2024-09-10T10:08:35.369237+0000","last_active":"2024-09-10T10:10:01.185200+0000","last_peered":"2024-09-10T10:10:01.185200+0000","last_clean":"2024-09-10T10:10:01.185200+0000","last_became_active":"2024-09-10T10:08:35.368903+0000","last_became_peered":"2024-09-10T10:08:35.368903+0000","last_unstale":"2024-09-10T10:10:01.185200+0000","last_undegraded":"2024-09-10T10:10:01.185200+0000","last_fullsized":"2024-09-10T10:10:01.185200+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:05.150549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.110084+0000","last_change":"2024-09-10T10:08:35.367284+0000","last_active":"2024-09-10T10:10:01.110084+0000","last_peered":"2024-09-10T10:10:01.110084+0000","last_clean":"2024-09-10T10:10:01.110084+0000","last_became_active":"2024-09-10T10:08:35.366969+0000","last_became_peered":"2024-09-10T10:08:35.366969+0000","last_unstale":"2024-09-10T10:10:01.110084+0000","last_undegraded":"2024-09-10T10:10:01.110084+0000","last_fullsized":"2024-09-10T10:10:01.110084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:16.949804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722356+0000","last_change":"2024-09-10T10:08:35.374559+0000","last_active":"2024-09-10T10:10:00.722356+0000","last_peered":"2024-09-10T10:10:00.722356+0000","last_clean":"2024-09-10T10:10:00.722356+0000","last_became_active":"2024-09-10T10:08:35.374191+0000","last_became_peered":"2024-09-10T10:08:35.374191+0000","last_unstale":"2024-09-10T10:10:00.722356+0000","last_undegraded":"2024-09-10T10:10:00.722356+0000","last_fullsized":"2024-09-10T10:10:00.722356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:48.292249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721995+0000","last_change":"2024-09-10T10:08:35.368042+0000","last_active":"2024-09-10T10:10:00.721995+0000","last_peered":"2024-09-10T10:10:00.721995+0000","last_clean":"2024-09-10T10:10:00.721995+0000","last_became_active":"2024-09-10T10:08:35.365985+0000","last_became_peered":"2024-09-10T10:08:35.365985+0000","last_unstale":"2024-09-10T10:10:00.721995+0000","last_undegraded":"2024-09-10T10:10:00.721995+0000","last_fullsized":"2024-09-10T10:10:00.721995+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:04.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938540+0000","last_change":"2024-09-10T10:08:35.375826+0000","last_active":"2024-09-10T10:10:00.938540+0000","last_peered":"2024-09-10T10:10:00.938540+0000","last_clean":"2024-09-10T10:10:00.938540+0000","last_became_active":"2024-09-10T10:08:35.375485+0000","last_became_peered":"2024-09-10T10:08:35.375485+0000","last_unstale":"2024-09-10T10:10:00.938540+0000","last_undegraded":"2024-09-10T10:10:00.938540+0000","last_fullsized":"2024-09-10T10:10:00.938540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:49.146648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938670+0000","last_change":"2024-09-10T10:08:35.375745+0000","last_active":"2024-09-10T10:10:00.938670+0000","last_peered":"2024-09-10T10:10:00.938670+0000","last_clean":"2024-09-10T10:10:00.938670+0000","last_became_active":"2024-09-10T10:08:35.375427+0000","last_became_peered":"2024-09-10T10:08:35.375427+0000","last_unstale":"2024-09-10T10:10:00.938670+0000","last_undegraded":"2024-09-10T10:10:00.938670+0000","last_fullsized":"2024-09-10T10:10:00.938670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:48.743434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185877+0000","last_change":"2024-09-10T10:08:35.377092+0000","last_active":"2024-09-10T10:10:01.185877+0000","last_peered":"2024-09-10T10:10:01.185877+0000","last_clean":"2024-09-10T10:10:01.185877+0000","last_became_active":"2024-09-10T10:08:35.376761+0000","last_became_peered":"2024-09-10T10:08:35.376761+0000","last_unstale":"2024-09-10T10:10:01.185877+0000","last_undegraded":"2024-09-10T10:10:01.185877+0000","last_fullsized":"2024-09-10T10:10:01.185877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:58.631742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66472,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":359,"num_read_kb":251,"num_write":169,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":199416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286200,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449124,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1044480,"data_stored":538290,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678058,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32348,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712804,"statfs":{"total":95995035648,"available":95961911296,"internally_reserved":0,"allocated":1183744,"data_stored":1188005,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841583,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1060864,"data_stored":542600,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070516,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1052672,"data_stored":538402,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1105920,"data_stored":1134728,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462976,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1036288,"data_stored":533680,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724614,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32276,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712876,"statfs":{"total":95995035648,"available":95961985024,"internally_reserved":0,"allocated":1114112,"data_stored":1129923,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888137,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1048576,"data_stored":538723,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149775,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1048576,"data_stored":533874,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1126400,"data_stored":597409,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712888,"statfs":{"total":95995035648,"available":95961997312,"internally_reserved":0,"allocated":1101824,"data_stored":595666,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1060864,"data_stored":535068,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":62076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:10:27.536 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:10:27.916 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:28.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:27 smithi050 ceph-mon[30354]: from='client.24953 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:10:28.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:27 smithi050 ceph-mon[30354]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:10:28.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:27 smithi189 ceph-mon[34999]: from='client.24953 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:10:28.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:27 smithi189 ceph-mon[34999]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:10:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:27 smithi084 ceph-mon[34812]: from='client.24953 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:10:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:27 smithi084 ceph-mon[34812]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:10:28.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.509+0000 7fd751400640 1 -- 172.21.15.50:0/647228084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74c102790 msgr2=0x7fd74c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:28.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.509+0000 7fd751400640 1 --2- 172.21.15.50:0/647228084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74c102790 0x7fd74c1067e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd734009900 tx=0x7fd73402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.510+0000 7fd751400640 1 -- 172.21.15.50:0/647228084 shutdown_connections 2024-09-10T10:10:28.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.510+0000 7fd751400640 1 --2- 172.21.15.50:0/647228084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd74c106f10 0x7fd74c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.510+0000 7fd751400640 1 --2- 172.21.15.50:0/647228084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74c102790 0x7fd74c1067e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.510+0000 7fd751400640 1 --2- 172.21.15.50:0/647228084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd74c101de0 0x7fd74c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.510+0000 7fd751400640 1 -- 172.21.15.50:0/647228084 >> 172.21.15.50:0/647228084 conn(0x7fd74c0fd8c0 msgr2=0x7fd74c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:28.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.510+0000 7fd751400640 1 -- 172.21.15.50:0/647228084 shutdown_connections 2024-09-10T10:10:28.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.510+0000 7fd751400640 1 -- 172.21.15.50:0/647228084 wait complete. 2024-09-10T10:10:28.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.511+0000 7fd751400640 1 Processor -- start 2024-09-10T10:10:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.511+0000 7fd751400640 1 -- start start 2024-09-10T10:10:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.511+0000 7fd751400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd74c101de0 0x7fd74c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.511+0000 7fd751400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74c102790 0x7fd74c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.511+0000 7fd751400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd74c106f10 0x7fd74c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.511+0000 7fd751400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c111fc0 con 0x7fd74c102790 2024-09-10T10:10:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.511+0000 7fd751400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c111e40 con 0x7fd74c101de0 2024-09-10T10:10:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.511+0000 7fd751400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c112140 con 0x7fd74c106f10 2024-09-10T10:10:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.512+0000 7fd741e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74c102790 0x7fd74c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.512+0000 7fd74a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd74c101de0 0x7fd74c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.512+0000 7fd74a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd74c101de0 0x7fd74c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:35912/0 (socket says 172.21.15.50:35912) 2024-09-10T10:10:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.512+0000 7fd741e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74c102790 0x7fd74c19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57814/0 (socket says 172.21.15.50:57814) 2024-09-10T10:10:28.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.512+0000 7fd74a800640 1 -- 172.21.15.50:0/309336718 learned_addr learned my addr 172.21.15.50:0/309336718 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:28.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.512+0000 7fd74b200640 1 --2- 172.21.15.50:0/309336718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd74c106f10 0x7fd74c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:28.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.512+0000 7fd74a800640 1 -- 172.21.15.50:0/309336718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd74c106f10 msgr2=0x7fd74c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:28.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.512+0000 7fd74a800640 1 --2- 172.21.15.50:0/309336718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd74c106f10 0x7fd74c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.512+0000 7fd74a800640 1 -- 172.21.15.50:0/309336718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74c102790 msgr2=0x7fd74c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:28.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.512+0000 7fd74a800640 1 --2- 172.21.15.50:0/309336718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74c102790 0x7fd74c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.512+0000 7fd74a800640 1 -- 172.21.15.50:0/309336718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c19f5d0 con 0x7fd74c101de0 2024-09-10T10:10:28.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.513+0000 7fd74a800640 1 --2- 172.21.15.50:0/309336718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd74c101de0 0x7fd74c19a620 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00e9f0 tx=0x7fd73c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.513+0000 7fd743e00640 1 -- 172.21.15.50:0/309336718 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c00cd80 con 0x7fd74c101de0 2024-09-10T10:10:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.513+0000 7fd743e00640 1 -- 172.21.15.50:0/309336718 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd73c010910 con 0x7fd74c101de0 2024-09-10T10:10:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.513+0000 7fd743e00640 1 -- 172.21.15.50:0/309336718 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c018990 con 0x7fd74c101de0 2024-09-10T10:10:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.513+0000 7fd751400640 1 -- 172.21.15.50:0/309336718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74c19f8c0 con 0x7fd74c101de0 2024-09-10T10:10:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.513+0000 7fd751400640 1 -- 172.21.15.50:0/309336718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74c1a71a0 con 0x7fd74c101de0 2024-09-10T10:10:28.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.514+0000 7fd751400640 1 -- 172.21.15.50:0/309336718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74c1021c0 con 0x7fd74c101de0 2024-09-10T10:10:28.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.516+0000 7fd743e00640 1 -- 172.21.15.50:0/309336718 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd73c010ac0 con 0x7fd74c101de0 2024-09-10T10:10:28.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.517+0000 7fd743e00640 1 --2- 172.21.15.50:0/309336718 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7300a2c90 0x7fd7300a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.517+0000 7fd743e00640 1 -- 172.21.15.50:0/309336718 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fd73c0cfc50 con 0x7fd74c101de0 2024-09-10T10:10:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.518+0000 7fd741e00640 1 --2- 172.21.15.50:0/309336718 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7300a2c90 0x7fd7300a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:28.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.518+0000 7fd741e00640 1 --2- 172.21.15.50:0/309336718 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7300a2c90 0x7fd7300a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd734000c00 tx=0x7fd734005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:28.520 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.519+0000 7fd743e00640 1 -- 172.21.15.50:0/309336718 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd73c09c010 con 0x7fd74c101de0 2024-09-10T10:10:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.700+0000 7fd751400640 1 -- 172.21.15.50:0/309336718 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd74c10de00 con 0x7fd7300a2c90 2024-09-10T10:10:28.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.709+0000 7fd743e00640 1 -- 172.21.15.50:0/309336718 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340636 (secure 0 0 0) 0x7fd74c10de00 con 0x7fd7300a2c90 2024-09-10T10:10:28.714 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:10:28.716 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-10T10:10:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.714+0000 7fd751400640 1 -- 172.21.15.50:0/309336718 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7300a2c90 msgr2=0x7fd7300a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.714+0000 7fd751400640 1 --2- 172.21.15.50:0/309336718 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7300a2c90 0x7fd7300a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd734000c00 tx=0x7fd734005b50 comp rx=0 tx=0).stop 2024-09-10T10:10:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.714+0000 7fd751400640 1 -- 172.21.15.50:0/309336718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd74c101de0 msgr2=0x7fd74c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.714+0000 7fd751400640 1 --2- 172.21.15.50:0/309336718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd74c101de0 0x7fd74c19a620 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00e9f0 tx=0x7fd73c00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.714+0000 7fd751400640 1 -- 172.21.15.50:0/309336718 shutdown_connections 2024-09-10T10:10:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.714+0000 7fd751400640 1 --2- 172.21.15.50:0/309336718 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd7300a2c90 0x7fd7300a5150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.714+0000 7fd751400640 1 --2- 172.21.15.50:0/309336718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd74c106f10 0x7fd74c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.714+0000 7fd751400640 1 --2- 172.21.15.50:0/309336718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd74c102790 0x7fd74c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.714+0000 7fd751400640 1 --2- 172.21.15.50:0/309336718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd74c101de0 0x7fd74c19a620 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.714+0000 7fd751400640 1 -- 172.21.15.50:0/309336718 >> 172.21.15.50:0/309336718 conn(0x7fd74c0fd8c0 msgr2=0x7fd74c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.714+0000 7fd751400640 1 -- 172.21.15.50:0/309336718 shutdown_connections 2024-09-10T10:10:28.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:28.714+0000 7fd751400640 1 -- 172.21.15.50:0/309336718 wait complete. 2024-09-10T10:10:29.139 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:28 smithi050 ceph-mon[30354]: from='client.24959 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:10:29.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:28 smithi189 ceph-mon[34999]: from='client.24959 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:10:29.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:28 smithi084 ceph-mon[34812]: from='client.24959 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:10:29.490 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-10T10:10:26.790610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657074,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":505,"num_read_kb":370,"num_write":352,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":283,"ondisk_log_size":283,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361996,"kb_used_data":12680,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579828,"statfs":{"total":1151940427776,"available":1151569743872,"internally_reserved":0,"allocated":12984320,"data_stored":8406368,"data_compressed":498339,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010946"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724596+0000","last_change":"2024-09-10T10:08:32.889755+0000","last_active":"2024-09-10T10:10:00.724596+0000","last_peered":"2024-09-10T10:10:00.724596+0000","last_clean":"2024-09-10T10:10:00.724596+0000","last_became_active":"2024-09-10T10:08:32.889455+0000","last_became_peered":"2024-09-10T10:08:32.889455+0000","last_unstale":"2024-09-10T10:10:00.724596+0000","last_undegraded":"2024-09-10T10:10:00.724596+0000","last_fullsized":"2024-09-10T10:10:00.724596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:53.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.974619+0000","last_change":"2024-09-10T10:10:00.974216+0000","last_active":"2024-09-10T10:10:00.974619+0000","last_peered":"2024-09-10T10:10:00.974619+0000","last_clean":"2024-09-10T10:10:00.974619+0000","last_became_active":"2024-09-10T10:10:00.973841+0000","last_became_peered":"2024-09-10T10:10:00.973841+0000","last_unstale":"2024-09-10T10:10:00.974619+0000","last_undegraded":"2024-09-10T10:10:00.974619+0000","last_fullsized":"2024-09-10T10:10:00.974619+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:30.575610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972464+0000","last_change":"2024-09-10T10:08:44.399836+0000","last_active":"2024-09-10T10:10:00.972464+0000","last_peered":"2024-09-10T10:10:00.972464+0000","last_clean":"2024-09-10T10:10:00.972464+0000","last_became_active":"2024-09-10T10:08:44.399510+0000","last_became_peered":"2024-09-10T10:08:44.399510+0000","last_unstale":"2024-09-10T10:10:00.972464+0000","last_undegraded":"2024-09-10T10:10:00.972464+0000","last_fullsized":"2024-09-10T10:10:00.972464+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:47.372690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722195+0000","last_change":"2024-09-10T10:08:32.887099+0000","last_active":"2024-09-10T10:10:00.722195+0000","last_peered":"2024-09-10T10:10:00.722195+0000","last_clean":"2024-09-10T10:10:00.722195+0000","last_became_active":"2024-09-10T10:08:32.886730+0000","last_became_peered":"2024-09-10T10:08:32.886730+0000","last_unstale":"2024-09-10T10:10:00.722195+0000","last_undegraded":"2024-09-10T10:10:00.722195+0000","last_fullsized":"2024-09-10T10:10:00.722195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.277241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.939029+0000","last_change":"2024-09-10T10:08:35.375494+0000","last_active":"2024-09-10T10:10:00.939029+0000","last_peered":"2024-09-10T10:10:00.939029+0000","last_clean":"2024-09-10T10:10:00.939029+0000","last_became_active":"2024-09-10T10:08:35.373991+0000","last_became_peered":"2024-09-10T10:08:35.373991+0000","last_unstale":"2024-09-10T10:10:00.939029+0000","last_undegraded":"2024-09-10T10:10:00.939029+0000","last_fullsized":"2024-09-10T10:10:00.939029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:25.858163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721497+0000","last_change":"2024-09-10T10:09:00.457967+0000","last_active":"2024-09-10T10:10:00.721497+0000","last_peered":"2024-09-10T10:10:00.721497+0000","last_clean":"2024-09-10T10:10:00.721497+0000","last_became_active":"2024-09-10T10:09:00.457446+0000","last_became_peered":"2024-09-10T10:09:00.457446+0000","last_unstale":"2024-09-10T10:10:00.721497+0000","last_undegraded":"2024-09-10T10:10:00.721497+0000","last_fullsized":"2024-09-10T10:10:00.721497+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:00.550304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722766+0000","last_change":"2024-09-10T10:08:32.890270+0000","last_active":"2024-09-10T10:10:00.722766+0000","last_peered":"2024-09-10T10:10:00.722766+0000","last_clean":"2024-09-10T10:10:00.722766+0000","last_became_active":"2024-09-10T10:08:32.889887+0000","last_became_peered":"2024-09-10T10:08:32.889887+0000","last_unstale":"2024-09-10T10:10:00.722766+0000","last_undegraded":"2024-09-10T10:10:00.722766+0000","last_fullsized":"2024-09-10T10:10:00.722766+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:39.757510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862316+0000","last_change":"2024-09-10T10:08:35.357257+0000","last_active":"2024-09-10T10:10:00.862316+0000","last_peered":"2024-09-10T10:10:00.862316+0000","last_clean":"2024-09-10T10:10:00.862316+0000","last_became_active":"2024-09-10T10:08:35.356918+0000","last_became_peered":"2024-09-10T10:08:35.356918+0000","last_unstale":"2024-09-10T10:10:00.862316+0000","last_undegraded":"2024-09-10T10:10:00.862316+0000","last_fullsized":"2024-09-10T10:10:00.862316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:04.387581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721937+0000","last_change":"2024-09-10T10:09:00.487116+0000","last_active":"2024-09-10T10:10:00.721937+0000","last_peered":"2024-09-10T10:10:00.721937+0000","last_clean":"2024-09-10T10:10:00.721937+0000","last_became_active":"2024-09-10T10:09:00.486646+0000","last_became_peered":"2024-09-10T10:09:00.486646+0000","last_unstale":"2024-09-10T10:10:00.721937+0000","last_undegraded":"2024-09-10T10:10:00.721937+0000","last_fullsized":"2024-09-10T10:10:00.721937+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:40.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722841+0000","last_change":"2024-09-10T10:08:32.891399+0000","last_active":"2024-09-10T10:10:00.722841+0000","last_peered":"2024-09-10T10:10:00.722841+0000","last_clean":"2024-09-10T10:10:00.722841+0000","last_became_active":"2024-09-10T10:08:32.891022+0000","last_became_peered":"2024-09-10T10:08:32.891022+0000","last_unstale":"2024-09-10T10:10:00.722841+0000","last_undegraded":"2024-09-10T10:10:00.722841+0000","last_fullsized":"2024-09-10T10:10:00.722841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:30.842443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840315+0000","last_change":"2024-09-10T10:08:35.370630+0000","last_active":"2024-09-10T10:10:00.840315+0000","last_peered":"2024-09-10T10:10:00.840315+0000","last_clean":"2024-09-10T10:10:00.840315+0000","last_became_active":"2024-09-10T10:08:35.370263+0000","last_became_peered":"2024-09-10T10:08:35.370263+0000","last_unstale":"2024-09-10T10:10:00.840315+0000","last_undegraded":"2024-09-10T10:10:00.840315+0000","last_fullsized":"2024-09-10T10:10:00.840315+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:41.549815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721632+0000","last_change":"2024-09-10T10:08:44.405298+0000","last_active":"2024-09-10T10:10:00.721632+0000","last_peered":"2024-09-10T10:10:00.721632+0000","last_clean":"2024-09-10T10:10:00.721632+0000","last_became_active":"2024-09-10T10:08:44.405027+0000","last_became_peered":"2024-09-10T10:08:44.405027+0000","last_unstale":"2024-09-10T10:10:00.721632+0000","last_undegraded":"2024-09-10T10:10:00.721632+0000","last_fullsized":"2024-09-10T10:10:00.721632+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:08.486563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185348+0000","last_change":"2024-09-10T10:08:35.369040+0000","last_active":"2024-09-10T10:10:01.185348+0000","last_peered":"2024-09-10T10:10:01.185348+0000","last_clean":"2024-09-10T10:10:01.185348+0000","last_became_active":"2024-09-10T10:08:35.368576+0000","last_became_peered":"2024-09-10T10:08:35.368576+0000","last_unstale":"2024-09-10T10:10:01.185348+0000","last_undegraded":"2024-09-10T10:10:01.185348+0000","last_fullsized":"2024-09-10T10:10:01.185348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:44.887554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722320+0000","last_change":"2024-09-10T10:08:32.889549+0000","last_active":"2024-09-10T10:10:00.722320+0000","last_peered":"2024-09-10T10:10:00.722320+0000","last_clean":"2024-09-10T10:10:00.722320+0000","last_became_active":"2024-09-10T10:08:32.889197+0000","last_became_peered":"2024-09-10T10:08:32.889197+0000","last_unstale":"2024-09-10T10:10:00.722320+0000","last_undegraded":"2024-09-10T10:10:00.722320+0000","last_fullsized":"2024-09-10T10:10:00.722320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:53.697069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721918+0000","last_change":"2024-09-10T10:08:44.929048+0000","last_active":"2024-09-10T10:10:00.721918+0000","last_peered":"2024-09-10T10:10:00.721918+0000","last_clean":"2024-09-10T10:10:00.721918+0000","last_became_active":"2024-09-10T10:08:44.928345+0000","last_became_peered":"2024-09-10T10:08:44.928345+0000","last_unstale":"2024-09-10T10:10:00.721918+0000","last_undegraded":"2024-09-10T10:10:00.721918+0000","last_fullsized":"2024-09-10T10:10:00.721918+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:23.121853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721372+0000","last_change":"2024-09-10T10:08:35.377385+0000","last_active":"2024-09-10T10:10:00.721372+0000","last_peered":"2024-09-10T10:10:00.721372+0000","last_clean":"2024-09-10T10:10:00.721372+0000","last_became_active":"2024-09-10T10:08:35.377092+0000","last_became_peered":"2024-09-10T10:08:35.377092+0000","last_unstale":"2024-09-10T10:10:00.721372+0000","last_undegraded":"2024-09-10T10:10:00.721372+0000","last_fullsized":"2024-09-10T10:10:00.721372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:23.169370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972261+0000","last_change":"2024-09-10T10:08:32.891614+0000","last_active":"2024-09-10T10:10:00.972261+0000","last_peered":"2024-09-10T10:10:00.972261+0000","last_clean":"2024-09-10T10:10:00.972261+0000","last_became_active":"2024-09-10T10:08:32.891141+0000","last_became_peered":"2024-09-10T10:08:32.891141+0000","last_unstale":"2024-09-10T10:10:00.972261+0000","last_undegraded":"2024-09-10T10:10:00.972261+0000","last_fullsized":"2024-09-10T10:10:00.972261+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:20.258863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721871+0000","last_change":"2024-09-10T10:08:44.401125+0000","last_active":"2024-09-10T10:10:00.721871+0000","last_peered":"2024-09-10T10:10:00.721871+0000","last_clean":"2024-09-10T10:10:00.721871+0000","last_became_active":"2024-09-10T10:08:44.400483+0000","last_became_peered":"2024-09-10T10:08:44.400483+0000","last_unstale":"2024-09-10T10:10:00.721871+0000","last_undegraded":"2024-09-10T10:10:00.721871+0000","last_fullsized":"2024-09-10T10:10:00.721871+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:12.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185284+0000","last_change":"2024-09-10T10:08:35.376806+0000","last_active":"2024-09-10T10:10:01.185284+0000","last_peered":"2024-09-10T10:10:01.185284+0000","last_clean":"2024-09-10T10:10:01.185284+0000","last_became_active":"2024-09-10T10:08:35.376400+0000","last_became_peered":"2024-09-10T10:08:35.376400+0000","last_unstale":"2024-09-10T10:10:01.185284+0000","last_undegraded":"2024-09-10T10:10:01.185284+0000","last_fullsized":"2024-09-10T10:10:01.185284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:48.303039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721519+0000","last_change":"2024-09-10T10:08:32.883881+0000","last_active":"2024-09-10T10:10:00.721519+0000","last_peered":"2024-09-10T10:10:00.721519+0000","last_clean":"2024-09-10T10:10:00.721519+0000","last_became_active":"2024-09-10T10:08:32.883540+0000","last_became_peered":"2024-09-10T10:08:32.883540+0000","last_unstale":"2024-09-10T10:10:00.721519+0000","last_undegraded":"2024-09-10T10:10:00.721519+0000","last_fullsized":"2024-09-10T10:10:00.721519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:57.359729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724274+0000","last_change":"2024-09-10T10:08:44.401548+0000","last_active":"2024-09-10T10:10:00.724274+0000","last_peered":"2024-09-10T10:10:00.724274+0000","last_clean":"2024-09-10T10:10:00.724274+0000","last_became_active":"2024-09-10T10:08:44.401034+0000","last_became_peered":"2024-09-10T10:08:44.401034+0000","last_unstale":"2024-09-10T10:10:00.724274+0000","last_undegraded":"2024-09-10T10:10:00.724274+0000","last_fullsized":"2024-09-10T10:10:00.724274+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:17.292973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722142+0000","last_change":"2024-09-10T10:08:35.359969+0000","last_active":"2024-09-10T10:10:00.722142+0000","last_peered":"2024-09-10T10:10:00.722142+0000","last_clean":"2024-09-10T10:10:00.722142+0000","last_became_active":"2024-09-10T10:08:35.359599+0000","last_became_peered":"2024-09-10T10:08:35.359599+0000","last_unstale":"2024-09-10T10:10:00.722142+0000","last_undegraded":"2024-09-10T10:10:00.722142+0000","last_fullsized":"2024-09-10T10:10:00.722142+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:00.778269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862109+0000","last_change":"2024-09-10T10:09:00.487582+0000","last_active":"2024-09-10T10:10:00.862109+0000","last_peered":"2024-09-10T10:10:00.862109+0000","last_clean":"2024-09-10T10:10:00.862109+0000","last_became_active":"2024-09-10T10:09:00.487229+0000","last_became_peered":"2024-09-10T10:09:00.487229+0000","last_unstale":"2024-09-10T10:10:00.862109+0000","last_undegraded":"2024-09-10T10:10:00.862109+0000","last_fullsized":"2024-09-10T10:10:00.862109+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:53.341736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722009+0000","last_change":"2024-09-10T10:08:44.929224+0000","last_active":"2024-09-10T10:10:00.722009+0000","last_peered":"2024-09-10T10:10:00.722009+0000","last_clean":"2024-09-10T10:10:00.722009+0000","last_became_active":"2024-09-10T10:08:44.928640+0000","last_became_peered":"2024-09-10T10:08:44.928640+0000","last_unstale":"2024-09-10T10:10:00.722009+0000","last_undegraded":"2024-09-10T10:10:00.722009+0000","last_fullsized":"2024-09-10T10:10:00.722009+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:42.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938766+0000","last_change":"2024-09-10T10:08:35.376585+0000","last_active":"2024-09-10T10:10:00.938766+0000","last_peered":"2024-09-10T10:10:00.938766+0000","last_clean":"2024-09-10T10:10:00.938766+0000","last_became_active":"2024-09-10T10:08:35.375693+0000","last_became_peered":"2024-09-10T10:08:35.375693+0000","last_unstale":"2024-09-10T10:10:00.938766+0000","last_undegraded":"2024-09-10T10:10:00.938766+0000","last_fullsized":"2024-09-10T10:10:00.938766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:59.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722265+0000","last_change":"2024-09-10T10:08:32.884542+0000","last_active":"2024-09-10T10:10:00.722265+0000","last_peered":"2024-09-10T10:10:00.722265+0000","last_clean":"2024-09-10T10:10:00.722265+0000","last_became_active":"2024-09-10T10:08:32.884192+0000","last_became_peered":"2024-09-10T10:08:32.884192+0000","last_unstale":"2024-09-10T10:10:00.722265+0000","last_undegraded":"2024-09-10T10:10:00.722265+0000","last_fullsized":"2024-09-10T10:10:00.722265+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:57.756641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972592+0000","last_change":"2024-09-10T10:08:44.391514+0000","last_active":"2024-09-10T10:10:00.972592+0000","last_peered":"2024-09-10T10:10:00.972592+0000","last_clean":"2024-09-10T10:10:00.972592+0000","last_became_active":"2024-09-10T10:08:44.391116+0000","last_became_peered":"2024-09-10T10:08:44.391116+0000","last_unstale":"2024-09-10T10:10:00.972592+0000","last_undegraded":"2024-09-10T10:10:00.972592+0000","last_fullsized":"2024-09-10T10:10:00.972592+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:41.586014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722193+0000","last_change":"2024-09-10T10:08:35.365604+0000","last_active":"2024-09-10T10:10:00.722193+0000","last_peered":"2024-09-10T10:10:00.722193+0000","last_clean":"2024-09-10T10:10:00.722193+0000","last_became_active":"2024-09-10T10:08:35.364915+0000","last_became_peered":"2024-09-10T10:08:35.364915+0000","last_unstale":"2024-09-10T10:10:00.722193+0000","last_undegraded":"2024-09-10T10:10:00.722193+0000","last_fullsized":"2024-09-10T10:10:00.722193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:12.885021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'11","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724849+0000","last_change":"2024-09-10T10:08:32.888223+0000","last_active":"2024-09-10T10:10:00.724849+0000","last_peered":"2024-09-10T10:10:00.724849+0000","last_clean":"2024-09-10T10:10:00.724849+0000","last_became_active":"2024-09-10T10:08:32.887919+0000","last_became_peered":"2024-09-10T10:08:32.887919+0000","last_unstale":"2024-09-10T10:10:00.724849+0000","last_undegraded":"2024-09-10T10:10:00.724849+0000","last_fullsized":"2024-09-10T10:10:00.724849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:19.781337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721010+0000","last_change":"2024-09-10T10:08:44.929322+0000","last_active":"2024-09-10T10:10:00.721010+0000","last_peered":"2024-09-10T10:10:00.721010+0000","last_clean":"2024-09-10T10:10:00.721010+0000","last_became_active":"2024-09-10T10:08:44.928252+0000","last_became_peered":"2024-09-10T10:08:44.928252+0000","last_unstale":"2024-09-10T10:10:00.721010+0000","last_undegraded":"2024-09-10T10:10:00.721010+0000","last_fullsized":"2024-09-10T10:10:00.721010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:33.048265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040381+0000","last_change":"2024-09-10T10:08:35.364168+0000","last_active":"2024-09-10T10:10:01.040381+0000","last_peered":"2024-09-10T10:10:01.040381+0000","last_clean":"2024-09-10T10:10:01.040381+0000","last_became_active":"2024-09-10T10:08:35.363739+0000","last_became_peered":"2024-09-10T10:08:35.363739+0000","last_unstale":"2024-09-10T10:10:01.040381+0000","last_undegraded":"2024-09-10T10:10:01.040381+0000","last_fullsized":"2024-09-10T10:10:01.040381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:43.029409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722777+0000","last_change":"2024-09-10T10:08:32.893021+0000","last_active":"2024-09-10T10:10:00.722777+0000","last_peered":"2024-09-10T10:10:00.722777+0000","last_clean":"2024-09-10T10:10:00.722777+0000","last_became_active":"2024-09-10T10:08:32.892667+0000","last_became_peered":"2024-09-10T10:08:32.892667+0000","last_unstale":"2024-09-10T10:10:00.722777+0000","last_undegraded":"2024-09-10T10:10:00.722777+0000","last_fullsized":"2024-09-10T10:10:00.722777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:52.427489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185519+0000","last_change":"2024-09-10T10:08:44.393831+0000","last_active":"2024-09-10T10:10:01.185519+0000","last_peered":"2024-09-10T10:10:01.185519+0000","last_clean":"2024-09-10T10:10:01.185519+0000","last_became_active":"2024-09-10T10:08:44.393415+0000","last_became_peered":"2024-09-10T10:08:44.393415+0000","last_unstale":"2024-09-10T10:10:01.185519+0000","last_undegraded":"2024-09-10T10:10:01.185519+0000","last_fullsized":"2024-09-10T10:10:01.185519+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:52.171292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.110344+0000","last_change":"2024-09-10T10:08:35.374787+0000","last_active":"2024-09-10T10:10:01.110344+0000","last_peered":"2024-09-10T10:10:01.110344+0000","last_clean":"2024-09-10T10:10:01.110344+0000","last_became_active":"2024-09-10T10:08:35.374549+0000","last_became_peered":"2024-09-10T10:08:35.374549+0000","last_unstale":"2024-09-10T10:10:01.110344+0000","last_undegraded":"2024-09-10T10:10:01.110344+0000","last_fullsized":"2024-09-10T10:10:01.110344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:58.925515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724378+0000","last_change":"2024-09-10T10:08:32.886267+0000","last_active":"2024-09-10T10:10:00.724378+0000","last_peered":"2024-09-10T10:10:00.724378+0000","last_clean":"2024-09-10T10:10:00.724378+0000","last_became_active":"2024-09-10T10:08:32.885869+0000","last_became_peered":"2024-09-10T10:08:32.885869+0000","last_unstale":"2024-09-10T10:10:00.724378+0000","last_undegraded":"2024-09-10T10:10:00.724378+0000","last_fullsized":"2024-09-10T10:10:00.724378+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:06.784839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722177+0000","last_change":"2024-09-10T10:09:00.486656+0000","last_active":"2024-09-10T10:10:00.722177+0000","last_peered":"2024-09-10T10:10:00.722177+0000","last_clean":"2024-09-10T10:10:00.722177+0000","last_became_active":"2024-09-10T10:09:00.486072+0000","last_became_peered":"2024-09-10T10:09:00.486072+0000","last_unstale":"2024-09-10T10:10:00.722177+0000","last_undegraded":"2024-09-10T10:10:00.722177+0000","last_fullsized":"2024-09-10T10:10:00.722177+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:26.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.110279+0000","last_change":"2024-09-10T10:08:35.366130+0000","last_active":"2024-09-10T10:10:01.110279+0000","last_peered":"2024-09-10T10:10:01.110279+0000","last_clean":"2024-09-10T10:10:01.110279+0000","last_became_active":"2024-09-10T10:08:35.365785+0000","last_became_peered":"2024-09-10T10:08:35.365785+0000","last_unstale":"2024-09-10T10:10:01.110279+0000","last_undegraded":"2024-09-10T10:10:01.110279+0000","last_fullsized":"2024-09-10T10:10:01.110279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:35.771767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184895+0000","last_change":"2024-09-10T10:08:32.884113+0000","last_active":"2024-09-10T10:10:01.184895+0000","last_peered":"2024-09-10T10:10:01.184895+0000","last_clean":"2024-09-10T10:10:01.184895+0000","last_became_active":"2024-09-10T10:08:32.883503+0000","last_became_peered":"2024-09-10T10:08:32.883503+0000","last_unstale":"2024-09-10T10:10:01.184895+0000","last_undegraded":"2024-09-10T10:10:01.184895+0000","last_fullsized":"2024-09-10T10:10:01.184895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:20.513465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040223+0000","last_change":"2024-09-10T10:08:44.400137+0000","last_active":"2024-09-10T10:10:01.040223+0000","last_peered":"2024-09-10T10:10:01.040223+0000","last_clean":"2024-09-10T10:10:01.040223+0000","last_became_active":"2024-09-10T10:08:44.398736+0000","last_became_peered":"2024-09-10T10:08:44.398736+0000","last_unstale":"2024-09-10T10:10:01.040223+0000","last_undegraded":"2024-09-10T10:10:01.040223+0000","last_fullsized":"2024-09-10T10:10:01.040223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:48.922732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839789+0000","last_change":"2024-09-10T10:08:35.360818+0000","last_active":"2024-09-10T10:10:00.839789+0000","last_peered":"2024-09-10T10:10:00.839789+0000","last_clean":"2024-09-10T10:10:00.839789+0000","last_became_active":"2024-09-10T10:08:35.360504+0000","last_became_peered":"2024-09-10T10:08:35.360504+0000","last_unstale":"2024-09-10T10:10:00.839789+0000","last_undegraded":"2024-09-10T10:10:00.839789+0000","last_fullsized":"2024-09-10T10:10:00.839789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:45.396069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'4","reported_seq":100,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:20.621422+0000","last_change":"2024-09-10T10:08:32.883915+0000","last_active":"2024-09-10T10:10:20.621422+0000","last_peered":"2024-09-10T10:10:20.621422+0000","last_clean":"2024-09-10T10:10:20.621422+0000","last_became_active":"2024-09-10T10:08:32.883573+0000","last_became_peered":"2024-09-10T10:08:32.883573+0000","last_unstale":"2024-09-10T10:10:20.621422+0000","last_undegraded":"2024-09-10T10:10:20.621422+0000","last_fullsized":"2024-09-10T10:10:20.621422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:56.271267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040548+0000","last_change":"2024-09-10T10:08:44.928968+0000","last_active":"2024-09-10T10:10:01.040548+0000","last_peered":"2024-09-10T10:10:01.040548+0000","last_clean":"2024-09-10T10:10:01.040548+0000","last_became_active":"2024-09-10T10:08:44.928445+0000","last_became_peered":"2024-09-10T10:08:44.928445+0000","last_unstale":"2024-09-10T10:10:01.040548+0000","last_undegraded":"2024-09-10T10:10:01.040548+0000","last_fullsized":"2024-09-10T10:10:01.040548+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:01.799454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039913+0000","last_change":"2024-09-10T10:08:35.369027+0000","last_active":"2024-09-10T10:10:01.039913+0000","last_peered":"2024-09-10T10:10:01.039913+0000","last_clean":"2024-09-10T10:10:01.039913+0000","last_became_active":"2024-09-10T10:08:35.368692+0000","last_became_peered":"2024-09-10T10:08:35.368692+0000","last_unstale":"2024-09-10T10:10:01.039913+0000","last_undegraded":"2024-09-10T10:10:01.039913+0000","last_fullsized":"2024-09-10T10:10:01.039913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:09.500617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184735+0000","last_change":"2024-09-10T10:08:32.888661+0000","last_active":"2024-09-10T10:10:01.184735+0000","last_peered":"2024-09-10T10:10:01.184735+0000","last_clean":"2024-09-10T10:10:01.184735+0000","last_became_active":"2024-09-10T10:08:32.888312+0000","last_became_peered":"2024-09-10T10:08:32.888312+0000","last_unstale":"2024-09-10T10:10:01.184735+0000","last_undegraded":"2024-09-10T10:10:01.184735+0000","last_fullsized":"2024-09-10T10:10:01.184735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:47.293560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840320+0000","last_change":"2024-09-10T10:08:44.929512+0000","last_active":"2024-09-10T10:10:00.840320+0000","last_peered":"2024-09-10T10:10:00.840320+0000","last_clean":"2024-09-10T10:10:00.840320+0000","last_became_active":"2024-09-10T10:08:44.928992+0000","last_became_peered":"2024-09-10T10:08:44.928992+0000","last_unstale":"2024-09-10T10:10:00.840320+0000","last_undegraded":"2024-09-10T10:10:00.840320+0000","last_fullsized":"2024-09-10T10:10:00.840320+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:31.827967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.863799+0000","last_change":"2024-09-10T10:10:00.863430+0000","last_active":"2024-09-10T10:10:00.863799+0000","last_peered":"2024-09-10T10:10:00.863799+0000","last_clean":"2024-09-10T10:10:00.863799+0000","last_became_active":"2024-09-10T10:10:00.863082+0000","last_became_peered":"2024-09-10T10:10:00.863082+0000","last_unstale":"2024-09-10T10:10:00.863799+0000","last_undegraded":"2024-09-10T10:10:00.863799+0000","last_fullsized":"2024-09-10T10:10:00.863799+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:24.848797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722200+0000","last_change":"2024-09-10T10:08:32.885451+0000","last_active":"2024-09-10T10:10:00.722200+0000","last_peered":"2024-09-10T10:10:00.722200+0000","last_clean":"2024-09-10T10:10:00.722200+0000","last_became_active":"2024-09-10T10:08:32.885102+0000","last_became_peered":"2024-09-10T10:08:32.885102+0000","last_unstale":"2024-09-10T10:10:00.722200+0000","last_undegraded":"2024-09-10T10:10:00.722200+0000","last_fullsized":"2024-09-10T10:10:00.722200+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:52.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":356,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185287+0000","last_change":"2024-09-10T10:07:13.661841+0000","last_active":"2024-09-10T10:10:01.185287+0000","last_peered":"2024-09-10T10:10:01.185287+0000","last_clean":"2024-09-10T10:10:01.185287+0000","last_became_active":"2024-09-10T10:07:13.661310+0000","last_became_peered":"2024-09-10T10:07:13.661310+0000","last_unstale":"2024-09-10T10:10:01.185287+0000","last_undegraded":"2024-09-10T10:10:01.185287+0000","last_fullsized":"2024-09-10T10:10:01.185287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_clean_scrub_stamp":"2024-09-10T10:03:29.327083+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:39.414636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185574+0000","last_change":"2024-09-10T10:08:44.391277+0000","last_active":"2024-09-10T10:10:01.185574+0000","last_peered":"2024-09-10T10:10:01.185574+0000","last_clean":"2024-09-10T10:10:01.185574+0000","last_became_active":"2024-09-10T10:08:44.390867+0000","last_became_peered":"2024-09-10T10:08:44.390867+0000","last_unstale":"2024-09-10T10:10:01.185574+0000","last_undegraded":"2024-09-10T10:10:01.185574+0000","last_fullsized":"2024-09-10T10:10:01.185574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:23.299812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185722+0000","last_change":"2024-09-10T10:08:35.364750+0000","last_active":"2024-09-10T10:10:01.185722+0000","last_peered":"2024-09-10T10:10:01.185722+0000","last_clean":"2024-09-10T10:10:01.185722+0000","last_became_active":"2024-09-10T10:08:35.364034+0000","last_became_peered":"2024-09-10T10:08:35.364034+0000","last_unstale":"2024-09-10T10:10:01.185722+0000","last_undegraded":"2024-09-10T10:10:01.185722+0000","last_fullsized":"2024-09-10T10:10:01.185722+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:15.296086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973319+0000","last_change":"2024-09-10T10:08:32.886884+0000","last_active":"2024-09-10T10:10:00.973319+0000","last_peered":"2024-09-10T10:10:00.973319+0000","last_clean":"2024-09-10T10:10:00.973319+0000","last_became_active":"2024-09-10T10:08:32.886544+0000","last_became_peered":"2024-09-10T10:08:32.886544+0000","last_unstale":"2024-09-10T10:10:00.973319+0000","last_undegraded":"2024-09-10T10:10:00.973319+0000","last_fullsized":"2024-09-10T10:10:00.973319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:30.511881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862190+0000","last_change":"2024-09-10T10:08:44.390761+0000","last_active":"2024-09-10T10:10:00.862190+0000","last_peered":"2024-09-10T10:10:00.862190+0000","last_clean":"2024-09-10T10:10:00.862190+0000","last_became_active":"2024-09-10T10:08:44.390190+0000","last_became_peered":"2024-09-10T10:08:44.390190+0000","last_unstale":"2024-09-10T10:10:00.862190+0000","last_undegraded":"2024-09-10T10:10:00.862190+0000","last_fullsized":"2024-09-10T10:10:00.862190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:38.216171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185602+0000","last_change":"2024-09-10T10:08:35.362956+0000","last_active":"2024-09-10T10:10:01.185602+0000","last_peered":"2024-09-10T10:10:01.185602+0000","last_clean":"2024-09-10T10:10:01.185602+0000","last_became_active":"2024-09-10T10:08:35.362623+0000","last_became_peered":"2024-09-10T10:08:35.362623+0000","last_unstale":"2024-09-10T10:10:01.185602+0000","last_undegraded":"2024-09-10T10:10:01.185602+0000","last_fullsized":"2024-09-10T10:10:01.185602+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:50.162838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840512+0000","last_change":"2024-09-10T10:08:32.889741+0000","last_active":"2024-09-10T10:10:00.840512+0000","last_peered":"2024-09-10T10:10:00.840512+0000","last_clean":"2024-09-10T10:10:00.840512+0000","last_became_active":"2024-09-10T10:08:32.889394+0000","last_became_peered":"2024-09-10T10:08:32.889394+0000","last_unstale":"2024-09-10T10:10:00.840512+0000","last_undegraded":"2024-09-10T10:10:00.840512+0000","last_fullsized":"2024-09-10T10:10:00.840512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:16.845738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938245+0000","last_change":"2024-09-10T10:08:44.403781+0000","last_active":"2024-09-10T10:10:00.938245+0000","last_peered":"2024-09-10T10:10:00.938245+0000","last_clean":"2024-09-10T10:10:00.938245+0000","last_became_active":"2024-09-10T10:08:44.399601+0000","last_became_peered":"2024-09-10T10:08:44.399601+0000","last_unstale":"2024-09-10T10:10:00.938245+0000","last_undegraded":"2024-09-10T10:10:00.938245+0000","last_fullsized":"2024-09-10T10:10:00.938245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:45.587247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185766+0000","last_change":"2024-09-10T10:08:35.367825+0000","last_active":"2024-09-10T10:10:01.185766+0000","last_peered":"2024-09-10T10:10:01.185766+0000","last_clean":"2024-09-10T10:10:01.185766+0000","last_became_active":"2024-09-10T10:08:35.367511+0000","last_became_peered":"2024-09-10T10:08:35.367511+0000","last_unstale":"2024-09-10T10:10:01.185766+0000","last_undegraded":"2024-09-10T10:10:01.185766+0000","last_fullsized":"2024-09-10T10:10:01.185766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:03.356912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039709+0000","last_change":"2024-09-10T10:08:32.888524+0000","last_active":"2024-09-10T10:10:01.039709+0000","last_peered":"2024-09-10T10:10:01.039709+0000","last_clean":"2024-09-10T10:10:01.039709+0000","last_became_active":"2024-09-10T10:08:32.888148+0000","last_became_peered":"2024-09-10T10:08:32.888148+0000","last_unstale":"2024-09-10T10:10:01.039709+0000","last_undegraded":"2024-09-10T10:10:01.039709+0000","last_fullsized":"2024-09-10T10:10:01.039709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:34.342167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839505+0000","last_change":"2024-09-10T10:08:44.392952+0000","last_active":"2024-09-10T10:10:00.839505+0000","last_peered":"2024-09-10T10:10:00.839505+0000","last_clean":"2024-09-10T10:10:00.839505+0000","last_became_active":"2024-09-10T10:08:44.392476+0000","last_became_peered":"2024-09-10T10:08:44.392476+0000","last_unstale":"2024-09-10T10:10:00.839505+0000","last_undegraded":"2024-09-10T10:10:00.839505+0000","last_fullsized":"2024-09-10T10:10:00.839505+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:26.530305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185541+0000","last_change":"2024-09-10T10:08:35.364501+0000","last_active":"2024-09-10T10:10:01.185541+0000","last_peered":"2024-09-10T10:10:01.185541+0000","last_clean":"2024-09-10T10:10:01.185541+0000","last_became_active":"2024-09-10T10:08:35.364102+0000","last_became_peered":"2024-09-10T10:08:35.364102+0000","last_unstale":"2024-09-10T10:10:01.185541+0000","last_undegraded":"2024-09-10T10:10:01.185541+0000","last_fullsized":"2024-09-10T10:10:01.185541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:42.743140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":21,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185836+0000","last_change":"2024-09-10T10:09:00.461639+0000","last_active":"2024-09-10T10:10:01.185836+0000","last_peered":"2024-09-10T10:10:01.185836+0000","last_clean":"2024-09-10T10:10:01.185836+0000","last_became_active":"2024-09-10T10:09:00.457246+0000","last_became_peered":"2024-09-10T10:09:00.457246+0000","last_unstale":"2024-09-10T10:10:01.185836+0000","last_undegraded":"2024-09-10T10:10:01.185836+0000","last_fullsized":"2024-09-10T10:10:01.185836+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:30.387035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839839+0000","last_change":"2024-09-10T10:08:44.401728+0000","last_active":"2024-09-10T10:10:00.839839+0000","last_peered":"2024-09-10T10:10:00.839839+0000","last_clean":"2024-09-10T10:10:00.839839+0000","last_became_active":"2024-09-10T10:08:44.401334+0000","last_became_peered":"2024-09-10T10:08:44.401334+0000","last_unstale":"2024-09-10T10:10:00.839839+0000","last_undegraded":"2024-09-10T10:10:00.839839+0000","last_fullsized":"2024-09-10T10:10:00.839839+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:57.496196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839806+0000","last_change":"2024-09-10T10:09:00.486353+0000","last_active":"2024-09-10T10:10:00.839806+0000","last_peered":"2024-09-10T10:10:00.839806+0000","last_clean":"2024-09-10T10:10:00.839806+0000","last_became_active":"2024-09-10T10:09:00.485938+0000","last_became_peered":"2024-09-10T10:09:00.485938+0000","last_unstale":"2024-09-10T10:10:00.839806+0000","last_undegraded":"2024-09-10T10:10:00.839806+0000","last_fullsized":"2024-09-10T10:10:00.839806+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:38.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722275+0000","last_change":"2024-09-10T10:08:32.893278+0000","last_active":"2024-09-10T10:10:00.722275+0000","last_peered":"2024-09-10T10:10:00.722275+0000","last_clean":"2024-09-10T10:10:00.722275+0000","last_became_active":"2024-09-10T10:08:32.892848+0000","last_became_peered":"2024-09-10T10:08:32.892848+0000","last_unstale":"2024-09-10T10:10:00.722275+0000","last_undegraded":"2024-09-10T10:10:00.722275+0000","last_fullsized":"2024-09-10T10:10:00.722275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:09.336253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040433+0000","last_change":"2024-09-10T10:08:44.407213+0000","last_active":"2024-09-10T10:10:01.040433+0000","last_peered":"2024-09-10T10:10:01.040433+0000","last_clean":"2024-09-10T10:10:01.040433+0000","last_became_active":"2024-09-10T10:08:44.405198+0000","last_became_peered":"2024-09-10T10:08:44.405198+0000","last_unstale":"2024-09-10T10:10:01.040433+0000","last_undegraded":"2024-09-10T10:10:01.040433+0000","last_fullsized":"2024-09-10T10:10:01.040433+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:15.921684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185154+0000","last_change":"2024-09-10T10:08:35.362683+0000","last_active":"2024-09-10T10:10:01.185154+0000","last_peered":"2024-09-10T10:10:01.185154+0000","last_clean":"2024-09-10T10:10:01.185154+0000","last_became_active":"2024-09-10T10:08:35.362353+0000","last_became_peered":"2024-09-10T10:08:35.362353+0000","last_unstale":"2024-09-10T10:10:01.185154+0000","last_undegraded":"2024-09-10T10:10:01.185154+0000","last_fullsized":"2024-09-10T10:10:01.185154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.489716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'4","reported_seq":106,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:23.626147+0000","last_change":"2024-09-10T10:08:32.881024+0000","last_active":"2024-09-10T10:10:23.626147+0000","last_peered":"2024-09-10T10:10:23.626147+0000","last_clean":"2024-09-10T10:10:23.626147+0000","last_became_active":"2024-09-10T10:08:32.880691+0000","last_became_peered":"2024-09-10T10:08:32.880691+0000","last_unstale":"2024-09-10T10:10:23.626147+0000","last_undegraded":"2024-09-10T10:10:23.626147+0000","last_fullsized":"2024-09-10T10:10:23.626147+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:15.988063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724379+0000","last_change":"2024-09-10T10:08:44.400509+0000","last_active":"2024-09-10T10:10:00.724379+0000","last_peered":"2024-09-10T10:10:00.724379+0000","last_clean":"2024-09-10T10:10:00.724379+0000","last_became_active":"2024-09-10T10:08:44.400152+0000","last_became_peered":"2024-09-10T10:08:44.400152+0000","last_unstale":"2024-09-10T10:10:00.724379+0000","last_undegraded":"2024-09-10T10:10:00.724379+0000","last_fullsized":"2024-09-10T10:10:00.724379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:43.550208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185438+0000","last_change":"2024-09-10T10:08:35.364208+0000","last_active":"2024-09-10T10:10:01.185438+0000","last_peered":"2024-09-10T10:10:01.185438+0000","last_clean":"2024-09-10T10:10:01.185438+0000","last_became_active":"2024-09-10T10:08:35.363751+0000","last_became_peered":"2024-09-10T10:08:35.363751+0000","last_unstale":"2024-09-10T10:10:01.185438+0000","last_undegraded":"2024-09-10T10:10:01.185438+0000","last_fullsized":"2024-09-10T10:10:01.185438+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:21.791512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840142+0000","last_change":"2024-09-10T10:08:32.890611+0000","last_active":"2024-09-10T10:10:00.840142+0000","last_peered":"2024-09-10T10:10:00.840142+0000","last_clean":"2024-09-10T10:10:00.840142+0000","last_became_active":"2024-09-10T10:08:32.890296+0000","last_became_peered":"2024-09-10T10:08:32.890296+0000","last_unstale":"2024-09-10T10:10:00.840142+0000","last_undegraded":"2024-09-10T10:10:00.840142+0000","last_fullsized":"2024-09-10T10:10:00.840142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.977575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185554+0000","last_change":"2024-09-10T10:08:44.402607+0000","last_active":"2024-09-10T10:10:01.185554+0000","last_peered":"2024-09-10T10:10:01.185554+0000","last_clean":"2024-09-10T10:10:01.185554+0000","last_became_active":"2024-09-10T10:08:44.401623+0000","last_became_peered":"2024-09-10T10:08:44.401623+0000","last_unstale":"2024-09-10T10:10:01.185554+0000","last_undegraded":"2024-09-10T10:10:01.185554+0000","last_fullsized":"2024-09-10T10:10:01.185554+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:21.105349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040010+0000","last_change":"2024-09-10T10:08:35.360642+0000","last_active":"2024-09-10T10:10:01.040010+0000","last_peered":"2024-09-10T10:10:01.040010+0000","last_clean":"2024-09-10T10:10:01.040010+0000","last_became_active":"2024-09-10T10:08:35.356667+0000","last_became_peered":"2024-09-10T10:08:35.356667+0000","last_unstale":"2024-09-10T10:10:01.040010+0000","last_undegraded":"2024-09-10T10:10:01.040010+0000","last_fullsized":"2024-09-10T10:10:01.040010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:08.404973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972303+0000","last_change":"2024-09-10T10:08:32.890418+0000","last_active":"2024-09-10T10:10:00.972303+0000","last_peered":"2024-09-10T10:10:00.972303+0000","last_clean":"2024-09-10T10:10:00.972303+0000","last_became_active":"2024-09-10T10:08:32.890081+0000","last_became_peered":"2024-09-10T10:08:32.890081+0000","last_unstale":"2024-09-10T10:10:00.972303+0000","last_undegraded":"2024-09-10T10:10:00.972303+0000","last_fullsized":"2024-09-10T10:10:00.972303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:52.839714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840304+0000","last_change":"2024-09-10T10:08:44.401322+0000","last_active":"2024-09-10T10:10:00.840304+0000","last_peered":"2024-09-10T10:10:00.840304+0000","last_clean":"2024-09-10T10:10:00.840304+0000","last_became_active":"2024-09-10T10:08:44.400906+0000","last_became_peered":"2024-09-10T10:08:44.400906+0000","last_unstale":"2024-09-10T10:10:00.840304+0000","last_undegraded":"2024-09-10T10:10:00.840304+0000","last_fullsized":"2024-09-10T10:10:00.840304+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:08.616288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722616+0000","last_change":"2024-09-10T10:08:35.366580+0000","last_active":"2024-09-10T10:10:00.722616+0000","last_peered":"2024-09-10T10:10:00.722616+0000","last_clean":"2024-09-10T10:10:00.722616+0000","last_became_active":"2024-09-10T10:08:35.365943+0000","last_became_peered":"2024-09-10T10:08:35.365943+0000","last_unstale":"2024-09-10T10:10:00.722616+0000","last_undegraded":"2024-09-10T10:10:00.722616+0000","last_fullsized":"2024-09-10T10:10:00.722616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:58.351517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'33","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:25.628332+0000","last_change":"2024-09-10T10:08:32.888411+0000","last_active":"2024-09-10T10:10:25.628332+0000","last_peered":"2024-09-10T10:10:25.628332+0000","last_clean":"2024-09-10T10:10:25.628332+0000","last_became_active":"2024-09-10T10:08:32.888093+0000","last_became_peered":"2024-09-10T10:08:32.888093+0000","last_unstale":"2024-09-10T10:10:25.628332+0000","last_undegraded":"2024-09-10T10:10:25.628332+0000","last_fullsized":"2024-09-10T10:10:25.628332+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.532868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62076,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":128,"num_read_kb":125,"num_write":34,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724398+0000","last_change":"2024-09-10T10:08:44.400432+0000","last_active":"2024-09-10T10:10:00.724398+0000","last_peered":"2024-09-10T10:10:00.724398+0000","last_clean":"2024-09-10T10:10:00.724398+0000","last_became_active":"2024-09-10T10:08:44.399981+0000","last_became_peered":"2024-09-10T10:08:44.399981+0000","last_unstale":"2024-09-10T10:10:00.724398+0000","last_undegraded":"2024-09-10T10:10:00.724398+0000","last_fullsized":"2024-09-10T10:10:00.724398+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:57.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862321+0000","last_change":"2024-09-10T10:09:00.460848+0000","last_active":"2024-09-10T10:10:00.862321+0000","last_peered":"2024-09-10T10:10:00.862321+0000","last_clean":"2024-09-10T10:10:00.862321+0000","last_became_active":"2024-09-10T10:09:00.460459+0000","last_became_peered":"2024-09-10T10:09:00.460459+0000","last_unstale":"2024-09-10T10:10:00.862321+0000","last_undegraded":"2024-09-10T10:10:00.862321+0000","last_fullsized":"2024-09-10T10:10:00.862321+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:06.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840490+0000","last_change":"2024-09-10T10:08:32.885909+0000","last_active":"2024-09-10T10:10:00.840490+0000","last_peered":"2024-09-10T10:10:00.840490+0000","last_clean":"2024-09-10T10:10:00.840490+0000","last_became_active":"2024-09-10T10:08:32.885512+0000","last_became_peered":"2024-09-10T10:08:32.885512+0000","last_unstale":"2024-09-10T10:10:00.840490+0000","last_undegraded":"2024-09-10T10:10:00.840490+0000","last_fullsized":"2024-09-10T10:10:00.840490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:44.850772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721837+0000","last_change":"2024-09-10T10:08:44.400323+0000","last_active":"2024-09-10T10:10:00.721837+0000","last_peered":"2024-09-10T10:10:00.721837+0000","last_clean":"2024-09-10T10:10:00.721837+0000","last_became_active":"2024-09-10T10:08:44.399923+0000","last_became_peered":"2024-09-10T10:08:44.399923+0000","last_unstale":"2024-09-10T10:10:00.721837+0000","last_undegraded":"2024-09-10T10:10:00.721837+0000","last_fullsized":"2024-09-10T10:10:00.721837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:45.496392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.939070+0000","last_change":"2024-09-10T10:08:35.375543+0000","last_active":"2024-09-10T10:10:00.939070+0000","last_peered":"2024-09-10T10:10:00.939070+0000","last_clean":"2024-09-10T10:10:00.939070+0000","last_became_active":"2024-09-10T10:08:35.374312+0000","last_became_peered":"2024-09-10T10:08:35.374312+0000","last_unstale":"2024-09-10T10:10:00.939070+0000","last_undegraded":"2024-09-10T10:10:00.939070+0000","last_fullsized":"2024-09-10T10:10:00.939070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:34.208716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184817+0000","last_change":"2024-09-10T10:08:32.888540+0000","last_active":"2024-09-10T10:10:01.184817+0000","last_peered":"2024-09-10T10:10:01.184817+0000","last_clean":"2024-09-10T10:10:01.184817+0000","last_became_active":"2024-09-10T10:08:32.888187+0000","last_became_peered":"2024-09-10T10:08:32.888187+0000","last_unstale":"2024-09-10T10:10:01.184817+0000","last_undegraded":"2024-09-10T10:10:01.184817+0000","last_fullsized":"2024-09-10T10:10:01.184817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:06.694533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.723660+0000","last_change":"2024-09-10T10:08:44.397995+0000","last_active":"2024-09-10T10:10:00.723660+0000","last_peered":"2024-09-10T10:10:00.723660+0000","last_clean":"2024-09-10T10:10:00.723660+0000","last_became_active":"2024-09-10T10:08:44.397583+0000","last_became_peered":"2024-09-10T10:08:44.397583+0000","last_unstale":"2024-09-10T10:10:00.723660+0000","last_undegraded":"2024-09-10T10:10:00.723660+0000","last_fullsized":"2024-09-10T10:10:00.723660+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:03.908014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862695+0000","last_change":"2024-09-10T10:08:35.361053+0000","last_active":"2024-09-10T10:10:00.862695+0000","last_peered":"2024-09-10T10:10:00.862695+0000","last_clean":"2024-09-10T10:10:00.862695+0000","last_became_active":"2024-09-10T10:08:35.360736+0000","last_became_peered":"2024-09-10T10:08:35.360736+0000","last_unstale":"2024-09-10T10:10:00.862695+0000","last_undegraded":"2024-09-10T10:10:00.862695+0000","last_fullsized":"2024-09-10T10:10:00.862695+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:45.435384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'3","reported_seq":103,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:24.626719+0000","last_change":"2024-09-10T10:08:32.885067+0000","last_active":"2024-09-10T10:10:24.626719+0000","last_peered":"2024-09-10T10:10:24.626719+0000","last_clean":"2024-09-10T10:10:24.626719+0000","last_became_active":"2024-09-10T10:08:32.884676+0000","last_became_peered":"2024-09-10T10:08:32.884676+0000","last_unstale":"2024-09-10T10:10:24.626719+0000","last_undegraded":"2024-09-10T10:10:24.626719+0000","last_fullsized":"2024-09-10T10:10:24.626719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.667680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721159+0000","last_change":"2024-09-10T10:08:44.395892+0000","last_active":"2024-09-10T10:10:00.721159+0000","last_peered":"2024-09-10T10:10:00.721159+0000","last_clean":"2024-09-10T10:10:00.721159+0000","last_became_active":"2024-09-10T10:08:44.395188+0000","last_became_peered":"2024-09-10T10:08:44.395188+0000","last_unstale":"2024-09-10T10:10:00.721159+0000","last_undegraded":"2024-09-10T10:10:00.721159+0000","last_fullsized":"2024-09-10T10:10:00.721159+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:27.562053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.939159+0000","last_change":"2024-09-10T10:08:44.403185+0000","last_active":"2024-09-10T10:10:00.939159+0000","last_peered":"2024-09-10T10:10:00.939159+0000","last_clean":"2024-09-10T10:10:00.939159+0000","last_became_active":"2024-09-10T10:08:44.399943+0000","last_became_peered":"2024-09-10T10:08:44.399943+0000","last_unstale":"2024-09-10T10:10:00.939159+0000","last_undegraded":"2024-09-10T10:10:00.939159+0000","last_fullsized":"2024-09-10T10:10:00.939159+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:07.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.723795+0000","last_change":"2024-09-10T10:08:35.367552+0000","last_active":"2024-09-10T10:10:00.723795+0000","last_peered":"2024-09-10T10:10:00.723795+0000","last_clean":"2024-09-10T10:10:00.723795+0000","last_became_active":"2024-09-10T10:08:35.367215+0000","last_became_peered":"2024-09-10T10:08:35.367215+0000","last_unstale":"2024-09-10T10:10:00.723795+0000","last_undegraded":"2024-09-10T10:10:00.723795+0000","last_fullsized":"2024-09-10T10:10:00.723795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:28.756769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839931+0000","last_change":"2024-09-10T10:08:32.885830+0000","last_active":"2024-09-10T10:10:00.839931+0000","last_peered":"2024-09-10T10:10:00.839931+0000","last_clean":"2024-09-10T10:10:00.839931+0000","last_became_active":"2024-09-10T10:08:32.885465+0000","last_became_peered":"2024-09-10T10:08:32.885465+0000","last_unstale":"2024-09-10T10:10:00.839931+0000","last_undegraded":"2024-09-10T10:10:00.839931+0000","last_fullsized":"2024-09-10T10:10:00.839931+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:55.101364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185725+0000","last_change":"2024-09-10T10:09:00.487666+0000","last_active":"2024-09-10T10:10:01.185725+0000","last_peered":"2024-09-10T10:10:01.185725+0000","last_clean":"2024-09-10T10:10:01.185725+0000","last_became_active":"2024-09-10T10:09:00.487110+0000","last_became_peered":"2024-09-10T10:09:00.487110+0000","last_unstale":"2024-09-10T10:10:01.185725+0000","last_undegraded":"2024-09-10T10:10:01.185725+0000","last_fullsized":"2024-09-10T10:10:01.185725+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:28.817826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721165+0000","last_change":"2024-09-10T10:08:35.356247+0000","last_active":"2024-09-10T10:10:00.721165+0000","last_peered":"2024-09-10T10:10:00.721165+0000","last_clean":"2024-09-10T10:10:00.721165+0000","last_became_active":"2024-09-10T10:08:35.355953+0000","last_became_peered":"2024-09-10T10:08:35.355953+0000","last_unstale":"2024-09-10T10:10:00.721165+0000","last_undegraded":"2024-09-10T10:10:00.721165+0000","last_fullsized":"2024-09-10T10:10:00.721165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:24.625382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039720+0000","last_change":"2024-09-10T10:08:32.882151+0000","last_active":"2024-09-10T10:10:01.039720+0000","last_peered":"2024-09-10T10:10:01.039720+0000","last_clean":"2024-09-10T10:10:01.039720+0000","last_became_active":"2024-09-10T10:08:32.881688+0000","last_became_peered":"2024-09-10T10:08:32.881688+0000","last_unstale":"2024-09-10T10:10:01.039720+0000","last_undegraded":"2024-09-10T10:10:01.039720+0000","last_fullsized":"2024-09-10T10:10:01.039720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:49.186299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.109606+0000","last_change":"2024-09-10T10:08:32.887018+0000","last_active":"2024-09-10T10:10:01.109606+0000","last_peered":"2024-09-10T10:10:01.109606+0000","last_clean":"2024-09-10T10:10:01.109606+0000","last_became_active":"2024-09-10T10:08:32.886636+0000","last_became_peered":"2024-09-10T10:08:32.886636+0000","last_unstale":"2024-09-10T10:10:01.109606+0000","last_undegraded":"2024-09-10T10:10:01.109606+0000","last_fullsized":"2024-09-10T10:10:01.109606+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:24.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839937+0000","last_change":"2024-09-10T10:08:35.363803+0000","last_active":"2024-09-10T10:10:00.839937+0000","last_peered":"2024-09-10T10:10:00.839937+0000","last_clean":"2024-09-10T10:10:00.839937+0000","last_became_active":"2024-09-10T10:08:35.363442+0000","last_became_peered":"2024-09-10T10:08:35.363442+0000","last_unstale":"2024-09-10T10:10:00.839937+0000","last_undegraded":"2024-09-10T10:10:00.839937+0000","last_fullsized":"2024-09-10T10:10:00.839937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:59.045347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972887+0000","last_change":"2024-09-10T10:08:44.403970+0000","last_active":"2024-09-10T10:10:00.972887+0000","last_peered":"2024-09-10T10:10:00.972887+0000","last_clean":"2024-09-10T10:10:00.972887+0000","last_became_active":"2024-09-10T10:08:44.403462+0000","last_became_peered":"2024-09-10T10:08:44.403462+0000","last_unstale":"2024-09-10T10:10:00.972887+0000","last_undegraded":"2024-09-10T10:10:00.972887+0000","last_fullsized":"2024-09-10T10:10:00.972887+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:09.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":105,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:20.621696+0000","last_change":"2024-09-10T10:08:32.893227+0000","last_active":"2024-09-10T10:10:20.621696+0000","last_peered":"2024-09-10T10:10:20.621696+0000","last_clean":"2024-09-10T10:10:20.621696+0000","last_became_active":"2024-09-10T10:08:32.892732+0000","last_became_peered":"2024-09-10T10:08:32.892732+0000","last_unstale":"2024-09-10T10:10:20.621696+0000","last_undegraded":"2024-09-10T10:10:20.621696+0000","last_fullsized":"2024-09-10T10:10:20.621696+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:16.933955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722295+0000","last_change":"2024-09-10T10:08:35.368806+0000","last_active":"2024-09-10T10:10:00.722295+0000","last_peered":"2024-09-10T10:10:00.722295+0000","last_clean":"2024-09-10T10:10:00.722295+0000","last_became_active":"2024-09-10T10:08:35.368397+0000","last_became_peered":"2024-09-10T10:08:35.368397+0000","last_unstale":"2024-09-10T10:10:00.722295+0000","last_undegraded":"2024-09-10T10:10:00.722295+0000","last_fullsized":"2024-09-10T10:10:00.722295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:39.656295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973037+0000","last_change":"2024-09-10T10:08:44.391941+0000","last_active":"2024-09-10T10:10:00.973037+0000","last_peered":"2024-09-10T10:10:00.973037+0000","last_clean":"2024-09-10T10:10:00.973037+0000","last_became_active":"2024-09-10T10:08:44.391553+0000","last_became_peered":"2024-09-10T10:08:44.391553+0000","last_unstale":"2024-09-10T10:10:00.973037+0000","last_undegraded":"2024-09-10T10:10:00.973037+0000","last_fullsized":"2024-09-10T10:10:00.973037+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:34.279772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185333+0000","last_change":"2024-09-10T10:08:35.363192+0000","last_active":"2024-09-10T10:10:01.185333+0000","last_peered":"2024-09-10T10:10:01.185333+0000","last_clean":"2024-09-10T10:10:01.185333+0000","last_became_active":"2024-09-10T10:08:35.362890+0000","last_became_peered":"2024-09-10T10:08:35.362890+0000","last_unstale":"2024-09-10T10:10:01.185333+0000","last_undegraded":"2024-09-10T10:10:01.185333+0000","last_fullsized":"2024-09-10T10:10:01.185333+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:07.493539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972754+0000","last_change":"2024-09-10T10:08:35.362471+0000","last_active":"2024-09-10T10:10:00.972754+0000","last_peered":"2024-09-10T10:10:00.972754+0000","last_clean":"2024-09-10T10:10:00.972754+0000","last_became_active":"2024-09-10T10:08:35.361553+0000","last_became_peered":"2024-09-10T10:08:35.361553+0000","last_unstale":"2024-09-10T10:10:00.972754+0000","last_undegraded":"2024-09-10T10:10:00.972754+0000","last_fullsized":"2024-09-10T10:10:00.972754+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:24.511901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972544+0000","last_change":"2024-09-10T10:08:35.371025+0000","last_active":"2024-09-10T10:10:00.972544+0000","last_peered":"2024-09-10T10:10:00.972544+0000","last_clean":"2024-09-10T10:10:00.972544+0000","last_became_active":"2024-09-10T10:08:35.370692+0000","last_became_peered":"2024-09-10T10:08:35.370692+0000","last_unstale":"2024-09-10T10:10:00.972544+0000","last_undegraded":"2024-09-10T10:10:00.972544+0000","last_fullsized":"2024-09-10T10:10:00.972544+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:22.289843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938270+0000","last_change":"2024-09-10T10:08:35.373519+0000","last_active":"2024-09-10T10:10:00.938270+0000","last_peered":"2024-09-10T10:10:00.938270+0000","last_clean":"2024-09-10T10:10:00.938270+0000","last_became_active":"2024-09-10T10:08:35.372719+0000","last_became_peered":"2024-09-10T10:08:35.372719+0000","last_unstale":"2024-09-10T10:10:00.938270+0000","last_undegraded":"2024-09-10T10:10:00.938270+0000","last_fullsized":"2024-09-10T10:10:00.938270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:24.530809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040368+0000","last_change":"2024-09-10T10:09:00.489944+0000","last_active":"2024-09-10T10:10:01.040368+0000","last_peered":"2024-09-10T10:10:01.040368+0000","last_clean":"2024-09-10T10:10:01.040368+0000","last_became_active":"2024-09-10T10:09:00.489269+0000","last_became_peered":"2024-09-10T10:09:00.489269+0000","last_unstale":"2024-09-10T10:10:01.040368+0000","last_undegraded":"2024-09-10T10:10:01.040368+0000","last_fullsized":"2024-09-10T10:10:01.040368+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:46.561078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185737+0000","last_change":"2024-09-10T10:08:35.364779+0000","last_active":"2024-09-10T10:10:01.185737+0000","last_peered":"2024-09-10T10:10:01.185737+0000","last_clean":"2024-09-10T10:10:01.185737+0000","last_became_active":"2024-09-10T10:08:35.364455+0000","last_became_peered":"2024-09-10T10:08:35.364455+0000","last_unstale":"2024-09-10T10:10:01.185737+0000","last_undegraded":"2024-09-10T10:10:01.185737+0000","last_fullsized":"2024-09-10T10:10:01.185737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:08.552218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973001+0000","last_change":"2024-09-10T10:08:35.357147+0000","last_active":"2024-09-10T10:10:00.973001+0000","last_peered":"2024-09-10T10:10:00.973001+0000","last_clean":"2024-09-10T10:10:00.973001+0000","last_became_active":"2024-09-10T10:08:35.356808+0000","last_became_peered":"2024-09-10T10:08:35.356808+0000","last_unstale":"2024-09-10T10:10:00.973001+0000","last_undegraded":"2024-09-10T10:10:00.973001+0000","last_fullsized":"2024-09-10T10:10:00.973001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:35.731496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721990+0000","last_change":"2024-09-10T10:08:35.365795+0000","last_active":"2024-09-10T10:10:00.721990+0000","last_peered":"2024-09-10T10:10:00.721990+0000","last_clean":"2024-09-10T10:10:00.721990+0000","last_became_active":"2024-09-10T10:08:35.365342+0000","last_became_peered":"2024-09-10T10:08:35.365342+0000","last_unstale":"2024-09-10T10:10:00.721990+0000","last_undegraded":"2024-09-10T10:10:00.721990+0000","last_fullsized":"2024-09-10T10:10:00.721990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:20.012890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722126+0000","last_change":"2024-09-10T10:09:00.486664+0000","last_active":"2024-09-10T10:10:00.722126+0000","last_peered":"2024-09-10T10:10:00.722126+0000","last_clean":"2024-09-10T10:10:00.722126+0000","last_became_active":"2024-09-10T10:09:00.486239+0000","last_became_peered":"2024-09-10T10:09:00.486239+0000","last_unstale":"2024-09-10T10:10:00.722126+0000","last_undegraded":"2024-09-10T10:10:00.722126+0000","last_fullsized":"2024-09-10T10:10:00.722126+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:47.472245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721352+0000","last_change":"2024-09-10T10:08:35.367403+0000","last_active":"2024-09-10T10:10:00.721352+0000","last_peered":"2024-09-10T10:10:00.721352+0000","last_clean":"2024-09-10T10:10:00.721352+0000","last_became_active":"2024-09-10T10:08:35.365969+0000","last_became_peered":"2024-09-10T10:08:35.365969+0000","last_unstale":"2024-09-10T10:10:00.721352+0000","last_undegraded":"2024-09-10T10:10:00.721352+0000","last_fullsized":"2024-09-10T10:10:00.721352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:27.657226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862371+0000","last_change":"2024-09-10T10:08:35.359185+0000","last_active":"2024-09-10T10:10:00.862371+0000","last_peered":"2024-09-10T10:10:00.862371+0000","last_clean":"2024-09-10T10:10:00.862371+0000","last_became_active":"2024-09-10T10:08:35.358825+0000","last_became_peered":"2024-09-10T10:08:35.358825+0000","last_unstale":"2024-09-10T10:10:00.862371+0000","last_undegraded":"2024-09-10T10:10:00.862371+0000","last_fullsized":"2024-09-10T10:10:00.862371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:31.884533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040223+0000","last_change":"2024-09-10T10:08:35.378151+0000","last_active":"2024-09-10T10:10:01.040223+0000","last_peered":"2024-09-10T10:10:01.040223+0000","last_clean":"2024-09-10T10:10:01.040223+0000","last_became_active":"2024-09-10T10:08:35.377784+0000","last_became_peered":"2024-09-10T10:08:35.377784+0000","last_unstale":"2024-09-10T10:10:01.040223+0000","last_undegraded":"2024-09-10T10:10:01.040223+0000","last_fullsized":"2024-09-10T10:10:01.040223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.027310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185581+0000","last_change":"2024-09-10T10:08:35.364550+0000","last_active":"2024-09-10T10:10:01.185581+0000","last_peered":"2024-09-10T10:10:01.185581+0000","last_clean":"2024-09-10T10:10:01.185581+0000","last_became_active":"2024-09-10T10:08:35.364224+0000","last_became_peered":"2024-09-10T10:08:35.364224+0000","last_unstale":"2024-09-10T10:10:01.185581+0000","last_undegraded":"2024-09-10T10:10:01.185581+0000","last_fullsized":"2024-09-10T10:10:01.185581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:38.584494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973205+0000","last_change":"2024-09-10T10:08:35.357333+0000","last_active":"2024-09-10T10:10:00.973205+0000","last_peered":"2024-09-10T10:10:00.973205+0000","last_clean":"2024-09-10T10:10:00.973205+0000","last_became_active":"2024-09-10T10:08:35.356940+0000","last_became_peered":"2024-09-10T10:08:35.356940+0000","last_unstale":"2024-09-10T10:10:00.973205+0000","last_undegraded":"2024-09-10T10:10:00.973205+0000","last_fullsized":"2024-09-10T10:10:00.973205+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:40.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724816+0000","last_change":"2024-09-10T10:08:35.367208+0000","last_active":"2024-09-10T10:10:00.724816+0000","last_peered":"2024-09-10T10:10:00.724816+0000","last_clean":"2024-09-10T10:10:00.724816+0000","last_became_active":"2024-09-10T10:08:35.361942+0000","last_became_peered":"2024-09-10T10:08:35.361942+0000","last_unstale":"2024-09-10T10:10:00.724816+0000","last_undegraded":"2024-09-10T10:10:00.724816+0000","last_fullsized":"2024-09-10T10:10:00.724816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:19.030623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185952+0000","last_change":"2024-09-10T10:08:35.377164+0000","last_active":"2024-09-10T10:10:01.185952+0000","last_peered":"2024-09-10T10:10:01.185952+0000","last_clean":"2024-09-10T10:10:01.185952+0000","last_became_active":"2024-09-10T10:08:35.376457+0000","last_became_peered":"2024-09-10T10:08:35.376457+0000","last_unstale":"2024-09-10T10:10:01.185952+0000","last_undegraded":"2024-09-10T10:10:01.185952+0000","last_fullsized":"2024-09-10T10:10:01.185952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.291635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.861984+0000","last_change":"2024-09-10T10:08:35.365096+0000","last_active":"2024-09-10T10:10:00.861984+0000","last_peered":"2024-09-10T10:10:00.861984+0000","last_clean":"2024-09-10T10:10:00.861984+0000","last_became_active":"2024-09-10T10:08:35.364780+0000","last_became_peered":"2024-09-10T10:08:35.364780+0000","last_unstale":"2024-09-10T10:10:00.861984+0000","last_undegraded":"2024-09-10T10:10:00.861984+0000","last_fullsized":"2024-09-10T10:10:00.861984+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:30.177904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938000+0000","last_change":"2024-09-10T10:08:35.377017+0000","last_active":"2024-09-10T10:10:00.938000+0000","last_peered":"2024-09-10T10:10:00.938000+0000","last_clean":"2024-09-10T10:10:00.938000+0000","last_became_active":"2024-09-10T10:08:35.372243+0000","last_became_peered":"2024-09-10T10:08:35.372243+0000","last_unstale":"2024-09-10T10:10:00.938000+0000","last_undegraded":"2024-09-10T10:10:00.938000+0000","last_fullsized":"2024-09-10T10:10:00.938000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:26.105505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938292+0000","last_change":"2024-09-10T10:08:35.379782+0000","last_active":"2024-09-10T10:10:00.938292+0000","last_peered":"2024-09-10T10:10:00.938292+0000","last_clean":"2024-09-10T10:10:00.938292+0000","last_became_active":"2024-09-10T10:08:35.377109+0000","last_became_peered":"2024-09-10T10:08:35.377109+0000","last_unstale":"2024-09-10T10:10:00.938292+0000","last_undegraded":"2024-09-10T10:10:00.938292+0000","last_fullsized":"2024-09-10T10:10:00.938292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:10.761016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040219+0000","last_change":"2024-09-10T10:08:35.364891+0000","last_active":"2024-09-10T10:10:01.040219+0000","last_peered":"2024-09-10T10:10:01.040219+0000","last_clean":"2024-09-10T10:10:01.040219+0000","last_became_active":"2024-09-10T10:08:35.363845+0000","last_became_peered":"2024-09-10T10:08:35.363845+0000","last_unstale":"2024-09-10T10:10:01.040219+0000","last_undegraded":"2024-09-10T10:10:01.040219+0000","last_fullsized":"2024-09-10T10:10:01.040219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:03.346994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722141+0000","last_change":"2024-09-10T10:08:35.363548+0000","last_active":"2024-09-10T10:10:00.722141+0000","last_peered":"2024-09-10T10:10:00.722141+0000","last_clean":"2024-09-10T10:10:00.722141+0000","last_became_active":"2024-09-10T10:08:35.363229+0000","last_became_peered":"2024-09-10T10:08:35.363229+0000","last_unstale":"2024-09-10T10:10:00.722141+0000","last_undegraded":"2024-09-10T10:10:00.722141+0000","last_fullsized":"2024-09-10T10:10:00.722141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:38.773445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185717+0000","last_change":"2024-09-10T10:08:35.360717+0000","last_active":"2024-09-10T10:10:01.185717+0000","last_peered":"2024-09-10T10:10:01.185717+0000","last_clean":"2024-09-10T10:10:01.185717+0000","last_became_active":"2024-09-10T10:08:35.360410+0000","last_became_peered":"2024-09-10T10:08:35.360410+0000","last_unstale":"2024-09-10T10:10:01.185717+0000","last_undegraded":"2024-09-10T10:10:01.185717+0000","last_fullsized":"2024-09-10T10:10:01.185717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:59.322524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.110560+0000","last_change":"2024-09-10T10:08:35.362359+0000","last_active":"2024-09-10T10:10:01.110560+0000","last_peered":"2024-09-10T10:10:01.110560+0000","last_clean":"2024-09-10T10:10:01.110560+0000","last_became_active":"2024-09-10T10:08:35.361580+0000","last_became_peered":"2024-09-10T10:08:35.361580+0000","last_unstale":"2024-09-10T10:10:01.110560+0000","last_undegraded":"2024-09-10T10:10:01.110560+0000","last_fullsized":"2024-09-10T10:10:01.110560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:23.265237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862689+0000","last_change":"2024-09-10T10:08:35.367305+0000","last_active":"2024-09-10T10:10:00.862689+0000","last_peered":"2024-09-10T10:10:00.862689+0000","last_clean":"2024-09-10T10:10:00.862689+0000","last_became_active":"2024-09-10T10:08:35.366936+0000","last_became_peered":"2024-09-10T10:08:35.366936+0000","last_unstale":"2024-09-10T10:10:00.862689+0000","last_undegraded":"2024-09-10T10:10:00.862689+0000","last_fullsized":"2024-09-10T10:10:00.862689+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:28.158474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721162+0000","last_change":"2024-09-10T10:08:35.369983+0000","last_active":"2024-09-10T10:10:00.721162+0000","last_peered":"2024-09-10T10:10:00.721162+0000","last_clean":"2024-09-10T10:10:00.721162+0000","last_became_active":"2024-09-10T10:08:35.367662+0000","last_became_peered":"2024-09-10T10:08:35.367662+0000","last_unstale":"2024-09-10T10:10:00.721162+0000","last_undegraded":"2024-09-10T10:10:00.721162+0000","last_fullsized":"2024-09-10T10:10:00.721162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185200+0000","last_change":"2024-09-10T10:08:35.369237+0000","last_active":"2024-09-10T10:10:01.185200+0000","last_peered":"2024-09-10T10:10:01.185200+0000","last_clean":"2024-09-10T10:10:01.185200+0000","last_became_active":"2024-09-10T10:08:35.368903+0000","last_became_peered":"2024-09-10T10:08:35.368903+0000","last_unstale":"2024-09-10T10:10:01.185200+0000","last_undegraded":"2024-09-10T10:10:01.185200+0000","last_fullsized":"2024-09-10T10:10:01.185200+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:05.150549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.110084+0000","last_change":"2024-09-10T10:08:35.367284+0000","last_active":"2024-09-10T10:10:01.110084+0000","last_peered":"2024-09-10T10:10:01.110084+0000","last_clean":"2024-09-10T10:10:01.110084+0000","last_became_active":"2024-09-10T10:08:35.366969+0000","last_became_peered":"2024-09-10T10:08:35.366969+0000","last_unstale":"2024-09-10T10:10:01.110084+0000","last_undegraded":"2024-09-10T10:10:01.110084+0000","last_fullsized":"2024-09-10T10:10:01.110084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:16.949804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722356+0000","last_change":"2024-09-10T10:08:35.374559+0000","last_active":"2024-09-10T10:10:00.722356+0000","last_peered":"2024-09-10T10:10:00.722356+0000","last_clean":"2024-09-10T10:10:00.722356+0000","last_became_active":"2024-09-10T10:08:35.374191+0000","last_became_peered":"2024-09-10T10:08:35.374191+0000","last_unstale":"2024-09-10T10:10:00.722356+0000","last_undegraded":"2024-09-10T10:10:00.722356+0000","last_fullsized":"2024-09-10T10:10:00.722356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:48.292249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721995+0000","last_change":"2024-09-10T10:08:35.368042+0000","last_active":"2024-09-10T10:10:00.721995+0000","last_peered":"2024-09-10T10:10:00.721995+0000","last_clean":"2024-09-10T10:10:00.721995+0000","last_became_active":"2024-09-10T10:08:35.365985+0000","last_became_peered":"2024-09-10T10:08:35.365985+0000","last_unstale":"2024-09-10T10:10:00.721995+0000","last_undegraded":"2024-09-10T10:10:00.721995+0000","last_fullsized":"2024-09-10T10:10:00.721995+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:04.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938540+0000","last_change":"2024-09-10T10:08:35.375826+0000","last_active":"2024-09-10T10:10:00.938540+0000","last_peered":"2024-09-10T10:10:00.938540+0000","last_clean":"2024-09-10T10:10:00.938540+0000","last_became_active":"2024-09-10T10:08:35.375485+0000","last_became_peered":"2024-09-10T10:08:35.375485+0000","last_unstale":"2024-09-10T10:10:00.938540+0000","last_undegraded":"2024-09-10T10:10:00.938540+0000","last_fullsized":"2024-09-10T10:10:00.938540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:49.146648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938670+0000","last_change":"2024-09-10T10:08:35.375745+0000","last_active":"2024-09-10T10:10:00.938670+0000","last_peered":"2024-09-10T10:10:00.938670+0000","last_clean":"2024-09-10T10:10:00.938670+0000","last_became_active":"2024-09-10T10:08:35.375427+0000","last_became_peered":"2024-09-10T10:08:35.375427+0000","last_unstale":"2024-09-10T10:10:00.938670+0000","last_undegraded":"2024-09-10T10:10:00.938670+0000","last_fullsized":"2024-09-10T10:10:00.938670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:48.743434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185877+0000","last_change":"2024-09-10T10:08:35.377092+0000","last_active":"2024-09-10T10:10:01.185877+0000","last_peered":"2024-09-10T10:10:01.185877+0000","last_clean":"2024-09-10T10:10:01.185877+0000","last_became_active":"2024-09-10T10:08:35.376761+0000","last_became_peered":"2024-09-10T10:08:35.376761+0000","last_unstale":"2024-09-10T10:10:01.185877+0000","last_undegraded":"2024-09-10T10:10:01.185877+0000","last_fullsized":"2024-09-10T10:10:01.185877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:58.631742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66472,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":379,"num_read_kb":261,"num_write":169,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":199416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286200,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449124,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1044480,"data_stored":538290,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678059,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32348,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712804,"statfs":{"total":95995035648,"available":95961911296,"internally_reserved":0,"allocated":1183744,"data_stored":1188005,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841583,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1060864,"data_stored":542600,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070517,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1052672,"data_stored":538402,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1105920,"data_stored":1134728,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462976,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1036288,"data_stored":533680,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724614,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32276,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712876,"statfs":{"total":95995035648,"available":95961985024,"internally_reserved":0,"allocated":1114112,"data_stored":1129923,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888138,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1048576,"data_stored":538723,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149775,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1048576,"data_stored":533874,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1126400,"data_stored":597409,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712888,"statfs":{"total":95995035648,"available":95961997312,"internally_reserved":0,"allocated":1101824,"data_stored":595666,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1060864,"data_stored":535068,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":62076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:10:29.495 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T10:10:29.495 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T10:10:29.495 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T10:10:29.495 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T10:10:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:30.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:29 smithi050 ceph-mon[30354]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:10:30.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:29 smithi189 ceph-mon[34999]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:10:30.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:29 smithi084 ceph-mon[34812]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:10:30.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.458+0000 7f546ec00640 1 -- 172.21.15.50:0/135206432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54681049c0 msgr2=0x7f5468108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:30.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.458+0000 7f546ec00640 1 --2- 172.21.15.50:0/135206432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54681049c0 0x7f5468108a10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5450009900 tx=0x7f545002a410 comp rx=0 tx=0).stop 2024-09-10T10:10:30.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.458+0000 7f546ec00640 1 -- 172.21.15.50:0/135206432 shutdown_connections 2024-09-10T10:10:30.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.458+0000 7f546ec00640 1 --2- 172.21.15.50:0/135206432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5468109140 0x7f5468110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.458+0000 7f546ec00640 1 --2- 172.21.15.50:0/135206432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54681049c0 0x7f5468108a10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.458+0000 7f546ec00640 1 --2- 172.21.15.50:0/135206432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5468104010 0x7f54681043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.458+0000 7f546ec00640 1 -- 172.21.15.50:0/135206432 >> 172.21.15.50:0/135206432 conn(0x7f54680ffa50 msgr2=0x7f5468101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:30.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.458+0000 7f546ec00640 1 -- 172.21.15.50:0/135206432 shutdown_connections 2024-09-10T10:10:30.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.458+0000 7f546ec00640 1 -- 172.21.15.50:0/135206432 wait complete. 2024-09-10T10:10:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.459+0000 7f546ec00640 1 Processor -- start 2024-09-10T10:10:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.459+0000 7f546ec00640 1 -- start start 2024-09-10T10:10:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.460+0000 7f546ec00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5468104010 0x7f54681a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.460+0000 7f546ec00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54681049c0 0x7f54681a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.460+0000 7f546ec00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5468109140 0x7f546819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.460+0000 7f546ec00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f54681141b0 con 0x7f5468104010 2024-09-10T10:10:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.460+0000 7f546ec00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5468114030 con 0x7f54681049c0 2024-09-10T10:10:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.460+0000 7f546ec00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5468114330 con 0x7f5468109140 2024-09-10T10:10:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.460+0000 7f5467e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5468104010 0x7f54681a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:30.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.460+0000 7f5467e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5468104010 0x7f54681a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57828/0 (socket says 172.21.15.50:57828) 2024-09-10T10:10:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.460+0000 7f5467e00640 1 -- 172.21.15.50:0/3861723187 learned_addr learned my addr 172.21.15.50:0/3861723187 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.460+0000 7f545fe00640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54681049c0 0x7f54681a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.460+0000 7f546cc00640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5468109140 0x7f546819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.461+0000 7f5467e00640 1 -- 172.21.15.50:0/3861723187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5468109140 msgr2=0x7f546819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.461+0000 7f5467e00640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5468109140 0x7f546819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.461+0000 7f5467e00640 1 -- 172.21.15.50:0/3861723187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54681049c0 msgr2=0x7f54681a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.461+0000 7f5467e00640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54681049c0 0x7f54681a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.461+0000 7f5467e00640 1 -- 172.21.15.50:0/3861723187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546819acf0 con 0x7f5468104010 2024-09-10T10:10:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.461+0000 7f5467e00640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5468104010 0x7f54681a0400 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f545800e9f0 tx=0x7f545800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.461+0000 7f5465600640 1 -- 172.21.15.50:0/3861723187 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545800cd80 con 0x7f5468104010 2024-09-10T10:10:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.461+0000 7f5465600640 1 -- 172.21.15.50:0/3861723187 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5458010910 con 0x7f5468104010 2024-09-10T10:10:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.461+0000 7f546ec00640 1 -- 172.21.15.50:0/3861723187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f546819afe0 con 0x7f5468104010 2024-09-10T10:10:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.462+0000 7f5465600640 1 -- 172.21.15.50:0/3861723187 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54580188f0 con 0x7f5468104010 2024-09-10T10:10:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.462+0000 7f546ec00640 1 -- 172.21.15.50:0/3861723187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54681a72d0 con 0x7f5468104010 2024-09-10T10:10:30.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.463+0000 7f546ec00640 1 -- 172.21.15.50:0/3861723187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54681043f0 con 0x7f5468104010 2024-09-10T10:10:30.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.465+0000 7f5465600640 1 -- 172.21.15.50:0/3861723187 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5458010ac0 con 0x7f5468104010 2024-09-10T10:10:30.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.466+0000 7f5465600640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f544c0a2c10 0x7f544c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:30.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.466+0000 7f5465600640 1 -- 172.21.15.50:0/3861723187 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f54580cf980 con 0x7f5468104010 2024-09-10T10:10:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.466+0000 7f545fe00640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f544c0a2c10 0x7f544c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:30.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.467+0000 7f545fe00640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f544c0a2c10 0x7f544c0a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5450000c00 tx=0x7f5450005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:30.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.470+0000 7f5465600640 1 -- 172.21.15.50:0/3861723187 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f545809bd40 con 0x7f5468104010 2024-09-10T10:10:30.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.694+0000 7f546ec00640 1 -- 172.21.15.50:0/3861723187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f546810c380 con 0x7f5468104010 2024-09-10T10:10:30.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.694+0000 7f5465600640 1 -- 172.21.15.50:0/3861723187 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f54580a0040 con 0x7f5468104010 2024-09-10T10:10:30.695 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:10:30.696 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T10:10:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.697+0000 7f546ec00640 1 -- 172.21.15.50:0/3861723187 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f544c0a2c10 msgr2=0x7f544c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.697+0000 7f546ec00640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f544c0a2c10 0x7f544c0a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5450000c00 tx=0x7f5450005b50 comp rx=0 tx=0).stop 2024-09-10T10:10:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.697+0000 7f546ec00640 1 -- 172.21.15.50:0/3861723187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5468104010 msgr2=0x7f54681a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.697+0000 7f546ec00640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5468104010 0x7f54681a0400 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f545800e9f0 tx=0x7f545800eeb0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.697+0000 7f546ec00640 1 -- 172.21.15.50:0/3861723187 shutdown_connections 2024-09-10T10:10:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.697+0000 7f546ec00640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f544c0a2c10 0x7f544c0a50d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.697+0000 7f546ec00640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5468109140 0x7f546819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.697+0000 7f546ec00640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54681049c0 0x7f54681a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.697+0000 7f546ec00640 1 --2- 172.21.15.50:0/3861723187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5468104010 0x7f54681a0400 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:30.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.697+0000 7f546ec00640 1 -- 172.21.15.50:0/3861723187 >> 172.21.15.50:0/3861723187 conn(0x7f54680ffa50 msgr2=0x7f5468100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:30.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.697+0000 7f546ec00640 1 -- 172.21.15.50:0/3861723187 shutdown_connections 2024-09-10T10:10:30.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:30.697+0000 7f546ec00640 1 -- 172.21.15.50:0/3861723187 wait complete. 2024-09-10T10:10:30.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:30 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3861723187' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T10:10:31.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:30 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3861723187' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T10:10:31.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:30 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3861723187' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T10:10:31.463 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T10:10:31.464 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:10:31.839 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:32.157 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:31 smithi050 ceph-mon[30354]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:10:32.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:31 smithi189 ceph-mon[34999]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:10:32.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:31 smithi084 ceph-mon[34812]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:10:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.382+0000 7f3ba3200640 1 -- 172.21.15.50:0/1397218163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba41047e0 msgr2=0x7f3ba4108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.382+0000 7f3ba3200640 1 --2- 172.21.15.50:0/1397218163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba41047e0 0x7f3ba4108830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009900 tx=0x7f3b8c02a410 comp rx=0 tx=0).stop 2024-09-10T10:10:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.382+0000 7f3ba3200640 1 -- 172.21.15.50:0/1397218163 shutdown_connections 2024-09-10T10:10:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.382+0000 7f3ba3200640 1 --2- 172.21.15.50:0/1397218163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ba4108f60 0x7f3ba4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.382+0000 7f3ba3200640 1 --2- 172.21.15.50:0/1397218163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba41047e0 0x7f3ba4108830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.382+0000 7f3ba3200640 1 --2- 172.21.15.50:0/1397218163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4103e30 0x7f3ba4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.382+0000 7f3ba3200640 1 -- 172.21.15.50:0/1397218163 >> 172.21.15.50:0/1397218163 conn(0x7f3ba40ff910 msgr2=0x7f3ba4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.382+0000 7f3ba3200640 1 -- 172.21.15.50:0/1397218163 shutdown_connections 2024-09-10T10:10:32.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.382+0000 7f3ba3200640 1 -- 172.21.15.50:0/1397218163 wait complete. 2024-09-10T10:10:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.383+0000 7f3ba3200640 1 Processor -- start 2024-09-10T10:10:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.383+0000 7f3ba3200640 1 -- start start 2024-09-10T10:10:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.384+0000 7f3ba3200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4103e30 0x7f3ba419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.384+0000 7f3ba3200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ba41047e0 0x7f3ba419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.384+0000 7f3ba3200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba4108f60 0x7f3ba419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.384+0000 7f3ba3200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba4114010 con 0x7f3ba4108f60 2024-09-10T10:10:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.384+0000 7f3ba3200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba4113e90 con 0x7f3ba4103e30 2024-09-10T10:10:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.384+0000 7f3ba3200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba4114190 con 0x7f3ba41047e0 2024-09-10T10:10:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.384+0000 7f3ba2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba4108f60 0x7f3ba419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.384+0000 7f3ba2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba4108f60 0x7f3ba419ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57854/0 (socket says 172.21.15.50:57854) 2024-09-10T10:10:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.384+0000 7f3ba2800640 1 -- 172.21.15.50:0/1972912369 learned_addr learned my addr 172.21.15.50:0/1972912369 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.384+0000 7f3ba1e00640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4103e30 0x7f3ba419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.385+0000 7f3b9be00640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ba41047e0 0x7f3ba419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.385+0000 7f3ba2800640 1 -- 172.21.15.50:0/1972912369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ba41047e0 msgr2=0x7f3ba419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.385+0000 7f3ba2800640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ba41047e0 0x7f3ba419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.385+0000 7f3ba2800640 1 -- 172.21.15.50:0/1972912369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4103e30 msgr2=0x7f3ba419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.385+0000 7f3ba2800640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4103e30 0x7f3ba419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.385+0000 7f3ba2800640 1 -- 172.21.15.50:0/1972912369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba419f420 con 0x7f3ba4108f60 2024-09-10T10:10:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.385+0000 7f3b9be00640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ba41047e0 0x7f3ba419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:10:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.385+0000 7f3ba2800640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba4108f60 0x7f3ba419ed40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00eb10 tx=0x7f3b9c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.385+0000 7f3b9aa00640 1 -- 172.21.15.50:0/1972912369 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c004b20 con 0x7f3ba4108f60 2024-09-10T10:10:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.385+0000 7f3b9aa00640 1 -- 172.21.15.50:0/1972912369 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b9c004cc0 con 0x7f3ba4108f60 2024-09-10T10:10:32.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.385+0000 7f3ba3200640 1 -- 172.21.15.50:0/1972912369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba419f710 con 0x7f3ba4108f60 2024-09-10T10:10:32.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.385+0000 7f3b9aa00640 1 -- 172.21.15.50:0/1972912369 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c010760 con 0x7f3ba4108f60 2024-09-10T10:10:32.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.386+0000 7f3ba3200640 1 -- 172.21.15.50:0/1972912369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba41a6ff0 con 0x7f3ba4108f60 2024-09-10T10:10:32.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.387+0000 7f3ba3200640 1 -- 172.21.15.50:0/1972912369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba4105310 con 0x7f3ba4108f60 2024-09-10T10:10:32.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.388+0000 7f3b9aa00640 1 -- 172.21.15.50:0/1972912369 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3b9c005020 con 0x7f3ba4108f60 2024-09-10T10:10:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.390+0000 7f3b9aa00640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b880a2c90 0x7f3b880a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.390+0000 7f3b9aa00640 1 -- 172.21.15.50:0/1972912369 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f3b9c0cfc20 con 0x7f3ba4108f60 2024-09-10T10:10:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.390+0000 7f3ba1e00640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b880a2c90 0x7f3b880a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.391+0000 7f3ba1e00640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b880a2c90 0x7f3b880a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009bd0 tx=0x7f3b94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:32.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.394+0000 7f3b9aa00640 1 -- 172.21.15.50:0/1972912369 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b9c09c630 con 0x7f3ba4108f60 2024-09-10T10:10:32.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.614+0000 7f3ba3200640 1 -- 172.21.15.50:0/1972912369 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ba410bbb0 con 0x7f3ba4108f60 2024-09-10T10:10:32.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.614+0000 7f3b9aa00640 1 -- 172.21.15.50:0/1972912369 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11912 (secure 0 0 0) 0x7f3b9c09bf30 con 0x7f3ba4108f60 2024-09-10T10:10:32.616 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:10:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"btime":"2024-09-10T10:09:28:538200+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:09:28.424047+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24517,24521,24560]},"id":1}]} 2024-09-10T10:10:32.616 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2024-09-10T10:10:32.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.617+0000 7f3ba3200640 1 -- 172.21.15.50:0/1972912369 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b880a2c90 msgr2=0x7f3b880a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:32.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.617+0000 7f3ba3200640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b880a2c90 0x7f3b880a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009bd0 tx=0x7f3b94005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:32.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.617+0000 7f3ba3200640 1 -- 172.21.15.50:0/1972912369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba4108f60 msgr2=0x7f3ba419ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:32.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.617+0000 7f3ba3200640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba4108f60 0x7f3ba419ed40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00eb10 tx=0x7f3b9c00c2d0 comp rx=0 tx=0).stop 2024-09-10T10:10:32.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.617+0000 7f3ba3200640 1 -- 172.21.15.50:0/1972912369 shutdown_connections 2024-09-10T10:10:32.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.617+0000 7f3ba3200640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b880a2c90 0x7f3b880a5150 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:32.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.617+0000 7f3ba3200640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba4108f60 0x7f3ba419ed40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:32.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.617+0000 7f3ba3200640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ba41047e0 0x7f3ba419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:32.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.617+0000 7f3ba3200640 1 --2- 172.21.15.50:0/1972912369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4103e30 0x7f3ba419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:32.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.617+0000 7f3ba3200640 1 -- 172.21.15.50:0/1972912369 >> 172.21.15.50:0/1972912369 conn(0x7f3ba40ff910 msgr2=0x7f3ba4100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:32.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.617+0000 7f3ba3200640 1 -- 172.21.15.50:0/1972912369 shutdown_connections 2024-09-10T10:10:32.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:32.617+0000 7f3ba3200640 1 -- 172.21.15.50:0/1972912369 wait complete. 2024-09-10T10:10:33.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:32 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1972912369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:10:33.333 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:10:33.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:32 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1972912369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:10:33.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:32 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1972912369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:10:33.710 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:34.140 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:33 smithi050 ceph-mon[30354]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.251+0000 7fea9fc00640 1 -- 172.21.15.50:0/1323705453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea98105f40 msgr2=0x7fea981063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.251+0000 7fea9fc00640 1 --2- 172.21.15.50:0/1323705453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea98105f40 0x7fea981063d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea90009ca0 tx=0x7fea9002a950 comp rx=0 tx=0).stop 2024-09-10T10:10:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.251+0000 7fea9fc00640 1 -- 172.21.15.50:0/1323705453 shutdown_connections 2024-09-10T10:10:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.251+0000 7fea9fc00640 1 --2- 172.21.15.50:0/1323705453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea98105f40 0x7fea981063d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.251+0000 7fea9fc00640 1 --2- 172.21.15.50:0/1323705453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea98101450 0x7fea98105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.251+0000 7fea9fc00640 1 --2- 172.21.15.50:0/1323705453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea98100b30 0x7fea98100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.251+0000 7fea9fc00640 1 -- 172.21.15.50:0/1323705453 >> 172.21.15.50:0/1323705453 conn(0x7fea980fc7a0 msgr2=0x7fea980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.251+0000 7fea9fc00640 1 -- 172.21.15.50:0/1323705453 shutdown_connections 2024-09-10T10:10:34.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.251+0000 7fea9fc00640 1 -- 172.21.15.50:0/1323705453 wait complete. 2024-09-10T10:10:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.252+0000 7fea9fc00640 1 Processor -- start 2024-09-10T10:10:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.252+0000 7fea9fc00640 1 -- start start 2024-09-10T10:10:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.253+0000 7fea9fc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea98100b30 0x7fea981a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.253+0000 7fea9fc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea98101450 0x7fea981a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.253+0000 7fea9fc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea98105f40 0x7fea9819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.253+0000 7fea9fc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea98118570 con 0x7fea98100b30 2024-09-10T10:10:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.253+0000 7fea9fc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fea981183f0 con 0x7fea98101450 2024-09-10T10:10:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.253+0000 7fea9fc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fea981186f0 con 0x7fea98105f40 2024-09-10T10:10:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.253+0000 7fea9d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea98100b30 0x7fea981a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.253+0000 7fea9dc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea98105f40 0x7fea9819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:34.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.253+0000 7fea9d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea98100b30 0x7fea981a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57862/0 (socket says 172.21.15.50:57862) 2024-09-10T10:10:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.253+0000 7fea97e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea98101450 0x7fea981a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.253+0000 7fea9d200640 1 -- 172.21.15.50:0/1084349355 learned_addr learned my addr 172.21.15.50:0/1084349355 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.254+0000 7fea9dc00640 1 -- 172.21.15.50:0/1084349355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea98101450 msgr2=0x7fea981a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.254+0000 7fea9dc00640 1 --2- 172.21.15.50:0/1084349355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea98101450 0x7fea981a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.254+0000 7fea9dc00640 1 -- 172.21.15.50:0/1084349355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea98100b30 msgr2=0x7fea981a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.254+0000 7fea9dc00640 1 --2- 172.21.15.50:0/1084349355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea98100b30 0x7fea981a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.254+0000 7fea9dc00640 1 -- 172.21.15.50:0/1084349355 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9819ef90 con 0x7fea98105f40 2024-09-10T10:10:34.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.254+0000 7fea9d200640 1 --2- 172.21.15.50:0/1084349355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea98100b30 0x7fea981a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.254+0000 7fea9dc00640 1 --2- 172.21.15.50:0/1084349355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea98105f40 0x7fea9819e860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fea90005e30 tx=0x7fea9002fd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.254+0000 7fea95600640 1 -- 172.21.15.50:0/1084349355 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea90034040 con 0x7fea98105f40 2024-09-10T10:10:34.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.254+0000 7fea95600640 1 -- 172.21.15.50:0/1084349355 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea90030920 con 0x7fea98105f40 2024-09-10T10:10:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.254+0000 7fea95600640 1 -- 172.21.15.50:0/1084349355 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea90004780 con 0x7fea98105f40 2024-09-10T10:10:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.254+0000 7fea9fc00640 1 -- 172.21.15.50:0/1084349355 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9819f220 con 0x7fea98105f40 2024-09-10T10:10:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.255+0000 7fea9fc00640 1 -- 172.21.15.50:0/1084349355 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea981ab570 con 0x7fea98105f40 2024-09-10T10:10:34.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.256+0000 7fea9fc00640 1 -- 172.21.15.50:0/1084349355 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea98105920 con 0x7fea98105f40 2024-09-10T10:10:34.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.257+0000 7fea95600640 1 -- 172.21.15.50:0/1084349355 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fea90037020 con 0x7fea98105f40 2024-09-10T10:10:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.259+0000 7fea95600640 1 --2- 172.21.15.50:0/1084349355 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea800a2c10 0x7fea800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.259+0000 7fea95600640 1 -- 172.21.15.50:0/1084349355 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fea900f08d0 con 0x7fea98105f40 2024-09-10T10:10:34.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.259+0000 7fea9d200640 1 --2- 172.21.15.50:0/1084349355 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea800a2c10 0x7fea800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:34.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.260+0000 7fea9d200640 1 --2- 172.21.15.50:0/1084349355 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea800a2c10 0x7fea800a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fea9819f9a0 tx=0x7fea8c00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:34.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.261+0000 7fea95600640 1 -- 172.21.15.50:0/1084349355 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea9004a060 con 0x7fea98105f40 2024-09-10T10:10:34.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:33 smithi189 ceph-mon[34999]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:34.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:33 smithi084 ceph-mon[34812]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:34.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.482+0000 7fea9fc00640 1 -- 172.21.15.50:0/1084349355 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea981ab7d0 con 0x7fea98105f40 2024-09-10T10:10:34.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.484+0000 7fea95600640 1 -- 172.21.15.50:0/1084349355 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11912 (secure 0 0 0) 0x7fea900bd3f0 con 0x7fea98105f40 2024-09-10T10:10:34.485 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:10:34.486 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"btime":"2024-09-10T10:09:28:538200+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:09:28.424047+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24517,24521,24560]},"id":1}]} 2024-09-10T10:10:34.486 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2024-09-10T10:10:34.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.486+0000 7fea9fc00640 1 -- 172.21.15.50:0/1084349355 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea800a2c10 msgr2=0x7fea800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.486+0000 7fea9fc00640 1 --2- 172.21.15.50:0/1084349355 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea800a2c10 0x7fea800a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fea9819f9a0 tx=0x7fea8c00b4a0 comp rx=0 tx=0).stop 2024-09-10T10:10:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.486+0000 7fea9fc00640 1 -- 172.21.15.50:0/1084349355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea98105f40 msgr2=0x7fea9819e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.486+0000 7fea9fc00640 1 --2- 172.21.15.50:0/1084349355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea98105f40 0x7fea9819e860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fea90005e30 tx=0x7fea9002fd00 comp rx=0 tx=0).stop 2024-09-10T10:10:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.486+0000 7fea9fc00640 1 -- 172.21.15.50:0/1084349355 shutdown_connections 2024-09-10T10:10:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.486+0000 7fea9fc00640 1 --2- 172.21.15.50:0/1084349355 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea800a2c10 0x7fea800a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.486+0000 7fea9fc00640 1 --2- 172.21.15.50:0/1084349355 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea98105f40 0x7fea9819e860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.486+0000 7fea9fc00640 1 --2- 172.21.15.50:0/1084349355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea98101450 0x7fea981a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.486+0000 7fea9fc00640 1 --2- 172.21.15.50:0/1084349355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea98100b30 0x7fea981a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.486+0000 7fea9fc00640 1 -- 172.21.15.50:0/1084349355 >> 172.21.15.50:0/1084349355 conn(0x7fea980fc7a0 msgr2=0x7fea981038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:34.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.486+0000 7fea9fc00640 1 -- 172.21.15.50:0/1084349355 shutdown_connections 2024-09-10T10:10:34.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:34.486+0000 7fea9fc00640 1 -- 172.21.15.50:0/1084349355 wait complete. 2024-09-10T10:10:35.137 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:34 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1084349355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:10:35.175 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:10:35.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:34 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1084349355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:10:35.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:34 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1084349355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:10:35.597 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:35.975 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:35 smithi189 ceph-mon[34999]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:10:35.976 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:35 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:36.058 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:35 smithi050 ceph-mon[30354]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:10:36.058 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:35 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:36.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.173+0000 7fca10e00640 1 -- 172.21.15.50:0/2960969266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca0c074e30 msgr2=0x7fca0c10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:36.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.173+0000 7fca10e00640 1 --2- 172.21.15.50:0/2960969266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca0c074e30 0x7fca0c10dd40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4009900 tx=0x7fc9f402a480 comp rx=0 tx=0).stop 2024-09-10T10:10:36.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.173+0000 7fca10e00640 1 -- 172.21.15.50:0/2960969266 shutdown_connections 2024-09-10T10:10:36.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.173+0000 7fca10e00640 1 --2- 172.21.15.50:0/2960969266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca0c10e280 0x7fca0c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:36.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.173+0000 7fca10e00640 1 --2- 172.21.15.50:0/2960969266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca0c074e30 0x7fca0c10dd40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:36.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.173+0000 7fca10e00640 1 --2- 172.21.15.50:0/2960969266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca0c074510 0x7fca0c0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:36.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.173+0000 7fca10e00640 1 -- 172.21.15.50:0/2960969266 >> 172.21.15.50:0/2960969266 conn(0x7fca0c0fd740 msgr2=0x7fca0c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:36.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.173+0000 7fca10e00640 1 -- 172.21.15.50:0/2960969266 shutdown_connections 2024-09-10T10:10:36.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.173+0000 7fca10e00640 1 -- 172.21.15.50:0/2960969266 wait complete. 2024-09-10T10:10:36.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.174+0000 7fca10e00640 1 Processor -- start 2024-09-10T10:10:36.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.174+0000 7fca10e00640 1 -- start start 2024-09-10T10:10:36.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.174+0000 7fca10e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca0c074510 0x7fca0c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:36.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.174+0000 7fca10e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca0c074e30 0x7fca0c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:36.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.174+0000 7fca10e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca0c10e280 0x7fca0c19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:36.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.175+0000 7fca10e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c113fb0 con 0x7fca0c10e280 2024-09-10T10:10:36.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.175+0000 7fca10e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c113e30 con 0x7fca0c074e30 2024-09-10T10:10:36.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.175+0000 7fca10e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c114130 con 0x7fca0c074510 2024-09-10T10:10:36.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.175+0000 7fca0be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca0c10e280 0x7fca0c19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:36.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.175+0000 7fca03e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca0c074e30 0x7fca0c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:36.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.175+0000 7fca03e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca0c074e30 0x7fca0c19aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:35998/0 (socket says 172.21.15.50:35998) 2024-09-10T10:10:36.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.175+0000 7fca03e00640 1 -- 172.21.15.50:0/77716243 learned_addr learned my addr 172.21.15.50:0/77716243 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:36.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.176+0000 7fca03e00640 1 -- 172.21.15.50:0/77716243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca0c074510 msgr2=0x7fca0c19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:36.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.176+0000 7fca03e00640 1 --2- 172.21.15.50:0/77716243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca0c074510 0x7fca0c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:36.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.176+0000 7fca03e00640 1 -- 172.21.15.50:0/77716243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca0c10e280 msgr2=0x7fca0c19ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:36.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.176+0000 7fca03e00640 1 --2- 172.21.15.50:0/77716243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca0c10e280 0x7fca0c19ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:36.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.176+0000 7fca03e00640 1 -- 172.21.15.50:0/77716243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0c19f4c0 con 0x7fca0c074e30 2024-09-10T10:10:36.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.176+0000 7fca03e00640 1 --2- 172.21.15.50:0/77716243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca0c074e30 0x7fca0c19aa50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4006010 tx=0x7fc9f4004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:36.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.176+0000 7fca08c00640 1 -- 172.21.15.50:0/77716243 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f403f030 con 0x7fca0c074e30 2024-09-10T10:10:36.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.176+0000 7fca08c00640 1 -- 172.21.15.50:0/77716243 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9f4004440 con 0x7fca0c074e30 2024-09-10T10:10:36.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.176+0000 7fca08c00640 1 -- 172.21.15.50:0/77716243 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4035070 con 0x7fca0c074e30 2024-09-10T10:10:36.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.176+0000 7fca10e00640 1 -- 172.21.15.50:0/77716243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca0c19f750 con 0x7fca0c074e30 2024-09-10T10:10:36.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.177+0000 7fca10e00640 1 -- 172.21.15.50:0/77716243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca0c1a7090 con 0x7fca0c074e30 2024-09-10T10:10:36.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.178+0000 7fca10e00640 1 -- 172.21.15.50:0/77716243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca0c0748f0 con 0x7fca0c074e30 2024-09-10T10:10:36.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.182+0000 7fca08c00640 1 -- 172.21.15.50:0/77716243 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc9f4042030 con 0x7fca0c074e30 2024-09-10T10:10:36.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.183+0000 7fca08c00640 1 --2- 172.21.15.50:0/77716243 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc9f00a2c90 0x7fc9f00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:36.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.183+0000 7fca08c00640 1 -- 172.21.15.50:0/77716243 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fc9f40f01c0 con 0x7fca0c074e30 2024-09-10T10:10:36.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.184+0000 7fca0b400640 1 --2- 172.21.15.50:0/77716243 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc9f00a2c90 0x7fc9f00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:36.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.184+0000 7fca08c00640 1 -- 172.21.15.50:0/77716243 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9f4049030 con 0x7fca0c074e30 2024-09-10T10:10:36.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.184+0000 7fca0b400640 1 --2- 172.21.15.50:0/77716243 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc9f00a2c90 0x7fc9f00a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc005d00 tx=0x7fc9fc005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:36.187 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:35 smithi084 ceph-mon[34812]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:10:36.187 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:35 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:10:36.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.379+0000 7fca10e00640 1 -- 172.21.15.50:0/77716243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca0c109400 con 0x7fca0c074e30 2024-09-10T10:10:36.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.381+0000 7fca08c00640 1 -- 172.21.15.50:0/77716243 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24775 (secure 0 0 0) 0x7fc9f4030e50 con 0x7fca0c074e30 2024-09-10T10:10:36.383 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:10:36.383 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:10:00.717554+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:10:36.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.384+0000 7fca10e00640 1 -- 172.21.15.50:0/77716243 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc9f00a2c90 msgr2=0x7fc9f00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:36.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.384+0000 7fca10e00640 1 --2- 172.21.15.50:0/77716243 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc9f00a2c90 0x7fc9f00a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc005d00 tx=0x7fc9fc005c50 comp rx=0 tx=0).stop 2024-09-10T10:10:36.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.384+0000 7fca10e00640 1 -- 172.21.15.50:0/77716243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca0c074e30 msgr2=0x7fca0c19aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:36.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.384+0000 7fca10e00640 1 --2- 172.21.15.50:0/77716243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca0c074e30 0x7fca0c19aa50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4006010 tx=0x7fc9f4004040 comp rx=0 tx=0).stop 2024-09-10T10:10:36.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.384+0000 7fca10e00640 1 -- 172.21.15.50:0/77716243 shutdown_connections 2024-09-10T10:10:36.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.384+0000 7fca10e00640 1 --2- 172.21.15.50:0/77716243 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc9f00a2c90 0x7fc9f00a5150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:36.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.384+0000 7fca10e00640 1 --2- 172.21.15.50:0/77716243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca0c10e280 0x7fca0c19ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:36.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.384+0000 7fca10e00640 1 --2- 172.21.15.50:0/77716243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca0c074e30 0x7fca0c19aa50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:36.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.384+0000 7fca10e00640 1 --2- 172.21.15.50:0/77716243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca0c074510 0x7fca0c19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:36.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.384+0000 7fca10e00640 1 -- 172.21.15.50:0/77716243 >> 172.21.15.50:0/77716243 conn(0x7fca0c0fd740 msgr2=0x7fca0c0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:36.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.384+0000 7fca10e00640 1 -- 172.21.15.50:0/77716243 shutdown_connections 2024-09-10T10:10:36.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:36.384+0000 7fca10e00640 1 -- 172.21.15.50:0/77716243 wait complete. 2024-09-10T10:10:37.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:36 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/77716243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:10:37.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:37.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:37.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:37.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:36 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:37.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:36 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/77716243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:10:37.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:37.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:37.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:37.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:36 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:37.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:36 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/77716243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:10:37.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:37.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:37.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:37.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:36 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:37.800 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:10:38.213 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:38.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:37 smithi050 ceph-mon[30354]: pgmap v374: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:10:38.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:37 smithi189 ceph-mon[34999]: pgmap v374: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:10:38.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:37 smithi084 ceph-mon[34812]: pgmap v374: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:10:38.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.784+0000 7f718da00640 1 -- 172.21.15.50:0/1400583121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71881027a0 msgr2=0x7f71881067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:38.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.784+0000 7f718da00640 1 --2- 172.21.15.50:0/1400583121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71881027a0 0x7f71881067f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7170009900 tx=0x7f717002a410 comp rx=0 tx=0).stop 2024-09-10T10:10:38.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.784+0000 7f718da00640 1 -- 172.21.15.50:0/1400583121 shutdown_connections 2024-09-10T10:10:38.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.784+0000 7f718da00640 1 --2- 172.21.15.50:0/1400583121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7188106f20 0x7f718810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:38.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.784+0000 7f718da00640 1 --2- 172.21.15.50:0/1400583121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71881027a0 0x7f71881067f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:38.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.784+0000 7f718da00640 1 --2- 172.21.15.50:0/1400583121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7188101df0 0x7f71881021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:38.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.784+0000 7f718da00640 1 -- 172.21.15.50:0/1400583121 >> 172.21.15.50:0/1400583121 conn(0x7f71880fd8b0 msgr2=0x7f71880ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:38.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.784+0000 7f718da00640 1 -- 172.21.15.50:0/1400583121 shutdown_connections 2024-09-10T10:10:38.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.784+0000 7f718da00640 1 -- 172.21.15.50:0/1400583121 wait complete. 2024-09-10T10:10:38.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.785+0000 7f718da00640 1 Processor -- start 2024-09-10T10:10:38.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.785+0000 7f718da00640 1 -- start start 2024-09-10T10:10:38.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f718da00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7188101df0 0x7f718819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:38.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f718da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71881027a0 0x7f718819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:38.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f718da00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7188106f20 0x7f718819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:38.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f718da00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7188111fd0 con 0x7f71881027a0 2024-09-10T10:10:38.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f718da00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7188111e50 con 0x7f7188106f20 2024-09-10T10:10:38.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f718da00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7188112150 con 0x7f7188101df0 2024-09-10T10:10:38.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f717fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71881027a0 0x7f718819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:38.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f717fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71881027a0 0x7f718819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59814/0 (socket says 172.21.15.50:59814) 2024-09-10T10:10:38.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f717fe00640 1 -- 172.21.15.50:0/3443881543 learned_addr learned my addr 172.21.15.50:0/3443881543 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:38.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f7186a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7188101df0 0x7f718819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:38.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f7187400640 1 --2- 172.21.15.50:0/3443881543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7188106f20 0x7f718819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:38.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f7186a00640 1 -- 172.21.15.50:0/3443881543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7188106f20 msgr2=0x7f718819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:38.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f7186a00640 1 --2- 172.21.15.50:0/3443881543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7188106f20 0x7f718819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:38.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f7186a00640 1 -- 172.21.15.50:0/3443881543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71881027a0 msgr2=0x7f718819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:38.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f7186a00640 1 --2- 172.21.15.50:0/3443881543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71881027a0 0x7f718819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:38.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.786+0000 7f7186a00640 1 -- 172.21.15.50:0/3443881543 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718819f5d0 con 0x7f7188101df0 2024-09-10T10:10:38.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.787+0000 7f7186a00640 1 --2- 172.21.15.50:0/3443881543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7188101df0 0x7f718819a620 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f717800e9f0 tx=0x7f717800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:38.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.787+0000 7f717f400640 1 -- 172.21.15.50:0/3443881543 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717800ccc0 con 0x7f7188101df0 2024-09-10T10:10:38.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.787+0000 7f718da00640 1 -- 172.21.15.50:0/3443881543 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f718819f8c0 con 0x7f7188101df0 2024-09-10T10:10:38.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.787+0000 7f717f400640 1 -- 172.21.15.50:0/3443881543 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7178010910 con 0x7f7188101df0 2024-09-10T10:10:38.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.787+0000 7f717f400640 1 -- 172.21.15.50:0/3443881543 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7178018960 con 0x7f7188101df0 2024-09-10T10:10:38.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.787+0000 7f718da00640 1 -- 172.21.15.50:0/3443881543 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71881a71a0 con 0x7f7188101df0 2024-09-10T10:10:38.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.788+0000 7f718da00640 1 -- 172.21.15.50:0/3443881543 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71881021d0 con 0x7f7188101df0 2024-09-10T10:10:38.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.790+0000 7f717f400640 1 -- 172.21.15.50:0/3443881543 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7178010ac0 con 0x7f7188101df0 2024-09-10T10:10:38.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.791+0000 7f717f400640 1 --2- 172.21.15.50:0/3443881543 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f716c0a2c10 0x7f716c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:38.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.792+0000 7f717f400640 1 -- 172.21.15.50:0/3443881543 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f71780cfe10 con 0x7f7188101df0 2024-09-10T10:10:38.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.792+0000 7f717fe00640 1 --2- 172.21.15.50:0/3443881543 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f716c0a2c10 0x7f716c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:38.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.793+0000 7f717fe00640 1 --2- 172.21.15.50:0/3443881543 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f716c0a2c10 0x7f716c0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f71700096c0 tx=0x7f71700046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:38.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:38.794+0000 7f717f400640 1 -- 172.21.15.50:0/3443881543 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f717809c1d0 con 0x7f7188101df0 2024-09-10T10:10:39.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.037+0000 7f718da00640 1 -- 172.21.15.50:0/3443881543 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71881a7410 con 0x7f7188101df0 2024-09-10T10:10:39.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.038+0000 7f717f400640 1 -- 172.21.15.50:0/3443881543 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11912 (secure 0 0 0) 0x7f71780a04d0 con 0x7f7188101df0 2024-09-10T10:10:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:10:39.041 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"btime":"2024-09-10T10:09:28:538200+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:09:28.424047+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24517,24521,24560]},"id":1}]} 2024-09-10T10:10:39.042 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2024-09-10T10:10:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.041+0000 7f718da00640 1 -- 172.21.15.50:0/3443881543 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f716c0a2c10 msgr2=0x7f716c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.041+0000 7f718da00640 1 --2- 172.21.15.50:0/3443881543 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f716c0a2c10 0x7f716c0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f71700096c0 tx=0x7f71700046c0 comp rx=0 tx=0).stop 2024-09-10T10:10:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.041+0000 7f718da00640 1 -- 172.21.15.50:0/3443881543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7188101df0 msgr2=0x7f718819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:39.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.041+0000 7f718da00640 1 --2- 172.21.15.50:0/3443881543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7188101df0 0x7f718819a620 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f717800e9f0 tx=0x7f717800eeb0 comp rx=0 tx=0).stop 2024-09-10T10:10:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.041+0000 7f718da00640 1 -- 172.21.15.50:0/3443881543 shutdown_connections 2024-09-10T10:10:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.041+0000 7f718da00640 1 --2- 172.21.15.50:0/3443881543 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f716c0a2c10 0x7f716c0a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.041+0000 7f718da00640 1 --2- 172.21.15.50:0/3443881543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7188106f20 0x7f718819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.041+0000 7f718da00640 1 --2- 172.21.15.50:0/3443881543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f71881027a0 0x7f718819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:39.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.041+0000 7f718da00640 1 --2- 172.21.15.50:0/3443881543 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7188101df0 0x7f718819a620 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.041+0000 7f718da00640 1 -- 172.21.15.50:0/3443881543 >> 172.21.15.50:0/3443881543 conn(0x7f71880fd8b0 msgr2=0x7f71880ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.042+0000 7f718da00640 1 -- 172.21.15.50:0/3443881543 shutdown_connections 2024-09-10T10:10:39.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:39.042+0000 7f718da00640 1 -- 172.21.15.50:0/3443881543 wait complete. 2024-09-10T10:10:39.798 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T10:08:36.316040+0000', 'modified': '2024-09-10T10:09:28.424047+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24560, 'mds_1': 24521, 'mds_2': 24517}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24493': {'gid': 24493, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/1101442212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 1101442212}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 1101442212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.84:6835/1698924277', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 1698924277}, {'type': 'v1', 'addr': '172.21.15.84:6835', 'nonce': 1698924277}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/251140305', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 251140305}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 251140305}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.189:6839/2768859315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 2768859315}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 2768859315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24521': {'gid': 24521, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.84:6837/1457195028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 1457195028}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 1457195028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.84:6839/4235486934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6838', 'nonce': 4235486934}, {'type': 'v1', 'addr': '172.21.15.84:6839', 'nonce': 4235486934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24560, 'qdb_cluster': [24517, 24521, 24560]} 2024-09-10T10:10:39.799 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T10:10:39.799 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T10:10:40.185 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:40.323 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:39 smithi050 ceph-mon[30354]: pgmap v375: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:10:40.323 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:39 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:40.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:39 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:40.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:39 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3443881543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:10:40.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:39 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:40.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:39 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:40.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:39 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:40.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:39 smithi189 ceph-mon[34999]: pgmap v375: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:10:40.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:39 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:40.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:39 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:40.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:39 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3443881543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:10:40.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:39 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:40.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:39 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:40.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:39 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:40.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:39 smithi084 ceph-mon[34812]: pgmap v375: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:10:40.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:39 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:40.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:39 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:40.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:39 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3443881543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:10:40.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:39 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:10:40.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:39 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:10:40.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:39 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:10:40.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.745+0000 7f6d24800640 1 -- 172.21.15.50:0/3073090799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d1c103ff0 msgr2=0x7f6d1c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.745+0000 7f6d24800640 1 --2- 172.21.15.50:0/3073090799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d1c103ff0 0x7f6d1c1043d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009900 tx=0x7f6d1002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.745+0000 7f6d24800640 1 -- 172.21.15.50:0/3073090799 shutdown_connections 2024-09-10T10:10:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.745+0000 7f6d24800640 1 --2- 172.21.15.50:0/3073090799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d1c109120 0x7f6d1c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.745+0000 7f6d24800640 1 --2- 172.21.15.50:0/3073090799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d1c1049a0 0x7f6d1c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.745+0000 7f6d24800640 1 --2- 172.21.15.50:0/3073090799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d1c103ff0 0x7f6d1c1043d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.745+0000 7f6d24800640 1 -- 172.21.15.50:0/3073090799 >> 172.21.15.50:0/3073090799 conn(0x7f6d1c0ffa90 msgr2=0x7f6d1c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.745+0000 7f6d24800640 1 -- 172.21.15.50:0/3073090799 shutdown_connections 2024-09-10T10:10:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.745+0000 7f6d24800640 1 -- 172.21.15.50:0/3073090799 wait complete. 2024-09-10T10:10:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.746+0000 7f6d24800640 1 Processor -- start 2024-09-10T10:10:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.746+0000 7f6d24800640 1 -- start start 2024-09-10T10:10:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.747+0000 7f6d24800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d1c103ff0 0x7f6d1c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.747+0000 7f6d24800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d1c1049a0 0x7f6d1c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.747+0000 7f6d24800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d1c109120 0x7f6d1c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.747+0000 7f6d24800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c114170 con 0x7f6d1c103ff0 2024-09-10T10:10:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.747+0000 7f6d24800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c113ff0 con 0x7f6d1c1049a0 2024-09-10T10:10:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.747+0000 7f6d24800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c1142f0 con 0x7f6d1c109120 2024-09-10T10:10:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.747+0000 7f6d21e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d1c103ff0 0x7f6d1c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.747+0000 7f6d21e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d1c103ff0 0x7f6d1c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59834/0 (socket says 172.21.15.50:59834) 2024-09-10T10:10:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.747+0000 7f6d21e00640 1 -- 172.21.15.50:0/3869285477 learned_addr learned my addr 172.21.15.50:0/3869285477 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.747+0000 7f6d21400640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d1c1049a0 0x7f6d1c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.747+0000 7f6d22800640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d1c109120 0x7f6d1c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.748+0000 7f6d21400640 1 -- 172.21.15.50:0/3869285477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d1c109120 msgr2=0x7f6d1c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:40.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.748+0000 7f6d21400640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d1c109120 0x7f6d1c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.748+0000 7f6d21400640 1 -- 172.21.15.50:0/3869285477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d1c103ff0 msgr2=0x7f6d1c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.748+0000 7f6d21400640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d1c103ff0 0x7f6d1c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.748+0000 7f6d21400640 1 -- 172.21.15.50:0/3869285477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c19f5b0 con 0x7f6d1c1049a0 2024-09-10T10:10:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.748+0000 7f6d21400640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d1c1049a0 0x7f6d1c19ab40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00e9f0 tx=0x7f6d0c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.748+0000 7f6d16a00640 1 -- 172.21.15.50:0/3869285477 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c00ccc0 con 0x7f6d1c1049a0 2024-09-10T10:10:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.748+0000 7f6d24800640 1 -- 172.21.15.50:0/3869285477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1c19f8a0 con 0x7f6d1c1049a0 2024-09-10T10:10:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.748+0000 7f6d16a00640 1 -- 172.21.15.50:0/3869285477 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d0c010910 con 0x7f6d1c1049a0 2024-09-10T10:10:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.748+0000 7f6d16a00640 1 -- 172.21.15.50:0/3869285477 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c018960 con 0x7f6d1c1049a0 2024-09-10T10:10:40.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.749+0000 7f6d24800640 1 -- 172.21.15.50:0/3869285477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1c1a7180 con 0x7f6d1c1049a0 2024-09-10T10:10:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.751+0000 7f6d27456740 1 Processor -- start 2024-09-10T10:10:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.752+0000 7f6d27456740 1 -- start start 2024-09-10T10:10:40.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.752+0000 7f6d16a00640 1 -- 172.21.15.50:0/3869285477 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6d0c010ac0 con 0x7f6d1c1049a0 2024-09-10T10:10:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.752+0000 7f6d27456740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edce2330 0x55d5edce2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.752+0000 7f6d27456740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2c50 0x55d5edcecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.752+0000 7f6d27456740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edced510 0x55d5edcef900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.752+0000 7f6d27456740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d5edc480b0 con 0x55d5edce2c50 2024-09-10T10:10:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.752+0000 7f6d27456740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d5edbefab0 con 0x55d5edced510 2024-09-10T10:10:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.752+0000 7f6d27456740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d5edc44070 con 0x55d5edce2330 2024-09-10T10:10:40.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.752+0000 7f6d22800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edce2330 0x55d5edce2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.752+0000 7f6d22800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edce2330 0x55d5edce2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:37120/0 (socket says 172.21.15.50:37120) 2024-09-10T10:10:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.752+0000 7f6d22800640 1 -- 172.21.15.50:0/811475580 learned_addr learned my addr 172.21.15.50:0/811475580 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.753+0000 7f6d21e00640 1 --2- 172.21.15.50:0/811475580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2c50 0x55d5edcecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.753+0000 7f6d21400640 1 --2- 172.21.15.50:0/811475580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edced510 0x55d5edcef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.753+0000 7f6d22800640 1 -- 172.21.15.50:0/811475580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edced510 msgr2=0x55d5edcef900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.753+0000 7f6d22800640 1 --2- 172.21.15.50:0/811475580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edced510 0x55d5edcef900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.753+0000 7f6d22800640 1 -- 172.21.15.50:0/811475580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2c50 msgr2=0x55d5edcecfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.753+0000 7f6d22800640 1 --2- 172.21.15.50:0/811475580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2c50 0x55d5edcecfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.753+0000 7f6d22800640 1 -- 172.21.15.50:0/811475580 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5edbfc4a0 con 0x55d5edce2330 2024-09-10T10:10:40.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.753+0000 7f6d21400640 1 --2- 172.21.15.50:0/811475580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edced510 0x55d5edcef900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:10:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.753+0000 7f6d22800640 1 --2- 172.21.15.50:0/811475580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edce2330 0x55d5edce2710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009f50 tx=0x7f6d180118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2af6024e4e77e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.754+0000 7f6d0b000640 1 -- 172.21.15.50:0/811475580 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18004d20 con 0x55d5edce2330 2024-09-10T10:10:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.754+0000 7f6d0b000640 1 -- 172.21.15.50:0/811475580 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d18004050 con 0x55d5edce2330 2024-09-10T10:10:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.754+0000 7f6d0b000640 1 -- 172.21.15.50:0/811475580 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18005260 con 0x55d5edce2330 2024-09-10T10:10:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.754+0000 7f6d16a00640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6d040a2c90 0x7f6d040a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.754+0000 7f6d16a00640 1 -- 172.21.15.50:0/3869285477 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f6d0c0cf950 con 0x7f6d1c1049a0 2024-09-10T10:10:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.754+0000 7f6d21e00640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6d040a2c90 0x7f6d040a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.754+0000 7f6d27456740 1 -- 172.21.15.50:0/811475580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edce2330 msgr2=0x55d5edce2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.754+0000 7f6d27456740 1 --2- 172.21.15.50:0/811475580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edce2330 0x55d5edce2710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009f50 tx=0x7f6d180118d0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.754+0000 7f6d27456740 1 -- 172.21.15.50:0/811475580 shutdown_connections 2024-09-10T10:10:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.754+0000 7f6d27456740 1 --2- 172.21.15.50:0/811475580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edced510 0x55d5edcef900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.754+0000 7f6d27456740 1 --2- 172.21.15.50:0/811475580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2c50 0x55d5edcecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.754+0000 7f6d27456740 1 --2- 172.21.15.50:0/811475580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edce2330 0x55d5edce2710 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.754+0000 7f6d27456740 1 -- 172.21.15.50:0/811475580 >> 172.21.15.50:0/811475580 conn(0x55d5edcde8c0 msgr2=0x55d5edcdeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.755+0000 7f6d27456740 1 -- 172.21.15.50:0/811475580 shutdown_connections 2024-09-10T10:10:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.755+0000 7f6d27456740 1 -- 172.21.15.50:0/811475580 wait complete. 2024-09-10T10:10:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.755+0000 7f6d21e00640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6d040a2c90 0x7f6d040a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6d100096c0 tx=0x7f6d100046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.755+0000 7f6d27456740 1 -- start start 2024-09-10T10:10:40.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.756+0000 7f6d27456740 1 Processor -- start 2024-09-10T10:10:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.756+0000 7f6d27456740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2330 0x55d5edcea5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.756+0000 7f6d27456740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2c50 0x55d5edceaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.756+0000 7f6d27456740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edced510 0x55d5edceb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.756+0000 7f6d27456740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d5edcf0060 con 0x55d5edce2c50 2024-09-10T10:10:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.756+0000 7f6d27456740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d5edbd0920 con 0x55d5edce2330 2024-09-10T10:10:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.756+0000 7f6d27456740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d5edcf01e0 con 0x55d5edced510 2024-09-10T10:10:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.756+0000 7f6d27456740 10 client.0 _ll_register_callbacks cb 0x55d5edbf48a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:10:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.756+0000 7f6d21400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2c50 0x55d5edceaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.756+0000 7f6d21400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2c50 0x55d5edceaaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59850/0 (socket says 172.21.15.50:59850) 2024-09-10T10:10:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.756+0000 7f6d22800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edced510 0x55d5edceb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.756+0000 7f6d21400640 1 -- 172.21.15.50:0/2698167774 learned_addr learned my addr 172.21.15.50:0/2698167774 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:40.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.756+0000 7f6d21e00640 1 --2- 172.21.15.50:0/2698167774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2330 0x55d5edcea5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.757+0000 7f6d21400640 1 -- 172.21.15.50:0/2698167774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edced510 msgr2=0x55d5edceb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.757+0000 7f6d21400640 1 --2- 172.21.15.50:0/2698167774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edced510 0x55d5edceb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.757+0000 7f6d21400640 1 -- 172.21.15.50:0/2698167774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2330 msgr2=0x55d5edcea5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.757+0000 7f6d21400640 1 --2- 172.21.15.50:0/2698167774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2330 0x55d5edcea5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.757+0000 7f6d21400640 1 -- 172.21.15.50:0/2698167774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5ed9b92b0 con 0x55d5edce2c50 2024-09-10T10:10:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.757+0000 7f6d21400640 1 --2- 172.21.15.50:0/2698167774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2c50 0x55d5edceaaf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c098170 tx=0x7f6d0c09b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeeab291a93bd9c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:40.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.757+0000 7f6cff400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:10:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.757+0000 7f6cff400640 1 -- 172.21.15.50:0/2698167774 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c09b360 con 0x55d5edce2c50 2024-09-10T10:10:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.757+0000 7f6cff400640 1 -- 172.21.15.50:0/2698167774 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f6d0c010430 con 0x55d5edce2c50 2024-09-10T10:10:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.757+0000 7f6d27456740 1 -- 172.21.15.50:0/2698167774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d18004050 con 0x55d5edce2c50 2024-09-10T10:10:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.758+0000 7f6cff400640 1 -- 172.21.15.50:0/2698167774 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6d0c0a48d0 con 0x55d5edce2c50 2024-09-10T10:10:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.758+0000 7f6d27456740 10 client.14940 fetch_fsmap learned FSMap version 24 2024-09-10T10:10:40.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.758+0000 7f6d27456740 1 -- 172.21.15.50:0/2698167774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d5edcfbdb0 con 0x55d5edce2c50 2024-09-10T10:10:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.758+0000 7f6cff400640 1 -- 172.21.15.50:0/2698167774 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d0c0b1030 con 0x55d5edce2c50 2024-09-10T10:10:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.758+0000 7f6cff400640 1 -- 172.21.15.50:0/2698167774 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f6d0c09abd0 con 0x55d5edce2c50 2024-09-10T10:10:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.758+0000 7f6d27456740 10 client.14940 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T10:10:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.758+0000 7f6d27456740 10 client.14940 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T10:10:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.758+0000 7f6d27456740 20 client.14940 populate_metadata read hostname 'smithi050' 2024-09-10T10:10:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.758+0000 7f6d27456740 1 --2- 172.21.15.50:0/2698167774 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55d5edcfe340 0x55d5edcff7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.758+0000 7f6d27456740 4 client.14940 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:10:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.758+0000 7f6d27456740 1 -- 172.21.15.50:0/2698167774 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5edc55620 con 0x55d5edcfe340 2024-09-10T10:10:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.759+0000 7f6d21e00640 1 --2- 172.21.15.50:0/2698167774 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55d5edcfe340 0x55d5edcff7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.759+0000 7f6d21e00640 1 --2- 172.21.15.50:0/2698167774 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55d5edcfe340 0x55d5edcff7b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41a4076969362947 server_cookie=6a4c066b21445135 in_seq=0 out_seq=0 2024-09-10T10:10:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.759+0000 7f6cff400640 10 client.14940 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:10:40.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.760+0000 7f6cff400640 1 -- 172.21.15.50:0/2698167774 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d5edc55620 con 0x55d5edcfe340 2024-09-10T10:10:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.760+0000 7f6cff400640 10 client.14940 handle_command_reply: tid=0 2024-09-10T10:10:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.760+0000 7f6d27456740 1 client.14940 shutdown 2024-09-10T10:10:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.760+0000 7f6d27456740 1 -- 172.21.15.50:0/2698167774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2c50 msgr2=0x55d5edceaaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.760+0000 7f6d27456740 1 --2- 172.21.15.50:0/2698167774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2c50 0x55d5edceaaf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c098170 tx=0x7f6d0c09b670 comp rx=0 tx=0).stop 2024-09-10T10:10:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.761+0000 7f6d27456740 1 -- 172.21.15.50:0/2698167774 shutdown_connections 2024-09-10T10:10:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.761+0000 7f6d27456740 1 --2- 172.21.15.50:0/2698167774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edced510 0x55d5edceb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.761+0000 7f6d27456740 1 --2- 172.21.15.50:0/2698167774 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55d5edcfe340 0x55d5edcff7b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.761+0000 7f6d27456740 1 --2- 172.21.15.50:0/2698167774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2c50 0x55d5edceaaf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.761+0000 7f6d27456740 1 --2- 172.21.15.50:0/2698167774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2330 0x55d5edcea5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.761+0000 7f6d27456740 1 -- 172.21.15.50:0/2698167774 >> 172.21.15.50:0/2698167774 conn(0x55d5edcde8c0 msgr2=0x55d5edce45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.761+0000 7f6cff400640 0 client.14940 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:10:40.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.761+0000 7f6d27456740 1 -- 172.21.15.50:0/2698167774 shutdown_connections 2024-09-10T10:10:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.761+0000 7f6d27456740 1 -- 172.21.15.50:0/2698167774 wait complete. 2024-09-10T10:10:40.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.761+0000 7f6d27456740 20 client.14940 trim_cache size 0 max 16384 2024-09-10T10:10:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.779+0000 7f6d27456740 1 Processor -- start 2024-09-10T10:10:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.780+0000 7f6d27456740 1 -- start start 2024-09-10T10:10:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.780+0000 7f6d27456740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2330 0x55d5edcfea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.780+0000 7f6d27456740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2c50 0x55d5edcf90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.780+0000 7f6d27456740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edced510 0x55d5edce95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.780+0000 7f6d27456740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d5edcfdaf0 con 0x55d5edce2330 2024-09-10T10:10:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.780+0000 7f6d27456740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d5edcfe1c0 con 0x55d5edce2c50 2024-09-10T10:10:40.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.780+0000 7f6d27456740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d5edcfe890 con 0x55d5edced510 2024-09-10T10:10:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.780+0000 7f6d21e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2330 0x55d5edcfea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.780+0000 7f6d22800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edced510 0x55d5edce95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.780+0000 7f6d21400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2c50 0x55d5edcf90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.780+0000 7f6d22800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edced510 0x55d5edce95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:37146/0 (socket says 172.21.15.50:37146) 2024-09-10T10:10:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.780+0000 7f6d21e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2330 0x55d5edcfea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59852/0 (socket says 172.21.15.50:59852) 2024-09-10T10:10:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.780+0000 7f6d22800640 1 -- 172.21.15.50:0/4027489119 learned_addr learned my addr 172.21.15.50:0/4027489119 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.781+0000 7f6d21400640 1 -- 172.21.15.50:0/4027489119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edced510 msgr2=0x55d5edce95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.781+0000 7f6d21400640 1 --2- 172.21.15.50:0/4027489119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edced510 0x55d5edce95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.781+0000 7f6d21400640 1 -- 172.21.15.50:0/4027489119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2330 msgr2=0x55d5edcfea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:40.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.781+0000 7f6d21400640 1 --2- 172.21.15.50:0/4027489119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2330 0x55d5edcfea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.781+0000 7f6d21400640 1 -- 172.21.15.50:0/4027489119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5edce8b40 con 0x55d5edce2c50 2024-09-10T10:10:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.781+0000 7f6d21400640 1 --2- 172.21.15.50:0/4027489119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2c50 0x55d5edcf90b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c099fc0 tx=0x7f6d0c00ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4a3e618164a993 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.781+0000 7f6d0a600640 1 -- 172.21.15.50:0/4027489119 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c0b4e60 con 0x55d5edce2c50 2024-09-10T10:10:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.781+0000 7f6d0a600640 1 -- 172.21.15.50:0/4027489119 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d0c0b1020 con 0x55d5edce2c50 2024-09-10T10:10:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.781+0000 7f6d0a600640 1 -- 172.21.15.50:0/4027489119 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c018b00 con 0x55d5edce2c50 2024-09-10T10:10:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.782+0000 7f6d27456740 1 -- 172.21.15.50:0/4027489119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2c50 msgr2=0x55d5edcf90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.782+0000 7f6d27456740 1 --2- 172.21.15.50:0/4027489119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2c50 0x55d5edcf90b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c099fc0 tx=0x7f6d0c00ce60 comp rx=0 tx=0).stop 2024-09-10T10:10:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.782+0000 7f6d27456740 1 -- 172.21.15.50:0/4027489119 shutdown_connections 2024-09-10T10:10:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.782+0000 7f6d27456740 1 --2- 172.21.15.50:0/4027489119 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edced510 0x55d5edce95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.782+0000 7f6d27456740 1 --2- 172.21.15.50:0/4027489119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2c50 0x55d5edcf90b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.782+0000 7f6d27456740 1 --2- 172.21.15.50:0/4027489119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edce2330 0x55d5edcfea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.782+0000 7f6d27456740 1 -- 172.21.15.50:0/4027489119 >> 172.21.15.50:0/4027489119 conn(0x55d5edcde8c0 msgr2=0x55d5edce8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:40.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.782+0000 7f6d27456740 1 -- 172.21.15.50:0/4027489119 shutdown_connections 2024-09-10T10:10:40.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.782+0000 7f6d27456740 1 -- 172.21.15.50:0/4027489119 wait complete. 2024-09-10T10:10:40.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.782+0000 7f6d27456740 1 -- start start 2024-09-10T10:10:40.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.783+0000 7f6d27456740 1 Processor -- start 2024-09-10T10:10:40.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.783+0000 7f6d27456740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2330 0x55d5edd07a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.783+0000 7f6d27456740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edce2c50 0x55d5edd07f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.783+0000 7f6d27456740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edced510 0x55d5edd029c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.783+0000 7f6d27456740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d5edcff630 con 0x55d5edced510 2024-09-10T10:10:40.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.783+0000 7f6d27456740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d5edcfef60 con 0x55d5edce2330 2024-09-10T10:10:40.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.783+0000 7f6d27456740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d5edcffd00 con 0x55d5edce2c50 2024-09-10T10:10:40.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.783+0000 7f6d27456740 10 client.0 _ll_register_callbacks cb 0x7f6d0c0980a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:10:40.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.783+0000 7f6d22800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edced510 0x55d5edd029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.783+0000 7f6d22800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edced510 0x55d5edd029c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59868/0 (socket says 172.21.15.50:59868) 2024-09-10T10:10:40.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.783+0000 7f6d22800640 1 -- 172.21.15.50:0/187533250 learned_addr learned my addr 172.21.15.50:0/187533250 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:40.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.784+0000 7f6d21400640 1 --2- 172.21.15.50:0/187533250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edce2c50 0x55d5edd07f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.784+0000 7f6d21e00640 1 --2- 172.21.15.50:0/187533250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2330 0x55d5edd07a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.784+0000 7f6d22800640 1 -- 172.21.15.50:0/187533250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edce2c50 msgr2=0x55d5edd07f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.784+0000 7f6d22800640 1 --2- 172.21.15.50:0/187533250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edce2c50 0x55d5edd07f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.784+0000 7f6d22800640 1 -- 172.21.15.50:0/187533250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2330 msgr2=0x55d5edd07a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.784+0000 7f6d22800640 1 --2- 172.21.15.50:0/187533250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2330 0x55d5edd07a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.784+0000 7f6d22800640 1 -- 172.21.15.50:0/187533250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5edd02f30 con 0x55d5edced510 2024-09-10T10:10:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.784+0000 7f6d22800640 1 --2- 172.21.15.50:0/187533250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edced510 0x55d5edd029c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6d18012fd0 tx=0x7f6d18004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f691fd63fc4db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.784+0000 7f6cff400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:10:40.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.784+0000 7f6cff400640 1 -- 172.21.15.50:0/187533250 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18009bf0 con 0x55d5edced510 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.784+0000 7f6cff400640 1 -- 172.21.15.50:0/187533250 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f6d18004a50 con 0x55d5edced510 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.784+0000 7f6d27456740 1 -- 172.21.15.50:0/187533250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d0c0b1020 con 0x55d5edced510 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.785+0000 7f6cff400640 1 -- 172.21.15.50:0/187533250 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6d18004c50 con 0x55d5edced510 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.785+0000 7f6d27456740 10 client.14946 fetch_fsmap learned FSMap version 24 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.785+0000 7f6d27456740 1 -- 172.21.15.50:0/187533250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d5edd69290 con 0x55d5edced510 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.785+0000 7f6cff400640 1 -- 172.21.15.50:0/187533250 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d0c0b1020 con 0x55d5edced510 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.785+0000 7f6cff400640 1 -- 172.21.15.50:0/187533250 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f6d1800f5a0 con 0x55d5edced510 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.785+0000 7f6d27456740 10 client.14946 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.785+0000 7f6d27456740 10 client.14946 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.785+0000 7f6d27456740 20 client.14946 populate_metadata read hostname 'smithi050' 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.785+0000 7f6d27456740 1 --2- 172.21.15.50:0/187533250 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55d5edd6dc70 0x55d5edd6c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.785+0000 7f6d27456740 4 client.14946 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.785+0000 7f6d27456740 1 -- 172.21.15.50:0/187533250 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "status"}) -- 0x55d5edc4fb30 con 0x55d5edd6dc70 2024-09-10T10:10:40.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.786+0000 7f6d21e00640 1 --2- 172.21.15.50:0/187533250 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55d5edd6dc70 0x55d5edd6c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.786+0000 7f6d21e00640 1 --2- 172.21.15.50:0/187533250 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55d5edd6dc70 0x55d5edd6c980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=65584f167c011034 server_cookie=675b11dc7a78b180 in_seq=0 out_seq=0 2024-09-10T10:10:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.786+0000 7f6cff400640 10 client.14946 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:10:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.786+0000 7f6cff400640 1 -- 172.21.15.50:0/187533250 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d5edc4fb30 con 0x55d5edd6dc70 2024-09-10T10:10:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.786+0000 7f6cff400640 10 client.14946 handle_command_reply: tid=0 2024-09-10T10:10:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.786+0000 7f6d27456740 1 client.14946 shutdown 2024-09-10T10:10:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.787+0000 7f6d27456740 1 -- 172.21.15.50:0/187533250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edced510 msgr2=0x55d5edd029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.787+0000 7f6d27456740 1 --2- 172.21.15.50:0/187533250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edced510 0x55d5edd029c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6d18012fd0 tx=0x7f6d18004740 comp rx=0 tx=0).stop 2024-09-10T10:10:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.787+0000 7f6d27456740 1 -- 172.21.15.50:0/187533250 shutdown_connections 2024-09-10T10:10:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.787+0000 7f6d27456740 1 --2- 172.21.15.50:0/187533250 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55d5edd6dc70 0x55d5edd6c980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.787+0000 7f6d27456740 1 --2- 172.21.15.50:0/187533250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d5edced510 0x55d5edd029c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.787+0000 7f6d27456740 1 --2- 172.21.15.50:0/187533250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5edce2c50 0x55d5edd07f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.787+0000 7f6d27456740 1 --2- 172.21.15.50:0/187533250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d5edce2330 0x55d5edd07a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.787+0000 7f6cff400640 0 client.14946 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:10:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.787+0000 7f6d27456740 1 -- 172.21.15.50:0/187533250 >> 172.21.15.50:0/187533250 conn(0x55d5edcde8c0 msgr2=0x55d5edce96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.787+0000 7f6d27456740 1 -- 172.21.15.50:0/187533250 shutdown_connections 2024-09-10T10:10:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.787+0000 7f6d27456740 1 -- 172.21.15.50:0/187533250 wait complete. 2024-09-10T10:10:40.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.787+0000 7f6d27456740 20 client.14946 trim_cache size 0 max 16384 2024-09-10T10:10:40.793 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:10:40.793 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "4d54e0f8-6f5b-11ef-bcea-c7b262605968", 2024-09-10T10:10:40.794 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 2, 2024-09-10T10:10:40.794 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24517, 2024-09-10T10:10:40.794 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-10T10:10:40.794 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-10T10:10:40.794 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-10T10:10:40.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 75.255127967999996, 2024-09-10T10:10:40.794 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 24, 2024-09-10T10:10:40.794 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 95, 2024-09-10T10:10:40.794 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 93, 2024-09-10T10:10:40.794 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 147.556479919 2024-09-10T10:10:40.794 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:10:40.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.788+0000 7f6d24800640 1 -- 172.21.15.50:0/3869285477 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6d040a2c90 msgr2=0x7f6d040a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:40.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.788+0000 7f6d24800640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6d040a2c90 0x7f6d040a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6d100096c0 tx=0x7f6d100046c0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.788+0000 7f6d24800640 1 -- 172.21.15.50:0/3869285477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d1c1049a0 msgr2=0x7f6d1c19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:40.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.788+0000 7f6d24800640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d1c1049a0 0x7f6d1c19ab40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00e9f0 tx=0x7f6d0c00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.788+0000 7f6d24800640 1 -- 172.21.15.50:0/3869285477 shutdown_connections 2024-09-10T10:10:40.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.788+0000 7f6d24800640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6d040a2c90 0x7f6d040a5150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.788+0000 7f6d24800640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6d1c109120 0x7f6d1c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.788+0000 7f6d24800640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d1c1049a0 0x7f6d1c19ab40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.788+0000 7f6d24800640 1 --2- 172.21.15.50:0/3869285477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d1c103ff0 0x7f6d1c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.788+0000 7f6d24800640 1 -- 172.21.15.50:0/3869285477 >> 172.21.15.50:0/3869285477 conn(0x7f6d1c0ffa90 msgr2=0x7f6d1c100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.788+0000 7f6d24800640 1 -- 172.21.15.50:0/3869285477 shutdown_connections 2024-09-10T10:10:40.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:40.788+0000 7f6d24800640 1 -- 172.21.15.50:0/3869285477 wait complete. 2024-09-10T10:10:41.662 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T10:10:42.045 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:42.333 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:41 smithi050 ceph-mon[30354]: pgmap v376: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:10:42.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:41 smithi189 ceph-mon[34999]: pgmap v376: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:10:42.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:41 smithi084 ceph-mon[34812]: pgmap v376: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:10:42.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.578+0000 7f0db3800640 1 -- 172.21.15.50:0/1433924020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dac109120 msgr2=0x7f0dac110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:42.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.578+0000 7f0db3800640 1 --2- 172.21.15.50:0/1433924020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dac109120 0x7f0dac110ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009ca0 tx=0x7f0da402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.578+0000 7f0db3800640 1 -- 172.21.15.50:0/1433924020 shutdown_connections 2024-09-10T10:10:42.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.578+0000 7f0db3800640 1 --2- 172.21.15.50:0/1433924020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dac109120 0x7f0dac110ca0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.578+0000 7f0db3800640 1 --2- 172.21.15.50:0/1433924020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dac1049a0 0x7f0dac1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.578+0000 7f0db3800640 1 --2- 172.21.15.50:0/1433924020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dac103ff0 0x7f0dac1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.578+0000 7f0db3800640 1 -- 172.21.15.50:0/1433924020 >> 172.21.15.50:0/1433924020 conn(0x7f0dac0ffa90 msgr2=0x7f0dac101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:42.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.578+0000 7f0db3800640 1 -- 172.21.15.50:0/1433924020 shutdown_connections 2024-09-10T10:10:42.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.578+0000 7f0db3800640 1 -- 172.21.15.50:0/1433924020 wait complete. 2024-09-10T10:10:42.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.579+0000 7f0db3800640 1 Processor -- start 2024-09-10T10:10:42.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.579+0000 7f0db3800640 1 -- start start 2024-09-10T10:10:42.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.579+0000 7f0db3800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dac103ff0 0x7f0dac19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.579+0000 7f0db3800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dac1049a0 0x7f0dac19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0db3800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dac109120 0x7f0dac19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0db3800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0dac114180 con 0x7f0dac103ff0 2024-09-10T10:10:42.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0db3800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0dac114000 con 0x7f0dac109120 2024-09-10T10:10:42.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0db3800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0dac114300 con 0x7f0dac1049a0 2024-09-10T10:10:42.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0da3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dac1049a0 0x7f0dac19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0db0e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dac103ff0 0x7f0dac19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0da3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dac1049a0 0x7f0dac19ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:37180/0 (socket says 172.21.15.50:37180) 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0da3e00640 1 -- 172.21.15.50:0/3868084992 learned_addr learned my addr 172.21.15.50:0/3868084992 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0db1800640 1 --2- 172.21.15.50:0/3868084992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dac109120 0x7f0dac19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0da3e00640 1 -- 172.21.15.50:0/3868084992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dac109120 msgr2=0x7f0dac19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0da3e00640 1 --2- 172.21.15.50:0/3868084992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dac109120 0x7f0dac19ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0da3e00640 1 -- 172.21.15.50:0/3868084992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dac103ff0 msgr2=0x7f0dac19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0da3e00640 1 --2- 172.21.15.50:0/3868084992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dac103ff0 0x7f0dac19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0da3e00640 1 -- 172.21.15.50:0/3868084992 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dac19f570 con 0x7f0dac1049a0 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.580+0000 7f0da3e00640 1 --2- 172.21.15.50:0/3868084992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dac1049a0 0x7f0dac19ab00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400ea60 tx=0x7f0d9400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.581+0000 7f0daa000640 1 -- 172.21.15.50:0/3868084992 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9400cde0 con 0x7f0dac1049a0 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.581+0000 7f0daa000640 1 -- 172.21.15.50:0/3868084992 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d940035f0 con 0x7f0dac1049a0 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.581+0000 7f0db3800640 1 -- 172.21.15.50:0/3868084992 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dac19f860 con 0x7f0dac1049a0 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.581+0000 7f0daa000640 1 -- 172.21.15.50:0/3868084992 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94010670 con 0x7f0dac1049a0 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.581+0000 7f0db3800640 1 -- 172.21.15.50:0/3868084992 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dac1a7140 con 0x7f0dac1049a0 2024-09-10T10:10:42.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.584+0000 7f0db620a740 1 Processor -- start 2024-09-10T10:10:42.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.584+0000 7f0db620a740 1 -- start start 2024-09-10T10:10:42.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.584+0000 7f0db620a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebe330 0x558b0eebe710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.584+0000 7f0db620a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eebec50 0x558b0eec8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.584+0000 7f0daa000640 1 -- 172.21.15.50:0/3868084992 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0d940037a0 con 0x7f0dac1049a0 2024-09-10T10:10:42.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.584+0000 7f0db620a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eec9510 0x558b0eecb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.584+0000 7f0db620a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558b0ee240b0 con 0x558b0eebec50 2024-09-10T10:10:42.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.584+0000 7f0db620a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558b0edcbab0 con 0x558b0eebe330 2024-09-10T10:10:42.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.584+0000 7f0db620a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558b0ee20070 con 0x558b0eec9510 2024-09-10T10:10:42.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.585+0000 7f0db1800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebe330 0x558b0eebe710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.585+0000 7f0db1800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebe330 0x558b0eebe710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:60522/0 (socket says 172.21.15.50:60522) 2024-09-10T10:10:42.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.585+0000 7f0db1800640 1 -- 172.21.15.50:0/2135077541 learned_addr learned my addr 172.21.15.50:0/2135077541 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:42.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.585+0000 7f0db0e00640 1 --2- 172.21.15.50:0/2135077541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eebec50 0x558b0eec8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.585+0000 7f0da3e00640 1 --2- 172.21.15.50:0/2135077541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eec9510 0x558b0eecb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.585+0000 7f0db1800640 1 -- 172.21.15.50:0/2135077541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eec9510 msgr2=0x558b0eecb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:42.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.585+0000 7f0db1800640 1 --2- 172.21.15.50:0/2135077541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eec9510 0x558b0eecb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.585+0000 7f0db1800640 1 -- 172.21.15.50:0/2135077541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eebec50 msgr2=0x558b0eec8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:42.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.585+0000 7f0db1800640 1 --2- 172.21.15.50:0/2135077541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eebec50 0x558b0eec8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.585+0000 7f0db1800640 1 -- 172.21.15.50:0/2135077541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b0edd84a0 con 0x558b0eebe330 2024-09-10T10:10:42.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.585+0000 7f0da3e00640 1 --2- 172.21.15.50:0/2135077541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eec9510 0x558b0eecb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:10:42.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.585+0000 7f0db1800640 1 --2- 172.21.15.50:0/2135077541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebe330 0x558b0eebe710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009ca0 tx=0x7f0da40093e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5621f6e2c728e591 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:42.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.586+0000 7f0da2000640 1 -- 172.21.15.50:0/2135077541 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da4031db0 con 0x558b0eebe330 2024-09-10T10:10:42.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.586+0000 7f0da2000640 1 -- 172.21.15.50:0/2135077541 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0da4036030 con 0x558b0eebe330 2024-09-10T10:10:42.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.586+0000 7f0da2000640 1 -- 172.21.15.50:0/2135077541 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da4004330 con 0x558b0eebe330 2024-09-10T10:10:42.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.586+0000 7f0db620a740 1 -- 172.21.15.50:0/2135077541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebe330 msgr2=0x558b0eebe710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:42.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.586+0000 7f0db620a740 1 --2- 172.21.15.50:0/2135077541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebe330 0x558b0eebe710 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009ca0 tx=0x7f0da40093e0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.586+0000 7f0daa000640 1 --2- 172.21.15.50:0/3868084992 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d900a2c10 0x7f0d900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.587+0000 7f0db620a740 1 -- 172.21.15.50:0/2135077541 shutdown_connections 2024-09-10T10:10:42.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.587+0000 7f0db620a740 1 --2- 172.21.15.50:0/2135077541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eec9510 0x558b0eecb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.587+0000 7f0db620a740 1 --2- 172.21.15.50:0/2135077541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eebec50 0x558b0eec8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.587+0000 7f0db620a740 1 --2- 172.21.15.50:0/2135077541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebe330 0x558b0eebe710 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.587+0000 7f0db620a740 1 -- 172.21.15.50:0/2135077541 >> 172.21.15.50:0/2135077541 conn(0x558b0eeba8c0 msgr2=0x558b0eebaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:42.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.587+0000 7f0daa000640 1 -- 172.21.15.50:0/3868084992 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f0d940cf880 con 0x7f0dac1049a0 2024-09-10T10:10:42.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.587+0000 7f0db1800640 1 --2- 172.21.15.50:0/3868084992 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d900a2c10 0x7f0d900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.587+0000 7f0db620a740 1 -- 172.21.15.50:0/2135077541 shutdown_connections 2024-09-10T10:10:42.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.587+0000 7f0db620a740 1 -- 172.21.15.50:0/2135077541 wait complete. 2024-09-10T10:10:42.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.587+0000 7f0db620a740 1 -- start start 2024-09-10T10:10:42.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0db1800640 1 --2- 172.21.15.50:0/3868084992 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d900a2c10 0x7f0d900a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0da4006010 tx=0x7f0da4031ac0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:42.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0db620a740 1 Processor -- start 2024-09-10T10:10:42.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0db620a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eec6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0db620a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebec50 0x558b0eec6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0db620a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eec9510 0x558b0eec6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0db620a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558b0eecc000 con 0x558b0eec9510 2024-09-10T10:10:42.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0db620a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558b0edac920 con 0x558b0eebec50 2024-09-10T10:10:42.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0db620a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558b0eecc180 con 0x558b0eebe330 2024-09-10T10:10:42.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0db620a740 10 client.0 _ll_register_callbacks cb 0x558b0edd08a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:10:42.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0da3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebec50 0x558b0eec6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0db1800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eec9510 0x558b0eec6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0da3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebec50 0x558b0eec6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:60528/0 (socket says 172.21.15.50:60528) 2024-09-10T10:10:42.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0da3e00640 1 -- 172.21.15.50:0/1648137052 learned_addr learned my addr 172.21.15.50:0/1648137052 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:42.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.588+0000 7f0db0e00640 1 --2- 172.21.15.50:0/1648137052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eec6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.589+0000 7f0da3e00640 1 -- 172.21.15.50:0/1648137052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 msgr2=0x558b0eec6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.589+0000 7f0da3e00640 1 --2- 172.21.15.50:0/1648137052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eec6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.589+0000 7f0da3e00640 1 -- 172.21.15.50:0/1648137052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eec9510 msgr2=0x558b0eec6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.589+0000 7f0da3e00640 1 --2- 172.21.15.50:0/1648137052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eec9510 0x558b0eec6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.589+0000 7f0da3e00640 1 -- 172.21.15.50:0/1648137052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b0eb952b0 con 0x558b0eebec50 2024-09-10T10:10:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.589+0000 7f0db0e00640 1 --2- 172.21.15.50:0/1648137052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eec6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:10:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.589+0000 7f0da3e00640 1 --2- 172.21.15.50:0/1648137052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebec50 0x558b0eec6970 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400ea30 tx=0x7f0d9409b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e58a43f61acbc1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.589+0000 7f0d9aa00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:10:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.589+0000 7f0d9aa00640 1 -- 172.21.15.50:0/1648137052 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d940d2e60 con 0x558b0eebec50 2024-09-10T10:10:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.589+0000 7f0db620a740 1 -- 172.21.15.50:0/1648137052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0da4036030 con 0x558b0eebec50 2024-09-10T10:10:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.589+0000 7f0d9aa00640 1 -- 172.21.15.50:0/1648137052 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f0d940cd090 con 0x558b0eebec50 2024-09-10T10:10:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.590+0000 7f0d9aa00640 1 -- 172.21.15.50:0/1648137052 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0d9409ff40 con 0x558b0eebec50 2024-09-10T10:10:42.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.590+0000 7f0db620a740 10 client.25019 fetch_fsmap learned FSMap version 24 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.590+0000 7f0db620a740 1 -- 172.21.15.50:0/1648137052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558b0eed7b90 con 0x558b0eebec50 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.590+0000 7f0d9aa00640 1 -- 172.21.15.50:0/1648137052 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0da4036030 con 0x558b0eebec50 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.590+0000 7f0d9aa00640 1 -- 172.21.15.50:0/1648137052 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f0d9409afe0 con 0x558b0eebec50 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.590+0000 7f0db620a740 10 client.25019 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.590+0000 7f0db620a740 10 client.25019 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.590+0000 7f0db620a740 20 client.25019 populate_metadata read hostname 'smithi050' 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.590+0000 7f0db620a740 1 --2- 172.21.15.50:0/1648137052 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558b0eeda120 0x558b0eedb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.590+0000 7f0db620a740 4 client.25019 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.590+0000 7f0db620a740 1 -- 172.21.15.50:0/1648137052 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b0ee31620 con 0x558b0eeda120 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.591+0000 7f0db0e00640 1 --2- 172.21.15.50:0/1648137052 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558b0eeda120 0x558b0eedb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.591+0000 7f0db0e00640 1 --2- 172.21.15.50:0/1648137052 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558b0eeda120 0x558b0eedb590 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=370d8e5bd9c4f65d server_cookie=6866e54c5515df4d in_seq=0 out_seq=0 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.591+0000 7f0d9aa00640 10 client.25019 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.592+0000 7f0d9aa00640 1 -- 172.21.15.50:0/1648137052 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b0ee31620 con 0x558b0eeda120 2024-09-10T10:10:42.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.592+0000 7f0d9aa00640 10 client.25019 handle_command_reply: tid=0 2024-09-10T10:10:42.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.592+0000 7f0db620a740 1 client.25019 shutdown 2024-09-10T10:10:42.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.592+0000 7f0db620a740 1 -- 172.21.15.50:0/1648137052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebec50 msgr2=0x558b0eec6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:42.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.592+0000 7f0db620a740 1 --2- 172.21.15.50:0/1648137052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebec50 0x558b0eec6970 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400ea30 tx=0x7f0d9409b4f0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.593+0000 7f0db620a740 1 -- 172.21.15.50:0/1648137052 shutdown_connections 2024-09-10T10:10:42.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.593+0000 7f0db620a740 1 --2- 172.21.15.50:0/1648137052 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558b0eeda120 0x558b0eedb590 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.593+0000 7f0db620a740 1 --2- 172.21.15.50:0/1648137052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eec9510 0x558b0eec6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.593+0000 7f0db620a740 1 --2- 172.21.15.50:0/1648137052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebec50 0x558b0eec6970 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.593+0000 7f0db620a740 1 --2- 172.21.15.50:0/1648137052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eec6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.593+0000 7f0db620a740 1 -- 172.21.15.50:0/1648137052 >> 172.21.15.50:0/1648137052 conn(0x558b0eeba8c0 msgr2=0x558b0eec05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:42.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.593+0000 7f0d9aa00640 0 client.25019 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:10:42.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.593+0000 7f0db620a740 1 -- 172.21.15.50:0/1648137052 shutdown_connections 2024-09-10T10:10:42.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.593+0000 7f0db620a740 1 -- 172.21.15.50:0/1648137052 wait complete. 2024-09-10T10:10:42.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.593+0000 7f0db620a740 20 client.25019 trim_cache size 0 max 16384 2024-09-10T10:10:42.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.611+0000 7f0db620a740 1 Processor -- start 2024-09-10T10:10:42.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.612+0000 7f0db620a740 1 -- start start 2024-09-10T10:10:42.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.612+0000 7f0db620a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eebaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.612+0000 7f0db620a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebec50 0x558b0eec36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.612+0000 7f0db620a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eec9510 0x558b0eec3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.612+0000 7f0db620a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558b0eed98d0 con 0x558b0eec9510 2024-09-10T10:10:42.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.612+0000 7f0db620a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558b0eed9fa0 con 0x558b0eebec50 2024-09-10T10:10:42.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.612+0000 7f0db620a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558b0eeda670 con 0x558b0eebe330 2024-09-10T10:10:42.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.612+0000 7f0db1800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eec9510 0x558b0eec3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.612+0000 7f0db1800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eec9510 0x558b0eec3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59890/0 (socket says 172.21.15.50:59890) 2024-09-10T10:10:42.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.612+0000 7f0da3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebec50 0x558b0eec36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.612+0000 7f0db1800640 1 -- 172.21.15.50:0/1474938130 learned_addr learned my addr 172.21.15.50:0/1474938130 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.612+0000 7f0db0e00640 1 --2- 172.21.15.50:0/1474938130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eebaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.613+0000 7f0da3e00640 1 -- 172.21.15.50:0/1474938130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 msgr2=0x558b0eebaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.613+0000 7f0da3e00640 1 --2- 172.21.15.50:0/1474938130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eebaca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.613+0000 7f0da3e00640 1 -- 172.21.15.50:0/1474938130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eec9510 msgr2=0x558b0eec3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.613+0000 7f0da3e00640 1 --2- 172.21.15.50:0/1474938130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eec9510 0x558b0eec3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.613+0000 7f0da3e00640 1 -- 172.21.15.50:0/1474938130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b0eec8da0 con 0x558b0eebec50 2024-09-10T10:10:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.613+0000 7f0db0e00640 1 --2- 172.21.15.50:0/1474938130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eebaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:10:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.613+0000 7f0db1800640 1 --2- 172.21.15.50:0/1474938130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eec9510 0x558b0eec3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.613+0000 7f0da3e00640 1 --2- 172.21.15.50:0/1474938130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebec50 0x558b0eec36b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x558b0eec79e0 tx=0x7f0d94003f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cbeda4cb8e142de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.613+0000 7f0da1600640 1 -- 172.21.15.50:0/1474938130 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94097c10 con 0x558b0eebec50 2024-09-10T10:10:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.613+0000 7f0da1600640 1 -- 172.21.15.50:0/1474938130 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d940a4800 con 0x558b0eebec50 2024-09-10T10:10:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.613+0000 7f0da1600640 1 -- 172.21.15.50:0/1474938130 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94098200 con 0x558b0eebec50 2024-09-10T10:10:42.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.614+0000 7f0db620a740 1 -- 172.21.15.50:0/1474938130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebec50 msgr2=0x558b0eec36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.614+0000 7f0db620a740 1 --2- 172.21.15.50:0/1474938130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebec50 0x558b0eec36b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x558b0eec79e0 tx=0x7f0d94003f30 comp rx=0 tx=0).stop 2024-09-10T10:10:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.614+0000 7f0db620a740 1 -- 172.21.15.50:0/1474938130 shutdown_connections 2024-09-10T10:10:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.614+0000 7f0db620a740 1 --2- 172.21.15.50:0/1474938130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eec9510 0x558b0eec3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.614+0000 7f0db620a740 1 --2- 172.21.15.50:0/1474938130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eebec50 0x558b0eec36b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.614+0000 7f0db620a740 1 --2- 172.21.15.50:0/1474938130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eebaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.614+0000 7f0db620a740 1 -- 172.21.15.50:0/1474938130 >> 172.21.15.50:0/1474938130 conn(0x558b0eeba8c0 msgr2=0x558b0eec4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.614+0000 7f0db620a740 1 -- 172.21.15.50:0/1474938130 shutdown_connections 2024-09-10T10:10:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.614+0000 7f0db620a740 1 -- 172.21.15.50:0/1474938130 wait complete. 2024-09-10T10:10:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.614+0000 7f0db620a740 1 -- start start 2024-09-10T10:10:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.615+0000 7f0db620a740 1 Processor -- start 2024-09-10T10:10:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.615+0000 7f0db620a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eee37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.615+0000 7f0db620a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eebec50 0x558b0eee3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.615+0000 7f0db620a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eec9510 0x558b0eede7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.615+0000 7f0db620a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558b0eedb410 con 0x558b0eebec50 2024-09-10T10:10:42.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.615+0000 7f0db620a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558b0eedad40 con 0x558b0eec9510 2024-09-10T10:10:42.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.615+0000 7f0db620a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558b0eedbae0 con 0x558b0eebe330 2024-09-10T10:10:42.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.615+0000 7f0db620a740 10 client.0 _ll_register_callbacks cb 0x7f0d9409b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:10:42.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.615+0000 7f0da3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eebec50 0x558b0eee3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.615+0000 7f0da3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eebec50 0x558b0eee3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59896/0 (socket says 172.21.15.50:59896) 2024-09-10T10:10:42.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.615+0000 7f0da3e00640 1 -- 172.21.15.50:0/1736104024 learned_addr learned my addr 172.21.15.50:0/1736104024 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:42.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.615+0000 7f0db0e00640 1 --2- 172.21.15.50:0/1736104024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eee37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.616+0000 7f0db1800640 1 --2- 172.21.15.50:0/1736104024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eec9510 0x558b0eede7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.616+0000 7f0da3e00640 1 -- 172.21.15.50:0/1736104024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 msgr2=0x558b0eee37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:42.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.616+0000 7f0da3e00640 1 --2- 172.21.15.50:0/1736104024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eee37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.616+0000 7f0da3e00640 1 -- 172.21.15.50:0/1736104024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eec9510 msgr2=0x558b0eede7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:42.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.616+0000 7f0da3e00640 1 --2- 172.21.15.50:0/1736104024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eec9510 0x558b0eede7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.616+0000 7f0da3e00640 1 -- 172.21.15.50:0/1736104024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b0eedece0 con 0x558b0eebec50 2024-09-10T10:10:42.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.616+0000 7f0da3e00640 1 --2- 172.21.15.50:0/1736104024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eebec50 0x558b0eee3d30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d94097ff0 tx=0x7f0d9409ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee21f970387a30c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:42.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.616+0000 7f0d9aa00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:10:42.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.617+0000 7f0d9aa00640 1 -- 172.21.15.50:0/1736104024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d940ba4b0 con 0x558b0eebec50 2024-09-10T10:10:42.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.617+0000 7f0d9aa00640 1 -- 172.21.15.50:0/1736104024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f0d94004000 con 0x558b0eebec50 2024-09-10T10:10:42.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.617+0000 7f0db620a740 1 -- 172.21.15.50:0/1736104024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d940a4800 con 0x558b0eebec50 2024-09-10T10:10:42.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.617+0000 7f0d9aa00640 1 -- 172.21.15.50:0/1736104024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0d940cd090 con 0x558b0eebec50 2024-09-10T10:10:42.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.617+0000 7f0db620a740 10 client.14964 fetch_fsmap learned FSMap version 24 2024-09-10T10:10:42.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.617+0000 7f0db620a740 1 -- 172.21.15.50:0/1736104024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558b0eedece0 con 0x558b0eebec50 2024-09-10T10:10:42.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.617+0000 7f0d9aa00640 1 -- 172.21.15.50:0/1736104024 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d940a4800 con 0x558b0eebec50 2024-09-10T10:10:42.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.617+0000 7f0d9aa00640 1 -- 172.21.15.50:0/1736104024 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f0d940a11f0 con 0x558b0eebec50 2024-09-10T10:10:42.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.617+0000 7f0db620a740 10 client.14964 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T10:10:42.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.617+0000 7f0db620a740 10 client.14964 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T10:10:42.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.617+0000 7f0db620a740 20 client.14964 populate_metadata read hostname 'smithi050' 2024-09-10T10:10:42.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.618+0000 7f0db620a740 1 --2- 172.21.15.50:0/1736104024 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558b0ef49490 0x558b0ef481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:42.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.618+0000 7f0db620a740 4 client.14964 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:10:42.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.618+0000 7f0db620a740 1 -- 172.21.15.50:0/1736104024 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "status"}) -- 0x558b0ee2bb30 con 0x558b0ef49490 2024-09-10T10:10:42.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.618+0000 7f0db0e00640 1 --2- 172.21.15.50:0/1736104024 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558b0ef49490 0x558b0ef481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:42.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.618+0000 7f0db0e00640 1 --2- 172.21.15.50:0/1736104024 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558b0ef49490 0x558b0ef481a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e7566b849803a13b server_cookie=47d1463dd971168a in_seq=0 out_seq=0 2024-09-10T10:10:42.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.618+0000 7f0d9aa00640 10 client.14964 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:10:42.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0d9aa00640 1 -- 172.21.15.50:0/1736104024 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x558b0ee2bb30 con 0x558b0ef49490 2024-09-10T10:10:42.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0d9aa00640 10 client.14964 handle_command_reply: tid=0 2024-09-10T10:10:42.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0db620a740 1 client.14964 shutdown 2024-09-10T10:10:42.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0db620a740 1 -- 172.21.15.50:0/1736104024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eebec50 msgr2=0x558b0eee3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:42.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0db620a740 1 --2- 172.21.15.50:0/1736104024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eebec50 0x558b0eee3d30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d94097ff0 tx=0x7f0d9409ba10 comp rx=0 tx=0).stop 2024-09-10T10:10:42.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0db620a740 1 -- 172.21.15.50:0/1736104024 shutdown_connections 2024-09-10T10:10:42.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0db620a740 1 --2- 172.21.15.50:0/1736104024 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558b0ef49490 0x558b0ef481a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0db620a740 1 --2- 172.21.15.50:0/1736104024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558b0eec9510 0x558b0eede7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0db620a740 1 --2- 172.21.15.50:0/1736104024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558b0eebec50 0x558b0eee3d30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0d9aa00640 0 client.14964 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:10:42.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0db620a740 1 --2- 172.21.15.50:0/1736104024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558b0eebe330 0x558b0eee37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0db620a740 1 -- 172.21.15.50:0/1736104024 >> 172.21.15.50:0/1736104024 conn(0x558b0eeba8c0 msgr2=0x558b0eec05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:42.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0db620a740 1 -- 172.21.15.50:0/1736104024 shutdown_connections 2024-09-10T10:10:42.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.619+0000 7f0db620a740 1 -- 172.21.15.50:0/1736104024 wait complete. 2024-09-10T10:10:42.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.620+0000 7f0db620a740 20 client.14964 trim_cache size 0 max 16384 2024-09-10T10:10:42.636 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:10:42.636 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "4d54e0f8-6f5b-11ef-bcea-c7b262605968", 2024-09-10T10:10:42.637 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 1, 2024-09-10T10:10:42.637 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24521, 2024-09-10T10:10:42.637 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-10T10:10:42.637 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-10T10:10:42.637 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-10T10:10:42.637 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 78.101205217, 2024-09-10T10:10:42.637 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 24, 2024-09-10T10:10:42.637 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 95, 2024-09-10T10:10:42.637 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 93, 2024-09-10T10:10:42.637 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 152.19522921800001 2024-09-10T10:10:42.637 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:10:42.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.620+0000 7f0db3800640 1 -- 172.21.15.50:0/3868084992 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d900a2c10 msgr2=0x7f0d900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:42.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.620+0000 7f0db3800640 1 --2- 172.21.15.50:0/3868084992 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d900a2c10 0x7f0d900a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0da4006010 tx=0x7f0da4031ac0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.620+0000 7f0db3800640 1 -- 172.21.15.50:0/3868084992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dac1049a0 msgr2=0x7f0dac19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:42.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.620+0000 7f0db3800640 1 --2- 172.21.15.50:0/3868084992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dac1049a0 0x7f0dac19ab00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400ea60 tx=0x7f0d9400ef20 comp rx=0 tx=0).stop 2024-09-10T10:10:42.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.621+0000 7f0db3800640 1 -- 172.21.15.50:0/3868084992 shutdown_connections 2024-09-10T10:10:42.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.621+0000 7f0db3800640 1 --2- 172.21.15.50:0/3868084992 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d900a2c10 0x7f0d900a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.621+0000 7f0db3800640 1 --2- 172.21.15.50:0/3868084992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dac109120 0x7f0dac19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.621+0000 7f0db3800640 1 --2- 172.21.15.50:0/3868084992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dac1049a0 0x7f0dac19ab00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.621+0000 7f0db3800640 1 --2- 172.21.15.50:0/3868084992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dac103ff0 0x7f0dac19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.621+0000 7f0db3800640 1 -- 172.21.15.50:0/3868084992 >> 172.21.15.50:0/3868084992 conn(0x7f0dac0ffa90 msgr2=0x7f0dac1004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.621+0000 7f0db3800640 1 -- 172.21.15.50:0/3868084992 shutdown_connections 2024-09-10T10:10:42.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:42.621+0000 7f0db3800640 1 -- 172.21.15.50:0/3868084992 wait complete. 2024-09-10T10:10:43.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T10:10:43.709 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:44.151 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:43 smithi050 ceph-mon[30354]: pgmap v377: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:44.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.263+0000 7f62a0c00640 1 -- 172.21.15.50:0/2985783379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f629c112a30 msgr2=0x7f629c114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:44.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.263+0000 7f62a0c00640 1 --2- 172.21.15.50:0/2985783379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f629c112a30 0x7f629c114e20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6294009ca0 tx=0x7f629402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.263+0000 7f62a0c00640 1 -- 172.21.15.50:0/2985783379 shutdown_connections 2024-09-10T10:10:44.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.263+0000 7f62a0c00640 1 --2- 172.21.15.50:0/2985783379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f629c112a30 0x7f629c114e20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.263+0000 7f62a0c00640 1 --2- 172.21.15.50:0/2985783379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f629c077040 0x7f629c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.263+0000 7f62a0c00640 1 --2- 172.21.15.50:0/2985783379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c076720 0x7f629c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.263+0000 7f62a0c00640 1 -- 172.21.15.50:0/2985783379 >> 172.21.15.50:0/2985783379 conn(0x7f629c0ffa90 msgr2=0x7f629c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:44.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.264+0000 7f62a0c00640 1 -- 172.21.15.50:0/2985783379 shutdown_connections 2024-09-10T10:10:44.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.264+0000 7f62a0c00640 1 -- 172.21.15.50:0/2985783379 wait complete. 2024-09-10T10:10:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.264+0000 7f62a0c00640 1 Processor -- start 2024-09-10T10:10:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.265+0000 7f62a0c00640 1 -- start start 2024-09-10T10:10:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.265+0000 7f62a0c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f629c076720 0x7f629c1a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.265+0000 7f62a0c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f629c077040 0x7f629c1a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.265+0000 7f62a0c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c112a30 0x7f629c19e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.265+0000 7f62a0c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f629c1185d0 con 0x7f629c077040 2024-09-10T10:10:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.265+0000 7f62a0c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f629c118450 con 0x7f629c076720 2024-09-10T10:10:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.265+0000 7f62a0c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f629c118750 con 0x7f629c112a30 2024-09-10T10:10:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.265+0000 7f6293e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f629c077040 0x7f629c1a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.265+0000 7f6293e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f629c077040 0x7f629c1a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59926/0 (socket says 172.21.15.50:59926) 2024-09-10T10:10:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.265+0000 7f6293e00640 1 -- 172.21.15.50:0/8986901 learned_addr learned my addr 172.21.15.50:0/8986901 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.265+0000 7f6299e00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f629c076720 0x7f629c1a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.266+0000 7f629a800640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c112a30 0x7f629c19e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.266+0000 7f6293e00640 1 -- 172.21.15.50:0/8986901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c112a30 msgr2=0x7f629c19e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.266+0000 7f6293e00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c112a30 0x7f629c19e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.266+0000 7f6293e00640 1 -- 172.21.15.50:0/8986901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f629c076720 msgr2=0x7f629c1a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.266+0000 7f6293e00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f629c076720 0x7f629c1a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.266+0000 7f6293e00640 1 -- 172.21.15.50:0/8986901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629c19efa0 con 0x7f629c077040 2024-09-10T10:10:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.266+0000 7f6299e00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f629c076720 0x7f629c1a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.266+0000 7f6293e00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f629c077040 0x7f629c1a4bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f628400ea60 tx=0x7f628400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.266+0000 7f6292a00640 1 -- 172.21.15.50:0/8986901 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628400cde0 con 0x7f629c077040 2024-09-10T10:10:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.266+0000 7f6292a00640 1 -- 172.21.15.50:0/8986901 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62840035f0 con 0x7f629c077040 2024-09-10T10:10:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.267+0000 7f62a0c00640 1 -- 172.21.15.50:0/8986901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f629c19f290 con 0x7f629c077040 2024-09-10T10:10:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.267+0000 7f6292a00640 1 -- 172.21.15.50:0/8986901 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284010670 con 0x7f629c077040 2024-09-10T10:10:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.267+0000 7f62a0c00640 1 -- 172.21.15.50:0/8986901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f629c1ab580 con 0x7f629c077040 2024-09-10T10:10:44.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.270+0000 7f62a37cb740 1 Processor -- start 2024-09-10T10:10:44.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.270+0000 7f6292a00640 1 -- 172.21.15.50:0/8986901 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f62840037a0 con 0x7f629c077040 2024-09-10T10:10:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.270+0000 7f62a37cb740 1 -- start start 2024-09-10T10:10:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f62a37cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750330 0x564d85750710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f62a37cb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d85750c50 0x564d8575afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f62a37cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8575b510 0x564d8575d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f62a37cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564d856b60b0 con 0x564d8575b510 2024-09-10T10:10:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f62a37cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564d8565dab0 con 0x564d85750330 2024-09-10T10:10:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f62a37cb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564d856b2070 con 0x564d85750c50 2024-09-10T10:10:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f6293e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8575b510 0x564d8575d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f629a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750330 0x564d85750710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f6299e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d85750c50 0x564d8575afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f629a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750330 0x564d85750710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:60564/0 (socket says 172.21.15.50:60564) 2024-09-10T10:10:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f629a800640 1 -- 172.21.15.50:0/3554696954 learned_addr learned my addr 172.21.15.50:0/3554696954 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:44.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f629a800640 1 -- 172.21.15.50:0/3554696954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d85750c50 msgr2=0x564d8575afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:44.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f629a800640 1 --2- 172.21.15.50:0/3554696954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d85750c50 0x564d8575afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f629a800640 1 -- 172.21.15.50:0/3554696954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8575b510 msgr2=0x564d8575d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:44.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f629a800640 1 --2- 172.21.15.50:0/3554696954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8575b510 0x564d8575d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.271+0000 7f629a800640 1 -- 172.21.15.50:0/3554696954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d8566a4a0 con 0x564d85750330 2024-09-10T10:10:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.272+0000 7f629a800640 1 --2- 172.21.15.50:0/3554696954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750330 0x564d85750710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6294009ca0 tx=0x7f6294009870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=435bfe8a8bd9bf3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.272+0000 7f6292a00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f62800a2c90 0x7f62800a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.272+0000 7f6292a00640 1 -- 172.21.15.50:0/8986901 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f62840cf8a0 con 0x7f629c077040 2024-09-10T10:10:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.272+0000 7f6299e00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f62800a2c90 0x7f62800a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.272+0000 7f628b000640 1 -- 172.21.15.50:0/3554696954 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294031db0 con 0x564d85750330 2024-09-10T10:10:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.272+0000 7f628b000640 1 -- 172.21.15.50:0/3554696954 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6294036040 con 0x564d85750330 2024-09-10T10:10:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.272+0000 7f628b000640 1 -- 172.21.15.50:0/3554696954 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6294004330 con 0x564d85750330 2024-09-10T10:10:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.273+0000 7f62a37cb740 1 -- 172.21.15.50:0/3554696954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750330 msgr2=0x564d85750710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.273+0000 7f6299e00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f62800a2c90 0x7f62800a5150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x564d8574d720 tx=0x7f628c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.273+0000 7f62a37cb740 1 --2- 172.21.15.50:0/3554696954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750330 0x564d85750710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6294009ca0 tx=0x7f6294009870 comp rx=0 tx=0).stop 2024-09-10T10:10:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.273+0000 7f62a37cb740 1 -- 172.21.15.50:0/3554696954 shutdown_connections 2024-09-10T10:10:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.273+0000 7f62a37cb740 1 --2- 172.21.15.50:0/3554696954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8575b510 0x564d8575d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.273+0000 7f62a37cb740 1 --2- 172.21.15.50:0/3554696954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d85750c50 0x564d8575afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.273+0000 7f62a37cb740 1 --2- 172.21.15.50:0/3554696954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750330 0x564d85750710 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.273+0000 7f62a37cb740 1 -- 172.21.15.50:0/3554696954 >> 172.21.15.50:0/3554696954 conn(0x564d8574c8c0 msgr2=0x564d8574cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.273+0000 7f62a37cb740 1 -- 172.21.15.50:0/3554696954 shutdown_connections 2024-09-10T10:10:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.274+0000 7f62a37cb740 1 -- 172.21.15.50:0/3554696954 wait complete. 2024-09-10T10:10:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.274+0000 7f62a37cb740 1 -- start start 2024-09-10T10:10:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.274+0000 7f62a37cb740 1 Processor -- start 2024-09-10T10:10:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.275+0000 7f62a37cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85758580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.275+0000 7f62a37cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750c50 0x564d85758ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.275+0000 7f62a37cb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d8575b510 0x564d85759000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.275+0000 7f62a37cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564d8575e060 con 0x564d85750330 2024-09-10T10:10:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.275+0000 7f62a37cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564d8563e920 con 0x564d85750c50 2024-09-10T10:10:44.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.275+0000 7f62a37cb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564d8575e1e0 con 0x564d8575b510 2024-09-10T10:10:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.275+0000 7f62a37cb740 10 client.0 _ll_register_callbacks cb 0x564d856628a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:10:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.275+0000 7f6299e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85758580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.275+0000 7f6299e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85758580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59952/0 (socket says 172.21.15.50:59952) 2024-09-10T10:10:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.275+0000 7f6299e00640 1 -- 172.21.15.50:0/1405310512 learned_addr learned my addr 172.21.15.50:0/1405310512 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.275+0000 7f629a800640 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d8575b510 0x564d85759000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.275+0000 7f6293e00640 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750c50 0x564d85758ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.276+0000 7f629a800640 1 -- 172.21.15.50:0/1405310512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750c50 msgr2=0x564d85758ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.276+0000 7f629a800640 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750c50 0x564d85758ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.276+0000 7f629a800640 1 -- 172.21.15.50:0/1405310512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 msgr2=0x564d85758580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.276+0000 7f629a800640 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85758580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.276+0000 7f629a800640 1 -- 172.21.15.50:0/1405310512 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d854272b0 con 0x564d8575b510 2024-09-10T10:10:44.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.276+0000 7f6293e00640 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750c50 0x564d85758ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.276+0000 7f6299e00640 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85758580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.276+0000 7f629a800640 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d8575b510 0x564d85759000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f629402aeb0 tx=0x7f6294031820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daad3ddddcbfecf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.276+0000 7f627f400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.276+0000 7f627f400640 1 -- 172.21.15.50:0/1405310512 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629404a040 con 0x564d8575b510 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.276+0000 7f62a37cb740 1 -- 172.21.15.50:0/1405310512 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6294036040 con 0x564d8575b510 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.276+0000 7f627f400640 1 -- 172.21.15.50:0/1405310512 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f6294031450 con 0x564d8575b510 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.277+0000 7f627f400640 1 -- 172.21.15.50:0/1405310512 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f629405b050 con 0x564d8575b510 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.277+0000 7f62a37cb740 10 client.25000 fetch_fsmap learned FSMap version 24 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.277+0000 7f62a37cb740 1 -- 172.21.15.50:0/1405310512 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564d8575e060 con 0x564d8575b510 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.277+0000 7f627f400640 1 -- 172.21.15.50:0/1405310512 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6294036040 con 0x564d8575b510 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.277+0000 7f627f400640 1 -- 172.21.15.50:0/1405310512 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f629404d070 con 0x564d8575b510 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.277+0000 7f62a37cb740 10 client.25000 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.277+0000 7f62a37cb740 10 client.25000 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T10:10:44.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.277+0000 7f62a37cb740 20 client.25000 populate_metadata read hostname 'smithi050' 2024-09-10T10:10:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.277+0000 7f62a37cb740 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564d8576be90 0x564d8576d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.277+0000 7f62a37cb740 4 client.25000 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:10:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.277+0000 7f62a37cb740 1 -- 172.21.15.50:0/1405310512 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d856c3620 con 0x564d8576be90 2024-09-10T10:10:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.278+0000 7f6299e00640 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564d8576be90 0x564d8576d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.278+0000 7f6299e00640 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564d8576be90 0x564d8576d300 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88a62f370a35229c server_cookie=5dd4bb3f7b5105b3 in_seq=0 out_seq=0 2024-09-10T10:10:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.278+0000 7f627f400640 10 client.25000 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:10:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.279+0000 7f627f400640 1 -- 172.21.15.50:0/1405310512 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d856c3620 con 0x564d8576be90 2024-09-10T10:10:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.279+0000 7f627f400640 10 client.25000 handle_command_reply: tid=0 2024-09-10T10:10:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.279+0000 7f62a37cb740 1 client.25000 shutdown 2024-09-10T10:10:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.279+0000 7f62a37cb740 1 -- 172.21.15.50:0/1405310512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d8575b510 msgr2=0x564d85759000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.279+0000 7f62a37cb740 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d8575b510 0x564d85759000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f629402aeb0 tx=0x7f6294031820 comp rx=0 tx=0).stop 2024-09-10T10:10:44.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.279+0000 7f62a37cb740 1 -- 172.21.15.50:0/1405310512 shutdown_connections 2024-09-10T10:10:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.279+0000 7f62a37cb740 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564d8576be90 0x564d8576d300 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.279+0000 7f62a37cb740 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d8575b510 0x564d85759000 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.279+0000 7f62a37cb740 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750c50 0x564d85758ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.279+0000 7f62a37cb740 1 --2- 172.21.15.50:0/1405310512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85758580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.279+0000 7f627f400640 0 client.25000 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:10:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.279+0000 7f62a37cb740 1 -- 172.21.15.50:0/1405310512 >> 172.21.15.50:0/1405310512 conn(0x564d8574c8c0 msgr2=0x564d857525a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.279+0000 7f62a37cb740 1 -- 172.21.15.50:0/1405310512 shutdown_connections 2024-09-10T10:10:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.280+0000 7f62a37cb740 1 -- 172.21.15.50:0/1405310512 wait complete. 2024-09-10T10:10:44.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.280+0000 7f62a37cb740 20 client.25000 trim_cache size 0 max 16384 2024-09-10T10:10:44.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.298+0000 7f62a37cb740 1 Processor -- start 2024-09-10T10:10:44.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.298+0000 7f62a37cb740 1 -- start start 2024-09-10T10:10:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f62a37cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85766b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f62a37cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750c50 0x564d85755860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f62a37cb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d8575b510 0x564d85755da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f62a37cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564d8576b640 con 0x564d85750330 2024-09-10T10:10:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f62a37cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564d8576bd10 con 0x564d85750c50 2024-09-10T10:10:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f62a37cb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564d8576c3e0 con 0x564d8575b510 2024-09-10T10:10:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f6299e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85766b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f6293e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750c50 0x564d85755860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f6299e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85766b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59966/0 (socket says 172.21.15.50:59966) 2024-09-10T10:10:44.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f6299e00640 1 -- 172.21.15.50:0/1558600170 learned_addr learned my addr 172.21.15.50:0/1558600170 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f629a800640 1 --2- 172.21.15.50:0/1558600170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d8575b510 0x564d85755da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f6293e00640 1 -- 172.21.15.50:0/1558600170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d8575b510 msgr2=0x564d85755da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f6293e00640 1 --2- 172.21.15.50:0/1558600170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d8575b510 0x564d85755da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f6293e00640 1 -- 172.21.15.50:0/1558600170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 msgr2=0x564d85766b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f6293e00640 1 --2- 172.21.15.50:0/1558600170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85766b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.299+0000 7f6293e00640 1 -- 172.21.15.50:0/1558600170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d85750a40 con 0x564d85750c50 2024-09-10T10:10:44.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.300+0000 7f6293e00640 1 --2- 172.21.15.50:0/1558600170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750c50 0x564d85755860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f62840cce60 tx=0x7f628400ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd2df2f3329da421 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:44.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.300+0000 7f628a600640 1 -- 172.21.15.50:0/1558600170 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628409b6f0 con 0x564d85750c50 2024-09-10T10:10:44.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.300+0000 7f628a600640 1 -- 172.21.15.50:0/1558600170 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f628409c2b0 con 0x564d85750c50 2024-09-10T10:10:44.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.300+0000 7f628a600640 1 -- 172.21.15.50:0/1558600170 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628409b510 con 0x564d85750c50 2024-09-10T10:10:44.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.300+0000 7f62a37cb740 1 -- 172.21.15.50:0/1558600170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750c50 msgr2=0x564d85755860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:44.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.300+0000 7f62a37cb740 1 --2- 172.21.15.50:0/1558600170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750c50 0x564d85755860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f62840cce60 tx=0x7f628400ef90 comp rx=0 tx=0).stop 2024-09-10T10:10:44.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.301+0000 7f62a37cb740 1 -- 172.21.15.50:0/1558600170 shutdown_connections 2024-09-10T10:10:44.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.301+0000 7f62a37cb740 1 --2- 172.21.15.50:0/1558600170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d8575b510 0x564d85755da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.301+0000 7f62a37cb740 1 --2- 172.21.15.50:0/1558600170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d85750c50 0x564d85755860 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.301+0000 7f62a37cb740 1 --2- 172.21.15.50:0/1558600170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85766b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.301+0000 7f62a37cb740 1 -- 172.21.15.50:0/1558600170 >> 172.21.15.50:0/1558600170 conn(0x564d8574c8c0 msgr2=0x564d85766430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.301+0000 7f62a37cb740 1 -- 172.21.15.50:0/1558600170 shutdown_connections 2024-09-10T10:10:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.301+0000 7f62a37cb740 1 -- 172.21.15.50:0/1558600170 wait complete. 2024-09-10T10:10:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.301+0000 7f62a37cb740 1 -- start start 2024-09-10T10:10:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.301+0000 7f62a37cb740 1 Processor -- start 2024-09-10T10:10:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.302+0000 7f62a37cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85771680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.302+0000 7f62a37cb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d85750c50 0x564d85771bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.302+0000 7f62a37cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d8575b510 0x564d857d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.302+0000 7f62a37cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564d8576d180 con 0x564d85750330 2024-09-10T10:10:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.302+0000 7f62a37cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564d8576cab0 con 0x564d8575b510 2024-09-10T10:10:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.302+0000 7f62a37cb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564d8576d850 con 0x564d85750c50 2024-09-10T10:10:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.302+0000 7f62a37cb740 10 client.0 _ll_register_callbacks cb 0x7f628c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:10:44.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.302+0000 7f6299e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85771680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.302+0000 7f6299e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85771680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59974/0 (socket says 172.21.15.50:59974) 2024-09-10T10:10:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.302+0000 7f6299e00640 1 -- 172.21.15.50:0/2870855590 learned_addr learned my addr 172.21.15.50:0/2870855590 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.302+0000 7f629a800640 1 --2- 172.21.15.50:0/2870855590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d8575b510 0x564d857d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.302+0000 7f6293e00640 1 --2- 172.21.15.50:0/2870855590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d85750c50 0x564d85771bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.303+0000 7f6299e00640 1 -- 172.21.15.50:0/2870855590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d85750c50 msgr2=0x564d85771bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.303+0000 7f6299e00640 1 --2- 172.21.15.50:0/2870855590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d85750c50 0x564d85771bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.303+0000 7f6299e00640 1 -- 172.21.15.50:0/2870855590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d8575b510 msgr2=0x564d857d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:10:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.303+0000 7f6299e00640 1 --2- 172.21.15.50:0/2870855590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d8575b510 0x564d857d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.303+0000 7f6299e00640 1 -- 172.21.15.50:0/2870855590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d85772480 con 0x564d85750330 2024-09-10T10:10:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.303+0000 7f6299e00640 1 --2- 172.21.15.50:0/2870855590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85771680 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f628c00f9d0 tx=0x7f628c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de84df76d0c5f223 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:44.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.303+0000 7f627f400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:10:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.303+0000 7f627f400640 1 -- 172.21.15.50:0/2870855590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c01da10 con 0x564d85750330 2024-09-10T10:10:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.303+0000 7f62a37cb740 1 -- 172.21.15.50:0/2870855590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f628409c2b0 con 0x564d85750330 2024-09-10T10:10:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.303+0000 7f627f400640 1 -- 172.21.15.50:0/2870855590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f628c01dbb0 con 0x564d85750330 2024-09-10T10:10:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.304+0000 7f627f400640 1 -- 172.21.15.50:0/2870855590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f628c01ddb0 con 0x564d85750330 2024-09-10T10:10:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.304+0000 7f62a37cb740 10 client.14982 fetch_fsmap learned FSMap version 24 2024-09-10T10:10:44.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.304+0000 7f62a37cb740 1 -- 172.21.15.50:0/2870855590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564d857d6c40 con 0x564d85750330 2024-09-10T10:10:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.304+0000 7f627f400640 1 -- 172.21.15.50:0/2870855590 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f628409c2b0 con 0x564d85750330 2024-09-10T10:10:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.304+0000 7f627f400640 1 -- 172.21.15.50:0/2870855590 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f628c005020 con 0x564d85750330 2024-09-10T10:10:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.304+0000 7f62a37cb740 10 client.14982 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T10:10:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.304+0000 7f62a37cb740 10 client.14982 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T10:10:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.304+0000 7f62a37cb740 20 client.14982 populate_metadata read hostname 'smithi050' 2024-09-10T10:10:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.304+0000 7f62a37cb740 1 --2- 172.21.15.50:0/2870855590 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564d857db870 0x564d857da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.304+0000 7f62a37cb740 4 client.14982 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:10:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.304+0000 7f62a37cb740 1 -- 172.21.15.50:0/2870855590 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "status"}) -- 0x564d856bdb30 con 0x564d857db870 2024-09-10T10:10:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.305+0000 7f6293e00640 1 --2- 172.21.15.50:0/2870855590 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564d857db870 0x564d857da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.305+0000 7f6293e00640 1 --2- 172.21.15.50:0/2870855590 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564d857db870 0x564d857da580 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a05c300f875443a server_cookie=2769df3211d1c62e in_seq=0 out_seq=0 2024-09-10T10:10:44.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.305+0000 7f627f400640 10 client.14982 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:10:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.305+0000 7f627f400640 1 -- 172.21.15.50:0/2870855590 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564d856bdb30 con 0x564d857db870 2024-09-10T10:10:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.305+0000 7f627f400640 10 client.14982 handle_command_reply: tid=0 2024-09-10T10:10:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.305+0000 7f62a37cb740 1 client.14982 shutdown 2024-09-10T10:10:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f62a37cb740 1 -- 172.21.15.50:0/2870855590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 msgr2=0x564d85771680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f62a37cb740 1 --2- 172.21.15.50:0/2870855590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85771680 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f628c00f9d0 tx=0x7f628c0046c0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f62a37cb740 1 -- 172.21.15.50:0/2870855590 shutdown_connections 2024-09-10T10:10:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f62a37cb740 1 --2- 172.21.15.50:0/2870855590 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564d857db870 0x564d857da580 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f62a37cb740 1 --2- 172.21.15.50:0/2870855590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d8575b510 0x564d857d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f62a37cb740 1 --2- 172.21.15.50:0/2870855590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564d85750c50 0x564d85771bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f62a37cb740 1 --2- 172.21.15.50:0/2870855590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d85750330 0x564d85771680 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f627f400640 0 client.14982 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:10:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f62a37cb740 1 -- 172.21.15.50:0/2870855590 >> 172.21.15.50:0/2870855590 conn(0x564d8574c8c0 msgr2=0x564d85766c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:44.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f62a37cb740 1 -- 172.21.15.50:0/2870855590 shutdown_connections 2024-09-10T10:10:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f62a37cb740 1 -- 172.21.15.50:0/2870855590 wait complete. 2024-09-10T10:10:44.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f62a37cb740 20 client.14982 trim_cache size 0 max 16384 2024-09-10T10:10:44.312 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:10:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "4d54e0f8-6f5b-11ef-bcea-c7b262605968", 2024-09-10T10:10:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-10T10:10:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24560, 2024-09-10T10:10:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-10T10:10:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-10T10:10:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-10T10:10:44.312 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 127.949931757, 2024-09-10T10:10:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 24, 2024-09-10T10:10:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 95, 2024-09-10T10:10:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 93, 2024-09-10T10:10:44.313 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 140.78861487200001 2024-09-10T10:10:44.313 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:10:44.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f62a0c00640 1 -- 172.21.15.50:0/8986901 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f62800a2c90 msgr2=0x7f62800a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.306+0000 7f62a0c00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f62800a2c90 0x7f62800a5150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x564d8574d720 tx=0x7f628c005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.307+0000 7f62a0c00640 1 -- 172.21.15.50:0/8986901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f629c077040 msgr2=0x7f629c1a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.307+0000 7f62a0c00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f629c077040 0x7f629c1a4bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f628400ea60 tx=0x7f628400ef20 comp rx=0 tx=0).stop 2024-09-10T10:10:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.307+0000 7f62a0c00640 1 -- 172.21.15.50:0/8986901 shutdown_connections 2024-09-10T10:10:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.307+0000 7f62a0c00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f62800a2c90 0x7f62800a5150 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.307+0000 7f62a0c00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f629c112a30 0x7f629c19e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.307+0000 7f62a0c00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f629c077040 0x7f629c1a4bf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.307+0000 7f62a0c00640 1 --2- 172.21.15.50:0/8986901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f629c076720 0x7f629c1a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.307+0000 7f62a0c00640 1 -- 172.21.15.50:0/8986901 >> 172.21.15.50:0/8986901 conn(0x7f629c0ffa90 msgr2=0x7f629c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.307+0000 7f62a0c00640 1 -- 172.21.15.50:0/8986901 shutdown_connections 2024-09-10T10:10:44.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:44.307+0000 7f62a0c00640 1 -- 172.21.15.50:0/8986901 wait complete. 2024-09-10T10:10:44.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:43 smithi189 ceph-mon[34999]: pgmap v377: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:44.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:43 smithi084 ceph-mon[34812]: pgmap v377: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:45.087 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T10:10:45.087 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T10:10:45.101 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2024-09-10T10:10:45.101 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T10:10:45.479 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.034+0000 7f7372e00640 1 -- 172.21.15.50:0/1450308433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c1037c0 msgr2=0x7f736c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.034+0000 7f7372e00640 1 --2- 172.21.15.50:0/1450308433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c1037c0 0x7f736c10a050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7364009ca0 tx=0x7f736402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:10:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.034+0000 7f7372e00640 1 -- 172.21.15.50:0/1450308433 shutdown_connections 2024-09-10T10:10:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.034+0000 7f7372e00640 1 --2- 172.21.15.50:0/1450308433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c1037c0 0x7f736c10a050 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.034+0000 7f7372e00640 1 --2- 172.21.15.50:0/1450308433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f736c102e00 0x7f736c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.034+0000 7f7372e00640 1 --2- 172.21.15.50:0/1450308433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c101c00 0x7f736c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.034+0000 7f7372e00640 1 -- 172.21.15.50:0/1450308433 >> 172.21.15.50:0/1450308433 conn(0x7f736c0fd390 msgr2=0x7f736c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.034+0000 7f7372e00640 1 -- 172.21.15.50:0/1450308433 shutdown_connections 2024-09-10T10:10:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.034+0000 7f7372e00640 1 -- 172.21.15.50:0/1450308433 wait complete. 2024-09-10T10:10:46.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.035+0000 7f7372e00640 1 Processor -- start 2024-09-10T10:10:46.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.035+0000 7f7372e00640 1 -- start start 2024-09-10T10:10:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7372e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f736c101c00 0x7f736c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7372e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c102e00 0x7f736c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7372e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c1037c0 0x7f736c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7372e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f736c10d8d0 con 0x7f736c101c00 2024-09-10T10:10:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7372e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f736c10d750 con 0x7f736c1037c0 2024-09-10T10:10:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7372e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f736c10da50 con 0x7f736c102e00 2024-09-10T10:10:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7363e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c102e00 0x7f736c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f736be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f736c101c00 0x7f736c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7363e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c102e00 0x7f736c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:37292/0 (socket says 172.21.15.50:37292) 2024-09-10T10:10:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7363e00640 1 -- 172.21.15.50:0/3146190104 learned_addr learned my addr 172.21.15.50:0/3146190104 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7370e00640 1 --2- 172.21.15.50:0/3146190104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c1037c0 0x7f736c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7363e00640 1 -- 172.21.15.50:0/3146190104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c1037c0 msgr2=0x7f736c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7363e00640 1 --2- 172.21.15.50:0/3146190104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c1037c0 0x7f736c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7363e00640 1 -- 172.21.15.50:0/3146190104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f736c101c00 msgr2=0x7f736c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7363e00640 1 --2- 172.21.15.50:0/3146190104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f736c101c00 0x7f736c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.036+0000 7f7363e00640 1 -- 172.21.15.50:0/3146190104 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736c0753e0 con 0x7f736c102e00 2024-09-10T10:10:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.037+0000 7f7363e00640 1 --2- 172.21.15.50:0/3146190104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c102e00 0x7f736c0745e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f735400e9f0 tx=0x7f735400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.037+0000 7f7369600640 1 -- 172.21.15.50:0/3146190104 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735400cd80 con 0x7f736c102e00 2024-09-10T10:10:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.037+0000 7f7369600640 1 -- 172.21.15.50:0/3146190104 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7354010910 con 0x7f736c102e00 2024-09-10T10:10:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.037+0000 7f7369600640 1 -- 172.21.15.50:0/3146190104 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7354018990 con 0x7f736c102e00 2024-09-10T10:10:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.037+0000 7f7372e00640 1 -- 172.21.15.50:0/3146190104 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736c1a1fa0 con 0x7f736c102e00 2024-09-10T10:10:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.037+0000 7f7372e00640 1 -- 172.21.15.50:0/3146190104 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f736c1a24a0 con 0x7f736c102e00 2024-09-10T10:10:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.038+0000 7f7372e00640 1 -- 172.21.15.50:0/3146190104 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f736c108f80 con 0x7f736c102e00 2024-09-10T10:10:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.040+0000 7f7369600640 1 -- 172.21.15.50:0/3146190104 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7354010ac0 con 0x7f736c102e00 2024-09-10T10:10:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.041+0000 7f7369600640 1 --2- 172.21.15.50:0/3146190104 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f73500a2c90 0x7f73500a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.041+0000 7f7369600640 1 -- 172.21.15.50:0/3146190104 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f73540cf840 con 0x7f736c102e00 2024-09-10T10:10:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.041+0000 7f736be00640 1 --2- 172.21.15.50:0/3146190104 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f73500a2c90 0x7f73500a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.042+0000 7f736be00640 1 --2- 172.21.15.50:0/3146190104 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f73500a2c90 0x7f73500a5150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f736c102c60 tx=0x7f735c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:46.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.045+0000 7f7369600640 1 -- 172.21.15.50:0/3146190104 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f735409bc00 con 0x7f736c102e00 2024-09-10T10:10:46.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:45 smithi050 ceph-mon[30354]: pgmap v378: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:10:46.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.245+0000 7f7372e00640 1 -- 172.21.15.50:0/3146190104 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f736c062630 con 0x7f73500a2c90 2024-09-10T10:10:46.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.246+0000 7f7369600640 1 -- 172.21.15.50:0/3146190104 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f736c062630 con 0x7f73500a2c90 2024-09-10T10:10:46.248 INFO:teuthology.orchestra.run.smithi050.stdout:Backend: cephadm 2024-09-10T10:10:46.248 INFO:teuthology.orchestra.run.smithi050.stdout:Available: Yes 2024-09-10T10:10:46.248 INFO:teuthology.orchestra.run.smithi050.stdout:Paused: No 2024-09-10T10:10:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.249+0000 7f7372e00640 1 -- 172.21.15.50:0/3146190104 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f73500a2c90 msgr2=0x7f73500a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.249+0000 7f7372e00640 1 --2- 172.21.15.50:0/3146190104 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f73500a2c90 0x7f73500a5150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f736c102c60 tx=0x7f735c005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.249+0000 7f7372e00640 1 -- 172.21.15.50:0/3146190104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c102e00 msgr2=0x7f736c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.249+0000 7f7372e00640 1 --2- 172.21.15.50:0/3146190104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c102e00 0x7f736c0745e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f735400e9f0 tx=0x7f735400eeb0 comp rx=0 tx=0).stop 2024-09-10T10:10:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.249+0000 7f7372e00640 1 -- 172.21.15.50:0/3146190104 shutdown_connections 2024-09-10T10:10:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.249+0000 7f7372e00640 1 --2- 172.21.15.50:0/3146190104 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f73500a2c90 0x7f73500a5150 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.249+0000 7f7372e00640 1 --2- 172.21.15.50:0/3146190104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f736c1037c0 0x7f736c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.249+0000 7f7372e00640 1 --2- 172.21.15.50:0/3146190104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f736c102e00 0x7f736c0745e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.249+0000 7f7372e00640 1 --2- 172.21.15.50:0/3146190104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f736c101c00 0x7f736c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.249+0000 7f7372e00640 1 -- 172.21.15.50:0/3146190104 >> 172.21.15.50:0/3146190104 conn(0x7f736c0fd390 msgr2=0x7f736c106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.249+0000 7f7372e00640 1 -- 172.21.15.50:0/3146190104 shutdown_connections 2024-09-10T10:10:46.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:46.249+0000 7f7372e00640 1 -- 172.21.15.50:0/3146190104 wait complete. 2024-09-10T10:10:46.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:45 smithi189 ceph-mon[34999]: pgmap v378: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:10:46.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:45 smithi084 ceph-mon[34812]: pgmap v378: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:10:47.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T10:10:47.203 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:46 smithi050 ceph-mon[30354]: from='client.25012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:47.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:46 smithi189 ceph-mon[34999]: from='client.25012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:47.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:46 smithi084 ceph-mon[34812]: from='client.25012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:47.532 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:48.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.104+0000 7f335dc00640 1 -- 172.21.15.50:0/1540136375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3358105810 msgr2=0x7f335810c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.104+0000 7f335dc00640 1 --2- 172.21.15.50:0/1540136375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3358105810 0x7f335810c0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3350009ca0 tx=0x7f335002a8b0 comp rx=0 tx=0).stop 2024-09-10T10:10:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.104+0000 7f335dc00640 1 -- 172.21.15.50:0/1540136375 shutdown_connections 2024-09-10T10:10:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.104+0000 7f335dc00640 1 --2- 172.21.15.50:0/1540136375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3358105810 0x7f335810c0a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.104+0000 7f335dc00640 1 --2- 172.21.15.50:0/1540136375 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3358104e50 0x7f33581052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.104+0000 7f335dc00640 1 --2- 172.21.15.50:0/1540136375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3358103c50 0x7f3358104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.104+0000 7f335dc00640 1 -- 172.21.15.50:0/1540136375 >> 172.21.15.50:0/1540136375 conn(0x7f33580ff3e0 msgr2=0x7f3358101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.104+0000 7f335dc00640 1 -- 172.21.15.50:0/1540136375 shutdown_connections 2024-09-10T10:10:48.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.104+0000 7f335dc00640 1 -- 172.21.15.50:0/1540136375 wait complete. 2024-09-10T10:10:48.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.105+0000 7f335dc00640 1 Processor -- start 2024-09-10T10:10:48.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.105+0000 7f335dc00640 1 -- start start 2024-09-10T10:10:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.105+0000 7f335dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3358103c50 0x7f3358199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.105+0000 7f335dc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3358104e50 0x7f335819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.105+0000 7f335dc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3358105810 0x7f33581a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.105+0000 7f335dc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f335810f8b0 con 0x7f3358104e50 2024-09-10T10:10:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.105+0000 7f335dc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f335810f730 con 0x7f3358103c50 2024-09-10T10:10:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.105+0000 7f335dc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f335810fa30 con 0x7f3358105810 2024-09-10T10:10:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.106+0000 7f3357e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3358103c50 0x7f3358199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.106+0000 7f334fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3358104e50 0x7f335819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.106+0000 7f3357e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3358103c50 0x7f3358199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:51716/0 (socket says 172.21.15.50:51716) 2024-09-10T10:10:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.106+0000 7f3357e00640 1 -- 172.21.15.50:0/215951381 learned_addr learned my addr 172.21.15.50:0/215951381 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.106+0000 7f335d200640 1 --2- 172.21.15.50:0/215951381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3358105810 0x7f33581a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:48.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.106+0000 7f3357e00640 1 -- 172.21.15.50:0/215951381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3358105810 msgr2=0x7f33581a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:48.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.106+0000 7f3357e00640 1 --2- 172.21.15.50:0/215951381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3358105810 0x7f33581a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:48.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.106+0000 7f3357e00640 1 -- 172.21.15.50:0/215951381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3358104e50 msgr2=0x7f335819a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:48.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.106+0000 7f3357e00640 1 --2- 172.21.15.50:0/215951381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3358104e50 0x7f335819a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:48.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.106+0000 7f3357e00640 1 -- 172.21.15.50:0/215951381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33581a1ad0 con 0x7f3358103c50 2024-09-10T10:10:48.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.106+0000 7f3357e00640 1 --2- 172.21.15.50:0/215951381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3358103c50 0x7f3358199ea0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f334800e9c0 tx=0x7f334800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.107+0000 7f3355600640 1 -- 172.21.15.50:0/215951381 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334800cd80 con 0x7f3358103c50 2024-09-10T10:10:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.107+0000 7f3355600640 1 -- 172.21.15.50:0/215951381 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33480035f0 con 0x7f3358103c50 2024-09-10T10:10:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.107+0000 7f3355600640 1 -- 172.21.15.50:0/215951381 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3348010690 con 0x7f3358103c50 2024-09-10T10:10:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.107+0000 7f335dc00640 1 -- 172.21.15.50:0/215951381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33581a1dc0 con 0x7f3358103c50 2024-09-10T10:10:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.107+0000 7f335dc00640 1 -- 172.21.15.50:0/215951381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33581a2220 con 0x7f3358103c50 2024-09-10T10:10:48.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.108+0000 7f335dc00640 1 -- 172.21.15.50:0/215951381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f335810b000 con 0x7f3358103c50 2024-09-10T10:10:48.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.110+0000 7f3355600640 1 -- 172.21.15.50:0/215951381 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f33480037a0 con 0x7f3358103c50 2024-09-10T10:10:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.111+0000 7f3355600640 1 --2- 172.21.15.50:0/215951381 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f333c0a2c40 0x7f333c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:48.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.111+0000 7f3355600640 1 -- 172.21.15.50:0/215951381 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f33480cf930 con 0x7f3358103c50 2024-09-10T10:10:48.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.111+0000 7f334fe00640 1 --2- 172.21.15.50:0/215951381 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f333c0a2c40 0x7f333c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:48.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.112+0000 7f334fe00640 1 --2- 172.21.15.50:0/215951381 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f333c0a2c40 0x7f333c0a5100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f335819b3c0 tx=0x7f3340005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:48.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.115+0000 7f3355600640 1 -- 172.21.15.50:0/215951381 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f334809c340 con 0x7f3358103c50 2024-09-10T10:10:48.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.309+0000 7f335dc00640 1 -- 172.21.15.50:0/215951381 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3358062630 con 0x7f333c0a2c40 2024-09-10T10:10:48.311 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:47 smithi050 ceph-mon[30354]: pgmap v379: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:10:48.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.322+0000 7f3355600640 1 -- 172.21.15.50:0/215951381 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7f3358062630 con 0x7f333c0a2c40 2024-09-10T10:10:48.324 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:10:48.324 INFO:teuthology.orchestra.run.smithi050.stdout:mds.a smithi050 running (2m) 9s ago 2m 12.9M - 19.1.1-305-g1cf819b7 41d671128357 cb2b790deed8 2024-09-10T10:10:48.324 INFO:teuthology.orchestra.run.smithi050.stdout:mds.b smithi084 running (2m) 11s ago 2m 25.9M - 19.1.1-305-g1cf819b7 41d671128357 2b5c73030465 2024-09-10T10:10:48.324 INFO:teuthology.orchestra.run.smithi050.stdout:mds.c smithi189 running (2m) 11s ago 2m 19.4M - 19.1.1-305-g1cf819b7 41d671128357 625cc29b25b5 2024-09-10T10:10:48.324 INFO:teuthology.orchestra.run.smithi050.stdout:mds.d smithi050 running (2m) 9s ago 2m 13.1M - 19.1.1-305-g1cf819b7 41d671128357 4a0d96b64f6a 2024-09-10T10:10:48.324 INFO:teuthology.orchestra.run.smithi050.stdout:mds.e smithi084 running (2m) 11s ago 2m 17.3M - 19.1.1-305-g1cf819b7 41d671128357 cd4cd5f71aa4 2024-09-10T10:10:48.324 INFO:teuthology.orchestra.run.smithi050.stdout:mds.f smithi189 running (2m) 11s ago 2m 17.4M - 19.1.1-305-g1cf819b7 41d671128357 b680c43c86fa 2024-09-10T10:10:48.324 INFO:teuthology.orchestra.run.smithi050.stdout:mds.g smithi050 running (2m) 9s ago 2m 12.9M - 19.1.1-305-g1cf819b7 41d671128357 970e8319604a 2024-09-10T10:10:48.324 INFO:teuthology.orchestra.run.smithi050.stdout:mds.h smithi084 running (2m) 11s ago 2m 20.5M - 19.1.1-305-g1cf819b7 41d671128357 8d1a72c72018 2024-09-10T10:10:48.324 INFO:teuthology.orchestra.run.smithi050.stdout:mds.i smithi189 running (2m) 11s ago 2m 19.1M - 19.1.1-305-g1cf819b7 41d671128357 a211da92b4c8 2024-09-10T10:10:48.324 INFO:teuthology.orchestra.run.smithi050.stdout:mds.j smithi050 running (2m) 9s ago 2m 13.1M - 19.1.1-305-g1cf819b7 41d671128357 f2e0655ccc56 2024-09-10T10:10:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:mds.k smithi084 running (2m) 11s ago 2m 14.9M - 19.1.1-305-g1cf819b7 41d671128357 793e42c7ded8 2024-09-10T10:10:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:mds.l smithi189 running (2m) 11s ago 2m 13.8M - 19.1.1-305-g1cf819b7 41d671128357 79b51ac0a5d9 2024-09-10T10:10:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.x smithi050 *:9283,8765 running (10m) 9s ago 10m 510M - 19.1.1-305-g1cf819b7 41d671128357 5501499e7357 2024-09-10T10:10:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.y smithi084 *:8443,8765 running (8m) 11s ago 8m 445M - 19.1.1-305-g1cf819b7 41d671128357 8942596cc594 2024-09-10T10:10:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.z smithi189 *:8443,8765 running (8m) 11s ago 8m 443M - 19.1.1-305-g1cf819b7 41d671128357 c8bd9e304f5e 2024-09-10T10:10:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:mon.a smithi050 running (10m) 9s ago 10m 48.8M 2048M 19.1.1-305-g1cf819b7 41d671128357 53aa894ee78c 2024-09-10T10:10:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:mon.b smithi084 running (9m) 11s ago 9m 41.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 18af21be624a 2024-09-10T10:10:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:mon.c smithi189 running (9m) 11s ago 9m 42.0M 2048M 19.1.1-305-g1cf819b7 41d671128357 0b21d6848b2c 2024-09-10T10:10:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (8m) 9s ago 8m 45.5M 4273M 19.1.1-305-g1cf819b7 41d671128357 18fd16c5bb56 2024-09-10T10:10:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi084 running (7m) 11s ago 7m 58.5M 4272M 19.1.1-305-g1cf819b7 41d671128357 5fe7f056c487 2024-09-10T10:10:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi189 running (7m) 11s ago 7m 50.8M 4272M 19.1.1-305-g1cf819b7 41d671128357 54e347b82666 2024-09-10T10:10:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi050 running (6m) 9s ago 6m 43.2M 4273M 19.1.1-305-g1cf819b7 41d671128357 73a4b82deb12 2024-09-10T10:10:48.325 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi084 running (6m) 11s ago 6m 55.7M 4272M 19.1.1-305-g1cf819b7 41d671128357 73a432f6331d 2024-09-10T10:10:48.326 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi189 running (6m) 11s ago 6m 57.4M 4272M 19.1.1-305-g1cf819b7 41d671128357 da9d8cd82ca4 2024-09-10T10:10:48.326 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6 smithi050 running (5m) 9s ago 5m 52.2M 4273M 19.1.1-305-g1cf819b7 41d671128357 4d1e00ad9b25 2024-09-10T10:10:48.326 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7 smithi084 running (5m) 11s ago 5m 45.5M 4272M 19.1.1-305-g1cf819b7 41d671128357 2354aec58d20 2024-09-10T10:10:48.326 INFO:teuthology.orchestra.run.smithi050.stdout:osd.8 smithi189 running (4m) 11s ago 4m 54.5M 4272M 19.1.1-305-g1cf819b7 41d671128357 765d54370f7f 2024-09-10T10:10:48.326 INFO:teuthology.orchestra.run.smithi050.stdout:osd.9 smithi050 running (4m) 9s ago 4m 41.4M 4273M 19.1.1-305-g1cf819b7 41d671128357 704759bb9684 2024-09-10T10:10:48.326 INFO:teuthology.orchestra.run.smithi050.stdout:osd.10 smithi084 running (3m) 11s ago 3m 54.5M 4272M 19.1.1-305-g1cf819b7 41d671128357 f66ccadf83e8 2024-09-10T10:10:48.326 INFO:teuthology.orchestra.run.smithi050.stdout:osd.11 smithi189 running (3m) 11s ago 3m 43.6M 4272M 19.1.1-305-g1cf819b7 41d671128357 9c0c635d2c33 2024-09-10T10:10:48.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.324+0000 7f335dc00640 1 -- 172.21.15.50:0/215951381 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f333c0a2c40 msgr2=0x7f333c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:48.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.324+0000 7f335dc00640 1 --2- 172.21.15.50:0/215951381 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f333c0a2c40 0x7f333c0a5100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f335819b3c0 tx=0x7f3340005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:48.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.324+0000 7f335dc00640 1 -- 172.21.15.50:0/215951381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3358103c50 msgr2=0x7f3358199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:48.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.324+0000 7f335dc00640 1 --2- 172.21.15.50:0/215951381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3358103c50 0x7f3358199ea0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f334800e9c0 tx=0x7f334800ee80 comp rx=0 tx=0).stop 2024-09-10T10:10:48.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.325+0000 7f335dc00640 1 -- 172.21.15.50:0/215951381 shutdown_connections 2024-09-10T10:10:48.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.325+0000 7f335dc00640 1 --2- 172.21.15.50:0/215951381 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f333c0a2c40 0x7f333c0a5100 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:48.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.325+0000 7f335dc00640 1 --2- 172.21.15.50:0/215951381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3358105810 0x7f33581a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:48.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.325+0000 7f335dc00640 1 --2- 172.21.15.50:0/215951381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3358104e50 0x7f335819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:48.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.325+0000 7f335dc00640 1 --2- 172.21.15.50:0/215951381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3358103c50 0x7f3358199ea0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:48.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.325+0000 7f335dc00640 1 -- 172.21.15.50:0/215951381 >> 172.21.15.50:0/215951381 conn(0x7f33580ff3e0 msgr2=0x7f33581081d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:48.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.325+0000 7f335dc00640 1 -- 172.21.15.50:0/215951381 shutdown_connections 2024-09-10T10:10:48.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:48.325+0000 7f335dc00640 1 -- 172.21.15.50:0/215951381 wait complete. 2024-09-10T10:10:48.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:47 smithi189 ceph-mon[34999]: pgmap v379: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:10:48.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:47 smithi084 ceph-mon[34812]: pgmap v379: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:10:49.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T10:10:49.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:48 smithi189 ceph-mon[34999]: from='client.25055 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:49.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:48 smithi084 ceph-mon[34812]: from='client.25055 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:49.451 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:49.464 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:48 smithi050 ceph-mon[30354]: from='client.25055 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.993+0000 7fa6f0200640 1 -- 172.21.15.50:0/1011147405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e8104f60 msgr2=0x7fa6e81053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.993+0000 7fa6f0200640 1 --2- 172.21.15.50:0/1011147405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e8104f60 0x7fa6e81053e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009860 tx=0x7fa6d402a340 comp rx=0 tx=0).stop 2024-09-10T10:10:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.993+0000 7fa6f0200640 1 -- 172.21.15.50:0/1011147405 shutdown_connections 2024-09-10T10:10:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.993+0000 7fa6f0200640 1 --2- 172.21.15.50:0/1011147405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e8105920 0x7fa6e810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.993+0000 7fa6f0200640 1 --2- 172.21.15.50:0/1011147405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e8104f60 0x7fa6e81053e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.993+0000 7fa6f0200640 1 --2- 172.21.15.50:0/1011147405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6e8103e00 0x7fa6e8104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.993+0000 7fa6f0200640 1 -- 172.21.15.50:0/1011147405 >> 172.21.15.50:0/1011147405 conn(0x7fa6e80ff5b0 msgr2=0x7fa6e81019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.994+0000 7fa6f0200640 1 -- 172.21.15.50:0/1011147405 shutdown_connections 2024-09-10T10:10:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.994+0000 7fa6f0200640 1 -- 172.21.15.50:0/1011147405 wait complete. 2024-09-10T10:10:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.994+0000 7fa6f0200640 1 Processor -- start 2024-09-10T10:10:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.995+0000 7fa6f0200640 1 -- start start 2024-09-10T10:10:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.995+0000 7fa6f0200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e8103e00 0x7fa6e819a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.995+0000 7fa6f0200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e8104f60 0x7fa6e819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.995+0000 7fa6f0200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6e8105920 0x7fa6e81a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.995+0000 7fa6f0200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e810fa90 con 0x7fa6e8105920 2024-09-10T10:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.995+0000 7fa6f0200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e810f910 con 0x7fa6e8103e00 2024-09-10T10:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.995+0000 7fa6f0200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e810fc10 con 0x7fa6e8104f60 2024-09-10T10:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.995+0000 7fa6ed800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e8103e00 0x7fa6e819a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.995+0000 7fa6ed800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e8103e00 0x7fa6e819a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:51720/0 (socket says 172.21.15.50:51720) 2024-09-10T10:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.995+0000 7fa6ed800640 1 -- 172.21.15.50:0/1101228220 learned_addr learned my addr 172.21.15.50:0/1101228220 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.995+0000 7fa6ee200640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6e8105920 0x7fa6e81a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.995+0000 7fa6ece00640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e8104f60 0x7fa6e819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.996+0000 7fa6ed800640 1 -- 172.21.15.50:0/1101228220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e8104f60 msgr2=0x7fa6e819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.996+0000 7fa6ed800640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e8104f60 0x7fa6e819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.996+0000 7fa6ed800640 1 -- 172.21.15.50:0/1101228220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6e8105920 msgr2=0x7fa6e81a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.996+0000 7fa6ed800640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6e8105920 0x7fa6e81a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.996+0000 7fa6ed800640 1 -- 172.21.15.50:0/1101228220 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e81a1d70 con 0x7fa6e8103e00 2024-09-10T10:10:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.996+0000 7fa6ed800640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e8103e00 0x7fa6e819a140 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00e9f0 tx=0x7fa6dc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:49.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.996+0000 7fa6e6000640 1 -- 172.21.15.50:0/1101228220 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00cd80 con 0x7fa6e8103e00 2024-09-10T10:10:49.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.996+0000 7fa6e6000640 1 -- 172.21.15.50:0/1101228220 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6dc010910 con 0x7fa6e8103e00 2024-09-10T10:10:49.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.996+0000 7fa6f0200640 1 -- 172.21.15.50:0/1101228220 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e81a2060 con 0x7fa6e8103e00 2024-09-10T10:10:49.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.997+0000 7fa6e6000640 1 -- 172.21.15.50:0/1101228220 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc018990 con 0x7fa6e8103e00 2024-09-10T10:10:50.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.997+0000 7fa6f0200640 1 -- 172.21.15.50:0/1101228220 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e81a25c0 con 0x7fa6e8103e00 2024-09-10T10:10:50.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:49.998+0000 7fa6f0200640 1 -- 172.21.15.50:0/1101228220 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e8104200 con 0x7fa6e8103e00 2024-09-10T10:10:50.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.000+0000 7fa6e6000640 1 -- 172.21.15.50:0/1101228220 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa6dc010ac0 con 0x7fa6e8103e00 2024-09-10T10:10:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.001+0000 7fa6e6000640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa6d00a2cc0 0x7fa6d00a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.001+0000 7fa6e6000640 1 -- 172.21.15.50:0/1101228220 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa6dc0cf7d0 con 0x7fa6e8103e00 2024-09-10T10:10:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.001+0000 7fa6ece00640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa6d00a2cc0 0x7fa6d00a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.002+0000 7fa6ece00640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa6d00a2cc0 0x7fa6d00a5180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4030410 tx=0x7fa6d4030550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:50.003 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:49 smithi050 ceph-mon[30354]: pgmap v380: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:10:50.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.005+0000 7fa6e6000640 1 -- 172.21.15.50:0/1101228220 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6dc09bb90 con 0x7fa6e8103e00 2024-09-10T10:10:50.196 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.195+0000 7fa6f0200640 1 -- 172.21.15.50:0/1101228220 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fa6e8062630 con 0x7fa6d00a2cc0 2024-09-10T10:10:50.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.201+0000 7fa6e6000640 1 -- 172.21.15.50:0/1101228220 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fa6e8062630 con 0x7fa6d00a2cc0 2024-09-10T10:10:50.202 INFO:teuthology.orchestra.run.smithi050.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T10:10:50.202 INFO:teuthology.orchestra.run.smithi050.stdout:mds.all 12/12 13s ago 3m smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-10T10:10:50.203 INFO:teuthology.orchestra.run.smithi050.stdout:mgr 3/3 13s ago 8m smithi050=x;smithi084=y;smithi189=z;count:3 2024-09-10T10:10:50.203 INFO:teuthology.orchestra.run.smithi050.stdout:mon 3/3 13s ago 9m smithi050:172.21.15.50=a;smithi084:172.21.15.84=b;smithi189:172.21.15.189=c;count:3 2024-09-10T10:10:50.203 INFO:teuthology.orchestra.run.smithi050.stdout:osd 12 13s ago - 2024-09-10T10:10:50.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.203+0000 7fa6f0200640 1 -- 172.21.15.50:0/1101228220 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa6d00a2cc0 msgr2=0x7fa6d00a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:50.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.203+0000 7fa6f0200640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa6d00a2cc0 0x7fa6d00a5180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4030410 tx=0x7fa6d4030550 comp rx=0 tx=0).stop 2024-09-10T10:10:50.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.203+0000 7fa6f0200640 1 -- 172.21.15.50:0/1101228220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e8103e00 msgr2=0x7fa6e819a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:50.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.203+0000 7fa6f0200640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e8103e00 0x7fa6e819a140 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00e9f0 tx=0x7fa6dc00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:10:50.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.203+0000 7fa6f0200640 1 -- 172.21.15.50:0/1101228220 shutdown_connections 2024-09-10T10:10:50.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.203+0000 7fa6f0200640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa6d00a2cc0 0x7fa6d00a5180 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:50.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.203+0000 7fa6f0200640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6e8105920 0x7fa6e81a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:50.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.203+0000 7fa6f0200640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa6e8104f60 0x7fa6e819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:50.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.203+0000 7fa6f0200640 1 --2- 172.21.15.50:0/1101228220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e8103e00 0x7fa6e819a140 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:50.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.204+0000 7fa6f0200640 1 -- 172.21.15.50:0/1101228220 >> 172.21.15.50:0/1101228220 conn(0x7fa6e80ff5b0 msgr2=0x7fa6e8108460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:50.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.204+0000 7fa6f0200640 1 -- 172.21.15.50:0/1101228220 shutdown_connections 2024-09-10T10:10:50.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:50.204+0000 7fa6f0200640 1 -- 172.21.15.50:0/1101228220 wait complete. 2024-09-10T10:10:50.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:49 smithi189 ceph-mon[34999]: pgmap v380: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:10:50.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:49 smithi084 ceph-mon[34812]: pgmap v380: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:10:50.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T10:10:51.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:50 smithi050 ceph-mon[30354]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:51.276 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:51.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:50 smithi189 ceph-mon[34999]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:51.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:50 smithi084 ceph-mon[34812]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.912+0000 7f95fbe00640 1 -- 172.21.15.50:0/1433983510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95fc103c50 msgr2=0x7f95fc104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.912+0000 7f95fbe00640 1 --2- 172.21.15.50:0/1433983510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95fc103c50 0x7f95fc104050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009900 tx=0x7f95ec02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:10:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.912+0000 7f95fbe00640 1 -- 172.21.15.50:0/1433983510 shutdown_connections 2024-09-10T10:10:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.912+0000 7f95fbe00640 1 --2- 172.21.15.50:0/1433983510 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95fc105810 0x7f95fc10c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.912+0000 7f95fbe00640 1 --2- 172.21.15.50:0/1433983510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95fc104e50 0x7f95fc1052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.912+0000 7f95fbe00640 1 --2- 172.21.15.50:0/1433983510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95fc103c50 0x7f95fc104050 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:51.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.912+0000 7f95fbe00640 1 -- 172.21.15.50:0/1433983510 >> 172.21.15.50:0/1433983510 conn(0x7f95fc0ff3e0 msgr2=0x7f95fc101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:51.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.912+0000 7f95fbe00640 1 -- 172.21.15.50:0/1433983510 shutdown_connections 2024-09-10T10:10:51.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.912+0000 7f95fbe00640 1 -- 172.21.15.50:0/1433983510 wait complete. 2024-09-10T10:10:51.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.913+0000 7f95fbe00640 1 Processor -- start 2024-09-10T10:10:51.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.913+0000 7f95fbe00640 1 -- start start 2024-09-10T10:10:51.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95fbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95fc103c50 0x7f95fc199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:51.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95fbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95fc104e50 0x7f95fc19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95fbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95fc105810 0x7f95fc1a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95fbe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc10f930 con 0x7f95fc105810 2024-09-10T10:10:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95fbe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc10f7b0 con 0x7f95fc104e50 2024-09-10T10:10:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95fbe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc10fab0 con 0x7f95fc103c50 2024-09-10T10:10:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95fb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95fc105810 0x7f95fc1a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95faa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95fc103c50 0x7f95fc199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95faa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95fc103c50 0x7f95fc199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:59486/0 (socket says 172.21.15.50:59486) 2024-09-10T10:10:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95faa00640 1 -- 172.21.15.50:0/1207492958 learned_addr learned my addr 172.21.15.50:0/1207492958 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95fa000640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95fc104e50 0x7f95fc19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95faa00640 1 -- 172.21.15.50:0/1207492958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95fc104e50 msgr2=0x7f95fc19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95faa00640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95fc104e50 0x7f95fc19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95faa00640 1 -- 172.21.15.50:0/1207492958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95fc105810 msgr2=0x7f95fc1a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:51.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95faa00640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95fc105810 0x7f95fc1a14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95faa00640 1 -- 172.21.15.50:0/1207492958 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95fc1a1b50 con 0x7f95fc103c50 2024-09-10T10:10:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.914+0000 7f95fb400640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95fc105810 0x7f95fc1a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.915+0000 7f95faa00640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95fc103c50 0x7f95fc199f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95ec031440 tx=0x7f95ec032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.915+0000 7f95f3400640 1 -- 172.21.15.50:0/1207492958 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec03f030 con 0x7f95fc103c50 2024-09-10T10:10:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.915+0000 7f95fbe00640 1 -- 172.21.15.50:0/1207492958 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95fc1a1de0 con 0x7f95fc103c50 2024-09-10T10:10:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.915+0000 7f95f3400640 1 -- 172.21.15.50:0/1207492958 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95ec003ce0 con 0x7f95fc103c50 2024-09-10T10:10:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.915+0000 7f95f3400640 1 -- 172.21.15.50:0/1207492958 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec035070 con 0x7f95fc103c50 2024-09-10T10:10:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.915+0000 7f95fbe00640 1 -- 172.21.15.50:0/1207492958 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95fc1a21e0 con 0x7f95fc103c50 2024-09-10T10:10:51.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.916+0000 7f95fbe00640 1 -- 172.21.15.50:0/1207492958 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95fc10b020 con 0x7f95fc103c50 2024-09-10T10:10:51.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.918+0000 7f95f3400640 1 -- 172.21.15.50:0/1207492958 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f95ec042030 con 0x7f95fc103c50 2024-09-10T10:10:51.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.919+0000 7f95f3400640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f95e00a2c40 0x7f95e00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:51.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.920+0000 7f95f3400640 1 -- 172.21.15.50:0/1207492958 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f95ec0efe30 con 0x7f95fc103c50 2024-09-10T10:10:51.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.920+0000 7f95fa000640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f95e00a2c40 0x7f95e00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:51.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.920+0000 7f95fa000640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f95e00a2c40 0x7f95e00a5100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f95fc19b440 tx=0x7f95e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:51.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:51.922+0000 7f95f3400640 1 -- 172.21.15.50:0/1207492958 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95ec0bc1f0 con 0x7f95fc103c50 2024-09-10T10:10:52.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.114+0000 7f95fbe00640 1 -- 172.21.15.50:0/1207492958 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f95fc062630 con 0x7f95e00a2c40 2024-09-10T10:10:52.706 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:51 smithi084 ceph-mon[34812]: pgmap v381: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:10:52.706 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:51 smithi189 ceph-mon[34999]: pgmap v381: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:10:52.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.115+0000 7f95f3400640 1 -- 172.21.15.50:0/1207492958 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f95fc062630 con 0x7f95e00a2c40 2024-09-10T10:10:52.707 INFO:teuthology.orchestra.run.smithi050.stdout:HOST ADDR LABELS STATUS 2024-09-10T10:10:52.707 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050 172.21.15.50 2024-09-10T10:10:52.707 INFO:teuthology.orchestra.run.smithi050.stdout:smithi084 172.21.15.84 2024-09-10T10:10:52.707 INFO:teuthology.orchestra.run.smithi050.stdout:smithi189 172.21.15.189 2024-09-10T10:10:52.707 INFO:teuthology.orchestra.run.smithi050.stdout:3 hosts in cluster 2024-09-10T10:10:52.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.118+0000 7f95fbe00640 1 -- 172.21.15.50:0/1207492958 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f95e00a2c40 msgr2=0x7f95e00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:52.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.118+0000 7f95fbe00640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f95e00a2c40 0x7f95e00a5100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f95fc19b440 tx=0x7f95e8005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:52.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.118+0000 7f95fbe00640 1 -- 172.21.15.50:0/1207492958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95fc103c50 msgr2=0x7f95fc199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:52.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.118+0000 7f95fbe00640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95fc103c50 0x7f95fc199f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95ec031440 tx=0x7f95ec032ce0 comp rx=0 tx=0).stop 2024-09-10T10:10:52.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.118+0000 7f95fbe00640 1 -- 172.21.15.50:0/1207492958 shutdown_connections 2024-09-10T10:10:52.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.118+0000 7f95fbe00640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f95e00a2c40 0x7f95e00a5100 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:52.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.118+0000 7f95fbe00640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95fc105810 0x7f95fc1a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:52.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.118+0000 7f95fbe00640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95fc104e50 0x7f95fc19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:52.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.118+0000 7f95fbe00640 1 --2- 172.21.15.50:0/1207492958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95fc103c50 0x7f95fc199f20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:52.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.118+0000 7f95fbe00640 1 -- 172.21.15.50:0/1207492958 >> 172.21.15.50:0/1207492958 conn(0x7f95fc0ff3e0 msgr2=0x7f95fc1081f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:52.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.118+0000 7f95fbe00640 1 -- 172.21.15.50:0/1207492958 shutdown_connections 2024-09-10T10:10:52.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:52.118+0000 7f95fbe00640 1 -- 172.21.15.50:0/1207492958 wait complete. 2024-09-10T10:10:52.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:51 smithi050 ceph-mon[30354]: pgmap v381: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:10:52.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T10:10:53.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:53 smithi050 ceph-mon[30354]: from='client.25030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:53.216 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:53.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:53 smithi189 ceph-mon[34999]: from='client.25030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:53.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:53 smithi084 ceph-mon[34812]: from='client.25030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:53.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.800+0000 7f5358200640 1 -- 172.21.15.50:0/1664153647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53501015d0 msgr2=0x7f5350101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.800+0000 7f5358200640 1 --2- 172.21.15.50:0/1664153647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53501015d0 0x7f5350101e70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5348009ca0 tx=0x7f534802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.800+0000 7f5358200640 1 -- 172.21.15.50:0/1664153647 shutdown_connections 2024-09-10T10:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.800+0000 7f5358200640 1 --2- 172.21.15.50:0/1664153647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53501015d0 0x7f5350101e70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.800+0000 7f5358200640 1 --2- 172.21.15.50:0/1664153647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5350100c30 0x7f5350101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.800+0000 7f5358200640 1 --2- 172.21.15.50:0/1664153647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f53500ffbb0 0x7f53500fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.800+0000 7f5358200640 1 -- 172.21.15.50:0/1664153647 >> 172.21.15.50:0/1664153647 conn(0x7f53500fb610 msgr2=0x7f53500fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.800+0000 7f5358200640 1 -- 172.21.15.50:0/1664153647 shutdown_connections 2024-09-10T10:10:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.800+0000 7f5358200640 1 -- 172.21.15.50:0/1664153647 wait complete. 2024-09-10T10:10:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.801+0000 7f5358200640 1 Processor -- start 2024-09-10T10:10:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.801+0000 7f5358200640 1 -- start start 2024-09-10T10:10:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5358200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53500ffbb0 0x7f535019a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5358200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5350100c30 0x7f535019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5358200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53501015d0 0x7f53501a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5358200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f535010fa80 con 0x7f53501015d0 2024-09-10T10:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5358200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f535010f900 con 0x7f53500ffbb0 2024-09-10T10:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5358200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f535010fc00 con 0x7f5350100c30 2024-09-10T10:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5355800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53500ffbb0 0x7f535019a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5354e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5350100c30 0x7f535019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5355800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53500ffbb0 0x7f535019a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:51752/0 (socket says 172.21.15.50:51752) 2024-09-10T10:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5355800640 1 -- 172.21.15.50:0/2244120589 learned_addr learned my addr 172.21.15.50:0/2244120589 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5356200640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53501015d0 0x7f53501a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5355800640 1 -- 172.21.15.50:0/2244120589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5350100c30 msgr2=0x7f535019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5355800640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5350100c30 0x7f535019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5355800640 1 -- 172.21.15.50:0/2244120589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53501015d0 msgr2=0x7f53501a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5355800640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53501015d0 0x7f53501a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5355800640 1 -- 172.21.15.50:0/2244120589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53501a1cb0 con 0x7f53500ffbb0 2024-09-10T10:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.802+0000 7f5354e00640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5350100c30 0x7f535019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.803+0000 7f5355800640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53500ffbb0 0x7f535019a080 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f534400e9f0 tx=0x7f534400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.803+0000 7f534e000640 1 -- 172.21.15.50:0/2244120589 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534400cd80 con 0x7f53500ffbb0 2024-09-10T10:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.803+0000 7f534e000640 1 -- 172.21.15.50:0/2244120589 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5344010910 con 0x7f53500ffbb0 2024-09-10T10:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.803+0000 7f534e000640 1 -- 172.21.15.50:0/2244120589 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344018990 con 0x7f53500ffbb0 2024-09-10T10:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.803+0000 7f5358200640 1 -- 172.21.15.50:0/2244120589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53501a1fa0 con 0x7f53500ffbb0 2024-09-10T10:10:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.803+0000 7f5358200640 1 -- 172.21.15.50:0/2244120589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53501a2340 con 0x7f53500ffbb0 2024-09-10T10:10:53.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.804+0000 7f5358200640 1 -- 172.21.15.50:0/2244120589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f535010bf10 con 0x7f53500ffbb0 2024-09-10T10:10:53.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.806+0000 7f534e000640 1 -- 172.21.15.50:0/2244120589 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5344010ac0 con 0x7f53500ffbb0 2024-09-10T10:10:53.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.808+0000 7f534e000640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f53380a2c40 0x7f53380a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:53.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.808+0000 7f534e000640 1 -- 172.21.15.50:0/2244120589 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f53440cfd30 con 0x7f53500ffbb0 2024-09-10T10:10:53.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.808+0000 7f5354e00640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f53380a2c40 0x7f53380a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:53.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.809+0000 7f5354e00640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f53380a2c40 0x7f53380a5100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f535019b5a0 tx=0x7f533c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:53.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:53.810+0000 7f534e000640 1 -- 172.21.15.50:0/2244120589 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f534409c740 con 0x7f53500ffbb0 2024-09-10T10:10:54.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.001+0000 7f5358200640 1 -- 172.21.15.50:0/2244120589 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f5350062630 con 0x7f53380a2c40 2024-09-10T10:10:54.004 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.003+0000 7f534e000640 1 -- 172.21.15.50:0/2244120589 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f5350062630 con 0x7f53380a2c40 2024-09-10T10:10:54.004 INFO:teuthology.orchestra.run.smithi050.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T10:10:54.004 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513001F480DGN 447G No 4m ago Has a FileSystem, LVM detected 2024-09-10T10:10:54.005 INFO:teuthology.orchestra.run.smithi050.stdout:smithi084 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WF400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-10T10:10:54.005 INFO:teuthology.orchestra.run.smithi050.stdout:smithi189 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6232004L400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-10T10:10:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.005+0000 7f5358200640 1 -- 172.21.15.50:0/2244120589 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f53380a2c40 msgr2=0x7f53380a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.005+0000 7f5358200640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f53380a2c40 0x7f53380a5100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f535019b5a0 tx=0x7f533c005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.005+0000 7f5358200640 1 -- 172.21.15.50:0/2244120589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53500ffbb0 msgr2=0x7f535019a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.005+0000 7f5358200640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53500ffbb0 0x7f535019a080 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f534400e9f0 tx=0x7f534400eeb0 comp rx=0 tx=0).stop 2024-09-10T10:10:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.005+0000 7f5358200640 1 -- 172.21.15.50:0/2244120589 shutdown_connections 2024-09-10T10:10:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.005+0000 7f5358200640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f53380a2c40 0x7f53380a5100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.005+0000 7f5358200640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53501015d0 0x7f53501a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.005+0000 7f5358200640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5350100c30 0x7f535019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.005+0000 7f5358200640 1 --2- 172.21.15.50:0/2244120589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53500ffbb0 0x7f535019a080 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:54.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.005+0000 7f5358200640 1 -- 172.21.15.50:0/2244120589 >> 172.21.15.50:0/2244120589 conn(0x7f53500fb610 msgr2=0x7f53500fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:54.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.006+0000 7f5358200640 1 -- 172.21.15.50:0/2244120589 shutdown_connections 2024-09-10T10:10:54.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:54.006+0000 7f5358200640 1 -- 172.21.15.50:0/2244120589 wait complete. 2024-09-10T10:10:54.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:54 smithi189 ceph-mon[34999]: pgmap v382: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:54.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:54 smithi084 ceph-mon[34812]: pgmap v382: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:54.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:54 smithi050 ceph-mon[30354]: pgmap v382: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:10:54.850 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T10:10:54.860 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2024-09-10T10:10:54.860 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T10:10:55.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:55 smithi050 ceph-mon[30354]: from='client.25073 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:55.240 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:55.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:55 smithi189 ceph-mon[34999]: from='client.25073 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:55.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:55 smithi084 ceph-mon[34812]: from='client.25073 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:10:55.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.796+0000 7fe029600640 1 -- 172.21.15.50:0/3709131081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe024103e00 msgr2=0x7fe024104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:55.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.796+0000 7fe029600640 1 --2- 172.21.15.50:0/3709131081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe024103e00 0x7fe024104200 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe014009900 tx=0x7fe01402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:10:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.797+0000 7fe029600640 1 -- 172.21.15.50:0/3709131081 shutdown_connections 2024-09-10T10:10:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.797+0000 7fe029600640 1 --2- 172.21.15.50:0/3709131081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe024105920 0x7fe02410c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.797+0000 7fe029600640 1 --2- 172.21.15.50:0/3709131081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe024104f60 0x7fe0241053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.797+0000 7fe029600640 1 --2- 172.21.15.50:0/3709131081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe024103e00 0x7fe024104200 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.797+0000 7fe029600640 1 -- 172.21.15.50:0/3709131081 >> 172.21.15.50:0/3709131081 conn(0x7fe0240ff5b0 msgr2=0x7fe0241019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.797+0000 7fe029600640 1 -- 172.21.15.50:0/3709131081 shutdown_connections 2024-09-10T10:10:55.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.797+0000 7fe029600640 1 -- 172.21.15.50:0/3709131081 wait complete. 2024-09-10T10:10:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.798+0000 7fe029600640 1 Processor -- start 2024-09-10T10:10:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.798+0000 7fe029600640 1 -- start start 2024-09-10T10:10:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.798+0000 7fe029600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe024103e00 0x7fe02419a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.798+0000 7fe029600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe024104f60 0x7fe02419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.798+0000 7fe029600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe024105920 0x7fe0241a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.798+0000 7fe029600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe02410fa90 con 0x7fe024103e00 2024-09-10T10:10:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.798+0000 7fe029600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe02410f910 con 0x7fe024105920 2024-09-10T10:10:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.798+0000 7fe029600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe02410fc10 con 0x7fe024104f60 2024-09-10T10:10:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.798+0000 7fe023400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe024105920 0x7fe0241a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.799+0000 7fe022000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe024104f60 0x7fe02419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.799+0000 7fe023400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe024105920 0x7fe0241a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:51776/0 (socket says 172.21.15.50:51776) 2024-09-10T10:10:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.799+0000 7fe023400640 1 -- 172.21.15.50:0/2648662592 learned_addr learned my addr 172.21.15.50:0/2648662592 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:55.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.799+0000 7fe022a00640 1 --2- 172.21.15.50:0/2648662592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe024103e00 0x7fe02419a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.799+0000 7fe023400640 1 -- 172.21.15.50:0/2648662592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe024104f60 msgr2=0x7fe02419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.799+0000 7fe023400640 1 --2- 172.21.15.50:0/2648662592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe024104f60 0x7fe02419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.799+0000 7fe023400640 1 -- 172.21.15.50:0/2648662592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe024103e00 msgr2=0x7fe02419a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.799+0000 7fe023400640 1 --2- 172.21.15.50:0/2648662592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe024103e00 0x7fe02419a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.799+0000 7fe023400640 1 -- 172.21.15.50:0/2648662592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0241a1d10 con 0x7fe024105920 2024-09-10T10:10:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.799+0000 7fe023400640 1 --2- 172.21.15.50:0/2648662592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe024105920 0x7fe0241a16a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00eb10 tx=0x7fe01c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.799+0000 7fe01b400640 1 -- 172.21.15.50:0/2648662592 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c004b20 con 0x7fe024105920 2024-09-10T10:10:55.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.800+0000 7fe01b400640 1 -- 172.21.15.50:0/2648662592 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe01c004cc0 con 0x7fe024105920 2024-09-10T10:10:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.800+0000 7fe029600640 1 -- 172.21.15.50:0/2648662592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0241a1fa0 con 0x7fe024105920 2024-09-10T10:10:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.800+0000 7fe01b400640 1 -- 172.21.15.50:0/2648662592 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c010760 con 0x7fe024105920 2024-09-10T10:10:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.800+0000 7fe029600640 1 -- 172.21.15.50:0/2648662592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0241a24b0 con 0x7fe024105920 2024-09-10T10:10:55.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.801+0000 7fe029600640 1 -- 172.21.15.50:0/2648662592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe02410b1a0 con 0x7fe024105920 2024-09-10T10:10:55.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.803+0000 7fe01b400640 1 -- 172.21.15.50:0/2648662592 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe01c044b60 con 0x7fe024105920 2024-09-10T10:10:55.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.804+0000 7fe01b400640 1 --2- 172.21.15.50:0/2648662592 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe0080a2cc0 0x7fe0080a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:55.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.804+0000 7fe01b400640 1 -- 172.21.15.50:0/2648662592 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe01c0cfac0 con 0x7fe024105920 2024-09-10T10:10:55.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.804+0000 7fe022a00640 1 --2- 172.21.15.50:0/2648662592 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe0080a2cc0 0x7fe0080a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:55.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.805+0000 7fe022a00640 1 --2- 172.21.15.50:0/2648662592 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe0080a2cc0 0x7fe0080a5180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe0140314e0 tx=0x7fe014000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:55.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:55.806+0000 7fe01b400640 1 -- 172.21.15.50:0/2648662592 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe01c09c4d0 con 0x7fe024105920 2024-09-10T10:10:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.027+0000 7fe029600640 1 -- 172.21.15.50:0/2648662592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe02402d7c0 con 0x7fe024105920 2024-09-10T10:10:56.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.028+0000 7fe01b400640 1 -- 172.21.15.50:0/2648662592 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3088 (secure 0 0 0) 0x7fe01c09bdd0 con 0x7fe024105920 2024-09-10T10:10:56.030 INFO:teuthology.orchestra.run.smithi050.stdout:e24 2024-09-10T10:10:56.030 INFO:teuthology.orchestra.run.smithi050.stdout:btime 2024-09-10T10:09:28:538200+0000 2024-09-10T10:10:56.030 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:10:56.030 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T10:10:56.030 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2024-09-10T10:10:56.030 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:10:56.030 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:10:56.030 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2024-09-10T10:10:56.030 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 24 2024-09-10T10:10:56.031 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:10:56.031 INFO:teuthology.orchestra.run.smithi050.stdout:created 2024-09-10T10:08:36.316040+0000 2024-09-10T10:10:56.031 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2024-09-10T10:09:28.424047+0000 2024-09-10T10:10:56.031 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2024-09-10T10:10:56.031 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2024-09-10T10:10:56.031 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 300 2024-09-10T10:10:56.031 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2024-09-10T10:10:56.031 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2024-09-10T10:10:56.031 INFO:teuthology.orchestra.run.smithi050.stdout:max_xattr_size 65536 2024-09-10T10:10:56.031 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2024-09-10T10:10:56.031 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2024-09-10T10:10:56.031 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2024-09-10T10:10:56.031 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T10:10:56.032 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 3 2024-09-10T10:10:56.032 INFO:teuthology.orchestra.run.smithi050.stdout:in 0,1,2 2024-09-10T10:10:56.032 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=24560,1=24521,2=24517} 2024-09-10T10:10:56.032 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2024-09-10T10:10:56.032 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2024-09-10T10:10:56.032 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2024-09-10T10:10:56.032 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3,4] 2024-09-10T10:10:56.032 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2024-09-10T10:10:56.032 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data disabled 2024-09-10T10:10:56.032 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2024-09-10T10:10:56.032 INFO:teuthology.orchestra.run.smithi050.stdout:bal_rank_mask -1 2024-09-10T10:10:56.032 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 0 2024-09-10T10:10:56.032 INFO:teuthology.orchestra.run.smithi050.stdout:qdb_cluster leader: 24560 members: 24517,24521,24560 2024-09-10T10:10:56.033 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b{0:24560} state up:active seq 5 addr [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:10:56.033 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c{0:24499} state up:standby-replay seq 1 addr [v2:172.21.15.189:6836/251140305,v1:172.21.15.189:6837/251140305] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:10:56.033 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.h{1:24521} state up:active seq 20 addr [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:10:56.033 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.e{1:24494} state up:standby-replay seq 1 addr [v2:172.21.15.84:6834/1698924277,v1:172.21.15.84:6835/1698924277] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:10:56.033 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.i{2:24517} state up:active seq 20 addr [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:10:56.033 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.f{2:24493} state up:standby-replay seq 1 addr [v2:172.21.15.189:6834/1101442212,v1:172.21.15.189:6835/1101442212] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:10:56.033 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:10:56.033 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:10:56.033 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2024-09-10T10:10:56.033 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:10:56.033 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.j{-1:14439} state up:standby seq 1 addr [v2:172.21.15.50:6834/3271446428,v1:172.21.15.50:6835/3271446428] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:10:56.033 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d{-1:14451} state up:standby seq 1 addr [v2:172.21.15.50:6836/206120468,v1:172.21.15.50:6837/206120468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:10:56.033 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.g{-1:14484} state up:standby seq 1 addr [v2:172.21.15.50:6838/1454697649,v1:172.21.15.50:6839/1454697649] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:10:56.034 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a{-1:14496} state up:standby seq 1 addr [v2:172.21.15.50:6840/1041312964,v1:172.21.15.50:6841/1041312964] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:10:56.034 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.l{-1:24448} state up:standby seq 1 addr [v2:172.21.15.189:6832/3692905441,v1:172.21.15.189:6833/3692905441] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:10:56.034 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.k{-1:24458} state up:standby seq 1 addr [v2:172.21.15.84:6832/4243926452,v1:172.21.15.84:6833/4243926452] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:10:56.034 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2024-09-10T10:10:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.032+0000 7fe029600640 1 -- 172.21.15.50:0/2648662592 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe0080a2cc0 msgr2=0x7fe0080a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.032+0000 7fe029600640 1 --2- 172.21.15.50:0/2648662592 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe0080a2cc0 0x7fe0080a5180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe0140314e0 tx=0x7fe014000bc0 comp rx=0 tx=0).stop 2024-09-10T10:10:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.032+0000 7fe029600640 1 -- 172.21.15.50:0/2648662592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe024105920 msgr2=0x7fe0241a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.032+0000 7fe029600640 1 --2- 172.21.15.50:0/2648662592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe024105920 0x7fe0241a16a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00eb10 tx=0x7fe01c00c2d0 comp rx=0 tx=0).stop 2024-09-10T10:10:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.032+0000 7fe029600640 1 -- 172.21.15.50:0/2648662592 shutdown_connections 2024-09-10T10:10:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.032+0000 7fe029600640 1 --2- 172.21.15.50:0/2648662592 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe0080a2cc0 0x7fe0080a5180 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.032+0000 7fe029600640 1 --2- 172.21.15.50:0/2648662592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe024105920 0x7fe0241a16a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.032+0000 7fe029600640 1 --2- 172.21.15.50:0/2648662592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe024104f60 0x7fe02419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.032+0000 7fe029600640 1 --2- 172.21.15.50:0/2648662592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe024103e00 0x7fe02419a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.032+0000 7fe029600640 1 -- 172.21.15.50:0/2648662592 >> 172.21.15.50:0/2648662592 conn(0x7fe0240ff5b0 msgr2=0x7fe024108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.032+0000 7fe029600640 1 -- 172.21.15.50:0/2648662592 shutdown_connections 2024-09-10T10:10:56.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:56.032+0000 7fe029600640 1 -- 172.21.15.50:0/2648662592 wait complete. 2024-09-10T10:10:56.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:56 smithi189 ceph-mon[34999]: pgmap v383: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:10:56.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:56 smithi084 ceph-mon[34812]: pgmap v383: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:10:56.385 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:56 smithi050 ceph-mon[30354]: pgmap v383: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:10:56.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T10:10:57.082 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:57.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:57 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2648662592' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:10:57.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:57 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2648662592' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:10:57.378 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:57 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2648662592' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:10:57.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.630+0000 7f8c6a000640 1 -- 172.21.15.50:0/2437938761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c64101c00 msgr2=0x7f8c64102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:57.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.630+0000 7f8c6a000640 1 --2- 172.21.15.50:0/2437938761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c64101c00 0x7f8c64102000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009900 tx=0x7f8c5402a400 comp rx=0 tx=0).stop 2024-09-10T10:10:57.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.630+0000 7f8c6a000640 1 -- 172.21.15.50:0/2437938761 shutdown_connections 2024-09-10T10:10:57.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.630+0000 7f8c6a000640 1 --2- 172.21.15.50:0/2437938761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c641037c0 0x7f8c6410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:57.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.630+0000 7f8c6a000640 1 --2- 172.21.15.50:0/2437938761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c64102e00 0x7f8c64103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:57.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.630+0000 7f8c6a000640 1 --2- 172.21.15.50:0/2437938761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c64101c00 0x7f8c64102000 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:57.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.630+0000 7f8c6a000640 1 -- 172.21.15.50:0/2437938761 >> 172.21.15.50:0/2437938761 conn(0x7f8c640fd390 msgr2=0x7f8c640ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:57.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.630+0000 7f8c6a000640 1 -- 172.21.15.50:0/2437938761 shutdown_connections 2024-09-10T10:10:57.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.630+0000 7f8c6a000640 1 -- 172.21.15.50:0/2437938761 wait complete. 2024-09-10T10:10:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.631+0000 7f8c6a000640 1 Processor -- start 2024-09-10T10:10:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.631+0000 7f8c6a000640 1 -- start start 2024-09-10T10:10:57.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.632+0000 7f8c6a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c64101c00 0x7f8c6419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.632+0000 7f8c6a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c64102e00 0x7f8c6419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.632+0000 7f8c6a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c641037c0 0x7f8c641a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.632+0000 7f8c6a000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6410d8e0 con 0x7f8c64101c00 2024-09-10T10:10:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.632+0000 7f8c6a000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6410d760 con 0x7f8c641037c0 2024-09-10T10:10:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.632+0000 7f8c6a000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6410da60 con 0x7f8c64102e00 2024-09-10T10:10:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.632+0000 7f8c62a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c64102e00 0x7f8c6419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.632+0000 7f8c62a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c64102e00 0x7f8c6419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:43736/0 (socket says 172.21.15.50:43736) 2024-09-10T10:10:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.632+0000 7f8c62a00640 1 -- 172.21.15.50:0/2618373882 learned_addr learned my addr 172.21.15.50:0/2618373882 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.632+0000 7f8c63400640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c64101c00 0x7f8c6419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:57.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.632+0000 7f8c63e00640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c641037c0 0x7f8c641a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.633+0000 7f8c62a00640 1 -- 172.21.15.50:0/2618373882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c641037c0 msgr2=0x7f8c641a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.633+0000 7f8c62a00640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c641037c0 0x7f8c641a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.633+0000 7f8c62a00640 1 -- 172.21.15.50:0/2618373882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c64101c00 msgr2=0x7f8c6419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.633+0000 7f8c62a00640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c64101c00 0x7f8c6419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.633+0000 7f8c62a00640 1 -- 172.21.15.50:0/2618373882 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c641a1d30 con 0x7f8c64102e00 2024-09-10T10:10:57.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.633+0000 7f8c63400640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c64101c00 0x7f8c6419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:10:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.633+0000 7f8c62a00640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c64102e00 0x7f8c6419a640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000e9f0 tx=0x7f8c5000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.633+0000 7f8c5be00640 1 -- 172.21.15.50:0/2618373882 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5000cd80 con 0x7f8c64102e00 2024-09-10T10:10:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.633+0000 7f8c6a000640 1 -- 172.21.15.50:0/2618373882 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c641a1fc0 con 0x7f8c64102e00 2024-09-10T10:10:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.633+0000 7f8c5be00640 1 -- 172.21.15.50:0/2618373882 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c50010910 con 0x7f8c64102e00 2024-09-10T10:10:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.633+0000 7f8c5be00640 1 -- 172.21.15.50:0/2618373882 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c500188f0 con 0x7f8c64102e00 2024-09-10T10:10:57.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.633+0000 7f8c6a000640 1 -- 172.21.15.50:0/2618373882 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c641a2520 con 0x7f8c64102e00 2024-09-10T10:10:57.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.634+0000 7f8c6a000640 1 -- 172.21.15.50:0/2618373882 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c641a2750 con 0x7f8c64102e00 2024-09-10T10:10:57.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.637+0000 7f8c5be00640 1 -- 172.21.15.50:0/2618373882 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8c50010ac0 con 0x7f8c64102e00 2024-09-10T10:10:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.638+0000 7f8c5be00640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8c480a2cc0 0x7f8c480a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.639+0000 7f8c5be00640 1 -- 172.21.15.50:0/2618373882 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f8c500cfc00 con 0x7f8c64102e00 2024-09-10T10:10:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.639+0000 7f8c63400640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8c480a2cc0 0x7f8c480a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:57.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.639+0000 7f8c63400640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8c480a2cc0 0x7f8c480a5180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8c5402a9f0 tx=0x7f8c540315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:57.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.640+0000 7f8c5be00640 1 -- 172.21.15.50:0/2618373882 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8c5009bfc0 con 0x7f8c64102e00 2024-09-10T10:10:57.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.824+0000 7f8c6a000640 1 -- 172.21.15.50:0/2618373882 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f8c641a2920 con 0x7f8c64102e00 2024-09-10T10:10:57.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.825+0000 7f8c5be00640 1 -- 172.21.15.50:0/2618373882 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v95) ==== 56+0+5632 (secure 0 0 0) 0x7f8c500a02c0 con 0x7f8c64102e00 2024-09-10T10:10:57.826 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 95 2024-09-10T10:10:57.827 INFO:teuthology.orchestra.run.smithi050.stdout:fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:10:57.827 INFO:teuthology.orchestra.run.smithi050.stdout:created 2024-09-10T10:00:05.600019+0000 2024-09-10T10:10:57.827 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2024-09-10T10:10:00.717554+0000 2024-09-10T10:10:57.827 INFO:teuthology.orchestra.run.smithi050.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T10:10:57.827 INFO:teuthology.orchestra.run.smithi050.stdout:crush_version 27 2024-09-10T10:10:57.827 INFO:teuthology.orchestra.run.smithi050.stdout:full_ratio 0.95 2024-09-10T10:10:57.827 INFO:teuthology.orchestra.run.smithi050.stdout:backfillfull_ratio 0.9 2024-09-10T10:10:57.827 INFO:teuthology.orchestra.run.smithi050.stdout:nearfull_ratio 0.85 2024-09-10T10:10:57.827 INFO:teuthology.orchestra.run.smithi050.stdout:require_min_compat_client luminous 2024-09-10T10:10:57.827 INFO:teuthology.orchestra.run.smithi050.stdout:min_compat_client luminous 2024-09-10T10:10:57.827 INFO:teuthology.orchestra.run.smithi050.stdout:require_osd_release squid 2024-09-10T10:10:57.827 INFO:teuthology.orchestra.run.smithi050.stdout:stretch_mode_enabled false 2024-09-10T10:10:57.828 INFO:teuthology.orchestra.run.smithi050.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T10:10:57.828 INFO:teuthology.orchestra.run.smithi050.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-10T10:10:57.828 INFO:teuthology.orchestra.run.smithi050.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-10T10:10:57.828 INFO:teuthology.orchestra.run.smithi050.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 91 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-10T10:10:57.828 INFO:teuthology.orchestra.run.smithi050.stdout:max_osd 12 2024-09-10T10:10:57.828 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6802/386458864,v1:172.21.15.50:6803/386458864] [v2:172.21.15.50:6804/386458864,v1:172.21.15.50:6805/386458864] exists,up 3afef902-c68c-43dc-bc50-62848d35dcc9 2024-09-10T10:10:57.828 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 up in weight 1 up_from 13 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6800/139119620,v1:172.21.15.84:6801/139119620] [v2:172.21.15.84:6802/139119620,v1:172.21.15.84:6803/139119620] exists,up 30da8eb4-6117-4e2c-8dbb-b0da47d30752 2024-09-10T10:10:57.828 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 up in weight 1 up_from 18 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6800/3611073908,v1:172.21.15.189:6801/3611073908] [v2:172.21.15.189:6802/3611073908,v1:172.21.15.189:6803/3611073908] exists,up bf7e7da7-c81c-420d-884d-ea22de897b36 2024-09-10T10:10:57.828 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 up in weight 1 up_from 26 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6810/3341598052,v1:172.21.15.50:6811/3341598052] [v2:172.21.15.50:6812/3341598052,v1:172.21.15.50:6813/3341598052] exists,up e018ffaa-703d-4b65-81d4-0b673271ec13 2024-09-10T10:10:57.828 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 up in weight 1 up_from 34 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6808/361197029,v1:172.21.15.84:6809/361197029] [v2:172.21.15.84:6810/361197029,v1:172.21.15.84:6811/361197029] exists,up e47aaa2b-af6f-495e-a0db-d15709cd9d39 2024-09-10T10:10:57.828 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 up in weight 1 up_from 39 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6808/2921666386,v1:172.21.15.189:6809/2921666386] [v2:172.21.15.189:6810/2921666386,v1:172.21.15.189:6811/2921666386] exists,up 8272a0aa-9784-4815-87cc-971b69d9fafd 2024-09-10T10:10:57.828 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6 up in weight 1 up_from 47 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6818/335559869,v1:172.21.15.50:6819/335559869] [v2:172.21.15.50:6820/335559869,v1:172.21.15.50:6821/335559869] exists,up 637fff8d-4b45-4311-871f-c367b574351f 2024-09-10T10:10:57.829 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7 up in weight 1 up_from 52 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6816/3709749103,v1:172.21.15.84:6817/3709749103] [v2:172.21.15.84:6818/3709749103,v1:172.21.15.84:6819/3709749103] exists,up 0fcce770-960b-49a6-9e44-a7acf157afc0 2024-09-10T10:10:57.829 INFO:teuthology.orchestra.run.smithi050.stdout:osd.8 up in weight 1 up_from 59 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6816/2053233762,v1:172.21.15.189:6817/2053233762] [v2:172.21.15.189:6818/2053233762,v1:172.21.15.189:6819/2053233762] exists,up a23d1843-1228-44ab-af7b-209c433b38dd 2024-09-10T10:10:57.829 INFO:teuthology.orchestra.run.smithi050.stdout:osd.9 up in weight 1 up_from 66 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6826/471324226,v1:172.21.15.50:6827/471324226] [v2:172.21.15.50:6828/471324226,v1:172.21.15.50:6829/471324226] exists,up b80673a0-7727-4303-894e-9d056dfd45b4 2024-09-10T10:10:57.829 INFO:teuthology.orchestra.run.smithi050.stdout:osd.10 up in weight 1 up_from 71 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6824/1222120613,v1:172.21.15.84:6825/1222120613] [v2:172.21.15.84:6826/1222120613,v1:172.21.15.84:6827/1222120613] exists,up f0e5ac95-60a0-4425-b069-1c87439d05bc 2024-09-10T10:10:57.829 INFO:teuthology.orchestra.run.smithi050.stdout:osd.11 up in weight 1 up_from 78 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6824/2433594841,v1:172.21.15.189:6825/2433594841] [v2:172.21.15.189:6826/2433594841,v1:172.21.15.189:6827/2433594841] exists,up 613818bd-4319-4c6f-b3a9-2e034bfe1d5c 2024-09-10T10:10:57.829 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 2.8 [2,11] 2024-09-10T10:10:57.829 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 2.f [8,11] 2024-09-10T10:10:57.829 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.2 [3,9] 2024-09-10T10:10:57.829 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.11 [4,7] 2024-09-10T10:10:57.829 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.14 [4,6] 2024-09-10T10:10:57.829 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.1e [3,9] 2024-09-10T10:10:57.829 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.24 [4,9] 2024-09-10T10:10:57.830 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.28 [5,8] 2024-09-10T10:10:57.830 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 4.2 [9,1] 2024-09-10T10:10:57.830 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 4.18 [9,8] 2024-09-10T10:10:57.830 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 4.1b [5,10] 2024-09-10T10:10:57.830 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 4.1f [9,8] 2024-09-10T10:10:57.830 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6801/2344357525 expires 2024-09-11T10:00:58.655297+0000 2024-09-10T10:10:57.830 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6800/2344357525 expires 2024-09-11T10:00:58.655297+0000 2024-09-10T10:10:57.830 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/3762668389 expires 2024-09-11T10:00:58.655297+0000 2024-09-10T10:10:57.830 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/3709959859 expires 2024-09-11T10:00:58.655297+0000 2024-09-10T10:10:57.830 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/3594719218 expires 2024-09-11T10:00:30.124281+0000 2024-09-10T10:10:57.830 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/2396848832 expires 2024-09-11T10:00:30.124281+0000 2024-09-10T10:10:57.830 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/1220276123 expires 2024-09-11T10:00:30.124281+0000 2024-09-10T10:10:57.830 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/2312780179 expires 2024-09-11T10:00:58.655297+0000 2024-09-10T10:10:57.831 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6801/3083035719 expires 2024-09-11T10:00:30.124281+0000 2024-09-10T10:10:57.831 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6800/3083035719 expires 2024-09-11T10:00:30.124281+0000 2024-09-10T10:10:57.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.827+0000 7f8c6a000640 1 -- 172.21.15.50:0/2618373882 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8c480a2cc0 msgr2=0x7f8c480a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:57.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.827+0000 7f8c6a000640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8c480a2cc0 0x7f8c480a5180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8c5402a9f0 tx=0x7f8c540315b0 comp rx=0 tx=0).stop 2024-09-10T10:10:57.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.827+0000 7f8c6a000640 1 -- 172.21.15.50:0/2618373882 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c64102e00 msgr2=0x7f8c6419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:57.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.827+0000 7f8c6a000640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c64102e00 0x7f8c6419a640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000e9f0 tx=0x7f8c5000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:10:57.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.827+0000 7f8c6a000640 1 -- 172.21.15.50:0/2618373882 shutdown_connections 2024-09-10T10:10:57.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.827+0000 7f8c6a000640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8c480a2cc0 0x7f8c480a5180 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:57.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.827+0000 7f8c6a000640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c641037c0 0x7f8c641a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:57.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.827+0000 7f8c6a000640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c64102e00 0x7f8c6419a640 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:57.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.827+0000 7f8c6a000640 1 --2- 172.21.15.50:0/2618373882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c64101c00 0x7f8c6419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:57.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.827+0000 7f8c6a000640 1 -- 172.21.15.50:0/2618373882 >> 172.21.15.50:0/2618373882 conn(0x7f8c640fd390 msgr2=0x7f8c64074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:57.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.827+0000 7f8c6a000640 1 -- 172.21.15.50:0/2618373882 shutdown_connections 2024-09-10T10:10:57.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:57.827+0000 7f8c6a000640 1 -- 172.21.15.50:0/2618373882 wait complete. 2024-09-10T10:10:58.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:58 smithi189 ceph-mon[34999]: pgmap v384: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:10:58.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:10:58 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2618373882' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T10:10:58.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:58 smithi084 ceph-mon[34812]: pgmap v384: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:10:58.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:10:58 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2618373882' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T10:10:58.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:58 smithi050 ceph-mon[30354]: pgmap v384: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:10:58.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:10:58 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2618373882' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T10:10:58.585 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T10:10:58.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:10:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:10:59.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.598+0000 7f96e0200640 1 -- 172.21.15.50:0/3711623954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d8109120 msgr2=0x7f96d8110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:59.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.598+0000 7f96e0200640 1 --2- 172.21.15.50:0/3711623954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d8109120 0x7f96d8110ca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009ca0 tx=0x7f96d002a8b0 comp rx=0 tx=0).stop 2024-09-10T10:10:59.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.598+0000 7f96e0200640 1 -- 172.21.15.50:0/3711623954 shutdown_connections 2024-09-10T10:10:59.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.598+0000 7f96e0200640 1 --2- 172.21.15.50:0/3711623954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d8109120 0x7f96d8110ca0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:59.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.598+0000 7f96e0200640 1 --2- 172.21.15.50:0/3711623954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d81049a0 0x7f96d81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:59.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.598+0000 7f96e0200640 1 --2- 172.21.15.50:0/3711623954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d8103ff0 0x7f96d81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:59.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.598+0000 7f96e0200640 1 -- 172.21.15.50:0/3711623954 >> 172.21.15.50:0/3711623954 conn(0x7f96d80ffa90 msgr2=0x7f96d8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:59.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.598+0000 7f96e0200640 1 -- 172.21.15.50:0/3711623954 shutdown_connections 2024-09-10T10:10:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.598+0000 7f96e0200640 1 -- 172.21.15.50:0/3711623954 wait complete. 2024-09-10T10:10:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.599+0000 7f96e0200640 1 Processor -- start 2024-09-10T10:10:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.599+0000 7f96e0200640 1 -- start start 2024-09-10T10:10:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.599+0000 7f96e0200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d8103ff0 0x7f96d819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.599+0000 7f96e0200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d81049a0 0x7f96d819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.599+0000 7f96e0200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d8109120 0x7f96d819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.599+0000 7f96e0200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96d8114130 con 0x7f96d8103ff0 2024-09-10T10:10:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.599+0000 7f96e0200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f96d8113fb0 con 0x7f96d81049a0 2024-09-10T10:10:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.599+0000 7f96e0200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96d81142b0 con 0x7f96d8109120 2024-09-10T10:10:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.600+0000 7f96dd800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d8103ff0 0x7f96d819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.600+0000 7f96de200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d8109120 0x7f96d819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:59.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.600+0000 7f96dd800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d8103ff0 0x7f96d819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40212/0 (socket says 172.21.15.50:40212) 2024-09-10T10:10:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.600+0000 7f96dd800640 1 -- 172.21.15.50:0/2828911661 learned_addr learned my addr 172.21.15.50:0/2828911661 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:10:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.600+0000 7f96dce00640 1 --2- 172.21.15.50:0/2828911661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d81049a0 0x7f96d819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.600+0000 7f96dd800640 1 -- 172.21.15.50:0/2828911661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d8109120 msgr2=0x7f96d819ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.600+0000 7f96dd800640 1 --2- 172.21.15.50:0/2828911661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d8109120 0x7f96d819ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.600+0000 7f96dd800640 1 -- 172.21.15.50:0/2828911661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d81049a0 msgr2=0x7f96d819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.600+0000 7f96dd800640 1 --2- 172.21.15.50:0/2828911661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d81049a0 0x7f96d819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.600+0000 7f96dd800640 1 -- 172.21.15.50:0/2828911661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d819f540 con 0x7f96d8103ff0 2024-09-10T10:10:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.600+0000 7f96dd800640 1 --2- 172.21.15.50:0/2828911661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d8103ff0 0x7f96d819a590 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00ea60 tx=0x7f96cc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.600+0000 7f96d6000640 1 -- 172.21.15.50:0/2828911661 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc00cde0 con 0x7f96d8103ff0 2024-09-10T10:10:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.601+0000 7f96d6000640 1 -- 172.21.15.50:0/2828911661 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96cc0035f0 con 0x7f96d8103ff0 2024-09-10T10:10:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.601+0000 7f96e0200640 1 -- 172.21.15.50:0/2828911661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d819f830 con 0x7f96d8103ff0 2024-09-10T10:10:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.601+0000 7f96d6000640 1 -- 172.21.15.50:0/2828911661 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc010670 con 0x7f96d8103ff0 2024-09-10T10:10:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.601+0000 7f96e0200640 1 -- 172.21.15.50:0/2828911661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d81a7110 con 0x7f96d8103ff0 2024-09-10T10:10:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.602+0000 7f96e0200640 1 -- 172.21.15.50:0/2828911661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d81043d0 con 0x7f96d8103ff0 2024-09-10T10:10:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.604+0000 7f96d6000640 1 -- 172.21.15.50:0/2828911661 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f96cc0037a0 con 0x7f96d8103ff0 2024-09-10T10:10:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.605+0000 7f96d6000640 1 --2- 172.21.15.50:0/2828911661 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f96c00a2c00 0x7f96c00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:10:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.605+0000 7f96d6000640 1 -- 172.21.15.50:0/2828911661 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f96cc0cf670 con 0x7f96d8103ff0 2024-09-10T10:10:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.605+0000 7f96dce00640 1 --2- 172.21.15.50:0/2828911661 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f96c00a2c00 0x7f96c00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:10:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.606+0000 7f96dce00640 1 --2- 172.21.15.50:0/2828911661 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f96c00a2c00 0x7f96c00a50c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f96d810aa90 tx=0x7f96c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:10:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.609+0000 7f96d6000640 1 -- 172.21.15.50:0/2828911661 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96cc09c1e0 con 0x7f96d8103ff0 2024-09-10T10:10:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.830+0000 7f96e0200640 1 -- 172.21.15.50:0/2828911661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96d819b8f0 con 0x7f96d8103ff0 2024-09-10T10:10:59.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.831+0000 7f96d6000640 1 -- 172.21.15.50:0/2828911661 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11912 (secure 0 0 0) 0x7f96cc09bae0 con 0x7f96d8103ff0 2024-09-10T10:10:59.833 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:10:59.833 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"btime":"2024-09-10T10:09:28:538200+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:09:28.424047+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24517,24521,24560]},"id":1}]} 2024-09-10T10:10:59.833 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2024-09-10T10:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.834+0000 7f96e0200640 1 -- 172.21.15.50:0/2828911661 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f96c00a2c00 msgr2=0x7f96c00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.834+0000 7f96e0200640 1 --2- 172.21.15.50:0/2828911661 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f96c00a2c00 0x7f96c00a50c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f96d810aa90 tx=0x7f96c4005f90 comp rx=0 tx=0).stop 2024-09-10T10:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.834+0000 7f96e0200640 1 -- 172.21.15.50:0/2828911661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d8103ff0 msgr2=0x7f96d819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.834+0000 7f96e0200640 1 --2- 172.21.15.50:0/2828911661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d8103ff0 0x7f96d819a590 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00ea60 tx=0x7f96cc00ef20 comp rx=0 tx=0).stop 2024-09-10T10:10:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.834+0000 7f96e0200640 1 -- 172.21.15.50:0/2828911661 shutdown_connections 2024-09-10T10:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.834+0000 7f96e0200640 1 --2- 172.21.15.50:0/2828911661 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f96c00a2c00 0x7f96c00a50c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.834+0000 7f96e0200640 1 --2- 172.21.15.50:0/2828911661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f96d8109120 0x7f96d819ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.834+0000 7f96e0200640 1 --2- 172.21.15.50:0/2828911661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d81049a0 0x7f96d819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.834+0000 7f96e0200640 1 --2- 172.21.15.50:0/2828911661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d8103ff0 0x7f96d819a590 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.834+0000 7f96e0200640 1 -- 172.21.15.50:0/2828911661 >> 172.21.15.50:0/2828911661 conn(0x7f96d80ffa90 msgr2=0x7f96d8101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.834+0000 7f96e0200640 1 -- 172.21.15.50:0/2828911661 shutdown_connections 2024-09-10T10:10:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:10:59.834+0000 7f96e0200640 1 -- 172.21.15.50:0/2828911661 wait complete. 2024-09-10T10:11:00.182 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:00 smithi050 ceph-mon[30354]: pgmap v385: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:11:00.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:00 smithi050 ceph-mon[30354]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-10T10:11:00.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:00 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2828911661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:00.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:00 smithi189 ceph-mon[34999]: pgmap v385: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:11:00.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:00 smithi189 ceph-mon[34999]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-10T10:11:00.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:00 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2828911661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:00 smithi084 ceph-mon[34812]: pgmap v385: 129 pgs: 129 active+clean; 642 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:11:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:00 smithi084 ceph-mon[34812]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-10T10:11:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:00 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2828911661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:00.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:11:00.949 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.548+0000 7f0b84600640 1 -- 172.21.15.50:0/90429297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b7c109140 msgr2=0x7f0b7c110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.548+0000 7f0b84600640 1 --2- 172.21.15.50:0/90429297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b7c109140 0x7f0b7c110cc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009ca0 tx=0x7f0b7402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.548+0000 7f0b84600640 1 -- 172.21.15.50:0/90429297 shutdown_connections 2024-09-10T10:11:01.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.548+0000 7f0b84600640 1 --2- 172.21.15.50:0/90429297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b7c109140 0x7f0b7c110cc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.548+0000 7f0b84600640 1 --2- 172.21.15.50:0/90429297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c1049c0 0x7f0b7c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.548+0000 7f0b84600640 1 --2- 172.21.15.50:0/90429297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b7c104010 0x7f0b7c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.548+0000 7f0b84600640 1 -- 172.21.15.50:0/90429297 >> 172.21.15.50:0/90429297 conn(0x7f0b7c0ffa50 msgr2=0x7f0b7c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:01.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.548+0000 7f0b84600640 1 -- 172.21.15.50:0/90429297 shutdown_connections 2024-09-10T10:11:01.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.548+0000 7f0b84600640 1 -- 172.21.15.50:0/90429297 wait complete. 2024-09-10T10:11:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.549+0000 7f0b84600640 1 Processor -- start 2024-09-10T10:11:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.549+0000 7f0b84600640 1 -- start start 2024-09-10T10:11:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b84600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b7c104010 0x7f0b7c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b84600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b7c1049c0 0x7f0b7c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b84600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c109140 0x7f0b7c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b84600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c114170 con 0x7f0b7c1049c0 2024-09-10T10:11:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b84600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c113ff0 con 0x7f0b7c109140 2024-09-10T10:11:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b84600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c1142f0 con 0x7f0b7c104010 2024-09-10T10:11:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b81c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b7c104010 0x7f0b7c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b81c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b7c104010 0x7f0b7c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:43766/0 (socket says 172.21.15.50:43766) 2024-09-10T10:11:01.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b81c00640 1 -- 172.21.15.50:0/2319235913 learned_addr learned my addr 172.21.15.50:0/2319235913 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b82600640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c109140 0x7f0b7c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b81200640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b7c1049c0 0x7f0b7c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b81c00640 1 -- 172.21.15.50:0/2319235913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c109140 msgr2=0x7f0b7c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b81c00640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c109140 0x7f0b7c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b81c00640 1 -- 172.21.15.50:0/2319235913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b7c1049c0 msgr2=0x7f0b7c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b81c00640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b7c1049c0 0x7f0b7c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.550+0000 7f0b81c00640 1 -- 172.21.15.50:0/2319235913 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c19f5c0 con 0x7f0b7c104010 2024-09-10T10:11:01.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.551+0000 7f0b81c00640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b7c104010 0x7f0b7c19a610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000e9f0 tx=0x7f0b7000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:01.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.551+0000 7f0b7a000640 1 -- 172.21.15.50:0/2319235913 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7000cd80 con 0x7f0b7c104010 2024-09-10T10:11:01.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.551+0000 7f0b84600640 1 -- 172.21.15.50:0/2319235913 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7c19f8b0 con 0x7f0b7c104010 2024-09-10T10:11:01.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.551+0000 7f0b7a000640 1 -- 172.21.15.50:0/2319235913 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b70005500 con 0x7f0b7c104010 2024-09-10T10:11:01.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.551+0000 7f0b7a000640 1 -- 172.21.15.50:0/2319235913 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70010690 con 0x7f0b7c104010 2024-09-10T10:11:01.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.551+0000 7f0b84600640 1 -- 172.21.15.50:0/2319235913 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7c1a7190 con 0x7f0b7c104010 2024-09-10T10:11:01.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.552+0000 7f0b84600640 1 -- 172.21.15.50:0/2319235913 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b7c1043f0 con 0x7f0b7c104010 2024-09-10T10:11:01.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.554+0000 7f0b7a000640 1 -- 172.21.15.50:0/2319235913 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0b700046c0 con 0x7f0b7c104010 2024-09-10T10:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.555+0000 7f0b7a000640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b640a2b80 0x7f0b640a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.556+0000 7f0b7a000640 1 -- 172.21.15.50:0/2319235913 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f0b700cf850 con 0x7f0b7c104010 2024-09-10T10:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.556+0000 7f0b81200640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b640a2b80 0x7f0b640a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:01.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.556+0000 7f0b81200640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b640a2b80 0x7f0b640a5040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c10ab10 tx=0x7f0b68005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:01.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.558+0000 7f0b7a000640 1 -- 172.21.15.50:0/2319235913 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b7009c3c0 con 0x7f0b7c104010 2024-09-10T10:11:01.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.782+0000 7f0b84600640 1 -- 172.21.15.50:0/2319235913 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b7c19b970 con 0x7f0b7c104010 2024-09-10T10:11:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.783+0000 7f0b7a000640 1 -- 172.21.15.50:0/2319235913 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11912 (secure 0 0 0) 0x7f0b7009bcc0 con 0x7f0b7c104010 2024-09-10T10:11:01.784 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:01.785 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"btime":"2024-09-10T10:09:28:538200+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:09:28.424047+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24517,24521,24560]},"id":1}]} 2024-09-10T10:11:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 24 2024-09-10T10:11:01.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.785+0000 7f0b84600640 1 -- 172.21.15.50:0/2319235913 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b640a2b80 msgr2=0x7f0b640a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.785+0000 7f0b84600640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b640a2b80 0x7f0b640a5040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c10ab10 tx=0x7f0b68005f90 comp rx=0 tx=0).stop 2024-09-10T10:11:01.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.785+0000 7f0b84600640 1 -- 172.21.15.50:0/2319235913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b7c104010 msgr2=0x7f0b7c19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:01.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.785+0000 7f0b84600640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b7c104010 0x7f0b7c19a610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000e9f0 tx=0x7f0b7000edf0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.785+0000 7f0b84600640 1 -- 172.21.15.50:0/2319235913 shutdown_connections 2024-09-10T10:11:01.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.785+0000 7f0b84600640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b640a2b80 0x7f0b640a5040 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.785+0000 7f0b84600640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b7c109140 0x7f0b7c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.785+0000 7f0b84600640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b7c1049c0 0x7f0b7c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.785+0000 7f0b84600640 1 --2- 172.21.15.50:0/2319235913 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b7c104010 0x7f0b7c19a610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:01.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.785+0000 7f0b84600640 1 -- 172.21.15.50:0/2319235913 >> 172.21.15.50:0/2319235913 conn(0x7f0b7c0ffa50 msgr2=0x7f0b7c100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:01.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.786+0000 7f0b84600640 1 -- 172.21.15.50:0/2319235913 shutdown_connections 2024-09-10T10:11:01.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:01.786+0000 7f0b84600640 1 -- 172.21.15.50:0/2319235913 wait complete. 2024-09-10T10:11:02.131 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:02 smithi050 ceph-mon[30354]: pgmap v386: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:11:02.132 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:02 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2319235913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:02.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:02 smithi189 ceph-mon[34999]: pgmap v386: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:11:02.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:02 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2319235913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:02.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:02 smithi084 ceph-mon[34812]: pgmap v386: 129 pgs: 129 active+clean; 642 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:11:02.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:02 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2319235913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:02.496 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:11:02.873 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.432+0000 7fca03200640 1 -- 172.21.15.50:0/933770098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca04108f60 msgr2=0x7fca04110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.432+0000 7fca03200640 1 --2- 172.21.15.50:0/933770098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca04108f60 0x7fca04110ae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009ca0 tx=0x7fc9fc02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:11:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.432+0000 7fca03200640 1 -- 172.21.15.50:0/933770098 shutdown_connections 2024-09-10T10:11:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.432+0000 7fca03200640 1 --2- 172.21.15.50:0/933770098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca04108f60 0x7fca04110ae0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.432+0000 7fca03200640 1 --2- 172.21.15.50:0/933770098 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca041047e0 0x7fca04108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.432+0000 7fca03200640 1 --2- 172.21.15.50:0/933770098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca04103e30 0x7fca04104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.432+0000 7fca03200640 1 -- 172.21.15.50:0/933770098 >> 172.21.15.50:0/933770098 conn(0x7fca040ff910 msgr2=0x7fca04101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.432+0000 7fca03200640 1 -- 172.21.15.50:0/933770098 shutdown_connections 2024-09-10T10:11:03.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.432+0000 7fca03200640 1 -- 172.21.15.50:0/933770098 wait complete. 2024-09-10T10:11:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.433+0000 7fca03200640 1 Processor -- start 2024-09-10T10:11:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.433+0000 7fca03200640 1 -- start start 2024-09-10T10:11:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.434+0000 7fca03200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca04103e30 0x7fca0419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.434+0000 7fca03200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca041047e0 0x7fca0419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.434+0000 7fca03200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca04108f60 0x7fca0419ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.434+0000 7fca03200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca04113fc0 con 0x7fca04103e30 2024-09-10T10:11:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.434+0000 7fca03200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fca04113e40 con 0x7fca041047e0 2024-09-10T10:11:03.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.434+0000 7fca03200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fca04114140 con 0x7fca04108f60 2024-09-10T10:11:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.434+0000 7fca01e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca04103e30 0x7fca0419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.434+0000 7fca01e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca04103e30 0x7fca0419a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40250/0 (socket says 172.21.15.50:40250) 2024-09-10T10:11:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.434+0000 7fca02800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca04108f60 0x7fca0419ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.434+0000 7fca01e00640 1 -- 172.21.15.50:0/476195521 learned_addr learned my addr 172.21.15.50:0/476195521 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.434+0000 7fca01400640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca041047e0 0x7fca0419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.435+0000 7fca01e00640 1 -- 172.21.15.50:0/476195521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca04108f60 msgr2=0x7fca0419ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.435+0000 7fca01e00640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca04108f60 0x7fca0419ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.435+0000 7fca01e00640 1 -- 172.21.15.50:0/476195521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca041047e0 msgr2=0x7fca0419a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.435+0000 7fca01e00640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca041047e0 0x7fca0419a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.435+0000 7fca01e00640 1 -- 172.21.15.50:0/476195521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0419f3d0 con 0x7fca04103e30 2024-09-10T10:11:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.435+0000 7fca02800640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca04108f60 0x7fca0419ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:03.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.435+0000 7fca01e00640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca04103e30 0x7fca0419a420 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400ea60 tx=0x7fc9f400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:03.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.435+0000 7fc9faa00640 1 -- 172.21.15.50:0/476195521 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400cde0 con 0x7fca04103e30 2024-09-10T10:11:03.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.435+0000 7fc9faa00640 1 -- 172.21.15.50:0/476195521 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9f40035f0 con 0x7fca04103e30 2024-09-10T10:11:03.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.435+0000 7fca03200640 1 -- 172.21.15.50:0/476195521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca0419f6c0 con 0x7fca04103e30 2024-09-10T10:11:03.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.435+0000 7fc9faa00640 1 -- 172.21.15.50:0/476195521 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4010670 con 0x7fca04103e30 2024-09-10T10:11:03.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.435+0000 7fca03200640 1 -- 172.21.15.50:0/476195521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca041a6fa0 con 0x7fca04103e30 2024-09-10T10:11:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.437+0000 7fca03200640 1 -- 172.21.15.50:0/476195521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e4005290 con 0x7fca04103e30 2024-09-10T10:11:03.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.439+0000 7fc9faa00640 1 -- 172.21.15.50:0/476195521 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc9f4021430 con 0x7fca04103e30 2024-09-10T10:11:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.440+0000 7fc9faa00640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc9e80a2b80 0x7fc9e80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.440+0000 7fc9faa00640 1 -- 172.21.15.50:0/476195521 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fc9f40cf650 con 0x7fca04103e30 2024-09-10T10:11:03.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.440+0000 7fca01400640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc9e80a2b80 0x7fc9e80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:03.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.441+0000 7fca01400640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc9e80a2b80 0x7fc9e80a5040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fca040ffd30 tx=0x7fc9f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:03.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.444+0000 7fc9faa00640 1 -- 172.21.15.50:0/476195521 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9f409c1c0 con 0x7fca04103e30 2024-09-10T10:11:03.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.629+0000 7fca03200640 1 -- 172.21.15.50:0/476195521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9e4005580 con 0x7fca04103e30 2024-09-10T10:11:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.631+0000 7fc9faa00640 1 -- 172.21.15.50:0/476195521 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24775 (secure 0 0 0) 0x7fc9f409bac0 con 0x7fca04103e30 2024-09-10T10:11:03.633 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:03.634 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:10:00.717554+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:11:03.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.635+0000 7fca03200640 1 -- 172.21.15.50:0/476195521 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc9e80a2b80 msgr2=0x7fc9e80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:03.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.635+0000 7fca03200640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc9e80a2b80 0x7fc9e80a5040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fca040ffd30 tx=0x7fc9f0005f90 comp rx=0 tx=0).stop 2024-09-10T10:11:03.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.635+0000 7fca03200640 1 -- 172.21.15.50:0/476195521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca04103e30 msgr2=0x7fca0419a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.635+0000 7fca03200640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca04103e30 0x7fca0419a420 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400ea60 tx=0x7fc9f400ef20 comp rx=0 tx=0).stop 2024-09-10T10:11:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.635+0000 7fca03200640 1 -- 172.21.15.50:0/476195521 shutdown_connections 2024-09-10T10:11:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.635+0000 7fca03200640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc9e80a2b80 0x7fc9e80a5040 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.635+0000 7fca03200640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fca04108f60 0x7fca0419ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.635+0000 7fca03200640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca041047e0 0x7fca0419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.635+0000 7fca03200640 1 --2- 172.21.15.50:0/476195521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca04103e30 0x7fca0419a420 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.635+0000 7fca03200640 1 -- 172.21.15.50:0/476195521 >> 172.21.15.50:0/476195521 conn(0x7fca040ff910 msgr2=0x7fca04100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.635+0000 7fca03200640 1 -- 172.21.15.50:0/476195521 shutdown_connections 2024-09-10T10:11:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:03.635+0000 7fca03200640 1 -- 172.21.15.50:0/476195521 wait complete. 2024-09-10T10:11:04.301 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:04 smithi050 ceph-mon[30354]: pgmap v387: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T10:11:04.301 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:04 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/476195521' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:11:04.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:04 smithi189 ceph-mon[34999]: pgmap v387: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T10:11:04.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:04 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/476195521' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:11:04.339 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T10:08:36.316040+0000', 'modified': '2024-09-10T10:09:28.424047+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24560, 'mds_1': 24521, 'mds_2': 24517}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24493': {'gid': 24493, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/1101442212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 1101442212}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 1101442212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.84:6835/1698924277', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 1698924277}, {'type': 'v1', 'addr': '172.21.15.84:6835', 'nonce': 1698924277}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/251140305', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 251140305}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 251140305}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.189:6839/2768859315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 2768859315}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 2768859315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24521': {'gid': 24521, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.84:6837/1457195028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 1457195028}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 1457195028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.84:6839/4235486934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6838', 'nonce': 4235486934}, {'type': 'v1', 'addr': '172.21.15.84:6839', 'nonce': 4235486934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24560, 'qdb_cluster': [24517, 24521, 24560]} 2024-09-10T10:11:04.339 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T10:11:04.339 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T10:11:04.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:04 smithi084 ceph-mon[34812]: pgmap v387: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T10:11:04.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:04 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/476195521' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:11:04.718 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:05.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.426+0000 7f653f000640 1 -- 172.21.15.50:0/3830907232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65381019c0 msgr2=0x7f6538101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:05.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.426+0000 7f653f000640 1 --2- 172.21.15.50:0/3830907232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65381019c0 0x7f6538101e20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6524009930 tx=0x7f652402a420 comp rx=0 tx=0).stop 2024-09-10T10:11:05.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.426+0000 7f653f000640 1 -- 172.21.15.50:0/3830907232 shutdown_connections 2024-09-10T10:11:05.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.426+0000 7f653f000640 1 --2- 172.21.15.50:0/3830907232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6538102360 0x7f653810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.426+0000 7f653f000640 1 --2- 172.21.15.50:0/3830907232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65381019c0 0x7f6538101e20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.426+0000 7f653f000640 1 --2- 172.21.15.50:0/3830907232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65381079c0 0x7f6538107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.426+0000 7f653f000640 1 -- 172.21.15.50:0/3830907232 >> 172.21.15.50:0/3830907232 conn(0x7f65380fd740 msgr2=0x7f65380ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:05.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.426+0000 7f653f000640 1 -- 172.21.15.50:0/3830907232 shutdown_connections 2024-09-10T10:11:05.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.426+0000 7f653f000640 1 -- 172.21.15.50:0/3830907232 wait complete. 2024-09-10T10:11:05.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.427+0000 7f653f000640 1 Processor -- start 2024-09-10T10:11:05.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.427+0000 7f653f000640 1 -- start start 2024-09-10T10:11:05.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653f000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65381019c0 0x7f653819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653f000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6538102360 0x7f653819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653f000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65381079c0 0x7f653819edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653f000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6538111d90 con 0x7f6538102360 2024-09-10T10:11:05.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653f000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6538111c10 con 0x7f65381019c0 2024-09-10T10:11:05.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653f000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6538111f10 con 0x7f65381079c0 2024-09-10T10:11:05.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6538102360 0x7f653819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65381019c0 0x7f653819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65381019c0 0x7f653819a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:47614/0 (socket says 172.21.15.50:47614) 2024-09-10T10:11:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653dc00640 1 -- 172.21.15.50:0/2148692848 learned_addr learned my addr 172.21.15.50:0/2148692848 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653e600640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65381079c0 0x7f653819edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653dc00640 1 -- 172.21.15.50:0/2148692848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65381079c0 msgr2=0x7f653819edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653dc00640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65381079c0 0x7f653819edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653dc00640 1 -- 172.21.15.50:0/2148692848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6538102360 msgr2=0x7f653819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653dc00640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6538102360 0x7f653819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653dc00640 1 -- 172.21.15.50:0/2148692848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653819f490 con 0x7f65381019c0 2024-09-10T10:11:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.428+0000 7f653d200640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6538102360 0x7f653819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.429+0000 7f653dc00640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65381019c0 0x7f653819a4e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f652c00e9f0 tx=0x7f652c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.429+0000 7f6536000640 1 -- 172.21.15.50:0/2148692848 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c00cd80 con 0x7f65381019c0 2024-09-10T10:11:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.429+0000 7f653f000640 1 -- 172.21.15.50:0/2148692848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653819f780 con 0x7f65381019c0 2024-09-10T10:11:05.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.429+0000 7f6536000640 1 -- 172.21.15.50:0/2148692848 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f652c010910 con 0x7f65381019c0 2024-09-10T10:11:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.429+0000 7f6536000640 1 -- 172.21.15.50:0/2148692848 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c0188f0 con 0x7f65381019c0 2024-09-10T10:11:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.429+0000 7f653f000640 1 -- 172.21.15.50:0/2148692848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65381a7060 con 0x7f65381019c0 2024-09-10T10:11:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.433+0000 7f65431de740 1 Processor -- start 2024-09-10T10:11:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.433+0000 7f65431de740 1 -- start start 2024-09-10T10:11:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.434+0000 7f65431de740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aae64e0 0x55671aae68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.434+0000 7f65431de740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671aaf1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.434+0000 7f65431de740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aaf16c0 0x55671aaf3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.434+0000 7f65431de740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55671aa4c0b0 con 0x55671aaf16c0 2024-09-10T10:11:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.434+0000 7f65431de740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55671a9f3ab0 con 0x55671aae6e00 2024-09-10T10:11:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.434+0000 7f65431de740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55671aa48070 con 0x55671aae64e0 2024-09-10T10:11:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.434+0000 7f6536000640 1 -- 172.21.15.50:0/2148692848 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f652c010ac0 con 0x7f65381019c0 2024-09-10T10:11:05.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.434+0000 7f653e600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aae64e0 0x55671aae68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.434+0000 7f653d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aaf16c0 0x55671aaf3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.434+0000 7f653e600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aae64e0 0x55671aae68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:43812/0 (socket says 172.21.15.50:43812) 2024-09-10T10:11:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.434+0000 7f653e600640 1 -- 172.21.15.50:0/1539662506 learned_addr learned my addr 172.21.15.50:0/1539662506 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.435+0000 7f653dc00640 1 --2- 172.21.15.50:0/1539662506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671aaf1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.435+0000 7f653e600640 1 -- 172.21.15.50:0/1539662506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 msgr2=0x55671aaf1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.435+0000 7f653e600640 1 --2- 172.21.15.50:0/1539662506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671aaf1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.435+0000 7f653e600640 1 -- 172.21.15.50:0/1539662506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aaf16c0 msgr2=0x55671aaf3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.435+0000 7f653e600640 1 --2- 172.21.15.50:0/1539662506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aaf16c0 0x55671aaf3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.435+0000 7f653e600640 1 -- 172.21.15.50:0/1539662506 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55671aa004a0 con 0x55671aae64e0 2024-09-10T10:11:05.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.435+0000 7f653dc00640 1 --2- 172.21.15.50:0/1539662506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671aaf1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:11:05.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.435+0000 7f653e600640 1 --2- 172.21.15.50:0/1539662506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aae64e0 0x55671aae68c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6530010370 tx=0x7f6530010830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74afb1ea22d5eb93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:05.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.436+0000 7f6536000640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f65200a2b80 0x7f65200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.436+0000 7f652aa00640 1 -- 172.21.15.50:0/1539662506 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530016070 con 0x55671aae64e0 2024-09-10T10:11:05.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.436+0000 7f652aa00640 1 -- 172.21.15.50:0/1539662506 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6530004d20 con 0x55671aae64e0 2024-09-10T10:11:05.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.436+0000 7f652aa00640 1 -- 172.21.15.50:0/1539662506 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530005480 con 0x55671aae64e0 2024-09-10T10:11:05.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.436+0000 7f6536000640 1 -- 172.21.15.50:0/2148692848 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f652c0cf740 con 0x7f65381019c0 2024-09-10T10:11:05.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.436+0000 7f653dc00640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f65200a2b80 0x7f65200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.436+0000 7f653dc00640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f65200a2b80 0x7f65200a5040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f652c098630 tx=0x7f652c009700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:05.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.436+0000 7f65431de740 1 -- 172.21.15.50:0/1539662506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aae64e0 msgr2=0x55671aae68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:05.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.437+0000 7f65431de740 1 --2- 172.21.15.50:0/1539662506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aae64e0 0x55671aae68c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6530010370 tx=0x7f6530010830 comp rx=0 tx=0).stop 2024-09-10T10:11:05.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.437+0000 7f65431de740 1 -- 172.21.15.50:0/1539662506 shutdown_connections 2024-09-10T10:11:05.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.437+0000 7f65431de740 1 --2- 172.21.15.50:0/1539662506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aaf16c0 0x55671aaf3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.437+0000 7f65431de740 1 --2- 172.21.15.50:0/1539662506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671aaf1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.437+0000 7f65431de740 1 --2- 172.21.15.50:0/1539662506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aae64e0 0x55671aae68c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.437+0000 7f65431de740 1 -- 172.21.15.50:0/1539662506 >> 172.21.15.50:0/1539662506 conn(0x55671aae2a70 msgr2=0x55671aae2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.437+0000 7f65431de740 1 -- 172.21.15.50:0/1539662506 shutdown_connections 2024-09-10T10:11:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.437+0000 7f65431de740 1 -- 172.21.15.50:0/1539662506 wait complete. 2024-09-10T10:11:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.437+0000 7f65431de740 1 -- start start 2024-09-10T10:11:05.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.437+0000 7f65431de740 1 Processor -- start 2024-09-10T10:11:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.438+0000 7f65431de740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae64e0 0x55671aaee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.438+0000 7f65431de740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae6e00 0x55671aaeeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.438+0000 7f65431de740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 0x55671aaef040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.438+0000 7f65431de740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55671aaf4330 con 0x55671aae6e00 2024-09-10T10:11:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.438+0000 7f65431de740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55671a9d4920 con 0x55671aae64e0 2024-09-10T10:11:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.438+0000 7f65431de740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55671aaf44b0 con 0x55671aaf16c0 2024-09-10T10:11:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.438+0000 7f65431de740 10 client.0 _ll_register_callbacks cb 0x55671a9f88a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.438+0000 7f653d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae6e00 0x55671aaeeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.438+0000 7f653e600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae64e0 0x55671aaee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.438+0000 7f653d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae6e00 0x55671aaeeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40276/0 (socket says 172.21.15.50:40276) 2024-09-10T10:11:05.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.438+0000 7f653d200640 1 -- 172.21.15.50:0/1253405569 learned_addr learned my addr 172.21.15.50:0/1253405569 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:05.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.438+0000 7f653e600640 1 --2- 172.21.15.50:0/1253405569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 0x55671aaef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.439+0000 7f653d200640 1 -- 172.21.15.50:0/1253405569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 msgr2=0x55671aaef040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:05.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.439+0000 7f653d200640 1 --2- 172.21.15.50:0/1253405569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 0x55671aaef040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.439+0000 7f653d200640 1 -- 172.21.15.50:0/1253405569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae64e0 msgr2=0x55671aaee5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:05.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.439+0000 7f653d200640 1 --2- 172.21.15.50:0/1253405569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae64e0 0x55671aaee5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.439+0000 7f653d200640 1 -- 172.21.15.50:0/1253405569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55671a7bd2b0 con 0x55671aae6e00 2024-09-10T10:11:05.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.439+0000 7f653e600640 1 --2- 172.21.15.50:0/1253405569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae64e0 0x55671aaee5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:05.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.439+0000 7f653d200640 1 --2- 172.21.15.50:0/1253405569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae6e00 0x55671aaeeb00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f652402a940 tx=0x7f6524031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f3313cf6813868 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:05.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.439+0000 7f651f400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:11:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.439+0000 7f651f400640 1 -- 172.21.15.50:0/1253405569 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524035040 con 0x55671aae6e00 2024-09-10T10:11:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.439+0000 7f651f400640 1 -- 172.21.15.50:0/1253405569 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f6524004450 con 0x55671aae6e00 2024-09-10T10:11:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.439+0000 7f65431de740 1 -- 172.21.15.50:0/1253405569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6530004d20 con 0x55671aae6e00 2024-09-10T10:11:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.440+0000 7f651f400640 1 -- 172.21.15.50:0/1253405569 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f65240035f0 con 0x55671aae6e00 2024-09-10T10:11:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.440+0000 7f65431de740 10 client.15054 fetch_fsmap learned FSMap version 24 2024-09-10T10:11:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.440+0000 7f65431de740 1 -- 172.21.15.50:0/1253405569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55671aafff90 con 0x55671aae6e00 2024-09-10T10:11:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.440+0000 7f651f400640 1 -- 172.21.15.50:0/1253405569 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6530004d20 con 0x55671aae6e00 2024-09-10T10:11:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.440+0000 7f651f400640 1 -- 172.21.15.50:0/1253405569 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f6524048920 con 0x55671aae6e00 2024-09-10T10:11:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.440+0000 7f65431de740 10 client.15054 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T10:11:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.440+0000 7f65431de740 10 client.15054 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T10:11:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.440+0000 7f65431de740 20 client.15054 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.440+0000 7f65431de740 1 --2- 172.21.15.50:0/1253405569 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55671ab025c0 0x55671ab03a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.440+0000 7f65431de740 4 client.15054 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:11:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.440+0000 7f65431de740 1 -- 172.21.15.50:0/1253405569 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55671aa59620 con 0x55671ab025c0 2024-09-10T10:11:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.441+0000 7f653e600640 1 --2- 172.21.15.50:0/1253405569 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55671ab025c0 0x55671ab03a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.441+0000 7f653e600640 1 --2- 172.21.15.50:0/1253405569 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55671ab025c0 0x55671ab03a30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=efb3128d6c458d69 server_cookie=29d9986571e2ac11 in_seq=0 out_seq=0 2024-09-10T10:11:05.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.441+0000 7f651f400640 10 client.15054 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:11:05.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.442+0000 7f651f400640 1 -- 172.21.15.50:0/1253405569 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55671aa59620 con 0x55671ab025c0 2024-09-10T10:11:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.442+0000 7f651f400640 10 client.15054 handle_command_reply: tid=0 2024-09-10T10:11:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.443+0000 7f65431de740 1 client.15054 shutdown 2024-09-10T10:11:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.443+0000 7f65431de740 1 -- 172.21.15.50:0/1253405569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae6e00 msgr2=0x55671aaeeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.443+0000 7f65431de740 1 --2- 172.21.15.50:0/1253405569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae6e00 0x55671aaeeb00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f652402a940 tx=0x7f6524031860 comp rx=0 tx=0).stop 2024-09-10T10:11:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.443+0000 7f65431de740 1 -- 172.21.15.50:0/1253405569 shutdown_connections 2024-09-10T10:11:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.443+0000 7f65431de740 1 --2- 172.21.15.50:0/1253405569 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 0x55671aaef040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.443+0000 7f65431de740 1 --2- 172.21.15.50:0/1253405569 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55671ab025c0 0x55671ab03a30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.443+0000 7f65431de740 1 --2- 172.21.15.50:0/1253405569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae6e00 0x55671aaeeb00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.443+0000 7f65431de740 1 --2- 172.21.15.50:0/1253405569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae64e0 0x55671aaee5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.443+0000 7f65431de740 1 -- 172.21.15.50:0/1253405569 >> 172.21.15.50:0/1253405569 conn(0x55671aae2a70 msgr2=0x55671aae8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.443+0000 7f651f400640 0 client.15054 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:11:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.443+0000 7f65431de740 1 -- 172.21.15.50:0/1253405569 shutdown_connections 2024-09-10T10:11:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.443+0000 7f65431de740 1 -- 172.21.15.50:0/1253405569 wait complete. 2024-09-10T10:11:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.443+0000 7f65431de740 20 client.15054 trim_cache size 0 max 16384 2024-09-10T10:11:05.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.462+0000 7f65431de740 1 Processor -- start 2024-09-10T10:11:05.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.462+0000 7f65431de740 1 -- start start 2024-09-10T10:11:05.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.462+0000 7f65431de740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 0x55671aafe010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.462+0000 7f65431de740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671aae2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.462+0000 7f65431de740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 0x55671aaeee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.462+0000 7f65431de740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55671ab01d70 con 0x55671aae64e0 2024-09-10T10:11:05.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.462+0000 7f65431de740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55671ab02440 con 0x55671aae6e00 2024-09-10T10:11:05.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.462+0000 7f65431de740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55671ab02b10 con 0x55671aaf16c0 2024-09-10T10:11:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.463+0000 7f653e600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 0x55671aafe010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.463+0000 7f653e600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 0x55671aafe010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40284/0 (socket says 172.21.15.50:40284) 2024-09-10T10:11:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.463+0000 7f653e600640 1 -- 172.21.15.50:0/54730076 learned_addr learned my addr 172.21.15.50:0/54730076 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.463+0000 7f653d200640 1 --2- 172.21.15.50:0/54730076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671aae2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.463+0000 7f653e600640 1 --2- 172.21.15.50:0/54730076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 0x55671aaeee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.463+0000 7f653e600640 1 -- 172.21.15.50:0/54730076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 msgr2=0x55671aaeee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.463+0000 7f653e600640 1 --2- 172.21.15.50:0/54730076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 0x55671aaeee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.463+0000 7f653e600640 1 -- 172.21.15.50:0/54730076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 msgr2=0x55671aae2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.463+0000 7f653e600640 1 --2- 172.21.15.50:0/54730076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671aae2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.463+0000 7f653e600640 1 -- 172.21.15.50:0/54730076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55671aae2510 con 0x55671aae64e0 2024-09-10T10:11:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.464+0000 7f653e600640 1 --2- 172.21.15.50:0/54730076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 0x55671aafe010 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6530015040 tx=0x7f6530009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a5b2fd747f3acd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.464+0000 7f652a000640 1 -- 172.21.15.50:0/54730076 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530016040 con 0x55671aae64e0 2024-09-10T10:11:05.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.464+0000 7f652a000640 1 -- 172.21.15.50:0/54730076 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f653002e070 con 0x55671aae64e0 2024-09-10T10:11:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.464+0000 7f652a000640 1 -- 172.21.15.50:0/54730076 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65300058c0 con 0x55671aae64e0 2024-09-10T10:11:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.464+0000 7f65431de740 1 -- 172.21.15.50:0/54730076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 msgr2=0x55671aafe010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.464+0000 7f65431de740 1 --2- 172.21.15.50:0/54730076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 0x55671aafe010 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6530015040 tx=0x7f6530009600 comp rx=0 tx=0).stop 2024-09-10T10:11:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.464+0000 7f65431de740 1 -- 172.21.15.50:0/54730076 shutdown_connections 2024-09-10T10:11:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.464+0000 7f65431de740 1 --2- 172.21.15.50:0/54730076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 0x55671aaeee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.464+0000 7f65431de740 1 --2- 172.21.15.50:0/54730076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671aae2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.464+0000 7f65431de740 1 --2- 172.21.15.50:0/54730076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 0x55671aafe010 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.464+0000 7f65431de740 1 -- 172.21.15.50:0/54730076 >> 172.21.15.50:0/54730076 conn(0x55671aae2a70 msgr2=0x55671aaece90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.465+0000 7f65431de740 1 -- 172.21.15.50:0/54730076 shutdown_connections 2024-09-10T10:11:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.465+0000 7f65431de740 1 -- 172.21.15.50:0/54730076 wait complete. 2024-09-10T10:11:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.465+0000 7f65431de740 1 -- start start 2024-09-10T10:11:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.465+0000 7f65431de740 1 Processor -- start 2024-09-10T10:11:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f65431de740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 0x55671ab0c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f65431de740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671ab055a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f65431de740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 0x55671ab05ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f65431de740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55671ab038b0 con 0x55671aae64e0 2024-09-10T10:11:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f65431de740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55671ab031e0 con 0x55671aae6e00 2024-09-10T10:11:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f65431de740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55671ab03f80 con 0x55671aaf16c0 2024-09-10T10:11:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f65431de740 10 client.0 _ll_register_callbacks cb 0x7f6524005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f653e600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 0x55671ab0c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f653d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671ab055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f653e600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 0x55671ab0c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40288/0 (socket says 172.21.15.50:40288) 2024-09-10T10:11:05.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f653e600640 1 -- 172.21.15.50:0/2000836385 learned_addr learned my addr 172.21.15.50:0/2000836385 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f653e600640 1 --2- 172.21.15.50:0/2000836385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 0x55671ab05ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f653d200640 1 -- 172.21.15.50:0/2000836385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 msgr2=0x55671ab05ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f653d200640 1 --2- 172.21.15.50:0/2000836385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 0x55671ab05ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f653d200640 1 -- 172.21.15.50:0/2000836385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 msgr2=0x55671ab0c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f653d200640 1 --2- 172.21.15.50:0/2000836385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 0x55671ab0c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.466+0000 7f653d200640 1 -- 172.21.15.50:0/2000836385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55671ab060a0 con 0x55671aae6e00 2024-09-10T10:11:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.467+0000 7f653e600640 1 --2- 172.21.15.50:0/2000836385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 0x55671ab0c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.467+0000 7f653d200640 1 --2- 172.21.15.50:0/2000836385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671ab055a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55671aaefb70 tx=0x7f6524009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af3cb3c1378a79ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.467+0000 7f651f400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:11:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.467+0000 7f651f400640 1 -- 172.21.15.50:0/2000836385 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524059070 con 0x55671aae6e00 2024-09-10T10:11:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.467+0000 7f65431de740 1 -- 172.21.15.50:0/2000836385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f653002e070 con 0x55671aae6e00 2024-09-10T10:11:05.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.467+0000 7f651f400640 1 -- 172.21.15.50:0/2000836385 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f6524005450 con 0x55671aae6e00 2024-09-10T10:11:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.468+0000 7f651f400640 1 -- 172.21.15.50:0/2000836385 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6524065050 con 0x55671aae6e00 2024-09-10T10:11:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.468+0000 7f65431de740 10 client.25118 fetch_fsmap learned FSMap version 24 2024-09-10T10:11:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.468+0000 7f65431de740 1 -- 172.21.15.50:0/2000836385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55671ab0ab30 con 0x55671aae6e00 2024-09-10T10:11:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.468+0000 7f651f400640 1 -- 172.21.15.50:0/2000836385 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f653002e070 con 0x55671aae6e00 2024-09-10T10:11:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.468+0000 7f651f400640 1 -- 172.21.15.50:0/2000836385 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f65240038b0 con 0x55671aae6e00 2024-09-10T10:11:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.468+0000 7f65431de740 10 client.25118 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T10:11:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.468+0000 7f65431de740 10 client.25118 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T10:11:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.468+0000 7f65431de740 20 client.25118 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.468+0000 7f65431de740 1 --2- 172.21.15.50:0/2000836385 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55671ab71690 0x55671ab703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.468+0000 7f65431de740 4 client.25118 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:11:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.468+0000 7f65431de740 1 -- 172.21.15.50:0/2000836385 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "status"}) -- 0x55671aa53b30 con 0x55671ab71690 2024-09-10T10:11:05.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.469+0000 7f653e600640 1 --2- 172.21.15.50:0/2000836385 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55671ab71690 0x55671ab703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.469+0000 7f653e600640 1 --2- 172.21.15.50:0/2000836385 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55671ab71690 0x55671ab703a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=77479a329e9c2cb1 server_cookie=2cbbccc98814ffee in_seq=0 out_seq=0 2024-09-10T10:11:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.469+0000 7f651f400640 10 client.25118 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:11:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f651f400640 1 -- 172.21.15.50:0/2000836385 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55671aa53b30 con 0x55671ab71690 2024-09-10T10:11:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f651f400640 10 client.25118 handle_command_reply: tid=0 2024-09-10T10:11:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f65431de740 1 client.25118 shutdown 2024-09-10T10:11:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f65431de740 1 -- 172.21.15.50:0/2000836385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 msgr2=0x55671ab055a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f65431de740 1 --2- 172.21.15.50:0/2000836385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671ab055a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55671aaefb70 tx=0x7f6524009680 comp rx=0 tx=0).stop 2024-09-10T10:11:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f65431de740 1 -- 172.21.15.50:0/2000836385 shutdown_connections 2024-09-10T10:11:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f65431de740 1 --2- 172.21.15.50:0/2000836385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55671aaf16c0 0x55671ab05ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f65431de740 1 --2- 172.21.15.50:0/2000836385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55671aae6e00 0x55671ab055a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f65431de740 1 --2- 172.21.15.50:0/2000836385 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55671ab71690 0x55671ab703a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f65431de740 1 --2- 172.21.15.50:0/2000836385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55671aae64e0 0x55671ab0c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f65431de740 1 -- 172.21.15.50:0/2000836385 >> 172.21.15.50:0/2000836385 conn(0x55671aae2a70 msgr2=0x55671aafcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:05.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f651f400640 0 client.25118 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:11:05.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f65431de740 1 -- 172.21.15.50:0/2000836385 shutdown_connections 2024-09-10T10:11:05.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f65431de740 1 -- 172.21.15.50:0/2000836385 wait complete. 2024-09-10T10:11:05.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.470+0000 7f65431de740 20 client.25118 trim_cache size 0 max 16384 2024-09-10T10:11:05.476 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:11:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "4d54e0f8-6f5b-11ef-bcea-c7b262605968", 2024-09-10T10:11:05.476 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 2, 2024-09-10T10:11:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24517, 2024-09-10T10:11:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-10T10:11:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-10T10:11:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-10T10:11:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 99.938339825, 2024-09-10T10:11:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 24, 2024-09-10T10:11:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 95, 2024-09-10T10:11:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 93, 2024-09-10T10:11:05.477 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 172.23971485199999 2024-09-10T10:11:05.477 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:11:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.471+0000 7f653f000640 1 -- 172.21.15.50:0/2148692848 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f65200a2b80 msgr2=0x7f65200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.471+0000 7f653f000640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f65200a2b80 0x7f65200a5040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f652c098630 tx=0x7f652c009700 comp rx=0 tx=0).stop 2024-09-10T10:11:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.471+0000 7f653f000640 1 -- 172.21.15.50:0/2148692848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65381019c0 msgr2=0x7f653819a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.471+0000 7f653f000640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65381019c0 0x7f653819a4e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f652c00e9f0 tx=0x7f652c00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.471+0000 7f653f000640 1 -- 172.21.15.50:0/2148692848 shutdown_connections 2024-09-10T10:11:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.471+0000 7f653f000640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f65200a2b80 0x7f65200a5040 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.471+0000 7f653f000640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65381079c0 0x7f653819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.471+0000 7f653f000640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6538102360 0x7f653819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.471+0000 7f653f000640 1 --2- 172.21.15.50:0/2148692848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65381019c0 0x7f653819a4e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:05.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.471+0000 7f653f000640 1 -- 172.21.15.50:0/2148692848 >> 172.21.15.50:0/2148692848 conn(0x7f65380fd740 msgr2=0x7f653810d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:05.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.471+0000 7f653f000640 1 -- 172.21.15.50:0/2148692848 shutdown_connections 2024-09-10T10:11:05.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:05.471+0000 7f653f000640 1 -- 172.21.15.50:0/2148692848 wait complete. 2024-09-10T10:11:06.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:06 smithi050 ceph-mon[30354]: pgmap v388: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T10:11:06.235 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T10:11:06.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:06 smithi189 ceph-mon[34999]: pgmap v388: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T10:11:06.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:06 smithi084 ceph-mon[34812]: pgmap v388: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T10:11:06.615 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:07.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.207+0000 7f2a02200640 1 -- 172.21.15.50:0/2326262327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29fc077040 msgr2=0x7f29fc112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:07.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.207+0000 7f2a02200640 1 --2- 172.21.15.50:0/2326262327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29fc077040 0x7f29fc112510 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009900 tx=0x7f29e402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.207+0000 7f2a02200640 1 -- 172.21.15.50:0/2326262327 shutdown_connections 2024-09-10T10:11:07.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.207+0000 7f2a02200640 1 --2- 172.21.15.50:0/2326262327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29fc112a50 0x7f29fc114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.207+0000 7f2a02200640 1 --2- 172.21.15.50:0/2326262327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29fc077040 0x7f29fc112510 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.207+0000 7f2a02200640 1 --2- 172.21.15.50:0/2326262327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29fc076720 0x7f29fc076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.207+0000 7f2a02200640 1 -- 172.21.15.50:0/2326262327 >> 172.21.15.50:0/2326262327 conn(0x7f29fc0ffa50 msgr2=0x7f29fc101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:07.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.207+0000 7f2a02200640 1 -- 172.21.15.50:0/2326262327 shutdown_connections 2024-09-10T10:11:07.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.207+0000 7f2a02200640 1 -- 172.21.15.50:0/2326262327 wait complete. 2024-09-10T10:11:07.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.208+0000 7f2a02200640 1 Processor -- start 2024-09-10T10:11:07.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.208+0000 7f2a02200640 1 -- start start 2024-09-10T10:11:07.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.209+0000 7f2a02200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29fc076720 0x7f29fc1a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.209+0000 7f2a02200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29fc077040 0x7f29fc1a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.209+0000 7f2a02200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29fc112a50 0x7f29fc19e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.209+0000 7f2a02200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29fc1185c0 con 0x7f29fc112a50 2024-09-10T10:11:07.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.209+0000 7f2a02200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f29fc118440 con 0x7f29fc077040 2024-09-10T10:11:07.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.209+0000 7f2a02200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f29fc118740 con 0x7f29fc076720 2024-09-10T10:11:07.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.209+0000 7f29fbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29fc112a50 0x7f29fc19e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.209+0000 7f29fbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29fc112a50 0x7f29fc19e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42394/0 (socket says 172.21.15.50:42394) 2024-09-10T10:11:07.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.209+0000 7f29fb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29fc076720 0x7f29fc1a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.209+0000 7f29fbe00640 1 -- 172.21.15.50:0/2976970164 learned_addr learned my addr 172.21.15.50:0/2976970164 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:07.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.209+0000 7f29f3e00640 1 --2- 172.21.15.50:0/2976970164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29fc077040 0x7f29fc1a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.210+0000 7f29fbe00640 1 -- 172.21.15.50:0/2976970164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29fc076720 msgr2=0x7f29fc1a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:07.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.210+0000 7f29fbe00640 1 --2- 172.21.15.50:0/2976970164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29fc076720 0x7f29fc1a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.210+0000 7f29fbe00640 1 -- 172.21.15.50:0/2976970164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29fc077040 msgr2=0x7f29fc1a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:07.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.210+0000 7f29fbe00640 1 --2- 172.21.15.50:0/2976970164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29fc077040 0x7f29fc1a4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.210+0000 7f29fbe00640 1 -- 172.21.15.50:0/2976970164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29fc19f0a0 con 0x7f29fc112a50 2024-09-10T10:11:07.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.210+0000 7f29fbe00640 1 --2- 172.21.15.50:0/2976970164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29fc112a50 0x7f29fc19e970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f29f400dac0 tx=0x7f29f400df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:07.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.210+0000 7f29f8c00640 1 -- 172.21.15.50:0/2976970164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4017030 con 0x7f29fc112a50 2024-09-10T10:11:07.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.210+0000 7f29f8c00640 1 -- 172.21.15.50:0/2976970164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29f4003e50 con 0x7f29fc112a50 2024-09-10T10:11:07.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.210+0000 7f29f8c00640 1 -- 172.21.15.50:0/2976970164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4010460 con 0x7f29fc112a50 2024-09-10T10:11:07.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.210+0000 7f2a02200640 1 -- 172.21.15.50:0/2976970164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29fc19f390 con 0x7f29fc112a50 2024-09-10T10:11:07.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.210+0000 7f2a02200640 1 -- 172.21.15.50:0/2976970164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29fc1ab680 con 0x7f29fc112a50 2024-09-10T10:11:07.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.213+0000 7f2a04c6e740 1 Processor -- start 2024-09-10T10:11:07.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.213+0000 7f29f8c00640 1 -- 172.21.15.50:0/2976970164 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f29f401a070 con 0x7f29fc112a50 2024-09-10T10:11:07.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.214+0000 7f2a04c6e740 1 -- start start 2024-09-10T10:11:07.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.214+0000 7f2a04c6e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066ed4330 0x55b066ed4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.214+0000 7f2a04c6e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4c50 0x55b066edefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.214+0000 7f2a04c6e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066edf510 0x55b066ee1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.214+0000 7f2a04c6e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b066e3a0b0 con 0x55b066edf510 2024-09-10T10:11:07.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.214+0000 7f2a04c6e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b066de1ab0 con 0x55b066ed4330 2024-09-10T10:11:07.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.214+0000 7f2a04c6e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b066e36070 con 0x55b066ed4c50 2024-09-10T10:11:07.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29f3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066ed4330 0x55b066ed4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29f3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066ed4330 0x55b066ed4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:38764/0 (socket says 172.21.15.50:38764) 2024-09-10T10:11:07.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29f3e00640 1 -- 172.21.15.50:0/1736967752 learned_addr learned my addr 172.21.15.50:0/1736967752 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:07.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29fb400640 1 --2- 172.21.15.50:0/1736967752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4c50 0x55b066edefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29f3e00640 1 --2- 172.21.15.50:0/1736967752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066edf510 0x55b066ee1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29fb400640 1 -- 172.21.15.50:0/1736967752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066ed4330 msgr2=0x55b066ed4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:07.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29fb400640 1 --2- 172.21.15.50:0/1736967752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066ed4330 0x55b066ed4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29fb400640 1 -- 172.21.15.50:0/1736967752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066edf510 msgr2=0x55b066ee1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:07.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29fb400640 1 --2- 172.21.15.50:0/1736967752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066edf510 0x55b066ee1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29fb400640 1 -- 172.21.15.50:0/1736967752 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b066dee4a0 con 0x55b066ed4c50 2024-09-10T10:11:07.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29f3e00640 1 --2- 172.21.15.50:0/1736967752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066ed4330 0x55b066ed4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:07.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29f8c00640 1 --2- 172.21.15.50:0/2976970164 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f29e00a2c00 0x7f29e00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29fb400640 1 --2- 172.21.15.50:0/1736967752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4c50 0x55b066edefd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29ec005d00 tx=0x7f29ec0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f608e9992e20e161 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:07.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.215+0000 7f29f8c00640 1 -- 172.21.15.50:0/2976970164 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f29f40cf090 con 0x7f29fc112a50 2024-09-10T10:11:07.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.216+0000 7f29f3e00640 1 --2- 172.21.15.50:0/2976970164 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f29e00a2c00 0x7f29e00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.216+0000 7f29ebe00640 1 -- 172.21.15.50:0/1736967752 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec01c480 con 0x55b066ed4c50 2024-09-10T10:11:07.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.216+0000 7f29ebe00640 1 -- 172.21.15.50:0/1736967752 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29ec01cb00 con 0x55b066ed4c50 2024-09-10T10:11:07.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.216+0000 7f29ebe00640 1 -- 172.21.15.50:0/1736967752 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec011ac0 con 0x55b066ed4c50 2024-09-10T10:11:07.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.217+0000 7f2a04c6e740 1 -- 172.21.15.50:0/1736967752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4c50 msgr2=0x55b066edefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:07.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.217+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/1736967752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4c50 0x55b066edefd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29ec005d00 tx=0x7f29ec0107a0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.217+0000 7f29f3e00640 1 --2- 172.21.15.50:0/2976970164 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f29e00a2c00 0x7f29e00a50c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55b066ed1c40 tx=0x7f29e40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:07.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.217+0000 7f2a04c6e740 1 -- 172.21.15.50:0/1736967752 shutdown_connections 2024-09-10T10:11:07.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.217+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/1736967752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066edf510 0x55b066ee1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.217+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/1736967752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4c50 0x55b066edefd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.217+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/1736967752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066ed4330 0x55b066ed4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.217+0000 7f2a04c6e740 1 -- 172.21.15.50:0/1736967752 >> 172.21.15.50:0/1736967752 conn(0x55b066ed08c0 msgr2=0x55b066ed0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.217+0000 7f2a04c6e740 1 -- 172.21.15.50:0/1736967752 shutdown_connections 2024-09-10T10:11:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.217+0000 7f2a04c6e740 1 -- 172.21.15.50:0/1736967752 wait complete. 2024-09-10T10:11:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.218+0000 7f2a04c6e740 1 -- start start 2024-09-10T10:11:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.218+0000 7f2a04c6e740 1 Processor -- start 2024-09-10T10:11:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.218+0000 7f2a04c6e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4330 0x55b066edc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.218+0000 7f2a04c6e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 0x55b066edca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.218+0000 7f2a04c6e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066edf510 0x55b066edcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.218+0000 7f2a04c6e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b066ee2060 con 0x55b066ed4c50 2024-09-10T10:11:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.218+0000 7f2a04c6e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b066dc2920 con 0x55b066edf510 2024-09-10T10:11:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.218+0000 7f2a04c6e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b066ee21e0 con 0x55b066ed4330 2024-09-10T10:11:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.218+0000 7f2a04c6e740 10 client.0 _ll_register_callbacks cb 0x55b066de68a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29f3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 0x55b066edca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29fb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4330 0x55b066edc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29fb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4330 0x55b066edc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:39882/0 (socket says 172.21.15.50:39882) 2024-09-10T10:11:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29fb400640 1 -- 172.21.15.50:0/722175877 learned_addr learned my addr 172.21.15.50:0/722175877 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29f3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 0x55b066edca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42422/0 (socket says 172.21.15.50:42422) 2024-09-10T10:11:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29fb400640 1 -- 172.21.15.50:0/722175877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066edf510 msgr2=0x55b066edcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29fbe00640 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066edf510 0x55b066edcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29fb400640 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066edf510 0x55b066edcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29fb400640 1 -- 172.21.15.50:0/722175877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 msgr2=0x55b066edca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29fb400640 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 0x55b066edca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29fb400640 1 -- 172.21.15.50:0/722175877 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b066bab2b0 con 0x55b066ed4330 2024-09-10T10:11:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29f3e00640 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 0x55b066edca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29fbe00640 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066edf510 0x55b066edcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:11:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29fb400640 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4330 0x55b066edc510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00bf80 tx=0x7f29ec00bfb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b94f9edb4f510939 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.219+0000 7f29e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:11:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.220+0000 7f29e8c00640 1 -- 172.21.15.50:0/722175877 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec02a060 con 0x55b066ed4330 2024-09-10T10:11:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.220+0000 7f29e8c00640 1 -- 172.21.15.50:0/722175877 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f29ec01c750 con 0x55b066ed4330 2024-09-10T10:11:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.220+0000 7f2a04c6e740 1 -- 172.21.15.50:0/722175877 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29ec01cb00 con 0x55b066ed4330 2024-09-10T10:11:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.220+0000 7f29e8c00640 1 -- 172.21.15.50:0/722175877 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f29ec031050 con 0x55b066ed4330 2024-09-10T10:11:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.220+0000 7f2a04c6e740 10 client.25093 fetch_fsmap learned FSMap version 24 2024-09-10T10:11:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.220+0000 7f2a04c6e740 1 -- 172.21.15.50:0/722175877 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b066eeddf0 con 0x55b066ed4330 2024-09-10T10:11:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.220+0000 7f29e8c00640 1 -- 172.21.15.50:0/722175877 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29ec01cb00 con 0x55b066ed4330 2024-09-10T10:11:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.221+0000 7f29e8c00640 1 -- 172.21.15.50:0/722175877 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f29ec011c50 con 0x55b066ed4330 2024-09-10T10:11:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.221+0000 7f2a04c6e740 10 client.25093 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T10:11:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.221+0000 7f2a04c6e740 10 client.25093 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T10:11:07.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.221+0000 7f2a04c6e740 20 client.25093 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:07.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.221+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b066ef0080 0x55b066ef14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.221+0000 7f2a04c6e740 4 client.25093 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:11:07.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.221+0000 7f2a04c6e740 1 -- 172.21.15.50:0/722175877 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b066e47620 con 0x55b066ef0080 2024-09-10T10:11:07.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.221+0000 7f29f3e00640 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b066ef0080 0x55b066ef14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.222+0000 7f29f3e00640 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b066ef0080 0x55b066ef14f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c13b228e9dca3f63 server_cookie=acaf8cf0bfe08d57 in_seq=0 out_seq=0 2024-09-10T10:11:07.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.222+0000 7f29e8c00640 10 client.25093 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:11:07.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f29e8c00640 1 -- 172.21.15.50:0/722175877 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b066e47620 con 0x55b066ef0080 2024-09-10T10:11:07.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f29e8c00640 10 client.25093 handle_command_reply: tid=0 2024-09-10T10:11:07.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f2a04c6e740 1 client.25093 shutdown 2024-09-10T10:11:07.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f2a04c6e740 1 -- 172.21.15.50:0/722175877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4330 msgr2=0x55b066edc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:07.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4330 0x55b066edc510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00bf80 tx=0x7f29ec00bfb0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f2a04c6e740 1 -- 172.21.15.50:0/722175877 shutdown_connections 2024-09-10T10:11:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b066ef0080 0x55b066ef14f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066edf510 0x55b066edcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 0x55b066edca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/722175877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4330 0x55b066edc510 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f2a04c6e740 1 -- 172.21.15.50:0/722175877 >> 172.21.15.50:0/722175877 conn(0x55b066ed08c0 msgr2=0x55b066ed65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f29e8c00640 0 client.25093 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:11:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f2a04c6e740 1 -- 172.21.15.50:0/722175877 shutdown_connections 2024-09-10T10:11:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.223+0000 7f2a04c6e740 1 -- 172.21.15.50:0/722175877 wait complete. 2024-09-10T10:11:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.224+0000 7f2a04c6e740 20 client.25093 trim_cache size 0 max 16384 2024-09-10T10:11:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.242+0000 7f2a04c6e740 1 Processor -- start 2024-09-10T10:11:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.242+0000 7f2a04c6e740 1 -- start start 2024-09-10T10:11:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f2a04c6e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4330 0x55b066ef0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f2a04c6e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 0x55b066ed6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f2a04c6e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066edf510 0x55b066edca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f2a04c6e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b066eef830 con 0x55b066ed4c50 2024-09-10T10:11:07.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f2a04c6e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b066eeff00 con 0x55b066edf510 2024-09-10T10:11:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f2a04c6e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b066ef05d0 con 0x55b066ed4330 2024-09-10T10:11:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f29f3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 0x55b066ed6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f29f3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 0x55b066ed6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42424/0 (socket says 172.21.15.50:42424) 2024-09-10T10:11:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f29f3e00640 1 -- 172.21.15.50:0/1001716017 learned_addr learned my addr 172.21.15.50:0/1001716017 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f29fbe00640 1 --2- 172.21.15.50:0/1001716017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066edf510 0x55b066edca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f29fb400640 1 --2- 172.21.15.50:0/1001716017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4330 0x55b066ef0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f29f3e00640 1 -- 172.21.15.50:0/1001716017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4330 msgr2=0x55b066ef0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f29f3e00640 1 --2- 172.21.15.50:0/1001716017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4330 0x55b066ef0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f29f3e00640 1 -- 172.21.15.50:0/1001716017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066edf510 msgr2=0x55b066edca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f29f3e00640 1 --2- 172.21.15.50:0/1001716017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066edf510 0x55b066edca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.243+0000 7f29f3e00640 1 -- 172.21.15.50:0/1001716017 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b066ed1a30 con 0x55b066ed4c50 2024-09-10T10:11:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.244+0000 7f29f3e00640 1 --2- 172.21.15.50:0/1001716017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 0x55b066ed6d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f29e4005940 tx=0x7f29e4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d68e6d54e73b2b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.244+0000 7f29eb400640 1 -- 172.21.15.50:0/1001716017 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4058070 con 0x55b066ed4c50 2024-09-10T10:11:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.244+0000 7f29eb400640 1 -- 172.21.15.50:0/1001716017 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e40056a0 con 0x55b066ed4c50 2024-09-10T10:11:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.244+0000 7f29eb400640 1 -- 172.21.15.50:0/1001716017 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e404f070 con 0x55b066ed4c50 2024-09-10T10:11:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.244+0000 7f2a04c6e740 1 -- 172.21.15.50:0/1001716017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 msgr2=0x55b066ed6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:07.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.244+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/1001716017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 0x55b066ed6d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f29e4005940 tx=0x7f29e4009260 comp rx=0 tx=0).stop 2024-09-10T10:11:07.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.245+0000 7f2a04c6e740 1 -- 172.21.15.50:0/1001716017 shutdown_connections 2024-09-10T10:11:07.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.245+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/1001716017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066edf510 0x55b066edca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.245+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/1001716017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066ed4c50 0x55b066ed6d90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.245+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/1001716017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4330 0x55b066ef0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.245+0000 7f2a04c6e740 1 -- 172.21.15.50:0/1001716017 >> 172.21.15.50:0/1001716017 conn(0x55b066ed08c0 msgr2=0x55b066ed0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:07.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.245+0000 7f2a04c6e740 1 -- 172.21.15.50:0/1001716017 shutdown_connections 2024-09-10T10:11:07.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.245+0000 7f2a04c6e740 1 -- 172.21.15.50:0/1001716017 wait complete. 2024-09-10T10:11:07.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.245+0000 7f2a04c6e740 1 -- start start 2024-09-10T10:11:07.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.245+0000 7f2a04c6e740 1 Processor -- start 2024-09-10T10:11:07.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f2a04c6e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066ed4330 0x55b066ef4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f2a04c6e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4c50 0x55b066ef4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f2a04c6e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066edf510 0x55b066ef4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f2a04c6e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b066ef1370 con 0x55b066edf510 2024-09-10T10:11:07.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f2a04c6e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b066ef0ca0 con 0x55b066ed4330 2024-09-10T10:11:07.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f2a04c6e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b066ef1a40 con 0x55b066ed4c50 2024-09-10T10:11:07.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f2a04c6e740 10 client.0 _ll_register_callbacks cb 0x7f29ec00bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:07.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f29f3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4c50 0x55b066ef4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f29fb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066ed4330 0x55b066ef4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f29fbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066edf510 0x55b066ef4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f29f3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4c50 0x55b066ef4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:39892/0 (socket says 172.21.15.50:39892) 2024-09-10T10:11:07.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f29f3e00640 1 -- 172.21.15.50:0/2565675756 learned_addr learned my addr 172.21.15.50:0/2565675756 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:07.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f29fb400640 1 -- 172.21.15.50:0/2565675756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4c50 msgr2=0x55b066ef4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:07.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f29fb400640 1 --2- 172.21.15.50:0/2565675756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4c50 0x55b066ef4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f29fb400640 1 -- 172.21.15.50:0/2565675756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066edf510 msgr2=0x55b066ef4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:07.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.246+0000 7f29fb400640 1 --2- 172.21.15.50:0/2565675756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066edf510 0x55b066ef4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.247+0000 7f29fb400640 1 -- 172.21.15.50:0/2565675756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b066ef94c0 con 0x55b066ed4330 2024-09-10T10:11:07.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.247+0000 7f29fbe00640 1 --2- 172.21.15.50:0/2565675756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066edf510 0x55b066ef4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:07.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.247+0000 7f29fb400640 1 --2- 172.21.15.50:0/2565675756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066ed4330 0x55b066ef4340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29ec001eb0 tx=0x7f29ec004960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf09ad4bac7ccd1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:07.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.247+0000 7f29e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:11:07.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.247+0000 7f29e8c00640 1 -- 172.21.15.50:0/2565675756 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec019330 con 0x55b066ed4330 2024-09-10T10:11:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.247+0000 7f2a04c6e740 1 -- 172.21.15.50:0/2565675756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29e40056a0 con 0x55b066ed4330 2024-09-10T10:11:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.247+0000 7f29e8c00640 1 -- 172.21.15.50:0/2565675756 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f29ec01c960 con 0x55b066ed4330 2024-09-10T10:11:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.247+0000 7f29e8c00640 1 -- 172.21.15.50:0/2565675756 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f29ec042050 con 0x55b066ed4330 2024-09-10T10:11:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.247+0000 7f2a04c6e740 10 client.25133 fetch_fsmap learned FSMap version 24 2024-09-10T10:11:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.247+0000 7f2a04c6e740 1 -- 172.21.15.50:0/2565675756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b066f5aba0 con 0x55b066ed4330 2024-09-10T10:11:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.248+0000 7f29e8c00640 1 -- 172.21.15.50:0/2565675756 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e40056a0 con 0x55b066ed4330 2024-09-10T10:11:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.248+0000 7f29e8c00640 1 -- 172.21.15.50:0/2565675756 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f29ec03d030 con 0x55b066ed4330 2024-09-10T10:11:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.248+0000 7f2a04c6e740 10 client.25133 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T10:11:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.248+0000 7f2a04c6e740 10 client.25133 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T10:11:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.248+0000 7f2a04c6e740 20 client.25133 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.248+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/2565675756 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b066f5f6c0 0x55b066f5e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:07.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.248+0000 7f2a04c6e740 4 client.25133 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:11:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.248+0000 7f2a04c6e740 1 -- 172.21.15.50:0/2565675756 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "status"}) -- 0x55b066e41b30 con 0x55b066f5f6c0 2024-09-10T10:11:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.248+0000 7f29f3e00640 1 --2- 172.21.15.50:0/2565675756 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b066f5f6c0 0x55b066f5e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f29f3e00640 1 --2- 172.21.15.50:0/2565675756 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b066f5f6c0 0x55b066f5e3d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6f8d172871a425e0 server_cookie=8c5b724b5dee8b3 in_seq=0 out_seq=0 2024-09-10T10:11:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f29e8c00640 10 client.25133 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:11:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f29e8c00640 1 -- 172.21.15.50:0/2565675756 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b066e41b30 con 0x55b066f5f6c0 2024-09-10T10:11:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f29e8c00640 10 client.25133 handle_command_reply: tid=0 2024-09-10T10:11:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f2a04c6e740 1 client.25133 shutdown 2024-09-10T10:11:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f2a04c6e740 1 -- 172.21.15.50:0/2565675756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066ed4330 msgr2=0x55b066ef4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/2565675756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066ed4330 0x55b066ef4340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29ec001eb0 tx=0x7f29ec004960 comp rx=0 tx=0).stop 2024-09-10T10:11:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f2a04c6e740 1 -- 172.21.15.50:0/2565675756 shutdown_connections 2024-09-10T10:11:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/2565675756 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b066f5f6c0 0x55b066f5e3d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/2565675756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b066edf510 0x55b066ef4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/2565675756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b066ed4c50 0x55b066ef4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f2a04c6e740 1 --2- 172.21.15.50:0/2565675756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b066ed4330 0x55b066ef4340 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f2a04c6e740 1 -- 172.21.15.50:0/2565675756 >> 172.21.15.50:0/2565675756 conn(0x55b066ed08c0 msgr2=0x55b066eea430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.249+0000 7f29e8c00640 0 client.25133 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:11:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.250+0000 7f2a04c6e740 1 -- 172.21.15.50:0/2565675756 shutdown_connections 2024-09-10T10:11:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.250+0000 7f2a04c6e740 1 -- 172.21.15.50:0/2565675756 wait complete. 2024-09-10T10:11:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.250+0000 7f2a04c6e740 20 client.25133 trim_cache size 0 max 16384 2024-09-10T10:11:07.256 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:11:07.257 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "4d54e0f8-6f5b-11ef-bcea-c7b262605968", 2024-09-10T10:11:07.257 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 1, 2024-09-10T10:11:07.257 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24521, 2024-09-10T10:11:07.257 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-10T10:11:07.257 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-10T10:11:07.257 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-10T10:11:07.257 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 102.731509777, 2024-09-10T10:11:07.257 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 24, 2024-09-10T10:11:07.257 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 95, 2024-09-10T10:11:07.257 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 93, 2024-09-10T10:11:07.257 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 176.82553435200001 2024-09-10T10:11:07.257 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:11:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.250+0000 7f2a02200640 1 -- 172.21.15.50:0/2976970164 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f29e00a2c00 msgr2=0x7f29e00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.250+0000 7f2a02200640 1 --2- 172.21.15.50:0/2976970164 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f29e00a2c00 0x7f29e00a50c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55b066ed1c40 tx=0x7f29e40058d0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.250+0000 7f2a02200640 1 -- 172.21.15.50:0/2976970164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29fc112a50 msgr2=0x7f29fc19e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.250+0000 7f2a02200640 1 --2- 172.21.15.50:0/2976970164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29fc112a50 0x7f29fc19e970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f29f400dac0 tx=0x7f29f400df80 comp rx=0 tx=0).stop 2024-09-10T10:11:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.250+0000 7f2a02200640 1 -- 172.21.15.50:0/2976970164 shutdown_connections 2024-09-10T10:11:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.250+0000 7f2a02200640 1 --2- 172.21.15.50:0/2976970164 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f29e00a2c00 0x7f29e00a50c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.250+0000 7f2a02200640 1 --2- 172.21.15.50:0/2976970164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29fc112a50 0x7f29fc19e970 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.250+0000 7f2a02200640 1 --2- 172.21.15.50:0/2976970164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29fc077040 0x7f29fc1a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.250+0000 7f2a02200640 1 --2- 172.21.15.50:0/2976970164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29fc076720 0x7f29fc1a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.250+0000 7f2a02200640 1 -- 172.21.15.50:0/2976970164 >> 172.21.15.50:0/2976970164 conn(0x7f29fc0ffa50 msgr2=0x7f29fc101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.251+0000 7f2a02200640 1 -- 172.21.15.50:0/2976970164 shutdown_connections 2024-09-10T10:11:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:07.251+0000 7f2a02200640 1 -- 172.21.15.50:0/2976970164 wait complete. 2024-09-10T10:11:08.168 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:08 smithi050 ceph-mon[30354]: pgmap v389: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T10:11:08.208 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T10:11:08.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:08 smithi189 ceph-mon[34999]: pgmap v389: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T10:11:08.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:08 smithi084 ceph-mon[34812]: pgmap v389: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T10:11:08.606 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.195+0000 7fc119000640 1 -- 172.21.15.50:0/3660730503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc114109120 msgr2=0x7fc114110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.195+0000 7fc119000640 1 --2- 172.21.15.50:0/3660730503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc114109120 0x7fc114110ca0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009ca0 tx=0x7fc10c02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.195+0000 7fc119000640 1 -- 172.21.15.50:0/3660730503 shutdown_connections 2024-09-10T10:11:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.195+0000 7fc119000640 1 --2- 172.21.15.50:0/3660730503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc114109120 0x7fc114110ca0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.195+0000 7fc119000640 1 --2- 172.21.15.50:0/3660730503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1141049a0 0x7fc1141089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.195+0000 7fc119000640 1 --2- 172.21.15.50:0/3660730503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc114103ff0 0x7fc1141043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.195+0000 7fc119000640 1 -- 172.21.15.50:0/3660730503 >> 172.21.15.50:0/3660730503 conn(0x7fc1140ffa90 msgr2=0x7fc114101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:09.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.195+0000 7fc119000640 1 -- 172.21.15.50:0/3660730503 shutdown_connections 2024-09-10T10:11:09.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.196+0000 7fc119000640 1 -- 172.21.15.50:0/3660730503 wait complete. 2024-09-10T10:11:09.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.197+0000 7fc119000640 1 Processor -- start 2024-09-10T10:11:09.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.197+0000 7fc119000640 1 -- start start 2024-09-10T10:11:09.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.197+0000 7fc119000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc114103ff0 0x7fc11419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.197+0000 7fc119000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1141049a0 0x7fc11419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.197+0000 7fc119000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc114109120 0x7fc11419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.197+0000 7fc119000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc114114130 con 0x7fc1141049a0 2024-09-10T10:11:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.197+0000 7fc119000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc114113fb0 con 0x7fc114109120 2024-09-10T10:11:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.197+0000 7fc119000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc1141142b0 con 0x7fc114103ff0 2024-09-10T10:11:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.197+0000 7fc10be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1141049a0 0x7fc11419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.197+0000 7fc10be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1141049a0 0x7fc11419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42460/0 (socket says 172.21.15.50:42460) 2024-09-10T10:11:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.197+0000 7fc10be00640 1 -- 172.21.15.50:0/4030488591 learned_addr learned my addr 172.21.15.50:0/4030488591 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.198+0000 7fc111e00640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc114103ff0 0x7fc11419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.198+0000 7fc112800640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc114109120 0x7fc11419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.198+0000 7fc10be00640 1 -- 172.21.15.50:0/4030488591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc114103ff0 msgr2=0x7fc11419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.198+0000 7fc10be00640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc114103ff0 0x7fc11419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.198+0000 7fc10be00640 1 -- 172.21.15.50:0/4030488591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc114109120 msgr2=0x7fc11419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:09.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.198+0000 7fc10be00640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc114109120 0x7fc11419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.198+0000 7fc10be00640 1 -- 172.21.15.50:0/4030488591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11419f5a0 con 0x7fc1141049a0 2024-09-10T10:11:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.198+0000 7fc10be00640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1141049a0 0x7fc11419ab30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00e9f0 tx=0x7fc0fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.199+0000 7fc10aa00640 1 -- 172.21.15.50:0/4030488591 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc00cd80 con 0x7fc1141049a0 2024-09-10T10:11:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.199+0000 7fc119000640 1 -- 172.21.15.50:0/4030488591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc11419f890 con 0x7fc1141049a0 2024-09-10T10:11:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.199+0000 7fc10aa00640 1 -- 172.21.15.50:0/4030488591 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0fc010910 con 0x7fc1141049a0 2024-09-10T10:11:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.199+0000 7fc119000640 1 -- 172.21.15.50:0/4030488591 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1141a7170 con 0x7fc1141049a0 2024-09-10T10:11:09.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.199+0000 7fc10aa00640 1 -- 172.21.15.50:0/4030488591 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc018910 con 0x7fc1141049a0 2024-09-10T10:11:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.202+0000 7fc10aa00640 1 -- 172.21.15.50:0/4030488591 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc0fc010ac0 con 0x7fc1141049a0 2024-09-10T10:11:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.202+0000 7fc11ba44740 1 Processor -- start 2024-09-10T10:11:09.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.202+0000 7fc11ba44740 1 -- start start 2024-09-10T10:11:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.202+0000 7fc11ba44740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4cc330 0x56436b4cc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.202+0000 7fc11ba44740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4ccc50 0x56436b4d6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.202+0000 7fc11ba44740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4d7510 0x56436b4d9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.202+0000 7fc11ba44740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56436b4320b0 con 0x56436b4d7510 2024-09-10T10:11:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.202+0000 7fc11ba44740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56436b3d9ab0 con 0x56436b4ccc50 2024-09-10T10:11:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.202+0000 7fc11ba44740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56436b42e070 con 0x56436b4cc330 2024-09-10T10:11:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.203+0000 7fc112800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4cc330 0x56436b4cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.203+0000 7fc10be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4d7510 0x56436b4d9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.203+0000 7fc112800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4cc330 0x56436b4cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:39922/0 (socket says 172.21.15.50:39922) 2024-09-10T10:11:09.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.203+0000 7fc112800640 1 -- 172.21.15.50:0/3628349951 learned_addr learned my addr 172.21.15.50:0/3628349951 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:09.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.203+0000 7fc111e00640 1 --2- 172.21.15.50:0/3628349951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4ccc50 0x56436b4d6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.203+0000 7fc112800640 1 -- 172.21.15.50:0/3628349951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4ccc50 msgr2=0x56436b4d6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.203+0000 7fc112800640 1 --2- 172.21.15.50:0/3628349951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4ccc50 0x56436b4d6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.203+0000 7fc112800640 1 -- 172.21.15.50:0/3628349951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4d7510 msgr2=0x56436b4d9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.203+0000 7fc112800640 1 --2- 172.21.15.50:0/3628349951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4d7510 0x56436b4d9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.203+0000 7fc112800640 1 -- 172.21.15.50:0/3628349951 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56436b3e64a0 con 0x56436b4cc330 2024-09-10T10:11:09.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.203+0000 7fc112800640 1 --2- 172.21.15.50:0/3628349951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4cc330 0x56436b4cc710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009ca0 tx=0x7fc10c009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adb66b4a0fa4a0c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.204+0000 7fc103400640 1 -- 172.21.15.50:0/3628349951 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c031db0 con 0x56436b4cc330 2024-09-10T10:11:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.204+0000 7fc10aa00640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc0f80a2b80 0x7fc0f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.204+0000 7fc103400640 1 -- 172.21.15.50:0/3628349951 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc10c036040 con 0x56436b4cc330 2024-09-10T10:11:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.204+0000 7fc103400640 1 -- 172.21.15.50:0/3628349951 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c004380 con 0x56436b4cc330 2024-09-10T10:11:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.204+0000 7fc10aa00640 1 -- 172.21.15.50:0/4030488591 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fc0fc0cf710 con 0x7fc1141049a0 2024-09-10T10:11:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.204+0000 7fc111e00640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc0f80a2b80 0x7fc0f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.205+0000 7fc11ba44740 1 -- 172.21.15.50:0/3628349951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4cc330 msgr2=0x56436b4cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.205+0000 7fc11ba44740 1 --2- 172.21.15.50:0/3628349951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4cc330 0x56436b4cc710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009ca0 tx=0x7fc10c009800 comp rx=0 tx=0).stop 2024-09-10T10:11:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.205+0000 7fc11ba44740 1 -- 172.21.15.50:0/3628349951 shutdown_connections 2024-09-10T10:11:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.205+0000 7fc11ba44740 1 --2- 172.21.15.50:0/3628349951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4d7510 0x56436b4d9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.205+0000 7fc11ba44740 1 --2- 172.21.15.50:0/3628349951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4ccc50 0x56436b4d6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.205+0000 7fc11ba44740 1 --2- 172.21.15.50:0/3628349951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4cc330 0x56436b4cc710 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.205+0000 7fc11ba44740 1 -- 172.21.15.50:0/3628349951 >> 172.21.15.50:0/3628349951 conn(0x56436b4c88c0 msgr2=0x56436b4c8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.205+0000 7fc111e00640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc0f80a2b80 0x7fc0f80a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x56436b4c9720 tx=0x7fc10400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.205+0000 7fc11ba44740 1 -- 172.21.15.50:0/3628349951 shutdown_connections 2024-09-10T10:11:09.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.205+0000 7fc11ba44740 1 -- 172.21.15.50:0/3628349951 wait complete. 2024-09-10T10:11:09.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.205+0000 7fc11ba44740 1 -- start start 2024-09-10T10:11:09.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.206+0000 7fc11ba44740 1 Processor -- start 2024-09-10T10:11:09.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.206+0000 7fc11ba44740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 0x56436b4d4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.206+0000 7fc11ba44740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4ccc50 0x56436b4d49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.206+0000 7fc11ba44740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4d4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.206+0000 7fc11ba44740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56436b4da000 con 0x56436b4cc330 2024-09-10T10:11:09.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.206+0000 7fc11ba44740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56436b3ba920 con 0x56436b4d7510 2024-09-10T10:11:09.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.206+0000 7fc11ba44740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56436b4da180 con 0x56436b4ccc50 2024-09-10T10:11:09.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.206+0000 7fc11ba44740 10 client.0 _ll_register_callbacks cb 0x56436b3de8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:09.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.206+0000 7fc111e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 0x56436b4d4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.207+0000 7fc111e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 0x56436b4d4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42488/0 (socket says 172.21.15.50:42488) 2024-09-10T10:11:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.207+0000 7fc111e00640 1 -- 172.21.15.50:0/1647852254 learned_addr learned my addr 172.21.15.50:0/1647852254 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.207+0000 7fc10be00640 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4ccc50 0x56436b4d49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.207+0000 7fc112800640 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4d4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.207+0000 7fc112800640 1 -- 172.21.15.50:0/1647852254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4ccc50 msgr2=0x56436b4d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.207+0000 7fc112800640 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4ccc50 0x56436b4d49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.207+0000 7fc112800640 1 -- 172.21.15.50:0/1647852254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 msgr2=0x56436b4d4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.207+0000 7fc112800640 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 0x56436b4d4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.207+0000 7fc112800640 1 -- 172.21.15.50:0/1647852254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56436b1a32b0 con 0x56436b4d7510 2024-09-10T10:11:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.207+0000 7fc111e00640 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 0x56436b4d4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.207+0000 7fc10be00640 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4ccc50 0x56436b4d49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.207+0000 7fc112800640 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4d4f00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc10c004af0 tx=0x7fc10c031e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eba92cedb10cb32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:09.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.207+0000 7fc0f7e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:11:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.208+0000 7fc0f7e00640 1 -- 172.21.15.50:0/1647852254 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c052060 con 0x56436b4d7510 2024-09-10T10:11:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.208+0000 7fc11ba44740 1 -- 172.21.15.50:0/1647852254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc10c036040 con 0x56436b4d7510 2024-09-10T10:11:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.208+0000 7fc0f7e00640 1 -- 172.21.15.50:0/1647852254 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fc10c003b80 con 0x56436b4d7510 2024-09-10T10:11:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.208+0000 7fc0f7e00640 1 -- 172.21.15.50:0/1647852254 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc10c003d80 con 0x56436b4d7510 2024-09-10T10:11:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.208+0000 7fc11ba44740 10 client.25145 fetch_fsmap learned FSMap version 24 2024-09-10T10:11:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.208+0000 7fc11ba44740 1 -- 172.21.15.50:0/1647852254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56436b4da000 con 0x56436b4d7510 2024-09-10T10:11:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.208+0000 7fc0f7e00640 1 -- 172.21.15.50:0/1647852254 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc10c036040 con 0x56436b4d7510 2024-09-10T10:11:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.208+0000 7fc0f7e00640 1 -- 172.21.15.50:0/1647852254 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fc10c043070 con 0x56436b4d7510 2024-09-10T10:11:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.209+0000 7fc11ba44740 10 client.25145 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T10:11:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.209+0000 7fc11ba44740 10 client.25145 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T10:11:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.209+0000 7fc11ba44740 20 client.25145 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.209+0000 7fc11ba44740 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56436b4e7e30 0x56436b4e92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.209+0000 7fc11ba44740 4 client.25145 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:11:09.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.209+0000 7fc11ba44740 1 -- 172.21.15.50:0/1647852254 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56436b43f620 con 0x56436b4e7e30 2024-09-10T10:11:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.209+0000 7fc111e00640 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56436b4e7e30 0x56436b4e92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.210+0000 7fc111e00640 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56436b4e7e30 0x56436b4e92a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3085926fe08c5972 server_cookie=91acdf949263ff65 in_seq=0 out_seq=0 2024-09-10T10:11:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.210+0000 7fc0f7e00640 10 client.25145 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.210+0000 7fc0f7e00640 1 -- 172.21.15.50:0/1647852254 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56436b43f620 con 0x56436b4e7e30 2024-09-10T10:11:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.210+0000 7fc0f7e00640 10 client.25145 handle_command_reply: tid=0 2024-09-10T10:11:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.211+0000 7fc11ba44740 1 client.25145 shutdown 2024-09-10T10:11:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.211+0000 7fc11ba44740 1 -- 172.21.15.50:0/1647852254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 msgr2=0x56436b4d4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.211+0000 7fc11ba44740 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4d4f00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc10c004af0 tx=0x7fc10c031e60 comp rx=0 tx=0).stop 2024-09-10T10:11:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.211+0000 7fc11ba44740 1 -- 172.21.15.50:0/1647852254 shutdown_connections 2024-09-10T10:11:09.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.211+0000 7fc11ba44740 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56436b4e7e30 0x56436b4e92a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.211+0000 7fc11ba44740 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4d4f00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.211+0000 7fc11ba44740 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4ccc50 0x56436b4d49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.211+0000 7fc11ba44740 1 --2- 172.21.15.50:0/1647852254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 0x56436b4d4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.211+0000 7fc11ba44740 1 -- 172.21.15.50:0/1647852254 >> 172.21.15.50:0/1647852254 conn(0x56436b4c88c0 msgr2=0x56436b4ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.211+0000 7fc0f7e00640 0 client.25145 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.211+0000 7fc11ba44740 1 -- 172.21.15.50:0/1647852254 shutdown_connections 2024-09-10T10:11:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.211+0000 7fc11ba44740 1 -- 172.21.15.50:0/1647852254 wait complete. 2024-09-10T10:11:09.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.211+0000 7fc11ba44740 20 client.25145 trim_cache size 0 max 16384 2024-09-10T10:11:09.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.230+0000 7fc11ba44740 1 Processor -- start 2024-09-10T10:11:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.230+0000 7fc11ba44740 1 -- start start 2024-09-10T10:11:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.230+0000 7fc11ba44740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 0x56436b4e92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.230+0000 7fc11ba44740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4ccc50 0x56436b4d3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.230+0000 7fc11ba44740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.230+0000 7fc11ba44740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56436b4e75e0 con 0x56436b4cc330 2024-09-10T10:11:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.230+0000 7fc11ba44740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56436b4e7cb0 con 0x56436b4d7510 2024-09-10T10:11:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.230+0000 7fc11ba44740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56436b4e8380 con 0x56436b4ccc50 2024-09-10T10:11:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.230+0000 7fc111e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 0x56436b4e92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.230+0000 7fc111e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 0x56436b4e92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42494/0 (socket says 172.21.15.50:42494) 2024-09-10T10:11:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.230+0000 7fc111e00640 1 -- 172.21.15.50:0/357677506 learned_addr learned my addr 172.21.15.50:0/357677506 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.231+0000 7fc112800640 1 --2- 172.21.15.50:0/357677506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.231+0000 7fc10be00640 1 --2- 172.21.15.50:0/357677506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4ccc50 0x56436b4d3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.231+0000 7fc111e00640 1 -- 172.21.15.50:0/357677506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4ccc50 msgr2=0x56436b4d3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.231+0000 7fc111e00640 1 --2- 172.21.15.50:0/357677506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4ccc50 0x56436b4d3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.231+0000 7fc111e00640 1 -- 172.21.15.50:0/357677506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 msgr2=0x56436b4ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.231+0000 7fc111e00640 1 --2- 172.21.15.50:0/357677506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.231+0000 7fc111e00640 1 -- 172.21.15.50:0/357677506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56436b4e7410 con 0x56436b4cc330 2024-09-10T10:11:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.231+0000 7fc111e00640 1 --2- 172.21.15.50:0/357677506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 0x56436b4e92a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc104005d00 tx=0x7fc104019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5473812785691e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.231+0000 7fc102a00640 1 -- 172.21.15.50:0/357677506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc104005020 con 0x56436b4cc330 2024-09-10T10:11:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.231+0000 7fc102a00640 1 -- 172.21.15.50:0/357677506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1040047a0 con 0x56436b4cc330 2024-09-10T10:11:09.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.231+0000 7fc102a00640 1 -- 172.21.15.50:0/357677506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10402a740 con 0x56436b4cc330 2024-09-10T10:11:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.232+0000 7fc11ba44740 1 -- 172.21.15.50:0/357677506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 msgr2=0x56436b4e92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.232+0000 7fc11ba44740 1 --2- 172.21.15.50:0/357677506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 0x56436b4e92a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc104005d00 tx=0x7fc104019000 comp rx=0 tx=0).stop 2024-09-10T10:11:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.232+0000 7fc11ba44740 1 -- 172.21.15.50:0/357677506 shutdown_connections 2024-09-10T10:11:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.232+0000 7fc11ba44740 1 --2- 172.21.15.50:0/357677506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.232+0000 7fc11ba44740 1 --2- 172.21.15.50:0/357677506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4ccc50 0x56436b4d3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.232+0000 7fc11ba44740 1 --2- 172.21.15.50:0/357677506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4cc330 0x56436b4e92a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.232+0000 7fc11ba44740 1 -- 172.21.15.50:0/357677506 >> 172.21.15.50:0/357677506 conn(0x56436b4c88c0 msgr2=0x56436b4cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.232+0000 7fc11ba44740 1 -- 172.21.15.50:0/357677506 shutdown_connections 2024-09-10T10:11:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.232+0000 7fc11ba44740 1 -- 172.21.15.50:0/357677506 wait complete. 2024-09-10T10:11:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.233+0000 7fc11ba44740 1 -- start start 2024-09-10T10:11:09.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.233+0000 7fc11ba44740 1 Processor -- start 2024-09-10T10:11:09.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.233+0000 7fc11ba44740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4cc330 0x56436b4f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.233+0000 7fc11ba44740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4ccc50 0x56436b4f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.233+0000 7fc11ba44740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4eaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.233+0000 7fc11ba44740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56436b4e9120 con 0x56436b4ccc50 2024-09-10T10:11:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.233+0000 7fc11ba44740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56436b4e8a50 con 0x56436b4d7510 2024-09-10T10:11:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.233+0000 7fc11ba44740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56436b4e97f0 con 0x56436b4cc330 2024-09-10T10:11:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.233+0000 7fc11ba44740 10 client.0 _ll_register_callbacks cb 0x7fc10c005f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.234+0000 7fc10be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4ccc50 0x56436b4f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.234+0000 7fc112800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4eaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.234+0000 7fc10be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4ccc50 0x56436b4f1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42504/0 (socket says 172.21.15.50:42504) 2024-09-10T10:11:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.234+0000 7fc10be00640 1 -- 172.21.15.50:0/2974306354 learned_addr learned my addr 172.21.15.50:0/2974306354 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.234+0000 7fc111e00640 1 --2- 172.21.15.50:0/2974306354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4cc330 0x56436b4f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.234+0000 7fc112800640 1 -- 172.21.15.50:0/2974306354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4cc330 msgr2=0x56436b4f17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.234+0000 7fc112800640 1 --2- 172.21.15.50:0/2974306354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4cc330 0x56436b4f17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.234+0000 7fc112800640 1 -- 172.21.15.50:0/2974306354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4ccc50 msgr2=0x56436b4f1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.234+0000 7fc112800640 1 --2- 172.21.15.50:0/2974306354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4ccc50 0x56436b4f1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.234+0000 7fc112800640 1 -- 172.21.15.50:0/2974306354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56436b4eb320 con 0x56436b4d7510 2024-09-10T10:11:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.234+0000 7fc111e00640 1 --2- 172.21.15.50:0/2974306354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4cc330 0x56436b4f17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:11:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.234+0000 7fc112800640 1 --2- 172.21.15.50:0/2974306354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4eaaf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc10c02f970 tx=0x7fc10c005da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6b7e0b9892a037 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.234+0000 7fc0f7e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:11:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc0f7e00640 1 -- 172.21.15.50:0/2974306354 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c052070 con 0x56436b4d7510 2024-09-10T10:11:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc11ba44740 1 -- 172.21.15.50:0/2974306354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1040047a0 con 0x56436b4d7510 2024-09-10T10:11:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc0f7e00640 1 -- 172.21.15.50:0/2974306354 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fc10c003b80 con 0x56436b4d7510 2024-09-10T10:11:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc0f7e00640 1 -- 172.21.15.50:0/2974306354 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc10c009540 con 0x56436b4d7510 2024-09-10T10:11:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc11ba44740 10 client.25151 fetch_fsmap learned FSMap version 24 2024-09-10T10:11:09.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc11ba44740 1 -- 172.21.15.50:0/2974306354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56436b4efe00 con 0x56436b4d7510 2024-09-10T10:11:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc0f7e00640 1 -- 172.21.15.50:0/2974306354 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1040047a0 con 0x56436b4d7510 2024-09-10T10:11:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc0f7e00640 1 -- 172.21.15.50:0/2974306354 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fc10c043040 con 0x56436b4d7510 2024-09-10T10:11:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc11ba44740 10 client.25151 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T10:11:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc11ba44740 10 client.25151 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T10:11:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc11ba44740 20 client.25151 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc11ba44740 1 --2- 172.21.15.50:0/2974306354 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56436b556970 0x56436b555680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc11ba44740 4 client.25151 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:11:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.235+0000 7fc11ba44740 1 -- 172.21.15.50:0/2974306354 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "status"}) -- 0x56436b439b30 con 0x56436b556970 2024-09-10T10:11:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.236+0000 7fc111e00640 1 --2- 172.21.15.50:0/2974306354 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56436b556970 0x56436b555680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.236+0000 7fc111e00640 1 --2- 172.21.15.50:0/2974306354 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56436b556970 0x56436b555680 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d111006f22265406 server_cookie=257e59687e46fb77 in_seq=0 out_seq=0 2024-09-10T10:11:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.236+0000 7fc0f7e00640 10 client.25151 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc0f7e00640 1 -- 172.21.15.50:0/2974306354 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56436b439b30 con 0x56436b556970 2024-09-10T10:11:09.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc0f7e00640 10 client.25151 handle_command_reply: tid=0 2024-09-10T10:11:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc11ba44740 1 client.25151 shutdown 2024-09-10T10:11:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc11ba44740 1 -- 172.21.15.50:0/2974306354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 msgr2=0x56436b4eaaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc11ba44740 1 --2- 172.21.15.50:0/2974306354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4eaaf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc10c02f970 tx=0x7fc10c005da0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc11ba44740 1 -- 172.21.15.50:0/2974306354 shutdown_connections 2024-09-10T10:11:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc11ba44740 1 --2- 172.21.15.50:0/2974306354 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56436b556970 0x56436b555680 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc11ba44740 1 --2- 172.21.15.50:0/2974306354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56436b4d7510 0x56436b4eaaf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc11ba44740 1 --2- 172.21.15.50:0/2974306354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56436b4ccc50 0x56436b4f1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc11ba44740 1 --2- 172.21.15.50:0/2974306354 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56436b4cc330 0x56436b4f17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc0f7e00640 0 client.25151 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc11ba44740 1 -- 172.21.15.50:0/2974306354 >> 172.21.15.50:0/2974306354 conn(0x56436b4c88c0 msgr2=0x56436b4e2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc11ba44740 1 -- 172.21.15.50:0/2974306354 shutdown_connections 2024-09-10T10:11:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc11ba44740 1 -- 172.21.15.50:0/2974306354 wait complete. 2024-09-10T10:11:09.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.237+0000 7fc11ba44740 20 client.25151 trim_cache size 0 max 16384 2024-09-10T10:11:09.243 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:11:09.243 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "4d54e0f8-6f5b-11ef-bcea-c7b262605968", 2024-09-10T10:11:09.243 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-10T10:11:09.243 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24560, 2024-09-10T10:11:09.243 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-10T10:11:09.243 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-10T10:11:09.243 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-10T10:11:09.243 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 152.88115296999999, 2024-09-10T10:11:09.243 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 24, 2024-09-10T10:11:09.243 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 95, 2024-09-10T10:11:09.243 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 93, 2024-09-10T10:11:09.244 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 165.719836765 2024-09-10T10:11:09.244 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:11:09.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.238+0000 7fc119000640 1 -- 172.21.15.50:0/4030488591 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc0f80a2b80 msgr2=0x7fc0f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:09.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.238+0000 7fc119000640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc0f80a2b80 0x7fc0f80a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x56436b4c9720 tx=0x7fc10400b410 comp rx=0 tx=0).stop 2024-09-10T10:11:09.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.238+0000 7fc119000640 1 -- 172.21.15.50:0/4030488591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1141049a0 msgr2=0x7fc11419ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:09.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.238+0000 7fc119000640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1141049a0 0x7fc11419ab30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00e9f0 tx=0x7fc0fc00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.238+0000 7fc119000640 1 -- 172.21.15.50:0/4030488591 shutdown_connections 2024-09-10T10:11:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.238+0000 7fc119000640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc0f80a2b80 0x7fc0f80a5040 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.238+0000 7fc119000640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc114109120 0x7fc11419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.238+0000 7fc119000640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1141049a0 0x7fc11419ab30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.238+0000 7fc119000640 1 --2- 172.21.15.50:0/4030488591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc114103ff0 0x7fc11419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.238+0000 7fc119000640 1 -- 172.21.15.50:0/4030488591 >> 172.21.15.50:0/4030488591 conn(0x7fc1140ffa90 msgr2=0x7fc114100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.238+0000 7fc119000640 1 -- 172.21.15.50:0/4030488591 shutdown_connections 2024-09-10T10:11:09.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:09.238+0000 7fc119000640 1 -- 172.21.15.50:0/4030488591 wait complete. 2024-09-10T10:11:10.004 INFO:teuthology.run_tasks:Running task sequential... 2024-09-10T10:11:10.014 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-10T10:11:10.015 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-10T10:11:10.015 INFO:teuthology.task.print:Enabling mgr modules 2024-09-10T10:11:10.015 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T10:11:10.096 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T10:11:10.096 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-10T10:11:10.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:11:10.096 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-10T10:11:10.134 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-10T10:11:10.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:11:10.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T10:11:10.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:10 smithi050 ceph-mon[30354]: pgmap v390: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:11:10.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:11:10.237 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-09-10T10:11:10.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:10 smithi189 ceph-mon[34999]: pgmap v390: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:11:10.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:10 smithi084 ceph-mon[34812]: pgmap v390: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:11:10.570 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-10T10:11:10.570 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T10:11:10.571 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T10:11:10.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T10:11:10.948 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:11.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.516+0000 7f4d68a00640 1 -- 172.21.15.50:0/2486766264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64108f60 msgr2=0x7f4d64110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:11.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.516+0000 7f4d68a00640 1 --2- 172.21.15.50:0/2486766264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64108f60 0x7f4d64110ae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009900 tx=0x7f4d5c02a410 comp rx=0 tx=0).stop 2024-09-10T10:11:11.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.516+0000 7f4d68a00640 1 -- 172.21.15.50:0/2486766264 shutdown_connections 2024-09-10T10:11:11.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.516+0000 7f4d68a00640 1 --2- 172.21.15.50:0/2486766264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64108f60 0x7f4d64110ae0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.516+0000 7f4d68a00640 1 --2- 172.21.15.50:0/2486766264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d641047e0 0x7f4d64108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.516+0000 7f4d68a00640 1 --2- 172.21.15.50:0/2486766264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64103e30 0x7f4d64104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.516+0000 7f4d68a00640 1 -- 172.21.15.50:0/2486766264 >> 172.21.15.50:0/2486766264 conn(0x7f4d640ff910 msgr2=0x7f4d64101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.516+0000 7f4d68a00640 1 -- 172.21.15.50:0/2486766264 shutdown_connections 2024-09-10T10:11:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.516+0000 7f4d68a00640 1 -- 172.21.15.50:0/2486766264 wait complete. 2024-09-10T10:11:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.517+0000 7f4d68a00640 1 Processor -- start 2024-09-10T10:11:11.519 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.517+0000 7f4d68a00640 1 -- start start 2024-09-10T10:11:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.517+0000 7f4d68a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64103e30 0x7f4d6419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.517+0000 7f4d68a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d641047e0 0x7f4d6419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.517+0000 7f4d68a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64108f60 0x7f4d6419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.517+0000 7f4d68a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64114010 con 0x7f4d64103e30 2024-09-10T10:11:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.517+0000 7f4d68a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64113e90 con 0x7f4d64108f60 2024-09-10T10:11:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.517+0000 7f4d68a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64114190 con 0x7f4d641047e0 2024-09-10T10:11:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.518+0000 7f4d59e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d641047e0 0x7f4d6419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.518+0000 7f4d62800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64103e30 0x7f4d6419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.518+0000 7f4d59e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d641047e0 0x7f4d6419a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:39964/0 (socket says 172.21.15.50:39964) 2024-09-10T10:11:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.518+0000 7f4d59e00640 1 -- 172.21.15.50:0/4008585517 learned_addr learned my addr 172.21.15.50:0/4008585517 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.518+0000 7f4d63200640 1 --2- 172.21.15.50:0/4008585517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64108f60 0x7f4d6419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.518+0000 7f4d59e00640 1 -- 172.21.15.50:0/4008585517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64108f60 msgr2=0x7f4d6419ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.518+0000 7f4d59e00640 1 --2- 172.21.15.50:0/4008585517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64108f60 0x7f4d6419ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.518+0000 7f4d59e00640 1 -- 172.21.15.50:0/4008585517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64103e30 msgr2=0x7f4d6419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.518+0000 7f4d59e00640 1 --2- 172.21.15.50:0/4008585517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64103e30 0x7f4d6419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.518+0000 7f4d59e00640 1 -- 172.21.15.50:0/4008585517 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6419f3e0 con 0x7f4d641047e0 2024-09-10T10:11:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.519+0000 7f4d59e00640 1 --2- 172.21.15.50:0/4008585517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d641047e0 0x7f4d6419a970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00e9f0 tx=0x7f4d4c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.519+0000 7f4d5be00640 1 -- 172.21.15.50:0/4008585517 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c00cd80 con 0x7f4d641047e0 2024-09-10T10:11:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.519+0000 7f4d5be00640 1 -- 172.21.15.50:0/4008585517 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d4c005500 con 0x7f4d641047e0 2024-09-10T10:11:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.519+0000 7f4d68a00640 1 -- 172.21.15.50:0/4008585517 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6419f6d0 con 0x7f4d641047e0 2024-09-10T10:11:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.519+0000 7f4d5be00640 1 -- 172.21.15.50:0/4008585517 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c010690 con 0x7f4d641047e0 2024-09-10T10:11:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.519+0000 7f4d68a00640 1 -- 172.21.15.50:0/4008585517 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d641a6fb0 con 0x7f4d641047e0 2024-09-10T10:11:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.520+0000 7f4d68a00640 1 -- 172.21.15.50:0/4008585517 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d64105310 con 0x7f4d641047e0 2024-09-10T10:11:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.522+0000 7f4d5be00640 1 -- 172.21.15.50:0/4008585517 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4d4c0046c0 con 0x7f4d641047e0 2024-09-10T10:11:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.523+0000 7f4d5be00640 1 --2- 172.21.15.50:0/4008585517 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4d480a2b80 0x7f4d480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.523+0000 7f4d5be00640 1 -- 172.21.15.50:0/4008585517 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f4d4c0cf7d0 con 0x7f4d641047e0 2024-09-10T10:11:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.523+0000 7f4d62800640 1 --2- 172.21.15.50:0/4008585517 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4d480a2b80 0x7f4d480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.524+0000 7f4d62800640 1 --2- 172.21.15.50:0/4008585517 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4d480a2b80 0x7f4d480a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4d54005fd0 tx=0x7f4d54009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.527+0000 7f4d5be00640 1 -- 172.21.15.50:0/4008585517 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d4c09c340 con 0x7f4d641047e0 2024-09-10T10:11:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.752+0000 7f4d68a00640 1 -- 172.21.15.50:0/4008585517 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4d6402d7c0 con 0x7f4d641047e0 2024-09-10T10:11:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.753+0000 7f4d5be00640 1 -- 172.21.15.50:0/4008585517 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+88 (secure 0 0 0) 0x7f4d4c09bc40 con 0x7f4d641047e0 2024-09-10T10:11:11.754 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T10:11:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.755+0000 7f4d68a00640 1 -- 172.21.15.50:0/4008585517 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4d480a2b80 msgr2=0x7f4d480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.755+0000 7f4d68a00640 1 --2- 172.21.15.50:0/4008585517 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4d480a2b80 0x7f4d480a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4d54005fd0 tx=0x7f4d54009500 comp rx=0 tx=0).stop 2024-09-10T10:11:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.755+0000 7f4d68a00640 1 -- 172.21.15.50:0/4008585517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d641047e0 msgr2=0x7f4d6419a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.755+0000 7f4d68a00640 1 --2- 172.21.15.50:0/4008585517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d641047e0 0x7f4d6419a970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00e9f0 tx=0x7f4d4c00edf0 comp rx=0 tx=0).stop 2024-09-10T10:11:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.755+0000 7f4d68a00640 1 -- 172.21.15.50:0/4008585517 shutdown_connections 2024-09-10T10:11:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.755+0000 7f4d68a00640 1 --2- 172.21.15.50:0/4008585517 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4d480a2b80 0x7f4d480a5040 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.755+0000 7f4d68a00640 1 --2- 172.21.15.50:0/4008585517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64108f60 0x7f4d6419ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.755+0000 7f4d68a00640 1 --2- 172.21.15.50:0/4008585517 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4d641047e0 0x7f4d6419a970 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.755+0000 7f4d68a00640 1 --2- 172.21.15.50:0/4008585517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64103e30 0x7f4d6419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.755+0000 7f4d68a00640 1 -- 172.21.15.50:0/4008585517 >> 172.21.15.50:0/4008585517 conn(0x7f4d640ff910 msgr2=0x7f4d64100ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:11.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.755+0000 7f4d68a00640 1 -- 172.21.15.50:0/4008585517 shutdown_connections 2024-09-10T10:11:11.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:11.755+0000 7f4d68a00640 1 -- 172.21.15.50:0/4008585517 wait complete. 2024-09-10T10:11:12.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:12 smithi189 ceph-mon[34999]: pgmap v391: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:11:12.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:12 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4008585517' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T10:11:12.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:12 smithi084 ceph-mon[34812]: pgmap v391: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:11:12.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:12 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4008585517' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T10:11:12.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:12 smithi050 ceph-mon[30354]: pgmap v391: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:11:12.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:12 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4008585517' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T10:11:12.624 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T10:11:12.624 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T10:11:12.624 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-09-10T10:11:12.624 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T10:11:12.624 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T10:11:12.624 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T10:11:12.624 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T10:11:12.624 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T10:11:12.624 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T10:11:12.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:11:12.625 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-09-10T10:11:12.661 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T10:11:12.661 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T10:11:12.661 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T10:11:12.661 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:11:12.661 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-09-10T10:11:12.661 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:11:12.661 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:11:12.661 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:11:12.662 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-09-10T10:11:12.662 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:11:12.662 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:11:12.662 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-09-10T10:11:12.662 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T10:11:12.662 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:11:12.662 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-09-10T10:11:12.662 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T10:11:12.662 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42072sec preferred_lft 42072sec 2024-09-10T10:11:12.662 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-09-10T10:11:12.662 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:11:12.662 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:11:12.662 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:11:12.663 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-09-10T10:11:12.664 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T10:11:12.664 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:11:12.664 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-10T10:11:12.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2024-09-10T10:11:12.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2024-09-10T10:11:12.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2024-09-10T10:11:12.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T10:11:12.664 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-10T10:11:12.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:11:12.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:11:12.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:11:12.895 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T10:11:12.950 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-09-10T10:11:12.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:11:12.954 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-09-10T10:11:12.990 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-09-10T10:11:12.991 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T10:11:12.991 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T10:11:12.991 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T10:11:12.991 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T10:11:12.991 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:11:12.991 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-10T10:11:12.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T10:11:12.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T10:11:12.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T10:11:12.992 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-10T10:11:13.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:11:13.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:11:13.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:11:13.192 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-10T10:11:13.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:11:13.229 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2024-09-10T10:11:13.305 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:11:13.305 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-10T10:11:13.305 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T10:11:13.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T10:11:13.306 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-10T10:11:13.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:11:13.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:11:13.483 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T10:11:13.484 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:11:13.484 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-10T10:11:13.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T10:11:13.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T10:11:13.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T10:11:13.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T10:11:13.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T10:11:13.484 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-10T10:11:13.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:11:13.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:11:13.703 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:11:13.703 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-09-10T10:11:13.703 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-09-10T10:11:13.703 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T10:11:13.704 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-09-10T10:11:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:11:13.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:11:13.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T10:11:13.872 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T10:11:13.908 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T10:11:13.908 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T10:11:13.908 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T10:11:13.982 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-10T10:11:13.982 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-10T10:11:13.982 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/1df80b48-a991-4aee-be18-584505af10da 2024-09-10T10:11:13.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:11:13.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/1df80b48-a991-4aee-be18-584505af10da /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2024-09-10T10:11:14.112 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2024-09-10T10:11:14.112 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync". 2024-09-10T10:11:14.113 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2024-09-10T10:11:14.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:14 smithi189 ceph-mon[34999]: pgmap v392: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-10T10:11:14.336 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:14 smithi050 ceph-mon[30354]: pgmap v392: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-10T10:11:14.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:14 smithi084 ceph-mon[34812]: pgmap v392: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-10T10:11:14.751 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync 2024-09-10T10:11:14.751 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync". 2024-09-10T10:11:14.751 INFO:teuthology.orchestra.run.smithi050.stdout:invalid new device string format 2024-09-10T10:11:14.751 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.84:6789,172.21.15.189:6789" 2024-09-10T10:11:14.751 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.50:6789,172.21.15.84:6789,172.21.15.189:6789:/volumes/qa/sv_1/1df80b48-a991-4aee-be18-584505af10da 2024-09-10T10:11:14.751 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,wsync,key=0,fsid=4d54e0f8-6f5b-11ef-bcea-c7b262605968" will pass to kernel 2024-09-10T10:11:14.754 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T10:11:14.754 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-09-10T10:11:14.754 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T10:11:14.754 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T10:11:14.754 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T10:11:14.757 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T10:11:14.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:11:14.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T10:11:14.816 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T10:11:14.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T10:11:14.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:11:14.909 INFO:teuthology.orchestra.run.smithi050.stdout:client15105 2024-09-10T10:11:14.909 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:11:14.909 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T10:11:14.946 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T10:11:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T10:11:15.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:11:15.078 INFO:teuthology.orchestra.run.smithi050.stdout:client15105 2024-09-10T10:11:15.079 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T10:11:15.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T10:11:15.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:11:15.168 INFO:teuthology.orchestra.run.smithi050.stdout:client15105 2024-09-10T10:11:15.169 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968.client15105/status') 2024-09-10T10:11:15.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:11:15.269 INFO:teuthology.orchestra.run.smithi050.stdout:instance: client.15105 (3)192.168.0.1:0/471923513 2024-09-10T10:11:15.270 INFO:teuthology.orchestra.run.smithi050.stdout:blocklisted: false 2024-09-10T10:11:15.270 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records in 2024-09-10T10:11:15.270 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records out 2024-09-10T10:11:15.270 INFO:teuthology.orchestra.run.smithi050.stderr:69 bytes copied, 6.0474e-05 s, 1.1 MB/s 2024-09-10T10:11:15.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:11:15.281 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T10:11:15.290 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T10:11:15.290 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2024-09-10T10:11:15.290 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-10T10:11:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.450+0000 7f8300a00640 1 -- 172.21.15.50:0/2754182833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82fc103b70 msgr2=0x7f82fc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.450+0000 7f8300a00640 1 --2- 172.21.15.50:0/2754182833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82fc103b70 0x7f82fc103f70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009900 tx=0x7f82ec02a400 comp rx=0 tx=0).stop 2024-09-10T10:11:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.450+0000 7f8300a00640 1 -- 172.21.15.50:0/2754182833 shutdown_connections 2024-09-10T10:11:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.450+0000 7f8300a00640 1 --2- 172.21.15.50:0/2754182833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82fc105720 0x7f82fc10bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.450+0000 7f8300a00640 1 --2- 172.21.15.50:0/2754182833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82fc104d60 0x7f82fc1051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.450+0000 7f8300a00640 1 --2- 172.21.15.50:0/2754182833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82fc103b70 0x7f82fc103f70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.450+0000 7f8300a00640 1 -- 172.21.15.50:0/2754182833 >> 172.21.15.50:0/2754182833 conn(0x7f82fc0ff310 msgr2=0x7f82fc101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.450+0000 7f8300a00640 1 -- 172.21.15.50:0/2754182833 shutdown_connections 2024-09-10T10:11:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.450+0000 7f8300a00640 1 -- 172.21.15.50:0/2754182833 wait complete. 2024-09-10T10:11:15.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.451+0000 7f8300a00640 1 Processor -- start 2024-09-10T10:11:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.451+0000 7f8300a00640 1 -- start start 2024-09-10T10:11:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.451+0000 7f8300a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82fc103b70 0x7f82fc199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.451+0000 7f8300a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82fc104d60 0x7f82fc19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.451+0000 7f8300a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82fc105720 0x7f82fc1a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.451+0000 7f8300a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82fc10f7f0 con 0x7f82fc103b70 2024-09-10T10:11:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.451+0000 7f8300a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f82fc10f670 con 0x7f82fc104d60 2024-09-10T10:11:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.451+0000 7f8300a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f82fc10f970 con 0x7f82fc105720 2024-09-10T10:11:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.451+0000 7f82fa800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82fc103b70 0x7f82fc199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.451+0000 7f82fb200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82fc105720 0x7f82fc1a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.451+0000 7f82fb200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82fc105720 0x7f82fc1a1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:39982/0 (socket says 172.21.15.50:39982) 2024-09-10T10:11:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.451+0000 7f82fb200640 1 -- 172.21.15.50:0/814674679 learned_addr learned my addr 172.21.15.50:0/814674679 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:15.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.451+0000 7f82f9e00640 1 --2- 172.21.15.50:0/814674679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82fc104d60 0x7f82fc19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.452+0000 7f82fb200640 1 -- 172.21.15.50:0/814674679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82fc104d60 msgr2=0x7f82fc19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.452+0000 7f82fb200640 1 --2- 172.21.15.50:0/814674679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82fc104d60 0x7f82fc19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.452+0000 7f82fb200640 1 -- 172.21.15.50:0/814674679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82fc103b70 msgr2=0x7f82fc199ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.452+0000 7f82fb200640 1 --2- 172.21.15.50:0/814674679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82fc103b70 0x7f82fc199ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.452+0000 7f82fb200640 1 -- 172.21.15.50:0/814674679 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82fc1a1ac0 con 0x7f82fc105720 2024-09-10T10:11:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.452+0000 7f82fb200640 1 --2- 172.21.15.50:0/814674679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82fc105720 0x7f82fc1a1450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82f400eb10 tx=0x7f82f400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.452+0000 7f82f3400640 1 -- 172.21.15.50:0/814674679 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f4004b20 con 0x7f82fc105720 2024-09-10T10:11:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.452+0000 7f82f3400640 1 -- 172.21.15.50:0/814674679 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82f4004cc0 con 0x7f82fc105720 2024-09-10T10:11:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.452+0000 7f8300a00640 1 -- 172.21.15.50:0/814674679 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82fc1a1db0 con 0x7f82fc105720 2024-09-10T10:11:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.452+0000 7f82f3400640 1 -- 172.21.15.50:0/814674679 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f4010760 con 0x7f82fc105720 2024-09-10T10:11:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.453+0000 7f8300a00640 1 -- 172.21.15.50:0/814674679 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82fc1a2270 con 0x7f82fc105720 2024-09-10T10:11:15.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.453+0000 7f8300a00640 1 -- 172.21.15.50:0/814674679 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82fc10afd0 con 0x7f82fc105720 2024-09-10T10:11:15.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.456+0000 7f82f3400640 1 -- 172.21.15.50:0/814674679 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f82f4045bd0 con 0x7f82fc105720 2024-09-10T10:11:15.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.457+0000 7f82f3400640 1 --2- 172.21.15.50:0/814674679 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f82e00a2b80 0x7f82e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:15.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.457+0000 7f82f3400640 1 -- 172.21.15.50:0/814674679 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f82f40cfb10 con 0x7f82fc105720 2024-09-10T10:11:15.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.457+0000 7f82fa800640 1 --2- 172.21.15.50:0/814674679 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f82e00a2b80 0x7f82e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:15.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.458+0000 7f82fa800640 1 --2- 172.21.15.50:0/814674679 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f82e00a2b80 0x7f82e00a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f82ec005ab0 tx=0x7f82ec000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:15.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.459+0000 7f82f3400640 1 -- 172.21.15.50:0/814674679 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f82f409c680 con 0x7f82fc105720 2024-09-10T10:11:15.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:15.685+0000 7f8300a00640 1 -- 172.21.15.50:0/814674679 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f82fc02d7c0 con 0x7f82fc105720 2024-09-10T10:11:16.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.058+0000 7f82f3400640 1 -- 172.21.15.50:0/814674679 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f82f409bf80 con 0x7f82fc105720 2024-09-10T10:11:16.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.061+0000 7f8300a00640 1 -- 172.21.15.50:0/814674679 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f82e00a2b80 msgr2=0x7f82e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.061+0000 7f8300a00640 1 --2- 172.21.15.50:0/814674679 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f82e00a2b80 0x7f82e00a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f82ec005ab0 tx=0x7f82ec000bc0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.061+0000 7f8300a00640 1 -- 172.21.15.50:0/814674679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82fc105720 msgr2=0x7f82fc1a1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.061+0000 7f8300a00640 1 --2- 172.21.15.50:0/814674679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82fc105720 0x7f82fc1a1450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82f400eb10 tx=0x7f82f400c2d0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.061+0000 7f8300a00640 1 -- 172.21.15.50:0/814674679 shutdown_connections 2024-09-10T10:11:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.061+0000 7f8300a00640 1 --2- 172.21.15.50:0/814674679 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f82e00a2b80 0x7f82e00a5040 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.061+0000 7f8300a00640 1 --2- 172.21.15.50:0/814674679 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f82fc105720 0x7f82fc1a1450 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.061+0000 7f8300a00640 1 --2- 172.21.15.50:0/814674679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82fc104d60 0x7f82fc19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.061+0000 7f8300a00640 1 --2- 172.21.15.50:0/814674679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82fc103b70 0x7f82fc199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.061+0000 7f8300a00640 1 -- 172.21.15.50:0/814674679 >> 172.21.15.50:0/814674679 conn(0x7f82fc0ff310 msgr2=0x7f82fc1081a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.061+0000 7f8300a00640 1 -- 172.21.15.50:0/814674679 shutdown_connections 2024-09-10T10:11:16.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.061+0000 7f8300a00640 1 -- 172.21.15.50:0/814674679 wait complete. 2024-09-10T10:11:16.082 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T10:11:16.092 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-10T10:11:16.111 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T10:11:16.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.268+0000 7f27f1600640 1 -- 172.21.15.50:0/1043937888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27ec103d30 msgr2=0x7f27ec104130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.268+0000 7f27f1600640 1 --2- 172.21.15.50:0/1043937888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27ec103d30 0x7f27ec104130 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009900 tx=0x7f27dc02a410 comp rx=0 tx=0).stop 2024-09-10T10:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.268+0000 7f27f1600640 1 -- 172.21.15.50:0/1043937888 shutdown_connections 2024-09-10T10:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.268+0000 7f27f1600640 1 --2- 172.21.15.50:0/1043937888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27ec1058e0 0x7f27ec10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.268+0000 7f27f1600640 1 --2- 172.21.15.50:0/1043937888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27ec104f20 0x7f27ec1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.268+0000 7f27f1600640 1 --2- 172.21.15.50:0/1043937888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27ec103d30 0x7f27ec104130 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.268+0000 7f27f1600640 1 -- 172.21.15.50:0/1043937888 >> 172.21.15.50:0/1043937888 conn(0x7f27ec0ff4b0 msgr2=0x7f27ec1018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.268+0000 7f27f1600640 1 -- 172.21.15.50:0/1043937888 shutdown_connections 2024-09-10T10:11:16.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.268+0000 7f27f1600640 1 -- 172.21.15.50:0/1043937888 wait complete. 2024-09-10T10:11:16.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.269+0000 7f27f1600640 1 Processor -- start 2024-09-10T10:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.269+0000 7f27f1600640 1 -- start start 2024-09-10T10:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.269+0000 7f27f1600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27ec103d30 0x7f27ec19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.269+0000 7f27f1600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27ec104f20 0x7f27ec19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.269+0000 7f27f1600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27ec1058e0 0x7f27ec1a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27f1600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec10fa00 con 0x7f27ec104f20 2024-09-10T10:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27f1600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec10f880 con 0x7f27ec1058e0 2024-09-10T10:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27f1600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec10fb80 con 0x7f27ec103d30 2024-09-10T10:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27ea000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27ec104f20 0x7f27ec19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27ea000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27ec104f20 0x7f27ec19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42554/0 (socket says 172.21.15.50:42554) 2024-09-10T10:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27ea000640 1 -- 172.21.15.50:0/1364442402 learned_addr learned my addr 172.21.15.50:0/1364442402 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27eb400640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27ec1058e0 0x7f27ec1a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27eaa00640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27ec103d30 0x7f27ec19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:16.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27eb400640 1 -- 172.21.15.50:0/1364442402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27ec103d30 msgr2=0x7f27ec19a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27eb400640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27ec103d30 0x7f27ec19a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27eb400640 1 -- 172.21.15.50:0/1364442402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27ec104f20 msgr2=0x7f27ec19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27eb400640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27ec104f20 0x7f27ec19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27eb400640 1 -- 172.21.15.50:0/1364442402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ec1a1c70 con 0x7f27ec1058e0 2024-09-10T10:11:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.270+0000 7f27ea000640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27ec104f20 0x7f27ec19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.271+0000 7f27eb400640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27ec1058e0 0x7f27ec1a1600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009fd0 tx=0x7f27e400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.271+0000 7f27e3400640 1 -- 172.21.15.50:0/1364442402 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e400ce20 con 0x7f27ec1058e0 2024-09-10T10:11:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.271+0000 7f27f1600640 1 -- 172.21.15.50:0/1364442402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ec1a1f60 con 0x7f27ec1058e0 2024-09-10T10:11:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.271+0000 7f27e3400640 1 -- 172.21.15.50:0/1364442402 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27e4005020 con 0x7f27ec1058e0 2024-09-10T10:11:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.271+0000 7f27e3400640 1 -- 172.21.15.50:0/1364442402 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4010720 con 0x7f27ec1058e0 2024-09-10T10:11:16.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.271+0000 7f27f1600640 1 -- 172.21.15.50:0/1364442402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ec1a2420 con 0x7f27ec1058e0 2024-09-10T10:11:16.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.272+0000 7f27f1600640 1 -- 172.21.15.50:0/1364442402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ec10b170 con 0x7f27ec1058e0 2024-09-10T10:11:16.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.274+0000 7f27e3400640 1 -- 172.21.15.50:0/1364442402 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f27e4005540 con 0x7f27ec1058e0 2024-09-10T10:11:16.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.275+0000 7f27e3400640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f27d00a2b90 0x7f27d00a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:16.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.275+0000 7f27e3400640 1 -- 172.21.15.50:0/1364442402 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f27e40cfb40 con 0x7f27ec1058e0 2024-09-10T10:11:16.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.276+0000 7f27eaa00640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f27d00a2b90 0x7f27d00a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:16.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.276+0000 7f27eaa00640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f27d00a2b90 0x7f27d00a5050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f27dc02aa00 tx=0x7f27dc0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:16.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.279+0000 7f27e3400640 1 -- 172.21.15.50:0/1364442402 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f27e409c6b0 con 0x7f27ec1058e0 2024-09-10T10:11:16.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:16 smithi189 ceph-mon[34999]: pgmap v393: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:11:16.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:16 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/814674679' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T10:11:16.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:16 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T10:11:16.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:16 smithi084 ceph-mon[34812]: pgmap v393: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:11:16.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:16 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/814674679' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T10:11:16.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:16 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T10:11:16.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:16 smithi050 ceph-mon[30354]: pgmap v393: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:11:16.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:16 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/814674679' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T10:11:16.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:16 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T10:11:16.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.474+0000 7f27f1600640 1 -- 172.21.15.50:0/1364442402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27ec062df0 con 0x7f27ec1058e0 2024-09-10T10:11:16.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.476+0000 7f27e3400640 1 -- 172.21.15.50:0/1364442402 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24775 (secure 0 0 0) 0x7f27e407ae20 con 0x7f27ec1058e0 2024-09-10T10:11:16.478 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:16.478 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:10:00.717554+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:11:16.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.478+0000 7f27f1600640 1 -- 172.21.15.50:0/1364442402 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f27d00a2b90 msgr2=0x7f27d00a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:16.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.478+0000 7f27f1600640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f27d00a2b90 0x7f27d00a5050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f27dc02aa00 tx=0x7f27dc0315b0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.478+0000 7f27f1600640 1 -- 172.21.15.50:0/1364442402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27ec1058e0 msgr2=0x7f27ec1a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.478+0000 7f27f1600640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27ec1058e0 0x7f27ec1a1600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009fd0 tx=0x7f27e400ef10 comp rx=0 tx=0).stop 2024-09-10T10:11:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.478+0000 7f27f1600640 1 -- 172.21.15.50:0/1364442402 shutdown_connections 2024-09-10T10:11:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.478+0000 7f27f1600640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f27d00a2b90 0x7f27d00a5050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.478+0000 7f27f1600640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27ec1058e0 0x7f27ec1a1600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.478+0000 7f27f1600640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27ec104f20 0x7f27ec19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.478+0000 7f27f1600640 1 --2- 172.21.15.50:0/1364442402 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27ec103d30 0x7f27ec19a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.478+0000 7f27f1600640 1 -- 172.21.15.50:0/1364442402 >> 172.21.15.50:0/1364442402 conn(0x7f27ec0ff4b0 msgr2=0x7f27ec108340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.478+0000 7f27f1600640 1 -- 172.21.15.50:0/1364442402 shutdown_connections 2024-09-10T10:11:16.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.478+0000 7f27f1600640 1 -- 172.21.15.50:0/1364442402 wait complete. 2024-09-10T10:11:16.497 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T10:03:29.276863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T10:08:31.657814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T10:08:34.330951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-10T10:08:42.905904+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-10T10:11:16.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T10:11:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.657+0000 7f4196400640 1 -- 172.21.15.50:0/2410362844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4190076bb0 msgr2=0x7f4190076fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.657+0000 7f4196400640 1 --2- 172.21.15.50:0/2410362844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4190076bb0 0x7f4190076fb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4180009900 tx=0x7f418002a410 comp rx=0 tx=0).stop 2024-09-10T10:11:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.657+0000 7f4196400640 1 -- 172.21.15.50:0/2410362844 shutdown_connections 2024-09-10T10:11:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.657+0000 7f4196400640 1 --2- 172.21.15.50:0/2410362844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4190078790 0x7f4190079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.657+0000 7f4196400640 1 --2- 172.21.15.50:0/2410362844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4190077df0 0x7f4190078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.657+0000 7f4196400640 1 --2- 172.21.15.50:0/2410362844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4190076bb0 0x7f4190076fb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.657+0000 7f4196400640 1 -- 172.21.15.50:0/2410362844 >> 172.21.15.50:0/2410362844 conn(0x7f41900ff4a0 msgr2=0x7f41901018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:16.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.657+0000 7f4196400640 1 -- 172.21.15.50:0/2410362844 shutdown_connections 2024-09-10T10:11:16.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.658+0000 7f4196400640 1 -- 172.21.15.50:0/2410362844 wait complete. 2024-09-10T10:11:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.658+0000 7f4196400640 1 Processor -- start 2024-09-10T10:11:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.659+0000 7f4196400640 1 -- start start 2024-09-10T10:11:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.659+0000 7f4196400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4190076bb0 0x7f419019e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.659+0000 7f4196400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4190077df0 0x7f419019e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.659+0000 7f4196400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4190078790 0x7f41901a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.659+0000 7f4196400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4190113e00 con 0x7f4190076bb0 2024-09-10T10:11:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.659+0000 7f4196400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4190113c80 con 0x7f4190077df0 2024-09-10T10:11:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.659+0000 7f4196400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4190113f80 con 0x7f4190078790 2024-09-10T10:11:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.659+0000 7f418f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4190076bb0 0x7f419019e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.659+0000 7f418f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4190076bb0 0x7f419019e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42572/0 (socket says 172.21.15.50:42572) 2024-09-10T10:11:16.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.659+0000 7f418f400640 1 -- 172.21.15.50:0/2272723515 learned_addr learned my addr 172.21.15.50:0/2272723515 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:16.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.659+0000 7f4187e00640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4190077df0 0x7f419019e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:16.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.659+0000 7f418fe00640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4190078790 0x7f41901a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:16.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.659+0000 7f418f400640 1 -- 172.21.15.50:0/2272723515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4190078790 msgr2=0x7f41901a5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:16.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.660+0000 7f418f400640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4190078790 0x7f41901a5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.660+0000 7f418f400640 1 -- 172.21.15.50:0/2272723515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4190077df0 msgr2=0x7f419019e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:16.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.660+0000 7f418f400640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4190077df0 0x7f419019e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.660+0000 7f418f400640 1 -- 172.21.15.50:0/2272723515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41901a60c0 con 0x7f4190076bb0 2024-09-10T10:11:16.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.660+0000 7f418fe00640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4190078790 0x7f41901a5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:11:16.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.660+0000 7f418f400640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4190076bb0 0x7f419019e4a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4180031440 tx=0x7f4180032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:16.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.660+0000 7f418cc00640 1 -- 172.21.15.50:0/2272723515 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418003f030 con 0x7f4190076bb0 2024-09-10T10:11:16.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.660+0000 7f418cc00640 1 -- 172.21.15.50:0/2272723515 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4180003ce0 con 0x7f4190076bb0 2024-09-10T10:11:16.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.660+0000 7f4196400640 1 -- 172.21.15.50:0/2272723515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41901a6350 con 0x7f4190076bb0 2024-09-10T10:11:16.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.660+0000 7f418cc00640 1 -- 172.21.15.50:0/2272723515 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180035070 con 0x7f4190076bb0 2024-09-10T10:11:16.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.660+0000 7f4196400640 1 -- 172.21.15.50:0/2272723515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41901a6890 con 0x7f4190076bb0 2024-09-10T10:11:16.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.661+0000 7f4196400640 1 -- 172.21.15.50:0/2272723515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4190110810 con 0x7f4190076bb0 2024-09-10T10:11:16.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.663+0000 7f418cc00640 1 -- 172.21.15.50:0/2272723515 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4180042030 con 0x7f4190076bb0 2024-09-10T10:11:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.664+0000 7f418cc00640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f41740a2c10 0x7f41740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.665+0000 7f418cc00640 1 -- 172.21.15.50:0/2272723515 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f41800ef970 con 0x7f4190076bb0 2024-09-10T10:11:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.665+0000 7f4187e00640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f41740a2c10 0x7f41740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:16.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.665+0000 7f4187e00640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f41740a2c10 0x7f41740a50d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f419019f9b0 tx=0x7f4178005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:16.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.669+0000 7f418cc00640 1 -- 172.21.15.50:0/2272723515 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41800bc4e0 con 0x7f4190076bb0 2024-09-10T10:11:16.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.854+0000 7f4196400640 1 -- 172.21.15.50:0/2272723515 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4190062df0 con 0x7f4190076bb0 2024-09-10T10:11:16.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.855+0000 7f418cc00640 1 -- 172.21.15.50:0/2272723515 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f41800bbde0 con 0x7f4190076bb0 2024-09-10T10:11:16.857 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-10T10:11:16.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.857+0000 7f4196400640 1 -- 172.21.15.50:0/2272723515 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f41740a2c10 msgr2=0x7f41740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:16.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.857+0000 7f4196400640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f41740a2c10 0x7f41740a50d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f419019f9b0 tx=0x7f4178005f90 comp rx=0 tx=0).stop 2024-09-10T10:11:16.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.857+0000 7f4196400640 1 -- 172.21.15.50:0/2272723515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4190076bb0 msgr2=0x7f419019e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:16.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.857+0000 7f4196400640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4190076bb0 0x7f419019e4a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4180031440 tx=0x7f4180032ce0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.857+0000 7f4196400640 1 -- 172.21.15.50:0/2272723515 shutdown_connections 2024-09-10T10:11:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.857+0000 7f4196400640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f41740a2c10 0x7f41740a50d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.857+0000 7f4196400640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4190078790 0x7f41901a5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.857+0000 7f4196400640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4190077df0 0x7f419019e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.857+0000 7f4196400640 1 --2- 172.21.15.50:0/2272723515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4190076bb0 0x7f419019e4a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.857+0000 7f4196400640 1 -- 172.21.15.50:0/2272723515 >> 172.21.15.50:0/2272723515 conn(0x7f41900ff4a0 msgr2=0x7f4190100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.857+0000 7f4196400640 1 -- 172.21.15.50:0/2272723515 shutdown_connections 2024-09-10T10:11:16.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:16.857+0000 7f4196400640 1 -- 172.21.15.50:0/2272723515 wait complete. 2024-09-10T10:11:16.876 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T10:11:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.036+0000 7f6458000640 1 -- 172.21.15.50:0/2420182502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64501058d0 msgr2=0x7f645010c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.036+0000 7f6458000640 1 --2- 172.21.15.50:0/2420182502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64501058d0 0x7f645010c160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6448009be0 tx=0x7f644802a6c0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.036+0000 7f6458000640 1 -- 172.21.15.50:0/2420182502 shutdown_connections 2024-09-10T10:11:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.036+0000 7f6458000640 1 --2- 172.21.15.50:0/2420182502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64501058d0 0x7f645010c160 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.036+0000 7f6458000640 1 --2- 172.21.15.50:0/2420182502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6450104f10 0x7f6450105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.036+0000 7f6458000640 1 --2- 172.21.15.50:0/2420182502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6450103d20 0x7f6450104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.036+0000 7f6458000640 1 -- 172.21.15.50:0/2420182502 >> 172.21.15.50:0/2420182502 conn(0x7f64500ff4a0 msgr2=0x7f64501018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.036+0000 7f6458000640 1 -- 172.21.15.50:0/2420182502 shutdown_connections 2024-09-10T10:11:17.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.036+0000 7f6458000640 1 -- 172.21.15.50:0/2420182502 wait complete. 2024-09-10T10:11:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.037+0000 7f6458000640 1 Processor -- start 2024-09-10T10:11:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.037+0000 7f6458000640 1 -- start start 2024-09-10T10:11:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6458000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6450103d20 0x7f645019a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6458000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6450104f10 0x7f645019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6458000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64501058d0 0x7f64501a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6458000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f645010f950 con 0x7f64501058d0 2024-09-10T10:11:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6458000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f645010f7d0 con 0x7f6450104f10 2024-09-10T10:11:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6458000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f645010fad0 con 0x7f6450103d20 2024-09-10T10:11:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6456000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64501058d0 0x7f64501a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6456000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64501058d0 0x7f64501a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51068/0 (socket says 172.21.15.50:51068) 2024-09-10T10:11:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6456000640 1 -- 172.21.15.50:0/3470370391 learned_addr learned my addr 172.21.15.50:0/3470370391 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6455600640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6450103d20 0x7f645019a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6454c00640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6450104f10 0x7f645019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6456000640 1 -- 172.21.15.50:0/3470370391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6450103d20 msgr2=0x7f645019a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6456000640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6450103d20 0x7f645019a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6456000640 1 -- 172.21.15.50:0/3470370391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6450104f10 msgr2=0x7f645019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6456000640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6450104f10 0x7f645019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.038+0000 7f6456000640 1 -- 172.21.15.50:0/3470370391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64501a1c50 con 0x7f64501058d0 2024-09-10T10:11:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.039+0000 7f6456000640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64501058d0 0x7f64501a15e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f64480305b0 tx=0x7f64480305e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.039+0000 7f644e000640 1 -- 172.21.15.50:0/3470370391 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448041020 con 0x7f64501058d0 2024-09-10T10:11:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.039+0000 7f644e000640 1 -- 172.21.15.50:0/3470370391 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6448037040 con 0x7f64501058d0 2024-09-10T10:11:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.039+0000 7f644e000640 1 -- 172.21.15.50:0/3470370391 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448036070 con 0x7f64501058d0 2024-09-10T10:11:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.039+0000 7f6458000640 1 -- 172.21.15.50:0/3470370391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64501a1ee0 con 0x7f64501058d0 2024-09-10T10:11:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.039+0000 7f6458000640 1 -- 172.21.15.50:0/3470370391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64501a2340 con 0x7f64501058d0 2024-09-10T10:11:17.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.040+0000 7f6458000640 1 -- 172.21.15.50:0/3470370391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f645010b160 con 0x7f64501058d0 2024-09-10T10:11:17.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.042+0000 7f644e000640 1 -- 172.21.15.50:0/3470370391 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6448044020 con 0x7f64501058d0 2024-09-10T10:11:17.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.044+0000 7f644e000640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f64380a2b90 0x7f64380a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:17.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.044+0000 7f644e000640 1 -- 172.21.15.50:0/3470370391 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f64480effe0 con 0x7f64501058d0 2024-09-10T10:11:17.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.044+0000 7f6455600640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f64380a2b90 0x7f64380a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:17.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.045+0000 7f6455600640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f64380a2b90 0x7f64380a5050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6450104d70 tx=0x7f6444009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:17.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.049+0000 7f644e000640 1 -- 172.21.15.50:0/3470370391 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f644804b020 con 0x7f64501058d0 2024-09-10T10:11:17.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:17 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T10:11:17.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:17 smithi050 ceph-mon[30354]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:11:17.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:17 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1364442402' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:11:17.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:17 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2272723515' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:11:17.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.235+0000 7f6458000640 1 -- 172.21.15.50:0/3470370391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6450062e90 con 0x7f64501058d0 2024-09-10T10:11:17.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.235+0000 7f644e000640 1 -- 172.21.15.50:0/3470370391 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) ==== 104+0+11 (secure 0 0 0) 0x7f64480bcb90 con 0x7f64501058d0 2024-09-10T10:11:17.238 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-10T10:11:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.238+0000 7f6458000640 1 -- 172.21.15.50:0/3470370391 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f64380a2b90 msgr2=0x7f64380a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.238+0000 7f6458000640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f64380a2b90 0x7f64380a5050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6450104d70 tx=0x7f6444009260 comp rx=0 tx=0).stop 2024-09-10T10:11:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.238+0000 7f6458000640 1 -- 172.21.15.50:0/3470370391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64501058d0 msgr2=0x7f64501a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.238+0000 7f6458000640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64501058d0 0x7f64501a15e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f64480305b0 tx=0x7f64480305e0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.238+0000 7f6458000640 1 -- 172.21.15.50:0/3470370391 shutdown_connections 2024-09-10T10:11:17.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.238+0000 7f6458000640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f64380a2b90 0x7f64380a5050 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.238+0000 7f6458000640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64501058d0 0x7f64501a15e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.238+0000 7f6458000640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6450104f10 0x7f645019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.238+0000 7f6458000640 1 --2- 172.21.15.50:0/3470370391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6450103d20 0x7f645019a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.238+0000 7f6458000640 1 -- 172.21.15.50:0/3470370391 >> 172.21.15.50:0/3470370391 conn(0x7f64500ff4a0 msgr2=0x7f6450108330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:17.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.238+0000 7f6458000640 1 -- 172.21.15.50:0/3470370391 shutdown_connections 2024-09-10T10:11:17.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.238+0000 7f6458000640 1 -- 172.21.15.50:0/3470370391 wait complete. 2024-09-10T10:11:17.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T10:11:17.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:17 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T10:11:17.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:17 smithi189 ceph-mon[34999]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:11:17.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:17 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1364442402' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:11:17.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:17 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2272723515' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:11:17.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:17 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T10:11:17.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:17 smithi084 ceph-mon[34812]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T10:11:17.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:17 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1364442402' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:11:17.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:17 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2272723515' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:11:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.415+0000 7f0231000640 1 -- 172.21.15.50:0/3788854034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f022c104f10 msgr2=0x7f022c105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.415+0000 7f0231000640 1 --2- 172.21.15.50:0/3788854034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f022c104f10 0x7f022c105390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0214009900 tx=0x7f021402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.416+0000 7f0231000640 1 -- 172.21.15.50:0/3788854034 shutdown_connections 2024-09-10T10:11:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.416+0000 7f0231000640 1 --2- 172.21.15.50:0/3788854034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f022c1058d0 0x7f022c10c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.416+0000 7f0231000640 1 --2- 172.21.15.50:0/3788854034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f022c104f10 0x7f022c105390 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.416+0000 7f0231000640 1 --2- 172.21.15.50:0/3788854034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f022c103d20 0x7f022c104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.416+0000 7f0231000640 1 -- 172.21.15.50:0/3788854034 >> 172.21.15.50:0/3788854034 conn(0x7f022c0ff4a0 msgr2=0x7f022c1018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.416+0000 7f0231000640 1 -- 172.21.15.50:0/3788854034 shutdown_connections 2024-09-10T10:11:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.416+0000 7f0231000640 1 -- 172.21.15.50:0/3788854034 wait complete. 2024-09-10T10:11:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.417+0000 7f0231000640 1 Processor -- start 2024-09-10T10:11:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.417+0000 7f0231000640 1 -- start start 2024-09-10T10:11:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.417+0000 7f0231000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f022c103d20 0x7f022c19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.417+0000 7f0231000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f022c104f10 0x7f022c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.417+0000 7f0231000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f022c1058d0 0x7f022c1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.417+0000 7f0231000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f022c10f9d0 con 0x7f022c103d20 2024-09-10T10:11:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.417+0000 7f0231000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f022c10f850 con 0x7f022c1058d0 2024-09-10T10:11:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.417+0000 7f0231000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f022c10fb50 con 0x7f022c104f10 2024-09-10T10:11:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.417+0000 7f0229e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f022c103d20 0x7f022c19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.417+0000 7f0229e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f022c103d20 0x7f022c19a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51086/0 (socket says 172.21.15.50:51086) 2024-09-10T10:11:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.417+0000 7f0229e00640 1 -- 172.21.15.50:0/274571418 learned_addr learned my addr 172.21.15.50:0/274571418 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.417+0000 7f0223e00640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f022c104f10 0x7f022c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.417+0000 7f022a800640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f022c1058d0 0x7f022c1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.418+0000 7f0229e00640 1 -- 172.21.15.50:0/274571418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f022c104f10 msgr2=0x7f022c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.418+0000 7f0229e00640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f022c104f10 0x7f022c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.418+0000 7f0229e00640 1 -- 172.21.15.50:0/274571418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f022c1058d0 msgr2=0x7f022c1a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.418+0000 7f0229e00640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f022c1058d0 0x7f022c1a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.418+0000 7f0229e00640 1 -- 172.21.15.50:0/274571418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c1a1ca0 con 0x7f022c103d20 2024-09-10T10:11:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.418+0000 7f022a800640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f022c1058d0 0x7f022c1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:11:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.418+0000 7f0229e00640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f022c103d20 0x7f022c19a080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f021c00e9c0 tx=0x7f021c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.418+0000 7f0222a00640 1 -- 172.21.15.50:0/274571418 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c00cd80 con 0x7f022c103d20 2024-09-10T10:11:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.418+0000 7f0222a00640 1 -- 172.21.15.50:0/274571418 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f021c0035f0 con 0x7f022c103d20 2024-09-10T10:11:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.418+0000 7f0231000640 1 -- 172.21.15.50:0/274571418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022c1a1f90 con 0x7f022c103d20 2024-09-10T10:11:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.418+0000 7f0222a00640 1 -- 172.21.15.50:0/274571418 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c010690 con 0x7f022c103d20 2024-09-10T10:11:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.418+0000 7f0231000640 1 -- 172.21.15.50:0/274571418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f022c1a23f0 con 0x7f022c103d20 2024-09-10T10:11:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.419+0000 7f0231000640 1 -- 172.21.15.50:0/274571418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022c10b0e0 con 0x7f022c103d20 2024-09-10T10:11:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.421+0000 7f0222a00640 1 -- 172.21.15.50:0/274571418 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f021c0037a0 con 0x7f022c103d20 2024-09-10T10:11:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.423+0000 7f0222a00640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f02100a2b90 0x7f02100a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.423+0000 7f0222a00640 1 -- 172.21.15.50:0/274571418 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f021c0cf8a0 con 0x7f022c103d20 2024-09-10T10:11:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.423+0000 7f0223e00640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f02100a2b90 0x7f02100a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:17.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.424+0000 7f0223e00640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f02100a2b90 0x7f02100a5050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0214031440 tx=0x7f02140315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:17.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.426+0000 7f0222a00640 1 -- 172.21.15.50:0/274571418 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f021c09c410 con 0x7f022c103d20 2024-09-10T10:11:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.611+0000 7f0231000640 1 -- 172.21.15.50:0/274571418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f022c062ef0 con 0x7f022c103d20 2024-09-10T10:11:17.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.611+0000 7f0222a00640 1 -- 172.21.15.50:0/274571418 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) ==== 100+0+11 (secure 0 0 0) 0x7f021c09bd10 con 0x7f022c103d20 2024-09-10T10:11:17.614 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-10T10:11:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.613+0000 7f0231000640 1 -- 172.21.15.50:0/274571418 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f02100a2b90 msgr2=0x7f02100a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.613+0000 7f0231000640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f02100a2b90 0x7f02100a5050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0214031440 tx=0x7f02140315b0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.613+0000 7f0231000640 1 -- 172.21.15.50:0/274571418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f022c103d20 msgr2=0x7f022c19a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.613+0000 7f0231000640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f022c103d20 0x7f022c19a080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f021c00e9c0 tx=0x7f021c00ee80 comp rx=0 tx=0).stop 2024-09-10T10:11:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.614+0000 7f0231000640 1 -- 172.21.15.50:0/274571418 shutdown_connections 2024-09-10T10:11:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.614+0000 7f0231000640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f02100a2b90 0x7f02100a5050 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.614+0000 7f0231000640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f022c1058d0 0x7f022c1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.614+0000 7f0231000640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f022c104f10 0x7f022c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.614+0000 7f0231000640 1 --2- 172.21.15.50:0/274571418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f022c103d20 0x7f022c19a080 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.614+0000 7f0231000640 1 -- 172.21.15.50:0/274571418 >> 172.21.15.50:0/274571418 conn(0x7f022c0ff4a0 msgr2=0x7f022c1082b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.614+0000 7f0231000640 1 -- 172.21.15.50:0/274571418 shutdown_connections 2024-09-10T10:11:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.614+0000 7f0231000640 1 -- 172.21.15.50:0/274571418 wait complete. 2024-09-10T10:11:17.632 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-10T10:11:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.791+0000 7fcece200640 1 -- 172.21.15.50:0/2941273759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec81058c0 msgr2=0x7fcec810c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.791+0000 7fcece200640 1 --2- 172.21.15.50:0/2941273759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec81058c0 0x7fcec810c150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009ca0 tx=0x7fcec002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.791+0000 7fcece200640 1 -- 172.21.15.50:0/2941273759 shutdown_connections 2024-09-10T10:11:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.791+0000 7fcece200640 1 --2- 172.21.15.50:0/2941273759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec81058c0 0x7fcec810c150 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.791+0000 7fcece200640 1 --2- 172.21.15.50:0/2941273759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcec8104f00 0x7fcec8105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.791+0000 7fcece200640 1 --2- 172.21.15.50:0/2941273759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcec8103d10 0x7fcec8104110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.791+0000 7fcece200640 1 -- 172.21.15.50:0/2941273759 >> 172.21.15.50:0/2941273759 conn(0x7fcec80ff470 msgr2=0x7fcec81018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.792+0000 7fcece200640 1 -- 172.21.15.50:0/2941273759 shutdown_connections 2024-09-10T10:11:17.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.792+0000 7fcece200640 1 -- 172.21.15.50:0/2941273759 wait complete. 2024-09-10T10:11:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.792+0000 7fcece200640 1 Processor -- start 2024-09-10T10:11:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcece200640 1 -- start start 2024-09-10T10:11:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcece200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec8103d10 0x7fcec819a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcece200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcec8104f00 0x7fcec819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcece200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcec81058c0 0x7fcec81a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcece200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcec810f9e0 con 0x7fcec8103d10 2024-09-10T10:11:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcece200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcec810f860 con 0x7fcec8104f00 2024-09-10T10:11:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcece200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcec810fb60 con 0x7fcec81058c0 2024-09-10T10:11:17.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcec7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec8103d10 0x7fcec819a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcec7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec8103d10 0x7fcec819a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51096/0 (socket says 172.21.15.50:51096) 2024-09-10T10:11:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcec7400640 1 -- 172.21.15.50:0/142110906 learned_addr learned my addr 172.21.15.50:0/142110906 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcec7e00640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcec81058c0 0x7fcec81a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcebfe00640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcec8104f00 0x7fcec819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcec7400640 1 -- 172.21.15.50:0/142110906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcec81058c0 msgr2=0x7fcec81a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcec7400640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcec81058c0 0x7fcec81a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcec7400640 1 -- 172.21.15.50:0/142110906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcec8104f00 msgr2=0x7fcec819a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcec7400640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcec8104f00 0x7fcec819a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcec7400640 1 -- 172.21.15.50:0/142110906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec81a1c30 con 0x7fcec8103d10 2024-09-10T10:11:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcebfe00640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcec8104f00 0x7fcec819a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:11:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.793+0000 7fcec7e00640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcec81058c0 0x7fcec81a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:11:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.794+0000 7fcec7400640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec8103d10 0x7fcec819a010 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fceb800e9f0 tx=0x7fceb800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:17.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.794+0000 7fcec4c00640 1 -- 172.21.15.50:0/142110906 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb800ccc0 con 0x7fcec8103d10 2024-09-10T10:11:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.794+0000 7fcec4c00640 1 -- 172.21.15.50:0/142110906 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fceb8005500 con 0x7fcec8103d10 2024-09-10T10:11:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.794+0000 7fcec4c00640 1 -- 172.21.15.50:0/142110906 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8010430 con 0x7fcec8103d10 2024-09-10T10:11:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.794+0000 7fcece200640 1 -- 172.21.15.50:0/142110906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec81a1f20 con 0x7fcec8103d10 2024-09-10T10:11:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.794+0000 7fcece200640 1 -- 172.21.15.50:0/142110906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec81a2330 con 0x7fcec8103d10 2024-09-10T10:11:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.795+0000 7fcece200640 1 -- 172.21.15.50:0/142110906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec810b0b0 con 0x7fcec8103d10 2024-09-10T10:11:17.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.798+0000 7fcec4c00640 1 -- 172.21.15.50:0/142110906 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fceb8005020 con 0x7fcec8103d10 2024-09-10T10:11:17.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.800+0000 7fcec4c00640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fceac0a2b90 0x7fceac0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:17.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.800+0000 7fcec4c00640 1 -- 172.21.15.50:0/142110906 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fceb80cf850 con 0x7fcec8103d10 2024-09-10T10:11:17.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.800+0000 7fcebfe00640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fceac0a2b90 0x7fceac0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:17.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.800+0000 7fcebfe00640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fceac0a2b90 0x7fceac0a5050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcec819b520 tx=0x7fceb0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:17.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.804+0000 7fcec4c00640 1 -- 172.21.15.50:0/142110906 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fceb809c3c0 con 0x7fcec8103d10 2024-09-10T10:11:17.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.986+0000 7fcece200640 1 -- 172.21.15.50:0/142110906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fcec8062ef0 con 0x7fcec8103d10 2024-09-10T10:11:17.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.987+0000 7fcec4c00640 1 -- 172.21.15.50:0/142110906 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v95) ==== 103+0+11 (secure 0 0 0) 0x7fceb809bcc0 con 0x7fcec8103d10 2024-09-10T10:11:17.989 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-10T10:11:17.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.989+0000 7fcece200640 1 -- 172.21.15.50:0/142110906 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fceac0a2b90 msgr2=0x7fceac0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.989+0000 7fcece200640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fceac0a2b90 0x7fceac0a5050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcec819b520 tx=0x7fceb0005f90 comp rx=0 tx=0).stop 2024-09-10T10:11:17.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.989+0000 7fcece200640 1 -- 172.21.15.50:0/142110906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec8103d10 msgr2=0x7fcec819a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:17.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.989+0000 7fcece200640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec8103d10 0x7fcec819a010 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fceb800e9f0 tx=0x7fceb800eeb0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.989+0000 7fcece200640 1 -- 172.21.15.50:0/142110906 shutdown_connections 2024-09-10T10:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.989+0000 7fcece200640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fceac0a2b90 0x7fceac0a5050 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.989+0000 7fcece200640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcec81058c0 0x7fcec81a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.989+0000 7fcece200640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcec8104f00 0x7fcec819a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.989+0000 7fcece200640 1 --2- 172.21.15.50:0/142110906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcec8103d10 0x7fcec819a010 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.989+0000 7fcece200640 1 -- 172.21.15.50:0/142110906 >> 172.21.15.50:0/142110906 conn(0x7fcec80ff470 msgr2=0x7fcec8108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.989+0000 7fcece200640 1 -- 172.21.15.50:0/142110906 shutdown_connections 2024-09-10T10:11:17.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:17.989+0000 7fcece200640 1 -- 172.21.15.50:0/142110906 wait complete. 2024-09-10T10:11:18.007 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-10T10:11:18.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:11:18.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:18 smithi189 ceph-mon[34999]: pgmap v394: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T10:11:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:18 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3470370391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T10:11:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:18 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/274571418' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T10:11:18.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:18 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/142110906' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-10T10:11:18.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:18 smithi084 ceph-mon[34812]: pgmap v394: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T10:11:18.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:18 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3470370391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T10:11:18.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:18 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/274571418' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T10:11:18.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:18 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/142110906' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-10T10:11:18.386 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:18.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:18 smithi050 ceph-mon[30354]: pgmap v394: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T10:11:18.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:18 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3470370391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T10:11:18.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:18 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/274571418' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T10:11:18.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:18 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/142110906' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-10T10:11:18.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.954+0000 7f4fb7200640 1 -- 172.21.15.50:0/2994074278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb0108f60 msgr2=0x7f4fb0110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:18.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.954+0000 7f4fb7200640 1 --2- 172.21.15.50:0/2994074278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb0108f60 0x7f4fb0110ae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009ca0 tx=0x7f4fac02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:11:18.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.954+0000 7f4fb7200640 1 -- 172.21.15.50:0/2994074278 shutdown_connections 2024-09-10T10:11:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.954+0000 7f4fb7200640 1 --2- 172.21.15.50:0/2994074278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb0108f60 0x7f4fb0110ae0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.954+0000 7f4fb7200640 1 --2- 172.21.15.50:0/2994074278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb01047e0 0x7f4fb0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.954+0000 7f4fb7200640 1 --2- 172.21.15.50:0/2994074278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb0103e30 0x7f4fb0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.954+0000 7f4fb7200640 1 -- 172.21.15.50:0/2994074278 >> 172.21.15.50:0/2994074278 conn(0x7f4fb00ff8d0 msgr2=0x7f4fb0101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.954+0000 7f4fb7200640 1 -- 172.21.15.50:0/2994074278 shutdown_connections 2024-09-10T10:11:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.954+0000 7f4fb7200640 1 -- 172.21.15.50:0/2994074278 wait complete. 2024-09-10T10:11:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.955+0000 7f4fb7200640 1 Processor -- start 2024-09-10T10:11:18.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.955+0000 7f4fb7200640 1 -- start start 2024-09-10T10:11:18.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb7200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb0103e30 0x7f4fb019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb7200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb01047e0 0x7f4fb019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb0108f60 0x7f4fb019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb7200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0113fc0 con 0x7f4fb0103e30 2024-09-10T10:11:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0113e40 con 0x7f4fb0108f60 2024-09-10T10:11:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb7200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0114140 con 0x7f4fb01047e0 2024-09-10T10:11:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb0103e30 0x7f4fb019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb0108f60 0x7f4fb019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb5400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb01047e0 0x7f4fb019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb0108f60 0x7f4fb019ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:41918/0 (socket says 172.21.15.50:41918) 2024-09-10T10:11:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb6800640 1 -- 172.21.15.50:0/3085477926 learned_addr learned my addr 172.21.15.50:0/3085477926 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb5400640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb01047e0 0x7f4fb019a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:52108/0 (socket says 172.21.15.50:52108) 2024-09-10T10:11:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb0103e30 0x7f4fb019a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51102/0 (socket says 172.21.15.50:51102) 2024-09-10T10:11:18.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.956+0000 7f4fb5400640 1 -- 172.21.15.50:0/3085477926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb0108f60 msgr2=0x7f4fb019ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.957+0000 7f4fb5400640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb0108f60 0x7f4fb019ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.957+0000 7f4fb5400640 1 -- 172.21.15.50:0/3085477926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb0103e30 msgr2=0x7f4fb019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.957+0000 7f4fb5400640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb0103e30 0x7f4fb019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.957+0000 7f4fb5400640 1 -- 172.21.15.50:0/3085477926 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb019f3b0 con 0x7f4fb01047e0 2024-09-10T10:11:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.957+0000 7f4fb6800640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb0108f60 0x7f4fb019ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.957+0000 7f4fb5400640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb01047e0 0x7f4fb019a940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000e9f0 tx=0x7f4fa000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.957+0000 7f4faaa00640 1 -- 172.21.15.50:0/3085477926 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000ccc0 con 0x7f4fb01047e0 2024-09-10T10:11:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.957+0000 7f4fb7200640 1 -- 172.21.15.50:0/3085477926 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb019f6a0 con 0x7f4fb01047e0 2024-09-10T10:11:18.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.958+0000 7f4fb7200640 1 -- 172.21.15.50:0/3085477926 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb01a6f80 con 0x7f4fb01047e0 2024-09-10T10:11:18.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.958+0000 7f4faaa00640 1 -- 172.21.15.50:0/3085477926 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fa0010910 con 0x7f4fb01047e0 2024-09-10T10:11:18.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.958+0000 7f4faaa00640 1 -- 172.21.15.50:0/3085477926 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0018880 con 0x7f4fb01047e0 2024-09-10T10:11:18.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.959+0000 7f4fb7200640 1 -- 172.21.15.50:0/3085477926 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f94005290 con 0x7f4fb01047e0 2024-09-10T10:11:18.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.961+0000 7f4faaa00640 1 -- 172.21.15.50:0/3085477926 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4fa0010430 con 0x7f4fb01047e0 2024-09-10T10:11:18.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.962+0000 7f4faaa00640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4f980a2c00 0x7f4f980a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:18.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.962+0000 7f4faaa00640 1 -- 172.21.15.50:0/3085477926 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f4fa00cf420 con 0x7f4fb01047e0 2024-09-10T10:11:18.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.962+0000 7f4fb5e00640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4f980a2c00 0x7f4f980a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:18.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.963+0000 7f4fb5e00640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4f980a2c00 0x7f4f980a50c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009bd0 tx=0x7f4fa4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:18.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:18.964+0000 7f4faaa00640 1 -- 172.21.15.50:0/3085477926 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fa009b9a0 con 0x7f4fb01047e0 2024-09-10T10:11:19.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.186+0000 7f4fb7200640 1 -- 172.21.15.50:0/3085477926 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f94005580 con 0x7f4fb01047e0 2024-09-10T10:11:19.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.187+0000 7f4faaa00640 1 -- 172.21.15.50:0/3085477926 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f4fa009fca0 con 0x7f4fb01047e0 2024-09-10T10:11:19.189 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:19.189 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:11:19.189 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:11:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.190+0000 7f4fb7200640 1 -- 172.21.15.50:0/3085477926 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4f980a2c00 msgr2=0x7f4f980a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.190+0000 7f4fb7200640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4f980a2c00 0x7f4f980a50c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009bd0 tx=0x7f4fa4005f90 comp rx=0 tx=0).stop 2024-09-10T10:11:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.190+0000 7f4fb7200640 1 -- 172.21.15.50:0/3085477926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb01047e0 msgr2=0x7f4fb019a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.190+0000 7f4fb7200640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb01047e0 0x7f4fb019a940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000e9f0 tx=0x7f4fa000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:11:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.190+0000 7f4fb7200640 1 -- 172.21.15.50:0/3085477926 shutdown_connections 2024-09-10T10:11:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.190+0000 7f4fb7200640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4f980a2c00 0x7f4f980a50c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.190+0000 7f4fb7200640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fb0108f60 0x7f4fb019ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.190+0000 7f4fb7200640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fb01047e0 0x7f4fb019a940 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.190+0000 7f4fb7200640 1 --2- 172.21.15.50:0/3085477926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb0103e30 0x7f4fb019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.190+0000 7f4fb7200640 1 -- 172.21.15.50:0/3085477926 >> 172.21.15.50:0/3085477926 conn(0x7f4fb00ff8d0 msgr2=0x7f4fb0100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:19.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.190+0000 7f4fb7200640 1 -- 172.21.15.50:0/3085477926 shutdown_connections 2024-09-10T10:11:19.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:19.190+0000 7f4fb7200640 1 -- 172.21.15.50:0/3085477926 wait complete. 2024-09-10T10:11:20.075 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-10T10:11:20.075 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-10T10:11:20.076 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T10:11:20.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.236+0000 7f115e600640 1 -- 172.21.15.50:0/2758783777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1158103d30 msgr2=0x7f1158104130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:20.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.236+0000 7f115e600640 1 --2- 172.21.15.50:0/2758783777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1158103d30 0x7f1158104130 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1148009900 tx=0x7f114802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.236+0000 7f115e600640 1 -- 172.21.15.50:0/2758783777 shutdown_connections 2024-09-10T10:11:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.236+0000 7f115e600640 1 --2- 172.21.15.50:0/2758783777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11581058e0 0x7f115810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.236+0000 7f115e600640 1 --2- 172.21.15.50:0/2758783777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1158104f20 0x7f11581053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.236+0000 7f115e600640 1 --2- 172.21.15.50:0/2758783777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1158103d30 0x7f1158104130 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.236+0000 7f115e600640 1 -- 172.21.15.50:0/2758783777 >> 172.21.15.50:0/2758783777 conn(0x7f11580ff4b0 msgr2=0x7f11581018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.236+0000 7f115e600640 1 -- 172.21.15.50:0/2758783777 shutdown_connections 2024-09-10T10:11:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.236+0000 7f115e600640 1 -- 172.21.15.50:0/2758783777 wait complete. 2024-09-10T10:11:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.237+0000 7f115e600640 1 Processor -- start 2024-09-10T10:11:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.237+0000 7f115e600640 1 -- start start 2024-09-10T10:11:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.237+0000 7f115e600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1158103d30 0x7f115819a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.237+0000 7f115e600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1158104f20 0x7f115819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.237+0000 7f115e600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11581058e0 0x7f11581a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.237+0000 7f115e600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f115810fa00 con 0x7f1158104f20 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.237+0000 7f115e600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f115810f880 con 0x7f11581058e0 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.237+0000 7f115e600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f115810fb80 con 0x7f1158103d30 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.238+0000 7f1156a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1158104f20 0x7f115819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.238+0000 7f1156a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1158104f20 0x7f115819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51116/0 (socket says 172.21.15.50:51116) 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.238+0000 7f1156a00640 1 -- 172.21.15.50:0/853148971 learned_addr learned my addr 172.21.15.50:0/853148971 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.238+0000 7f1157e00640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11581058e0 0x7f11581a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.238+0000 7f1157400640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1158103d30 0x7f115819a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.238+0000 7f1156a00640 1 -- 172.21.15.50:0/853148971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1158103d30 msgr2=0x7f115819a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.238+0000 7f1156a00640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1158103d30 0x7f115819a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.238+0000 7f1156a00640 1 -- 172.21.15.50:0/853148971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11581058e0 msgr2=0x7f11581a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.238+0000 7f1156a00640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11581058e0 0x7f11581a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.238+0000 7f1156a00640 1 -- 172.21.15.50:0/853148971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11581a1c80 con 0x7f1158104f20 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.238+0000 7f1157e00640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11581058e0 0x7f11581a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.238+0000 7f1156a00640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1158104f20 0x7f115819a5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f114400e9f0 tx=0x7f114400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.239+0000 7f114fe00640 1 -- 172.21.15.50:0/853148971 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114400cd80 con 0x7f1158104f20 2024-09-10T10:11:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.239+0000 7f114fe00640 1 -- 172.21.15.50:0/853148971 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1144010910 con 0x7f1158104f20 2024-09-10T10:11:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.239+0000 7f115e600640 1 -- 172.21.15.50:0/853148971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11581a1f70 con 0x7f1158104f20 2024-09-10T10:11:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.239+0000 7f114fe00640 1 -- 172.21.15.50:0/853148971 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144018990 con 0x7f1158104f20 2024-09-10T10:11:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.239+0000 7f115e600640 1 -- 172.21.15.50:0/853148971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11581a2430 con 0x7f1158104f20 2024-09-10T10:11:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.240+0000 7f115e600640 1 -- 172.21.15.50:0/853148971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f115810b120 con 0x7f1158104f20 2024-09-10T10:11:20.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.242+0000 7f114fe00640 1 -- 172.21.15.50:0/853148971 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1144010ac0 con 0x7f1158104f20 2024-09-10T10:11:20.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.244+0000 7f114fe00640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f113c0a2b90 0x7f113c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:20.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.244+0000 7f114fe00640 1 -- 172.21.15.50:0/853148971 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f11440cf750 con 0x7f1158104f20 2024-09-10T10:11:20.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.244+0000 7f1157400640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f113c0a2b90 0x7f113c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:20.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.245+0000 7f1157400640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f113c0a2b90 0x7f113c0a5050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f114802a9e0 tx=0x7f11480315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:20.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.247+0000 7f114fe00640 1 -- 172.21.15.50:0/853148971 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f114409bc70 con 0x7f1158104f20 2024-09-10T10:11:20.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:20 smithi189 ceph-mon[34999]: pgmap v395: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T10:11:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:20 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3085477926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:20.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:20 smithi084 ceph-mon[34812]: pgmap v395: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T10:11:20.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:20 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3085477926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:20.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.429+0000 7f115e600640 1 -- 172.21.15.50:0/853148971 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1158062630 con 0x7f113c0a2b90 2024-09-10T10:11:20.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.439+0000 7f114fe00640 1 -- 172.21.15.50:0/853148971 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340752 (secure 0 0 0) 0x7f1158062630 con 0x7f113c0a2b90 2024-09-10T10:11:20.444 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:20.446 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-10T10:11:20.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.443+0000 7f115e600640 1 -- 172.21.15.50:0/853148971 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f113c0a2b90 msgr2=0x7f113c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:20.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.443+0000 7f115e600640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f113c0a2b90 0x7f113c0a5050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f114802a9e0 tx=0x7f11480315b0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.443+0000 7f115e600640 1 -- 172.21.15.50:0/853148971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1158104f20 msgr2=0x7f115819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:20.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.443+0000 7f115e600640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1158104f20 0x7f115819a5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f114400e9f0 tx=0x7f114400eeb0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.443+0000 7f115e600640 1 -- 172.21.15.50:0/853148971 shutdown_connections 2024-09-10T10:11:20.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.443+0000 7f115e600640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f113c0a2b90 0x7f113c0a5050 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.443+0000 7f115e600640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11581058e0 0x7f11581a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.443+0000 7f115e600640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1158104f20 0x7f115819a5a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.443+0000 7f115e600640 1 --2- 172.21.15.50:0/853148971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1158103d30 0x7f115819a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.443+0000 7f115e600640 1 -- 172.21.15.50:0/853148971 >> 172.21.15.50:0/853148971 conn(0x7f11580ff4b0 msgr2=0x7f11581082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:20.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.443+0000 7f115e600640 1 -- 172.21.15.50:0/853148971 shutdown_connections 2024-09-10T10:11:20.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.443+0000 7f115e600640 1 -- 172.21.15.50:0/853148971 wait complete. 2024-09-10T10:11:20.458 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:20 smithi050 ceph-mon[30354]: pgmap v395: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T10:11:20.458 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:20 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3085477926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:20.460 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":395,"stamp":"2024-09-10T10:11:18.804526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657916,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":819,"num_read_kb":529,"num_write":363,"num_write_kb":3067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":793,"ondisk_log_size":793,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366100,"kb_used_data":12692,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575724,"statfs":{"total":1151940427776,"available":1151565541376,"internally_reserved":0,"allocated":12996608,"data_stored":8408894,"data_compressed":498339,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":311,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003037"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724648+0000","last_change":"2024-09-10T10:08:32.889755+0000","last_active":"2024-09-10T10:10:00.724648+0000","last_peered":"2024-09-10T10:10:00.724648+0000","last_clean":"2024-09-10T10:10:00.724648+0000","last_became_active":"2024-09-10T10:08:32.889455+0000","last_became_peered":"2024-09-10T10:08:32.889455+0000","last_unstale":"2024-09-10T10:10:00.724648+0000","last_undegraded":"2024-09-10T10:10:00.724648+0000","last_fullsized":"2024-09-10T10:10:00.724648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:53.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"95'5","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.760977+0000","last_change":"2024-09-10T10:10:00.974216+0000","last_active":"2024-09-10T10:10:58.760977+0000","last_peered":"2024-09-10T10:10:58.760977+0000","last_clean":"2024-09-10T10:10:58.760977+0000","last_became_active":"2024-09-10T10:10:00.973841+0000","last_became_peered":"2024-09-10T10:10:00.973841+0000","last_unstale":"2024-09-10T10:10:58.760977+0000","last_undegraded":"2024-09-10T10:10:58.760977+0000","last_fullsized":"2024-09-10T10:10:58.760977+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:30.575610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972516+0000","last_change":"2024-09-10T10:08:44.399836+0000","last_active":"2024-09-10T10:10:00.972516+0000","last_peered":"2024-09-10T10:10:00.972516+0000","last_clean":"2024-09-10T10:10:00.972516+0000","last_became_active":"2024-09-10T10:08:44.399510+0000","last_became_peered":"2024-09-10T10:08:44.399510+0000","last_unstale":"2024-09-10T10:10:00.972516+0000","last_undegraded":"2024-09-10T10:10:00.972516+0000","last_fullsized":"2024-09-10T10:10:00.972516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:47.372690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722255+0000","last_change":"2024-09-10T10:08:32.887099+0000","last_active":"2024-09-10T10:10:00.722255+0000","last_peered":"2024-09-10T10:10:00.722255+0000","last_clean":"2024-09-10T10:10:00.722255+0000","last_became_active":"2024-09-10T10:08:32.886730+0000","last_became_peered":"2024-09-10T10:08:32.886730+0000","last_unstale":"2024-09-10T10:10:00.722255+0000","last_undegraded":"2024-09-10T10:10:00.722255+0000","last_fullsized":"2024-09-10T10:10:00.722255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.277241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.777729+0000","last_change":"2024-09-10T10:08:35.375494+0000","last_active":"2024-09-10T10:10:58.777729+0000","last_peered":"2024-09-10T10:10:58.777729+0000","last_clean":"2024-09-10T10:10:58.777729+0000","last_became_active":"2024-09-10T10:08:35.373991+0000","last_became_peered":"2024-09-10T10:08:35.373991+0000","last_unstale":"2024-09-10T10:10:58.777729+0000","last_undegraded":"2024-09-10T10:10:58.777729+0000","last_fullsized":"2024-09-10T10:10:58.777729+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:25.858163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721597+0000","last_change":"2024-09-10T10:09:00.457967+0000","last_active":"2024-09-10T10:10:00.721597+0000","last_peered":"2024-09-10T10:10:00.721597+0000","last_clean":"2024-09-10T10:10:00.721597+0000","last_became_active":"2024-09-10T10:09:00.457446+0000","last_became_peered":"2024-09-10T10:09:00.457446+0000","last_unstale":"2024-09-10T10:10:00.721597+0000","last_undegraded":"2024-09-10T10:10:00.721597+0000","last_fullsized":"2024-09-10T10:10:00.721597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:00.550304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722817+0000","last_change":"2024-09-10T10:08:32.890270+0000","last_active":"2024-09-10T10:10:00.722817+0000","last_peered":"2024-09-10T10:10:00.722817+0000","last_clean":"2024-09-10T10:10:00.722817+0000","last_became_active":"2024-09-10T10:08:32.889887+0000","last_became_peered":"2024-09-10T10:08:32.889887+0000","last_unstale":"2024-09-10T10:10:00.722817+0000","last_undegraded":"2024-09-10T10:10:00.722817+0000","last_fullsized":"2024-09-10T10:10:00.722817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:39.757510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774008+0000","last_change":"2024-09-10T10:08:35.357257+0000","last_active":"2024-09-10T10:10:58.774008+0000","last_peered":"2024-09-10T10:10:58.774008+0000","last_clean":"2024-09-10T10:10:58.774008+0000","last_became_active":"2024-09-10T10:08:35.356918+0000","last_became_peered":"2024-09-10T10:08:35.356918+0000","last_unstale":"2024-09-10T10:10:58.774008+0000","last_undegraded":"2024-09-10T10:10:58.774008+0000","last_fullsized":"2024-09-10T10:10:58.774008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:04.387581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722105+0000","last_change":"2024-09-10T10:09:00.487116+0000","last_active":"2024-09-10T10:10:00.722105+0000","last_peered":"2024-09-10T10:10:00.722105+0000","last_clean":"2024-09-10T10:10:00.722105+0000","last_became_active":"2024-09-10T10:09:00.486646+0000","last_became_peered":"2024-09-10T10:09:00.486646+0000","last_unstale":"2024-09-10T10:10:00.722105+0000","last_undegraded":"2024-09-10T10:10:00.722105+0000","last_fullsized":"2024-09-10T10:10:00.722105+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:40.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722877+0000","last_change":"2024-09-10T10:08:32.891399+0000","last_active":"2024-09-10T10:10:00.722877+0000","last_peered":"2024-09-10T10:10:00.722877+0000","last_clean":"2024-09-10T10:10:00.722877+0000","last_became_active":"2024-09-10T10:08:32.891022+0000","last_became_peered":"2024-09-10T10:08:32.891022+0000","last_unstale":"2024-09-10T10:10:00.722877+0000","last_undegraded":"2024-09-10T10:10:00.722877+0000","last_fullsized":"2024-09-10T10:10:00.722877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:30.842443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771765+0000","last_change":"2024-09-10T10:08:35.370630+0000","last_active":"2024-09-10T10:10:58.771765+0000","last_peered":"2024-09-10T10:10:58.771765+0000","last_clean":"2024-09-10T10:10:58.771765+0000","last_became_active":"2024-09-10T10:08:35.370263+0000","last_became_peered":"2024-09-10T10:08:35.370263+0000","last_unstale":"2024-09-10T10:10:58.771765+0000","last_undegraded":"2024-09-10T10:10:58.771765+0000","last_fullsized":"2024-09-10T10:10:58.771765+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:41.549815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721697+0000","last_change":"2024-09-10T10:08:44.405298+0000","last_active":"2024-09-10T10:10:00.721697+0000","last_peered":"2024-09-10T10:10:00.721697+0000","last_clean":"2024-09-10T10:10:00.721697+0000","last_became_active":"2024-09-10T10:08:44.405027+0000","last_became_peered":"2024-09-10T10:08:44.405027+0000","last_unstale":"2024-09-10T10:10:00.721697+0000","last_undegraded":"2024-09-10T10:10:00.721697+0000","last_fullsized":"2024-09-10T10:10:00.721697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:08.486563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776546+0000","last_change":"2024-09-10T10:08:35.369040+0000","last_active":"2024-09-10T10:10:58.776546+0000","last_peered":"2024-09-10T10:10:58.776546+0000","last_clean":"2024-09-10T10:10:58.776546+0000","last_became_active":"2024-09-10T10:08:35.368576+0000","last_became_peered":"2024-09-10T10:08:35.368576+0000","last_unstale":"2024-09-10T10:10:58.776546+0000","last_undegraded":"2024-09-10T10:10:58.776546+0000","last_fullsized":"2024-09-10T10:10:58.776546+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:44.887554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722399+0000","last_change":"2024-09-10T10:08:32.889549+0000","last_active":"2024-09-10T10:10:00.722399+0000","last_peered":"2024-09-10T10:10:00.722399+0000","last_clean":"2024-09-10T10:10:00.722399+0000","last_became_active":"2024-09-10T10:08:32.889197+0000","last_became_peered":"2024-09-10T10:08:32.889197+0000","last_unstale":"2024-09-10T10:10:00.722399+0000","last_undegraded":"2024-09-10T10:10:00.722399+0000","last_fullsized":"2024-09-10T10:10:00.722399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:53.697069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721966+0000","last_change":"2024-09-10T10:08:44.929048+0000","last_active":"2024-09-10T10:10:00.721966+0000","last_peered":"2024-09-10T10:10:00.721966+0000","last_clean":"2024-09-10T10:10:00.721966+0000","last_became_active":"2024-09-10T10:08:44.928345+0000","last_became_peered":"2024-09-10T10:08:44.928345+0000","last_unstale":"2024-09-10T10:10:00.721966+0000","last_undegraded":"2024-09-10T10:10:00.721966+0000","last_fullsized":"2024-09-10T10:10:00.721966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:23.121853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776712+0000","last_change":"2024-09-10T10:08:35.377385+0000","last_active":"2024-09-10T10:10:58.776712+0000","last_peered":"2024-09-10T10:10:58.776712+0000","last_clean":"2024-09-10T10:10:58.776712+0000","last_became_active":"2024-09-10T10:08:35.377092+0000","last_became_peered":"2024-09-10T10:08:35.377092+0000","last_unstale":"2024-09-10T10:10:58.776712+0000","last_undegraded":"2024-09-10T10:10:58.776712+0000","last_fullsized":"2024-09-10T10:10:58.776712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:23.169370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972319+0000","last_change":"2024-09-10T10:08:32.891614+0000","last_active":"2024-09-10T10:10:00.972319+0000","last_peered":"2024-09-10T10:10:00.972319+0000","last_clean":"2024-09-10T10:10:00.972319+0000","last_became_active":"2024-09-10T10:08:32.891141+0000","last_became_peered":"2024-09-10T10:08:32.891141+0000","last_unstale":"2024-09-10T10:10:00.972319+0000","last_undegraded":"2024-09-10T10:10:00.972319+0000","last_fullsized":"2024-09-10T10:10:00.972319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:20.258863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721932+0000","last_change":"2024-09-10T10:08:44.401125+0000","last_active":"2024-09-10T10:10:00.721932+0000","last_peered":"2024-09-10T10:10:00.721932+0000","last_clean":"2024-09-10T10:10:00.721932+0000","last_became_active":"2024-09-10T10:08:44.400483+0000","last_became_peered":"2024-09-10T10:08:44.400483+0000","last_unstale":"2024-09-10T10:10:00.721932+0000","last_undegraded":"2024-09-10T10:10:00.721932+0000","last_fullsized":"2024-09-10T10:10:00.721932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:12.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766815+0000","last_change":"2024-09-10T10:08:35.376806+0000","last_active":"2024-09-10T10:10:58.766815+0000","last_peered":"2024-09-10T10:10:58.766815+0000","last_clean":"2024-09-10T10:10:58.766815+0000","last_became_active":"2024-09-10T10:08:35.376400+0000","last_became_peered":"2024-09-10T10:08:35.376400+0000","last_unstale":"2024-09-10T10:10:58.766815+0000","last_undegraded":"2024-09-10T10:10:58.766815+0000","last_fullsized":"2024-09-10T10:10:58.766815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:48.303039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721567+0000","last_change":"2024-09-10T10:08:32.883881+0000","last_active":"2024-09-10T10:10:00.721567+0000","last_peered":"2024-09-10T10:10:00.721567+0000","last_clean":"2024-09-10T10:10:00.721567+0000","last_became_active":"2024-09-10T10:08:32.883540+0000","last_became_peered":"2024-09-10T10:08:32.883540+0000","last_unstale":"2024-09-10T10:10:00.721567+0000","last_undegraded":"2024-09-10T10:10:00.721567+0000","last_fullsized":"2024-09-10T10:10:00.721567+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:57.359729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724324+0000","last_change":"2024-09-10T10:08:44.401548+0000","last_active":"2024-09-10T10:10:00.724324+0000","last_peered":"2024-09-10T10:10:00.724324+0000","last_clean":"2024-09-10T10:10:00.724324+0000","last_became_active":"2024-09-10T10:08:44.401034+0000","last_became_peered":"2024-09-10T10:08:44.401034+0000","last_unstale":"2024-09-10T10:10:00.724324+0000","last_undegraded":"2024-09-10T10:10:00.724324+0000","last_fullsized":"2024-09-10T10:10:00.724324+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:17.292973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"95'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.760304+0000","last_change":"2024-09-10T10:08:35.359969+0000","last_active":"2024-09-10T10:10:58.760304+0000","last_peered":"2024-09-10T10:10:58.760304+0000","last_clean":"2024-09-10T10:10:58.760304+0000","last_became_active":"2024-09-10T10:08:35.359599+0000","last_became_peered":"2024-09-10T10:08:35.359599+0000","last_unstale":"2024-09-10T10:10:58.760304+0000","last_undegraded":"2024-09-10T10:10:58.760304+0000","last_fullsized":"2024-09-10T10:10:58.760304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:00.778269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862147+0000","last_change":"2024-09-10T10:09:00.487582+0000","last_active":"2024-09-10T10:10:00.862147+0000","last_peered":"2024-09-10T10:10:00.862147+0000","last_clean":"2024-09-10T10:10:00.862147+0000","last_became_active":"2024-09-10T10:09:00.487229+0000","last_became_peered":"2024-09-10T10:09:00.487229+0000","last_unstale":"2024-09-10T10:10:00.862147+0000","last_undegraded":"2024-09-10T10:10:00.862147+0000","last_fullsized":"2024-09-10T10:10:00.862147+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:53.341736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722077+0000","last_change":"2024-09-10T10:08:44.929224+0000","last_active":"2024-09-10T10:10:00.722077+0000","last_peered":"2024-09-10T10:10:00.722077+0000","last_clean":"2024-09-10T10:10:00.722077+0000","last_became_active":"2024-09-10T10:08:44.928640+0000","last_became_peered":"2024-09-10T10:08:44.928640+0000","last_unstale":"2024-09-10T10:10:00.722077+0000","last_undegraded":"2024-09-10T10:10:00.722077+0000","last_fullsized":"2024-09-10T10:10:00.722077+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:42.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778123+0000","last_change":"2024-09-10T10:08:35.376585+0000","last_active":"2024-09-10T10:10:58.778123+0000","last_peered":"2024-09-10T10:10:58.778123+0000","last_clean":"2024-09-10T10:10:58.778123+0000","last_became_active":"2024-09-10T10:08:35.375693+0000","last_became_peered":"2024-09-10T10:08:35.375693+0000","last_unstale":"2024-09-10T10:10:58.778123+0000","last_undegraded":"2024-09-10T10:10:58.778123+0000","last_fullsized":"2024-09-10T10:10:58.778123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:59.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722314+0000","last_change":"2024-09-10T10:08:32.884542+0000","last_active":"2024-09-10T10:10:00.722314+0000","last_peered":"2024-09-10T10:10:00.722314+0000","last_clean":"2024-09-10T10:10:00.722314+0000","last_became_active":"2024-09-10T10:08:32.884192+0000","last_became_peered":"2024-09-10T10:08:32.884192+0000","last_unstale":"2024-09-10T10:10:00.722314+0000","last_undegraded":"2024-09-10T10:10:00.722314+0000","last_fullsized":"2024-09-10T10:10:00.722314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:57.756641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972690+0000","last_change":"2024-09-10T10:08:44.391514+0000","last_active":"2024-09-10T10:10:00.972690+0000","last_peered":"2024-09-10T10:10:00.972690+0000","last_clean":"2024-09-10T10:10:00.972690+0000","last_became_active":"2024-09-10T10:08:44.391116+0000","last_became_peered":"2024-09-10T10:08:44.391116+0000","last_unstale":"2024-09-10T10:10:00.972690+0000","last_undegraded":"2024-09-10T10:10:00.972690+0000","last_fullsized":"2024-09-10T10:10:00.972690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:41.586014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.768916+0000","last_change":"2024-09-10T10:08:35.365604+0000","last_active":"2024-09-10T10:10:58.768916+0000","last_peered":"2024-09-10T10:10:58.768916+0000","last_clean":"2024-09-10T10:10:58.768916+0000","last_became_active":"2024-09-10T10:08:35.364915+0000","last_became_peered":"2024-09-10T10:08:35.364915+0000","last_unstale":"2024-09-10T10:10:58.768916+0000","last_undegraded":"2024-09-10T10:10:58.768916+0000","last_fullsized":"2024-09-10T10:10:58.768916+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:12.885021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'12","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:43.962125+0000","last_change":"2024-09-10T10:08:32.888223+0000","last_active":"2024-09-10T10:10:43.962125+0000","last_peered":"2024-09-10T10:10:43.962125+0000","last_clean":"2024-09-10T10:10:43.962125+0000","last_became_active":"2024-09-10T10:08:32.887919+0000","last_became_peered":"2024-09-10T10:08:32.887919+0000","last_unstale":"2024-09-10T10:10:43.962125+0000","last_undegraded":"2024-09-10T10:10:43.962125+0000","last_fullsized":"2024-09-10T10:10:43.962125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:19.781337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721073+0000","last_change":"2024-09-10T10:08:44.929322+0000","last_active":"2024-09-10T10:10:00.721073+0000","last_peered":"2024-09-10T10:10:00.721073+0000","last_clean":"2024-09-10T10:10:00.721073+0000","last_became_active":"2024-09-10T10:08:44.928252+0000","last_became_peered":"2024-09-10T10:08:44.928252+0000","last_unstale":"2024-09-10T10:10:00.721073+0000","last_undegraded":"2024-09-10T10:10:00.721073+0000","last_fullsized":"2024-09-10T10:10:00.721073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:33.048265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762075+0000","last_change":"2024-09-10T10:08:35.364168+0000","last_active":"2024-09-10T10:10:58.762075+0000","last_peered":"2024-09-10T10:10:58.762075+0000","last_clean":"2024-09-10T10:10:58.762075+0000","last_became_active":"2024-09-10T10:08:35.363739+0000","last_became_peered":"2024-09-10T10:08:35.363739+0000","last_unstale":"2024-09-10T10:10:58.762075+0000","last_undegraded":"2024-09-10T10:10:58.762075+0000","last_fullsized":"2024-09-10T10:10:58.762075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:43.029409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722836+0000","last_change":"2024-09-10T10:08:32.893021+0000","last_active":"2024-09-10T10:10:00.722836+0000","last_peered":"2024-09-10T10:10:00.722836+0000","last_clean":"2024-09-10T10:10:00.722836+0000","last_became_active":"2024-09-10T10:08:32.892667+0000","last_became_peered":"2024-09-10T10:08:32.892667+0000","last_unstale":"2024-09-10T10:10:00.722836+0000","last_undegraded":"2024-09-10T10:10:00.722836+0000","last_fullsized":"2024-09-10T10:10:00.722836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:52.427489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185575+0000","last_change":"2024-09-10T10:08:44.393831+0000","last_active":"2024-09-10T10:10:01.185575+0000","last_peered":"2024-09-10T10:10:01.185575+0000","last_clean":"2024-09-10T10:10:01.185575+0000","last_became_active":"2024-09-10T10:08:44.393415+0000","last_became_peered":"2024-09-10T10:08:44.393415+0000","last_unstale":"2024-09-10T10:10:01.185575+0000","last_undegraded":"2024-09-10T10:10:01.185575+0000","last_fullsized":"2024-09-10T10:10:01.185575+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:52.171292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769530+0000","last_change":"2024-09-10T10:08:35.374787+0000","last_active":"2024-09-10T10:10:58.769530+0000","last_peered":"2024-09-10T10:10:58.769530+0000","last_clean":"2024-09-10T10:10:58.769530+0000","last_became_active":"2024-09-10T10:08:35.374549+0000","last_became_peered":"2024-09-10T10:08:35.374549+0000","last_unstale":"2024-09-10T10:10:58.769530+0000","last_undegraded":"2024-09-10T10:10:58.769530+0000","last_fullsized":"2024-09-10T10:10:58.769530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:58.925515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724437+0000","last_change":"2024-09-10T10:08:32.886267+0000","last_active":"2024-09-10T10:10:00.724437+0000","last_peered":"2024-09-10T10:10:00.724437+0000","last_clean":"2024-09-10T10:10:00.724437+0000","last_became_active":"2024-09-10T10:08:32.885869+0000","last_became_peered":"2024-09-10T10:08:32.885869+0000","last_unstale":"2024-09-10T10:10:00.724437+0000","last_undegraded":"2024-09-10T10:10:00.724437+0000","last_fullsized":"2024-09-10T10:10:00.724437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:06.784839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722243+0000","last_change":"2024-09-10T10:09:00.486656+0000","last_active":"2024-09-10T10:10:00.722243+0000","last_peered":"2024-09-10T10:10:00.722243+0000","last_clean":"2024-09-10T10:10:00.722243+0000","last_became_active":"2024-09-10T10:09:00.486072+0000","last_became_peered":"2024-09-10T10:09:00.486072+0000","last_unstale":"2024-09-10T10:10:00.722243+0000","last_undegraded":"2024-09-10T10:10:00.722243+0000","last_fullsized":"2024-09-10T10:10:00.722243+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:26.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767023+0000","last_change":"2024-09-10T10:08:35.366130+0000","last_active":"2024-09-10T10:10:58.767023+0000","last_peered":"2024-09-10T10:10:58.767023+0000","last_clean":"2024-09-10T10:10:58.767023+0000","last_became_active":"2024-09-10T10:08:35.365785+0000","last_became_peered":"2024-09-10T10:08:35.365785+0000","last_unstale":"2024-09-10T10:10:58.767023+0000","last_undegraded":"2024-09-10T10:10:58.767023+0000","last_fullsized":"2024-09-10T10:10:58.767023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:35.771767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184987+0000","last_change":"2024-09-10T10:08:32.884113+0000","last_active":"2024-09-10T10:10:01.184987+0000","last_peered":"2024-09-10T10:10:01.184987+0000","last_clean":"2024-09-10T10:10:01.184987+0000","last_became_active":"2024-09-10T10:08:32.883503+0000","last_became_peered":"2024-09-10T10:08:32.883503+0000","last_unstale":"2024-09-10T10:10:01.184987+0000","last_undegraded":"2024-09-10T10:10:01.184987+0000","last_fullsized":"2024-09-10T10:10:01.184987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:20.513465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040285+0000","last_change":"2024-09-10T10:08:44.400137+0000","last_active":"2024-09-10T10:10:01.040285+0000","last_peered":"2024-09-10T10:10:01.040285+0000","last_clean":"2024-09-10T10:10:01.040285+0000","last_became_active":"2024-09-10T10:08:44.398736+0000","last_became_peered":"2024-09-10T10:08:44.398736+0000","last_unstale":"2024-09-10T10:10:01.040285+0000","last_undegraded":"2024-09-10T10:10:01.040285+0000","last_fullsized":"2024-09-10T10:10:01.040285+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:48.922732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.756485+0000","last_change":"2024-09-10T10:08:35.360818+0000","last_active":"2024-09-10T10:10:58.756485+0000","last_peered":"2024-09-10T10:10:58.756485+0000","last_clean":"2024-09-10T10:10:58.756485+0000","last_became_active":"2024-09-10T10:08:35.360504+0000","last_became_peered":"2024-09-10T10:08:35.360504+0000","last_unstale":"2024-09-10T10:10:58.756485+0000","last_undegraded":"2024-09-10T10:10:58.756485+0000","last_fullsized":"2024-09-10T10:10:58.756485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:45.396069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"95'5","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:15.700178+0000","last_change":"2024-09-10T10:08:32.883915+0000","last_active":"2024-09-10T10:11:15.700178+0000","last_peered":"2024-09-10T10:11:15.700178+0000","last_clean":"2024-09-10T10:11:15.700178+0000","last_became_active":"2024-09-10T10:08:32.883573+0000","last_became_peered":"2024-09-10T10:08:32.883573+0000","last_unstale":"2024-09-10T10:11:15.700178+0000","last_undegraded":"2024-09-10T10:11:15.700178+0000","last_fullsized":"2024-09-10T10:11:15.700178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:56.271267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040574+0000","last_change":"2024-09-10T10:08:44.928968+0000","last_active":"2024-09-10T10:10:01.040574+0000","last_peered":"2024-09-10T10:10:01.040574+0000","last_clean":"2024-09-10T10:10:01.040574+0000","last_became_active":"2024-09-10T10:08:44.928445+0000","last_became_peered":"2024-09-10T10:08:44.928445+0000","last_unstale":"2024-09-10T10:10:01.040574+0000","last_undegraded":"2024-09-10T10:10:01.040574+0000","last_fullsized":"2024-09-10T10:10:01.040574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:01.799454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.748248+0000","last_change":"2024-09-10T10:08:35.369027+0000","last_active":"2024-09-10T10:10:58.748248+0000","last_peered":"2024-09-10T10:10:58.748248+0000","last_clean":"2024-09-10T10:10:58.748248+0000","last_became_active":"2024-09-10T10:08:35.368692+0000","last_became_peered":"2024-09-10T10:08:35.368692+0000","last_unstale":"2024-09-10T10:10:58.748248+0000","last_undegraded":"2024-09-10T10:10:58.748248+0000","last_fullsized":"2024-09-10T10:10:58.748248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:09.500617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184814+0000","last_change":"2024-09-10T10:08:32.888661+0000","last_active":"2024-09-10T10:10:01.184814+0000","last_peered":"2024-09-10T10:10:01.184814+0000","last_clean":"2024-09-10T10:10:01.184814+0000","last_became_active":"2024-09-10T10:08:32.888312+0000","last_became_peered":"2024-09-10T10:08:32.888312+0000","last_unstale":"2024-09-10T10:10:01.184814+0000","last_undegraded":"2024-09-10T10:10:01.184814+0000","last_fullsized":"2024-09-10T10:10:01.184814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:47.293560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840405+0000","last_change":"2024-09-10T10:08:44.929512+0000","last_active":"2024-09-10T10:10:00.840405+0000","last_peered":"2024-09-10T10:10:00.840405+0000","last_clean":"2024-09-10T10:10:00.840405+0000","last_became_active":"2024-09-10T10:08:44.928992+0000","last_became_peered":"2024-09-10T10:08:44.928992+0000","last_unstale":"2024-09-10T10:10:00.840405+0000","last_undegraded":"2024-09-10T10:10:00.840405+0000","last_fullsized":"2024-09-10T10:10:00.840405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:31.827967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'8","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766202+0000","last_change":"2024-09-10T10:10:00.863430+0000","last_active":"2024-09-10T10:10:58.766202+0000","last_peered":"2024-09-10T10:10:58.766202+0000","last_clean":"2024-09-10T10:10:58.766202+0000","last_became_active":"2024-09-10T10:10:00.863082+0000","last_became_peered":"2024-09-10T10:10:00.863082+0000","last_unstale":"2024-09-10T10:10:58.766202+0000","last_undegraded":"2024-09-10T10:10:58.766202+0000","last_fullsized":"2024-09-10T10:10:58.766202+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:24.848797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722248+0000","last_change":"2024-09-10T10:08:32.885451+0000","last_active":"2024-09-10T10:10:00.722248+0000","last_peered":"2024-09-10T10:10:00.722248+0000","last_clean":"2024-09-10T10:10:00.722248+0000","last_became_active":"2024-09-10T10:08:32.885102+0000","last_became_peered":"2024-09-10T10:08:32.885102+0000","last_unstale":"2024-09-10T10:10:00.722248+0000","last_undegraded":"2024-09-10T10:10:00.722248+0000","last_fullsized":"2024-09-10T10:10:00.722248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:52.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":356,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185287+0000","last_change":"2024-09-10T10:07:13.661841+0000","last_active":"2024-09-10T10:10:01.185287+0000","last_peered":"2024-09-10T10:10:01.185287+0000","last_clean":"2024-09-10T10:10:01.185287+0000","last_became_active":"2024-09-10T10:07:13.661310+0000","last_became_peered":"2024-09-10T10:07:13.661310+0000","last_unstale":"2024-09-10T10:10:01.185287+0000","last_undegraded":"2024-09-10T10:10:01.185287+0000","last_fullsized":"2024-09-10T10:10:01.185287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_clean_scrub_stamp":"2024-09-10T10:03:29.327083+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:39.414636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185638+0000","last_change":"2024-09-10T10:08:44.391277+0000","last_active":"2024-09-10T10:10:01.185638+0000","last_peered":"2024-09-10T10:10:01.185638+0000","last_clean":"2024-09-10T10:10:01.185638+0000","last_became_active":"2024-09-10T10:08:44.390867+0000","last_became_peered":"2024-09-10T10:08:44.390867+0000","last_unstale":"2024-09-10T10:10:01.185638+0000","last_undegraded":"2024-09-10T10:10:01.185638+0000","last_fullsized":"2024-09-10T10:10:01.185638+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:23.299812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772994+0000","last_change":"2024-09-10T10:08:35.364750+0000","last_active":"2024-09-10T10:10:58.772994+0000","last_peered":"2024-09-10T10:10:58.772994+0000","last_clean":"2024-09-10T10:10:58.772994+0000","last_became_active":"2024-09-10T10:08:35.364034+0000","last_became_peered":"2024-09-10T10:08:35.364034+0000","last_unstale":"2024-09-10T10:10:58.772994+0000","last_undegraded":"2024-09-10T10:10:58.772994+0000","last_fullsized":"2024-09-10T10:10:58.772994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:15.296086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973375+0000","last_change":"2024-09-10T10:08:32.886884+0000","last_active":"2024-09-10T10:10:00.973375+0000","last_peered":"2024-09-10T10:10:00.973375+0000","last_clean":"2024-09-10T10:10:00.973375+0000","last_became_active":"2024-09-10T10:08:32.886544+0000","last_became_peered":"2024-09-10T10:08:32.886544+0000","last_unstale":"2024-09-10T10:10:00.973375+0000","last_undegraded":"2024-09-10T10:10:00.973375+0000","last_fullsized":"2024-09-10T10:10:00.973375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:30.511881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862240+0000","last_change":"2024-09-10T10:08:44.390761+0000","last_active":"2024-09-10T10:10:00.862240+0000","last_peered":"2024-09-10T10:10:00.862240+0000","last_clean":"2024-09-10T10:10:00.862240+0000","last_became_active":"2024-09-10T10:08:44.390190+0000","last_became_peered":"2024-09-10T10:08:44.390190+0000","last_unstale":"2024-09-10T10:10:00.862240+0000","last_undegraded":"2024-09-10T10:10:00.862240+0000","last_fullsized":"2024-09-10T10:10:00.862240+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:38.216171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767507+0000","last_change":"2024-09-10T10:08:35.362956+0000","last_active":"2024-09-10T10:10:58.767507+0000","last_peered":"2024-09-10T10:10:58.767507+0000","last_clean":"2024-09-10T10:10:58.767507+0000","last_became_active":"2024-09-10T10:08:35.362623+0000","last_became_peered":"2024-09-10T10:08:35.362623+0000","last_unstale":"2024-09-10T10:10:58.767507+0000","last_undegraded":"2024-09-10T10:10:58.767507+0000","last_fullsized":"2024-09-10T10:10:58.767507+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:50.162838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840553+0000","last_change":"2024-09-10T10:08:32.889741+0000","last_active":"2024-09-10T10:10:00.840553+0000","last_peered":"2024-09-10T10:10:00.840553+0000","last_clean":"2024-09-10T10:10:00.840553+0000","last_became_active":"2024-09-10T10:08:32.889394+0000","last_became_peered":"2024-09-10T10:08:32.889394+0000","last_unstale":"2024-09-10T10:10:00.840553+0000","last_undegraded":"2024-09-10T10:10:00.840553+0000","last_fullsized":"2024-09-10T10:10:00.840553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:16.845738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938314+0000","last_change":"2024-09-10T10:08:44.403781+0000","last_active":"2024-09-10T10:10:00.938314+0000","last_peered":"2024-09-10T10:10:00.938314+0000","last_clean":"2024-09-10T10:10:00.938314+0000","last_became_active":"2024-09-10T10:08:44.399601+0000","last_became_peered":"2024-09-10T10:08:44.399601+0000","last_unstale":"2024-09-10T10:10:00.938314+0000","last_undegraded":"2024-09-10T10:10:00.938314+0000","last_fullsized":"2024-09-10T10:10:00.938314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:45.587247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765508+0000","last_change":"2024-09-10T10:08:35.367825+0000","last_active":"2024-09-10T10:10:58.765508+0000","last_peered":"2024-09-10T10:10:58.765508+0000","last_clean":"2024-09-10T10:10:58.765508+0000","last_became_active":"2024-09-10T10:08:35.367511+0000","last_became_peered":"2024-09-10T10:08:35.367511+0000","last_unstale":"2024-09-10T10:10:58.765508+0000","last_undegraded":"2024-09-10T10:10:58.765508+0000","last_fullsized":"2024-09-10T10:10:58.765508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:03.356912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039782+0000","last_change":"2024-09-10T10:08:32.888524+0000","last_active":"2024-09-10T10:10:01.039782+0000","last_peered":"2024-09-10T10:10:01.039782+0000","last_clean":"2024-09-10T10:10:01.039782+0000","last_became_active":"2024-09-10T10:08:32.888148+0000","last_became_peered":"2024-09-10T10:08:32.888148+0000","last_unstale":"2024-09-10T10:10:01.039782+0000","last_undegraded":"2024-09-10T10:10:01.039782+0000","last_fullsized":"2024-09-10T10:10:01.039782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:34.342167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839577+0000","last_change":"2024-09-10T10:08:44.392952+0000","last_active":"2024-09-10T10:10:00.839577+0000","last_peered":"2024-09-10T10:10:00.839577+0000","last_clean":"2024-09-10T10:10:00.839577+0000","last_became_active":"2024-09-10T10:08:44.392476+0000","last_became_peered":"2024-09-10T10:08:44.392476+0000","last_unstale":"2024-09-10T10:10:00.839577+0000","last_undegraded":"2024-09-10T10:10:00.839577+0000","last_fullsized":"2024-09-10T10:10:00.839577+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:26.530305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761361+0000","last_change":"2024-09-10T10:08:35.364501+0000","last_active":"2024-09-10T10:10:58.761361+0000","last_peered":"2024-09-10T10:10:58.761361+0000","last_clean":"2024-09-10T10:10:58.761361+0000","last_became_active":"2024-09-10T10:08:35.364102+0000","last_became_peered":"2024-09-10T10:08:35.364102+0000","last_unstale":"2024-09-10T10:10:58.761361+0000","last_undegraded":"2024-09-10T10:10:58.761361+0000","last_fullsized":"2024-09-10T10:10:58.761361+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:42.743140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":22,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185891+0000","last_change":"2024-09-10T10:09:00.461639+0000","last_active":"2024-09-10T10:10:01.185891+0000","last_peered":"2024-09-10T10:10:01.185891+0000","last_clean":"2024-09-10T10:10:01.185891+0000","last_became_active":"2024-09-10T10:09:00.457246+0000","last_became_peered":"2024-09-10T10:09:00.457246+0000","last_unstale":"2024-09-10T10:10:01.185891+0000","last_undegraded":"2024-09-10T10:10:01.185891+0000","last_fullsized":"2024-09-10T10:10:01.185891+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:30.387035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840110+0000","last_change":"2024-09-10T10:08:44.401728+0000","last_active":"2024-09-10T10:10:00.840110+0000","last_peered":"2024-09-10T10:10:00.840110+0000","last_clean":"2024-09-10T10:10:00.840110+0000","last_became_active":"2024-09-10T10:08:44.401334+0000","last_became_peered":"2024-09-10T10:08:44.401334+0000","last_unstale":"2024-09-10T10:10:00.840110+0000","last_undegraded":"2024-09-10T10:10:00.840110+0000","last_fullsized":"2024-09-10T10:10:00.840110+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:57.496196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"95'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769526+0000","last_change":"2024-09-10T10:09:00.486353+0000","last_active":"2024-09-10T10:10:58.769526+0000","last_peered":"2024-09-10T10:10:58.769526+0000","last_clean":"2024-09-10T10:10:58.769526+0000","last_became_active":"2024-09-10T10:09:00.485938+0000","last_became_peered":"2024-09-10T10:09:00.485938+0000","last_unstale":"2024-09-10T10:10:58.769526+0000","last_undegraded":"2024-09-10T10:10:58.769526+0000","last_fullsized":"2024-09-10T10:10:58.769526+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:38.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722331+0000","last_change":"2024-09-10T10:08:32.893278+0000","last_active":"2024-09-10T10:10:00.722331+0000","last_peered":"2024-09-10T10:10:00.722331+0000","last_clean":"2024-09-10T10:10:00.722331+0000","last_became_active":"2024-09-10T10:08:32.892848+0000","last_became_peered":"2024-09-10T10:08:32.892848+0000","last_unstale":"2024-09-10T10:10:00.722331+0000","last_undegraded":"2024-09-10T10:10:00.722331+0000","last_fullsized":"2024-09-10T10:10:00.722331+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:09.336253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040465+0000","last_change":"2024-09-10T10:08:44.407213+0000","last_active":"2024-09-10T10:10:01.040465+0000","last_peered":"2024-09-10T10:10:01.040465+0000","last_clean":"2024-09-10T10:10:01.040465+0000","last_became_active":"2024-09-10T10:08:44.405198+0000","last_became_peered":"2024-09-10T10:08:44.405198+0000","last_unstale":"2024-09-10T10:10:01.040465+0000","last_undegraded":"2024-09-10T10:10:01.040465+0000","last_fullsized":"2024-09-10T10:10:01.040465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:15.921684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767621+0000","last_change":"2024-09-10T10:08:35.362683+0000","last_active":"2024-09-10T10:10:58.767621+0000","last_peered":"2024-09-10T10:10:58.767621+0000","last_clean":"2024-09-10T10:10:58.767621+0000","last_became_active":"2024-09-10T10:08:35.362353+0000","last_became_peered":"2024-09-10T10:08:35.362353+0000","last_unstale":"2024-09-10T10:10:58.767621+0000","last_undegraded":"2024-09-10T10:10:58.767621+0000","last_fullsized":"2024-09-10T10:10:58.767621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.489716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"95'5","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:13.697773+0000","last_change":"2024-09-10T10:08:32.881024+0000","last_active":"2024-09-10T10:11:13.697773+0000","last_peered":"2024-09-10T10:11:13.697773+0000","last_clean":"2024-09-10T10:11:13.697773+0000","last_became_active":"2024-09-10T10:08:32.880691+0000","last_became_peered":"2024-09-10T10:08:32.880691+0000","last_unstale":"2024-09-10T10:11:13.697773+0000","last_undegraded":"2024-09-10T10:11:13.697773+0000","last_fullsized":"2024-09-10T10:11:13.697773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:15.988063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724443+0000","last_change":"2024-09-10T10:08:44.400509+0000","last_active":"2024-09-10T10:10:00.724443+0000","last_peered":"2024-09-10T10:10:00.724443+0000","last_clean":"2024-09-10T10:10:00.724443+0000","last_became_active":"2024-09-10T10:08:44.400152+0000","last_became_peered":"2024-09-10T10:08:44.400152+0000","last_unstale":"2024-09-10T10:10:00.724443+0000","last_undegraded":"2024-09-10T10:10:00.724443+0000","last_fullsized":"2024-09-10T10:10:00.724443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:43.550208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.775766+0000","last_change":"2024-09-10T10:08:35.364208+0000","last_active":"2024-09-10T10:10:58.775766+0000","last_peered":"2024-09-10T10:10:58.775766+0000","last_clean":"2024-09-10T10:10:58.775766+0000","last_became_active":"2024-09-10T10:08:35.363751+0000","last_became_peered":"2024-09-10T10:08:35.363751+0000","last_unstale":"2024-09-10T10:10:58.775766+0000","last_undegraded":"2024-09-10T10:10:58.775766+0000","last_fullsized":"2024-09-10T10:10:58.775766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:21.791512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840204+0000","last_change":"2024-09-10T10:08:32.890611+0000","last_active":"2024-09-10T10:10:00.840204+0000","last_peered":"2024-09-10T10:10:00.840204+0000","last_clean":"2024-09-10T10:10:00.840204+0000","last_became_active":"2024-09-10T10:08:32.890296+0000","last_became_peered":"2024-09-10T10:08:32.890296+0000","last_unstale":"2024-09-10T10:10:00.840204+0000","last_undegraded":"2024-09-10T10:10:00.840204+0000","last_fullsized":"2024-09-10T10:10:00.840204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.977575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185624+0000","last_change":"2024-09-10T10:08:44.402607+0000","last_active":"2024-09-10T10:10:01.185624+0000","last_peered":"2024-09-10T10:10:01.185624+0000","last_clean":"2024-09-10T10:10:01.185624+0000","last_became_active":"2024-09-10T10:08:44.401623+0000","last_became_peered":"2024-09-10T10:08:44.401623+0000","last_unstale":"2024-09-10T10:10:01.185624+0000","last_undegraded":"2024-09-10T10:10:01.185624+0000","last_fullsized":"2024-09-10T10:10:01.185624+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:21.105349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.775534+0000","last_change":"2024-09-10T10:08:35.360642+0000","last_active":"2024-09-10T10:10:58.775534+0000","last_peered":"2024-09-10T10:10:58.775534+0000","last_clean":"2024-09-10T10:10:58.775534+0000","last_became_active":"2024-09-10T10:08:35.356667+0000","last_became_peered":"2024-09-10T10:08:35.356667+0000","last_unstale":"2024-09-10T10:10:58.775534+0000","last_undegraded":"2024-09-10T10:10:58.775534+0000","last_fullsized":"2024-09-10T10:10:58.775534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:08.404973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972507+0000","last_change":"2024-09-10T10:08:32.890418+0000","last_active":"2024-09-10T10:10:00.972507+0000","last_peered":"2024-09-10T10:10:00.972507+0000","last_clean":"2024-09-10T10:10:00.972507+0000","last_became_active":"2024-09-10T10:08:32.890081+0000","last_became_peered":"2024-09-10T10:08:32.890081+0000","last_unstale":"2024-09-10T10:10:00.972507+0000","last_undegraded":"2024-09-10T10:10:00.972507+0000","last_fullsized":"2024-09-10T10:10:00.972507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:52.839714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840379+0000","last_change":"2024-09-10T10:08:44.401322+0000","last_active":"2024-09-10T10:10:00.840379+0000","last_peered":"2024-09-10T10:10:00.840379+0000","last_clean":"2024-09-10T10:10:00.840379+0000","last_became_active":"2024-09-10T10:08:44.400906+0000","last_became_peered":"2024-09-10T10:08:44.400906+0000","last_unstale":"2024-09-10T10:10:00.840379+0000","last_undegraded":"2024-09-10T10:10:00.840379+0000","last_fullsized":"2024-09-10T10:10:00.840379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:08.616288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761674+0000","last_change":"2024-09-10T10:08:35.366580+0000","last_active":"2024-09-10T10:10:58.761674+0000","last_peered":"2024-09-10T10:10:58.761674+0000","last_clean":"2024-09-10T10:10:58.761674+0000","last_became_active":"2024-09-10T10:08:35.365943+0000","last_became_peered":"2024-09-10T10:08:35.365943+0000","last_unstale":"2024-09-10T10:10:58.761674+0000","last_undegraded":"2024-09-10T10:10:58.761674+0000","last_fullsized":"2024-09-10T10:10:58.761674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:58.351517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"95'38","reported_seq":309,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:15.700952+0000","last_change":"2024-09-10T10:08:32.888411+0000","last_active":"2024-09-10T10:11:15.700952+0000","last_peered":"2024-09-10T10:11:15.700952+0000","last_clean":"2024-09-10T10:11:15.700952+0000","last_became_active":"2024-09-10T10:08:32.888093+0000","last_became_peered":"2024-09-10T10:08:32.888093+0000","last_unstale":"2024-09-10T10:11:15.700952+0000","last_undegraded":"2024-09-10T10:11:15.700952+0000","last_fullsized":"2024-09-10T10:11:15.700952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.532868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62636,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":230,"num_read_kb":177,"num_write":39,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724453+0000","last_change":"2024-09-10T10:08:44.400432+0000","last_active":"2024-09-10T10:10:00.724453+0000","last_peered":"2024-09-10T10:10:00.724453+0000","last_clean":"2024-09-10T10:10:00.724453+0000","last_became_active":"2024-09-10T10:08:44.399981+0000","last_became_peered":"2024-09-10T10:08:44.399981+0000","last_unstale":"2024-09-10T10:10:00.724453+0000","last_undegraded":"2024-09-10T10:10:00.724453+0000","last_fullsized":"2024-09-10T10:10:00.724453+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:57.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"95'11","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765617+0000","last_change":"2024-09-10T10:09:00.460848+0000","last_active":"2024-09-10T10:10:58.765617+0000","last_peered":"2024-09-10T10:10:58.765617+0000","last_clean":"2024-09-10T10:10:58.765617+0000","last_became_active":"2024-09-10T10:09:00.460459+0000","last_became_peered":"2024-09-10T10:09:00.460459+0000","last_unstale":"2024-09-10T10:10:58.765617+0000","last_undegraded":"2024-09-10T10:10:58.765617+0000","last_fullsized":"2024-09-10T10:10:58.765617+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:06.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840557+0000","last_change":"2024-09-10T10:08:32.885909+0000","last_active":"2024-09-10T10:10:00.840557+0000","last_peered":"2024-09-10T10:10:00.840557+0000","last_clean":"2024-09-10T10:10:00.840557+0000","last_became_active":"2024-09-10T10:08:32.885512+0000","last_became_peered":"2024-09-10T10:08:32.885512+0000","last_unstale":"2024-09-10T10:10:00.840557+0000","last_undegraded":"2024-09-10T10:10:00.840557+0000","last_fullsized":"2024-09-10T10:10:00.840557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:44.850772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721902+0000","last_change":"2024-09-10T10:08:44.400323+0000","last_active":"2024-09-10T10:10:00.721902+0000","last_peered":"2024-09-10T10:10:00.721902+0000","last_clean":"2024-09-10T10:10:00.721902+0000","last_became_active":"2024-09-10T10:08:44.399923+0000","last_became_peered":"2024-09-10T10:08:44.399923+0000","last_unstale":"2024-09-10T10:10:00.721902+0000","last_undegraded":"2024-09-10T10:10:00.721902+0000","last_fullsized":"2024-09-10T10:10:00.721902+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:45.496392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771495+0000","last_change":"2024-09-10T10:08:35.375543+0000","last_active":"2024-09-10T10:10:58.771495+0000","last_peered":"2024-09-10T10:10:58.771495+0000","last_clean":"2024-09-10T10:10:58.771495+0000","last_became_active":"2024-09-10T10:08:35.374312+0000","last_became_peered":"2024-09-10T10:08:35.374312+0000","last_unstale":"2024-09-10T10:10:58.771495+0000","last_undegraded":"2024-09-10T10:10:58.771495+0000","last_fullsized":"2024-09-10T10:10:58.771495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:34.208716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184909+0000","last_change":"2024-09-10T10:08:32.888540+0000","last_active":"2024-09-10T10:10:01.184909+0000","last_peered":"2024-09-10T10:10:01.184909+0000","last_clean":"2024-09-10T10:10:01.184909+0000","last_became_active":"2024-09-10T10:08:32.888187+0000","last_became_peered":"2024-09-10T10:08:32.888187+0000","last_unstale":"2024-09-10T10:10:01.184909+0000","last_undegraded":"2024-09-10T10:10:01.184909+0000","last_fullsized":"2024-09-10T10:10:01.184909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:06.694533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.723713+0000","last_change":"2024-09-10T10:08:44.397995+0000","last_active":"2024-09-10T10:10:00.723713+0000","last_peered":"2024-09-10T10:10:00.723713+0000","last_clean":"2024-09-10T10:10:00.723713+0000","last_became_active":"2024-09-10T10:08:44.397583+0000","last_became_peered":"2024-09-10T10:08:44.397583+0000","last_unstale":"2024-09-10T10:10:00.723713+0000","last_undegraded":"2024-09-10T10:10:00.723713+0000","last_fullsized":"2024-09-10T10:10:00.723713+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:03.908014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773846+0000","last_change":"2024-09-10T10:08:35.361053+0000","last_active":"2024-09-10T10:10:58.773846+0000","last_peered":"2024-09-10T10:10:58.773846+0000","last_clean":"2024-09-10T10:10:58.773846+0000","last_became_active":"2024-09-10T10:08:35.360736+0000","last_became_peered":"2024-09-10T10:08:35.360736+0000","last_unstale":"2024-09-10T10:10:58.773846+0000","last_undegraded":"2024-09-10T10:10:58.773846+0000","last_fullsized":"2024-09-10T10:10:58.773846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:45.435384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"95'4","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:14.698498+0000","last_change":"2024-09-10T10:08:32.885067+0000","last_active":"2024-09-10T10:11:14.698498+0000","last_peered":"2024-09-10T10:11:14.698498+0000","last_clean":"2024-09-10T10:11:14.698498+0000","last_became_active":"2024-09-10T10:08:32.884676+0000","last_became_peered":"2024-09-10T10:08:32.884676+0000","last_unstale":"2024-09-10T10:11:14.698498+0000","last_undegraded":"2024-09-10T10:11:14.698498+0000","last_fullsized":"2024-09-10T10:11:14.698498+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.667680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721235+0000","last_change":"2024-09-10T10:08:44.395892+0000","last_active":"2024-09-10T10:10:00.721235+0000","last_peered":"2024-09-10T10:10:00.721235+0000","last_clean":"2024-09-10T10:10:00.721235+0000","last_became_active":"2024-09-10T10:08:44.395188+0000","last_became_peered":"2024-09-10T10:08:44.395188+0000","last_unstale":"2024-09-10T10:10:00.721235+0000","last_undegraded":"2024-09-10T10:10:00.721235+0000","last_fullsized":"2024-09-10T10:10:00.721235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:27.562053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.939198+0000","last_change":"2024-09-10T10:08:44.403185+0000","last_active":"2024-09-10T10:10:00.939198+0000","last_peered":"2024-09-10T10:10:00.939198+0000","last_clean":"2024-09-10T10:10:00.939198+0000","last_became_active":"2024-09-10T10:08:44.399943+0000","last_became_peered":"2024-09-10T10:08:44.399943+0000","last_unstale":"2024-09-10T10:10:00.939198+0000","last_undegraded":"2024-09-10T10:10:00.939198+0000","last_fullsized":"2024-09-10T10:10:00.939198+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:07.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.770162+0000","last_change":"2024-09-10T10:08:35.367552+0000","last_active":"2024-09-10T10:10:58.770162+0000","last_peered":"2024-09-10T10:10:58.770162+0000","last_clean":"2024-09-10T10:10:58.770162+0000","last_became_active":"2024-09-10T10:08:35.367215+0000","last_became_peered":"2024-09-10T10:08:35.367215+0000","last_unstale":"2024-09-10T10:10:58.770162+0000","last_undegraded":"2024-09-10T10:10:58.770162+0000","last_fullsized":"2024-09-10T10:10:58.770162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:28.756769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840019+0000","last_change":"2024-09-10T10:08:32.885830+0000","last_active":"2024-09-10T10:10:00.840019+0000","last_peered":"2024-09-10T10:10:00.840019+0000","last_clean":"2024-09-10T10:10:00.840019+0000","last_became_active":"2024-09-10T10:08:32.885465+0000","last_became_peered":"2024-09-10T10:08:32.885465+0000","last_unstale":"2024-09-10T10:10:00.840019+0000","last_undegraded":"2024-09-10T10:10:00.840019+0000","last_fullsized":"2024-09-10T10:10:00.840019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:55.101364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185761+0000","last_change":"2024-09-10T10:09:00.487666+0000","last_active":"2024-09-10T10:10:01.185761+0000","last_peered":"2024-09-10T10:10:01.185761+0000","last_clean":"2024-09-10T10:10:01.185761+0000","last_became_active":"2024-09-10T10:09:00.487110+0000","last_became_peered":"2024-09-10T10:09:00.487110+0000","last_unstale":"2024-09-10T10:10:01.185761+0000","last_undegraded":"2024-09-10T10:10:01.185761+0000","last_fullsized":"2024-09-10T10:10:01.185761+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:28.817826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755501+0000","last_change":"2024-09-10T10:08:35.356247+0000","last_active":"2024-09-10T10:10:58.755501+0000","last_peered":"2024-09-10T10:10:58.755501+0000","last_clean":"2024-09-10T10:10:58.755501+0000","last_became_active":"2024-09-10T10:08:35.355953+0000","last_became_peered":"2024-09-10T10:08:35.355953+0000","last_unstale":"2024-09-10T10:10:58.755501+0000","last_undegraded":"2024-09-10T10:10:58.755501+0000","last_fullsized":"2024-09-10T10:10:58.755501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:24.625382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039784+0000","last_change":"2024-09-10T10:08:32.882151+0000","last_active":"2024-09-10T10:10:01.039784+0000","last_peered":"2024-09-10T10:10:01.039784+0000","last_clean":"2024-09-10T10:10:01.039784+0000","last_became_active":"2024-09-10T10:08:32.881688+0000","last_became_peered":"2024-09-10T10:08:32.881688+0000","last_unstale":"2024-09-10T10:10:01.039784+0000","last_undegraded":"2024-09-10T10:10:01.039784+0000","last_fullsized":"2024-09-10T10:10:01.039784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:49.186299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.109676+0000","last_change":"2024-09-10T10:08:32.887018+0000","last_active":"2024-09-10T10:10:01.109676+0000","last_peered":"2024-09-10T10:10:01.109676+0000","last_clean":"2024-09-10T10:10:01.109676+0000","last_became_active":"2024-09-10T10:08:32.886636+0000","last_became_peered":"2024-09-10T10:08:32.886636+0000","last_unstale":"2024-09-10T10:10:01.109676+0000","last_undegraded":"2024-09-10T10:10:01.109676+0000","last_fullsized":"2024-09-10T10:10:01.109676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:24.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762425+0000","last_change":"2024-09-10T10:08:35.363803+0000","last_active":"2024-09-10T10:10:58.762425+0000","last_peered":"2024-09-10T10:10:58.762425+0000","last_clean":"2024-09-10T10:10:58.762425+0000","last_became_active":"2024-09-10T10:08:35.363442+0000","last_became_peered":"2024-09-10T10:08:35.363442+0000","last_unstale":"2024-09-10T10:10:58.762425+0000","last_undegraded":"2024-09-10T10:10:58.762425+0000","last_fullsized":"2024-09-10T10:10:58.762425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:59.045347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972949+0000","last_change":"2024-09-10T10:08:44.403970+0000","last_active":"2024-09-10T10:10:00.972949+0000","last_peered":"2024-09-10T10:10:00.972949+0000","last_clean":"2024-09-10T10:10:00.972949+0000","last_became_active":"2024-09-10T10:08:44.403462+0000","last_became_peered":"2024-09-10T10:08:44.403462+0000","last_unstale":"2024-09-10T10:10:00.972949+0000","last_undegraded":"2024-09-10T10:10:00.972949+0000","last_fullsized":"2024-09-10T10:10:00.972949+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:09.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:15.700842+0000","last_change":"2024-09-10T10:08:32.893227+0000","last_active":"2024-09-10T10:11:15.700842+0000","last_peered":"2024-09-10T10:11:15.700842+0000","last_clean":"2024-09-10T10:11:15.700842+0000","last_became_active":"2024-09-10T10:08:32.892732+0000","last_became_peered":"2024-09-10T10:08:32.892732+0000","last_unstale":"2024-09-10T10:11:15.700842+0000","last_undegraded":"2024-09-10T10:11:15.700842+0000","last_fullsized":"2024-09-10T10:11:15.700842+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:16.933955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761246+0000","last_change":"2024-09-10T10:08:35.368806+0000","last_active":"2024-09-10T10:10:58.761246+0000","last_peered":"2024-09-10T10:10:58.761246+0000","last_clean":"2024-09-10T10:10:58.761246+0000","last_became_active":"2024-09-10T10:08:35.368397+0000","last_became_peered":"2024-09-10T10:08:35.368397+0000","last_unstale":"2024-09-10T10:10:58.761246+0000","last_undegraded":"2024-09-10T10:10:58.761246+0000","last_fullsized":"2024-09-10T10:10:58.761246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:39.656295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973102+0000","last_change":"2024-09-10T10:08:44.391941+0000","last_active":"2024-09-10T10:10:00.973102+0000","last_peered":"2024-09-10T10:10:00.973102+0000","last_clean":"2024-09-10T10:10:00.973102+0000","last_became_active":"2024-09-10T10:08:44.391553+0000","last_became_peered":"2024-09-10T10:08:44.391553+0000","last_unstale":"2024-09-10T10:10:00.973102+0000","last_undegraded":"2024-09-10T10:10:00.973102+0000","last_fullsized":"2024-09-10T10:10:00.973102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:34.279772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762216+0000","last_change":"2024-09-10T10:08:35.363192+0000","last_active":"2024-09-10T10:10:58.762216+0000","last_peered":"2024-09-10T10:10:58.762216+0000","last_clean":"2024-09-10T10:10:58.762216+0000","last_became_active":"2024-09-10T10:08:35.362890+0000","last_became_peered":"2024-09-10T10:08:35.362890+0000","last_unstale":"2024-09-10T10:10:58.762216+0000","last_undegraded":"2024-09-10T10:10:58.762216+0000","last_fullsized":"2024-09-10T10:10:58.762216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:07.493539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"95'12","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.748590+0000","last_change":"2024-09-10T10:08:35.362471+0000","last_active":"2024-09-10T10:10:58.748590+0000","last_peered":"2024-09-10T10:10:58.748590+0000","last_clean":"2024-09-10T10:10:58.748590+0000","last_became_active":"2024-09-10T10:08:35.361553+0000","last_became_peered":"2024-09-10T10:08:35.361553+0000","last_unstale":"2024-09-10T10:10:58.748590+0000","last_undegraded":"2024-09-10T10:10:58.748590+0000","last_fullsized":"2024-09-10T10:10:58.748590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:24.511901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.777795+0000","last_change":"2024-09-10T10:08:35.371025+0000","last_active":"2024-09-10T10:10:58.777795+0000","last_peered":"2024-09-10T10:10:58.777795+0000","last_clean":"2024-09-10T10:10:58.777795+0000","last_became_active":"2024-09-10T10:08:35.370692+0000","last_became_peered":"2024-09-10T10:08:35.370692+0000","last_unstale":"2024-09-10T10:10:58.777795+0000","last_undegraded":"2024-09-10T10:10:58.777795+0000","last_fullsized":"2024-09-10T10:10:58.777795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:22.289843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776381+0000","last_change":"2024-09-10T10:08:35.373519+0000","last_active":"2024-09-10T10:10:58.776381+0000","last_peered":"2024-09-10T10:10:58.776381+0000","last_clean":"2024-09-10T10:10:58.776381+0000","last_became_active":"2024-09-10T10:08:35.372719+0000","last_became_peered":"2024-09-10T10:08:35.372719+0000","last_unstale":"2024-09-10T10:10:58.776381+0000","last_undegraded":"2024-09-10T10:10:58.776381+0000","last_fullsized":"2024-09-10T10:10:58.776381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:24.530809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"95'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778078+0000","last_change":"2024-09-10T10:09:00.489944+0000","last_active":"2024-09-10T10:10:58.778078+0000","last_peered":"2024-09-10T10:10:58.778078+0000","last_clean":"2024-09-10T10:10:58.778078+0000","last_became_active":"2024-09-10T10:09:00.489269+0000","last_became_peered":"2024-09-10T10:09:00.489269+0000","last_unstale":"2024-09-10T10:10:58.778078+0000","last_undegraded":"2024-09-10T10:10:58.778078+0000","last_fullsized":"2024-09-10T10:10:58.778078+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:46.561078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761792+0000","last_change":"2024-09-10T10:08:35.364779+0000","last_active":"2024-09-10T10:10:58.761792+0000","last_peered":"2024-09-10T10:10:58.761792+0000","last_clean":"2024-09-10T10:10:58.761792+0000","last_became_active":"2024-09-10T10:08:35.364455+0000","last_became_peered":"2024-09-10T10:08:35.364455+0000","last_unstale":"2024-09-10T10:10:58.761792+0000","last_undegraded":"2024-09-10T10:10:58.761792+0000","last_fullsized":"2024-09-10T10:10:58.761792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:08.552218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761074+0000","last_change":"2024-09-10T10:08:35.357147+0000","last_active":"2024-09-10T10:10:58.761074+0000","last_peered":"2024-09-10T10:10:58.761074+0000","last_clean":"2024-09-10T10:10:58.761074+0000","last_became_active":"2024-09-10T10:08:35.356808+0000","last_became_peered":"2024-09-10T10:08:35.356808+0000","last_unstale":"2024-09-10T10:10:58.761074+0000","last_undegraded":"2024-09-10T10:10:58.761074+0000","last_fullsized":"2024-09-10T10:10:58.761074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:35.731496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"95'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755499+0000","last_change":"2024-09-10T10:08:35.365795+0000","last_active":"2024-09-10T10:10:58.755499+0000","last_peered":"2024-09-10T10:10:58.755499+0000","last_clean":"2024-09-10T10:10:58.755499+0000","last_became_active":"2024-09-10T10:08:35.365342+0000","last_became_peered":"2024-09-10T10:08:35.365342+0000","last_unstale":"2024-09-10T10:10:58.755499+0000","last_undegraded":"2024-09-10T10:10:58.755499+0000","last_fullsized":"2024-09-10T10:10:58.755499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:20.012890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"95'6","reported_seq":22,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.763139+0000","last_change":"2024-09-10T10:09:00.486664+0000","last_active":"2024-09-10T10:10:58.763139+0000","last_peered":"2024-09-10T10:10:58.763139+0000","last_clean":"2024-09-10T10:10:58.763139+0000","last_became_active":"2024-09-10T10:09:00.486239+0000","last_became_peered":"2024-09-10T10:09:00.486239+0000","last_unstale":"2024-09-10T10:10:58.763139+0000","last_undegraded":"2024-09-10T10:10:58.763139+0000","last_fullsized":"2024-09-10T10:10:58.763139+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:47.472245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755183+0000","last_change":"2024-09-10T10:08:35.367403+0000","last_active":"2024-09-10T10:10:58.755183+0000","last_peered":"2024-09-10T10:10:58.755183+0000","last_clean":"2024-09-10T10:10:58.755183+0000","last_became_active":"2024-09-10T10:08:35.365969+0000","last_became_peered":"2024-09-10T10:08:35.365969+0000","last_unstale":"2024-09-10T10:10:58.755183+0000","last_undegraded":"2024-09-10T10:10:58.755183+0000","last_fullsized":"2024-09-10T10:10:58.755183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:27.657226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773597+0000","last_change":"2024-09-10T10:08:35.359185+0000","last_active":"2024-09-10T10:10:58.773597+0000","last_peered":"2024-09-10T10:10:58.773597+0000","last_clean":"2024-09-10T10:10:58.773597+0000","last_became_active":"2024-09-10T10:08:35.358825+0000","last_became_peered":"2024-09-10T10:08:35.358825+0000","last_unstale":"2024-09-10T10:10:58.773597+0000","last_undegraded":"2024-09-10T10:10:58.773597+0000","last_fullsized":"2024-09-10T10:10:58.773597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:31.884533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778457+0000","last_change":"2024-09-10T10:08:35.378151+0000","last_active":"2024-09-10T10:10:58.778457+0000","last_peered":"2024-09-10T10:10:58.778457+0000","last_clean":"2024-09-10T10:10:58.778457+0000","last_became_active":"2024-09-10T10:08:35.377784+0000","last_became_peered":"2024-09-10T10:08:35.377784+0000","last_unstale":"2024-09-10T10:10:58.778457+0000","last_undegraded":"2024-09-10T10:10:58.778457+0000","last_fullsized":"2024-09-10T10:10:58.778457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.027310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762465+0000","last_change":"2024-09-10T10:08:35.364550+0000","last_active":"2024-09-10T10:10:58.762465+0000","last_peered":"2024-09-10T10:10:58.762465+0000","last_clean":"2024-09-10T10:10:58.762465+0000","last_became_active":"2024-09-10T10:08:35.364224+0000","last_became_peered":"2024-09-10T10:08:35.364224+0000","last_unstale":"2024-09-10T10:10:58.762465+0000","last_undegraded":"2024-09-10T10:10:58.762465+0000","last_fullsized":"2024-09-10T10:10:58.762465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:38.584494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.750237+0000","last_change":"2024-09-10T10:08:35.357333+0000","last_active":"2024-09-10T10:10:58.750237+0000","last_peered":"2024-09-10T10:10:58.750237+0000","last_clean":"2024-09-10T10:10:58.750237+0000","last_became_active":"2024-09-10T10:08:35.356940+0000","last_became_peered":"2024-09-10T10:08:35.356940+0000","last_unstale":"2024-09-10T10:10:58.750237+0000","last_undegraded":"2024-09-10T10:10:58.750237+0000","last_fullsized":"2024-09-10T10:10:58.750237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:40.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769367+0000","last_change":"2024-09-10T10:08:35.367208+0000","last_active":"2024-09-10T10:10:58.769367+0000","last_peered":"2024-09-10T10:10:58.769367+0000","last_clean":"2024-09-10T10:10:58.769367+0000","last_became_active":"2024-09-10T10:08:35.361942+0000","last_became_peered":"2024-09-10T10:08:35.361942+0000","last_unstale":"2024-09-10T10:10:58.769367+0000","last_undegraded":"2024-09-10T10:10:58.769367+0000","last_fullsized":"2024-09-10T10:10:58.769367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:19.030623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773220+0000","last_change":"2024-09-10T10:08:35.377164+0000","last_active":"2024-09-10T10:10:58.773220+0000","last_peered":"2024-09-10T10:10:58.773220+0000","last_clean":"2024-09-10T10:10:58.773220+0000","last_became_active":"2024-09-10T10:08:35.376457+0000","last_became_peered":"2024-09-10T10:08:35.376457+0000","last_unstale":"2024-09-10T10:10:58.773220+0000","last_undegraded":"2024-09-10T10:10:58.773220+0000","last_fullsized":"2024-09-10T10:10:58.773220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.291635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772661+0000","last_change":"2024-09-10T10:08:35.365096+0000","last_active":"2024-09-10T10:10:58.772661+0000","last_peered":"2024-09-10T10:10:58.772661+0000","last_clean":"2024-09-10T10:10:58.772661+0000","last_became_active":"2024-09-10T10:08:35.364780+0000","last_became_peered":"2024-09-10T10:08:35.364780+0000","last_unstale":"2024-09-10T10:10:58.772661+0000","last_undegraded":"2024-09-10T10:10:58.772661+0000","last_fullsized":"2024-09-10T10:10:58.772661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:30.177904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774627+0000","last_change":"2024-09-10T10:08:35.377017+0000","last_active":"2024-09-10T10:10:58.774627+0000","last_peered":"2024-09-10T10:10:58.774627+0000","last_clean":"2024-09-10T10:10:58.774627+0000","last_became_active":"2024-09-10T10:08:35.372243+0000","last_became_peered":"2024-09-10T10:08:35.372243+0000","last_unstale":"2024-09-10T10:10:58.774627+0000","last_undegraded":"2024-09-10T10:10:58.774627+0000","last_fullsized":"2024-09-10T10:10:58.774627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:26.105505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774291+0000","last_change":"2024-09-10T10:08:35.379782+0000","last_active":"2024-09-10T10:10:58.774291+0000","last_peered":"2024-09-10T10:10:58.774291+0000","last_clean":"2024-09-10T10:10:58.774291+0000","last_became_active":"2024-09-10T10:08:35.377109+0000","last_became_peered":"2024-09-10T10:08:35.377109+0000","last_unstale":"2024-09-10T10:10:58.774291+0000","last_undegraded":"2024-09-10T10:10:58.774291+0000","last_fullsized":"2024-09-10T10:10:58.774291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:10.761016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.764497+0000","last_change":"2024-09-10T10:08:35.364891+0000","last_active":"2024-09-10T10:10:58.764497+0000","last_peered":"2024-09-10T10:10:58.764497+0000","last_clean":"2024-09-10T10:10:58.764497+0000","last_became_active":"2024-09-10T10:08:35.363845+0000","last_became_peered":"2024-09-10T10:08:35.363845+0000","last_unstale":"2024-09-10T10:10:58.764497+0000","last_undegraded":"2024-09-10T10:10:58.764497+0000","last_fullsized":"2024-09-10T10:10:58.764497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:03.346994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766501+0000","last_change":"2024-09-10T10:08:35.363548+0000","last_active":"2024-09-10T10:10:58.766501+0000","last_peered":"2024-09-10T10:10:58.766501+0000","last_clean":"2024-09-10T10:10:58.766501+0000","last_became_active":"2024-09-10T10:08:35.363229+0000","last_became_peered":"2024-09-10T10:08:35.363229+0000","last_unstale":"2024-09-10T10:10:58.766501+0000","last_undegraded":"2024-09-10T10:10:58.766501+0000","last_fullsized":"2024-09-10T10:10:58.766501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:38.773445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773111+0000","last_change":"2024-09-10T10:08:35.360717+0000","last_active":"2024-09-10T10:10:58.773111+0000","last_peered":"2024-09-10T10:10:58.773111+0000","last_clean":"2024-09-10T10:10:58.773111+0000","last_became_active":"2024-09-10T10:08:35.360410+0000","last_became_peered":"2024-09-10T10:08:35.360410+0000","last_unstale":"2024-09-10T10:10:58.773111+0000","last_undegraded":"2024-09-10T10:10:58.773111+0000","last_fullsized":"2024-09-10T10:10:58.773111+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:59.322524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'16","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772823+0000","last_change":"2024-09-10T10:08:35.362359+0000","last_active":"2024-09-10T10:10:58.772823+0000","last_peered":"2024-09-10T10:10:58.772823+0000","last_clean":"2024-09-10T10:10:58.772823+0000","last_became_active":"2024-09-10T10:08:35.361580+0000","last_became_peered":"2024-09-10T10:08:35.361580+0000","last_unstale":"2024-09-10T10:10:58.772823+0000","last_undegraded":"2024-09-10T10:10:58.772823+0000","last_fullsized":"2024-09-10T10:10:58.772823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:23.265237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771033+0000","last_change":"2024-09-10T10:08:35.367305+0000","last_active":"2024-09-10T10:10:58.771033+0000","last_peered":"2024-09-10T10:10:58.771033+0000","last_clean":"2024-09-10T10:10:58.771033+0000","last_became_active":"2024-09-10T10:08:35.366936+0000","last_became_peered":"2024-09-10T10:08:35.366936+0000","last_unstale":"2024-09-10T10:10:58.771033+0000","last_undegraded":"2024-09-10T10:10:58.771033+0000","last_fullsized":"2024-09-10T10:10:58.771033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:28.158474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765168+0000","last_change":"2024-09-10T10:08:35.369983+0000","last_active":"2024-09-10T10:10:58.765168+0000","last_peered":"2024-09-10T10:10:58.765168+0000","last_clean":"2024-09-10T10:10:58.765168+0000","last_became_active":"2024-09-10T10:08:35.367662+0000","last_became_peered":"2024-09-10T10:08:35.367662+0000","last_unstale":"2024-09-10T10:10:58.765168+0000","last_undegraded":"2024-09-10T10:10:58.765168+0000","last_fullsized":"2024-09-10T10:10:58.765168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771023+0000","last_change":"2024-09-10T10:08:35.369237+0000","last_active":"2024-09-10T10:10:58.771023+0000","last_peered":"2024-09-10T10:10:58.771023+0000","last_clean":"2024-09-10T10:10:58.771023+0000","last_became_active":"2024-09-10T10:08:35.368903+0000","last_became_peered":"2024-09-10T10:08:35.368903+0000","last_unstale":"2024-09-10T10:10:58.771023+0000","last_undegraded":"2024-09-10T10:10:58.771023+0000","last_fullsized":"2024-09-10T10:10:58.771023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:05.150549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773489+0000","last_change":"2024-09-10T10:08:35.367284+0000","last_active":"2024-09-10T10:10:58.773489+0000","last_peered":"2024-09-10T10:10:58.773489+0000","last_clean":"2024-09-10T10:10:58.773489+0000","last_became_active":"2024-09-10T10:08:35.366969+0000","last_became_peered":"2024-09-10T10:08:35.366969+0000","last_unstale":"2024-09-10T10:10:58.773489+0000","last_undegraded":"2024-09-10T10:10:58.773489+0000","last_fullsized":"2024-09-10T10:10:58.773489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:16.949804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.749286+0000","last_change":"2024-09-10T10:08:35.374559+0000","last_active":"2024-09-10T10:10:58.749286+0000","last_peered":"2024-09-10T10:10:58.749286+0000","last_clean":"2024-09-10T10:10:58.749286+0000","last_became_active":"2024-09-10T10:08:35.374191+0000","last_became_peered":"2024-09-10T10:08:35.374191+0000","last_unstale":"2024-09-10T10:10:58.749286+0000","last_undegraded":"2024-09-10T10:10:58.749286+0000","last_fullsized":"2024-09-10T10:10:58.749286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:48.292249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.757757+0000","last_change":"2024-09-10T10:08:35.368042+0000","last_active":"2024-09-10T10:10:58.757757+0000","last_peered":"2024-09-10T10:10:58.757757+0000","last_clean":"2024-09-10T10:10:58.757757+0000","last_became_active":"2024-09-10T10:08:35.365985+0000","last_became_peered":"2024-09-10T10:08:35.365985+0000","last_unstale":"2024-09-10T10:10:58.757757+0000","last_undegraded":"2024-09-10T10:10:58.757757+0000","last_fullsized":"2024-09-10T10:10:58.757757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:04.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774113+0000","last_change":"2024-09-10T10:08:35.375826+0000","last_active":"2024-09-10T10:10:58.774113+0000","last_peered":"2024-09-10T10:10:58.774113+0000","last_clean":"2024-09-10T10:10:58.774113+0000","last_became_active":"2024-09-10T10:08:35.375485+0000","last_became_peered":"2024-09-10T10:08:35.375485+0000","last_unstale":"2024-09-10T10:10:58.774113+0000","last_undegraded":"2024-09-10T10:10:58.774113+0000","last_fullsized":"2024-09-10T10:10:58.774113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:49.146648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.763221+0000","last_change":"2024-09-10T10:08:35.375745+0000","last_active":"2024-09-10T10:10:58.763221+0000","last_peered":"2024-09-10T10:10:58.763221+0000","last_clean":"2024-09-10T10:10:58.763221+0000","last_became_active":"2024-09-10T10:08:35.375427+0000","last_became_peered":"2024-09-10T10:08:35.375427+0000","last_unstale":"2024-09-10T10:10:58.763221+0000","last_undegraded":"2024-09-10T10:10:58.763221+0000","last_fullsized":"2024-09-10T10:10:58.763221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:48.743434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771465+0000","last_change":"2024-09-10T10:08:35.377092+0000","last_active":"2024-09-10T10:10:58.771465+0000","last_peered":"2024-09-10T10:10:58.771465+0000","last_clean":"2024-09-10T10:10:58.771465+0000","last_became_active":"2024-09-10T10:08:35.376761+0000","last_became_peered":"2024-09-10T10:08:35.376761+0000","last_unstale":"2024-09-10T10:10:58.771465+0000","last_undegraded":"2024-09-10T10:10:58.771465+0000","last_fullsized":"2024-09-10T10:10:58.771465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:58.631742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67314,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":693,"num_read_kb":420,"num_write":180,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":201942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286200,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449135,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":538290,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678069,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712808,"statfs":{"total":95995035648,"available":95961915392,"internally_reserved":0,"allocated":1187840,"data_stored":1188706,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841593,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":542600,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070527,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":538402,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299460,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":1135010,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462987,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":533680,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724625,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1114112,"data_stored":1130064,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888148,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1048576,"data_stored":538864,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149786,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":533874,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411426,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1130496,"data_stored":598110,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1105920,"data_stored":596226,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738476,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":535068,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:11:20.466 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T10:11:20.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.659+0000 7fea26e00640 1 -- 172.21.15.50:0/3563611950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea20103050 msgr2=0x7fea20103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:20.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.659+0000 7fea26e00640 1 --2- 172.21.15.50:0/3563611950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea20103050 0x7fea20103450 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fea14009ca0 tx=0x7fea1402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.660+0000 7fea26e00640 1 -- 172.21.15.50:0/3563611950 shutdown_connections 2024-09-10T10:11:20.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.660+0000 7fea26e00640 1 --2- 172.21.15.50:0/3563611950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea20101f40 0x7fea20109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.660+0000 7fea26e00640 1 --2- 172.21.15.50:0/3563611950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea20101580 0x7fea20101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.660+0000 7fea26e00640 1 --2- 172.21.15.50:0/3563611950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea20103050 0x7fea20103450 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.660+0000 7fea26e00640 1 -- 172.21.15.50:0/3563611950 >> 172.21.15.50:0/3563611950 conn(0x7fea200fd110 msgr2=0x7fea200ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:20.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.660+0000 7fea26e00640 1 -- 172.21.15.50:0/3563611950 shutdown_connections 2024-09-10T10:11:20.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.660+0000 7fea26e00640 1 -- 172.21.15.50:0/3563611950 wait complete. 2024-09-10T10:11:20.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.661+0000 7fea26e00640 1 Processor -- start 2024-09-10T10:11:20.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.661+0000 7fea26e00640 1 -- start start 2024-09-10T10:11:20.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.661+0000 7fea26e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea20101580 0x7fea20199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:20.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.661+0000 7fea26e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea20101f40 0x7fea2019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:20.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.661+0000 7fea26e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea20103050 0x7fea201a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:20.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.661+0000 7fea26e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea2010d720 con 0x7fea20101580 2024-09-10T10:11:20.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.661+0000 7fea26e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fea2010d5a0 con 0x7fea20101f40 2024-09-10T10:11:20.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.661+0000 7fea26e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fea2010d8a0 con 0x7fea20103050 2024-09-10T10:11:20.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.661+0000 7fea25a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea20101580 0x7fea20199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:20.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.661+0000 7fea25a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea20101580 0x7fea20199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51138/0 (socket says 172.21.15.50:51138) 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.661+0000 7fea25a00640 1 -- 172.21.15.50:0/2890861095 learned_addr learned my addr 172.21.15.50:0/2890861095 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.661+0000 7fea26400640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea20103050 0x7fea201a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.661+0000 7fea25000640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea20101f40 0x7fea2019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.662+0000 7fea25a00640 1 -- 172.21.15.50:0/2890861095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea20103050 msgr2=0x7fea201a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.662+0000 7fea25a00640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea20103050 0x7fea201a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.662+0000 7fea25a00640 1 -- 172.21.15.50:0/2890861095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea20101f40 msgr2=0x7fea2019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.662+0000 7fea25a00640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea20101f40 0x7fea2019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.662+0000 7fea25a00640 1 -- 172.21.15.50:0/2890861095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea201a1bf0 con 0x7fea20101580 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.662+0000 7fea25a00640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea20101580 0x7fea20199fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fea14000f80 tx=0x7fea140319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.662+0000 7fea1e000640 1 -- 172.21.15.50:0/2890861095 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14003bf0 con 0x7fea20101580 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.662+0000 7fea1e000640 1 -- 172.21.15.50:0/2890861095 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea14003d90 con 0x7fea20101580 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.662+0000 7fea1e000640 1 -- 172.21.15.50:0/2890861095 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1402fd30 con 0x7fea20101580 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.662+0000 7fea26e00640 1 -- 172.21.15.50:0/2890861095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea201a1e80 con 0x7fea20101580 2024-09-10T10:11:20.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.663+0000 7fea26e00640 1 -- 172.21.15.50:0/2890861095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea201a2340 con 0x7fea20101580 2024-09-10T10:11:20.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.664+0000 7fea26e00640 1 -- 172.21.15.50:0/2890861095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea20101a00 con 0x7fea20101580 2024-09-10T10:11:20.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.666+0000 7fea1e000640 1 -- 172.21.15.50:0/2890861095 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fea14004040 con 0x7fea20101580 2024-09-10T10:11:20.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.667+0000 7fea1e000640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea080a2c10 0x7fea080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:20.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.667+0000 7fea1e000640 1 -- 172.21.15.50:0/2890861095 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fea140f09b0 con 0x7fea20101580 2024-09-10T10:11:20.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.667+0000 7fea25000640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea080a2c10 0x7fea080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:20.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.668+0000 7fea25000640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea080a2c10 0x7fea080a50d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fea2019b4e0 tx=0x7fea0c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:20.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.671+0000 7fea1e000640 1 -- 172.21.15.50:0/2890861095 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea140bd5b0 con 0x7fea20101580 2024-09-10T10:11:20.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.854+0000 7fea26e00640 1 -- 172.21.15.50:0/2890861095 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fea20109af0 con 0x7fea080a2c10 2024-09-10T10:11:20.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.862+0000 7fea1e000640 1 -- 172.21.15.50:0/2890861095 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340752 (secure 0 0 0) 0x7fea20109af0 con 0x7fea080a2c10 2024-09-10T10:11:20.868 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:20.870 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-10T10:11:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.867+0000 7fea26e00640 1 -- 172.21.15.50:0/2890861095 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea080a2c10 msgr2=0x7fea080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.867+0000 7fea26e00640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea080a2c10 0x7fea080a50d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fea2019b4e0 tx=0x7fea0c00b390 comp rx=0 tx=0).stop 2024-09-10T10:11:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.867+0000 7fea26e00640 1 -- 172.21.15.50:0/2890861095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea20101580 msgr2=0x7fea20199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:20.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.867+0000 7fea26e00640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea20101580 0x7fea20199fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fea14000f80 tx=0x7fea140319f0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.867+0000 7fea26e00640 1 -- 172.21.15.50:0/2890861095 shutdown_connections 2024-09-10T10:11:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.867+0000 7fea26e00640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea080a2c10 0x7fea080a50d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.867+0000 7fea26e00640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea20103050 0x7fea201a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.867+0000 7fea26e00640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea20101f40 0x7fea2019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.867+0000 7fea26e00640 1 --2- 172.21.15.50:0/2890861095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea20101580 0x7fea20199fd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.867+0000 7fea26e00640 1 -- 172.21.15.50:0/2890861095 >> 172.21.15.50:0/2890861095 conn(0x7fea200fd110 msgr2=0x7fea201083d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.867+0000 7fea26e00640 1 -- 172.21.15.50:0/2890861095 shutdown_connections 2024-09-10T10:11:20.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:20.867+0000 7fea26e00640 1 -- 172.21.15.50:0/2890861095 wait complete. 2024-09-10T10:11:20.885 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":396,"stamp":"2024-09-10T10:11:20.805069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657916,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":824,"num_read_kb":529,"num_write":365,"num_write_kb":3068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":794,"ondisk_log_size":794,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366100,"kb_used_data":12692,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575724,"statfs":{"total":1151940427776,"available":1151565541376,"internally_reserved":0,"allocated":12996608,"data_stored":8408894,"data_compressed":498339,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":311,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003072"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724648+0000","last_change":"2024-09-10T10:08:32.889755+0000","last_active":"2024-09-10T10:10:00.724648+0000","last_peered":"2024-09-10T10:10:00.724648+0000","last_clean":"2024-09-10T10:10:00.724648+0000","last_became_active":"2024-09-10T10:08:32.889455+0000","last_became_peered":"2024-09-10T10:08:32.889455+0000","last_unstale":"2024-09-10T10:10:00.724648+0000","last_undegraded":"2024-09-10T10:10:00.724648+0000","last_fullsized":"2024-09-10T10:10:00.724648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:53.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"95'5","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.760977+0000","last_change":"2024-09-10T10:10:00.974216+0000","last_active":"2024-09-10T10:10:58.760977+0000","last_peered":"2024-09-10T10:10:58.760977+0000","last_clean":"2024-09-10T10:10:58.760977+0000","last_became_active":"2024-09-10T10:10:00.973841+0000","last_became_peered":"2024-09-10T10:10:00.973841+0000","last_unstale":"2024-09-10T10:10:58.760977+0000","last_undegraded":"2024-09-10T10:10:58.760977+0000","last_fullsized":"2024-09-10T10:10:58.760977+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:30.575610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972516+0000","last_change":"2024-09-10T10:08:44.399836+0000","last_active":"2024-09-10T10:10:00.972516+0000","last_peered":"2024-09-10T10:10:00.972516+0000","last_clean":"2024-09-10T10:10:00.972516+0000","last_became_active":"2024-09-10T10:08:44.399510+0000","last_became_peered":"2024-09-10T10:08:44.399510+0000","last_unstale":"2024-09-10T10:10:00.972516+0000","last_undegraded":"2024-09-10T10:10:00.972516+0000","last_fullsized":"2024-09-10T10:10:00.972516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:47.372690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722255+0000","last_change":"2024-09-10T10:08:32.887099+0000","last_active":"2024-09-10T10:10:00.722255+0000","last_peered":"2024-09-10T10:10:00.722255+0000","last_clean":"2024-09-10T10:10:00.722255+0000","last_became_active":"2024-09-10T10:08:32.886730+0000","last_became_peered":"2024-09-10T10:08:32.886730+0000","last_unstale":"2024-09-10T10:10:00.722255+0000","last_undegraded":"2024-09-10T10:10:00.722255+0000","last_fullsized":"2024-09-10T10:10:00.722255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.277241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.777729+0000","last_change":"2024-09-10T10:08:35.375494+0000","last_active":"2024-09-10T10:10:58.777729+0000","last_peered":"2024-09-10T10:10:58.777729+0000","last_clean":"2024-09-10T10:10:58.777729+0000","last_became_active":"2024-09-10T10:08:35.373991+0000","last_became_peered":"2024-09-10T10:08:35.373991+0000","last_unstale":"2024-09-10T10:10:58.777729+0000","last_undegraded":"2024-09-10T10:10:58.777729+0000","last_fullsized":"2024-09-10T10:10:58.777729+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:25.858163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721597+0000","last_change":"2024-09-10T10:09:00.457967+0000","last_active":"2024-09-10T10:10:00.721597+0000","last_peered":"2024-09-10T10:10:00.721597+0000","last_clean":"2024-09-10T10:10:00.721597+0000","last_became_active":"2024-09-10T10:09:00.457446+0000","last_became_peered":"2024-09-10T10:09:00.457446+0000","last_unstale":"2024-09-10T10:10:00.721597+0000","last_undegraded":"2024-09-10T10:10:00.721597+0000","last_fullsized":"2024-09-10T10:10:00.721597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:00.550304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722817+0000","last_change":"2024-09-10T10:08:32.890270+0000","last_active":"2024-09-10T10:10:00.722817+0000","last_peered":"2024-09-10T10:10:00.722817+0000","last_clean":"2024-09-10T10:10:00.722817+0000","last_became_active":"2024-09-10T10:08:32.889887+0000","last_became_peered":"2024-09-10T10:08:32.889887+0000","last_unstale":"2024-09-10T10:10:00.722817+0000","last_undegraded":"2024-09-10T10:10:00.722817+0000","last_fullsized":"2024-09-10T10:10:00.722817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:39.757510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774008+0000","last_change":"2024-09-10T10:08:35.357257+0000","last_active":"2024-09-10T10:10:58.774008+0000","last_peered":"2024-09-10T10:10:58.774008+0000","last_clean":"2024-09-10T10:10:58.774008+0000","last_became_active":"2024-09-10T10:08:35.356918+0000","last_became_peered":"2024-09-10T10:08:35.356918+0000","last_unstale":"2024-09-10T10:10:58.774008+0000","last_undegraded":"2024-09-10T10:10:58.774008+0000","last_fullsized":"2024-09-10T10:10:58.774008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:04.387581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722105+0000","last_change":"2024-09-10T10:09:00.487116+0000","last_active":"2024-09-10T10:10:00.722105+0000","last_peered":"2024-09-10T10:10:00.722105+0000","last_clean":"2024-09-10T10:10:00.722105+0000","last_became_active":"2024-09-10T10:09:00.486646+0000","last_became_peered":"2024-09-10T10:09:00.486646+0000","last_unstale":"2024-09-10T10:10:00.722105+0000","last_undegraded":"2024-09-10T10:10:00.722105+0000","last_fullsized":"2024-09-10T10:10:00.722105+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:40.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722877+0000","last_change":"2024-09-10T10:08:32.891399+0000","last_active":"2024-09-10T10:10:00.722877+0000","last_peered":"2024-09-10T10:10:00.722877+0000","last_clean":"2024-09-10T10:10:00.722877+0000","last_became_active":"2024-09-10T10:08:32.891022+0000","last_became_peered":"2024-09-10T10:08:32.891022+0000","last_unstale":"2024-09-10T10:10:00.722877+0000","last_undegraded":"2024-09-10T10:10:00.722877+0000","last_fullsized":"2024-09-10T10:10:00.722877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:30.842443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771765+0000","last_change":"2024-09-10T10:08:35.370630+0000","last_active":"2024-09-10T10:10:58.771765+0000","last_peered":"2024-09-10T10:10:58.771765+0000","last_clean":"2024-09-10T10:10:58.771765+0000","last_became_active":"2024-09-10T10:08:35.370263+0000","last_became_peered":"2024-09-10T10:08:35.370263+0000","last_unstale":"2024-09-10T10:10:58.771765+0000","last_undegraded":"2024-09-10T10:10:58.771765+0000","last_fullsized":"2024-09-10T10:10:58.771765+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:41.549815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721697+0000","last_change":"2024-09-10T10:08:44.405298+0000","last_active":"2024-09-10T10:10:00.721697+0000","last_peered":"2024-09-10T10:10:00.721697+0000","last_clean":"2024-09-10T10:10:00.721697+0000","last_became_active":"2024-09-10T10:08:44.405027+0000","last_became_peered":"2024-09-10T10:08:44.405027+0000","last_unstale":"2024-09-10T10:10:00.721697+0000","last_undegraded":"2024-09-10T10:10:00.721697+0000","last_fullsized":"2024-09-10T10:10:00.721697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:08.486563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776546+0000","last_change":"2024-09-10T10:08:35.369040+0000","last_active":"2024-09-10T10:10:58.776546+0000","last_peered":"2024-09-10T10:10:58.776546+0000","last_clean":"2024-09-10T10:10:58.776546+0000","last_became_active":"2024-09-10T10:08:35.368576+0000","last_became_peered":"2024-09-10T10:08:35.368576+0000","last_unstale":"2024-09-10T10:10:58.776546+0000","last_undegraded":"2024-09-10T10:10:58.776546+0000","last_fullsized":"2024-09-10T10:10:58.776546+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:44.887554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722399+0000","last_change":"2024-09-10T10:08:32.889549+0000","last_active":"2024-09-10T10:10:00.722399+0000","last_peered":"2024-09-10T10:10:00.722399+0000","last_clean":"2024-09-10T10:10:00.722399+0000","last_became_active":"2024-09-10T10:08:32.889197+0000","last_became_peered":"2024-09-10T10:08:32.889197+0000","last_unstale":"2024-09-10T10:10:00.722399+0000","last_undegraded":"2024-09-10T10:10:00.722399+0000","last_fullsized":"2024-09-10T10:10:00.722399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:53.697069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721966+0000","last_change":"2024-09-10T10:08:44.929048+0000","last_active":"2024-09-10T10:10:00.721966+0000","last_peered":"2024-09-10T10:10:00.721966+0000","last_clean":"2024-09-10T10:10:00.721966+0000","last_became_active":"2024-09-10T10:08:44.928345+0000","last_became_peered":"2024-09-10T10:08:44.928345+0000","last_unstale":"2024-09-10T10:10:00.721966+0000","last_undegraded":"2024-09-10T10:10:00.721966+0000","last_fullsized":"2024-09-10T10:10:00.721966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:23.121853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776712+0000","last_change":"2024-09-10T10:08:35.377385+0000","last_active":"2024-09-10T10:10:58.776712+0000","last_peered":"2024-09-10T10:10:58.776712+0000","last_clean":"2024-09-10T10:10:58.776712+0000","last_became_active":"2024-09-10T10:08:35.377092+0000","last_became_peered":"2024-09-10T10:08:35.377092+0000","last_unstale":"2024-09-10T10:10:58.776712+0000","last_undegraded":"2024-09-10T10:10:58.776712+0000","last_fullsized":"2024-09-10T10:10:58.776712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:23.169370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972319+0000","last_change":"2024-09-10T10:08:32.891614+0000","last_active":"2024-09-10T10:10:00.972319+0000","last_peered":"2024-09-10T10:10:00.972319+0000","last_clean":"2024-09-10T10:10:00.972319+0000","last_became_active":"2024-09-10T10:08:32.891141+0000","last_became_peered":"2024-09-10T10:08:32.891141+0000","last_unstale":"2024-09-10T10:10:00.972319+0000","last_undegraded":"2024-09-10T10:10:00.972319+0000","last_fullsized":"2024-09-10T10:10:00.972319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:20.258863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721932+0000","last_change":"2024-09-10T10:08:44.401125+0000","last_active":"2024-09-10T10:10:00.721932+0000","last_peered":"2024-09-10T10:10:00.721932+0000","last_clean":"2024-09-10T10:10:00.721932+0000","last_became_active":"2024-09-10T10:08:44.400483+0000","last_became_peered":"2024-09-10T10:08:44.400483+0000","last_unstale":"2024-09-10T10:10:00.721932+0000","last_undegraded":"2024-09-10T10:10:00.721932+0000","last_fullsized":"2024-09-10T10:10:00.721932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:12.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766815+0000","last_change":"2024-09-10T10:08:35.376806+0000","last_active":"2024-09-10T10:10:58.766815+0000","last_peered":"2024-09-10T10:10:58.766815+0000","last_clean":"2024-09-10T10:10:58.766815+0000","last_became_active":"2024-09-10T10:08:35.376400+0000","last_became_peered":"2024-09-10T10:08:35.376400+0000","last_unstale":"2024-09-10T10:10:58.766815+0000","last_undegraded":"2024-09-10T10:10:58.766815+0000","last_fullsized":"2024-09-10T10:10:58.766815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:48.303039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721567+0000","last_change":"2024-09-10T10:08:32.883881+0000","last_active":"2024-09-10T10:10:00.721567+0000","last_peered":"2024-09-10T10:10:00.721567+0000","last_clean":"2024-09-10T10:10:00.721567+0000","last_became_active":"2024-09-10T10:08:32.883540+0000","last_became_peered":"2024-09-10T10:08:32.883540+0000","last_unstale":"2024-09-10T10:10:00.721567+0000","last_undegraded":"2024-09-10T10:10:00.721567+0000","last_fullsized":"2024-09-10T10:10:00.721567+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:57.359729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724324+0000","last_change":"2024-09-10T10:08:44.401548+0000","last_active":"2024-09-10T10:10:00.724324+0000","last_peered":"2024-09-10T10:10:00.724324+0000","last_clean":"2024-09-10T10:10:00.724324+0000","last_became_active":"2024-09-10T10:08:44.401034+0000","last_became_peered":"2024-09-10T10:08:44.401034+0000","last_unstale":"2024-09-10T10:10:00.724324+0000","last_undegraded":"2024-09-10T10:10:00.724324+0000","last_fullsized":"2024-09-10T10:10:00.724324+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:17.292973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"95'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.760304+0000","last_change":"2024-09-10T10:08:35.359969+0000","last_active":"2024-09-10T10:10:58.760304+0000","last_peered":"2024-09-10T10:10:58.760304+0000","last_clean":"2024-09-10T10:10:58.760304+0000","last_became_active":"2024-09-10T10:08:35.359599+0000","last_became_peered":"2024-09-10T10:08:35.359599+0000","last_unstale":"2024-09-10T10:10:58.760304+0000","last_undegraded":"2024-09-10T10:10:58.760304+0000","last_fullsized":"2024-09-10T10:10:58.760304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:00.778269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862147+0000","last_change":"2024-09-10T10:09:00.487582+0000","last_active":"2024-09-10T10:10:00.862147+0000","last_peered":"2024-09-10T10:10:00.862147+0000","last_clean":"2024-09-10T10:10:00.862147+0000","last_became_active":"2024-09-10T10:09:00.487229+0000","last_became_peered":"2024-09-10T10:09:00.487229+0000","last_unstale":"2024-09-10T10:10:00.862147+0000","last_undegraded":"2024-09-10T10:10:00.862147+0000","last_fullsized":"2024-09-10T10:10:00.862147+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:53.341736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722077+0000","last_change":"2024-09-10T10:08:44.929224+0000","last_active":"2024-09-10T10:10:00.722077+0000","last_peered":"2024-09-10T10:10:00.722077+0000","last_clean":"2024-09-10T10:10:00.722077+0000","last_became_active":"2024-09-10T10:08:44.928640+0000","last_became_peered":"2024-09-10T10:08:44.928640+0000","last_unstale":"2024-09-10T10:10:00.722077+0000","last_undegraded":"2024-09-10T10:10:00.722077+0000","last_fullsized":"2024-09-10T10:10:00.722077+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:42.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778123+0000","last_change":"2024-09-10T10:08:35.376585+0000","last_active":"2024-09-10T10:10:58.778123+0000","last_peered":"2024-09-10T10:10:58.778123+0000","last_clean":"2024-09-10T10:10:58.778123+0000","last_became_active":"2024-09-10T10:08:35.375693+0000","last_became_peered":"2024-09-10T10:08:35.375693+0000","last_unstale":"2024-09-10T10:10:58.778123+0000","last_undegraded":"2024-09-10T10:10:58.778123+0000","last_fullsized":"2024-09-10T10:10:58.778123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:59.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722314+0000","last_change":"2024-09-10T10:08:32.884542+0000","last_active":"2024-09-10T10:10:00.722314+0000","last_peered":"2024-09-10T10:10:00.722314+0000","last_clean":"2024-09-10T10:10:00.722314+0000","last_became_active":"2024-09-10T10:08:32.884192+0000","last_became_peered":"2024-09-10T10:08:32.884192+0000","last_unstale":"2024-09-10T10:10:00.722314+0000","last_undegraded":"2024-09-10T10:10:00.722314+0000","last_fullsized":"2024-09-10T10:10:00.722314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:57.756641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972690+0000","last_change":"2024-09-10T10:08:44.391514+0000","last_active":"2024-09-10T10:10:00.972690+0000","last_peered":"2024-09-10T10:10:00.972690+0000","last_clean":"2024-09-10T10:10:00.972690+0000","last_became_active":"2024-09-10T10:08:44.391116+0000","last_became_peered":"2024-09-10T10:08:44.391116+0000","last_unstale":"2024-09-10T10:10:00.972690+0000","last_undegraded":"2024-09-10T10:10:00.972690+0000","last_fullsized":"2024-09-10T10:10:00.972690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:41.586014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.768916+0000","last_change":"2024-09-10T10:08:35.365604+0000","last_active":"2024-09-10T10:10:58.768916+0000","last_peered":"2024-09-10T10:10:58.768916+0000","last_clean":"2024-09-10T10:10:58.768916+0000","last_became_active":"2024-09-10T10:08:35.364915+0000","last_became_peered":"2024-09-10T10:08:35.364915+0000","last_unstale":"2024-09-10T10:10:58.768916+0000","last_undegraded":"2024-09-10T10:10:58.768916+0000","last_fullsized":"2024-09-10T10:10:58.768916+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:12.885021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'13","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:59.381750+0000","last_change":"2024-09-10T10:08:32.888223+0000","last_active":"2024-09-10T10:10:59.381750+0000","last_peered":"2024-09-10T10:10:59.381750+0000","last_clean":"2024-09-10T10:10:59.381750+0000","last_became_active":"2024-09-10T10:08:32.887919+0000","last_became_peered":"2024-09-10T10:08:32.887919+0000","last_unstale":"2024-09-10T10:10:59.381750+0000","last_undegraded":"2024-09-10T10:10:59.381750+0000","last_fullsized":"2024-09-10T10:10:59.381750+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:19.781337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721073+0000","last_change":"2024-09-10T10:08:44.929322+0000","last_active":"2024-09-10T10:10:00.721073+0000","last_peered":"2024-09-10T10:10:00.721073+0000","last_clean":"2024-09-10T10:10:00.721073+0000","last_became_active":"2024-09-10T10:08:44.928252+0000","last_became_peered":"2024-09-10T10:08:44.928252+0000","last_unstale":"2024-09-10T10:10:00.721073+0000","last_undegraded":"2024-09-10T10:10:00.721073+0000","last_fullsized":"2024-09-10T10:10:00.721073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:33.048265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762075+0000","last_change":"2024-09-10T10:08:35.364168+0000","last_active":"2024-09-10T10:10:58.762075+0000","last_peered":"2024-09-10T10:10:58.762075+0000","last_clean":"2024-09-10T10:10:58.762075+0000","last_became_active":"2024-09-10T10:08:35.363739+0000","last_became_peered":"2024-09-10T10:08:35.363739+0000","last_unstale":"2024-09-10T10:10:58.762075+0000","last_undegraded":"2024-09-10T10:10:58.762075+0000","last_fullsized":"2024-09-10T10:10:58.762075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:43.029409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722836+0000","last_change":"2024-09-10T10:08:32.893021+0000","last_active":"2024-09-10T10:10:00.722836+0000","last_peered":"2024-09-10T10:10:00.722836+0000","last_clean":"2024-09-10T10:10:00.722836+0000","last_became_active":"2024-09-10T10:08:32.892667+0000","last_became_peered":"2024-09-10T10:08:32.892667+0000","last_unstale":"2024-09-10T10:10:00.722836+0000","last_undegraded":"2024-09-10T10:10:00.722836+0000","last_fullsized":"2024-09-10T10:10:00.722836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:52.427489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185575+0000","last_change":"2024-09-10T10:08:44.393831+0000","last_active":"2024-09-10T10:10:01.185575+0000","last_peered":"2024-09-10T10:10:01.185575+0000","last_clean":"2024-09-10T10:10:01.185575+0000","last_became_active":"2024-09-10T10:08:44.393415+0000","last_became_peered":"2024-09-10T10:08:44.393415+0000","last_unstale":"2024-09-10T10:10:01.185575+0000","last_undegraded":"2024-09-10T10:10:01.185575+0000","last_fullsized":"2024-09-10T10:10:01.185575+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:52.171292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769530+0000","last_change":"2024-09-10T10:08:35.374787+0000","last_active":"2024-09-10T10:10:58.769530+0000","last_peered":"2024-09-10T10:10:58.769530+0000","last_clean":"2024-09-10T10:10:58.769530+0000","last_became_active":"2024-09-10T10:08:35.374549+0000","last_became_peered":"2024-09-10T10:08:35.374549+0000","last_unstale":"2024-09-10T10:10:58.769530+0000","last_undegraded":"2024-09-10T10:10:58.769530+0000","last_fullsized":"2024-09-10T10:10:58.769530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:58.925515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724437+0000","last_change":"2024-09-10T10:08:32.886267+0000","last_active":"2024-09-10T10:10:00.724437+0000","last_peered":"2024-09-10T10:10:00.724437+0000","last_clean":"2024-09-10T10:10:00.724437+0000","last_became_active":"2024-09-10T10:08:32.885869+0000","last_became_peered":"2024-09-10T10:08:32.885869+0000","last_unstale":"2024-09-10T10:10:00.724437+0000","last_undegraded":"2024-09-10T10:10:00.724437+0000","last_fullsized":"2024-09-10T10:10:00.724437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:06.784839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722243+0000","last_change":"2024-09-10T10:09:00.486656+0000","last_active":"2024-09-10T10:10:00.722243+0000","last_peered":"2024-09-10T10:10:00.722243+0000","last_clean":"2024-09-10T10:10:00.722243+0000","last_became_active":"2024-09-10T10:09:00.486072+0000","last_became_peered":"2024-09-10T10:09:00.486072+0000","last_unstale":"2024-09-10T10:10:00.722243+0000","last_undegraded":"2024-09-10T10:10:00.722243+0000","last_fullsized":"2024-09-10T10:10:00.722243+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:26.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767023+0000","last_change":"2024-09-10T10:08:35.366130+0000","last_active":"2024-09-10T10:10:58.767023+0000","last_peered":"2024-09-10T10:10:58.767023+0000","last_clean":"2024-09-10T10:10:58.767023+0000","last_became_active":"2024-09-10T10:08:35.365785+0000","last_became_peered":"2024-09-10T10:08:35.365785+0000","last_unstale":"2024-09-10T10:10:58.767023+0000","last_undegraded":"2024-09-10T10:10:58.767023+0000","last_fullsized":"2024-09-10T10:10:58.767023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:35.771767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184987+0000","last_change":"2024-09-10T10:08:32.884113+0000","last_active":"2024-09-10T10:10:01.184987+0000","last_peered":"2024-09-10T10:10:01.184987+0000","last_clean":"2024-09-10T10:10:01.184987+0000","last_became_active":"2024-09-10T10:08:32.883503+0000","last_became_peered":"2024-09-10T10:08:32.883503+0000","last_unstale":"2024-09-10T10:10:01.184987+0000","last_undegraded":"2024-09-10T10:10:01.184987+0000","last_fullsized":"2024-09-10T10:10:01.184987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:20.513465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040285+0000","last_change":"2024-09-10T10:08:44.400137+0000","last_active":"2024-09-10T10:10:01.040285+0000","last_peered":"2024-09-10T10:10:01.040285+0000","last_clean":"2024-09-10T10:10:01.040285+0000","last_became_active":"2024-09-10T10:08:44.398736+0000","last_became_peered":"2024-09-10T10:08:44.398736+0000","last_unstale":"2024-09-10T10:10:01.040285+0000","last_undegraded":"2024-09-10T10:10:01.040285+0000","last_fullsized":"2024-09-10T10:10:01.040285+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:48.922732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.756485+0000","last_change":"2024-09-10T10:08:35.360818+0000","last_active":"2024-09-10T10:10:58.756485+0000","last_peered":"2024-09-10T10:10:58.756485+0000","last_clean":"2024-09-10T10:10:58.756485+0000","last_became_active":"2024-09-10T10:08:35.360504+0000","last_became_peered":"2024-09-10T10:08:35.360504+0000","last_unstale":"2024-09-10T10:10:58.756485+0000","last_undegraded":"2024-09-10T10:10:58.756485+0000","last_fullsized":"2024-09-10T10:10:58.756485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:45.396069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"95'5","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:15.700178+0000","last_change":"2024-09-10T10:08:32.883915+0000","last_active":"2024-09-10T10:11:15.700178+0000","last_peered":"2024-09-10T10:11:15.700178+0000","last_clean":"2024-09-10T10:11:15.700178+0000","last_became_active":"2024-09-10T10:08:32.883573+0000","last_became_peered":"2024-09-10T10:08:32.883573+0000","last_unstale":"2024-09-10T10:11:15.700178+0000","last_undegraded":"2024-09-10T10:11:15.700178+0000","last_fullsized":"2024-09-10T10:11:15.700178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:56.271267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040574+0000","last_change":"2024-09-10T10:08:44.928968+0000","last_active":"2024-09-10T10:10:01.040574+0000","last_peered":"2024-09-10T10:10:01.040574+0000","last_clean":"2024-09-10T10:10:01.040574+0000","last_became_active":"2024-09-10T10:08:44.928445+0000","last_became_peered":"2024-09-10T10:08:44.928445+0000","last_unstale":"2024-09-10T10:10:01.040574+0000","last_undegraded":"2024-09-10T10:10:01.040574+0000","last_fullsized":"2024-09-10T10:10:01.040574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:01.799454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.748248+0000","last_change":"2024-09-10T10:08:35.369027+0000","last_active":"2024-09-10T10:10:58.748248+0000","last_peered":"2024-09-10T10:10:58.748248+0000","last_clean":"2024-09-10T10:10:58.748248+0000","last_became_active":"2024-09-10T10:08:35.368692+0000","last_became_peered":"2024-09-10T10:08:35.368692+0000","last_unstale":"2024-09-10T10:10:58.748248+0000","last_undegraded":"2024-09-10T10:10:58.748248+0000","last_fullsized":"2024-09-10T10:10:58.748248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:09.500617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184814+0000","last_change":"2024-09-10T10:08:32.888661+0000","last_active":"2024-09-10T10:10:01.184814+0000","last_peered":"2024-09-10T10:10:01.184814+0000","last_clean":"2024-09-10T10:10:01.184814+0000","last_became_active":"2024-09-10T10:08:32.888312+0000","last_became_peered":"2024-09-10T10:08:32.888312+0000","last_unstale":"2024-09-10T10:10:01.184814+0000","last_undegraded":"2024-09-10T10:10:01.184814+0000","last_fullsized":"2024-09-10T10:10:01.184814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:47.293560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840405+0000","last_change":"2024-09-10T10:08:44.929512+0000","last_active":"2024-09-10T10:10:00.840405+0000","last_peered":"2024-09-10T10:10:00.840405+0000","last_clean":"2024-09-10T10:10:00.840405+0000","last_became_active":"2024-09-10T10:08:44.928992+0000","last_became_peered":"2024-09-10T10:08:44.928992+0000","last_unstale":"2024-09-10T10:10:00.840405+0000","last_undegraded":"2024-09-10T10:10:00.840405+0000","last_fullsized":"2024-09-10T10:10:00.840405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:31.827967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'8","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766202+0000","last_change":"2024-09-10T10:10:00.863430+0000","last_active":"2024-09-10T10:10:58.766202+0000","last_peered":"2024-09-10T10:10:58.766202+0000","last_clean":"2024-09-10T10:10:58.766202+0000","last_became_active":"2024-09-10T10:10:00.863082+0000","last_became_peered":"2024-09-10T10:10:00.863082+0000","last_unstale":"2024-09-10T10:10:58.766202+0000","last_undegraded":"2024-09-10T10:10:58.766202+0000","last_fullsized":"2024-09-10T10:10:58.766202+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:24.848797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722248+0000","last_change":"2024-09-10T10:08:32.885451+0000","last_active":"2024-09-10T10:10:00.722248+0000","last_peered":"2024-09-10T10:10:00.722248+0000","last_clean":"2024-09-10T10:10:00.722248+0000","last_became_active":"2024-09-10T10:08:32.885102+0000","last_became_peered":"2024-09-10T10:08:32.885102+0000","last_unstale":"2024-09-10T10:10:00.722248+0000","last_undegraded":"2024-09-10T10:10:00.722248+0000","last_fullsized":"2024-09-10T10:10:00.722248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:52.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":356,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185287+0000","last_change":"2024-09-10T10:07:13.661841+0000","last_active":"2024-09-10T10:10:01.185287+0000","last_peered":"2024-09-10T10:10:01.185287+0000","last_clean":"2024-09-10T10:10:01.185287+0000","last_became_active":"2024-09-10T10:07:13.661310+0000","last_became_peered":"2024-09-10T10:07:13.661310+0000","last_unstale":"2024-09-10T10:10:01.185287+0000","last_undegraded":"2024-09-10T10:10:01.185287+0000","last_fullsized":"2024-09-10T10:10:01.185287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_clean_scrub_stamp":"2024-09-10T10:03:29.327083+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:39.414636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185638+0000","last_change":"2024-09-10T10:08:44.391277+0000","last_active":"2024-09-10T10:10:01.185638+0000","last_peered":"2024-09-10T10:10:01.185638+0000","last_clean":"2024-09-10T10:10:01.185638+0000","last_became_active":"2024-09-10T10:08:44.390867+0000","last_became_peered":"2024-09-10T10:08:44.390867+0000","last_unstale":"2024-09-10T10:10:01.185638+0000","last_undegraded":"2024-09-10T10:10:01.185638+0000","last_fullsized":"2024-09-10T10:10:01.185638+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:23.299812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772994+0000","last_change":"2024-09-10T10:08:35.364750+0000","last_active":"2024-09-10T10:10:58.772994+0000","last_peered":"2024-09-10T10:10:58.772994+0000","last_clean":"2024-09-10T10:10:58.772994+0000","last_became_active":"2024-09-10T10:08:35.364034+0000","last_became_peered":"2024-09-10T10:08:35.364034+0000","last_unstale":"2024-09-10T10:10:58.772994+0000","last_undegraded":"2024-09-10T10:10:58.772994+0000","last_fullsized":"2024-09-10T10:10:58.772994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:15.296086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973375+0000","last_change":"2024-09-10T10:08:32.886884+0000","last_active":"2024-09-10T10:10:00.973375+0000","last_peered":"2024-09-10T10:10:00.973375+0000","last_clean":"2024-09-10T10:10:00.973375+0000","last_became_active":"2024-09-10T10:08:32.886544+0000","last_became_peered":"2024-09-10T10:08:32.886544+0000","last_unstale":"2024-09-10T10:10:00.973375+0000","last_undegraded":"2024-09-10T10:10:00.973375+0000","last_fullsized":"2024-09-10T10:10:00.973375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:30.511881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862240+0000","last_change":"2024-09-10T10:08:44.390761+0000","last_active":"2024-09-10T10:10:00.862240+0000","last_peered":"2024-09-10T10:10:00.862240+0000","last_clean":"2024-09-10T10:10:00.862240+0000","last_became_active":"2024-09-10T10:08:44.390190+0000","last_became_peered":"2024-09-10T10:08:44.390190+0000","last_unstale":"2024-09-10T10:10:00.862240+0000","last_undegraded":"2024-09-10T10:10:00.862240+0000","last_fullsized":"2024-09-10T10:10:00.862240+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:38.216171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767507+0000","last_change":"2024-09-10T10:08:35.362956+0000","last_active":"2024-09-10T10:10:58.767507+0000","last_peered":"2024-09-10T10:10:58.767507+0000","last_clean":"2024-09-10T10:10:58.767507+0000","last_became_active":"2024-09-10T10:08:35.362623+0000","last_became_peered":"2024-09-10T10:08:35.362623+0000","last_unstale":"2024-09-10T10:10:58.767507+0000","last_undegraded":"2024-09-10T10:10:58.767507+0000","last_fullsized":"2024-09-10T10:10:58.767507+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:50.162838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840553+0000","last_change":"2024-09-10T10:08:32.889741+0000","last_active":"2024-09-10T10:10:00.840553+0000","last_peered":"2024-09-10T10:10:00.840553+0000","last_clean":"2024-09-10T10:10:00.840553+0000","last_became_active":"2024-09-10T10:08:32.889394+0000","last_became_peered":"2024-09-10T10:08:32.889394+0000","last_unstale":"2024-09-10T10:10:00.840553+0000","last_undegraded":"2024-09-10T10:10:00.840553+0000","last_fullsized":"2024-09-10T10:10:00.840553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:16.845738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938314+0000","last_change":"2024-09-10T10:08:44.403781+0000","last_active":"2024-09-10T10:10:00.938314+0000","last_peered":"2024-09-10T10:10:00.938314+0000","last_clean":"2024-09-10T10:10:00.938314+0000","last_became_active":"2024-09-10T10:08:44.399601+0000","last_became_peered":"2024-09-10T10:08:44.399601+0000","last_unstale":"2024-09-10T10:10:00.938314+0000","last_undegraded":"2024-09-10T10:10:00.938314+0000","last_fullsized":"2024-09-10T10:10:00.938314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:45.587247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765508+0000","last_change":"2024-09-10T10:08:35.367825+0000","last_active":"2024-09-10T10:10:58.765508+0000","last_peered":"2024-09-10T10:10:58.765508+0000","last_clean":"2024-09-10T10:10:58.765508+0000","last_became_active":"2024-09-10T10:08:35.367511+0000","last_became_peered":"2024-09-10T10:08:35.367511+0000","last_unstale":"2024-09-10T10:10:58.765508+0000","last_undegraded":"2024-09-10T10:10:58.765508+0000","last_fullsized":"2024-09-10T10:10:58.765508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:03.356912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039782+0000","last_change":"2024-09-10T10:08:32.888524+0000","last_active":"2024-09-10T10:10:01.039782+0000","last_peered":"2024-09-10T10:10:01.039782+0000","last_clean":"2024-09-10T10:10:01.039782+0000","last_became_active":"2024-09-10T10:08:32.888148+0000","last_became_peered":"2024-09-10T10:08:32.888148+0000","last_unstale":"2024-09-10T10:10:01.039782+0000","last_undegraded":"2024-09-10T10:10:01.039782+0000","last_fullsized":"2024-09-10T10:10:01.039782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:34.342167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839577+0000","last_change":"2024-09-10T10:08:44.392952+0000","last_active":"2024-09-10T10:10:00.839577+0000","last_peered":"2024-09-10T10:10:00.839577+0000","last_clean":"2024-09-10T10:10:00.839577+0000","last_became_active":"2024-09-10T10:08:44.392476+0000","last_became_peered":"2024-09-10T10:08:44.392476+0000","last_unstale":"2024-09-10T10:10:00.839577+0000","last_undegraded":"2024-09-10T10:10:00.839577+0000","last_fullsized":"2024-09-10T10:10:00.839577+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:26.530305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761361+0000","last_change":"2024-09-10T10:08:35.364501+0000","last_active":"2024-09-10T10:10:58.761361+0000","last_peered":"2024-09-10T10:10:58.761361+0000","last_clean":"2024-09-10T10:10:58.761361+0000","last_became_active":"2024-09-10T10:08:35.364102+0000","last_became_peered":"2024-09-10T10:08:35.364102+0000","last_unstale":"2024-09-10T10:10:58.761361+0000","last_undegraded":"2024-09-10T10:10:58.761361+0000","last_fullsized":"2024-09-10T10:10:58.761361+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:42.743140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":22,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185891+0000","last_change":"2024-09-10T10:09:00.461639+0000","last_active":"2024-09-10T10:10:01.185891+0000","last_peered":"2024-09-10T10:10:01.185891+0000","last_clean":"2024-09-10T10:10:01.185891+0000","last_became_active":"2024-09-10T10:09:00.457246+0000","last_became_peered":"2024-09-10T10:09:00.457246+0000","last_unstale":"2024-09-10T10:10:01.185891+0000","last_undegraded":"2024-09-10T10:10:01.185891+0000","last_fullsized":"2024-09-10T10:10:01.185891+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:30.387035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840110+0000","last_change":"2024-09-10T10:08:44.401728+0000","last_active":"2024-09-10T10:10:00.840110+0000","last_peered":"2024-09-10T10:10:00.840110+0000","last_clean":"2024-09-10T10:10:00.840110+0000","last_became_active":"2024-09-10T10:08:44.401334+0000","last_became_peered":"2024-09-10T10:08:44.401334+0000","last_unstale":"2024-09-10T10:10:00.840110+0000","last_undegraded":"2024-09-10T10:10:00.840110+0000","last_fullsized":"2024-09-10T10:10:00.840110+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:57.496196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"95'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769526+0000","last_change":"2024-09-10T10:09:00.486353+0000","last_active":"2024-09-10T10:10:58.769526+0000","last_peered":"2024-09-10T10:10:58.769526+0000","last_clean":"2024-09-10T10:10:58.769526+0000","last_became_active":"2024-09-10T10:09:00.485938+0000","last_became_peered":"2024-09-10T10:09:00.485938+0000","last_unstale":"2024-09-10T10:10:58.769526+0000","last_undegraded":"2024-09-10T10:10:58.769526+0000","last_fullsized":"2024-09-10T10:10:58.769526+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:38.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722331+0000","last_change":"2024-09-10T10:08:32.893278+0000","last_active":"2024-09-10T10:10:00.722331+0000","last_peered":"2024-09-10T10:10:00.722331+0000","last_clean":"2024-09-10T10:10:00.722331+0000","last_became_active":"2024-09-10T10:08:32.892848+0000","last_became_peered":"2024-09-10T10:08:32.892848+0000","last_unstale":"2024-09-10T10:10:00.722331+0000","last_undegraded":"2024-09-10T10:10:00.722331+0000","last_fullsized":"2024-09-10T10:10:00.722331+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:09.336253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040465+0000","last_change":"2024-09-10T10:08:44.407213+0000","last_active":"2024-09-10T10:10:01.040465+0000","last_peered":"2024-09-10T10:10:01.040465+0000","last_clean":"2024-09-10T10:10:01.040465+0000","last_became_active":"2024-09-10T10:08:44.405198+0000","last_became_peered":"2024-09-10T10:08:44.405198+0000","last_unstale":"2024-09-10T10:10:01.040465+0000","last_undegraded":"2024-09-10T10:10:01.040465+0000","last_fullsized":"2024-09-10T10:10:01.040465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:15.921684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767621+0000","last_change":"2024-09-10T10:08:35.362683+0000","last_active":"2024-09-10T10:10:58.767621+0000","last_peered":"2024-09-10T10:10:58.767621+0000","last_clean":"2024-09-10T10:10:58.767621+0000","last_became_active":"2024-09-10T10:08:35.362353+0000","last_became_peered":"2024-09-10T10:08:35.362353+0000","last_unstale":"2024-09-10T10:10:58.767621+0000","last_undegraded":"2024-09-10T10:10:58.767621+0000","last_fullsized":"2024-09-10T10:10:58.767621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.489716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"95'5","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:18.705229+0000","last_change":"2024-09-10T10:08:32.881024+0000","last_active":"2024-09-10T10:11:18.705229+0000","last_peered":"2024-09-10T10:11:18.705229+0000","last_clean":"2024-09-10T10:11:18.705229+0000","last_became_active":"2024-09-10T10:08:32.880691+0000","last_became_peered":"2024-09-10T10:08:32.880691+0000","last_unstale":"2024-09-10T10:11:18.705229+0000","last_undegraded":"2024-09-10T10:11:18.705229+0000","last_fullsized":"2024-09-10T10:11:18.705229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:15.988063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724443+0000","last_change":"2024-09-10T10:08:44.400509+0000","last_active":"2024-09-10T10:10:00.724443+0000","last_peered":"2024-09-10T10:10:00.724443+0000","last_clean":"2024-09-10T10:10:00.724443+0000","last_became_active":"2024-09-10T10:08:44.400152+0000","last_became_peered":"2024-09-10T10:08:44.400152+0000","last_unstale":"2024-09-10T10:10:00.724443+0000","last_undegraded":"2024-09-10T10:10:00.724443+0000","last_fullsized":"2024-09-10T10:10:00.724443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:43.550208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.775766+0000","last_change":"2024-09-10T10:08:35.364208+0000","last_active":"2024-09-10T10:10:58.775766+0000","last_peered":"2024-09-10T10:10:58.775766+0000","last_clean":"2024-09-10T10:10:58.775766+0000","last_became_active":"2024-09-10T10:08:35.363751+0000","last_became_peered":"2024-09-10T10:08:35.363751+0000","last_unstale":"2024-09-10T10:10:58.775766+0000","last_undegraded":"2024-09-10T10:10:58.775766+0000","last_fullsized":"2024-09-10T10:10:58.775766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:21.791512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840204+0000","last_change":"2024-09-10T10:08:32.890611+0000","last_active":"2024-09-10T10:10:00.840204+0000","last_peered":"2024-09-10T10:10:00.840204+0000","last_clean":"2024-09-10T10:10:00.840204+0000","last_became_active":"2024-09-10T10:08:32.890296+0000","last_became_peered":"2024-09-10T10:08:32.890296+0000","last_unstale":"2024-09-10T10:10:00.840204+0000","last_undegraded":"2024-09-10T10:10:00.840204+0000","last_fullsized":"2024-09-10T10:10:00.840204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.977575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185624+0000","last_change":"2024-09-10T10:08:44.402607+0000","last_active":"2024-09-10T10:10:01.185624+0000","last_peered":"2024-09-10T10:10:01.185624+0000","last_clean":"2024-09-10T10:10:01.185624+0000","last_became_active":"2024-09-10T10:08:44.401623+0000","last_became_peered":"2024-09-10T10:08:44.401623+0000","last_unstale":"2024-09-10T10:10:01.185624+0000","last_undegraded":"2024-09-10T10:10:01.185624+0000","last_fullsized":"2024-09-10T10:10:01.185624+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:21.105349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.775534+0000","last_change":"2024-09-10T10:08:35.360642+0000","last_active":"2024-09-10T10:10:58.775534+0000","last_peered":"2024-09-10T10:10:58.775534+0000","last_clean":"2024-09-10T10:10:58.775534+0000","last_became_active":"2024-09-10T10:08:35.356667+0000","last_became_peered":"2024-09-10T10:08:35.356667+0000","last_unstale":"2024-09-10T10:10:58.775534+0000","last_undegraded":"2024-09-10T10:10:58.775534+0000","last_fullsized":"2024-09-10T10:10:58.775534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:08.404973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972507+0000","last_change":"2024-09-10T10:08:32.890418+0000","last_active":"2024-09-10T10:10:00.972507+0000","last_peered":"2024-09-10T10:10:00.972507+0000","last_clean":"2024-09-10T10:10:00.972507+0000","last_became_active":"2024-09-10T10:08:32.890081+0000","last_became_peered":"2024-09-10T10:08:32.890081+0000","last_unstale":"2024-09-10T10:10:00.972507+0000","last_undegraded":"2024-09-10T10:10:00.972507+0000","last_fullsized":"2024-09-10T10:10:00.972507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:52.839714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840379+0000","last_change":"2024-09-10T10:08:44.401322+0000","last_active":"2024-09-10T10:10:00.840379+0000","last_peered":"2024-09-10T10:10:00.840379+0000","last_clean":"2024-09-10T10:10:00.840379+0000","last_became_active":"2024-09-10T10:08:44.400906+0000","last_became_peered":"2024-09-10T10:08:44.400906+0000","last_unstale":"2024-09-10T10:10:00.840379+0000","last_undegraded":"2024-09-10T10:10:00.840379+0000","last_fullsized":"2024-09-10T10:10:00.840379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:08.616288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761674+0000","last_change":"2024-09-10T10:08:35.366580+0000","last_active":"2024-09-10T10:10:58.761674+0000","last_peered":"2024-09-10T10:10:58.761674+0000","last_clean":"2024-09-10T10:10:58.761674+0000","last_became_active":"2024-09-10T10:08:35.365943+0000","last_became_peered":"2024-09-10T10:08:35.365943+0000","last_unstale":"2024-09-10T10:10:58.761674+0000","last_undegraded":"2024-09-10T10:10:58.761674+0000","last_fullsized":"2024-09-10T10:10:58.761674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:58.351517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"95'38","reported_seq":309,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:15.700952+0000","last_change":"2024-09-10T10:08:32.888411+0000","last_active":"2024-09-10T10:11:15.700952+0000","last_peered":"2024-09-10T10:11:15.700952+0000","last_clean":"2024-09-10T10:11:15.700952+0000","last_became_active":"2024-09-10T10:08:32.888093+0000","last_became_peered":"2024-09-10T10:08:32.888093+0000","last_unstale":"2024-09-10T10:11:15.700952+0000","last_undegraded":"2024-09-10T10:11:15.700952+0000","last_fullsized":"2024-09-10T10:11:15.700952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.532868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62636,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":230,"num_read_kb":177,"num_write":39,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724453+0000","last_change":"2024-09-10T10:08:44.400432+0000","last_active":"2024-09-10T10:10:00.724453+0000","last_peered":"2024-09-10T10:10:00.724453+0000","last_clean":"2024-09-10T10:10:00.724453+0000","last_became_active":"2024-09-10T10:08:44.399981+0000","last_became_peered":"2024-09-10T10:08:44.399981+0000","last_unstale":"2024-09-10T10:10:00.724453+0000","last_undegraded":"2024-09-10T10:10:00.724453+0000","last_fullsized":"2024-09-10T10:10:00.724453+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:57.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"95'11","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765617+0000","last_change":"2024-09-10T10:09:00.460848+0000","last_active":"2024-09-10T10:10:58.765617+0000","last_peered":"2024-09-10T10:10:58.765617+0000","last_clean":"2024-09-10T10:10:58.765617+0000","last_became_active":"2024-09-10T10:09:00.460459+0000","last_became_peered":"2024-09-10T10:09:00.460459+0000","last_unstale":"2024-09-10T10:10:58.765617+0000","last_undegraded":"2024-09-10T10:10:58.765617+0000","last_fullsized":"2024-09-10T10:10:58.765617+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:06.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840557+0000","last_change":"2024-09-10T10:08:32.885909+0000","last_active":"2024-09-10T10:10:00.840557+0000","last_peered":"2024-09-10T10:10:00.840557+0000","last_clean":"2024-09-10T10:10:00.840557+0000","last_became_active":"2024-09-10T10:08:32.885512+0000","last_became_peered":"2024-09-10T10:08:32.885512+0000","last_unstale":"2024-09-10T10:10:00.840557+0000","last_undegraded":"2024-09-10T10:10:00.840557+0000","last_fullsized":"2024-09-10T10:10:00.840557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:44.850772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721902+0000","last_change":"2024-09-10T10:08:44.400323+0000","last_active":"2024-09-10T10:10:00.721902+0000","last_peered":"2024-09-10T10:10:00.721902+0000","last_clean":"2024-09-10T10:10:00.721902+0000","last_became_active":"2024-09-10T10:08:44.399923+0000","last_became_peered":"2024-09-10T10:08:44.399923+0000","last_unstale":"2024-09-10T10:10:00.721902+0000","last_undegraded":"2024-09-10T10:10:00.721902+0000","last_fullsized":"2024-09-10T10:10:00.721902+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:45.496392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771495+0000","last_change":"2024-09-10T10:08:35.375543+0000","last_active":"2024-09-10T10:10:58.771495+0000","last_peered":"2024-09-10T10:10:58.771495+0000","last_clean":"2024-09-10T10:10:58.771495+0000","last_became_active":"2024-09-10T10:08:35.374312+0000","last_became_peered":"2024-09-10T10:08:35.374312+0000","last_unstale":"2024-09-10T10:10:58.771495+0000","last_undegraded":"2024-09-10T10:10:58.771495+0000","last_fullsized":"2024-09-10T10:10:58.771495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:34.208716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184909+0000","last_change":"2024-09-10T10:08:32.888540+0000","last_active":"2024-09-10T10:10:01.184909+0000","last_peered":"2024-09-10T10:10:01.184909+0000","last_clean":"2024-09-10T10:10:01.184909+0000","last_became_active":"2024-09-10T10:08:32.888187+0000","last_became_peered":"2024-09-10T10:08:32.888187+0000","last_unstale":"2024-09-10T10:10:01.184909+0000","last_undegraded":"2024-09-10T10:10:01.184909+0000","last_fullsized":"2024-09-10T10:10:01.184909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:06.694533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.723713+0000","last_change":"2024-09-10T10:08:44.397995+0000","last_active":"2024-09-10T10:10:00.723713+0000","last_peered":"2024-09-10T10:10:00.723713+0000","last_clean":"2024-09-10T10:10:00.723713+0000","last_became_active":"2024-09-10T10:08:44.397583+0000","last_became_peered":"2024-09-10T10:08:44.397583+0000","last_unstale":"2024-09-10T10:10:00.723713+0000","last_undegraded":"2024-09-10T10:10:00.723713+0000","last_fullsized":"2024-09-10T10:10:00.723713+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:03.908014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773846+0000","last_change":"2024-09-10T10:08:35.361053+0000","last_active":"2024-09-10T10:10:58.773846+0000","last_peered":"2024-09-10T10:10:58.773846+0000","last_clean":"2024-09-10T10:10:58.773846+0000","last_became_active":"2024-09-10T10:08:35.360736+0000","last_became_peered":"2024-09-10T10:08:35.360736+0000","last_unstale":"2024-09-10T10:10:58.773846+0000","last_undegraded":"2024-09-10T10:10:58.773846+0000","last_fullsized":"2024-09-10T10:10:58.773846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:45.435384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"95'4","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:14.698498+0000","last_change":"2024-09-10T10:08:32.885067+0000","last_active":"2024-09-10T10:11:14.698498+0000","last_peered":"2024-09-10T10:11:14.698498+0000","last_clean":"2024-09-10T10:11:14.698498+0000","last_became_active":"2024-09-10T10:08:32.884676+0000","last_became_peered":"2024-09-10T10:08:32.884676+0000","last_unstale":"2024-09-10T10:11:14.698498+0000","last_undegraded":"2024-09-10T10:11:14.698498+0000","last_fullsized":"2024-09-10T10:11:14.698498+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.667680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721235+0000","last_change":"2024-09-10T10:08:44.395892+0000","last_active":"2024-09-10T10:10:00.721235+0000","last_peered":"2024-09-10T10:10:00.721235+0000","last_clean":"2024-09-10T10:10:00.721235+0000","last_became_active":"2024-09-10T10:08:44.395188+0000","last_became_peered":"2024-09-10T10:08:44.395188+0000","last_unstale":"2024-09-10T10:10:00.721235+0000","last_undegraded":"2024-09-10T10:10:00.721235+0000","last_fullsized":"2024-09-10T10:10:00.721235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:27.562053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.939198+0000","last_change":"2024-09-10T10:08:44.403185+0000","last_active":"2024-09-10T10:10:00.939198+0000","last_peered":"2024-09-10T10:10:00.939198+0000","last_clean":"2024-09-10T10:10:00.939198+0000","last_became_active":"2024-09-10T10:08:44.399943+0000","last_became_peered":"2024-09-10T10:08:44.399943+0000","last_unstale":"2024-09-10T10:10:00.939198+0000","last_undegraded":"2024-09-10T10:10:00.939198+0000","last_fullsized":"2024-09-10T10:10:00.939198+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:07.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.770162+0000","last_change":"2024-09-10T10:08:35.367552+0000","last_active":"2024-09-10T10:10:58.770162+0000","last_peered":"2024-09-10T10:10:58.770162+0000","last_clean":"2024-09-10T10:10:58.770162+0000","last_became_active":"2024-09-10T10:08:35.367215+0000","last_became_peered":"2024-09-10T10:08:35.367215+0000","last_unstale":"2024-09-10T10:10:58.770162+0000","last_undegraded":"2024-09-10T10:10:58.770162+0000","last_fullsized":"2024-09-10T10:10:58.770162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:28.756769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840019+0000","last_change":"2024-09-10T10:08:32.885830+0000","last_active":"2024-09-10T10:10:00.840019+0000","last_peered":"2024-09-10T10:10:00.840019+0000","last_clean":"2024-09-10T10:10:00.840019+0000","last_became_active":"2024-09-10T10:08:32.885465+0000","last_became_peered":"2024-09-10T10:08:32.885465+0000","last_unstale":"2024-09-10T10:10:00.840019+0000","last_undegraded":"2024-09-10T10:10:00.840019+0000","last_fullsized":"2024-09-10T10:10:00.840019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:55.101364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185761+0000","last_change":"2024-09-10T10:09:00.487666+0000","last_active":"2024-09-10T10:10:01.185761+0000","last_peered":"2024-09-10T10:10:01.185761+0000","last_clean":"2024-09-10T10:10:01.185761+0000","last_became_active":"2024-09-10T10:09:00.487110+0000","last_became_peered":"2024-09-10T10:09:00.487110+0000","last_unstale":"2024-09-10T10:10:01.185761+0000","last_undegraded":"2024-09-10T10:10:01.185761+0000","last_fullsized":"2024-09-10T10:10:01.185761+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:28.817826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755501+0000","last_change":"2024-09-10T10:08:35.356247+0000","last_active":"2024-09-10T10:10:58.755501+0000","last_peered":"2024-09-10T10:10:58.755501+0000","last_clean":"2024-09-10T10:10:58.755501+0000","last_became_active":"2024-09-10T10:08:35.355953+0000","last_became_peered":"2024-09-10T10:08:35.355953+0000","last_unstale":"2024-09-10T10:10:58.755501+0000","last_undegraded":"2024-09-10T10:10:58.755501+0000","last_fullsized":"2024-09-10T10:10:58.755501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:24.625382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039784+0000","last_change":"2024-09-10T10:08:32.882151+0000","last_active":"2024-09-10T10:10:01.039784+0000","last_peered":"2024-09-10T10:10:01.039784+0000","last_clean":"2024-09-10T10:10:01.039784+0000","last_became_active":"2024-09-10T10:08:32.881688+0000","last_became_peered":"2024-09-10T10:08:32.881688+0000","last_unstale":"2024-09-10T10:10:01.039784+0000","last_undegraded":"2024-09-10T10:10:01.039784+0000","last_fullsized":"2024-09-10T10:10:01.039784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:49.186299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.109676+0000","last_change":"2024-09-10T10:08:32.887018+0000","last_active":"2024-09-10T10:10:01.109676+0000","last_peered":"2024-09-10T10:10:01.109676+0000","last_clean":"2024-09-10T10:10:01.109676+0000","last_became_active":"2024-09-10T10:08:32.886636+0000","last_became_peered":"2024-09-10T10:08:32.886636+0000","last_unstale":"2024-09-10T10:10:01.109676+0000","last_undegraded":"2024-09-10T10:10:01.109676+0000","last_fullsized":"2024-09-10T10:10:01.109676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:24.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762425+0000","last_change":"2024-09-10T10:08:35.363803+0000","last_active":"2024-09-10T10:10:58.762425+0000","last_peered":"2024-09-10T10:10:58.762425+0000","last_clean":"2024-09-10T10:10:58.762425+0000","last_became_active":"2024-09-10T10:08:35.363442+0000","last_became_peered":"2024-09-10T10:08:35.363442+0000","last_unstale":"2024-09-10T10:10:58.762425+0000","last_undegraded":"2024-09-10T10:10:58.762425+0000","last_fullsized":"2024-09-10T10:10:58.762425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:59.045347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972949+0000","last_change":"2024-09-10T10:08:44.403970+0000","last_active":"2024-09-10T10:10:00.972949+0000","last_peered":"2024-09-10T10:10:00.972949+0000","last_clean":"2024-09-10T10:10:00.972949+0000","last_became_active":"2024-09-10T10:08:44.403462+0000","last_became_peered":"2024-09-10T10:08:44.403462+0000","last_unstale":"2024-09-10T10:10:00.972949+0000","last_undegraded":"2024-09-10T10:10:00.972949+0000","last_fullsized":"2024-09-10T10:10:00.972949+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:09.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:15.700842+0000","last_change":"2024-09-10T10:08:32.893227+0000","last_active":"2024-09-10T10:11:15.700842+0000","last_peered":"2024-09-10T10:11:15.700842+0000","last_clean":"2024-09-10T10:11:15.700842+0000","last_became_active":"2024-09-10T10:08:32.892732+0000","last_became_peered":"2024-09-10T10:08:32.892732+0000","last_unstale":"2024-09-10T10:11:15.700842+0000","last_undegraded":"2024-09-10T10:11:15.700842+0000","last_fullsized":"2024-09-10T10:11:15.700842+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:16.933955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761246+0000","last_change":"2024-09-10T10:08:35.368806+0000","last_active":"2024-09-10T10:10:58.761246+0000","last_peered":"2024-09-10T10:10:58.761246+0000","last_clean":"2024-09-10T10:10:58.761246+0000","last_became_active":"2024-09-10T10:08:35.368397+0000","last_became_peered":"2024-09-10T10:08:35.368397+0000","last_unstale":"2024-09-10T10:10:58.761246+0000","last_undegraded":"2024-09-10T10:10:58.761246+0000","last_fullsized":"2024-09-10T10:10:58.761246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:39.656295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973102+0000","last_change":"2024-09-10T10:08:44.391941+0000","last_active":"2024-09-10T10:10:00.973102+0000","last_peered":"2024-09-10T10:10:00.973102+0000","last_clean":"2024-09-10T10:10:00.973102+0000","last_became_active":"2024-09-10T10:08:44.391553+0000","last_became_peered":"2024-09-10T10:08:44.391553+0000","last_unstale":"2024-09-10T10:10:00.973102+0000","last_undegraded":"2024-09-10T10:10:00.973102+0000","last_fullsized":"2024-09-10T10:10:00.973102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:34.279772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762216+0000","last_change":"2024-09-10T10:08:35.363192+0000","last_active":"2024-09-10T10:10:58.762216+0000","last_peered":"2024-09-10T10:10:58.762216+0000","last_clean":"2024-09-10T10:10:58.762216+0000","last_became_active":"2024-09-10T10:08:35.362890+0000","last_became_peered":"2024-09-10T10:08:35.362890+0000","last_unstale":"2024-09-10T10:10:58.762216+0000","last_undegraded":"2024-09-10T10:10:58.762216+0000","last_fullsized":"2024-09-10T10:10:58.762216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:07.493539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"95'12","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.748590+0000","last_change":"2024-09-10T10:08:35.362471+0000","last_active":"2024-09-10T10:10:58.748590+0000","last_peered":"2024-09-10T10:10:58.748590+0000","last_clean":"2024-09-10T10:10:58.748590+0000","last_became_active":"2024-09-10T10:08:35.361553+0000","last_became_peered":"2024-09-10T10:08:35.361553+0000","last_unstale":"2024-09-10T10:10:58.748590+0000","last_undegraded":"2024-09-10T10:10:58.748590+0000","last_fullsized":"2024-09-10T10:10:58.748590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:24.511901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.777795+0000","last_change":"2024-09-10T10:08:35.371025+0000","last_active":"2024-09-10T10:10:58.777795+0000","last_peered":"2024-09-10T10:10:58.777795+0000","last_clean":"2024-09-10T10:10:58.777795+0000","last_became_active":"2024-09-10T10:08:35.370692+0000","last_became_peered":"2024-09-10T10:08:35.370692+0000","last_unstale":"2024-09-10T10:10:58.777795+0000","last_undegraded":"2024-09-10T10:10:58.777795+0000","last_fullsized":"2024-09-10T10:10:58.777795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:22.289843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776381+0000","last_change":"2024-09-10T10:08:35.373519+0000","last_active":"2024-09-10T10:10:58.776381+0000","last_peered":"2024-09-10T10:10:58.776381+0000","last_clean":"2024-09-10T10:10:58.776381+0000","last_became_active":"2024-09-10T10:08:35.372719+0000","last_became_peered":"2024-09-10T10:08:35.372719+0000","last_unstale":"2024-09-10T10:10:58.776381+0000","last_undegraded":"2024-09-10T10:10:58.776381+0000","last_fullsized":"2024-09-10T10:10:58.776381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:24.530809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"95'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778078+0000","last_change":"2024-09-10T10:09:00.489944+0000","last_active":"2024-09-10T10:10:58.778078+0000","last_peered":"2024-09-10T10:10:58.778078+0000","last_clean":"2024-09-10T10:10:58.778078+0000","last_became_active":"2024-09-10T10:09:00.489269+0000","last_became_peered":"2024-09-10T10:09:00.489269+0000","last_unstale":"2024-09-10T10:10:58.778078+0000","last_undegraded":"2024-09-10T10:10:58.778078+0000","last_fullsized":"2024-09-10T10:10:58.778078+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:46.561078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761792+0000","last_change":"2024-09-10T10:08:35.364779+0000","last_active":"2024-09-10T10:10:58.761792+0000","last_peered":"2024-09-10T10:10:58.761792+0000","last_clean":"2024-09-10T10:10:58.761792+0000","last_became_active":"2024-09-10T10:08:35.364455+0000","last_became_peered":"2024-09-10T10:08:35.364455+0000","last_unstale":"2024-09-10T10:10:58.761792+0000","last_undegraded":"2024-09-10T10:10:58.761792+0000","last_fullsized":"2024-09-10T10:10:58.761792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:08.552218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761074+0000","last_change":"2024-09-10T10:08:35.357147+0000","last_active":"2024-09-10T10:10:58.761074+0000","last_peered":"2024-09-10T10:10:58.761074+0000","last_clean":"2024-09-10T10:10:58.761074+0000","last_became_active":"2024-09-10T10:08:35.356808+0000","last_became_peered":"2024-09-10T10:08:35.356808+0000","last_unstale":"2024-09-10T10:10:58.761074+0000","last_undegraded":"2024-09-10T10:10:58.761074+0000","last_fullsized":"2024-09-10T10:10:58.761074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:35.731496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"95'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755499+0000","last_change":"2024-09-10T10:08:35.365795+0000","last_active":"2024-09-10T10:10:58.755499+0000","last_peered":"2024-09-10T10:10:58.755499+0000","last_clean":"2024-09-10T10:10:58.755499+0000","last_became_active":"2024-09-10T10:08:35.365342+0000","last_became_peered":"2024-09-10T10:08:35.365342+0000","last_unstale":"2024-09-10T10:10:58.755499+0000","last_undegraded":"2024-09-10T10:10:58.755499+0000","last_fullsized":"2024-09-10T10:10:58.755499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:20.012890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"95'6","reported_seq":22,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.763139+0000","last_change":"2024-09-10T10:09:00.486664+0000","last_active":"2024-09-10T10:10:58.763139+0000","last_peered":"2024-09-10T10:10:58.763139+0000","last_clean":"2024-09-10T10:10:58.763139+0000","last_became_active":"2024-09-10T10:09:00.486239+0000","last_became_peered":"2024-09-10T10:09:00.486239+0000","last_unstale":"2024-09-10T10:10:58.763139+0000","last_undegraded":"2024-09-10T10:10:58.763139+0000","last_fullsized":"2024-09-10T10:10:58.763139+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:47.472245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755183+0000","last_change":"2024-09-10T10:08:35.367403+0000","last_active":"2024-09-10T10:10:58.755183+0000","last_peered":"2024-09-10T10:10:58.755183+0000","last_clean":"2024-09-10T10:10:58.755183+0000","last_became_active":"2024-09-10T10:08:35.365969+0000","last_became_peered":"2024-09-10T10:08:35.365969+0000","last_unstale":"2024-09-10T10:10:58.755183+0000","last_undegraded":"2024-09-10T10:10:58.755183+0000","last_fullsized":"2024-09-10T10:10:58.755183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:27.657226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773597+0000","last_change":"2024-09-10T10:08:35.359185+0000","last_active":"2024-09-10T10:10:58.773597+0000","last_peered":"2024-09-10T10:10:58.773597+0000","last_clean":"2024-09-10T10:10:58.773597+0000","last_became_active":"2024-09-10T10:08:35.358825+0000","last_became_peered":"2024-09-10T10:08:35.358825+0000","last_unstale":"2024-09-10T10:10:58.773597+0000","last_undegraded":"2024-09-10T10:10:58.773597+0000","last_fullsized":"2024-09-10T10:10:58.773597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:31.884533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778457+0000","last_change":"2024-09-10T10:08:35.378151+0000","last_active":"2024-09-10T10:10:58.778457+0000","last_peered":"2024-09-10T10:10:58.778457+0000","last_clean":"2024-09-10T10:10:58.778457+0000","last_became_active":"2024-09-10T10:08:35.377784+0000","last_became_peered":"2024-09-10T10:08:35.377784+0000","last_unstale":"2024-09-10T10:10:58.778457+0000","last_undegraded":"2024-09-10T10:10:58.778457+0000","last_fullsized":"2024-09-10T10:10:58.778457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.027310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762465+0000","last_change":"2024-09-10T10:08:35.364550+0000","last_active":"2024-09-10T10:10:58.762465+0000","last_peered":"2024-09-10T10:10:58.762465+0000","last_clean":"2024-09-10T10:10:58.762465+0000","last_became_active":"2024-09-10T10:08:35.364224+0000","last_became_peered":"2024-09-10T10:08:35.364224+0000","last_unstale":"2024-09-10T10:10:58.762465+0000","last_undegraded":"2024-09-10T10:10:58.762465+0000","last_fullsized":"2024-09-10T10:10:58.762465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:38.584494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.750237+0000","last_change":"2024-09-10T10:08:35.357333+0000","last_active":"2024-09-10T10:10:58.750237+0000","last_peered":"2024-09-10T10:10:58.750237+0000","last_clean":"2024-09-10T10:10:58.750237+0000","last_became_active":"2024-09-10T10:08:35.356940+0000","last_became_peered":"2024-09-10T10:08:35.356940+0000","last_unstale":"2024-09-10T10:10:58.750237+0000","last_undegraded":"2024-09-10T10:10:58.750237+0000","last_fullsized":"2024-09-10T10:10:58.750237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:40.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769367+0000","last_change":"2024-09-10T10:08:35.367208+0000","last_active":"2024-09-10T10:10:58.769367+0000","last_peered":"2024-09-10T10:10:58.769367+0000","last_clean":"2024-09-10T10:10:58.769367+0000","last_became_active":"2024-09-10T10:08:35.361942+0000","last_became_peered":"2024-09-10T10:08:35.361942+0000","last_unstale":"2024-09-10T10:10:58.769367+0000","last_undegraded":"2024-09-10T10:10:58.769367+0000","last_fullsized":"2024-09-10T10:10:58.769367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:19.030623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773220+0000","last_change":"2024-09-10T10:08:35.377164+0000","last_active":"2024-09-10T10:10:58.773220+0000","last_peered":"2024-09-10T10:10:58.773220+0000","last_clean":"2024-09-10T10:10:58.773220+0000","last_became_active":"2024-09-10T10:08:35.376457+0000","last_became_peered":"2024-09-10T10:08:35.376457+0000","last_unstale":"2024-09-10T10:10:58.773220+0000","last_undegraded":"2024-09-10T10:10:58.773220+0000","last_fullsized":"2024-09-10T10:10:58.773220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.291635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772661+0000","last_change":"2024-09-10T10:08:35.365096+0000","last_active":"2024-09-10T10:10:58.772661+0000","last_peered":"2024-09-10T10:10:58.772661+0000","last_clean":"2024-09-10T10:10:58.772661+0000","last_became_active":"2024-09-10T10:08:35.364780+0000","last_became_peered":"2024-09-10T10:08:35.364780+0000","last_unstale":"2024-09-10T10:10:58.772661+0000","last_undegraded":"2024-09-10T10:10:58.772661+0000","last_fullsized":"2024-09-10T10:10:58.772661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:30.177904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774627+0000","last_change":"2024-09-10T10:08:35.377017+0000","last_active":"2024-09-10T10:10:58.774627+0000","last_peered":"2024-09-10T10:10:58.774627+0000","last_clean":"2024-09-10T10:10:58.774627+0000","last_became_active":"2024-09-10T10:08:35.372243+0000","last_became_peered":"2024-09-10T10:08:35.372243+0000","last_unstale":"2024-09-10T10:10:58.774627+0000","last_undegraded":"2024-09-10T10:10:58.774627+0000","last_fullsized":"2024-09-10T10:10:58.774627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:26.105505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774291+0000","last_change":"2024-09-10T10:08:35.379782+0000","last_active":"2024-09-10T10:10:58.774291+0000","last_peered":"2024-09-10T10:10:58.774291+0000","last_clean":"2024-09-10T10:10:58.774291+0000","last_became_active":"2024-09-10T10:08:35.377109+0000","last_became_peered":"2024-09-10T10:08:35.377109+0000","last_unstale":"2024-09-10T10:10:58.774291+0000","last_undegraded":"2024-09-10T10:10:58.774291+0000","last_fullsized":"2024-09-10T10:10:58.774291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:10.761016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.764497+0000","last_change":"2024-09-10T10:08:35.364891+0000","last_active":"2024-09-10T10:10:58.764497+0000","last_peered":"2024-09-10T10:10:58.764497+0000","last_clean":"2024-09-10T10:10:58.764497+0000","last_became_active":"2024-09-10T10:08:35.363845+0000","last_became_peered":"2024-09-10T10:08:35.363845+0000","last_unstale":"2024-09-10T10:10:58.764497+0000","last_undegraded":"2024-09-10T10:10:58.764497+0000","last_fullsized":"2024-09-10T10:10:58.764497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:03.346994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766501+0000","last_change":"2024-09-10T10:08:35.363548+0000","last_active":"2024-09-10T10:10:58.766501+0000","last_peered":"2024-09-10T10:10:58.766501+0000","last_clean":"2024-09-10T10:10:58.766501+0000","last_became_active":"2024-09-10T10:08:35.363229+0000","last_became_peered":"2024-09-10T10:08:35.363229+0000","last_unstale":"2024-09-10T10:10:58.766501+0000","last_undegraded":"2024-09-10T10:10:58.766501+0000","last_fullsized":"2024-09-10T10:10:58.766501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:38.773445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773111+0000","last_change":"2024-09-10T10:08:35.360717+0000","last_active":"2024-09-10T10:10:58.773111+0000","last_peered":"2024-09-10T10:10:58.773111+0000","last_clean":"2024-09-10T10:10:58.773111+0000","last_became_active":"2024-09-10T10:08:35.360410+0000","last_became_peered":"2024-09-10T10:08:35.360410+0000","last_unstale":"2024-09-10T10:10:58.773111+0000","last_undegraded":"2024-09-10T10:10:58.773111+0000","last_fullsized":"2024-09-10T10:10:58.773111+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:59.322524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'16","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772823+0000","last_change":"2024-09-10T10:08:35.362359+0000","last_active":"2024-09-10T10:10:58.772823+0000","last_peered":"2024-09-10T10:10:58.772823+0000","last_clean":"2024-09-10T10:10:58.772823+0000","last_became_active":"2024-09-10T10:08:35.361580+0000","last_became_peered":"2024-09-10T10:08:35.361580+0000","last_unstale":"2024-09-10T10:10:58.772823+0000","last_undegraded":"2024-09-10T10:10:58.772823+0000","last_fullsized":"2024-09-10T10:10:58.772823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:23.265237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771033+0000","last_change":"2024-09-10T10:08:35.367305+0000","last_active":"2024-09-10T10:10:58.771033+0000","last_peered":"2024-09-10T10:10:58.771033+0000","last_clean":"2024-09-10T10:10:58.771033+0000","last_became_active":"2024-09-10T10:08:35.366936+0000","last_became_peered":"2024-09-10T10:08:35.366936+0000","last_unstale":"2024-09-10T10:10:58.771033+0000","last_undegraded":"2024-09-10T10:10:58.771033+0000","last_fullsized":"2024-09-10T10:10:58.771033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:28.158474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765168+0000","last_change":"2024-09-10T10:08:35.369983+0000","last_active":"2024-09-10T10:10:58.765168+0000","last_peered":"2024-09-10T10:10:58.765168+0000","last_clean":"2024-09-10T10:10:58.765168+0000","last_became_active":"2024-09-10T10:08:35.367662+0000","last_became_peered":"2024-09-10T10:08:35.367662+0000","last_unstale":"2024-09-10T10:10:58.765168+0000","last_undegraded":"2024-09-10T10:10:58.765168+0000","last_fullsized":"2024-09-10T10:10:58.765168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771023+0000","last_change":"2024-09-10T10:08:35.369237+0000","last_active":"2024-09-10T10:10:58.771023+0000","last_peered":"2024-09-10T10:10:58.771023+0000","last_clean":"2024-09-10T10:10:58.771023+0000","last_became_active":"2024-09-10T10:08:35.368903+0000","last_became_peered":"2024-09-10T10:08:35.368903+0000","last_unstale":"2024-09-10T10:10:58.771023+0000","last_undegraded":"2024-09-10T10:10:58.771023+0000","last_fullsized":"2024-09-10T10:10:58.771023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:05.150549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773489+0000","last_change":"2024-09-10T10:08:35.367284+0000","last_active":"2024-09-10T10:10:58.773489+0000","last_peered":"2024-09-10T10:10:58.773489+0000","last_clean":"2024-09-10T10:10:58.773489+0000","last_became_active":"2024-09-10T10:08:35.366969+0000","last_became_peered":"2024-09-10T10:08:35.366969+0000","last_unstale":"2024-09-10T10:10:58.773489+0000","last_undegraded":"2024-09-10T10:10:58.773489+0000","last_fullsized":"2024-09-10T10:10:58.773489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:16.949804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.749286+0000","last_change":"2024-09-10T10:08:35.374559+0000","last_active":"2024-09-10T10:10:58.749286+0000","last_peered":"2024-09-10T10:10:58.749286+0000","last_clean":"2024-09-10T10:10:58.749286+0000","last_became_active":"2024-09-10T10:08:35.374191+0000","last_became_peered":"2024-09-10T10:08:35.374191+0000","last_unstale":"2024-09-10T10:10:58.749286+0000","last_undegraded":"2024-09-10T10:10:58.749286+0000","last_fullsized":"2024-09-10T10:10:58.749286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:48.292249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.757757+0000","last_change":"2024-09-10T10:08:35.368042+0000","last_active":"2024-09-10T10:10:58.757757+0000","last_peered":"2024-09-10T10:10:58.757757+0000","last_clean":"2024-09-10T10:10:58.757757+0000","last_became_active":"2024-09-10T10:08:35.365985+0000","last_became_peered":"2024-09-10T10:08:35.365985+0000","last_unstale":"2024-09-10T10:10:58.757757+0000","last_undegraded":"2024-09-10T10:10:58.757757+0000","last_fullsized":"2024-09-10T10:10:58.757757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:04.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774113+0000","last_change":"2024-09-10T10:08:35.375826+0000","last_active":"2024-09-10T10:10:58.774113+0000","last_peered":"2024-09-10T10:10:58.774113+0000","last_clean":"2024-09-10T10:10:58.774113+0000","last_became_active":"2024-09-10T10:08:35.375485+0000","last_became_peered":"2024-09-10T10:08:35.375485+0000","last_unstale":"2024-09-10T10:10:58.774113+0000","last_undegraded":"2024-09-10T10:10:58.774113+0000","last_fullsized":"2024-09-10T10:10:58.774113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:49.146648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.763221+0000","last_change":"2024-09-10T10:08:35.375745+0000","last_active":"2024-09-10T10:10:58.763221+0000","last_peered":"2024-09-10T10:10:58.763221+0000","last_clean":"2024-09-10T10:10:58.763221+0000","last_became_active":"2024-09-10T10:08:35.375427+0000","last_became_peered":"2024-09-10T10:08:35.375427+0000","last_unstale":"2024-09-10T10:10:58.763221+0000","last_undegraded":"2024-09-10T10:10:58.763221+0000","last_fullsized":"2024-09-10T10:10:58.763221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:48.743434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771465+0000","last_change":"2024-09-10T10:08:35.377092+0000","last_active":"2024-09-10T10:10:58.771465+0000","last_peered":"2024-09-10T10:10:58.771465+0000","last_clean":"2024-09-10T10:10:58.771465+0000","last_became_active":"2024-09-10T10:08:35.376761+0000","last_became_peered":"2024-09-10T10:08:35.376761+0000","last_unstale":"2024-09-10T10:10:58.771465+0000","last_undegraded":"2024-09-10T10:10:58.771465+0000","last_fullsized":"2024-09-10T10:10:58.771465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:58.631742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67314,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":698,"num_read_kb":420,"num_write":182,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":201942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286200,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449135,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":538290,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678069,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712808,"statfs":{"total":95995035648,"available":95961915392,"internally_reserved":0,"allocated":1187840,"data_stored":1188706,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841594,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":542600,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070528,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":538402,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299460,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":1135010,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462987,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":533680,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724625,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1114112,"data_stored":1130064,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888149,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1048576,"data_stored":538864,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149786,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":533874,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411426,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1130496,"data_stored":598110,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1105920,"data_stored":596226,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738477,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":535068,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:11:20.890 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-10T10:11:20.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T10:11:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.084+0000 7fde8da00640 1 -- 172.21.15.50:0/817599366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde88102d00 msgr2=0x7fde88103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.084+0000 7fde8da00640 1 --2- 172.21.15.50:0/817599366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde88102d00 0x7fde88103180 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fde70009900 tx=0x7fde7002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:11:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.084+0000 7fde8da00640 1 -- 172.21.15.50:0/817599366 shutdown_connections 2024-09-10T10:11:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.084+0000 7fde8da00640 1 --2- 172.21.15.50:0/817599366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde881036c0 0x7fde88109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.084+0000 7fde8da00640 1 --2- 172.21.15.50:0/817599366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde88102d00 0x7fde88103180 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.084+0000 7fde8da00640 1 --2- 172.21.15.50:0/817599366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde88101b10 0x7fde88101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.084+0000 7fde8da00640 1 -- 172.21.15.50:0/817599366 >> 172.21.15.50:0/817599366 conn(0x7fde880fd2b0 msgr2=0x7fde880ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.084+0000 7fde8da00640 1 -- 172.21.15.50:0/817599366 shutdown_connections 2024-09-10T10:11:21.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.085+0000 7fde8da00640 1 -- 172.21.15.50:0/817599366 wait complete. 2024-09-10T10:11:21.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.085+0000 7fde8da00640 1 Processor -- start 2024-09-10T10:11:21.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.085+0000 7fde8da00640 1 -- start start 2024-09-10T10:11:21.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.086+0000 7fde8da00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde88101b10 0x7fde88197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:21.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.086+0000 7fde8da00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde88102d00 0x7fde88198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.086+0000 7fde8da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde881036c0 0x7fde8819f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.086+0000 7fde8da00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fde8810d7c0 con 0x7fde881036c0 2024-09-10T10:11:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.086+0000 7fde8da00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fde8810d640 con 0x7fde88102d00 2024-09-10T10:11:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.086+0000 7fde8da00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fde8810d940 con 0x7fde88101b10 2024-09-10T10:11:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.086+0000 7fde7fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde88102d00 0x7fde88198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.086+0000 7fde7fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde88102d00 0x7fde88198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:41980/0 (socket says 172.21.15.50:41980) 2024-09-10T10:11:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.086+0000 7fde87400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde881036c0 0x7fde8819f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.086+0000 7fde7fe00640 1 -- 172.21.15.50:0/1325597799 learned_addr learned my addr 172.21.15.50:0/1325597799 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.086+0000 7fde86a00640 1 --2- 172.21.15.50:0/1325597799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde88101b10 0x7fde88197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.086+0000 7fde7fe00640 1 -- 172.21.15.50:0/1325597799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde88101b10 msgr2=0x7fde88197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.086+0000 7fde7fe00640 1 --2- 172.21.15.50:0/1325597799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde88101b10 0x7fde88197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.087+0000 7fde7fe00640 1 -- 172.21.15.50:0/1325597799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde881036c0 msgr2=0x7fde8819f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:21.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.087+0000 7fde7fe00640 1 --2- 172.21.15.50:0/1325597799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde881036c0 0x7fde8819f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.087+0000 7fde7fe00640 1 -- 172.21.15.50:0/1325597799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8819fa60 con 0x7fde88102d00 2024-09-10T10:11:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.087+0000 7fde7fe00640 1 --2- 172.21.15.50:0/1325597799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde88102d00 0x7fde88198380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde70031440 tx=0x7fde70032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.087+0000 7fde7f400640 1 -- 172.21.15.50:0/1325597799 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7003f030 con 0x7fde88102d00 2024-09-10T10:11:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.087+0000 7fde8da00640 1 -- 172.21.15.50:0/1325597799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde8819fcf0 con 0x7fde88102d00 2024-09-10T10:11:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.087+0000 7fde7f400640 1 -- 172.21.15.50:0/1325597799 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde70003ce0 con 0x7fde88102d00 2024-09-10T10:11:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.087+0000 7fde7f400640 1 -- 172.21.15.50:0/1325597799 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70035070 con 0x7fde88102d00 2024-09-10T10:11:21.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.087+0000 7fde8da00640 1 -- 172.21.15.50:0/1325597799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde881a0190 con 0x7fde88102d00 2024-09-10T10:11:21.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.088+0000 7fde8da00640 1 -- 172.21.15.50:0/1325597799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde88108eb0 con 0x7fde88102d00 2024-09-10T10:11:21.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.090+0000 7fde7f400640 1 -- 172.21.15.50:0/1325597799 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fde70042030 con 0x7fde88102d00 2024-09-10T10:11:21.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.091+0000 7fde7f400640 1 --2- 172.21.15.50:0/1325597799 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fde6c0a2b90 0x7fde6c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:21.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.091+0000 7fde7f400640 1 -- 172.21.15.50:0/1325597799 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fde700ef610 con 0x7fde88102d00 2024-09-10T10:11:21.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.092+0000 7fde86a00640 1 --2- 172.21.15.50:0/1325597799 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fde6c0a2b90 0x7fde6c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:21.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.092+0000 7fde86a00640 1 --2- 172.21.15.50:0/1325597799 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fde6c0a2b90 0x7fde6c0a5050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fde780095f0 tx=0x7fde78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:21.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.095+0000 7fde7f400640 1 -- 172.21.15.50:0/1325597799 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde700bbb30 con 0x7fde88102d00 2024-09-10T10:11:21.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:21 smithi050 ceph-mon[30354]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:21.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.280+0000 7fde8da00640 1 -- 172.21.15.50:0/1325597799 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde88062630 con 0x7fde6c0a2b90 2024-09-10T10:11:21.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.289+0000 7fde7f400640 1 -- 172.21.15.50:0/1325597799 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340752 (secure 0 0 0) 0x7fde88062630 con 0x7fde6c0a2b90 2024-09-10T10:11:21.294 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:21.296 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-10T10:11:21.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.293+0000 7fde8da00640 1 -- 172.21.15.50:0/1325597799 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fde6c0a2b90 msgr2=0x7fde6c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.293+0000 7fde8da00640 1 --2- 172.21.15.50:0/1325597799 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fde6c0a2b90 0x7fde6c0a5050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fde780095f0 tx=0x7fde78005f90 comp rx=0 tx=0).stop 2024-09-10T10:11:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.293+0000 7fde8da00640 1 -- 172.21.15.50:0/1325597799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde88102d00 msgr2=0x7fde88198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.293+0000 7fde8da00640 1 --2- 172.21.15.50:0/1325597799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde88102d00 0x7fde88198380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde70031440 tx=0x7fde70032ce0 comp rx=0 tx=0).stop 2024-09-10T10:11:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.293+0000 7fde8da00640 1 -- 172.21.15.50:0/1325597799 shutdown_connections 2024-09-10T10:11:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.293+0000 7fde8da00640 1 --2- 172.21.15.50:0/1325597799 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fde6c0a2b90 0x7fde6c0a5050 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.293+0000 7fde8da00640 1 --2- 172.21.15.50:0/1325597799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde881036c0 0x7fde8819f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.293+0000 7fde8da00640 1 --2- 172.21.15.50:0/1325597799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde88102d00 0x7fde88198380 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.293+0000 7fde8da00640 1 --2- 172.21.15.50:0/1325597799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fde88101b10 0x7fde88197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.293+0000 7fde8da00640 1 -- 172.21.15.50:0/1325597799 >> 172.21.15.50:0/1325597799 conn(0x7fde880fd2b0 msgr2=0x7fde88106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.293+0000 7fde8da00640 1 -- 172.21.15.50:0/1325597799 shutdown_connections 2024-09-10T10:11:21.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:21.294+0000 7fde8da00640 1 -- 172.21.15.50:0/1325597799 wait complete. 2024-09-10T10:11:21.312 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":396,"stamp":"2024-09-10T10:11:20.805069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657916,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":824,"num_read_kb":529,"num_write":365,"num_write_kb":3068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":794,"ondisk_log_size":794,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366100,"kb_used_data":12692,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575724,"statfs":{"total":1151940427776,"available":1151565541376,"internally_reserved":0,"allocated":12996608,"data_stored":8408894,"data_compressed":498339,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":311,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003072"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724648+0000","last_change":"2024-09-10T10:08:32.889755+0000","last_active":"2024-09-10T10:10:00.724648+0000","last_peered":"2024-09-10T10:10:00.724648+0000","last_clean":"2024-09-10T10:10:00.724648+0000","last_became_active":"2024-09-10T10:08:32.889455+0000","last_became_peered":"2024-09-10T10:08:32.889455+0000","last_unstale":"2024-09-10T10:10:00.724648+0000","last_undegraded":"2024-09-10T10:10:00.724648+0000","last_fullsized":"2024-09-10T10:10:00.724648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:53.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"95'5","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.760977+0000","last_change":"2024-09-10T10:10:00.974216+0000","last_active":"2024-09-10T10:10:58.760977+0000","last_peered":"2024-09-10T10:10:58.760977+0000","last_clean":"2024-09-10T10:10:58.760977+0000","last_became_active":"2024-09-10T10:10:00.973841+0000","last_became_peered":"2024-09-10T10:10:00.973841+0000","last_unstale":"2024-09-10T10:10:58.760977+0000","last_undegraded":"2024-09-10T10:10:58.760977+0000","last_fullsized":"2024-09-10T10:10:58.760977+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:30.575610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972516+0000","last_change":"2024-09-10T10:08:44.399836+0000","last_active":"2024-09-10T10:10:00.972516+0000","last_peered":"2024-09-10T10:10:00.972516+0000","last_clean":"2024-09-10T10:10:00.972516+0000","last_became_active":"2024-09-10T10:08:44.399510+0000","last_became_peered":"2024-09-10T10:08:44.399510+0000","last_unstale":"2024-09-10T10:10:00.972516+0000","last_undegraded":"2024-09-10T10:10:00.972516+0000","last_fullsized":"2024-09-10T10:10:00.972516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:47.372690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722255+0000","last_change":"2024-09-10T10:08:32.887099+0000","last_active":"2024-09-10T10:10:00.722255+0000","last_peered":"2024-09-10T10:10:00.722255+0000","last_clean":"2024-09-10T10:10:00.722255+0000","last_became_active":"2024-09-10T10:08:32.886730+0000","last_became_peered":"2024-09-10T10:08:32.886730+0000","last_unstale":"2024-09-10T10:10:00.722255+0000","last_undegraded":"2024-09-10T10:10:00.722255+0000","last_fullsized":"2024-09-10T10:10:00.722255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.277241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.777729+0000","last_change":"2024-09-10T10:08:35.375494+0000","last_active":"2024-09-10T10:10:58.777729+0000","last_peered":"2024-09-10T10:10:58.777729+0000","last_clean":"2024-09-10T10:10:58.777729+0000","last_became_active":"2024-09-10T10:08:35.373991+0000","last_became_peered":"2024-09-10T10:08:35.373991+0000","last_unstale":"2024-09-10T10:10:58.777729+0000","last_undegraded":"2024-09-10T10:10:58.777729+0000","last_fullsized":"2024-09-10T10:10:58.777729+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:25.858163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721597+0000","last_change":"2024-09-10T10:09:00.457967+0000","last_active":"2024-09-10T10:10:00.721597+0000","last_peered":"2024-09-10T10:10:00.721597+0000","last_clean":"2024-09-10T10:10:00.721597+0000","last_became_active":"2024-09-10T10:09:00.457446+0000","last_became_peered":"2024-09-10T10:09:00.457446+0000","last_unstale":"2024-09-10T10:10:00.721597+0000","last_undegraded":"2024-09-10T10:10:00.721597+0000","last_fullsized":"2024-09-10T10:10:00.721597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:00.550304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722817+0000","last_change":"2024-09-10T10:08:32.890270+0000","last_active":"2024-09-10T10:10:00.722817+0000","last_peered":"2024-09-10T10:10:00.722817+0000","last_clean":"2024-09-10T10:10:00.722817+0000","last_became_active":"2024-09-10T10:08:32.889887+0000","last_became_peered":"2024-09-10T10:08:32.889887+0000","last_unstale":"2024-09-10T10:10:00.722817+0000","last_undegraded":"2024-09-10T10:10:00.722817+0000","last_fullsized":"2024-09-10T10:10:00.722817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:39.757510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774008+0000","last_change":"2024-09-10T10:08:35.357257+0000","last_active":"2024-09-10T10:10:58.774008+0000","last_peered":"2024-09-10T10:10:58.774008+0000","last_clean":"2024-09-10T10:10:58.774008+0000","last_became_active":"2024-09-10T10:08:35.356918+0000","last_became_peered":"2024-09-10T10:08:35.356918+0000","last_unstale":"2024-09-10T10:10:58.774008+0000","last_undegraded":"2024-09-10T10:10:58.774008+0000","last_fullsized":"2024-09-10T10:10:58.774008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:04.387581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722105+0000","last_change":"2024-09-10T10:09:00.487116+0000","last_active":"2024-09-10T10:10:00.722105+0000","last_peered":"2024-09-10T10:10:00.722105+0000","last_clean":"2024-09-10T10:10:00.722105+0000","last_became_active":"2024-09-10T10:09:00.486646+0000","last_became_peered":"2024-09-10T10:09:00.486646+0000","last_unstale":"2024-09-10T10:10:00.722105+0000","last_undegraded":"2024-09-10T10:10:00.722105+0000","last_fullsized":"2024-09-10T10:10:00.722105+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:40.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722877+0000","last_change":"2024-09-10T10:08:32.891399+0000","last_active":"2024-09-10T10:10:00.722877+0000","last_peered":"2024-09-10T10:10:00.722877+0000","last_clean":"2024-09-10T10:10:00.722877+0000","last_became_active":"2024-09-10T10:08:32.891022+0000","last_became_peered":"2024-09-10T10:08:32.891022+0000","last_unstale":"2024-09-10T10:10:00.722877+0000","last_undegraded":"2024-09-10T10:10:00.722877+0000","last_fullsized":"2024-09-10T10:10:00.722877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:30.842443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771765+0000","last_change":"2024-09-10T10:08:35.370630+0000","last_active":"2024-09-10T10:10:58.771765+0000","last_peered":"2024-09-10T10:10:58.771765+0000","last_clean":"2024-09-10T10:10:58.771765+0000","last_became_active":"2024-09-10T10:08:35.370263+0000","last_became_peered":"2024-09-10T10:08:35.370263+0000","last_unstale":"2024-09-10T10:10:58.771765+0000","last_undegraded":"2024-09-10T10:10:58.771765+0000","last_fullsized":"2024-09-10T10:10:58.771765+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:41.549815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721697+0000","last_change":"2024-09-10T10:08:44.405298+0000","last_active":"2024-09-10T10:10:00.721697+0000","last_peered":"2024-09-10T10:10:00.721697+0000","last_clean":"2024-09-10T10:10:00.721697+0000","last_became_active":"2024-09-10T10:08:44.405027+0000","last_became_peered":"2024-09-10T10:08:44.405027+0000","last_unstale":"2024-09-10T10:10:00.721697+0000","last_undegraded":"2024-09-10T10:10:00.721697+0000","last_fullsized":"2024-09-10T10:10:00.721697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:08.486563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776546+0000","last_change":"2024-09-10T10:08:35.369040+0000","last_active":"2024-09-10T10:10:58.776546+0000","last_peered":"2024-09-10T10:10:58.776546+0000","last_clean":"2024-09-10T10:10:58.776546+0000","last_became_active":"2024-09-10T10:08:35.368576+0000","last_became_peered":"2024-09-10T10:08:35.368576+0000","last_unstale":"2024-09-10T10:10:58.776546+0000","last_undegraded":"2024-09-10T10:10:58.776546+0000","last_fullsized":"2024-09-10T10:10:58.776546+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:44.887554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722399+0000","last_change":"2024-09-10T10:08:32.889549+0000","last_active":"2024-09-10T10:10:00.722399+0000","last_peered":"2024-09-10T10:10:00.722399+0000","last_clean":"2024-09-10T10:10:00.722399+0000","last_became_active":"2024-09-10T10:08:32.889197+0000","last_became_peered":"2024-09-10T10:08:32.889197+0000","last_unstale":"2024-09-10T10:10:00.722399+0000","last_undegraded":"2024-09-10T10:10:00.722399+0000","last_fullsized":"2024-09-10T10:10:00.722399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:53.697069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721966+0000","last_change":"2024-09-10T10:08:44.929048+0000","last_active":"2024-09-10T10:10:00.721966+0000","last_peered":"2024-09-10T10:10:00.721966+0000","last_clean":"2024-09-10T10:10:00.721966+0000","last_became_active":"2024-09-10T10:08:44.928345+0000","last_became_peered":"2024-09-10T10:08:44.928345+0000","last_unstale":"2024-09-10T10:10:00.721966+0000","last_undegraded":"2024-09-10T10:10:00.721966+0000","last_fullsized":"2024-09-10T10:10:00.721966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:23.121853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776712+0000","last_change":"2024-09-10T10:08:35.377385+0000","last_active":"2024-09-10T10:10:58.776712+0000","last_peered":"2024-09-10T10:10:58.776712+0000","last_clean":"2024-09-10T10:10:58.776712+0000","last_became_active":"2024-09-10T10:08:35.377092+0000","last_became_peered":"2024-09-10T10:08:35.377092+0000","last_unstale":"2024-09-10T10:10:58.776712+0000","last_undegraded":"2024-09-10T10:10:58.776712+0000","last_fullsized":"2024-09-10T10:10:58.776712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:23.169370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972319+0000","last_change":"2024-09-10T10:08:32.891614+0000","last_active":"2024-09-10T10:10:00.972319+0000","last_peered":"2024-09-10T10:10:00.972319+0000","last_clean":"2024-09-10T10:10:00.972319+0000","last_became_active":"2024-09-10T10:08:32.891141+0000","last_became_peered":"2024-09-10T10:08:32.891141+0000","last_unstale":"2024-09-10T10:10:00.972319+0000","last_undegraded":"2024-09-10T10:10:00.972319+0000","last_fullsized":"2024-09-10T10:10:00.972319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:20.258863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721932+0000","last_change":"2024-09-10T10:08:44.401125+0000","last_active":"2024-09-10T10:10:00.721932+0000","last_peered":"2024-09-10T10:10:00.721932+0000","last_clean":"2024-09-10T10:10:00.721932+0000","last_became_active":"2024-09-10T10:08:44.400483+0000","last_became_peered":"2024-09-10T10:08:44.400483+0000","last_unstale":"2024-09-10T10:10:00.721932+0000","last_undegraded":"2024-09-10T10:10:00.721932+0000","last_fullsized":"2024-09-10T10:10:00.721932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:12.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766815+0000","last_change":"2024-09-10T10:08:35.376806+0000","last_active":"2024-09-10T10:10:58.766815+0000","last_peered":"2024-09-10T10:10:58.766815+0000","last_clean":"2024-09-10T10:10:58.766815+0000","last_became_active":"2024-09-10T10:08:35.376400+0000","last_became_peered":"2024-09-10T10:08:35.376400+0000","last_unstale":"2024-09-10T10:10:58.766815+0000","last_undegraded":"2024-09-10T10:10:58.766815+0000","last_fullsized":"2024-09-10T10:10:58.766815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:48.303039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721567+0000","last_change":"2024-09-10T10:08:32.883881+0000","last_active":"2024-09-10T10:10:00.721567+0000","last_peered":"2024-09-10T10:10:00.721567+0000","last_clean":"2024-09-10T10:10:00.721567+0000","last_became_active":"2024-09-10T10:08:32.883540+0000","last_became_peered":"2024-09-10T10:08:32.883540+0000","last_unstale":"2024-09-10T10:10:00.721567+0000","last_undegraded":"2024-09-10T10:10:00.721567+0000","last_fullsized":"2024-09-10T10:10:00.721567+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:57.359729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724324+0000","last_change":"2024-09-10T10:08:44.401548+0000","last_active":"2024-09-10T10:10:00.724324+0000","last_peered":"2024-09-10T10:10:00.724324+0000","last_clean":"2024-09-10T10:10:00.724324+0000","last_became_active":"2024-09-10T10:08:44.401034+0000","last_became_peered":"2024-09-10T10:08:44.401034+0000","last_unstale":"2024-09-10T10:10:00.724324+0000","last_undegraded":"2024-09-10T10:10:00.724324+0000","last_fullsized":"2024-09-10T10:10:00.724324+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:17.292973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"95'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.760304+0000","last_change":"2024-09-10T10:08:35.359969+0000","last_active":"2024-09-10T10:10:58.760304+0000","last_peered":"2024-09-10T10:10:58.760304+0000","last_clean":"2024-09-10T10:10:58.760304+0000","last_became_active":"2024-09-10T10:08:35.359599+0000","last_became_peered":"2024-09-10T10:08:35.359599+0000","last_unstale":"2024-09-10T10:10:58.760304+0000","last_undegraded":"2024-09-10T10:10:58.760304+0000","last_fullsized":"2024-09-10T10:10:58.760304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:00.778269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862147+0000","last_change":"2024-09-10T10:09:00.487582+0000","last_active":"2024-09-10T10:10:00.862147+0000","last_peered":"2024-09-10T10:10:00.862147+0000","last_clean":"2024-09-10T10:10:00.862147+0000","last_became_active":"2024-09-10T10:09:00.487229+0000","last_became_peered":"2024-09-10T10:09:00.487229+0000","last_unstale":"2024-09-10T10:10:00.862147+0000","last_undegraded":"2024-09-10T10:10:00.862147+0000","last_fullsized":"2024-09-10T10:10:00.862147+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:53.341736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722077+0000","last_change":"2024-09-10T10:08:44.929224+0000","last_active":"2024-09-10T10:10:00.722077+0000","last_peered":"2024-09-10T10:10:00.722077+0000","last_clean":"2024-09-10T10:10:00.722077+0000","last_became_active":"2024-09-10T10:08:44.928640+0000","last_became_peered":"2024-09-10T10:08:44.928640+0000","last_unstale":"2024-09-10T10:10:00.722077+0000","last_undegraded":"2024-09-10T10:10:00.722077+0000","last_fullsized":"2024-09-10T10:10:00.722077+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:42.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778123+0000","last_change":"2024-09-10T10:08:35.376585+0000","last_active":"2024-09-10T10:10:58.778123+0000","last_peered":"2024-09-10T10:10:58.778123+0000","last_clean":"2024-09-10T10:10:58.778123+0000","last_became_active":"2024-09-10T10:08:35.375693+0000","last_became_peered":"2024-09-10T10:08:35.375693+0000","last_unstale":"2024-09-10T10:10:58.778123+0000","last_undegraded":"2024-09-10T10:10:58.778123+0000","last_fullsized":"2024-09-10T10:10:58.778123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:59.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722314+0000","last_change":"2024-09-10T10:08:32.884542+0000","last_active":"2024-09-10T10:10:00.722314+0000","last_peered":"2024-09-10T10:10:00.722314+0000","last_clean":"2024-09-10T10:10:00.722314+0000","last_became_active":"2024-09-10T10:08:32.884192+0000","last_became_peered":"2024-09-10T10:08:32.884192+0000","last_unstale":"2024-09-10T10:10:00.722314+0000","last_undegraded":"2024-09-10T10:10:00.722314+0000","last_fullsized":"2024-09-10T10:10:00.722314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:57.756641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972690+0000","last_change":"2024-09-10T10:08:44.391514+0000","last_active":"2024-09-10T10:10:00.972690+0000","last_peered":"2024-09-10T10:10:00.972690+0000","last_clean":"2024-09-10T10:10:00.972690+0000","last_became_active":"2024-09-10T10:08:44.391116+0000","last_became_peered":"2024-09-10T10:08:44.391116+0000","last_unstale":"2024-09-10T10:10:00.972690+0000","last_undegraded":"2024-09-10T10:10:00.972690+0000","last_fullsized":"2024-09-10T10:10:00.972690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:41.586014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.768916+0000","last_change":"2024-09-10T10:08:35.365604+0000","last_active":"2024-09-10T10:10:58.768916+0000","last_peered":"2024-09-10T10:10:58.768916+0000","last_clean":"2024-09-10T10:10:58.768916+0000","last_became_active":"2024-09-10T10:08:35.364915+0000","last_became_peered":"2024-09-10T10:08:35.364915+0000","last_unstale":"2024-09-10T10:10:58.768916+0000","last_undegraded":"2024-09-10T10:10:58.768916+0000","last_fullsized":"2024-09-10T10:10:58.768916+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:12.885021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'13","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:59.381750+0000","last_change":"2024-09-10T10:08:32.888223+0000","last_active":"2024-09-10T10:10:59.381750+0000","last_peered":"2024-09-10T10:10:59.381750+0000","last_clean":"2024-09-10T10:10:59.381750+0000","last_became_active":"2024-09-10T10:08:32.887919+0000","last_became_peered":"2024-09-10T10:08:32.887919+0000","last_unstale":"2024-09-10T10:10:59.381750+0000","last_undegraded":"2024-09-10T10:10:59.381750+0000","last_fullsized":"2024-09-10T10:10:59.381750+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:19.781337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721073+0000","last_change":"2024-09-10T10:08:44.929322+0000","last_active":"2024-09-10T10:10:00.721073+0000","last_peered":"2024-09-10T10:10:00.721073+0000","last_clean":"2024-09-10T10:10:00.721073+0000","last_became_active":"2024-09-10T10:08:44.928252+0000","last_became_peered":"2024-09-10T10:08:44.928252+0000","last_unstale":"2024-09-10T10:10:00.721073+0000","last_undegraded":"2024-09-10T10:10:00.721073+0000","last_fullsized":"2024-09-10T10:10:00.721073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:33.048265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762075+0000","last_change":"2024-09-10T10:08:35.364168+0000","last_active":"2024-09-10T10:10:58.762075+0000","last_peered":"2024-09-10T10:10:58.762075+0000","last_clean":"2024-09-10T10:10:58.762075+0000","last_became_active":"2024-09-10T10:08:35.363739+0000","last_became_peered":"2024-09-10T10:08:35.363739+0000","last_unstale":"2024-09-10T10:10:58.762075+0000","last_undegraded":"2024-09-10T10:10:58.762075+0000","last_fullsized":"2024-09-10T10:10:58.762075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:43.029409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722836+0000","last_change":"2024-09-10T10:08:32.893021+0000","last_active":"2024-09-10T10:10:00.722836+0000","last_peered":"2024-09-10T10:10:00.722836+0000","last_clean":"2024-09-10T10:10:00.722836+0000","last_became_active":"2024-09-10T10:08:32.892667+0000","last_became_peered":"2024-09-10T10:08:32.892667+0000","last_unstale":"2024-09-10T10:10:00.722836+0000","last_undegraded":"2024-09-10T10:10:00.722836+0000","last_fullsized":"2024-09-10T10:10:00.722836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:52.427489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185575+0000","last_change":"2024-09-10T10:08:44.393831+0000","last_active":"2024-09-10T10:10:01.185575+0000","last_peered":"2024-09-10T10:10:01.185575+0000","last_clean":"2024-09-10T10:10:01.185575+0000","last_became_active":"2024-09-10T10:08:44.393415+0000","last_became_peered":"2024-09-10T10:08:44.393415+0000","last_unstale":"2024-09-10T10:10:01.185575+0000","last_undegraded":"2024-09-10T10:10:01.185575+0000","last_fullsized":"2024-09-10T10:10:01.185575+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:52.171292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769530+0000","last_change":"2024-09-10T10:08:35.374787+0000","last_active":"2024-09-10T10:10:58.769530+0000","last_peered":"2024-09-10T10:10:58.769530+0000","last_clean":"2024-09-10T10:10:58.769530+0000","last_became_active":"2024-09-10T10:08:35.374549+0000","last_became_peered":"2024-09-10T10:08:35.374549+0000","last_unstale":"2024-09-10T10:10:58.769530+0000","last_undegraded":"2024-09-10T10:10:58.769530+0000","last_fullsized":"2024-09-10T10:10:58.769530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:58.925515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724437+0000","last_change":"2024-09-10T10:08:32.886267+0000","last_active":"2024-09-10T10:10:00.724437+0000","last_peered":"2024-09-10T10:10:00.724437+0000","last_clean":"2024-09-10T10:10:00.724437+0000","last_became_active":"2024-09-10T10:08:32.885869+0000","last_became_peered":"2024-09-10T10:08:32.885869+0000","last_unstale":"2024-09-10T10:10:00.724437+0000","last_undegraded":"2024-09-10T10:10:00.724437+0000","last_fullsized":"2024-09-10T10:10:00.724437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:06.784839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722243+0000","last_change":"2024-09-10T10:09:00.486656+0000","last_active":"2024-09-10T10:10:00.722243+0000","last_peered":"2024-09-10T10:10:00.722243+0000","last_clean":"2024-09-10T10:10:00.722243+0000","last_became_active":"2024-09-10T10:09:00.486072+0000","last_became_peered":"2024-09-10T10:09:00.486072+0000","last_unstale":"2024-09-10T10:10:00.722243+0000","last_undegraded":"2024-09-10T10:10:00.722243+0000","last_fullsized":"2024-09-10T10:10:00.722243+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:26.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767023+0000","last_change":"2024-09-10T10:08:35.366130+0000","last_active":"2024-09-10T10:10:58.767023+0000","last_peered":"2024-09-10T10:10:58.767023+0000","last_clean":"2024-09-10T10:10:58.767023+0000","last_became_active":"2024-09-10T10:08:35.365785+0000","last_became_peered":"2024-09-10T10:08:35.365785+0000","last_unstale":"2024-09-10T10:10:58.767023+0000","last_undegraded":"2024-09-10T10:10:58.767023+0000","last_fullsized":"2024-09-10T10:10:58.767023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:35.771767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184987+0000","last_change":"2024-09-10T10:08:32.884113+0000","last_active":"2024-09-10T10:10:01.184987+0000","last_peered":"2024-09-10T10:10:01.184987+0000","last_clean":"2024-09-10T10:10:01.184987+0000","last_became_active":"2024-09-10T10:08:32.883503+0000","last_became_peered":"2024-09-10T10:08:32.883503+0000","last_unstale":"2024-09-10T10:10:01.184987+0000","last_undegraded":"2024-09-10T10:10:01.184987+0000","last_fullsized":"2024-09-10T10:10:01.184987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:20.513465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040285+0000","last_change":"2024-09-10T10:08:44.400137+0000","last_active":"2024-09-10T10:10:01.040285+0000","last_peered":"2024-09-10T10:10:01.040285+0000","last_clean":"2024-09-10T10:10:01.040285+0000","last_became_active":"2024-09-10T10:08:44.398736+0000","last_became_peered":"2024-09-10T10:08:44.398736+0000","last_unstale":"2024-09-10T10:10:01.040285+0000","last_undegraded":"2024-09-10T10:10:01.040285+0000","last_fullsized":"2024-09-10T10:10:01.040285+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:48.922732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.756485+0000","last_change":"2024-09-10T10:08:35.360818+0000","last_active":"2024-09-10T10:10:58.756485+0000","last_peered":"2024-09-10T10:10:58.756485+0000","last_clean":"2024-09-10T10:10:58.756485+0000","last_became_active":"2024-09-10T10:08:35.360504+0000","last_became_peered":"2024-09-10T10:08:35.360504+0000","last_unstale":"2024-09-10T10:10:58.756485+0000","last_undegraded":"2024-09-10T10:10:58.756485+0000","last_fullsized":"2024-09-10T10:10:58.756485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:45.396069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"95'5","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:15.700178+0000","last_change":"2024-09-10T10:08:32.883915+0000","last_active":"2024-09-10T10:11:15.700178+0000","last_peered":"2024-09-10T10:11:15.700178+0000","last_clean":"2024-09-10T10:11:15.700178+0000","last_became_active":"2024-09-10T10:08:32.883573+0000","last_became_peered":"2024-09-10T10:08:32.883573+0000","last_unstale":"2024-09-10T10:11:15.700178+0000","last_undegraded":"2024-09-10T10:11:15.700178+0000","last_fullsized":"2024-09-10T10:11:15.700178+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:56.271267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040574+0000","last_change":"2024-09-10T10:08:44.928968+0000","last_active":"2024-09-10T10:10:01.040574+0000","last_peered":"2024-09-10T10:10:01.040574+0000","last_clean":"2024-09-10T10:10:01.040574+0000","last_became_active":"2024-09-10T10:08:44.928445+0000","last_became_peered":"2024-09-10T10:08:44.928445+0000","last_unstale":"2024-09-10T10:10:01.040574+0000","last_undegraded":"2024-09-10T10:10:01.040574+0000","last_fullsized":"2024-09-10T10:10:01.040574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:01.799454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.748248+0000","last_change":"2024-09-10T10:08:35.369027+0000","last_active":"2024-09-10T10:10:58.748248+0000","last_peered":"2024-09-10T10:10:58.748248+0000","last_clean":"2024-09-10T10:10:58.748248+0000","last_became_active":"2024-09-10T10:08:35.368692+0000","last_became_peered":"2024-09-10T10:08:35.368692+0000","last_unstale":"2024-09-10T10:10:58.748248+0000","last_undegraded":"2024-09-10T10:10:58.748248+0000","last_fullsized":"2024-09-10T10:10:58.748248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:09.500617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184814+0000","last_change":"2024-09-10T10:08:32.888661+0000","last_active":"2024-09-10T10:10:01.184814+0000","last_peered":"2024-09-10T10:10:01.184814+0000","last_clean":"2024-09-10T10:10:01.184814+0000","last_became_active":"2024-09-10T10:08:32.888312+0000","last_became_peered":"2024-09-10T10:08:32.888312+0000","last_unstale":"2024-09-10T10:10:01.184814+0000","last_undegraded":"2024-09-10T10:10:01.184814+0000","last_fullsized":"2024-09-10T10:10:01.184814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:47.293560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840405+0000","last_change":"2024-09-10T10:08:44.929512+0000","last_active":"2024-09-10T10:10:00.840405+0000","last_peered":"2024-09-10T10:10:00.840405+0000","last_clean":"2024-09-10T10:10:00.840405+0000","last_became_active":"2024-09-10T10:08:44.928992+0000","last_became_peered":"2024-09-10T10:08:44.928992+0000","last_unstale":"2024-09-10T10:10:00.840405+0000","last_undegraded":"2024-09-10T10:10:00.840405+0000","last_fullsized":"2024-09-10T10:10:00.840405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:31.827967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'8","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766202+0000","last_change":"2024-09-10T10:10:00.863430+0000","last_active":"2024-09-10T10:10:58.766202+0000","last_peered":"2024-09-10T10:10:58.766202+0000","last_clean":"2024-09-10T10:10:58.766202+0000","last_became_active":"2024-09-10T10:10:00.863082+0000","last_became_peered":"2024-09-10T10:10:00.863082+0000","last_unstale":"2024-09-10T10:10:58.766202+0000","last_undegraded":"2024-09-10T10:10:58.766202+0000","last_fullsized":"2024-09-10T10:10:58.766202+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:24.848797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722248+0000","last_change":"2024-09-10T10:08:32.885451+0000","last_active":"2024-09-10T10:10:00.722248+0000","last_peered":"2024-09-10T10:10:00.722248+0000","last_clean":"2024-09-10T10:10:00.722248+0000","last_became_active":"2024-09-10T10:08:32.885102+0000","last_became_peered":"2024-09-10T10:08:32.885102+0000","last_unstale":"2024-09-10T10:10:00.722248+0000","last_undegraded":"2024-09-10T10:10:00.722248+0000","last_fullsized":"2024-09-10T10:10:00.722248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:52.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":356,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185287+0000","last_change":"2024-09-10T10:07:13.661841+0000","last_active":"2024-09-10T10:10:01.185287+0000","last_peered":"2024-09-10T10:10:01.185287+0000","last_clean":"2024-09-10T10:10:01.185287+0000","last_became_active":"2024-09-10T10:07:13.661310+0000","last_became_peered":"2024-09-10T10:07:13.661310+0000","last_unstale":"2024-09-10T10:10:01.185287+0000","last_undegraded":"2024-09-10T10:10:01.185287+0000","last_fullsized":"2024-09-10T10:10:01.185287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_clean_scrub_stamp":"2024-09-10T10:03:29.327083+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:39.414636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185638+0000","last_change":"2024-09-10T10:08:44.391277+0000","last_active":"2024-09-10T10:10:01.185638+0000","last_peered":"2024-09-10T10:10:01.185638+0000","last_clean":"2024-09-10T10:10:01.185638+0000","last_became_active":"2024-09-10T10:08:44.390867+0000","last_became_peered":"2024-09-10T10:08:44.390867+0000","last_unstale":"2024-09-10T10:10:01.185638+0000","last_undegraded":"2024-09-10T10:10:01.185638+0000","last_fullsized":"2024-09-10T10:10:01.185638+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:23.299812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772994+0000","last_change":"2024-09-10T10:08:35.364750+0000","last_active":"2024-09-10T10:10:58.772994+0000","last_peered":"2024-09-10T10:10:58.772994+0000","last_clean":"2024-09-10T10:10:58.772994+0000","last_became_active":"2024-09-10T10:08:35.364034+0000","last_became_peered":"2024-09-10T10:08:35.364034+0000","last_unstale":"2024-09-10T10:10:58.772994+0000","last_undegraded":"2024-09-10T10:10:58.772994+0000","last_fullsized":"2024-09-10T10:10:58.772994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:15.296086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973375+0000","last_change":"2024-09-10T10:08:32.886884+0000","last_active":"2024-09-10T10:10:00.973375+0000","last_peered":"2024-09-10T10:10:00.973375+0000","last_clean":"2024-09-10T10:10:00.973375+0000","last_became_active":"2024-09-10T10:08:32.886544+0000","last_became_peered":"2024-09-10T10:08:32.886544+0000","last_unstale":"2024-09-10T10:10:00.973375+0000","last_undegraded":"2024-09-10T10:10:00.973375+0000","last_fullsized":"2024-09-10T10:10:00.973375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:30.511881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862240+0000","last_change":"2024-09-10T10:08:44.390761+0000","last_active":"2024-09-10T10:10:00.862240+0000","last_peered":"2024-09-10T10:10:00.862240+0000","last_clean":"2024-09-10T10:10:00.862240+0000","last_became_active":"2024-09-10T10:08:44.390190+0000","last_became_peered":"2024-09-10T10:08:44.390190+0000","last_unstale":"2024-09-10T10:10:00.862240+0000","last_undegraded":"2024-09-10T10:10:00.862240+0000","last_fullsized":"2024-09-10T10:10:00.862240+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:38.216171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767507+0000","last_change":"2024-09-10T10:08:35.362956+0000","last_active":"2024-09-10T10:10:58.767507+0000","last_peered":"2024-09-10T10:10:58.767507+0000","last_clean":"2024-09-10T10:10:58.767507+0000","last_became_active":"2024-09-10T10:08:35.362623+0000","last_became_peered":"2024-09-10T10:08:35.362623+0000","last_unstale":"2024-09-10T10:10:58.767507+0000","last_undegraded":"2024-09-10T10:10:58.767507+0000","last_fullsized":"2024-09-10T10:10:58.767507+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:50.162838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840553+0000","last_change":"2024-09-10T10:08:32.889741+0000","last_active":"2024-09-10T10:10:00.840553+0000","last_peered":"2024-09-10T10:10:00.840553+0000","last_clean":"2024-09-10T10:10:00.840553+0000","last_became_active":"2024-09-10T10:08:32.889394+0000","last_became_peered":"2024-09-10T10:08:32.889394+0000","last_unstale":"2024-09-10T10:10:00.840553+0000","last_undegraded":"2024-09-10T10:10:00.840553+0000","last_fullsized":"2024-09-10T10:10:00.840553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:16.845738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938314+0000","last_change":"2024-09-10T10:08:44.403781+0000","last_active":"2024-09-10T10:10:00.938314+0000","last_peered":"2024-09-10T10:10:00.938314+0000","last_clean":"2024-09-10T10:10:00.938314+0000","last_became_active":"2024-09-10T10:08:44.399601+0000","last_became_peered":"2024-09-10T10:08:44.399601+0000","last_unstale":"2024-09-10T10:10:00.938314+0000","last_undegraded":"2024-09-10T10:10:00.938314+0000","last_fullsized":"2024-09-10T10:10:00.938314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:45.587247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765508+0000","last_change":"2024-09-10T10:08:35.367825+0000","last_active":"2024-09-10T10:10:58.765508+0000","last_peered":"2024-09-10T10:10:58.765508+0000","last_clean":"2024-09-10T10:10:58.765508+0000","last_became_active":"2024-09-10T10:08:35.367511+0000","last_became_peered":"2024-09-10T10:08:35.367511+0000","last_unstale":"2024-09-10T10:10:58.765508+0000","last_undegraded":"2024-09-10T10:10:58.765508+0000","last_fullsized":"2024-09-10T10:10:58.765508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:03.356912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039782+0000","last_change":"2024-09-10T10:08:32.888524+0000","last_active":"2024-09-10T10:10:01.039782+0000","last_peered":"2024-09-10T10:10:01.039782+0000","last_clean":"2024-09-10T10:10:01.039782+0000","last_became_active":"2024-09-10T10:08:32.888148+0000","last_became_peered":"2024-09-10T10:08:32.888148+0000","last_unstale":"2024-09-10T10:10:01.039782+0000","last_undegraded":"2024-09-10T10:10:01.039782+0000","last_fullsized":"2024-09-10T10:10:01.039782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:34.342167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839577+0000","last_change":"2024-09-10T10:08:44.392952+0000","last_active":"2024-09-10T10:10:00.839577+0000","last_peered":"2024-09-10T10:10:00.839577+0000","last_clean":"2024-09-10T10:10:00.839577+0000","last_became_active":"2024-09-10T10:08:44.392476+0000","last_became_peered":"2024-09-10T10:08:44.392476+0000","last_unstale":"2024-09-10T10:10:00.839577+0000","last_undegraded":"2024-09-10T10:10:00.839577+0000","last_fullsized":"2024-09-10T10:10:00.839577+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:26.530305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761361+0000","last_change":"2024-09-10T10:08:35.364501+0000","last_active":"2024-09-10T10:10:58.761361+0000","last_peered":"2024-09-10T10:10:58.761361+0000","last_clean":"2024-09-10T10:10:58.761361+0000","last_became_active":"2024-09-10T10:08:35.364102+0000","last_became_peered":"2024-09-10T10:08:35.364102+0000","last_unstale":"2024-09-10T10:10:58.761361+0000","last_undegraded":"2024-09-10T10:10:58.761361+0000","last_fullsized":"2024-09-10T10:10:58.761361+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:42.743140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":22,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185891+0000","last_change":"2024-09-10T10:09:00.461639+0000","last_active":"2024-09-10T10:10:01.185891+0000","last_peered":"2024-09-10T10:10:01.185891+0000","last_clean":"2024-09-10T10:10:01.185891+0000","last_became_active":"2024-09-10T10:09:00.457246+0000","last_became_peered":"2024-09-10T10:09:00.457246+0000","last_unstale":"2024-09-10T10:10:01.185891+0000","last_undegraded":"2024-09-10T10:10:01.185891+0000","last_fullsized":"2024-09-10T10:10:01.185891+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:30.387035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840110+0000","last_change":"2024-09-10T10:08:44.401728+0000","last_active":"2024-09-10T10:10:00.840110+0000","last_peered":"2024-09-10T10:10:00.840110+0000","last_clean":"2024-09-10T10:10:00.840110+0000","last_became_active":"2024-09-10T10:08:44.401334+0000","last_became_peered":"2024-09-10T10:08:44.401334+0000","last_unstale":"2024-09-10T10:10:00.840110+0000","last_undegraded":"2024-09-10T10:10:00.840110+0000","last_fullsized":"2024-09-10T10:10:00.840110+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:57.496196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"95'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769526+0000","last_change":"2024-09-10T10:09:00.486353+0000","last_active":"2024-09-10T10:10:58.769526+0000","last_peered":"2024-09-10T10:10:58.769526+0000","last_clean":"2024-09-10T10:10:58.769526+0000","last_became_active":"2024-09-10T10:09:00.485938+0000","last_became_peered":"2024-09-10T10:09:00.485938+0000","last_unstale":"2024-09-10T10:10:58.769526+0000","last_undegraded":"2024-09-10T10:10:58.769526+0000","last_fullsized":"2024-09-10T10:10:58.769526+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:38.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722331+0000","last_change":"2024-09-10T10:08:32.893278+0000","last_active":"2024-09-10T10:10:00.722331+0000","last_peered":"2024-09-10T10:10:00.722331+0000","last_clean":"2024-09-10T10:10:00.722331+0000","last_became_active":"2024-09-10T10:08:32.892848+0000","last_became_peered":"2024-09-10T10:08:32.892848+0000","last_unstale":"2024-09-10T10:10:00.722331+0000","last_undegraded":"2024-09-10T10:10:00.722331+0000","last_fullsized":"2024-09-10T10:10:00.722331+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:09.336253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040465+0000","last_change":"2024-09-10T10:08:44.407213+0000","last_active":"2024-09-10T10:10:01.040465+0000","last_peered":"2024-09-10T10:10:01.040465+0000","last_clean":"2024-09-10T10:10:01.040465+0000","last_became_active":"2024-09-10T10:08:44.405198+0000","last_became_peered":"2024-09-10T10:08:44.405198+0000","last_unstale":"2024-09-10T10:10:01.040465+0000","last_undegraded":"2024-09-10T10:10:01.040465+0000","last_fullsized":"2024-09-10T10:10:01.040465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:15.921684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767621+0000","last_change":"2024-09-10T10:08:35.362683+0000","last_active":"2024-09-10T10:10:58.767621+0000","last_peered":"2024-09-10T10:10:58.767621+0000","last_clean":"2024-09-10T10:10:58.767621+0000","last_became_active":"2024-09-10T10:08:35.362353+0000","last_became_peered":"2024-09-10T10:08:35.362353+0000","last_unstale":"2024-09-10T10:10:58.767621+0000","last_undegraded":"2024-09-10T10:10:58.767621+0000","last_fullsized":"2024-09-10T10:10:58.767621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.489716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"95'5","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:18.705229+0000","last_change":"2024-09-10T10:08:32.881024+0000","last_active":"2024-09-10T10:11:18.705229+0000","last_peered":"2024-09-10T10:11:18.705229+0000","last_clean":"2024-09-10T10:11:18.705229+0000","last_became_active":"2024-09-10T10:08:32.880691+0000","last_became_peered":"2024-09-10T10:08:32.880691+0000","last_unstale":"2024-09-10T10:11:18.705229+0000","last_undegraded":"2024-09-10T10:11:18.705229+0000","last_fullsized":"2024-09-10T10:11:18.705229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:15.988063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724443+0000","last_change":"2024-09-10T10:08:44.400509+0000","last_active":"2024-09-10T10:10:00.724443+0000","last_peered":"2024-09-10T10:10:00.724443+0000","last_clean":"2024-09-10T10:10:00.724443+0000","last_became_active":"2024-09-10T10:08:44.400152+0000","last_became_peered":"2024-09-10T10:08:44.400152+0000","last_unstale":"2024-09-10T10:10:00.724443+0000","last_undegraded":"2024-09-10T10:10:00.724443+0000","last_fullsized":"2024-09-10T10:10:00.724443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:43.550208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.775766+0000","last_change":"2024-09-10T10:08:35.364208+0000","last_active":"2024-09-10T10:10:58.775766+0000","last_peered":"2024-09-10T10:10:58.775766+0000","last_clean":"2024-09-10T10:10:58.775766+0000","last_became_active":"2024-09-10T10:08:35.363751+0000","last_became_peered":"2024-09-10T10:08:35.363751+0000","last_unstale":"2024-09-10T10:10:58.775766+0000","last_undegraded":"2024-09-10T10:10:58.775766+0000","last_fullsized":"2024-09-10T10:10:58.775766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:21.791512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840204+0000","last_change":"2024-09-10T10:08:32.890611+0000","last_active":"2024-09-10T10:10:00.840204+0000","last_peered":"2024-09-10T10:10:00.840204+0000","last_clean":"2024-09-10T10:10:00.840204+0000","last_became_active":"2024-09-10T10:08:32.890296+0000","last_became_peered":"2024-09-10T10:08:32.890296+0000","last_unstale":"2024-09-10T10:10:00.840204+0000","last_undegraded":"2024-09-10T10:10:00.840204+0000","last_fullsized":"2024-09-10T10:10:00.840204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.977575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185624+0000","last_change":"2024-09-10T10:08:44.402607+0000","last_active":"2024-09-10T10:10:01.185624+0000","last_peered":"2024-09-10T10:10:01.185624+0000","last_clean":"2024-09-10T10:10:01.185624+0000","last_became_active":"2024-09-10T10:08:44.401623+0000","last_became_peered":"2024-09-10T10:08:44.401623+0000","last_unstale":"2024-09-10T10:10:01.185624+0000","last_undegraded":"2024-09-10T10:10:01.185624+0000","last_fullsized":"2024-09-10T10:10:01.185624+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:21.105349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.775534+0000","last_change":"2024-09-10T10:08:35.360642+0000","last_active":"2024-09-10T10:10:58.775534+0000","last_peered":"2024-09-10T10:10:58.775534+0000","last_clean":"2024-09-10T10:10:58.775534+0000","last_became_active":"2024-09-10T10:08:35.356667+0000","last_became_peered":"2024-09-10T10:08:35.356667+0000","last_unstale":"2024-09-10T10:10:58.775534+0000","last_undegraded":"2024-09-10T10:10:58.775534+0000","last_fullsized":"2024-09-10T10:10:58.775534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:08.404973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972507+0000","last_change":"2024-09-10T10:08:32.890418+0000","last_active":"2024-09-10T10:10:00.972507+0000","last_peered":"2024-09-10T10:10:00.972507+0000","last_clean":"2024-09-10T10:10:00.972507+0000","last_became_active":"2024-09-10T10:08:32.890081+0000","last_became_peered":"2024-09-10T10:08:32.890081+0000","last_unstale":"2024-09-10T10:10:00.972507+0000","last_undegraded":"2024-09-10T10:10:00.972507+0000","last_fullsized":"2024-09-10T10:10:00.972507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:52.839714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840379+0000","last_change":"2024-09-10T10:08:44.401322+0000","last_active":"2024-09-10T10:10:00.840379+0000","last_peered":"2024-09-10T10:10:00.840379+0000","last_clean":"2024-09-10T10:10:00.840379+0000","last_became_active":"2024-09-10T10:08:44.400906+0000","last_became_peered":"2024-09-10T10:08:44.400906+0000","last_unstale":"2024-09-10T10:10:00.840379+0000","last_undegraded":"2024-09-10T10:10:00.840379+0000","last_fullsized":"2024-09-10T10:10:00.840379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:08.616288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761674+0000","last_change":"2024-09-10T10:08:35.366580+0000","last_active":"2024-09-10T10:10:58.761674+0000","last_peered":"2024-09-10T10:10:58.761674+0000","last_clean":"2024-09-10T10:10:58.761674+0000","last_became_active":"2024-09-10T10:08:35.365943+0000","last_became_peered":"2024-09-10T10:08:35.365943+0000","last_unstale":"2024-09-10T10:10:58.761674+0000","last_undegraded":"2024-09-10T10:10:58.761674+0000","last_fullsized":"2024-09-10T10:10:58.761674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:58.351517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"95'38","reported_seq":309,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:15.700952+0000","last_change":"2024-09-10T10:08:32.888411+0000","last_active":"2024-09-10T10:11:15.700952+0000","last_peered":"2024-09-10T10:11:15.700952+0000","last_clean":"2024-09-10T10:11:15.700952+0000","last_became_active":"2024-09-10T10:08:32.888093+0000","last_became_peered":"2024-09-10T10:08:32.888093+0000","last_unstale":"2024-09-10T10:11:15.700952+0000","last_undegraded":"2024-09-10T10:11:15.700952+0000","last_fullsized":"2024-09-10T10:11:15.700952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.532868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62636,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":230,"num_read_kb":177,"num_write":39,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724453+0000","last_change":"2024-09-10T10:08:44.400432+0000","last_active":"2024-09-10T10:10:00.724453+0000","last_peered":"2024-09-10T10:10:00.724453+0000","last_clean":"2024-09-10T10:10:00.724453+0000","last_became_active":"2024-09-10T10:08:44.399981+0000","last_became_peered":"2024-09-10T10:08:44.399981+0000","last_unstale":"2024-09-10T10:10:00.724453+0000","last_undegraded":"2024-09-10T10:10:00.724453+0000","last_fullsized":"2024-09-10T10:10:00.724453+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:57.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"95'11","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765617+0000","last_change":"2024-09-10T10:09:00.460848+0000","last_active":"2024-09-10T10:10:58.765617+0000","last_peered":"2024-09-10T10:10:58.765617+0000","last_clean":"2024-09-10T10:10:58.765617+0000","last_became_active":"2024-09-10T10:09:00.460459+0000","last_became_peered":"2024-09-10T10:09:00.460459+0000","last_unstale":"2024-09-10T10:10:58.765617+0000","last_undegraded":"2024-09-10T10:10:58.765617+0000","last_fullsized":"2024-09-10T10:10:58.765617+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:06.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840557+0000","last_change":"2024-09-10T10:08:32.885909+0000","last_active":"2024-09-10T10:10:00.840557+0000","last_peered":"2024-09-10T10:10:00.840557+0000","last_clean":"2024-09-10T10:10:00.840557+0000","last_became_active":"2024-09-10T10:08:32.885512+0000","last_became_peered":"2024-09-10T10:08:32.885512+0000","last_unstale":"2024-09-10T10:10:00.840557+0000","last_undegraded":"2024-09-10T10:10:00.840557+0000","last_fullsized":"2024-09-10T10:10:00.840557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:44.850772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721902+0000","last_change":"2024-09-10T10:08:44.400323+0000","last_active":"2024-09-10T10:10:00.721902+0000","last_peered":"2024-09-10T10:10:00.721902+0000","last_clean":"2024-09-10T10:10:00.721902+0000","last_became_active":"2024-09-10T10:08:44.399923+0000","last_became_peered":"2024-09-10T10:08:44.399923+0000","last_unstale":"2024-09-10T10:10:00.721902+0000","last_undegraded":"2024-09-10T10:10:00.721902+0000","last_fullsized":"2024-09-10T10:10:00.721902+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:45.496392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771495+0000","last_change":"2024-09-10T10:08:35.375543+0000","last_active":"2024-09-10T10:10:58.771495+0000","last_peered":"2024-09-10T10:10:58.771495+0000","last_clean":"2024-09-10T10:10:58.771495+0000","last_became_active":"2024-09-10T10:08:35.374312+0000","last_became_peered":"2024-09-10T10:08:35.374312+0000","last_unstale":"2024-09-10T10:10:58.771495+0000","last_undegraded":"2024-09-10T10:10:58.771495+0000","last_fullsized":"2024-09-10T10:10:58.771495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:34.208716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184909+0000","last_change":"2024-09-10T10:08:32.888540+0000","last_active":"2024-09-10T10:10:01.184909+0000","last_peered":"2024-09-10T10:10:01.184909+0000","last_clean":"2024-09-10T10:10:01.184909+0000","last_became_active":"2024-09-10T10:08:32.888187+0000","last_became_peered":"2024-09-10T10:08:32.888187+0000","last_unstale":"2024-09-10T10:10:01.184909+0000","last_undegraded":"2024-09-10T10:10:01.184909+0000","last_fullsized":"2024-09-10T10:10:01.184909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:06.694533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.723713+0000","last_change":"2024-09-10T10:08:44.397995+0000","last_active":"2024-09-10T10:10:00.723713+0000","last_peered":"2024-09-10T10:10:00.723713+0000","last_clean":"2024-09-10T10:10:00.723713+0000","last_became_active":"2024-09-10T10:08:44.397583+0000","last_became_peered":"2024-09-10T10:08:44.397583+0000","last_unstale":"2024-09-10T10:10:00.723713+0000","last_undegraded":"2024-09-10T10:10:00.723713+0000","last_fullsized":"2024-09-10T10:10:00.723713+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:03.908014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773846+0000","last_change":"2024-09-10T10:08:35.361053+0000","last_active":"2024-09-10T10:10:58.773846+0000","last_peered":"2024-09-10T10:10:58.773846+0000","last_clean":"2024-09-10T10:10:58.773846+0000","last_became_active":"2024-09-10T10:08:35.360736+0000","last_became_peered":"2024-09-10T10:08:35.360736+0000","last_unstale":"2024-09-10T10:10:58.773846+0000","last_undegraded":"2024-09-10T10:10:58.773846+0000","last_fullsized":"2024-09-10T10:10:58.773846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:45.435384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"95'4","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:14.698498+0000","last_change":"2024-09-10T10:08:32.885067+0000","last_active":"2024-09-10T10:11:14.698498+0000","last_peered":"2024-09-10T10:11:14.698498+0000","last_clean":"2024-09-10T10:11:14.698498+0000","last_became_active":"2024-09-10T10:08:32.884676+0000","last_became_peered":"2024-09-10T10:08:32.884676+0000","last_unstale":"2024-09-10T10:11:14.698498+0000","last_undegraded":"2024-09-10T10:11:14.698498+0000","last_fullsized":"2024-09-10T10:11:14.698498+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.667680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721235+0000","last_change":"2024-09-10T10:08:44.395892+0000","last_active":"2024-09-10T10:10:00.721235+0000","last_peered":"2024-09-10T10:10:00.721235+0000","last_clean":"2024-09-10T10:10:00.721235+0000","last_became_active":"2024-09-10T10:08:44.395188+0000","last_became_peered":"2024-09-10T10:08:44.395188+0000","last_unstale":"2024-09-10T10:10:00.721235+0000","last_undegraded":"2024-09-10T10:10:00.721235+0000","last_fullsized":"2024-09-10T10:10:00.721235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:27.562053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.939198+0000","last_change":"2024-09-10T10:08:44.403185+0000","last_active":"2024-09-10T10:10:00.939198+0000","last_peered":"2024-09-10T10:10:00.939198+0000","last_clean":"2024-09-10T10:10:00.939198+0000","last_became_active":"2024-09-10T10:08:44.399943+0000","last_became_peered":"2024-09-10T10:08:44.399943+0000","last_unstale":"2024-09-10T10:10:00.939198+0000","last_undegraded":"2024-09-10T10:10:00.939198+0000","last_fullsized":"2024-09-10T10:10:00.939198+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:07.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.770162+0000","last_change":"2024-09-10T10:08:35.367552+0000","last_active":"2024-09-10T10:10:58.770162+0000","last_peered":"2024-09-10T10:10:58.770162+0000","last_clean":"2024-09-10T10:10:58.770162+0000","last_became_active":"2024-09-10T10:08:35.367215+0000","last_became_peered":"2024-09-10T10:08:35.367215+0000","last_unstale":"2024-09-10T10:10:58.770162+0000","last_undegraded":"2024-09-10T10:10:58.770162+0000","last_fullsized":"2024-09-10T10:10:58.770162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:28.756769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840019+0000","last_change":"2024-09-10T10:08:32.885830+0000","last_active":"2024-09-10T10:10:00.840019+0000","last_peered":"2024-09-10T10:10:00.840019+0000","last_clean":"2024-09-10T10:10:00.840019+0000","last_became_active":"2024-09-10T10:08:32.885465+0000","last_became_peered":"2024-09-10T10:08:32.885465+0000","last_unstale":"2024-09-10T10:10:00.840019+0000","last_undegraded":"2024-09-10T10:10:00.840019+0000","last_fullsized":"2024-09-10T10:10:00.840019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:55.101364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185761+0000","last_change":"2024-09-10T10:09:00.487666+0000","last_active":"2024-09-10T10:10:01.185761+0000","last_peered":"2024-09-10T10:10:01.185761+0000","last_clean":"2024-09-10T10:10:01.185761+0000","last_became_active":"2024-09-10T10:09:00.487110+0000","last_became_peered":"2024-09-10T10:09:00.487110+0000","last_unstale":"2024-09-10T10:10:01.185761+0000","last_undegraded":"2024-09-10T10:10:01.185761+0000","last_fullsized":"2024-09-10T10:10:01.185761+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:28.817826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755501+0000","last_change":"2024-09-10T10:08:35.356247+0000","last_active":"2024-09-10T10:10:58.755501+0000","last_peered":"2024-09-10T10:10:58.755501+0000","last_clean":"2024-09-10T10:10:58.755501+0000","last_became_active":"2024-09-10T10:08:35.355953+0000","last_became_peered":"2024-09-10T10:08:35.355953+0000","last_unstale":"2024-09-10T10:10:58.755501+0000","last_undegraded":"2024-09-10T10:10:58.755501+0000","last_fullsized":"2024-09-10T10:10:58.755501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:24.625382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039784+0000","last_change":"2024-09-10T10:08:32.882151+0000","last_active":"2024-09-10T10:10:01.039784+0000","last_peered":"2024-09-10T10:10:01.039784+0000","last_clean":"2024-09-10T10:10:01.039784+0000","last_became_active":"2024-09-10T10:08:32.881688+0000","last_became_peered":"2024-09-10T10:08:32.881688+0000","last_unstale":"2024-09-10T10:10:01.039784+0000","last_undegraded":"2024-09-10T10:10:01.039784+0000","last_fullsized":"2024-09-10T10:10:01.039784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:49.186299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.109676+0000","last_change":"2024-09-10T10:08:32.887018+0000","last_active":"2024-09-10T10:10:01.109676+0000","last_peered":"2024-09-10T10:10:01.109676+0000","last_clean":"2024-09-10T10:10:01.109676+0000","last_became_active":"2024-09-10T10:08:32.886636+0000","last_became_peered":"2024-09-10T10:08:32.886636+0000","last_unstale":"2024-09-10T10:10:01.109676+0000","last_undegraded":"2024-09-10T10:10:01.109676+0000","last_fullsized":"2024-09-10T10:10:01.109676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:24.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762425+0000","last_change":"2024-09-10T10:08:35.363803+0000","last_active":"2024-09-10T10:10:58.762425+0000","last_peered":"2024-09-10T10:10:58.762425+0000","last_clean":"2024-09-10T10:10:58.762425+0000","last_became_active":"2024-09-10T10:08:35.363442+0000","last_became_peered":"2024-09-10T10:08:35.363442+0000","last_unstale":"2024-09-10T10:10:58.762425+0000","last_undegraded":"2024-09-10T10:10:58.762425+0000","last_fullsized":"2024-09-10T10:10:58.762425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:59.045347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972949+0000","last_change":"2024-09-10T10:08:44.403970+0000","last_active":"2024-09-10T10:10:00.972949+0000","last_peered":"2024-09-10T10:10:00.972949+0000","last_clean":"2024-09-10T10:10:00.972949+0000","last_became_active":"2024-09-10T10:08:44.403462+0000","last_became_peered":"2024-09-10T10:08:44.403462+0000","last_unstale":"2024-09-10T10:10:00.972949+0000","last_undegraded":"2024-09-10T10:10:00.972949+0000","last_fullsized":"2024-09-10T10:10:00.972949+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:09.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:15.700842+0000","last_change":"2024-09-10T10:08:32.893227+0000","last_active":"2024-09-10T10:11:15.700842+0000","last_peered":"2024-09-10T10:11:15.700842+0000","last_clean":"2024-09-10T10:11:15.700842+0000","last_became_active":"2024-09-10T10:08:32.892732+0000","last_became_peered":"2024-09-10T10:08:32.892732+0000","last_unstale":"2024-09-10T10:11:15.700842+0000","last_undegraded":"2024-09-10T10:11:15.700842+0000","last_fullsized":"2024-09-10T10:11:15.700842+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:16.933955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761246+0000","last_change":"2024-09-10T10:08:35.368806+0000","last_active":"2024-09-10T10:10:58.761246+0000","last_peered":"2024-09-10T10:10:58.761246+0000","last_clean":"2024-09-10T10:10:58.761246+0000","last_became_active":"2024-09-10T10:08:35.368397+0000","last_became_peered":"2024-09-10T10:08:35.368397+0000","last_unstale":"2024-09-10T10:10:58.761246+0000","last_undegraded":"2024-09-10T10:10:58.761246+0000","last_fullsized":"2024-09-10T10:10:58.761246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:39.656295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973102+0000","last_change":"2024-09-10T10:08:44.391941+0000","last_active":"2024-09-10T10:10:00.973102+0000","last_peered":"2024-09-10T10:10:00.973102+0000","last_clean":"2024-09-10T10:10:00.973102+0000","last_became_active":"2024-09-10T10:08:44.391553+0000","last_became_peered":"2024-09-10T10:08:44.391553+0000","last_unstale":"2024-09-10T10:10:00.973102+0000","last_undegraded":"2024-09-10T10:10:00.973102+0000","last_fullsized":"2024-09-10T10:10:00.973102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:34.279772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762216+0000","last_change":"2024-09-10T10:08:35.363192+0000","last_active":"2024-09-10T10:10:58.762216+0000","last_peered":"2024-09-10T10:10:58.762216+0000","last_clean":"2024-09-10T10:10:58.762216+0000","last_became_active":"2024-09-10T10:08:35.362890+0000","last_became_peered":"2024-09-10T10:08:35.362890+0000","last_unstale":"2024-09-10T10:10:58.762216+0000","last_undegraded":"2024-09-10T10:10:58.762216+0000","last_fullsized":"2024-09-10T10:10:58.762216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:07.493539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"95'12","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.748590+0000","last_change":"2024-09-10T10:08:35.362471+0000","last_active":"2024-09-10T10:10:58.748590+0000","last_peered":"2024-09-10T10:10:58.748590+0000","last_clean":"2024-09-10T10:10:58.748590+0000","last_became_active":"2024-09-10T10:08:35.361553+0000","last_became_peered":"2024-09-10T10:08:35.361553+0000","last_unstale":"2024-09-10T10:10:58.748590+0000","last_undegraded":"2024-09-10T10:10:58.748590+0000","last_fullsized":"2024-09-10T10:10:58.748590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:24.511901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.777795+0000","last_change":"2024-09-10T10:08:35.371025+0000","last_active":"2024-09-10T10:10:58.777795+0000","last_peered":"2024-09-10T10:10:58.777795+0000","last_clean":"2024-09-10T10:10:58.777795+0000","last_became_active":"2024-09-10T10:08:35.370692+0000","last_became_peered":"2024-09-10T10:08:35.370692+0000","last_unstale":"2024-09-10T10:10:58.777795+0000","last_undegraded":"2024-09-10T10:10:58.777795+0000","last_fullsized":"2024-09-10T10:10:58.777795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:22.289843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776381+0000","last_change":"2024-09-10T10:08:35.373519+0000","last_active":"2024-09-10T10:10:58.776381+0000","last_peered":"2024-09-10T10:10:58.776381+0000","last_clean":"2024-09-10T10:10:58.776381+0000","last_became_active":"2024-09-10T10:08:35.372719+0000","last_became_peered":"2024-09-10T10:08:35.372719+0000","last_unstale":"2024-09-10T10:10:58.776381+0000","last_undegraded":"2024-09-10T10:10:58.776381+0000","last_fullsized":"2024-09-10T10:10:58.776381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:24.530809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"95'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778078+0000","last_change":"2024-09-10T10:09:00.489944+0000","last_active":"2024-09-10T10:10:58.778078+0000","last_peered":"2024-09-10T10:10:58.778078+0000","last_clean":"2024-09-10T10:10:58.778078+0000","last_became_active":"2024-09-10T10:09:00.489269+0000","last_became_peered":"2024-09-10T10:09:00.489269+0000","last_unstale":"2024-09-10T10:10:58.778078+0000","last_undegraded":"2024-09-10T10:10:58.778078+0000","last_fullsized":"2024-09-10T10:10:58.778078+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:46.561078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761792+0000","last_change":"2024-09-10T10:08:35.364779+0000","last_active":"2024-09-10T10:10:58.761792+0000","last_peered":"2024-09-10T10:10:58.761792+0000","last_clean":"2024-09-10T10:10:58.761792+0000","last_became_active":"2024-09-10T10:08:35.364455+0000","last_became_peered":"2024-09-10T10:08:35.364455+0000","last_unstale":"2024-09-10T10:10:58.761792+0000","last_undegraded":"2024-09-10T10:10:58.761792+0000","last_fullsized":"2024-09-10T10:10:58.761792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:08.552218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761074+0000","last_change":"2024-09-10T10:08:35.357147+0000","last_active":"2024-09-10T10:10:58.761074+0000","last_peered":"2024-09-10T10:10:58.761074+0000","last_clean":"2024-09-10T10:10:58.761074+0000","last_became_active":"2024-09-10T10:08:35.356808+0000","last_became_peered":"2024-09-10T10:08:35.356808+0000","last_unstale":"2024-09-10T10:10:58.761074+0000","last_undegraded":"2024-09-10T10:10:58.761074+0000","last_fullsized":"2024-09-10T10:10:58.761074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:35.731496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"95'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755499+0000","last_change":"2024-09-10T10:08:35.365795+0000","last_active":"2024-09-10T10:10:58.755499+0000","last_peered":"2024-09-10T10:10:58.755499+0000","last_clean":"2024-09-10T10:10:58.755499+0000","last_became_active":"2024-09-10T10:08:35.365342+0000","last_became_peered":"2024-09-10T10:08:35.365342+0000","last_unstale":"2024-09-10T10:10:58.755499+0000","last_undegraded":"2024-09-10T10:10:58.755499+0000","last_fullsized":"2024-09-10T10:10:58.755499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:20.012890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"95'6","reported_seq":22,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.763139+0000","last_change":"2024-09-10T10:09:00.486664+0000","last_active":"2024-09-10T10:10:58.763139+0000","last_peered":"2024-09-10T10:10:58.763139+0000","last_clean":"2024-09-10T10:10:58.763139+0000","last_became_active":"2024-09-10T10:09:00.486239+0000","last_became_peered":"2024-09-10T10:09:00.486239+0000","last_unstale":"2024-09-10T10:10:58.763139+0000","last_undegraded":"2024-09-10T10:10:58.763139+0000","last_fullsized":"2024-09-10T10:10:58.763139+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:47.472245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755183+0000","last_change":"2024-09-10T10:08:35.367403+0000","last_active":"2024-09-10T10:10:58.755183+0000","last_peered":"2024-09-10T10:10:58.755183+0000","last_clean":"2024-09-10T10:10:58.755183+0000","last_became_active":"2024-09-10T10:08:35.365969+0000","last_became_peered":"2024-09-10T10:08:35.365969+0000","last_unstale":"2024-09-10T10:10:58.755183+0000","last_undegraded":"2024-09-10T10:10:58.755183+0000","last_fullsized":"2024-09-10T10:10:58.755183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:27.657226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773597+0000","last_change":"2024-09-10T10:08:35.359185+0000","last_active":"2024-09-10T10:10:58.773597+0000","last_peered":"2024-09-10T10:10:58.773597+0000","last_clean":"2024-09-10T10:10:58.773597+0000","last_became_active":"2024-09-10T10:08:35.358825+0000","last_became_peered":"2024-09-10T10:08:35.358825+0000","last_unstale":"2024-09-10T10:10:58.773597+0000","last_undegraded":"2024-09-10T10:10:58.773597+0000","last_fullsized":"2024-09-10T10:10:58.773597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:31.884533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778457+0000","last_change":"2024-09-10T10:08:35.378151+0000","last_active":"2024-09-10T10:10:58.778457+0000","last_peered":"2024-09-10T10:10:58.778457+0000","last_clean":"2024-09-10T10:10:58.778457+0000","last_became_active":"2024-09-10T10:08:35.377784+0000","last_became_peered":"2024-09-10T10:08:35.377784+0000","last_unstale":"2024-09-10T10:10:58.778457+0000","last_undegraded":"2024-09-10T10:10:58.778457+0000","last_fullsized":"2024-09-10T10:10:58.778457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.027310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762465+0000","last_change":"2024-09-10T10:08:35.364550+0000","last_active":"2024-09-10T10:10:58.762465+0000","last_peered":"2024-09-10T10:10:58.762465+0000","last_clean":"2024-09-10T10:10:58.762465+0000","last_became_active":"2024-09-10T10:08:35.364224+0000","last_became_peered":"2024-09-10T10:08:35.364224+0000","last_unstale":"2024-09-10T10:10:58.762465+0000","last_undegraded":"2024-09-10T10:10:58.762465+0000","last_fullsized":"2024-09-10T10:10:58.762465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:38.584494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.750237+0000","last_change":"2024-09-10T10:08:35.357333+0000","last_active":"2024-09-10T10:10:58.750237+0000","last_peered":"2024-09-10T10:10:58.750237+0000","last_clean":"2024-09-10T10:10:58.750237+0000","last_became_active":"2024-09-10T10:08:35.356940+0000","last_became_peered":"2024-09-10T10:08:35.356940+0000","last_unstale":"2024-09-10T10:10:58.750237+0000","last_undegraded":"2024-09-10T10:10:58.750237+0000","last_fullsized":"2024-09-10T10:10:58.750237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:40.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769367+0000","last_change":"2024-09-10T10:08:35.367208+0000","last_active":"2024-09-10T10:10:58.769367+0000","last_peered":"2024-09-10T10:10:58.769367+0000","last_clean":"2024-09-10T10:10:58.769367+0000","last_became_active":"2024-09-10T10:08:35.361942+0000","last_became_peered":"2024-09-10T10:08:35.361942+0000","last_unstale":"2024-09-10T10:10:58.769367+0000","last_undegraded":"2024-09-10T10:10:58.769367+0000","last_fullsized":"2024-09-10T10:10:58.769367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:19.030623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773220+0000","last_change":"2024-09-10T10:08:35.377164+0000","last_active":"2024-09-10T10:10:58.773220+0000","last_peered":"2024-09-10T10:10:58.773220+0000","last_clean":"2024-09-10T10:10:58.773220+0000","last_became_active":"2024-09-10T10:08:35.376457+0000","last_became_peered":"2024-09-10T10:08:35.376457+0000","last_unstale":"2024-09-10T10:10:58.773220+0000","last_undegraded":"2024-09-10T10:10:58.773220+0000","last_fullsized":"2024-09-10T10:10:58.773220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.291635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772661+0000","last_change":"2024-09-10T10:08:35.365096+0000","last_active":"2024-09-10T10:10:58.772661+0000","last_peered":"2024-09-10T10:10:58.772661+0000","last_clean":"2024-09-10T10:10:58.772661+0000","last_became_active":"2024-09-10T10:08:35.364780+0000","last_became_peered":"2024-09-10T10:08:35.364780+0000","last_unstale":"2024-09-10T10:10:58.772661+0000","last_undegraded":"2024-09-10T10:10:58.772661+0000","last_fullsized":"2024-09-10T10:10:58.772661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:30.177904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774627+0000","last_change":"2024-09-10T10:08:35.377017+0000","last_active":"2024-09-10T10:10:58.774627+0000","last_peered":"2024-09-10T10:10:58.774627+0000","last_clean":"2024-09-10T10:10:58.774627+0000","last_became_active":"2024-09-10T10:08:35.372243+0000","last_became_peered":"2024-09-10T10:08:35.372243+0000","last_unstale":"2024-09-10T10:10:58.774627+0000","last_undegraded":"2024-09-10T10:10:58.774627+0000","last_fullsized":"2024-09-10T10:10:58.774627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:26.105505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774291+0000","last_change":"2024-09-10T10:08:35.379782+0000","last_active":"2024-09-10T10:10:58.774291+0000","last_peered":"2024-09-10T10:10:58.774291+0000","last_clean":"2024-09-10T10:10:58.774291+0000","last_became_active":"2024-09-10T10:08:35.377109+0000","last_became_peered":"2024-09-10T10:08:35.377109+0000","last_unstale":"2024-09-10T10:10:58.774291+0000","last_undegraded":"2024-09-10T10:10:58.774291+0000","last_fullsized":"2024-09-10T10:10:58.774291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:10.761016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.764497+0000","last_change":"2024-09-10T10:08:35.364891+0000","last_active":"2024-09-10T10:10:58.764497+0000","last_peered":"2024-09-10T10:10:58.764497+0000","last_clean":"2024-09-10T10:10:58.764497+0000","last_became_active":"2024-09-10T10:08:35.363845+0000","last_became_peered":"2024-09-10T10:08:35.363845+0000","last_unstale":"2024-09-10T10:10:58.764497+0000","last_undegraded":"2024-09-10T10:10:58.764497+0000","last_fullsized":"2024-09-10T10:10:58.764497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:03.346994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766501+0000","last_change":"2024-09-10T10:08:35.363548+0000","last_active":"2024-09-10T10:10:58.766501+0000","last_peered":"2024-09-10T10:10:58.766501+0000","last_clean":"2024-09-10T10:10:58.766501+0000","last_became_active":"2024-09-10T10:08:35.363229+0000","last_became_peered":"2024-09-10T10:08:35.363229+0000","last_unstale":"2024-09-10T10:10:58.766501+0000","last_undegraded":"2024-09-10T10:10:58.766501+0000","last_fullsized":"2024-09-10T10:10:58.766501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:38.773445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773111+0000","last_change":"2024-09-10T10:08:35.360717+0000","last_active":"2024-09-10T10:10:58.773111+0000","last_peered":"2024-09-10T10:10:58.773111+0000","last_clean":"2024-09-10T10:10:58.773111+0000","last_became_active":"2024-09-10T10:08:35.360410+0000","last_became_peered":"2024-09-10T10:08:35.360410+0000","last_unstale":"2024-09-10T10:10:58.773111+0000","last_undegraded":"2024-09-10T10:10:58.773111+0000","last_fullsized":"2024-09-10T10:10:58.773111+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:59.322524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'16","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772823+0000","last_change":"2024-09-10T10:08:35.362359+0000","last_active":"2024-09-10T10:10:58.772823+0000","last_peered":"2024-09-10T10:10:58.772823+0000","last_clean":"2024-09-10T10:10:58.772823+0000","last_became_active":"2024-09-10T10:08:35.361580+0000","last_became_peered":"2024-09-10T10:08:35.361580+0000","last_unstale":"2024-09-10T10:10:58.772823+0000","last_undegraded":"2024-09-10T10:10:58.772823+0000","last_fullsized":"2024-09-10T10:10:58.772823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:23.265237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771033+0000","last_change":"2024-09-10T10:08:35.367305+0000","last_active":"2024-09-10T10:10:58.771033+0000","last_peered":"2024-09-10T10:10:58.771033+0000","last_clean":"2024-09-10T10:10:58.771033+0000","last_became_active":"2024-09-10T10:08:35.366936+0000","last_became_peered":"2024-09-10T10:08:35.366936+0000","last_unstale":"2024-09-10T10:10:58.771033+0000","last_undegraded":"2024-09-10T10:10:58.771033+0000","last_fullsized":"2024-09-10T10:10:58.771033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:28.158474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765168+0000","last_change":"2024-09-10T10:08:35.369983+0000","last_active":"2024-09-10T10:10:58.765168+0000","last_peered":"2024-09-10T10:10:58.765168+0000","last_clean":"2024-09-10T10:10:58.765168+0000","last_became_active":"2024-09-10T10:08:35.367662+0000","last_became_peered":"2024-09-10T10:08:35.367662+0000","last_unstale":"2024-09-10T10:10:58.765168+0000","last_undegraded":"2024-09-10T10:10:58.765168+0000","last_fullsized":"2024-09-10T10:10:58.765168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771023+0000","last_change":"2024-09-10T10:08:35.369237+0000","last_active":"2024-09-10T10:10:58.771023+0000","last_peered":"2024-09-10T10:10:58.771023+0000","last_clean":"2024-09-10T10:10:58.771023+0000","last_became_active":"2024-09-10T10:08:35.368903+0000","last_became_peered":"2024-09-10T10:08:35.368903+0000","last_unstale":"2024-09-10T10:10:58.771023+0000","last_undegraded":"2024-09-10T10:10:58.771023+0000","last_fullsized":"2024-09-10T10:10:58.771023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:05.150549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773489+0000","last_change":"2024-09-10T10:08:35.367284+0000","last_active":"2024-09-10T10:10:58.773489+0000","last_peered":"2024-09-10T10:10:58.773489+0000","last_clean":"2024-09-10T10:10:58.773489+0000","last_became_active":"2024-09-10T10:08:35.366969+0000","last_became_peered":"2024-09-10T10:08:35.366969+0000","last_unstale":"2024-09-10T10:10:58.773489+0000","last_undegraded":"2024-09-10T10:10:58.773489+0000","last_fullsized":"2024-09-10T10:10:58.773489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:16.949804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.749286+0000","last_change":"2024-09-10T10:08:35.374559+0000","last_active":"2024-09-10T10:10:58.749286+0000","last_peered":"2024-09-10T10:10:58.749286+0000","last_clean":"2024-09-10T10:10:58.749286+0000","last_became_active":"2024-09-10T10:08:35.374191+0000","last_became_peered":"2024-09-10T10:08:35.374191+0000","last_unstale":"2024-09-10T10:10:58.749286+0000","last_undegraded":"2024-09-10T10:10:58.749286+0000","last_fullsized":"2024-09-10T10:10:58.749286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:48.292249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.757757+0000","last_change":"2024-09-10T10:08:35.368042+0000","last_active":"2024-09-10T10:10:58.757757+0000","last_peered":"2024-09-10T10:10:58.757757+0000","last_clean":"2024-09-10T10:10:58.757757+0000","last_became_active":"2024-09-10T10:08:35.365985+0000","last_became_peered":"2024-09-10T10:08:35.365985+0000","last_unstale":"2024-09-10T10:10:58.757757+0000","last_undegraded":"2024-09-10T10:10:58.757757+0000","last_fullsized":"2024-09-10T10:10:58.757757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:04.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774113+0000","last_change":"2024-09-10T10:08:35.375826+0000","last_active":"2024-09-10T10:10:58.774113+0000","last_peered":"2024-09-10T10:10:58.774113+0000","last_clean":"2024-09-10T10:10:58.774113+0000","last_became_active":"2024-09-10T10:08:35.375485+0000","last_became_peered":"2024-09-10T10:08:35.375485+0000","last_unstale":"2024-09-10T10:10:58.774113+0000","last_undegraded":"2024-09-10T10:10:58.774113+0000","last_fullsized":"2024-09-10T10:10:58.774113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:49.146648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.763221+0000","last_change":"2024-09-10T10:08:35.375745+0000","last_active":"2024-09-10T10:10:58.763221+0000","last_peered":"2024-09-10T10:10:58.763221+0000","last_clean":"2024-09-10T10:10:58.763221+0000","last_became_active":"2024-09-10T10:08:35.375427+0000","last_became_peered":"2024-09-10T10:08:35.375427+0000","last_unstale":"2024-09-10T10:10:58.763221+0000","last_undegraded":"2024-09-10T10:10:58.763221+0000","last_fullsized":"2024-09-10T10:10:58.763221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:48.743434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771465+0000","last_change":"2024-09-10T10:08:35.377092+0000","last_active":"2024-09-10T10:10:58.771465+0000","last_peered":"2024-09-10T10:10:58.771465+0000","last_clean":"2024-09-10T10:10:58.771465+0000","last_became_active":"2024-09-10T10:08:35.376761+0000","last_became_peered":"2024-09-10T10:08:35.376761+0000","last_unstale":"2024-09-10T10:10:58.771465+0000","last_undegraded":"2024-09-10T10:10:58.771465+0000","last_fullsized":"2024-09-10T10:10:58.771465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:58.631742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67314,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":698,"num_read_kb":420,"num_write":182,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":201942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286200,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449135,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":538290,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678069,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712808,"statfs":{"total":95995035648,"available":95961915392,"internally_reserved":0,"allocated":1187840,"data_stored":1188706,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841594,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":542600,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070528,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":538402,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299460,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":1135010,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462987,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":533680,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724625,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1114112,"data_stored":1130064,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888149,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1048576,"data_stored":538864,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149786,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":533874,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411426,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1130496,"data_stored":598110,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1105920,"data_stored":596226,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738477,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":535068,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:11:21.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:11:21.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:21 smithi189 ceph-mon[34999]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:21.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:21 smithi084 ceph-mon[34812]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:21.732 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:22.184 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:22 smithi050 ceph-mon[30354]: pgmap v396: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T10:11:22.184 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:22 smithi050 ceph-mon[30354]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:22.184 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:22 smithi050 ceph-mon[30354]: from='client.25217 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:22.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.296+0000 7fae3d200640 1 -- 172.21.15.50:0/4216729898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae38106f10 msgr2=0x7fae3810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:22.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.296+0000 7fae3d200640 1 --2- 172.21.15.50:0/4216729898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae38106f10 0x7fae3810ea90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fae30009ca0 tx=0x7fae3002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:11:22.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.296+0000 7fae3d200640 1 -- 172.21.15.50:0/4216729898 shutdown_connections 2024-09-10T10:11:22.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.296+0000 7fae3d200640 1 --2- 172.21.15.50:0/4216729898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae38106f10 0x7fae3810ea90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:22.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.296+0000 7fae3d200640 1 --2- 172.21.15.50:0/4216729898 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae38102790 0x7fae381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:22.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.296+0000 7fae3d200640 1 --2- 172.21.15.50:0/4216729898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae38101de0 0x7fae381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:22.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.296+0000 7fae3d200640 1 -- 172.21.15.50:0/4216729898 >> 172.21.15.50:0/4216729898 conn(0x7fae380fd8c0 msgr2=0x7fae380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.296+0000 7fae3d200640 1 -- 172.21.15.50:0/4216729898 shutdown_connections 2024-09-10T10:11:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.297+0000 7fae3d200640 1 -- 172.21.15.50:0/4216729898 wait complete. 2024-09-10T10:11:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.298+0000 7fae3d200640 1 Processor -- start 2024-09-10T10:11:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.298+0000 7fae3d200640 1 -- start start 2024-09-10T10:11:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae3d200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae38101de0 0x7fae3819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae3d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae38102790 0x7fae3819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae3d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae38106f10 0x7fae3819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae3d200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fae38111f70 con 0x7fae38106f10 2024-09-10T10:11:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae3d200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fae38111df0 con 0x7fae38102790 2024-09-10T10:11:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae3d200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fae381120f0 con 0x7fae38101de0 2024-09-10T10:11:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae36800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae38106f10 0x7fae3819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae2d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae38102790 0x7fae3819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae35e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae38101de0 0x7fae3819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae2d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae38102790 0x7fae3819aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:42012/0 (socket says 172.21.15.50:42012) 2024-09-10T10:11:22.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae2d400640 1 -- 172.21.15.50:0/1458677291 learned_addr learned my addr 172.21.15.50:0/1458677291 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae35e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae38101de0 0x7fae3819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:52178/0 (socket says 172.21.15.50:52178) 2024-09-10T10:11:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae36800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae38106f10 0x7fae3819ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51194/0 (socket says 172.21.15.50:51194) 2024-09-10T10:11:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae2d400640 1 -- 172.21.15.50:0/1458677291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae38101de0 msgr2=0x7fae3819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae2d400640 1 --2- 172.21.15.50:0/1458677291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae38101de0 0x7fae3819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae2d400640 1 -- 172.21.15.50:0/1458677291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae38106f10 msgr2=0x7fae3819ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae2d400640 1 --2- 172.21.15.50:0/1458677291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae38106f10 0x7fae3819ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae2d400640 1 -- 172.21.15.50:0/1458677291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3819f560 con 0x7fae38102790 2024-09-10T10:11:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.299+0000 7fae36800640 1 --2- 172.21.15.50:0/1458677291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae38106f10 0x7fae3819ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.300+0000 7fae2d400640 1 --2- 172.21.15.50:0/1458677291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae38102790 0x7fae3819aaf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fae2000e9f0 tx=0x7fae2000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.300+0000 7fae2f400640 1 -- 172.21.15.50:0/1458677291 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2000cd80 con 0x7fae38102790 2024-09-10T10:11:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.300+0000 7fae2f400640 1 -- 172.21.15.50:0/1458677291 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae20010910 con 0x7fae38102790 2024-09-10T10:11:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.300+0000 7fae3d200640 1 -- 172.21.15.50:0/1458677291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3819f850 con 0x7fae38102790 2024-09-10T10:11:22.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.300+0000 7fae2f400640 1 -- 172.21.15.50:0/1458677291 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20018990 con 0x7fae38102790 2024-09-10T10:11:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.300+0000 7fae3d200640 1 -- 172.21.15.50:0/1458677291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae381a7130 con 0x7fae38102790 2024-09-10T10:11:22.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.301+0000 7fae3d200640 1 -- 172.21.15.50:0/1458677291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae381021c0 con 0x7fae38102790 2024-09-10T10:11:22.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.303+0000 7fae2f400640 1 -- 172.21.15.50:0/1458677291 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fae20010ac0 con 0x7fae38102790 2024-09-10T10:11:22.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.304+0000 7fae2f400640 1 --2- 172.21.15.50:0/1458677291 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fae1c0a2b80 0x7fae1c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:22.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.305+0000 7fae2f400640 1 -- 172.21.15.50:0/1458677291 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fae200cfc40 con 0x7fae38102790 2024-09-10T10:11:22.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.305+0000 7fae35e00640 1 --2- 172.21.15.50:0/1458677291 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fae1c0a2b80 0x7fae1c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:22.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.305+0000 7fae35e00640 1 --2- 172.21.15.50:0/1458677291 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fae1c0a2b80 0x7fae1c0a5040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fae28009bd0 tx=0x7fae28005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:22.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.306+0000 7fae2f400640 1 -- 172.21.15.50:0/1458677291 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae2009c160 con 0x7fae38102790 2024-09-10T10:11:22.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:22 smithi189 ceph-mon[34999]: pgmap v396: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T10:11:22.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:22 smithi189 ceph-mon[34999]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:22.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:22 smithi189 ceph-mon[34999]: from='client.25217 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:22 smithi084 ceph-mon[34812]: pgmap v396: 129 pgs: 129 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T10:11:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:22 smithi084 ceph-mon[34812]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:22 smithi084 ceph-mon[34812]: from='client.25217 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.531+0000 7fae3d200640 1 -- 172.21.15.50:0/1458677291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae381a7460 con 0x7fae38102790 2024-09-10T10:11:22.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.532+0000 7fae2f400640 1 -- 172.21.15.50:0/1458677291 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7fae200a0460 con 0x7fae38102790 2024-09-10T10:11:22.533 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:22.533 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:11:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:11:22.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.534+0000 7fae3d200640 1 -- 172.21.15.50:0/1458677291 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fae1c0a2b80 msgr2=0x7fae1c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:22.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.534+0000 7fae3d200640 1 --2- 172.21.15.50:0/1458677291 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fae1c0a2b80 0x7fae1c0a5040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fae28009bd0 tx=0x7fae28005f90 comp rx=0 tx=0).stop 2024-09-10T10:11:22.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.534+0000 7fae3d200640 1 -- 172.21.15.50:0/1458677291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae38102790 msgr2=0x7fae3819aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.534+0000 7fae3d200640 1 --2- 172.21.15.50:0/1458677291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae38102790 0x7fae3819aaf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fae2000e9f0 tx=0x7fae2000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:11:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.534+0000 7fae3d200640 1 -- 172.21.15.50:0/1458677291 shutdown_connections 2024-09-10T10:11:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.534+0000 7fae3d200640 1 --2- 172.21.15.50:0/1458677291 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fae1c0a2b80 0x7fae1c0a5040 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.534+0000 7fae3d200640 1 --2- 172.21.15.50:0/1458677291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae38106f10 0x7fae3819ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.534+0000 7fae3d200640 1 --2- 172.21.15.50:0/1458677291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae38102790 0x7fae3819aaf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.534+0000 7fae3d200640 1 --2- 172.21.15.50:0/1458677291 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae38101de0 0x7fae3819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.534+0000 7fae3d200640 1 -- 172.21.15.50:0/1458677291 >> 172.21.15.50:0/1458677291 conn(0x7fae380fd8c0 msgr2=0x7fae380fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.534+0000 7fae3d200640 1 -- 172.21.15.50:0/1458677291 shutdown_connections 2024-09-10T10:11:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:22.534+0000 7fae3d200640 1 -- 172.21.15.50:0/1458677291 wait complete. 2024-09-10T10:11:23.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:23 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1458677291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:23.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:23 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1458677291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:23.860 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:23 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1458677291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:23.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:11:24.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:24 smithi050 ceph-mon[30354]: pgmap v397: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T10:11:24.254 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:24.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:24 smithi189 ceph-mon[34999]: pgmap v397: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T10:11:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:24 smithi084 ceph-mon[34812]: pgmap v397: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T10:11:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.830+0000 7f1ea0e00640 1 -- 172.21.15.50:0/1731497726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9c1027a0 msgr2=0x7f1e9c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.830+0000 7f1ea0e00640 1 --2- 172.21.15.50:0/1731497726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9c1027a0 0x7f1e9c1067f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009900 tx=0x7f1e8402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:11:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.830+0000 7f1ea0e00640 1 -- 172.21.15.50:0/1731497726 shutdown_connections 2024-09-10T10:11:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.830+0000 7f1ea0e00640 1 --2- 172.21.15.50:0/1731497726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e9c106f20 0x7f1e9c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.830+0000 7f1ea0e00640 1 --2- 172.21.15.50:0/1731497726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9c1027a0 0x7f1e9c1067f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.830+0000 7f1ea0e00640 1 --2- 172.21.15.50:0/1731497726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c101df0 0x7f1e9c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.830+0000 7f1ea0e00640 1 -- 172.21.15.50:0/1731497726 >> 172.21.15.50:0/1731497726 conn(0x7f1e9c0fd8b0 msgr2=0x7f1e9c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.830+0000 7f1ea0e00640 1 -- 172.21.15.50:0/1731497726 shutdown_connections 2024-09-10T10:11:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.830+0000 7f1ea0e00640 1 -- 172.21.15.50:0/1731497726 wait complete. 2024-09-10T10:11:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.831+0000 7f1ea0e00640 1 Processor -- start 2024-09-10T10:11:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.831+0000 7f1ea0e00640 1 -- start start 2024-09-10T10:11:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.832+0000 7f1ea0e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9c101df0 0x7f1e9c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.832+0000 7f1ea0e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e9c1027a0 0x7f1e9c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.832+0000 7f1ea0e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c106f20 0x7f1e9c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.832+0000 7f1ea0e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c111f80 con 0x7f1e9c101df0 2024-09-10T10:11:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.832+0000 7f1ea0e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c111e00 con 0x7f1e9c1027a0 2024-09-10T10:11:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.832+0000 7f1ea0e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c112100 con 0x7f1e9c106f20 2024-09-10T10:11:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.832+0000 7f1e99e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9c101df0 0x7f1e9c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.832+0000 7f1e99e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9c101df0 0x7f1e9c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51218/0 (socket says 172.21.15.50:51218) 2024-09-10T10:11:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.832+0000 7f1e99e00640 1 -- 172.21.15.50:0/3865722966 learned_addr learned my addr 172.21.15.50:0/3865722966 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.832+0000 7f1e93e00640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e9c1027a0 0x7f1e9c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.832+0000 7f1e9a800640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c106f20 0x7f1e9c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.833+0000 7f1e99e00640 1 -- 172.21.15.50:0/3865722966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c106f20 msgr2=0x7f1e9c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.833+0000 7f1e99e00640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c106f20 0x7f1e9c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.833+0000 7f1e99e00640 1 -- 172.21.15.50:0/3865722966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e9c1027a0 msgr2=0x7f1e9c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.833+0000 7f1e99e00640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e9c1027a0 0x7f1e9c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.833+0000 7f1e99e00640 1 -- 172.21.15.50:0/3865722966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9c19f5d0 con 0x7f1e9c101df0 2024-09-10T10:11:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.833+0000 7f1e9a800640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c106f20 0x7f1e9c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:11:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.833+0000 7f1e99e00640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9c101df0 0x7f1e9c19a620 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00e9f0 tx=0x7f1e8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.833+0000 7f1e92a00640 1 -- 172.21.15.50:0/3865722966 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c00cd80 con 0x7f1e9c101df0 2024-09-10T10:11:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.833+0000 7f1e92a00640 1 -- 172.21.15.50:0/3865722966 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e8c010910 con 0x7f1e9c101df0 2024-09-10T10:11:24.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.833+0000 7f1e92a00640 1 -- 172.21.15.50:0/3865722966 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c018990 con 0x7f1e9c101df0 2024-09-10T10:11:24.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.833+0000 7f1ea0e00640 1 -- 172.21.15.50:0/3865722966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9c19f8c0 con 0x7f1e9c101df0 2024-09-10T10:11:24.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.833+0000 7f1ea0e00640 1 -- 172.21.15.50:0/3865722966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e9c1a71a0 con 0x7f1e9c101df0 2024-09-10T10:11:24.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.835+0000 7f1ea0e00640 1 -- 172.21.15.50:0/3865722966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e9c1021d0 con 0x7f1e9c101df0 2024-09-10T10:11:24.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.836+0000 7f1e92a00640 1 -- 172.21.15.50:0/3865722966 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1e8c010ac0 con 0x7f1e9c101df0 2024-09-10T10:11:24.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.838+0000 7f1e92a00640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e800a2c00 0x7f1e800a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:24.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.838+0000 7f1e92a00640 1 -- 172.21.15.50:0/3865722966 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f1e8c0cf750 con 0x7f1e9c101df0 2024-09-10T10:11:24.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.838+0000 7f1e93e00640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e800a2c00 0x7f1e800a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:24.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.839+0000 7f1e93e00640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e800a2c00 0x7f1e800a50c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009230 tx=0x7f1e840058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:24.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:24.842+0000 7f1e92a00640 1 -- 172.21.15.50:0/3865722966 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e8c09c2c0 con 0x7f1e9c101df0 2024-09-10T10:11:25.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.027+0000 7f1ea0e00640 1 -- 172.21.15.50:0/3865722966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e9c1a73a0 con 0x7f1e9c101df0 2024-09-10T10:11:25.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.029+0000 7f1e92a00640 1 -- 172.21.15.50:0/3865722966 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24775 (secure 0 0 0) 0x7f1e8c09bbc0 con 0x7f1e9c101df0 2024-09-10T10:11:25.031 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:25.031 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:10:00.717554+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:11:25.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.032+0000 7f1ea0e00640 1 -- 172.21.15.50:0/3865722966 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e800a2c00 msgr2=0x7f1e800a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:25.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.032+0000 7f1ea0e00640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e800a2c00 0x7f1e800a50c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009230 tx=0x7f1e840058d0 comp rx=0 tx=0).stop 2024-09-10T10:11:25.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.032+0000 7f1ea0e00640 1 -- 172.21.15.50:0/3865722966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9c101df0 msgr2=0x7f1e9c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.032+0000 7f1ea0e00640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9c101df0 0x7f1e9c19a620 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00e9f0 tx=0x7f1e8c00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:11:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.032+0000 7f1ea0e00640 1 -- 172.21.15.50:0/3865722966 shutdown_connections 2024-09-10T10:11:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.032+0000 7f1ea0e00640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e800a2c00 0x7f1e800a50c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.032+0000 7f1ea0e00640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e9c106f20 0x7f1e9c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.032+0000 7f1ea0e00640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e9c1027a0 0x7f1e9c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.032+0000 7f1ea0e00640 1 --2- 172.21.15.50:0/3865722966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9c101df0 0x7f1e9c19a620 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.032+0000 7f1ea0e00640 1 -- 172.21.15.50:0/3865722966 >> 172.21.15.50:0/3865722966 conn(0x7f1e9c0fd8b0 msgr2=0x7f1e9c0feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.032+0000 7f1ea0e00640 1 -- 172.21.15.50:0/3865722966 shutdown_connections 2024-09-10T10:11:25.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:25.032+0000 7f1ea0e00640 1 -- 172.21.15.50:0/3865722966 wait complete. 2024-09-10T10:11:25.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:25 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3865722966' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:11:25.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:25 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3865722966' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:11:25.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:25 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3865722966' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:11:25.856 DEBUG:tasks.fwd_scrub:Yielding 2024-09-10T10:11:25.856 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-10T10:11:25.871 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T10:11:25.871 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:11:25.871 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-10T10:11:25.872 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T10:11:25.872 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T10:11:26.265 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:26.265 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:26.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:26 smithi084 ceph-mon[34812]: pgmap v398: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T10:11:26.405 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:26 smithi050 ceph-mon[30354]: pgmap v398: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T10:11:26.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:26 smithi189 ceph-mon[34999]: pgmap v398: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T10:11:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.142+0000 7fad18a00640 1 -- 172.21.15.50:0/1437370027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad14074510 msgr2=0x7fad140748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.142+0000 7fad18a00640 1 --2- 172.21.15.50:0/1437370027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad14074510 0x7fad140748f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad04009860 tx=0x7fad0402a3d0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.143+0000 7fad18a00640 1 -- 172.21.15.50:0/1437370027 shutdown_connections 2024-09-10T10:11:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.143+0000 7fad18a00640 1 --2- 172.21.15.50:0/1437370027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad1410e280 0x7fad14110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.143+0000 7fad18a00640 1 --2- 172.21.15.50:0/1437370027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14074e30 0x7fad1410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.143+0000 7fad18a00640 1 --2- 172.21.15.50:0/1437370027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad14074510 0x7fad140748f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.143+0000 7fad18a00640 1 -- 172.21.15.50:0/1437370027 >> 172.21.15.50:0/1437370027 conn(0x7fad140fd740 msgr2=0x7fad140ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.143+0000 7fad18a00640 1 -- 172.21.15.50:0/1437370027 shutdown_connections 2024-09-10T10:11:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.143+0000 7fad18a00640 1 -- 172.21.15.50:0/1437370027 wait complete. 2024-09-10T10:11:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.144+0000 7fad18a00640 1 Processor -- start 2024-09-10T10:11:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.144+0000 7fad18a00640 1 -- start start 2024-09-10T10:11:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.144+0000 7fad18a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14074510 0x7fad1419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.144+0000 7fad18a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14074e30 0x7fad1419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad18a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad1410e280 0x7fad1419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad18a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fad14113fc0 con 0x7fad14074e30 2024-09-10T10:11:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad18a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fad14113e40 con 0x7fad1410e280 2024-09-10T10:11:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad18a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad14114140 con 0x7fad14074510 2024-09-10T10:11:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad11e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14074e30 0x7fad1419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad11e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14074e30 0x7fad1419a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59940/0 (socket says 172.21.15.50:59940) 2024-09-10T10:11:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad11e00640 1 -- 172.21.15.50:0/3884294105 learned_addr learned my addr 172.21.15.50:0/3884294105 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad12800640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14074510 0x7fad1419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad13200640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad1410e280 0x7fad1419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad13200640 1 -- 172.21.15.50:0/3884294105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14074510 msgr2=0x7fad1419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad13200640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14074510 0x7fad1419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad13200640 1 -- 172.21.15.50:0/3884294105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14074e30 msgr2=0x7fad1419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad13200640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14074e30 0x7fad1419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad13200640 1 -- 172.21.15.50:0/3884294105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1419f450 con 0x7fad1410e280 2024-09-10T10:11:27.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.145+0000 7fad11e00640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14074e30 0x7fad1419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:27.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.146+0000 7fad13200640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad1410e280 0x7fad1419ed70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fad0c005fd0 tx=0x7fad0c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:27.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.146+0000 7fad0b400640 1 -- 172.21.15.50:0/3884294105 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c00cdf0 con 0x7fad1410e280 2024-09-10T10:11:27.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.146+0000 7fad0b400640 1 -- 172.21.15.50:0/3884294105 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad0c005020 con 0x7fad1410e280 2024-09-10T10:11:27.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.146+0000 7fad18a00640 1 -- 172.21.15.50:0/3884294105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1419f740 con 0x7fad1410e280 2024-09-10T10:11:27.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.146+0000 7fad0b400640 1 -- 172.21.15.50:0/3884294105 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c0106d0 con 0x7fad1410e280 2024-09-10T10:11:27.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.146+0000 7fad18a00640 1 -- 172.21.15.50:0/3884294105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad141a7020 con 0x7fad1410e280 2024-09-10T10:11:27.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.149+0000 7fad0b400640 1 -- 172.21.15.50:0/3884294105 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fad0c0054d0 con 0x7fad1410e280 2024-09-10T10:11:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.151+0000 7fad0b400640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7facf80a2c00 0x7facf80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.151+0000 7fad1bec1740 1 Processor -- start 2024-09-10T10:11:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.151+0000 7fad12800640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7facf80a2c00 0x7facf80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.151+0000 7fad1bec1740 1 -- start start 2024-09-10T10:11:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.151+0000 7fad0b400640 1 -- 172.21.15.50:0/3884294105 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fad0c0cf9f0 con 0x7fad1410e280 2024-09-10T10:11:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.151+0000 7fad1bec1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477b8cb0 0x55ec477b9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.151+0000 7fad1bec1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477c3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.151+0000 7fad1bec1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477c3e90 0x55ec477c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad1bec1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ec4771f290 con 0x55ec477b8cb0 2024-09-10T10:11:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad1bec1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ec476c6b40 con 0x55ec477c3e90 2024-09-10T10:11:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad1bec1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ec4771b250 con 0x55ec477b95d0 2024-09-10T10:11:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad11e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad11e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477c3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:45460/0 (socket says 172.21.15.50:45460) 2024-09-10T10:11:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad11e00640 1 -- 172.21.15.50:0/1564773161 learned_addr learned my addr 172.21.15.50:0/1564773161 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad12800640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7facf80a2c00 0x7facf80a50c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fad0402a9c0 tx=0x7fad04005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad13200640 1 --2- 172.21.15.50:0/1564773161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477c3e90 0x55ec477c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad12800640 1 --2- 172.21.15.50:0/1564773161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477b8cb0 0x55ec477b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad11e00640 1 -- 172.21.15.50:0/1564773161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477c3e90 msgr2=0x55ec477c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:27.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad11e00640 1 --2- 172.21.15.50:0/1564773161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477c3e90 0x55ec477c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad11e00640 1 -- 172.21.15.50:0/1564773161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477b8cb0 msgr2=0x55ec477b9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad11e00640 1 --2- 172.21.15.50:0/1564773161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477b8cb0 0x55ec477b9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad11e00640 1 -- 172.21.15.50:0/1564773161 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec474906a0 con 0x55ec477b95d0 2024-09-10T10:11:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.152+0000 7fad12800640 1 --2- 172.21.15.50:0/1564773161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477b8cb0 0x55ec477b9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:11:27.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.153+0000 7fad11e00640 1 --2- 172.21.15.50:0/1564773161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477c3950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad000115f0 tx=0x7fad00009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72eb070efc8e7575 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:27.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.153+0000 7facff400640 1 -- 172.21.15.50:0/1564773161 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00005020 con 0x55ec477b95d0 2024-09-10T10:11:27.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.153+0000 7facff400640 1 -- 172.21.15.50:0/1564773161 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad000047a0 con 0x55ec477b95d0 2024-09-10T10:11:27.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.153+0000 7facff400640 1 -- 172.21.15.50:0/1564773161 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0000faa0 con 0x55ec477b95d0 2024-09-10T10:11:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.154+0000 7fad1bec1740 1 -- 172.21.15.50:0/1564773161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 msgr2=0x55ec477c3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.154+0000 7fad1bec1740 1 --2- 172.21.15.50:0/1564773161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477c3950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad000115f0 tx=0x7fad00009f90 comp rx=0 tx=0).stop 2024-09-10T10:11:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.154+0000 7fad1bec1740 1 -- 172.21.15.50:0/1564773161 shutdown_connections 2024-09-10T10:11:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.154+0000 7fad1bec1740 1 --2- 172.21.15.50:0/1564773161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477c3e90 0x55ec477c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.154+0000 7fad1bec1740 1 --2- 172.21.15.50:0/1564773161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477c3950 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.154+0000 7fad1bec1740 1 --2- 172.21.15.50:0/1564773161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477b8cb0 0x55ec477b9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.154+0000 7fad1bec1740 1 -- 172.21.15.50:0/1564773161 >> 172.21.15.50:0/1564773161 conn(0x55ec477b5240 msgr2=0x55ec477b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.154+0000 7fad1bec1740 1 -- 172.21.15.50:0/1564773161 shutdown_connections 2024-09-10T10:11:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.154+0000 7fad1bec1740 1 -- 172.21.15.50:0/1564773161 wait complete. 2024-09-10T10:11:27.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.155+0000 7fad1bec1740 1 -- start start 2024-09-10T10:11:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.155+0000 7fad1bec1740 1 Processor -- start 2024-09-10T10:11:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.155+0000 7fad1bec1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477b8cb0 0x55ec477c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.155+0000 7fad1bec1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.155+0000 7fad1bec1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477c3e90 0x55ec477c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.155+0000 7fad1bec1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ec477c6b00 con 0x55ec477c3e90 2024-09-10T10:11:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.155+0000 7fad1bec1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ec476d9fa0 con 0x55ec477b8cb0 2024-09-10T10:11:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.155+0000 7fad1bec1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ec477c6c80 con 0x55ec477b95d0 2024-09-10T10:11:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.155+0000 7fad1bec1740 10 client.0 _ll_register_callbacks cb 0x55ec4742dba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.156+0000 7fad11e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.156+0000 7fad11e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477c09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:45470/0 (socket says 172.21.15.50:45470) 2024-09-10T10:11:27.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.156+0000 7fad11e00640 1 -- 172.21.15.50:0/208613045 learned_addr learned my addr 172.21.15.50:0/208613045 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.156+0000 7fad13200640 1 --2- 172.21.15.50:0/208613045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477c3e90 0x55ec477c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.156+0000 7fad12800640 1 --2- 172.21.15.50:0/208613045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477b8cb0 0x55ec477c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.156+0000 7fad11e00640 1 -- 172.21.15.50:0/208613045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477b8cb0 msgr2=0x55ec477c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.156+0000 7fad11e00640 1 --2- 172.21.15.50:0/208613045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477b8cb0 0x55ec477c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.156+0000 7fad11e00640 1 -- 172.21.15.50:0/208613045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477c3e90 msgr2=0x55ec477c0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.156+0000 7fad11e00640 1 --2- 172.21.15.50:0/208613045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477c3e90 0x55ec477c0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.156+0000 7fad11e00640 1 -- 172.21.15.50:0/208613045 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec477c1720 con 0x55ec477b95d0 2024-09-10T10:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.157+0000 7fad11e00640 1 --2- 172.21.15.50:0/208613045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477c09e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad00009d10 tx=0x7fad0000ff90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a1bab0c1488eead server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:27.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.157+0000 7facf3e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.157+0000 7facf3e00640 1 -- 172.21.15.50:0/208613045 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00004030 con 0x55ec477b95d0 2024-09-10T10:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.157+0000 7facf3e00640 1 -- 172.21.15.50:0/208613045 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fad000041d0 con 0x55ec477b95d0 2024-09-10T10:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.157+0000 7fad1bec1740 1 -- 172.21.15.50:0/208613045 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad000047a0 con 0x55ec477b95d0 2024-09-10T10:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.157+0000 7facf3e00640 1 -- 172.21.15.50:0/208613045 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad00032050 con 0x55ec477b95d0 2024-09-10T10:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.157+0000 7fad1bec1740 10 client.25213 fetch_fsmap learned FSMap version 25 2024-09-10T10:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.157+0000 7fad1bec1740 1 -- 172.21.15.50:0/208613045 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ec477d2980 con 0x55ec477b95d0 2024-09-10T10:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.158+0000 7facf3e00640 1 -- 172.21.15.50:0/208613045 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad000047a0 con 0x55ec477b95d0 2024-09-10T10:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.158+0000 7facf3e00640 1 -- 172.21.15.50:0/208613045 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fad00003680 con 0x55ec477b95d0 2024-09-10T10:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.158+0000 7fad1bec1740 10 client.25213 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:11:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.158+0000 7fad1bec1740 10 client.25213 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:11:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.158+0000 7fad1bec1740 20 client.25213 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.158+0000 7fad1bec1740 1 --2- 172.21.15.50:0/208613045 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55ec477d3d90 0x55ec477d6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.158+0000 7fad1bec1740 4 client.25213 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:11:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.158+0000 7fad1bec1740 1 -- 172.21.15.50:0/208613045 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec4772c800 con 0x55ec477d3d90 2024-09-10T10:11:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.159+0000 7fad12800640 1 --2- 172.21.15.50:0/208613045 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55ec477d3d90 0x55ec477d6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.159+0000 7fad12800640 1 --2- 172.21.15.50:0/208613045 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55ec477d3d90 0x55ec477d6180 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fec517888008851 server_cookie=b918d830b7d25c38 in_seq=0 out_seq=0 2024-09-10T10:11:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.159+0000 7facf3e00640 10 client.25213 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.160+0000 7facf3e00640 1 -- 172.21.15.50:0/208613045 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec4772c800 con 0x55ec477d3d90 2024-09-10T10:11:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.160+0000 7facf3e00640 10 client.25213 handle_command_reply: tid=0 2024-09-10T10:11:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.160+0000 7fad1bec1740 1 client.25213 shutdown 2024-09-10T10:11:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.160+0000 7fad1bec1740 1 -- 172.21.15.50:0/208613045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 msgr2=0x55ec477c09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.160+0000 7fad1bec1740 1 --2- 172.21.15.50:0/208613045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477c09e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad00009d10 tx=0x7fad0000ff90 comp rx=0 tx=0).stop 2024-09-10T10:11:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.160+0000 7fad1bec1740 1 -- 172.21.15.50:0/208613045 shutdown_connections 2024-09-10T10:11:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.160+0000 7fad1bec1740 1 --2- 172.21.15.50:0/208613045 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55ec477d3d90 0x55ec477d6180 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.160+0000 7fad1bec1740 1 --2- 172.21.15.50:0/208613045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477c3e90 0x55ec477c0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.160+0000 7fad1bec1740 1 --2- 172.21.15.50:0/208613045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477c09e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.160+0000 7fad1bec1740 1 --2- 172.21.15.50:0/208613045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477b8cb0 0x55ec477c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.160+0000 7facf3e00640 0 client.25213 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.160+0000 7fad1bec1740 1 -- 172.21.15.50:0/208613045 >> 172.21.15.50:0/208613045 conn(0x55ec477b5240 msgr2=0x55ec477baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:27.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.161+0000 7fad1bec1740 1 -- 172.21.15.50:0/208613045 shutdown_connections 2024-09-10T10:11:27.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.161+0000 7fad1bec1740 1 -- 172.21.15.50:0/208613045 wait complete. 2024-09-10T10:11:27.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.161+0000 7fad1bec1740 20 client.25213 trim_cache size 0 max 16384 2024-09-10T10:11:27.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.179+0000 7fad1bec1740 1 Processor -- start 2024-09-10T10:11:27.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.179+0000 7fad1bec1740 1 -- start start 2024-09-10T10:11:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad1bec1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b8cb0 0x55ec477c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad1bec1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477b95d0 0x55ec477db910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad1bec1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477c3e90 0x55ec477dbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad1bec1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fad141b3620 con 0x55ec477b95d0 2024-09-10T10:11:27.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad1bec1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fad141b0ef0 con 0x55ec477c3e90 2024-09-10T10:11:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad1bec1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad141aed40 con 0x55ec477b8cb0 2024-09-10T10:11:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad11e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477b95d0 0x55ec477db910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad12800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b8cb0 0x55ec477c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad12800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b8cb0 0x55ec477c2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:45476/0 (socket says 172.21.15.50:45476) 2024-09-10T10:11:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad12800640 1 -- 172.21.15.50:0/3323617564 learned_addr learned my addr 172.21.15.50:0/3323617564 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:27.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad12800640 1 -- 172.21.15.50:0/3323617564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477c3e90 msgr2=0x55ec477dbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:27.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad12800640 1 --2- 172.21.15.50:0/3323617564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477c3e90 0x55ec477dbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad12800640 1 -- 172.21.15.50:0/3323617564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477b95d0 msgr2=0x55ec477db910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:27.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.180+0000 7fad12800640 1 --2- 172.21.15.50:0/3323617564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477b95d0 0x55ec477db910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.181+0000 7fad12800640 1 -- 172.21.15.50:0/3323617564 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec477bef30 con 0x55ec477b8cb0 2024-09-10T10:11:27.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.181+0000 7fad12800640 1 --2- 172.21.15.50:0/3323617564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b8cb0 0x55ec477c2950 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fad04009860 tx=0x7fad0403f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ac080717d60fb77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:27.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.181+0000 7facfea00640 1 -- 172.21.15.50:0/3323617564 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad040043c0 con 0x55ec477b8cb0 2024-09-10T10:11:27.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.181+0000 7facfea00640 1 -- 172.21.15.50:0/3323617564 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad04058070 con 0x55ec477b8cb0 2024-09-10T10:11:27.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.181+0000 7facfea00640 1 -- 172.21.15.50:0/3323617564 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04032410 con 0x55ec477b8cb0 2024-09-10T10:11:27.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.182+0000 7fad1bec1740 1 -- 172.21.15.50:0/3323617564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b8cb0 msgr2=0x55ec477c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.182+0000 7fad1bec1740 1 --2- 172.21.15.50:0/3323617564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b8cb0 0x55ec477c2950 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fad04009860 tx=0x7fad0403f000 comp rx=0 tx=0).stop 2024-09-10T10:11:27.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.182+0000 7fad1bec1740 1 -- 172.21.15.50:0/3323617564 shutdown_connections 2024-09-10T10:11:27.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.182+0000 7fad1bec1740 1 --2- 172.21.15.50:0/3323617564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477c3e90 0x55ec477dbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.182+0000 7fad1bec1740 1 --2- 172.21.15.50:0/3323617564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477b95d0 0x55ec477db910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.182+0000 7fad1bec1740 1 --2- 172.21.15.50:0/3323617564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b8cb0 0x55ec477c2950 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.182+0000 7fad1bec1740 1 -- 172.21.15.50:0/3323617564 >> 172.21.15.50:0/3323617564 conn(0x55ec477b5240 msgr2=0x55ec477c2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.182+0000 7fad1bec1740 1 -- 172.21.15.50:0/3323617564 shutdown_connections 2024-09-10T10:11:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.182+0000 7fad1bec1740 1 -- 172.21.15.50:0/3323617564 wait complete. 2024-09-10T10:11:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.183+0000 7fad1bec1740 1 -- start start 2024-09-10T10:11:27.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.183+0000 7fad1bec1740 1 Processor -- start 2024-09-10T10:11:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad1bec1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477b8cb0 0x55ec477cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad1bec1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad1bec1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477c3e90 0x55ec477bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad1bec1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fad141af3b0 con 0x55ec477c3e90 2024-09-10T10:11:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad1bec1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fad141b0820 con 0x55ec477b8cb0 2024-09-10T10:11:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad1bec1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad141afa80 con 0x55ec477b95d0 2024-09-10T10:11:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad1bec1740 10 client.0 _ll_register_callbacks cb 0x7fad0c098100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad11e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad12800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477b8cb0 0x55ec477cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad11e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477bd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:45486/0 (socket says 172.21.15.50:45486) 2024-09-10T10:11:27.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad11e00640 1 -- 172.21.15.50:0/3555748847 learned_addr learned my addr 172.21.15.50:0/3555748847 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad13200640 1 --2- 172.21.15.50:0/3555748847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477c3e90 0x55ec477bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad11e00640 1 -- 172.21.15.50:0/3555748847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477b8cb0 msgr2=0x55ec477cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad11e00640 1 --2- 172.21.15.50:0/3555748847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477b8cb0 0x55ec477cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad11e00640 1 -- 172.21.15.50:0/3555748847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477c3e90 msgr2=0x55ec477bdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad11e00640 1 --2- 172.21.15.50:0/3555748847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477c3e90 0x55ec477bdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.184+0000 7fad11e00640 1 -- 172.21.15.50:0/3555748847 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec477be3b0 con 0x55ec477b95d0 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.185+0000 7fad13200640 1 --2- 172.21.15.50:0/3555748847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477c3e90 0x55ec477bdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.185+0000 7fad11e00640 1 --2- 172.21.15.50:0/3555748847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477bd640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fad00001eb0 tx=0x7fad00003800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c2d17ff58526590 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.185+0000 7facf3e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.185+0000 7facf3e00640 1 -- 172.21.15.50:0/3555748847 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00011450 con 0x55ec477b95d0 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.185+0000 7facf3e00640 1 -- 172.21.15.50:0/3555748847 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fad00005030 con 0x55ec477b95d0 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.185+0000 7fad1bec1740 1 -- 172.21.15.50:0/3555748847 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad04058070 con 0x55ec477b95d0 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.185+0000 7facf3e00640 1 -- 172.21.15.50:0/3555748847 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad00009d40 con 0x55ec477b95d0 2024-09-10T10:11:27.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.186+0000 7fad1bec1740 10 client.25219 fetch_fsmap learned FSMap version 25 2024-09-10T10:11:27.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.186+0000 7fad1bec1740 1 -- 172.21.15.50:0/3555748847 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ec47847070 con 0x55ec477b95d0 2024-09-10T10:11:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.186+0000 7facf3e00640 1 -- 172.21.15.50:0/3555748847 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad04058070 con 0x55ec477b95d0 2024-09-10T10:11:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.186+0000 7facf3e00640 1 -- 172.21.15.50:0/3555748847 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fad00004b00 con 0x55ec477b95d0 2024-09-10T10:11:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.186+0000 7fad1bec1740 10 client.25219 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:11:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.186+0000 7fad1bec1740 10 client.25219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:11:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.186+0000 7fad1bec1740 20 client.25219 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.186+0000 7fad1bec1740 1 --2- 172.21.15.50:0/3555748847 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55ec478477b0 0x55ec47849bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.186+0000 7fad1bec1740 4 client.25219 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T10:11:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.186+0000 7fad1bec1740 1 -- 172.21.15.50:0/3555748847 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ec47726d10 con 0x55ec478477b0 2024-09-10T10:11:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.187+0000 7fad12800640 1 --2- 172.21.15.50:0/3555748847 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55ec478477b0 0x55ec47849bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.187+0000 7fad12800640 1 --2- 172.21.15.50:0/3555748847 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55ec478477b0 0x55ec47849bd0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=615fd18c2deee298 server_cookie=11121e8db4df9090 in_seq=0 out_seq=0 2024-09-10T10:11:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.187+0000 7facf3e00640 10 client.25219 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.188+0000 7facf3e00640 1 -- 172.21.15.50:0/3555748847 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ec47726d10 con 0x55ec478477b0 2024-09-10T10:11:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.188+0000 7facf3e00640 10 client.25219 handle_command_reply: tid=0 2024-09-10T10:11:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.188+0000 7fad1bec1740 1 client.25219 shutdown 2024-09-10T10:11:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.189+0000 7fad1bec1740 1 -- 172.21.15.50:0/3555748847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 msgr2=0x55ec477bd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.189+0000 7fad1bec1740 1 --2- 172.21.15.50:0/3555748847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477bd640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fad00001eb0 tx=0x7fad00003800 comp rx=0 tx=0).stop 2024-09-10T10:11:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.189+0000 7fad1bec1740 1 -- 172.21.15.50:0/3555748847 shutdown_connections 2024-09-10T10:11:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.189+0000 7fad1bec1740 1 --2- 172.21.15.50:0/3555748847 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55ec478477b0 0x55ec47849bd0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.189+0000 7fad1bec1740 1 --2- 172.21.15.50:0/3555748847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec477c3e90 0x55ec477bdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.189+0000 7fad1bec1740 1 --2- 172.21.15.50:0/3555748847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ec477b95d0 0x55ec477bd640 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.189+0000 7fad1bec1740 1 --2- 172.21.15.50:0/3555748847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ec477b8cb0 0x55ec477cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.189+0000 7fad1bec1740 1 -- 172.21.15.50:0/3555748847 >> 172.21.15.50:0/3555748847 conn(0x55ec477b5240 msgr2=0x55ec477c2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:27.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.189+0000 7facf3e00640 0 client.25219 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.189+0000 7fad1bec1740 1 -- 172.21.15.50:0/3555748847 shutdown_connections 2024-09-10T10:11:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.189+0000 7fad1bec1740 1 -- 172.21.15.50:0/3555748847 wait complete. 2024-09-10T10:11:27.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.189+0000 7fad1bec1740 20 client.25219 trim_cache size 0 max 16384 2024-09-10T10:11:27.193 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:11:27.193 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-10T10:11:27.193 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "5f603fda-5bcd-4c73-b04a-8a71aa2d5ba1", 2024-09-10T10:11:27.194 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-10T10:11:27.194 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:11:27.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.190+0000 7fad18a00640 1 -- 172.21.15.50:0/3884294105 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7facf80a2c00 msgr2=0x7facf80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.190+0000 7fad18a00640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7facf80a2c00 0x7facf80a50c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fad0402a9c0 tx=0x7fad04005c90 comp rx=0 tx=0).stop 2024-09-10T10:11:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.190+0000 7fad18a00640 1 -- 172.21.15.50:0/3884294105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad1410e280 msgr2=0x7fad1419ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.190+0000 7fad18a00640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad1410e280 0x7fad1419ed70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fad0c005fd0 tx=0x7fad0c00ef10 comp rx=0 tx=0).stop 2024-09-10T10:11:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.190+0000 7fad18a00640 1 -- 172.21.15.50:0/3884294105 shutdown_connections 2024-09-10T10:11:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.190+0000 7fad18a00640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7facf80a2c00 0x7facf80a50c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.190+0000 7fad18a00640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad1410e280 0x7fad1419ed70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.190+0000 7fad18a00640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad14074e30 0x7fad1419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.190+0000 7fad18a00640 1 --2- 172.21.15.50:0/3884294105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad14074510 0x7fad1419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.190+0000 7fad18a00640 1 -- 172.21.15.50:0/3884294105 >> 172.21.15.50:0/3884294105 conn(0x7fad140fd740 msgr2=0x7fad140fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.190+0000 7fad18a00640 1 -- 172.21.15.50:0/3884294105 shutdown_connections 2024-09-10T10:11:27.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.191+0000 7fad18a00640 1 -- 172.21.15.50:0/3884294105 wait complete. 2024-09-10T10:11:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.044+0000 7fe884c00640 1 -- 172.21.15.50:0/3592352817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe880108f60 msgr2=0x7fe880110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.044+0000 7fe884c00640 1 --2- 172.21.15.50:0/3592352817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe880108f60 0x7fe880110ae0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe878009ca0 tx=0x7fe87802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.044+0000 7fe884c00640 1 -- 172.21.15.50:0/3592352817 shutdown_connections 2024-09-10T10:11:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.044+0000 7fe884c00640 1 --2- 172.21.15.50:0/3592352817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe880108f60 0x7fe880110ae0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.044+0000 7fe884c00640 1 --2- 172.21.15.50:0/3592352817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8801047e0 0x7fe880108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.044+0000 7fe884c00640 1 --2- 172.21.15.50:0/3592352817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe880103e30 0x7fe880104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.044+0000 7fe884c00640 1 -- 172.21.15.50:0/3592352817 >> 172.21.15.50:0/3592352817 conn(0x7fe8800ff910 msgr2=0x7fe880101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:27.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.044+0000 7fe884c00640 1 -- 172.21.15.50:0/3592352817 shutdown_connections 2024-09-10T10:11:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.044+0000 7fe884c00640 1 -- 172.21.15.50:0/3592352817 wait complete. 2024-09-10T10:11:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.045+0000 7fe884c00640 1 Processor -- start 2024-09-10T10:11:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.045+0000 7fe884c00640 1 -- start start 2024-09-10T10:11:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe884c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe880103e30 0x7fe88019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe884c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8801047e0 0x7fe88019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe884c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe880108f60 0x7fe88019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe884c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe880113fc0 con 0x7fe880103e30 2024-09-10T10:11:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe884c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe880113e40 con 0x7fe880108f60 2024-09-10T10:11:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe884c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe880114140 con 0x7fe8801047e0 2024-09-10T10:11:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe87f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe880103e30 0x7fe88019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe87f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe880103e30 0x7fe88019a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59920/0 (socket says 172.21.15.50:59920) 2024-09-10T10:11:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe87f400640 1 -- 172.21.15.50:0/893056187 learned_addr learned my addr 172.21.15.50:0/893056187 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe877e00640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8801047e0 0x7fe88019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe87fe00640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe880108f60 0x7fe88019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe877e00640 1 -- 172.21.15.50:0/893056187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe880108f60 msgr2=0x7fe88019ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe877e00640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe880108f60 0x7fe88019ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe877e00640 1 -- 172.21.15.50:0/893056187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe880103e30 msgr2=0x7fe88019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe877e00640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe880103e30 0x7fe88019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe877e00640 1 -- 172.21.15.50:0/893056187 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88019f3b0 con 0x7fe8801047e0 2024-09-10T10:11:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.046+0000 7fe87f400640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe880103e30 0x7fe88019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.047+0000 7fe877e00640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8801047e0 0x7fe88019a940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe86800d6d0 tx=0x7fe86800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.047+0000 7fe87cc00640 1 -- 172.21.15.50:0/893056187 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868017070 con 0x7fe8801047e0 2024-09-10T10:11:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.047+0000 7fe884c00640 1 -- 172.21.15.50:0/893056187 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88019f6a0 con 0x7fe8801047e0 2024-09-10T10:11:27.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.047+0000 7fe87cc00640 1 -- 172.21.15.50:0/893056187 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe868009820 con 0x7fe8801047e0 2024-09-10T10:11:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.047+0000 7fe87cc00640 1 -- 172.21.15.50:0/893056187 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868004cd0 con 0x7fe8801047e0 2024-09-10T10:11:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.047+0000 7fe884c00640 1 -- 172.21.15.50:0/893056187 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8801a6f80 con 0x7fe8801047e0 2024-09-10T10:11:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.049+0000 7fe884c00640 1 -- 172.21.15.50:0/893056187 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe880105310 con 0x7fe8801047e0 2024-09-10T10:11:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.054+0000 7fe87cc00640 1 -- 172.21.15.50:0/893056187 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe8680099d0 con 0x7fe8801047e0 2024-09-10T10:11:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.055+0000 7fe87cc00640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe8640a2b80 0x7fe8640a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.055+0000 7fe87cc00640 1 -- 172.21.15.50:0/893056187 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe8680ceea0 con 0x7fe8801047e0 2024-09-10T10:11:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.055+0000 7fe87f400640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe8640a2b80 0x7fe8640a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.055+0000 7fe87cc00640 1 -- 172.21.15.50:0/893056187 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8680cf320 con 0x7fe8801047e0 2024-09-10T10:11:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.056+0000 7fe87f400640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe8640a2b80 0x7fe8640a5040 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe870011550 tx=0x7fe870005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:27.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.265+0000 7fe884c00640 1 -- 172.21.15.50:0/893056187 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe880062630 con 0x7fe8640a2b80 2024-09-10T10:11:27.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.274+0000 7fe87cc00640 1 -- 172.21.15.50:0/893056187 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340754 (secure 0 0 0) 0x7fe880062630 con 0x7fe8640a2b80 2024-09-10T10:11:27.282 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:27.284 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-10T10:11:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.279+0000 7fe884c00640 1 -- 172.21.15.50:0/893056187 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe8640a2b80 msgr2=0x7fe8640a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.279+0000 7fe884c00640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe8640a2b80 0x7fe8640a5040 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe870011550 tx=0x7fe870005f90 comp rx=0 tx=0).stop 2024-09-10T10:11:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.279+0000 7fe884c00640 1 -- 172.21.15.50:0/893056187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8801047e0 msgr2=0x7fe88019a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.279+0000 7fe884c00640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8801047e0 0x7fe88019a940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe86800d6d0 tx=0x7fe86800db90 comp rx=0 tx=0).stop 2024-09-10T10:11:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.280+0000 7fe884c00640 1 -- 172.21.15.50:0/893056187 shutdown_connections 2024-09-10T10:11:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.280+0000 7fe884c00640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe8640a2b80 0x7fe8640a5040 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.280+0000 7fe884c00640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe880108f60 0x7fe88019ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.280+0000 7fe884c00640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8801047e0 0x7fe88019a940 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.280+0000 7fe884c00640 1 --2- 172.21.15.50:0/893056187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe880103e30 0x7fe88019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:27.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.280+0000 7fe884c00640 1 -- 172.21.15.50:0/893056187 >> 172.21.15.50:0/893056187 conn(0x7fe8800ff910 msgr2=0x7fe880100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.281+0000 7fe884c00640 1 -- 172.21.15.50:0/893056187 shutdown_connections 2024-09-10T10:11:27.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:27.281+0000 7fe884c00640 1 -- 172.21.15.50:0/893056187 wait complete. 2024-09-10T10:11:28.152 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:11:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:28 smithi084 ceph-mon[34812]: pgmap v399: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T10:11:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:28 smithi084 ceph-mon[34812]: scrub queued for path: / 2024-09-10T10:11:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:28 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:11:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:28 smithi084 ceph-mon[34812]: scrub summary: active paths [/] 2024-09-10T10:11:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:28 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:11:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:28 smithi084 ceph-mon[34812]: from='client.25201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:28.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:28 smithi050 ceph-mon[30354]: pgmap v399: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T10:11:28.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:28 smithi050 ceph-mon[30354]: scrub queued for path: / 2024-09-10T10:11:28.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:28 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:11:28.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:28 smithi050 ceph-mon[30354]: scrub summary: active paths [/] 2024-09-10T10:11:28.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:28 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:11:28.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:28 smithi050 ceph-mon[30354]: from='client.25201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:28.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:28 smithi189 ceph-mon[34999]: pgmap v399: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T10:11:28.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:28 smithi189 ceph-mon[34999]: scrub queued for path: / 2024-09-10T10:11:28.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:28 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:11:28.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:28 smithi189 ceph-mon[34999]: scrub summary: active paths [/] 2024-09-10T10:11:28.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:28 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:11:28.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:28 smithi189 ceph-mon[34999]: from='client.25201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:28.948 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":399,"stamp":"2024-09-10T10:11:26.806825+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663289,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":870,"num_read_kb":560,"num_write":366,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":795,"ondisk_log_size":795,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366112,"kb_used_data":12704,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575712,"statfs":{"total":1151940427776,"available":1151565529088,"internally_reserved":0,"allocated":13008896,"data_stored":8425013,"data_compressed":498339,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5684,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":47,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003255"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724648+0000","last_change":"2024-09-10T10:08:32.889755+0000","last_active":"2024-09-10T10:10:00.724648+0000","last_peered":"2024-09-10T10:10:00.724648+0000","last_clean":"2024-09-10T10:10:00.724648+0000","last_became_active":"2024-09-10T10:08:32.889455+0000","last_became_peered":"2024-09-10T10:08:32.889455+0000","last_unstale":"2024-09-10T10:10:00.724648+0000","last_undegraded":"2024-09-10T10:10:00.724648+0000","last_fullsized":"2024-09-10T10:10:00.724648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:53.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"95'5","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.760977+0000","last_change":"2024-09-10T10:10:00.974216+0000","last_active":"2024-09-10T10:10:58.760977+0000","last_peered":"2024-09-10T10:10:58.760977+0000","last_clean":"2024-09-10T10:10:58.760977+0000","last_became_active":"2024-09-10T10:10:00.973841+0000","last_became_peered":"2024-09-10T10:10:00.973841+0000","last_unstale":"2024-09-10T10:10:58.760977+0000","last_undegraded":"2024-09-10T10:10:58.760977+0000","last_fullsized":"2024-09-10T10:10:58.760977+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:30.575610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972516+0000","last_change":"2024-09-10T10:08:44.399836+0000","last_active":"2024-09-10T10:10:00.972516+0000","last_peered":"2024-09-10T10:10:00.972516+0000","last_clean":"2024-09-10T10:10:00.972516+0000","last_became_active":"2024-09-10T10:08:44.399510+0000","last_became_peered":"2024-09-10T10:08:44.399510+0000","last_unstale":"2024-09-10T10:10:00.972516+0000","last_undegraded":"2024-09-10T10:10:00.972516+0000","last_fullsized":"2024-09-10T10:10:00.972516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:47.372690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722255+0000","last_change":"2024-09-10T10:08:32.887099+0000","last_active":"2024-09-10T10:10:00.722255+0000","last_peered":"2024-09-10T10:10:00.722255+0000","last_clean":"2024-09-10T10:10:00.722255+0000","last_became_active":"2024-09-10T10:08:32.886730+0000","last_became_peered":"2024-09-10T10:08:32.886730+0000","last_unstale":"2024-09-10T10:10:00.722255+0000","last_undegraded":"2024-09-10T10:10:00.722255+0000","last_fullsized":"2024-09-10T10:10:00.722255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.277241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.777729+0000","last_change":"2024-09-10T10:08:35.375494+0000","last_active":"2024-09-10T10:10:58.777729+0000","last_peered":"2024-09-10T10:10:58.777729+0000","last_clean":"2024-09-10T10:10:58.777729+0000","last_became_active":"2024-09-10T10:08:35.373991+0000","last_became_peered":"2024-09-10T10:08:35.373991+0000","last_unstale":"2024-09-10T10:10:58.777729+0000","last_undegraded":"2024-09-10T10:10:58.777729+0000","last_fullsized":"2024-09-10T10:10:58.777729+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:25.858163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721597+0000","last_change":"2024-09-10T10:09:00.457967+0000","last_active":"2024-09-10T10:10:00.721597+0000","last_peered":"2024-09-10T10:10:00.721597+0000","last_clean":"2024-09-10T10:10:00.721597+0000","last_became_active":"2024-09-10T10:09:00.457446+0000","last_became_peered":"2024-09-10T10:09:00.457446+0000","last_unstale":"2024-09-10T10:10:00.721597+0000","last_undegraded":"2024-09-10T10:10:00.721597+0000","last_fullsized":"2024-09-10T10:10:00.721597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:00.550304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722817+0000","last_change":"2024-09-10T10:08:32.890270+0000","last_active":"2024-09-10T10:10:00.722817+0000","last_peered":"2024-09-10T10:10:00.722817+0000","last_clean":"2024-09-10T10:10:00.722817+0000","last_became_active":"2024-09-10T10:08:32.889887+0000","last_became_peered":"2024-09-10T10:08:32.889887+0000","last_unstale":"2024-09-10T10:10:00.722817+0000","last_undegraded":"2024-09-10T10:10:00.722817+0000","last_fullsized":"2024-09-10T10:10:00.722817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:39.757510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774008+0000","last_change":"2024-09-10T10:08:35.357257+0000","last_active":"2024-09-10T10:10:58.774008+0000","last_peered":"2024-09-10T10:10:58.774008+0000","last_clean":"2024-09-10T10:10:58.774008+0000","last_became_active":"2024-09-10T10:08:35.356918+0000","last_became_peered":"2024-09-10T10:08:35.356918+0000","last_unstale":"2024-09-10T10:10:58.774008+0000","last_undegraded":"2024-09-10T10:10:58.774008+0000","last_fullsized":"2024-09-10T10:10:58.774008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:04.387581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722105+0000","last_change":"2024-09-10T10:09:00.487116+0000","last_active":"2024-09-10T10:10:00.722105+0000","last_peered":"2024-09-10T10:10:00.722105+0000","last_clean":"2024-09-10T10:10:00.722105+0000","last_became_active":"2024-09-10T10:09:00.486646+0000","last_became_peered":"2024-09-10T10:09:00.486646+0000","last_unstale":"2024-09-10T10:10:00.722105+0000","last_undegraded":"2024-09-10T10:10:00.722105+0000","last_fullsized":"2024-09-10T10:10:00.722105+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:40.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722877+0000","last_change":"2024-09-10T10:08:32.891399+0000","last_active":"2024-09-10T10:10:00.722877+0000","last_peered":"2024-09-10T10:10:00.722877+0000","last_clean":"2024-09-10T10:10:00.722877+0000","last_became_active":"2024-09-10T10:08:32.891022+0000","last_became_peered":"2024-09-10T10:08:32.891022+0000","last_unstale":"2024-09-10T10:10:00.722877+0000","last_undegraded":"2024-09-10T10:10:00.722877+0000","last_fullsized":"2024-09-10T10:10:00.722877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:30.842443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771765+0000","last_change":"2024-09-10T10:08:35.370630+0000","last_active":"2024-09-10T10:10:58.771765+0000","last_peered":"2024-09-10T10:10:58.771765+0000","last_clean":"2024-09-10T10:10:58.771765+0000","last_became_active":"2024-09-10T10:08:35.370263+0000","last_became_peered":"2024-09-10T10:08:35.370263+0000","last_unstale":"2024-09-10T10:10:58.771765+0000","last_undegraded":"2024-09-10T10:10:58.771765+0000","last_fullsized":"2024-09-10T10:10:58.771765+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:41.549815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721697+0000","last_change":"2024-09-10T10:08:44.405298+0000","last_active":"2024-09-10T10:10:00.721697+0000","last_peered":"2024-09-10T10:10:00.721697+0000","last_clean":"2024-09-10T10:10:00.721697+0000","last_became_active":"2024-09-10T10:08:44.405027+0000","last_became_peered":"2024-09-10T10:08:44.405027+0000","last_unstale":"2024-09-10T10:10:00.721697+0000","last_undegraded":"2024-09-10T10:10:00.721697+0000","last_fullsized":"2024-09-10T10:10:00.721697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:08.486563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776546+0000","last_change":"2024-09-10T10:08:35.369040+0000","last_active":"2024-09-10T10:10:58.776546+0000","last_peered":"2024-09-10T10:10:58.776546+0000","last_clean":"2024-09-10T10:10:58.776546+0000","last_became_active":"2024-09-10T10:08:35.368576+0000","last_became_peered":"2024-09-10T10:08:35.368576+0000","last_unstale":"2024-09-10T10:10:58.776546+0000","last_undegraded":"2024-09-10T10:10:58.776546+0000","last_fullsized":"2024-09-10T10:10:58.776546+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:44.887554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722399+0000","last_change":"2024-09-10T10:08:32.889549+0000","last_active":"2024-09-10T10:10:00.722399+0000","last_peered":"2024-09-10T10:10:00.722399+0000","last_clean":"2024-09-10T10:10:00.722399+0000","last_became_active":"2024-09-10T10:08:32.889197+0000","last_became_peered":"2024-09-10T10:08:32.889197+0000","last_unstale":"2024-09-10T10:10:00.722399+0000","last_undegraded":"2024-09-10T10:10:00.722399+0000","last_fullsized":"2024-09-10T10:10:00.722399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:53.697069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721966+0000","last_change":"2024-09-10T10:08:44.929048+0000","last_active":"2024-09-10T10:10:00.721966+0000","last_peered":"2024-09-10T10:10:00.721966+0000","last_clean":"2024-09-10T10:10:00.721966+0000","last_became_active":"2024-09-10T10:08:44.928345+0000","last_became_peered":"2024-09-10T10:08:44.928345+0000","last_unstale":"2024-09-10T10:10:00.721966+0000","last_undegraded":"2024-09-10T10:10:00.721966+0000","last_fullsized":"2024-09-10T10:10:00.721966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:23.121853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776712+0000","last_change":"2024-09-10T10:08:35.377385+0000","last_active":"2024-09-10T10:10:58.776712+0000","last_peered":"2024-09-10T10:10:58.776712+0000","last_clean":"2024-09-10T10:10:58.776712+0000","last_became_active":"2024-09-10T10:08:35.377092+0000","last_became_peered":"2024-09-10T10:08:35.377092+0000","last_unstale":"2024-09-10T10:10:58.776712+0000","last_undegraded":"2024-09-10T10:10:58.776712+0000","last_fullsized":"2024-09-10T10:10:58.776712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:23.169370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972319+0000","last_change":"2024-09-10T10:08:32.891614+0000","last_active":"2024-09-10T10:10:00.972319+0000","last_peered":"2024-09-10T10:10:00.972319+0000","last_clean":"2024-09-10T10:10:00.972319+0000","last_became_active":"2024-09-10T10:08:32.891141+0000","last_became_peered":"2024-09-10T10:08:32.891141+0000","last_unstale":"2024-09-10T10:10:00.972319+0000","last_undegraded":"2024-09-10T10:10:00.972319+0000","last_fullsized":"2024-09-10T10:10:00.972319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:20.258863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721932+0000","last_change":"2024-09-10T10:08:44.401125+0000","last_active":"2024-09-10T10:10:00.721932+0000","last_peered":"2024-09-10T10:10:00.721932+0000","last_clean":"2024-09-10T10:10:00.721932+0000","last_became_active":"2024-09-10T10:08:44.400483+0000","last_became_peered":"2024-09-10T10:08:44.400483+0000","last_unstale":"2024-09-10T10:10:00.721932+0000","last_undegraded":"2024-09-10T10:10:00.721932+0000","last_fullsized":"2024-09-10T10:10:00.721932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:12.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766815+0000","last_change":"2024-09-10T10:08:35.376806+0000","last_active":"2024-09-10T10:10:58.766815+0000","last_peered":"2024-09-10T10:10:58.766815+0000","last_clean":"2024-09-10T10:10:58.766815+0000","last_became_active":"2024-09-10T10:08:35.376400+0000","last_became_peered":"2024-09-10T10:08:35.376400+0000","last_unstale":"2024-09-10T10:10:58.766815+0000","last_undegraded":"2024-09-10T10:10:58.766815+0000","last_fullsized":"2024-09-10T10:10:58.766815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:48.303039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721567+0000","last_change":"2024-09-10T10:08:32.883881+0000","last_active":"2024-09-10T10:10:00.721567+0000","last_peered":"2024-09-10T10:10:00.721567+0000","last_clean":"2024-09-10T10:10:00.721567+0000","last_became_active":"2024-09-10T10:08:32.883540+0000","last_became_peered":"2024-09-10T10:08:32.883540+0000","last_unstale":"2024-09-10T10:10:00.721567+0000","last_undegraded":"2024-09-10T10:10:00.721567+0000","last_fullsized":"2024-09-10T10:10:00.721567+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:57.359729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724324+0000","last_change":"2024-09-10T10:08:44.401548+0000","last_active":"2024-09-10T10:10:00.724324+0000","last_peered":"2024-09-10T10:10:00.724324+0000","last_clean":"2024-09-10T10:10:00.724324+0000","last_became_active":"2024-09-10T10:08:44.401034+0000","last_became_peered":"2024-09-10T10:08:44.401034+0000","last_unstale":"2024-09-10T10:10:00.724324+0000","last_undegraded":"2024-09-10T10:10:00.724324+0000","last_fullsized":"2024-09-10T10:10:00.724324+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:17.292973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"95'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.760304+0000","last_change":"2024-09-10T10:08:35.359969+0000","last_active":"2024-09-10T10:10:58.760304+0000","last_peered":"2024-09-10T10:10:58.760304+0000","last_clean":"2024-09-10T10:10:58.760304+0000","last_became_active":"2024-09-10T10:08:35.359599+0000","last_became_peered":"2024-09-10T10:08:35.359599+0000","last_unstale":"2024-09-10T10:10:58.760304+0000","last_undegraded":"2024-09-10T10:10:58.760304+0000","last_fullsized":"2024-09-10T10:10:58.760304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:00.778269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862147+0000","last_change":"2024-09-10T10:09:00.487582+0000","last_active":"2024-09-10T10:10:00.862147+0000","last_peered":"2024-09-10T10:10:00.862147+0000","last_clean":"2024-09-10T10:10:00.862147+0000","last_became_active":"2024-09-10T10:09:00.487229+0000","last_became_peered":"2024-09-10T10:09:00.487229+0000","last_unstale":"2024-09-10T10:10:00.862147+0000","last_undegraded":"2024-09-10T10:10:00.862147+0000","last_fullsized":"2024-09-10T10:10:00.862147+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:53.341736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722077+0000","last_change":"2024-09-10T10:08:44.929224+0000","last_active":"2024-09-10T10:10:00.722077+0000","last_peered":"2024-09-10T10:10:00.722077+0000","last_clean":"2024-09-10T10:10:00.722077+0000","last_became_active":"2024-09-10T10:08:44.928640+0000","last_became_peered":"2024-09-10T10:08:44.928640+0000","last_unstale":"2024-09-10T10:10:00.722077+0000","last_undegraded":"2024-09-10T10:10:00.722077+0000","last_fullsized":"2024-09-10T10:10:00.722077+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:42.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778123+0000","last_change":"2024-09-10T10:08:35.376585+0000","last_active":"2024-09-10T10:10:58.778123+0000","last_peered":"2024-09-10T10:10:58.778123+0000","last_clean":"2024-09-10T10:10:58.778123+0000","last_became_active":"2024-09-10T10:08:35.375693+0000","last_became_peered":"2024-09-10T10:08:35.375693+0000","last_unstale":"2024-09-10T10:10:58.778123+0000","last_undegraded":"2024-09-10T10:10:58.778123+0000","last_fullsized":"2024-09-10T10:10:58.778123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:59.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722314+0000","last_change":"2024-09-10T10:08:32.884542+0000","last_active":"2024-09-10T10:10:00.722314+0000","last_peered":"2024-09-10T10:10:00.722314+0000","last_clean":"2024-09-10T10:10:00.722314+0000","last_became_active":"2024-09-10T10:08:32.884192+0000","last_became_peered":"2024-09-10T10:08:32.884192+0000","last_unstale":"2024-09-10T10:10:00.722314+0000","last_undegraded":"2024-09-10T10:10:00.722314+0000","last_fullsized":"2024-09-10T10:10:00.722314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:57.756641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972690+0000","last_change":"2024-09-10T10:08:44.391514+0000","last_active":"2024-09-10T10:10:00.972690+0000","last_peered":"2024-09-10T10:10:00.972690+0000","last_clean":"2024-09-10T10:10:00.972690+0000","last_became_active":"2024-09-10T10:08:44.391116+0000","last_became_peered":"2024-09-10T10:08:44.391116+0000","last_unstale":"2024-09-10T10:10:00.972690+0000","last_undegraded":"2024-09-10T10:10:00.972690+0000","last_fullsized":"2024-09-10T10:10:00.972690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:41.586014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.768916+0000","last_change":"2024-09-10T10:08:35.365604+0000","last_active":"2024-09-10T10:10:58.768916+0000","last_peered":"2024-09-10T10:10:58.768916+0000","last_clean":"2024-09-10T10:10:58.768916+0000","last_became_active":"2024-09-10T10:08:35.364915+0000","last_became_peered":"2024-09-10T10:08:35.364915+0000","last_unstale":"2024-09-10T10:10:58.768916+0000","last_undegraded":"2024-09-10T10:10:58.768916+0000","last_fullsized":"2024-09-10T10:10:58.768916+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:12.885021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'13","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:59.381750+0000","last_change":"2024-09-10T10:08:32.888223+0000","last_active":"2024-09-10T10:10:59.381750+0000","last_peered":"2024-09-10T10:10:59.381750+0000","last_clean":"2024-09-10T10:10:59.381750+0000","last_became_active":"2024-09-10T10:08:32.887919+0000","last_became_peered":"2024-09-10T10:08:32.887919+0000","last_unstale":"2024-09-10T10:10:59.381750+0000","last_undegraded":"2024-09-10T10:10:59.381750+0000","last_fullsized":"2024-09-10T10:10:59.381750+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:19.781337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721073+0000","last_change":"2024-09-10T10:08:44.929322+0000","last_active":"2024-09-10T10:10:00.721073+0000","last_peered":"2024-09-10T10:10:00.721073+0000","last_clean":"2024-09-10T10:10:00.721073+0000","last_became_active":"2024-09-10T10:08:44.928252+0000","last_became_peered":"2024-09-10T10:08:44.928252+0000","last_unstale":"2024-09-10T10:10:00.721073+0000","last_undegraded":"2024-09-10T10:10:00.721073+0000","last_fullsized":"2024-09-10T10:10:00.721073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:33.048265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762075+0000","last_change":"2024-09-10T10:08:35.364168+0000","last_active":"2024-09-10T10:10:58.762075+0000","last_peered":"2024-09-10T10:10:58.762075+0000","last_clean":"2024-09-10T10:10:58.762075+0000","last_became_active":"2024-09-10T10:08:35.363739+0000","last_became_peered":"2024-09-10T10:08:35.363739+0000","last_unstale":"2024-09-10T10:10:58.762075+0000","last_undegraded":"2024-09-10T10:10:58.762075+0000","last_fullsized":"2024-09-10T10:10:58.762075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:43.029409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722836+0000","last_change":"2024-09-10T10:08:32.893021+0000","last_active":"2024-09-10T10:10:00.722836+0000","last_peered":"2024-09-10T10:10:00.722836+0000","last_clean":"2024-09-10T10:10:00.722836+0000","last_became_active":"2024-09-10T10:08:32.892667+0000","last_became_peered":"2024-09-10T10:08:32.892667+0000","last_unstale":"2024-09-10T10:10:00.722836+0000","last_undegraded":"2024-09-10T10:10:00.722836+0000","last_fullsized":"2024-09-10T10:10:00.722836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:52.427489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185575+0000","last_change":"2024-09-10T10:08:44.393831+0000","last_active":"2024-09-10T10:10:01.185575+0000","last_peered":"2024-09-10T10:10:01.185575+0000","last_clean":"2024-09-10T10:10:01.185575+0000","last_became_active":"2024-09-10T10:08:44.393415+0000","last_became_peered":"2024-09-10T10:08:44.393415+0000","last_unstale":"2024-09-10T10:10:01.185575+0000","last_undegraded":"2024-09-10T10:10:01.185575+0000","last_fullsized":"2024-09-10T10:10:01.185575+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:52.171292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769530+0000","last_change":"2024-09-10T10:08:35.374787+0000","last_active":"2024-09-10T10:10:58.769530+0000","last_peered":"2024-09-10T10:10:58.769530+0000","last_clean":"2024-09-10T10:10:58.769530+0000","last_became_active":"2024-09-10T10:08:35.374549+0000","last_became_peered":"2024-09-10T10:08:35.374549+0000","last_unstale":"2024-09-10T10:10:58.769530+0000","last_undegraded":"2024-09-10T10:10:58.769530+0000","last_fullsized":"2024-09-10T10:10:58.769530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:58.925515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724437+0000","last_change":"2024-09-10T10:08:32.886267+0000","last_active":"2024-09-10T10:10:00.724437+0000","last_peered":"2024-09-10T10:10:00.724437+0000","last_clean":"2024-09-10T10:10:00.724437+0000","last_became_active":"2024-09-10T10:08:32.885869+0000","last_became_peered":"2024-09-10T10:08:32.885869+0000","last_unstale":"2024-09-10T10:10:00.724437+0000","last_undegraded":"2024-09-10T10:10:00.724437+0000","last_fullsized":"2024-09-10T10:10:00.724437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:06.784839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722243+0000","last_change":"2024-09-10T10:09:00.486656+0000","last_active":"2024-09-10T10:10:00.722243+0000","last_peered":"2024-09-10T10:10:00.722243+0000","last_clean":"2024-09-10T10:10:00.722243+0000","last_became_active":"2024-09-10T10:09:00.486072+0000","last_became_peered":"2024-09-10T10:09:00.486072+0000","last_unstale":"2024-09-10T10:10:00.722243+0000","last_undegraded":"2024-09-10T10:10:00.722243+0000","last_fullsized":"2024-09-10T10:10:00.722243+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:26.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767023+0000","last_change":"2024-09-10T10:08:35.366130+0000","last_active":"2024-09-10T10:10:58.767023+0000","last_peered":"2024-09-10T10:10:58.767023+0000","last_clean":"2024-09-10T10:10:58.767023+0000","last_became_active":"2024-09-10T10:08:35.365785+0000","last_became_peered":"2024-09-10T10:08:35.365785+0000","last_unstale":"2024-09-10T10:10:58.767023+0000","last_undegraded":"2024-09-10T10:10:58.767023+0000","last_fullsized":"2024-09-10T10:10:58.767023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:35.771767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184987+0000","last_change":"2024-09-10T10:08:32.884113+0000","last_active":"2024-09-10T10:10:01.184987+0000","last_peered":"2024-09-10T10:10:01.184987+0000","last_clean":"2024-09-10T10:10:01.184987+0000","last_became_active":"2024-09-10T10:08:32.883503+0000","last_became_peered":"2024-09-10T10:08:32.883503+0000","last_unstale":"2024-09-10T10:10:01.184987+0000","last_undegraded":"2024-09-10T10:10:01.184987+0000","last_fullsized":"2024-09-10T10:10:01.184987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:20.513465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040285+0000","last_change":"2024-09-10T10:08:44.400137+0000","last_active":"2024-09-10T10:10:01.040285+0000","last_peered":"2024-09-10T10:10:01.040285+0000","last_clean":"2024-09-10T10:10:01.040285+0000","last_became_active":"2024-09-10T10:08:44.398736+0000","last_became_peered":"2024-09-10T10:08:44.398736+0000","last_unstale":"2024-09-10T10:10:01.040285+0000","last_undegraded":"2024-09-10T10:10:01.040285+0000","last_fullsized":"2024-09-10T10:10:01.040285+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:48.922732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.756485+0000","last_change":"2024-09-10T10:08:35.360818+0000","last_active":"2024-09-10T10:10:58.756485+0000","last_peered":"2024-09-10T10:10:58.756485+0000","last_clean":"2024-09-10T10:10:58.756485+0000","last_became_active":"2024-09-10T10:08:35.360504+0000","last_became_peered":"2024-09-10T10:08:35.360504+0000","last_unstale":"2024-09-10T10:10:58.756485+0000","last_undegraded":"2024-09-10T10:10:58.756485+0000","last_fullsized":"2024-09-10T10:10:58.756485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:45.396069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"95'5","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:20.707700+0000","last_change":"2024-09-10T10:08:32.883915+0000","last_active":"2024-09-10T10:11:20.707700+0000","last_peered":"2024-09-10T10:11:20.707700+0000","last_clean":"2024-09-10T10:11:20.707700+0000","last_became_active":"2024-09-10T10:08:32.883573+0000","last_became_peered":"2024-09-10T10:08:32.883573+0000","last_unstale":"2024-09-10T10:11:20.707700+0000","last_undegraded":"2024-09-10T10:11:20.707700+0000","last_fullsized":"2024-09-10T10:11:20.707700+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:56.271267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040574+0000","last_change":"2024-09-10T10:08:44.928968+0000","last_active":"2024-09-10T10:10:01.040574+0000","last_peered":"2024-09-10T10:10:01.040574+0000","last_clean":"2024-09-10T10:10:01.040574+0000","last_became_active":"2024-09-10T10:08:44.928445+0000","last_became_peered":"2024-09-10T10:08:44.928445+0000","last_unstale":"2024-09-10T10:10:01.040574+0000","last_undegraded":"2024-09-10T10:10:01.040574+0000","last_fullsized":"2024-09-10T10:10:01.040574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:01.799454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.748248+0000","last_change":"2024-09-10T10:08:35.369027+0000","last_active":"2024-09-10T10:10:58.748248+0000","last_peered":"2024-09-10T10:10:58.748248+0000","last_clean":"2024-09-10T10:10:58.748248+0000","last_became_active":"2024-09-10T10:08:35.368692+0000","last_became_peered":"2024-09-10T10:08:35.368692+0000","last_unstale":"2024-09-10T10:10:58.748248+0000","last_undegraded":"2024-09-10T10:10:58.748248+0000","last_fullsized":"2024-09-10T10:10:58.748248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:09.500617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184814+0000","last_change":"2024-09-10T10:08:32.888661+0000","last_active":"2024-09-10T10:10:01.184814+0000","last_peered":"2024-09-10T10:10:01.184814+0000","last_clean":"2024-09-10T10:10:01.184814+0000","last_became_active":"2024-09-10T10:08:32.888312+0000","last_became_peered":"2024-09-10T10:08:32.888312+0000","last_unstale":"2024-09-10T10:10:01.184814+0000","last_undegraded":"2024-09-10T10:10:01.184814+0000","last_fullsized":"2024-09-10T10:10:01.184814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:47.293560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840405+0000","last_change":"2024-09-10T10:08:44.929512+0000","last_active":"2024-09-10T10:10:00.840405+0000","last_peered":"2024-09-10T10:10:00.840405+0000","last_clean":"2024-09-10T10:10:00.840405+0000","last_became_active":"2024-09-10T10:08:44.928992+0000","last_became_peered":"2024-09-10T10:08:44.928992+0000","last_unstale":"2024-09-10T10:10:00.840405+0000","last_undegraded":"2024-09-10T10:10:00.840405+0000","last_fullsized":"2024-09-10T10:10:00.840405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:31.827967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'8","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766202+0000","last_change":"2024-09-10T10:10:00.863430+0000","last_active":"2024-09-10T10:10:58.766202+0000","last_peered":"2024-09-10T10:10:58.766202+0000","last_clean":"2024-09-10T10:10:58.766202+0000","last_became_active":"2024-09-10T10:10:00.863082+0000","last_became_peered":"2024-09-10T10:10:00.863082+0000","last_unstale":"2024-09-10T10:10:58.766202+0000","last_undegraded":"2024-09-10T10:10:58.766202+0000","last_fullsized":"2024-09-10T10:10:58.766202+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:24.848797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722248+0000","last_change":"2024-09-10T10:08:32.885451+0000","last_active":"2024-09-10T10:10:00.722248+0000","last_peered":"2024-09-10T10:10:00.722248+0000","last_clean":"2024-09-10T10:10:00.722248+0000","last_became_active":"2024-09-10T10:08:32.885102+0000","last_became_peered":"2024-09-10T10:08:32.885102+0000","last_unstale":"2024-09-10T10:10:00.722248+0000","last_undegraded":"2024-09-10T10:10:00.722248+0000","last_fullsized":"2024-09-10T10:10:00.722248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:52.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":356,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185287+0000","last_change":"2024-09-10T10:07:13.661841+0000","last_active":"2024-09-10T10:10:01.185287+0000","last_peered":"2024-09-10T10:10:01.185287+0000","last_clean":"2024-09-10T10:10:01.185287+0000","last_became_active":"2024-09-10T10:07:13.661310+0000","last_became_peered":"2024-09-10T10:07:13.661310+0000","last_unstale":"2024-09-10T10:10:01.185287+0000","last_undegraded":"2024-09-10T10:10:01.185287+0000","last_fullsized":"2024-09-10T10:10:01.185287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_clean_scrub_stamp":"2024-09-10T10:03:29.327083+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:39.414636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185638+0000","last_change":"2024-09-10T10:08:44.391277+0000","last_active":"2024-09-10T10:10:01.185638+0000","last_peered":"2024-09-10T10:10:01.185638+0000","last_clean":"2024-09-10T10:10:01.185638+0000","last_became_active":"2024-09-10T10:08:44.390867+0000","last_became_peered":"2024-09-10T10:08:44.390867+0000","last_unstale":"2024-09-10T10:10:01.185638+0000","last_undegraded":"2024-09-10T10:10:01.185638+0000","last_fullsized":"2024-09-10T10:10:01.185638+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:23.299812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772994+0000","last_change":"2024-09-10T10:08:35.364750+0000","last_active":"2024-09-10T10:10:58.772994+0000","last_peered":"2024-09-10T10:10:58.772994+0000","last_clean":"2024-09-10T10:10:58.772994+0000","last_became_active":"2024-09-10T10:08:35.364034+0000","last_became_peered":"2024-09-10T10:08:35.364034+0000","last_unstale":"2024-09-10T10:10:58.772994+0000","last_undegraded":"2024-09-10T10:10:58.772994+0000","last_fullsized":"2024-09-10T10:10:58.772994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:15.296086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973375+0000","last_change":"2024-09-10T10:08:32.886884+0000","last_active":"2024-09-10T10:10:00.973375+0000","last_peered":"2024-09-10T10:10:00.973375+0000","last_clean":"2024-09-10T10:10:00.973375+0000","last_became_active":"2024-09-10T10:08:32.886544+0000","last_became_peered":"2024-09-10T10:08:32.886544+0000","last_unstale":"2024-09-10T10:10:00.973375+0000","last_undegraded":"2024-09-10T10:10:00.973375+0000","last_fullsized":"2024-09-10T10:10:00.973375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:30.511881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862240+0000","last_change":"2024-09-10T10:08:44.390761+0000","last_active":"2024-09-10T10:10:00.862240+0000","last_peered":"2024-09-10T10:10:00.862240+0000","last_clean":"2024-09-10T10:10:00.862240+0000","last_became_active":"2024-09-10T10:08:44.390190+0000","last_became_peered":"2024-09-10T10:08:44.390190+0000","last_unstale":"2024-09-10T10:10:00.862240+0000","last_undegraded":"2024-09-10T10:10:00.862240+0000","last_fullsized":"2024-09-10T10:10:00.862240+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:38.216171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767507+0000","last_change":"2024-09-10T10:08:35.362956+0000","last_active":"2024-09-10T10:10:58.767507+0000","last_peered":"2024-09-10T10:10:58.767507+0000","last_clean":"2024-09-10T10:10:58.767507+0000","last_became_active":"2024-09-10T10:08:35.362623+0000","last_became_peered":"2024-09-10T10:08:35.362623+0000","last_unstale":"2024-09-10T10:10:58.767507+0000","last_undegraded":"2024-09-10T10:10:58.767507+0000","last_fullsized":"2024-09-10T10:10:58.767507+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:50.162838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840553+0000","last_change":"2024-09-10T10:08:32.889741+0000","last_active":"2024-09-10T10:10:00.840553+0000","last_peered":"2024-09-10T10:10:00.840553+0000","last_clean":"2024-09-10T10:10:00.840553+0000","last_became_active":"2024-09-10T10:08:32.889394+0000","last_became_peered":"2024-09-10T10:08:32.889394+0000","last_unstale":"2024-09-10T10:10:00.840553+0000","last_undegraded":"2024-09-10T10:10:00.840553+0000","last_fullsized":"2024-09-10T10:10:00.840553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:16.845738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938314+0000","last_change":"2024-09-10T10:08:44.403781+0000","last_active":"2024-09-10T10:10:00.938314+0000","last_peered":"2024-09-10T10:10:00.938314+0000","last_clean":"2024-09-10T10:10:00.938314+0000","last_became_active":"2024-09-10T10:08:44.399601+0000","last_became_peered":"2024-09-10T10:08:44.399601+0000","last_unstale":"2024-09-10T10:10:00.938314+0000","last_undegraded":"2024-09-10T10:10:00.938314+0000","last_fullsized":"2024-09-10T10:10:00.938314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:45.587247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765508+0000","last_change":"2024-09-10T10:08:35.367825+0000","last_active":"2024-09-10T10:10:58.765508+0000","last_peered":"2024-09-10T10:10:58.765508+0000","last_clean":"2024-09-10T10:10:58.765508+0000","last_became_active":"2024-09-10T10:08:35.367511+0000","last_became_peered":"2024-09-10T10:08:35.367511+0000","last_unstale":"2024-09-10T10:10:58.765508+0000","last_undegraded":"2024-09-10T10:10:58.765508+0000","last_fullsized":"2024-09-10T10:10:58.765508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:03.356912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039782+0000","last_change":"2024-09-10T10:08:32.888524+0000","last_active":"2024-09-10T10:10:01.039782+0000","last_peered":"2024-09-10T10:10:01.039782+0000","last_clean":"2024-09-10T10:10:01.039782+0000","last_became_active":"2024-09-10T10:08:32.888148+0000","last_became_peered":"2024-09-10T10:08:32.888148+0000","last_unstale":"2024-09-10T10:10:01.039782+0000","last_undegraded":"2024-09-10T10:10:01.039782+0000","last_fullsized":"2024-09-10T10:10:01.039782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:34.342167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839577+0000","last_change":"2024-09-10T10:08:44.392952+0000","last_active":"2024-09-10T10:10:00.839577+0000","last_peered":"2024-09-10T10:10:00.839577+0000","last_clean":"2024-09-10T10:10:00.839577+0000","last_became_active":"2024-09-10T10:08:44.392476+0000","last_became_peered":"2024-09-10T10:08:44.392476+0000","last_unstale":"2024-09-10T10:10:00.839577+0000","last_undegraded":"2024-09-10T10:10:00.839577+0000","last_fullsized":"2024-09-10T10:10:00.839577+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:26.530305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761361+0000","last_change":"2024-09-10T10:08:35.364501+0000","last_active":"2024-09-10T10:10:58.761361+0000","last_peered":"2024-09-10T10:10:58.761361+0000","last_clean":"2024-09-10T10:10:58.761361+0000","last_became_active":"2024-09-10T10:08:35.364102+0000","last_became_peered":"2024-09-10T10:08:35.364102+0000","last_unstale":"2024-09-10T10:10:58.761361+0000","last_undegraded":"2024-09-10T10:10:58.761361+0000","last_fullsized":"2024-09-10T10:10:58.761361+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:42.743140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":22,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185891+0000","last_change":"2024-09-10T10:09:00.461639+0000","last_active":"2024-09-10T10:10:01.185891+0000","last_peered":"2024-09-10T10:10:01.185891+0000","last_clean":"2024-09-10T10:10:01.185891+0000","last_became_active":"2024-09-10T10:09:00.457246+0000","last_became_peered":"2024-09-10T10:09:00.457246+0000","last_unstale":"2024-09-10T10:10:01.185891+0000","last_undegraded":"2024-09-10T10:10:01.185891+0000","last_fullsized":"2024-09-10T10:10:01.185891+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:30.387035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840110+0000","last_change":"2024-09-10T10:08:44.401728+0000","last_active":"2024-09-10T10:10:00.840110+0000","last_peered":"2024-09-10T10:10:00.840110+0000","last_clean":"2024-09-10T10:10:00.840110+0000","last_became_active":"2024-09-10T10:08:44.401334+0000","last_became_peered":"2024-09-10T10:08:44.401334+0000","last_unstale":"2024-09-10T10:10:00.840110+0000","last_undegraded":"2024-09-10T10:10:00.840110+0000","last_fullsized":"2024-09-10T10:10:00.840110+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:57.496196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"95'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769526+0000","last_change":"2024-09-10T10:09:00.486353+0000","last_active":"2024-09-10T10:10:58.769526+0000","last_peered":"2024-09-10T10:10:58.769526+0000","last_clean":"2024-09-10T10:10:58.769526+0000","last_became_active":"2024-09-10T10:09:00.485938+0000","last_became_peered":"2024-09-10T10:09:00.485938+0000","last_unstale":"2024-09-10T10:10:58.769526+0000","last_undegraded":"2024-09-10T10:10:58.769526+0000","last_fullsized":"2024-09-10T10:10:58.769526+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:38.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722331+0000","last_change":"2024-09-10T10:08:32.893278+0000","last_active":"2024-09-10T10:10:00.722331+0000","last_peered":"2024-09-10T10:10:00.722331+0000","last_clean":"2024-09-10T10:10:00.722331+0000","last_became_active":"2024-09-10T10:08:32.892848+0000","last_became_peered":"2024-09-10T10:08:32.892848+0000","last_unstale":"2024-09-10T10:10:00.722331+0000","last_undegraded":"2024-09-10T10:10:00.722331+0000","last_fullsized":"2024-09-10T10:10:00.722331+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:09.336253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040465+0000","last_change":"2024-09-10T10:08:44.407213+0000","last_active":"2024-09-10T10:10:01.040465+0000","last_peered":"2024-09-10T10:10:01.040465+0000","last_clean":"2024-09-10T10:10:01.040465+0000","last_became_active":"2024-09-10T10:08:44.405198+0000","last_became_peered":"2024-09-10T10:08:44.405198+0000","last_unstale":"2024-09-10T10:10:01.040465+0000","last_undegraded":"2024-09-10T10:10:01.040465+0000","last_fullsized":"2024-09-10T10:10:01.040465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:15.921684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767621+0000","last_change":"2024-09-10T10:08:35.362683+0000","last_active":"2024-09-10T10:10:58.767621+0000","last_peered":"2024-09-10T10:10:58.767621+0000","last_clean":"2024-09-10T10:10:58.767621+0000","last_became_active":"2024-09-10T10:08:35.362353+0000","last_became_peered":"2024-09-10T10:08:35.362353+0000","last_unstale":"2024-09-10T10:10:58.767621+0000","last_undegraded":"2024-09-10T10:10:58.767621+0000","last_fullsized":"2024-09-10T10:10:58.767621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.489716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"95'5","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:23.713568+0000","last_change":"2024-09-10T10:08:32.881024+0000","last_active":"2024-09-10T10:11:23.713568+0000","last_peered":"2024-09-10T10:11:23.713568+0000","last_clean":"2024-09-10T10:11:23.713568+0000","last_became_active":"2024-09-10T10:08:32.880691+0000","last_became_peered":"2024-09-10T10:08:32.880691+0000","last_unstale":"2024-09-10T10:11:23.713568+0000","last_undegraded":"2024-09-10T10:11:23.713568+0000","last_fullsized":"2024-09-10T10:11:23.713568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:15.988063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724443+0000","last_change":"2024-09-10T10:08:44.400509+0000","last_active":"2024-09-10T10:10:00.724443+0000","last_peered":"2024-09-10T10:10:00.724443+0000","last_clean":"2024-09-10T10:10:00.724443+0000","last_became_active":"2024-09-10T10:08:44.400152+0000","last_became_peered":"2024-09-10T10:08:44.400152+0000","last_unstale":"2024-09-10T10:10:00.724443+0000","last_undegraded":"2024-09-10T10:10:00.724443+0000","last_fullsized":"2024-09-10T10:10:00.724443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:43.550208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.775766+0000","last_change":"2024-09-10T10:08:35.364208+0000","last_active":"2024-09-10T10:10:58.775766+0000","last_peered":"2024-09-10T10:10:58.775766+0000","last_clean":"2024-09-10T10:10:58.775766+0000","last_became_active":"2024-09-10T10:08:35.363751+0000","last_became_peered":"2024-09-10T10:08:35.363751+0000","last_unstale":"2024-09-10T10:10:58.775766+0000","last_undegraded":"2024-09-10T10:10:58.775766+0000","last_fullsized":"2024-09-10T10:10:58.775766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:21.791512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840204+0000","last_change":"2024-09-10T10:08:32.890611+0000","last_active":"2024-09-10T10:10:00.840204+0000","last_peered":"2024-09-10T10:10:00.840204+0000","last_clean":"2024-09-10T10:10:00.840204+0000","last_became_active":"2024-09-10T10:08:32.890296+0000","last_became_peered":"2024-09-10T10:08:32.890296+0000","last_unstale":"2024-09-10T10:10:00.840204+0000","last_undegraded":"2024-09-10T10:10:00.840204+0000","last_fullsized":"2024-09-10T10:10:00.840204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.977575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185624+0000","last_change":"2024-09-10T10:08:44.402607+0000","last_active":"2024-09-10T10:10:01.185624+0000","last_peered":"2024-09-10T10:10:01.185624+0000","last_clean":"2024-09-10T10:10:01.185624+0000","last_became_active":"2024-09-10T10:08:44.401623+0000","last_became_peered":"2024-09-10T10:08:44.401623+0000","last_unstale":"2024-09-10T10:10:01.185624+0000","last_undegraded":"2024-09-10T10:10:01.185624+0000","last_fullsized":"2024-09-10T10:10:01.185624+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:21.105349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.775534+0000","last_change":"2024-09-10T10:08:35.360642+0000","last_active":"2024-09-10T10:10:58.775534+0000","last_peered":"2024-09-10T10:10:58.775534+0000","last_clean":"2024-09-10T10:10:58.775534+0000","last_became_active":"2024-09-10T10:08:35.356667+0000","last_became_peered":"2024-09-10T10:08:35.356667+0000","last_unstale":"2024-09-10T10:10:58.775534+0000","last_undegraded":"2024-09-10T10:10:58.775534+0000","last_fullsized":"2024-09-10T10:10:58.775534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:08.404973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972507+0000","last_change":"2024-09-10T10:08:32.890418+0000","last_active":"2024-09-10T10:10:00.972507+0000","last_peered":"2024-09-10T10:10:00.972507+0000","last_clean":"2024-09-10T10:10:00.972507+0000","last_became_active":"2024-09-10T10:08:32.890081+0000","last_became_peered":"2024-09-10T10:08:32.890081+0000","last_unstale":"2024-09-10T10:10:00.972507+0000","last_undegraded":"2024-09-10T10:10:00.972507+0000","last_fullsized":"2024-09-10T10:10:00.972507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:52.839714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840379+0000","last_change":"2024-09-10T10:08:44.401322+0000","last_active":"2024-09-10T10:10:00.840379+0000","last_peered":"2024-09-10T10:10:00.840379+0000","last_clean":"2024-09-10T10:10:00.840379+0000","last_became_active":"2024-09-10T10:08:44.400906+0000","last_became_peered":"2024-09-10T10:08:44.400906+0000","last_unstale":"2024-09-10T10:10:00.840379+0000","last_undegraded":"2024-09-10T10:10:00.840379+0000","last_fullsized":"2024-09-10T10:10:00.840379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:08.616288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761674+0000","last_change":"2024-09-10T10:08:35.366580+0000","last_active":"2024-09-10T10:10:58.761674+0000","last_peered":"2024-09-10T10:10:58.761674+0000","last_clean":"2024-09-10T10:10:58.761674+0000","last_became_active":"2024-09-10T10:08:35.365943+0000","last_became_peered":"2024-09-10T10:08:35.365943+0000","last_unstale":"2024-09-10T10:10:58.761674+0000","last_undegraded":"2024-09-10T10:10:58.761674+0000","last_fullsized":"2024-09-10T10:10:58.761674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:58.351517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"95'39","reported_seq":331,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:25.715668+0000","last_change":"2024-09-10T10:08:32.888411+0000","last_active":"2024-09-10T10:11:25.715668+0000","last_peered":"2024-09-10T10:11:25.715668+0000","last_clean":"2024-09-10T10:11:25.715668+0000","last_became_active":"2024-09-10T10:08:32.888093+0000","last_became_peered":"2024-09-10T10:08:32.888093+0000","last_unstale":"2024-09-10T10:11:25.715668+0000","last_undegraded":"2024-09-10T10:11:25.715668+0000","last_fullsized":"2024-09-10T10:11:25.715668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.532868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68009,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":251,"num_read_kb":193,"num_write":40,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724453+0000","last_change":"2024-09-10T10:08:44.400432+0000","last_active":"2024-09-10T10:10:00.724453+0000","last_peered":"2024-09-10T10:10:00.724453+0000","last_clean":"2024-09-10T10:10:00.724453+0000","last_became_active":"2024-09-10T10:08:44.399981+0000","last_became_peered":"2024-09-10T10:08:44.399981+0000","last_unstale":"2024-09-10T10:10:00.724453+0000","last_undegraded":"2024-09-10T10:10:00.724453+0000","last_fullsized":"2024-09-10T10:10:00.724453+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:57.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"95'11","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765617+0000","last_change":"2024-09-10T10:09:00.460848+0000","last_active":"2024-09-10T10:10:58.765617+0000","last_peered":"2024-09-10T10:10:58.765617+0000","last_clean":"2024-09-10T10:10:58.765617+0000","last_became_active":"2024-09-10T10:09:00.460459+0000","last_became_peered":"2024-09-10T10:09:00.460459+0000","last_unstale":"2024-09-10T10:10:58.765617+0000","last_undegraded":"2024-09-10T10:10:58.765617+0000","last_fullsized":"2024-09-10T10:10:58.765617+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:06.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840557+0000","last_change":"2024-09-10T10:08:32.885909+0000","last_active":"2024-09-10T10:10:00.840557+0000","last_peered":"2024-09-10T10:10:00.840557+0000","last_clean":"2024-09-10T10:10:00.840557+0000","last_became_active":"2024-09-10T10:08:32.885512+0000","last_became_peered":"2024-09-10T10:08:32.885512+0000","last_unstale":"2024-09-10T10:10:00.840557+0000","last_undegraded":"2024-09-10T10:10:00.840557+0000","last_fullsized":"2024-09-10T10:10:00.840557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:44.850772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721902+0000","last_change":"2024-09-10T10:08:44.400323+0000","last_active":"2024-09-10T10:10:00.721902+0000","last_peered":"2024-09-10T10:10:00.721902+0000","last_clean":"2024-09-10T10:10:00.721902+0000","last_became_active":"2024-09-10T10:08:44.399923+0000","last_became_peered":"2024-09-10T10:08:44.399923+0000","last_unstale":"2024-09-10T10:10:00.721902+0000","last_undegraded":"2024-09-10T10:10:00.721902+0000","last_fullsized":"2024-09-10T10:10:00.721902+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:45.496392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771495+0000","last_change":"2024-09-10T10:08:35.375543+0000","last_active":"2024-09-10T10:10:58.771495+0000","last_peered":"2024-09-10T10:10:58.771495+0000","last_clean":"2024-09-10T10:10:58.771495+0000","last_became_active":"2024-09-10T10:08:35.374312+0000","last_became_peered":"2024-09-10T10:08:35.374312+0000","last_unstale":"2024-09-10T10:10:58.771495+0000","last_undegraded":"2024-09-10T10:10:58.771495+0000","last_fullsized":"2024-09-10T10:10:58.771495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:34.208716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184909+0000","last_change":"2024-09-10T10:08:32.888540+0000","last_active":"2024-09-10T10:10:01.184909+0000","last_peered":"2024-09-10T10:10:01.184909+0000","last_clean":"2024-09-10T10:10:01.184909+0000","last_became_active":"2024-09-10T10:08:32.888187+0000","last_became_peered":"2024-09-10T10:08:32.888187+0000","last_unstale":"2024-09-10T10:10:01.184909+0000","last_undegraded":"2024-09-10T10:10:01.184909+0000","last_fullsized":"2024-09-10T10:10:01.184909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:06.694533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.723713+0000","last_change":"2024-09-10T10:08:44.397995+0000","last_active":"2024-09-10T10:10:00.723713+0000","last_peered":"2024-09-10T10:10:00.723713+0000","last_clean":"2024-09-10T10:10:00.723713+0000","last_became_active":"2024-09-10T10:08:44.397583+0000","last_became_peered":"2024-09-10T10:08:44.397583+0000","last_unstale":"2024-09-10T10:10:00.723713+0000","last_undegraded":"2024-09-10T10:10:00.723713+0000","last_fullsized":"2024-09-10T10:10:00.723713+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:03.908014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773846+0000","last_change":"2024-09-10T10:08:35.361053+0000","last_active":"2024-09-10T10:10:58.773846+0000","last_peered":"2024-09-10T10:10:58.773846+0000","last_clean":"2024-09-10T10:10:58.773846+0000","last_became_active":"2024-09-10T10:08:35.360736+0000","last_became_peered":"2024-09-10T10:08:35.360736+0000","last_unstale":"2024-09-10T10:10:58.773846+0000","last_undegraded":"2024-09-10T10:10:58.773846+0000","last_fullsized":"2024-09-10T10:10:58.773846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:45.435384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"95'4","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:24.714269+0000","last_change":"2024-09-10T10:08:32.885067+0000","last_active":"2024-09-10T10:11:24.714269+0000","last_peered":"2024-09-10T10:11:24.714269+0000","last_clean":"2024-09-10T10:11:24.714269+0000","last_became_active":"2024-09-10T10:08:32.884676+0000","last_became_peered":"2024-09-10T10:08:32.884676+0000","last_unstale":"2024-09-10T10:11:24.714269+0000","last_undegraded":"2024-09-10T10:11:24.714269+0000","last_fullsized":"2024-09-10T10:11:24.714269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.667680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721235+0000","last_change":"2024-09-10T10:08:44.395892+0000","last_active":"2024-09-10T10:10:00.721235+0000","last_peered":"2024-09-10T10:10:00.721235+0000","last_clean":"2024-09-10T10:10:00.721235+0000","last_became_active":"2024-09-10T10:08:44.395188+0000","last_became_peered":"2024-09-10T10:08:44.395188+0000","last_unstale":"2024-09-10T10:10:00.721235+0000","last_undegraded":"2024-09-10T10:10:00.721235+0000","last_fullsized":"2024-09-10T10:10:00.721235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:27.562053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.939198+0000","last_change":"2024-09-10T10:08:44.403185+0000","last_active":"2024-09-10T10:10:00.939198+0000","last_peered":"2024-09-10T10:10:00.939198+0000","last_clean":"2024-09-10T10:10:00.939198+0000","last_became_active":"2024-09-10T10:08:44.399943+0000","last_became_peered":"2024-09-10T10:08:44.399943+0000","last_unstale":"2024-09-10T10:10:00.939198+0000","last_undegraded":"2024-09-10T10:10:00.939198+0000","last_fullsized":"2024-09-10T10:10:00.939198+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:07.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.770162+0000","last_change":"2024-09-10T10:08:35.367552+0000","last_active":"2024-09-10T10:10:58.770162+0000","last_peered":"2024-09-10T10:10:58.770162+0000","last_clean":"2024-09-10T10:10:58.770162+0000","last_became_active":"2024-09-10T10:08:35.367215+0000","last_became_peered":"2024-09-10T10:08:35.367215+0000","last_unstale":"2024-09-10T10:10:58.770162+0000","last_undegraded":"2024-09-10T10:10:58.770162+0000","last_fullsized":"2024-09-10T10:10:58.770162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:28.756769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840019+0000","last_change":"2024-09-10T10:08:32.885830+0000","last_active":"2024-09-10T10:10:00.840019+0000","last_peered":"2024-09-10T10:10:00.840019+0000","last_clean":"2024-09-10T10:10:00.840019+0000","last_became_active":"2024-09-10T10:08:32.885465+0000","last_became_peered":"2024-09-10T10:08:32.885465+0000","last_unstale":"2024-09-10T10:10:00.840019+0000","last_undegraded":"2024-09-10T10:10:00.840019+0000","last_fullsized":"2024-09-10T10:10:00.840019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:55.101364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185761+0000","last_change":"2024-09-10T10:09:00.487666+0000","last_active":"2024-09-10T10:10:01.185761+0000","last_peered":"2024-09-10T10:10:01.185761+0000","last_clean":"2024-09-10T10:10:01.185761+0000","last_became_active":"2024-09-10T10:09:00.487110+0000","last_became_peered":"2024-09-10T10:09:00.487110+0000","last_unstale":"2024-09-10T10:10:01.185761+0000","last_undegraded":"2024-09-10T10:10:01.185761+0000","last_fullsized":"2024-09-10T10:10:01.185761+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:28.817826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755501+0000","last_change":"2024-09-10T10:08:35.356247+0000","last_active":"2024-09-10T10:10:58.755501+0000","last_peered":"2024-09-10T10:10:58.755501+0000","last_clean":"2024-09-10T10:10:58.755501+0000","last_became_active":"2024-09-10T10:08:35.355953+0000","last_became_peered":"2024-09-10T10:08:35.355953+0000","last_unstale":"2024-09-10T10:10:58.755501+0000","last_undegraded":"2024-09-10T10:10:58.755501+0000","last_fullsized":"2024-09-10T10:10:58.755501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:24.625382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039784+0000","last_change":"2024-09-10T10:08:32.882151+0000","last_active":"2024-09-10T10:10:01.039784+0000","last_peered":"2024-09-10T10:10:01.039784+0000","last_clean":"2024-09-10T10:10:01.039784+0000","last_became_active":"2024-09-10T10:08:32.881688+0000","last_became_peered":"2024-09-10T10:08:32.881688+0000","last_unstale":"2024-09-10T10:10:01.039784+0000","last_undegraded":"2024-09-10T10:10:01.039784+0000","last_fullsized":"2024-09-10T10:10:01.039784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:49.186299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.109676+0000","last_change":"2024-09-10T10:08:32.887018+0000","last_active":"2024-09-10T10:10:01.109676+0000","last_peered":"2024-09-10T10:10:01.109676+0000","last_clean":"2024-09-10T10:10:01.109676+0000","last_became_active":"2024-09-10T10:08:32.886636+0000","last_became_peered":"2024-09-10T10:08:32.886636+0000","last_unstale":"2024-09-10T10:10:01.109676+0000","last_undegraded":"2024-09-10T10:10:01.109676+0000","last_fullsized":"2024-09-10T10:10:01.109676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:24.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762425+0000","last_change":"2024-09-10T10:08:35.363803+0000","last_active":"2024-09-10T10:10:58.762425+0000","last_peered":"2024-09-10T10:10:58.762425+0000","last_clean":"2024-09-10T10:10:58.762425+0000","last_became_active":"2024-09-10T10:08:35.363442+0000","last_became_peered":"2024-09-10T10:08:35.363442+0000","last_unstale":"2024-09-10T10:10:58.762425+0000","last_undegraded":"2024-09-10T10:10:58.762425+0000","last_fullsized":"2024-09-10T10:10:58.762425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:59.045347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972949+0000","last_change":"2024-09-10T10:08:44.403970+0000","last_active":"2024-09-10T10:10:00.972949+0000","last_peered":"2024-09-10T10:10:00.972949+0000","last_clean":"2024-09-10T10:10:00.972949+0000","last_became_active":"2024-09-10T10:08:44.403462+0000","last_became_peered":"2024-09-10T10:08:44.403462+0000","last_unstale":"2024-09-10T10:10:00.972949+0000","last_undegraded":"2024-09-10T10:10:00.972949+0000","last_fullsized":"2024-09-10T10:10:00.972949+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:09.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'7","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:20.708433+0000","last_change":"2024-09-10T10:08:32.893227+0000","last_active":"2024-09-10T10:11:20.708433+0000","last_peered":"2024-09-10T10:11:20.708433+0000","last_clean":"2024-09-10T10:11:20.708433+0000","last_became_active":"2024-09-10T10:08:32.892732+0000","last_became_peered":"2024-09-10T10:08:32.892732+0000","last_unstale":"2024-09-10T10:11:20.708433+0000","last_undegraded":"2024-09-10T10:11:20.708433+0000","last_fullsized":"2024-09-10T10:11:20.708433+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:16.933955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761246+0000","last_change":"2024-09-10T10:08:35.368806+0000","last_active":"2024-09-10T10:10:58.761246+0000","last_peered":"2024-09-10T10:10:58.761246+0000","last_clean":"2024-09-10T10:10:58.761246+0000","last_became_active":"2024-09-10T10:08:35.368397+0000","last_became_peered":"2024-09-10T10:08:35.368397+0000","last_unstale":"2024-09-10T10:10:58.761246+0000","last_undegraded":"2024-09-10T10:10:58.761246+0000","last_fullsized":"2024-09-10T10:10:58.761246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:39.656295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973102+0000","last_change":"2024-09-10T10:08:44.391941+0000","last_active":"2024-09-10T10:10:00.973102+0000","last_peered":"2024-09-10T10:10:00.973102+0000","last_clean":"2024-09-10T10:10:00.973102+0000","last_became_active":"2024-09-10T10:08:44.391553+0000","last_became_peered":"2024-09-10T10:08:44.391553+0000","last_unstale":"2024-09-10T10:10:00.973102+0000","last_undegraded":"2024-09-10T10:10:00.973102+0000","last_fullsized":"2024-09-10T10:10:00.973102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:34.279772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762216+0000","last_change":"2024-09-10T10:08:35.363192+0000","last_active":"2024-09-10T10:10:58.762216+0000","last_peered":"2024-09-10T10:10:58.762216+0000","last_clean":"2024-09-10T10:10:58.762216+0000","last_became_active":"2024-09-10T10:08:35.362890+0000","last_became_peered":"2024-09-10T10:08:35.362890+0000","last_unstale":"2024-09-10T10:10:58.762216+0000","last_undegraded":"2024-09-10T10:10:58.762216+0000","last_fullsized":"2024-09-10T10:10:58.762216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:07.493539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"95'12","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.748590+0000","last_change":"2024-09-10T10:08:35.362471+0000","last_active":"2024-09-10T10:10:58.748590+0000","last_peered":"2024-09-10T10:10:58.748590+0000","last_clean":"2024-09-10T10:10:58.748590+0000","last_became_active":"2024-09-10T10:08:35.361553+0000","last_became_peered":"2024-09-10T10:08:35.361553+0000","last_unstale":"2024-09-10T10:10:58.748590+0000","last_undegraded":"2024-09-10T10:10:58.748590+0000","last_fullsized":"2024-09-10T10:10:58.748590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:24.511901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.777795+0000","last_change":"2024-09-10T10:08:35.371025+0000","last_active":"2024-09-10T10:10:58.777795+0000","last_peered":"2024-09-10T10:10:58.777795+0000","last_clean":"2024-09-10T10:10:58.777795+0000","last_became_active":"2024-09-10T10:08:35.370692+0000","last_became_peered":"2024-09-10T10:08:35.370692+0000","last_unstale":"2024-09-10T10:10:58.777795+0000","last_undegraded":"2024-09-10T10:10:58.777795+0000","last_fullsized":"2024-09-10T10:10:58.777795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:22.289843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776381+0000","last_change":"2024-09-10T10:08:35.373519+0000","last_active":"2024-09-10T10:10:58.776381+0000","last_peered":"2024-09-10T10:10:58.776381+0000","last_clean":"2024-09-10T10:10:58.776381+0000","last_became_active":"2024-09-10T10:08:35.372719+0000","last_became_peered":"2024-09-10T10:08:35.372719+0000","last_unstale":"2024-09-10T10:10:58.776381+0000","last_undegraded":"2024-09-10T10:10:58.776381+0000","last_fullsized":"2024-09-10T10:10:58.776381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:24.530809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"95'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778078+0000","last_change":"2024-09-10T10:09:00.489944+0000","last_active":"2024-09-10T10:10:58.778078+0000","last_peered":"2024-09-10T10:10:58.778078+0000","last_clean":"2024-09-10T10:10:58.778078+0000","last_became_active":"2024-09-10T10:09:00.489269+0000","last_became_peered":"2024-09-10T10:09:00.489269+0000","last_unstale":"2024-09-10T10:10:58.778078+0000","last_undegraded":"2024-09-10T10:10:58.778078+0000","last_fullsized":"2024-09-10T10:10:58.778078+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:46.561078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761792+0000","last_change":"2024-09-10T10:08:35.364779+0000","last_active":"2024-09-10T10:10:58.761792+0000","last_peered":"2024-09-10T10:10:58.761792+0000","last_clean":"2024-09-10T10:10:58.761792+0000","last_became_active":"2024-09-10T10:08:35.364455+0000","last_became_peered":"2024-09-10T10:08:35.364455+0000","last_unstale":"2024-09-10T10:10:58.761792+0000","last_undegraded":"2024-09-10T10:10:58.761792+0000","last_fullsized":"2024-09-10T10:10:58.761792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:08.552218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761074+0000","last_change":"2024-09-10T10:08:35.357147+0000","last_active":"2024-09-10T10:10:58.761074+0000","last_peered":"2024-09-10T10:10:58.761074+0000","last_clean":"2024-09-10T10:10:58.761074+0000","last_became_active":"2024-09-10T10:08:35.356808+0000","last_became_peered":"2024-09-10T10:08:35.356808+0000","last_unstale":"2024-09-10T10:10:58.761074+0000","last_undegraded":"2024-09-10T10:10:58.761074+0000","last_fullsized":"2024-09-10T10:10:58.761074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:35.731496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"95'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755499+0000","last_change":"2024-09-10T10:08:35.365795+0000","last_active":"2024-09-10T10:10:58.755499+0000","last_peered":"2024-09-10T10:10:58.755499+0000","last_clean":"2024-09-10T10:10:58.755499+0000","last_became_active":"2024-09-10T10:08:35.365342+0000","last_became_peered":"2024-09-10T10:08:35.365342+0000","last_unstale":"2024-09-10T10:10:58.755499+0000","last_undegraded":"2024-09-10T10:10:58.755499+0000","last_fullsized":"2024-09-10T10:10:58.755499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:20.012890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"95'6","reported_seq":22,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.763139+0000","last_change":"2024-09-10T10:09:00.486664+0000","last_active":"2024-09-10T10:10:58.763139+0000","last_peered":"2024-09-10T10:10:58.763139+0000","last_clean":"2024-09-10T10:10:58.763139+0000","last_became_active":"2024-09-10T10:09:00.486239+0000","last_became_peered":"2024-09-10T10:09:00.486239+0000","last_unstale":"2024-09-10T10:10:58.763139+0000","last_undegraded":"2024-09-10T10:10:58.763139+0000","last_fullsized":"2024-09-10T10:10:58.763139+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:47.472245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755183+0000","last_change":"2024-09-10T10:08:35.367403+0000","last_active":"2024-09-10T10:10:58.755183+0000","last_peered":"2024-09-10T10:10:58.755183+0000","last_clean":"2024-09-10T10:10:58.755183+0000","last_became_active":"2024-09-10T10:08:35.365969+0000","last_became_peered":"2024-09-10T10:08:35.365969+0000","last_unstale":"2024-09-10T10:10:58.755183+0000","last_undegraded":"2024-09-10T10:10:58.755183+0000","last_fullsized":"2024-09-10T10:10:58.755183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:27.657226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773597+0000","last_change":"2024-09-10T10:08:35.359185+0000","last_active":"2024-09-10T10:10:58.773597+0000","last_peered":"2024-09-10T10:10:58.773597+0000","last_clean":"2024-09-10T10:10:58.773597+0000","last_became_active":"2024-09-10T10:08:35.358825+0000","last_became_peered":"2024-09-10T10:08:35.358825+0000","last_unstale":"2024-09-10T10:10:58.773597+0000","last_undegraded":"2024-09-10T10:10:58.773597+0000","last_fullsized":"2024-09-10T10:10:58.773597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:31.884533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778457+0000","last_change":"2024-09-10T10:08:35.378151+0000","last_active":"2024-09-10T10:10:58.778457+0000","last_peered":"2024-09-10T10:10:58.778457+0000","last_clean":"2024-09-10T10:10:58.778457+0000","last_became_active":"2024-09-10T10:08:35.377784+0000","last_became_peered":"2024-09-10T10:08:35.377784+0000","last_unstale":"2024-09-10T10:10:58.778457+0000","last_undegraded":"2024-09-10T10:10:58.778457+0000","last_fullsized":"2024-09-10T10:10:58.778457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.027310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762465+0000","last_change":"2024-09-10T10:08:35.364550+0000","last_active":"2024-09-10T10:10:58.762465+0000","last_peered":"2024-09-10T10:10:58.762465+0000","last_clean":"2024-09-10T10:10:58.762465+0000","last_became_active":"2024-09-10T10:08:35.364224+0000","last_became_peered":"2024-09-10T10:08:35.364224+0000","last_unstale":"2024-09-10T10:10:58.762465+0000","last_undegraded":"2024-09-10T10:10:58.762465+0000","last_fullsized":"2024-09-10T10:10:58.762465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:38.584494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.750237+0000","last_change":"2024-09-10T10:08:35.357333+0000","last_active":"2024-09-10T10:10:58.750237+0000","last_peered":"2024-09-10T10:10:58.750237+0000","last_clean":"2024-09-10T10:10:58.750237+0000","last_became_active":"2024-09-10T10:08:35.356940+0000","last_became_peered":"2024-09-10T10:08:35.356940+0000","last_unstale":"2024-09-10T10:10:58.750237+0000","last_undegraded":"2024-09-10T10:10:58.750237+0000","last_fullsized":"2024-09-10T10:10:58.750237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:40.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769367+0000","last_change":"2024-09-10T10:08:35.367208+0000","last_active":"2024-09-10T10:10:58.769367+0000","last_peered":"2024-09-10T10:10:58.769367+0000","last_clean":"2024-09-10T10:10:58.769367+0000","last_became_active":"2024-09-10T10:08:35.361942+0000","last_became_peered":"2024-09-10T10:08:35.361942+0000","last_unstale":"2024-09-10T10:10:58.769367+0000","last_undegraded":"2024-09-10T10:10:58.769367+0000","last_fullsized":"2024-09-10T10:10:58.769367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:19.030623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773220+0000","last_change":"2024-09-10T10:08:35.377164+0000","last_active":"2024-09-10T10:10:58.773220+0000","last_peered":"2024-09-10T10:10:58.773220+0000","last_clean":"2024-09-10T10:10:58.773220+0000","last_became_active":"2024-09-10T10:08:35.376457+0000","last_became_peered":"2024-09-10T10:08:35.376457+0000","last_unstale":"2024-09-10T10:10:58.773220+0000","last_undegraded":"2024-09-10T10:10:58.773220+0000","last_fullsized":"2024-09-10T10:10:58.773220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.291635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772661+0000","last_change":"2024-09-10T10:08:35.365096+0000","last_active":"2024-09-10T10:10:58.772661+0000","last_peered":"2024-09-10T10:10:58.772661+0000","last_clean":"2024-09-10T10:10:58.772661+0000","last_became_active":"2024-09-10T10:08:35.364780+0000","last_became_peered":"2024-09-10T10:08:35.364780+0000","last_unstale":"2024-09-10T10:10:58.772661+0000","last_undegraded":"2024-09-10T10:10:58.772661+0000","last_fullsized":"2024-09-10T10:10:58.772661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:30.177904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774627+0000","last_change":"2024-09-10T10:08:35.377017+0000","last_active":"2024-09-10T10:10:58.774627+0000","last_peered":"2024-09-10T10:10:58.774627+0000","last_clean":"2024-09-10T10:10:58.774627+0000","last_became_active":"2024-09-10T10:08:35.372243+0000","last_became_peered":"2024-09-10T10:08:35.372243+0000","last_unstale":"2024-09-10T10:10:58.774627+0000","last_undegraded":"2024-09-10T10:10:58.774627+0000","last_fullsized":"2024-09-10T10:10:58.774627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:26.105505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774291+0000","last_change":"2024-09-10T10:08:35.379782+0000","last_active":"2024-09-10T10:10:58.774291+0000","last_peered":"2024-09-10T10:10:58.774291+0000","last_clean":"2024-09-10T10:10:58.774291+0000","last_became_active":"2024-09-10T10:08:35.377109+0000","last_became_peered":"2024-09-10T10:08:35.377109+0000","last_unstale":"2024-09-10T10:10:58.774291+0000","last_undegraded":"2024-09-10T10:10:58.774291+0000","last_fullsized":"2024-09-10T10:10:58.774291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:10.761016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.764497+0000","last_change":"2024-09-10T10:08:35.364891+0000","last_active":"2024-09-10T10:10:58.764497+0000","last_peered":"2024-09-10T10:10:58.764497+0000","last_clean":"2024-09-10T10:10:58.764497+0000","last_became_active":"2024-09-10T10:08:35.363845+0000","last_became_peered":"2024-09-10T10:08:35.363845+0000","last_unstale":"2024-09-10T10:10:58.764497+0000","last_undegraded":"2024-09-10T10:10:58.764497+0000","last_fullsized":"2024-09-10T10:10:58.764497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:03.346994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766501+0000","last_change":"2024-09-10T10:08:35.363548+0000","last_active":"2024-09-10T10:10:58.766501+0000","last_peered":"2024-09-10T10:10:58.766501+0000","last_clean":"2024-09-10T10:10:58.766501+0000","last_became_active":"2024-09-10T10:08:35.363229+0000","last_became_peered":"2024-09-10T10:08:35.363229+0000","last_unstale":"2024-09-10T10:10:58.766501+0000","last_undegraded":"2024-09-10T10:10:58.766501+0000","last_fullsized":"2024-09-10T10:10:58.766501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:38.773445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773111+0000","last_change":"2024-09-10T10:08:35.360717+0000","last_active":"2024-09-10T10:10:58.773111+0000","last_peered":"2024-09-10T10:10:58.773111+0000","last_clean":"2024-09-10T10:10:58.773111+0000","last_became_active":"2024-09-10T10:08:35.360410+0000","last_became_peered":"2024-09-10T10:08:35.360410+0000","last_unstale":"2024-09-10T10:10:58.773111+0000","last_undegraded":"2024-09-10T10:10:58.773111+0000","last_fullsized":"2024-09-10T10:10:58.773111+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:59.322524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'16","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772823+0000","last_change":"2024-09-10T10:08:35.362359+0000","last_active":"2024-09-10T10:10:58.772823+0000","last_peered":"2024-09-10T10:10:58.772823+0000","last_clean":"2024-09-10T10:10:58.772823+0000","last_became_active":"2024-09-10T10:08:35.361580+0000","last_became_peered":"2024-09-10T10:08:35.361580+0000","last_unstale":"2024-09-10T10:10:58.772823+0000","last_undegraded":"2024-09-10T10:10:58.772823+0000","last_fullsized":"2024-09-10T10:10:58.772823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:23.265237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771033+0000","last_change":"2024-09-10T10:08:35.367305+0000","last_active":"2024-09-10T10:10:58.771033+0000","last_peered":"2024-09-10T10:10:58.771033+0000","last_clean":"2024-09-10T10:10:58.771033+0000","last_became_active":"2024-09-10T10:08:35.366936+0000","last_became_peered":"2024-09-10T10:08:35.366936+0000","last_unstale":"2024-09-10T10:10:58.771033+0000","last_undegraded":"2024-09-10T10:10:58.771033+0000","last_fullsized":"2024-09-10T10:10:58.771033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:28.158474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765168+0000","last_change":"2024-09-10T10:08:35.369983+0000","last_active":"2024-09-10T10:10:58.765168+0000","last_peered":"2024-09-10T10:10:58.765168+0000","last_clean":"2024-09-10T10:10:58.765168+0000","last_became_active":"2024-09-10T10:08:35.367662+0000","last_became_peered":"2024-09-10T10:08:35.367662+0000","last_unstale":"2024-09-10T10:10:58.765168+0000","last_undegraded":"2024-09-10T10:10:58.765168+0000","last_fullsized":"2024-09-10T10:10:58.765168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771023+0000","last_change":"2024-09-10T10:08:35.369237+0000","last_active":"2024-09-10T10:10:58.771023+0000","last_peered":"2024-09-10T10:10:58.771023+0000","last_clean":"2024-09-10T10:10:58.771023+0000","last_became_active":"2024-09-10T10:08:35.368903+0000","last_became_peered":"2024-09-10T10:08:35.368903+0000","last_unstale":"2024-09-10T10:10:58.771023+0000","last_undegraded":"2024-09-10T10:10:58.771023+0000","last_fullsized":"2024-09-10T10:10:58.771023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:05.150549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773489+0000","last_change":"2024-09-10T10:08:35.367284+0000","last_active":"2024-09-10T10:10:58.773489+0000","last_peered":"2024-09-10T10:10:58.773489+0000","last_clean":"2024-09-10T10:10:58.773489+0000","last_became_active":"2024-09-10T10:08:35.366969+0000","last_became_peered":"2024-09-10T10:08:35.366969+0000","last_unstale":"2024-09-10T10:10:58.773489+0000","last_undegraded":"2024-09-10T10:10:58.773489+0000","last_fullsized":"2024-09-10T10:10:58.773489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:16.949804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.749286+0000","last_change":"2024-09-10T10:08:35.374559+0000","last_active":"2024-09-10T10:10:58.749286+0000","last_peered":"2024-09-10T10:10:58.749286+0000","last_clean":"2024-09-10T10:10:58.749286+0000","last_became_active":"2024-09-10T10:08:35.374191+0000","last_became_peered":"2024-09-10T10:08:35.374191+0000","last_unstale":"2024-09-10T10:10:58.749286+0000","last_undegraded":"2024-09-10T10:10:58.749286+0000","last_fullsized":"2024-09-10T10:10:58.749286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:48.292249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.757757+0000","last_change":"2024-09-10T10:08:35.368042+0000","last_active":"2024-09-10T10:10:58.757757+0000","last_peered":"2024-09-10T10:10:58.757757+0000","last_clean":"2024-09-10T10:10:58.757757+0000","last_became_active":"2024-09-10T10:08:35.365985+0000","last_became_peered":"2024-09-10T10:08:35.365985+0000","last_unstale":"2024-09-10T10:10:58.757757+0000","last_undegraded":"2024-09-10T10:10:58.757757+0000","last_fullsized":"2024-09-10T10:10:58.757757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:04.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774113+0000","last_change":"2024-09-10T10:08:35.375826+0000","last_active":"2024-09-10T10:10:58.774113+0000","last_peered":"2024-09-10T10:10:58.774113+0000","last_clean":"2024-09-10T10:10:58.774113+0000","last_became_active":"2024-09-10T10:08:35.375485+0000","last_became_peered":"2024-09-10T10:08:35.375485+0000","last_unstale":"2024-09-10T10:10:58.774113+0000","last_undegraded":"2024-09-10T10:10:58.774113+0000","last_fullsized":"2024-09-10T10:10:58.774113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:49.146648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.763221+0000","last_change":"2024-09-10T10:08:35.375745+0000","last_active":"2024-09-10T10:10:58.763221+0000","last_peered":"2024-09-10T10:10:58.763221+0000","last_clean":"2024-09-10T10:10:58.763221+0000","last_became_active":"2024-09-10T10:08:35.375427+0000","last_became_peered":"2024-09-10T10:08:35.375427+0000","last_unstale":"2024-09-10T10:10:58.763221+0000","last_undegraded":"2024-09-10T10:10:58.763221+0000","last_fullsized":"2024-09-10T10:10:58.763221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:48.743434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771465+0000","last_change":"2024-09-10T10:08:35.377092+0000","last_active":"2024-09-10T10:10:58.771465+0000","last_peered":"2024-09-10T10:10:58.771465+0000","last_clean":"2024-09-10T10:10:58.771465+0000","last_became_active":"2024-09-10T10:08:35.376761+0000","last_became_peered":"2024-09-10T10:08:35.376761+0000","last_unstale":"2024-09-10T10:10:58.771465+0000","last_undegraded":"2024-09-10T10:10:58.771465+0000","last_fullsized":"2024-09-10T10:10:58.771465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:58.631742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72687,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":744,"num_read_kb":451,"num_write":183,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":218061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286200,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449136,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":538290,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678071,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32348,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712804,"statfs":{"total":95995035648,"available":95961911296,"internally_reserved":0,"allocated":1191936,"data_stored":1194079,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841595,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":542600,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070529,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":538402,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299461,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":1135010,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462988,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":533680,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724626,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1114112,"data_stored":1130064,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888150,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1048576,"data_stored":538864,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149787,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":533874,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411427,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1134592,"data_stored":603483,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1110016,"data_stored":601599,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738478,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":535068,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:11:28.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:11:29.064 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.630+0000 7ffb0d800640 1 -- 172.21.15.50:0/568177503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb08109120 msgr2=0x7ffb08110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.630+0000 7ffb0d800640 1 --2- 172.21.15.50:0/568177503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb08109120 0x7ffb08110ca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009ca0 tx=0x7ffb0002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.631+0000 7ffb0d800640 1 -- 172.21.15.50:0/568177503 shutdown_connections 2024-09-10T10:11:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.631+0000 7ffb0d800640 1 --2- 172.21.15.50:0/568177503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb08109120 0x7ffb08110ca0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.631+0000 7ffb0d800640 1 --2- 172.21.15.50:0/568177503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb081049a0 0x7ffb081089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.631+0000 7ffb0d800640 1 --2- 172.21.15.50:0/568177503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb08103ff0 0x7ffb081043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.631+0000 7ffb0d800640 1 -- 172.21.15.50:0/568177503 >> 172.21.15.50:0/568177503 conn(0x7ffb080ffa90 msgr2=0x7ffb08101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.631+0000 7ffb0d800640 1 -- 172.21.15.50:0/568177503 shutdown_connections 2024-09-10T10:11:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.631+0000 7ffb0d800640 1 -- 172.21.15.50:0/568177503 wait complete. 2024-09-10T10:11:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.632+0000 7ffb0d800640 1 Processor -- start 2024-09-10T10:11:29.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.632+0000 7ffb0d800640 1 -- start start 2024-09-10T10:11:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.632+0000 7ffb0d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb08103ff0 0x7ffb0819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.632+0000 7ffb0d800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb081049a0 0x7ffb0819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.632+0000 7ffb0d800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb08109120 0x7ffb0819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.632+0000 7ffb0d800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb081141a0 con 0x7ffb081049a0 2024-09-10T10:11:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.632+0000 7ffb0d800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffb08114020 con 0x7ffb08103ff0 2024-09-10T10:11:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.632+0000 7ffb0d800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffb08114320 con 0x7ffb08109120 2024-09-10T10:11:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.632+0000 7ffafe000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb081049a0 0x7ffb0819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.633+0000 7ffb06a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb08103ff0 0x7ffb0819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.633+0000 7ffafe000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb081049a0 0x7ffb0819ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59964/0 (socket says 172.21.15.50:59964) 2024-09-10T10:11:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.633+0000 7ffb06a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb08103ff0 0x7ffb0819a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:59688/0 (socket says 172.21.15.50:59688) 2024-09-10T10:11:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.633+0000 7ffafe000640 1 -- 172.21.15.50:0/3617763756 learned_addr learned my addr 172.21.15.50:0/3617763756 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.633+0000 7ffb07400640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb08109120 0x7ffb0819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.633+0000 7ffb06a00640 1 -- 172.21.15.50:0/3617763756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb08109120 msgr2=0x7ffb0819eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.633+0000 7ffb06a00640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb08109120 0x7ffb0819eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.633+0000 7ffb06a00640 1 -- 172.21.15.50:0/3617763756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb081049a0 msgr2=0x7ffb0819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.633+0000 7ffb06a00640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb081049a0 0x7ffb0819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.633+0000 7ffb06a00640 1 -- 172.21.15.50:0/3617763756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0819f590 con 0x7ffb08103ff0 2024-09-10T10:11:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.633+0000 7ffafe000640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb081049a0 0x7ffb0819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:29.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.633+0000 7ffb06a00640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb08103ff0 0x7ffb0819a5e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800e9f0 tx=0x7ffaf800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:29.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.634+0000 7ffaffe00640 1 -- 172.21.15.50:0/3617763756 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf800ccc0 con 0x7ffb08103ff0 2024-09-10T10:11:29.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.634+0000 7ffb0d800640 1 -- 172.21.15.50:0/3617763756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0819f880 con 0x7ffb08103ff0 2024-09-10T10:11:29.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.634+0000 7ffaffe00640 1 -- 172.21.15.50:0/3617763756 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaf8010910 con 0x7ffb08103ff0 2024-09-10T10:11:29.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.634+0000 7ffaffe00640 1 -- 172.21.15.50:0/3617763756 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8018960 con 0x7ffb08103ff0 2024-09-10T10:11:29.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.634+0000 7ffb0d800640 1 -- 172.21.15.50:0/3617763756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb081a7160 con 0x7ffb08103ff0 2024-09-10T10:11:29.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.637+0000 7ffb101df740 1 Processor -- start 2024-09-10T10:11:29.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.637+0000 7ffaffe00640 1 -- 172.21.15.50:0/3617763756 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ffaf8010ac0 con 0x7ffb08103ff0 2024-09-10T10:11:29.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.637+0000 7ffb101df740 1 -- start start 2024-09-10T10:11:29.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.637+0000 7ffb101df740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b912b90 0x55920b912f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.637+0000 7ffb101df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b9134b0 0x55920b91d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffb101df740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b91dd70 0x55920b920160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffb101df740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55920b8793e0 con 0x55920b91dd70 2024-09-10T10:11:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffb101df740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55920b820d80 con 0x55920b912b90 2024-09-10T10:11:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffb101df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55920b8753a0 con 0x55920b9134b0 2024-09-10T10:11:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffb07400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b912b90 0x55920b912f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffb07400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b912b90 0x55920b912f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:59702/0 (socket says 172.21.15.50:59702) 2024-09-10T10:11:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffb07400640 1 -- 172.21.15.50:0/411873886 learned_addr learned my addr 172.21.15.50:0/411873886 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffb06a00640 1 --2- 172.21.15.50:0/411873886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b9134b0 0x55920b91d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffafe000640 1 --2- 172.21.15.50:0/411873886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b91dd70 0x55920b920160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffb07400640 1 -- 172.21.15.50:0/411873886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b9134b0 msgr2=0x55920b91d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffb07400640 1 --2- 172.21.15.50:0/411873886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b9134b0 0x55920b91d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffb07400640 1 -- 172.21.15.50:0/411873886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b91dd70 msgr2=0x55920b920160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffb07400640 1 --2- 172.21.15.50:0/411873886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b91dd70 0x55920b920160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.638+0000 7ffb07400640 1 -- 172.21.15.50:0/411873886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55920b83fae0 con 0x55920b912b90 2024-09-10T10:11:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.639+0000 7ffb07400640 1 --2- 172.21.15.50:0/411873886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b912b90 0x55920b912f70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009ca0 tx=0x7ffb000093e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26465c21917c70be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.639+0000 7ffaffe00640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffaec0a2b80 0x7ffaec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.639+0000 7ffaffe00640 1 -- 172.21.15.50:0/3617763756 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7ffaf80cf7c0 con 0x7ffb08103ff0 2024-09-10T10:11:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.639+0000 7ffaf7e00640 1 -- 172.21.15.50:0/411873886 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00031db0 con 0x55920b912b90 2024-09-10T10:11:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.639+0000 7ffaf7e00640 1 -- 172.21.15.50:0/411873886 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb00036030 con 0x55920b912b90 2024-09-10T10:11:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.639+0000 7ffaf7e00640 1 -- 172.21.15.50:0/411873886 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00004370 con 0x55920b912b90 2024-09-10T10:11:29.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.639+0000 7ffb06a00640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffaec0a2b80 0x7ffaec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.640+0000 7ffb101df740 1 -- 172.21.15.50:0/411873886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b912b90 msgr2=0x55920b912f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.640+0000 7ffb06a00640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffaec0a2b80 0x7ffaec0a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80986b0 tx=0x7ffaf80d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.640+0000 7ffb101df740 1 --2- 172.21.15.50:0/411873886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b912b90 0x55920b912f70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009ca0 tx=0x7ffb000093e0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.640+0000 7ffb101df740 1 -- 172.21.15.50:0/411873886 shutdown_connections 2024-09-10T10:11:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.640+0000 7ffb101df740 1 --2- 172.21.15.50:0/411873886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b91dd70 0x55920b920160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.640+0000 7ffb101df740 1 --2- 172.21.15.50:0/411873886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b9134b0 0x55920b91d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.640+0000 7ffb101df740 1 --2- 172.21.15.50:0/411873886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b912b90 0x55920b912f70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.640+0000 7ffb101df740 1 -- 172.21.15.50:0/411873886 >> 172.21.15.50:0/411873886 conn(0x55920b90f120 msgr2=0x55920b90f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.641+0000 7ffb101df740 1 -- 172.21.15.50:0/411873886 shutdown_connections 2024-09-10T10:11:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.641+0000 7ffb101df740 1 -- 172.21.15.50:0/411873886 wait complete. 2024-09-10T10:11:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.641+0000 7ffb101df740 1 -- start start 2024-09-10T10:11:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.642+0000 7ffb101df740 1 Processor -- start 2024-09-10T10:11:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.642+0000 7ffb101df740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 0x55920b91ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.642+0000 7ffb101df740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b9134b0 0x55920b91b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.642+0000 7ffb101df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b91dd70 0x55920b91b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.642+0000 7ffb101df740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55920b920860 con 0x55920b912b90 2024-09-10T10:11:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.642+0000 7ffb101df740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55920b8340f0 con 0x55920b9134b0 2024-09-10T10:11:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.642+0000 7ffb101df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55920b9209e0 con 0x55920b91dd70 2024-09-10T10:11:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.642+0000 7ffb101df740 10 client.0 _ll_register_callbacks cb 0x55920b8259e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.642+0000 7ffb07400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 0x55920b91ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.643+0000 7ffafe000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b9134b0 0x55920b91b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.643+0000 7ffb07400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 0x55920b91ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59976/0 (socket says 172.21.15.50:59976) 2024-09-10T10:11:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.643+0000 7ffafe000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b9134b0 0x55920b91b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:59718/0 (socket says 172.21.15.50:59718) 2024-09-10T10:11:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.643+0000 7ffb07400640 1 -- 172.21.15.50:0/1147405853 learned_addr learned my addr 172.21.15.50:0/1147405853 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.643+0000 7ffb07400640 1 --2- 172.21.15.50:0/1147405853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b91dd70 0x55920b91b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.643+0000 7ffafe000640 1 -- 172.21.15.50:0/1147405853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b91dd70 msgr2=0x55920b91b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.643+0000 7ffafe000640 1 --2- 172.21.15.50:0/1147405853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b91dd70 0x55920b91b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.643+0000 7ffafe000640 1 -- 172.21.15.50:0/1147405853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 msgr2=0x55920b91ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.643+0000 7ffafe000640 1 --2- 172.21.15.50:0/1147405853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 0x55920b91ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.643+0000 7ffafe000640 1 -- 172.21.15.50:0/1147405853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55920b5ea3c0 con 0x55920b9134b0 2024-09-10T10:11:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.643+0000 7ffb07400640 1 --2- 172.21.15.50:0/1147405853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 0x55920b91ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.643+0000 7ffafe000640 1 --2- 172.21.15.50:0/1147405853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b9134b0 0x55920b91b170 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0012cf0 tx=0x7ffaf000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d959156e69bb2ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.644+0000 7ffaf4c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:11:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.644+0000 7ffaf4c00640 1 -- 172.21.15.50:0/1147405853 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf00120d0 con 0x55920b9134b0 2024-09-10T10:11:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.644+0000 7ffb101df740 1 -- 172.21.15.50:0/1147405853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb00036030 con 0x55920b9134b0 2024-09-10T10:11:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.644+0000 7ffaf4c00640 1 -- 172.21.15.50:0/1147405853 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7ffaf0010430 con 0x55920b9134b0 2024-09-10T10:11:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.644+0000 7ffaf4c00640 1 -- 172.21.15.50:0/1147405853 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffaf0012270 con 0x55920b9134b0 2024-09-10T10:11:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.644+0000 7ffb101df740 10 client.25262 fetch_fsmap learned FSMap version 25 2024-09-10T10:11:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.644+0000 7ffb101df740 1 -- 172.21.15.50:0/1147405853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55920b92c590 con 0x55920b9134b0 2024-09-10T10:11:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.645+0000 7ffaf4c00640 1 -- 172.21.15.50:0/1147405853 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb00036030 con 0x55920b9134b0 2024-09-10T10:11:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.645+0000 7ffaf4c00640 1 -- 172.21.15.50:0/1147405853 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ffaf001c780 con 0x55920b9134b0 2024-09-10T10:11:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.645+0000 7ffb101df740 10 client.25262 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:11:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.645+0000 7ffb101df740 10 client.25262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:11:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.645+0000 7ffb101df740 20 client.25262 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.645+0000 7ffb101df740 1 --2- 172.21.15.50:0/1147405853 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55920b92d9a0 0x55920b92fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.645+0000 7ffb101df740 4 client.25262 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:11:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.645+0000 7ffb101df740 1 -- 172.21.15.50:0/1147405853 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55920b886950 con 0x55920b92d9a0 2024-09-10T10:11:29.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.645+0000 7ffb07400640 1 --2- 172.21.15.50:0/1147405853 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55920b92d9a0 0x55920b92fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.646+0000 7ffb07400640 1 --2- 172.21.15.50:0/1147405853 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55920b92d9a0 0x55920b92fe00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=889dcccf3d6d7883 server_cookie=894b643944167bd9 in_seq=0 out_seq=0 2024-09-10T10:11:29.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.646+0000 7ffaf4c00640 10 client.25262 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.647+0000 7ffaf4c00640 1 -- 172.21.15.50:0/1147405853 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55920b886950 con 0x55920b92d9a0 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.647+0000 7ffaf4c00640 10 client.25262 handle_command_reply: tid=0 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.647+0000 7ffb101df740 1 client.25262 shutdown 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.647+0000 7ffb101df740 1 -- 172.21.15.50:0/1147405853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b9134b0 msgr2=0x55920b91b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.647+0000 7ffb101df740 1 --2- 172.21.15.50:0/1147405853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b9134b0 0x55920b91b170 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0012cf0 tx=0x7ffaf000f790 comp rx=0 tx=0).stop 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.647+0000 7ffb101df740 1 -- 172.21.15.50:0/1147405853 shutdown_connections 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.647+0000 7ffb101df740 1 --2- 172.21.15.50:0/1147405853 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55920b92d9a0 0x55920b92fe00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.647+0000 7ffb101df740 1 --2- 172.21.15.50:0/1147405853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b91dd70 0x55920b91b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.647+0000 7ffb101df740 1 --2- 172.21.15.50:0/1147405853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b9134b0 0x55920b91b170 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.647+0000 7ffb101df740 1 --2- 172.21.15.50:0/1147405853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 0x55920b91ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.647+0000 7ffaf4c00640 0 client.25262 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.647+0000 7ffb101df740 1 -- 172.21.15.50:0/1147405853 >> 172.21.15.50:0/1147405853 conn(0x55920b90f120 msgr2=0x55920b914e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.648+0000 7ffb101df740 1 -- 172.21.15.50:0/1147405853 shutdown_connections 2024-09-10T10:11:29.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.648+0000 7ffb101df740 1 -- 172.21.15.50:0/1147405853 wait complete. 2024-09-10T10:11:29.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.648+0000 7ffb101df740 20 client.25262 trim_cache size 0 max 16384 2024-09-10T10:11:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.666+0000 7ffb101df740 1 Processor -- start 2024-09-10T10:11:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.666+0000 7ffb101df740 1 -- start start 2024-09-10T10:11:29.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.666+0000 7ffb101df740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b912b90 0x55920b9155f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.666+0000 7ffb101df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b9134b0 0x55920b91cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.666+0000 7ffb101df740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b91dd70 0x55920b9356d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.666+0000 7ffb101df740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb081af350 con 0x55920b91dd70 2024-09-10T10:11:29.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.666+0000 7ffb101df740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffb081acc20 con 0x55920b912b90 2024-09-10T10:11:29.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.666+0000 7ffb101df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffb081aaa90 con 0x55920b9134b0 2024-09-10T10:11:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.667+0000 7ffafe000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b9134b0 0x55920b91cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.667+0000 7ffb07400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b91dd70 0x55920b9356d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.667+0000 7ffafe000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b9134b0 0x55920b91cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:45538/0 (socket says 172.21.15.50:45538) 2024-09-10T10:11:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.667+0000 7ffafe000640 1 -- 172.21.15.50:0/4247112707 learned_addr learned my addr 172.21.15.50:0/4247112707 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.667+0000 7ffb07400640 1 --2- 172.21.15.50:0/4247112707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b912b90 0x55920b9155f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.667+0000 7ffafe000640 1 -- 172.21.15.50:0/4247112707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b912b90 msgr2=0x55920b9155f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.667+0000 7ffafe000640 1 --2- 172.21.15.50:0/4247112707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b912b90 0x55920b9155f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.667+0000 7ffafe000640 1 -- 172.21.15.50:0/4247112707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b91dd70 msgr2=0x55920b9356d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.667+0000 7ffafe000640 1 --2- 172.21.15.50:0/4247112707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b91dd70 0x55920b9356d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.667+0000 7ffafe000640 1 -- 172.21.15.50:0/4247112707 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55920b91d5a0 con 0x55920b9134b0 2024-09-10T10:11:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.667+0000 7ffafe000640 1 --2- 172.21.15.50:0/4247112707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b9134b0 0x55920b91cba0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0000c00 tx=0x7ffaf000fc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c293d987e719897 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.668+0000 7ffaf7400640 1 -- 172.21.15.50:0/4247112707 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf001c420 con 0x55920b9134b0 2024-09-10T10:11:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.668+0000 7ffaf7400640 1 -- 172.21.15.50:0/4247112707 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaf0005040 con 0x55920b9134b0 2024-09-10T10:11:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.668+0000 7ffaf7400640 1 -- 172.21.15.50:0/4247112707 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf00048e0 con 0x55920b9134b0 2024-09-10T10:11:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.668+0000 7ffb101df740 1 -- 172.21.15.50:0/4247112707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b9134b0 msgr2=0x55920b91cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.668+0000 7ffb101df740 1 --2- 172.21.15.50:0/4247112707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b9134b0 0x55920b91cba0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0000c00 tx=0x7ffaf000fc90 comp rx=0 tx=0).stop 2024-09-10T10:11:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.669+0000 7ffb101df740 1 -- 172.21.15.50:0/4247112707 shutdown_connections 2024-09-10T10:11:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.669+0000 7ffb101df740 1 --2- 172.21.15.50:0/4247112707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b91dd70 0x55920b9356d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.669+0000 7ffb101df740 1 --2- 172.21.15.50:0/4247112707 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b9134b0 0x55920b91cba0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.669+0000 7ffb101df740 1 --2- 172.21.15.50:0/4247112707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b912b90 0x55920b9155f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.669+0000 7ffb101df740 1 -- 172.21.15.50:0/4247112707 >> 172.21.15.50:0/4247112707 conn(0x55920b90f120 msgr2=0x55920b91c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.669+0000 7ffb101df740 1 -- 172.21.15.50:0/4247112707 shutdown_connections 2024-09-10T10:11:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.669+0000 7ffb101df740 1 -- 172.21.15.50:0/4247112707 wait complete. 2024-09-10T10:11:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.669+0000 7ffb101df740 1 -- start start 2024-09-10T10:11:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.669+0000 7ffb101df740 1 Processor -- start 2024-09-10T10:11:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.670+0000 7ffb101df740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 0x55920b926320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.670+0000 7ffb101df740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b9134b0 0x55920b921650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.670+0000 7ffb101df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b91dd70 0x55920b921b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.670+0000 7ffb101df740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb081ab0e0 con 0x55920b912b90 2024-09-10T10:11:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.670+0000 7ffb101df740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffb081ac550 con 0x55920b9134b0 2024-09-10T10:11:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.670+0000 7ffb101df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffb081ab7b0 con 0x55920b91dd70 2024-09-10T10:11:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.670+0000 7ffb101df740 10 client.0 _ll_register_callbacks cb 0x7ffaf0012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.670+0000 7ffb07400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 0x55920b926320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.670+0000 7ffb07400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 0x55920b926320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59994/0 (socket says 172.21.15.50:59994) 2024-09-10T10:11:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.670+0000 7ffb07400640 1 -- 172.21.15.50:0/2800513860 learned_addr learned my addr 172.21.15.50:0/2800513860 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.670+0000 7ffafe000640 1 --2- 172.21.15.50:0/2800513860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b9134b0 0x55920b921650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.671+0000 7ffb07400640 1 --2- 172.21.15.50:0/2800513860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b91dd70 0x55920b921b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.671+0000 7ffb07400640 1 -- 172.21.15.50:0/2800513860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b91dd70 msgr2=0x55920b921b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.671+0000 7ffb07400640 1 --2- 172.21.15.50:0/2800513860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b91dd70 0x55920b921b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.671+0000 7ffb07400640 1 -- 172.21.15.50:0/2800513860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b9134b0 msgr2=0x55920b921650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.671+0000 7ffb07400640 1 --2- 172.21.15.50:0/2800513860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b9134b0 0x55920b921650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.671+0000 7ffb07400640 1 -- 172.21.15.50:0/2800513860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55920b922370 con 0x55920b912b90 2024-09-10T10:11:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.671+0000 7ffb07400640 1 --2- 172.21.15.50:0/2800513860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 0x55920b926320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ffb00031920 tx=0x7ffb00058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da524ebdba196d5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.671+0000 7ffaf4c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:11:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.671+0000 7ffaf4c00640 1 -- 172.21.15.50:0/2800513860 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0002f820 con 0x55920b912b90 2024-09-10T10:11:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.671+0000 7ffaf4c00640 1 -- 172.21.15.50:0/2800513860 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7ffb0002f9c0 con 0x55920b912b90 2024-09-10T10:11:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.671+0000 7ffb101df740 1 -- 172.21.15.50:0/2800513860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaf0005040 con 0x55920b912b90 2024-09-10T10:11:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.672+0000 7ffaf4c00640 1 -- 172.21.15.50:0/2800513860 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffb0002fbc0 con 0x55920b912b90 2024-09-10T10:11:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.672+0000 7ffb101df740 10 client.15219 fetch_fsmap learned FSMap version 25 2024-09-10T10:11:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.672+0000 7ffb101df740 1 -- 172.21.15.50:0/2800513860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55920b998660 con 0x55920b912b90 2024-09-10T10:11:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.672+0000 7ffaf4c00640 1 -- 172.21.15.50:0/2800513860 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaf0005040 con 0x55920b912b90 2024-09-10T10:11:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.672+0000 7ffaf4c00640 1 -- 172.21.15.50:0/2800513860 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ffb00050040 con 0x55920b912b90 2024-09-10T10:11:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.672+0000 7ffb101df740 10 client.15219 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:11:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.672+0000 7ffb101df740 10 client.15219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:11:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.672+0000 7ffb101df740 20 client.15219 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:29.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.672+0000 7ffb101df740 1 --2- 172.21.15.50:0/2800513860 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55920b998a00 0x55920b99adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:29.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.672+0000 7ffb101df740 4 client.15219 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:11:29.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.672+0000 7ffb101df740 1 -- 172.21.15.50:0/2800513860 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55920b880e60 con 0x55920b998a00 2024-09-10T10:11:29.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.673+0000 7ffafe000640 1 --2- 172.21.15.50:0/2800513860 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55920b998a00 0x55920b99adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.673+0000 7ffafe000640 1 --2- 172.21.15.50:0/2800513860 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55920b998a00 0x55920b99adf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f83c5fa326682087 server_cookie=a7aa0725f8d13c28 in_seq=0 out_seq=0 2024-09-10T10:11:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.673+0000 7ffaf4c00640 10 client.15219 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffaf4c00640 1 -- 172.21.15.50:0/2800513860 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55920b880e60 con 0x55920b998a00 2024-09-10T10:11:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffaf4c00640 10 client.15219 handle_command_reply: tid=0 2024-09-10T10:11:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffb101df740 1 client.15219 shutdown 2024-09-10T10:11:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffb101df740 1 -- 172.21.15.50:0/2800513860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 msgr2=0x55920b926320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffb101df740 1 --2- 172.21.15.50:0/2800513860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 0x55920b926320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ffb00031920 tx=0x7ffb00058040 comp rx=0 tx=0).stop 2024-09-10T10:11:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffb101df740 1 -- 172.21.15.50:0/2800513860 shutdown_connections 2024-09-10T10:11:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffb101df740 1 --2- 172.21.15.50:0/2800513860 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55920b998a00 0x55920b99adf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffb101df740 1 --2- 172.21.15.50:0/2800513860 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55920b91dd70 0x55920b921b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffb101df740 1 --2- 172.21.15.50:0/2800513860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55920b9134b0 0x55920b921650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffb101df740 1 --2- 172.21.15.50:0/2800513860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55920b912b90 0x55920b926320 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffb101df740 1 -- 172.21.15.50:0/2800513860 >> 172.21.15.50:0/2800513860 conn(0x55920b90f120 msgr2=0x55920b91b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffaf4c00640 0 client.15219 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffb101df740 1 -- 172.21.15.50:0/2800513860 shutdown_connections 2024-09-10T10:11:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffb101df740 1 -- 172.21.15.50:0/2800513860 wait complete. 2024-09-10T10:11:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.674+0000 7ffb101df740 20 client.15219 trim_cache size 0 max 16384 2024-09-10T10:11:29.678 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:11:29.678 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T10:11:29.679 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-10T10:11:29.679 INFO:teuthology.orchestra.run.smithi050.stdout: "5f603fda-5bcd-4c73-b04a-8a71aa2d5ba1": { 2024-09-10T10:11:29.679 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-10T10:11:29.679 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "5f603fda-5bcd-4c73-b04a-8a71aa2d5ba1", 2024-09-10T10:11:29.679 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2024-09-10T10:11:29.679 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:11:29.679 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:11:29.679 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:11:29.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.675+0000 7ffb0d800640 1 -- 172.21.15.50:0/3617763756 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffaec0a2b80 msgr2=0x7ffaec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:29.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.675+0000 7ffb0d800640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffaec0a2b80 0x7ffaec0a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80986b0 tx=0x7ffaf80d5530 comp rx=0 tx=0).stop 2024-09-10T10:11:29.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.675+0000 7ffb0d800640 1 -- 172.21.15.50:0/3617763756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb08103ff0 msgr2=0x7ffb0819a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:29.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.675+0000 7ffb0d800640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb08103ff0 0x7ffb0819a5e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800e9f0 tx=0x7ffaf800eeb0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.675+0000 7ffb0d800640 1 -- 172.21.15.50:0/3617763756 shutdown_connections 2024-09-10T10:11:29.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.675+0000 7ffb0d800640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ffaec0a2b80 0x7ffaec0a5040 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.675+0000 7ffb0d800640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb08109120 0x7ffb0819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.675+0000 7ffb0d800640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb081049a0 0x7ffb0819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.675+0000 7ffb0d800640 1 --2- 172.21.15.50:0/3617763756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb08103ff0 0x7ffb0819a5e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:29.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.675+0000 7ffb0d800640 1 -- 172.21.15.50:0/3617763756 >> 172.21.15.50:0/3617763756 conn(0x7ffb080ffa90 msgr2=0x7ffb081005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.676+0000 7ffb0d800640 1 -- 172.21.15.50:0/3617763756 shutdown_connections 2024-09-10T10:11:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:29.676+0000 7ffb0d800640 1 -- 172.21.15.50:0/3617763756 wait complete. 2024-09-10T10:11:29.887 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:30.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:30 smithi084 ceph-mon[34812]: pgmap v400: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:11:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:30 smithi050 ceph-mon[30354]: pgmap v400: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:11:30.586 INFO:tasks.cephfs.filesystem:scrub status for tag:5f603fda-5bcd-4c73-b04a-8a71aa2d5ba1 - {'path': '/', 'tag': '5f603fda-5bcd-4c73-b04a-8a71aa2d5ba1', 'options': 'recursive,force'} 2024-09-10T10:11:30.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:30 smithi189 ceph-mon[34999]: pgmap v400: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:11:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.082+0000 7f3647800640 1 -- 172.21.15.50:0/2170401228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3640074590 msgr2=0x7f3640074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:31.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.082+0000 7f3647800640 1 --2- 172.21.15.50:0/2170401228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3640074590 0x7f3640074970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3634009860 tx=0x7f363402a3d0 comp rx=0 tx=0).stop 2024-09-10T10:11:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.082+0000 7f3647800640 1 -- 172.21.15.50:0/2170401228 shutdown_connections 2024-09-10T10:11:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.082+0000 7f3647800640 1 --2- 172.21.15.50:0/2170401228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3640112b90 0x7f3640114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.082+0000 7f3647800640 1 --2- 172.21.15.50:0/2170401228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3640074eb0 0x7f3640112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.082+0000 7f3647800640 1 --2- 172.21.15.50:0/2170401228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3640074590 0x7f3640074970 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.082+0000 7f3647800640 1 -- 172.21.15.50:0/2170401228 >> 172.21.15.50:0/2170401228 conn(0x7f36400fd8c0 msgr2=0x7f36400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.082+0000 7f3647800640 1 -- 172.21.15.50:0/2170401228 shutdown_connections 2024-09-10T10:11:31.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.082+0000 7f3647800640 1 -- 172.21.15.50:0/2170401228 wait complete. 2024-09-10T10:11:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.083+0000 7f3647800640 1 Processor -- start 2024-09-10T10:11:31.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.083+0000 7f3647800640 1 -- start start 2024-09-10T10:11:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.083+0000 7f3647800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3640074590 0x7f36401a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.083+0000 7f3647800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3640074eb0 0x7f36401a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.083+0000 7f3647800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3640112b90 0x7f364019e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.083+0000 7f3647800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f36401185a0 con 0x7f3640074590 2024-09-10T10:11:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.083+0000 7f3647800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3640118420 con 0x7f3640074eb0 2024-09-10T10:11:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.083+0000 7f3647800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3640118720 con 0x7f3640112b90 2024-09-10T10:11:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.084+0000 7f3644e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3640074590 0x7f36401a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.084+0000 7f363fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3640074eb0 0x7f36401a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.084+0000 7f3644e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3640074590 0x7f36401a4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60002/0 (socket says 172.21.15.50:60002) 2024-09-10T10:11:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.084+0000 7f3644e00640 1 -- 172.21.15.50:0/4050580472 learned_addr learned my addr 172.21.15.50:0/4050580472 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:31.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.084+0000 7f3645800640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3640112b90 0x7f364019e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.084+0000 7f363fe00640 1 -- 172.21.15.50:0/4050580472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3640112b90 msgr2=0x7f364019e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.084+0000 7f363fe00640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3640112b90 0x7f364019e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.084+0000 7f363fe00640 1 -- 172.21.15.50:0/4050580472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3640074590 msgr2=0x7f36401a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.084+0000 7f363fe00640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3640074590 0x7f36401a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.084+0000 7f363fe00640 1 -- 172.21.15.50:0/4050580472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364019f080 con 0x7f3640074eb0 2024-09-10T10:11:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.084+0000 7f3645800640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3640112b90 0x7f364019e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:11:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.084+0000 7f3644e00640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3640074590 0x7f36401a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:31.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.085+0000 7f363fe00640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3640074eb0 0x7f36401a4cd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f362c005fd0 tx=0x7f362c00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.085+0000 7f363d600640 1 -- 172.21.15.50:0/4050580472 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c009c30 con 0x7f3640074eb0 2024-09-10T10:11:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.085+0000 7f3647800640 1 -- 172.21.15.50:0/4050580472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364019f370 con 0x7f3640074eb0 2024-09-10T10:11:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.085+0000 7f363d600640 1 -- 172.21.15.50:0/4050580472 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f362c009dd0 con 0x7f3640074eb0 2024-09-10T10:11:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.085+0000 7f363d600640 1 -- 172.21.15.50:0/4050580472 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c010460 con 0x7f3640074eb0 2024-09-10T10:11:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.085+0000 7f3647800640 1 -- 172.21.15.50:0/4050580472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36401ab660 con 0x7f3640074eb0 2024-09-10T10:11:31.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.086+0000 7f3647800640 1 -- 172.21.15.50:0/4050580472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3640074970 con 0x7f3640074eb0 2024-09-10T10:11:31.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.088+0000 7f363d600640 1 -- 172.21.15.50:0/4050580472 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f362c003f50 con 0x7f3640074eb0 2024-09-10T10:11:31.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.090+0000 7f363d600640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f36280a2b80 0x7f36280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:31.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.090+0000 7f363d600640 1 -- 172.21.15.50:0/4050580472 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f362c0cf370 con 0x7f3640074eb0 2024-09-10T10:11:31.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.090+0000 7f3644e00640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f36280a2b80 0x7f36280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:31.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.091+0000 7f3644e00640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f36280a2b80 0x7f36280a5040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f36340095f0 tx=0x7f3634005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:31.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.093+0000 7f363d600640 1 -- 172.21.15.50:0/4050580472 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f362c017020 con 0x7f3640074eb0 2024-09-10T10:11:31.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.277+0000 7f3647800640 1 -- 172.21.15.50:0/4050580472 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3640062630 con 0x7f36280a2b80 2024-09-10T10:11:31.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.286+0000 7f363d600640 1 -- 172.21.15.50:0/4050580472 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340754 (secure 0 0 0) 0x7f3640062630 con 0x7f36280a2b80 2024-09-10T10:11:31.291 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:31.293 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-10T10:11:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.291+0000 7f3647800640 1 -- 172.21.15.50:0/4050580472 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f36280a2b80 msgr2=0x7f36280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.291+0000 7f3647800640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f36280a2b80 0x7f36280a5040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f36340095f0 tx=0x7f3634005cb0 comp rx=0 tx=0).stop 2024-09-10T10:11:31.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.291+0000 7f3647800640 1 -- 172.21.15.50:0/4050580472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3640074eb0 msgr2=0x7f36401a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.291+0000 7f3647800640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3640074eb0 0x7f36401a4cd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f362c005fd0 tx=0x7f362c00dde0 comp rx=0 tx=0).stop 2024-09-10T10:11:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.291+0000 7f3647800640 1 -- 172.21.15.50:0/4050580472 shutdown_connections 2024-09-10T10:11:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.291+0000 7f3647800640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f36280a2b80 0x7f36280a5040 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.291+0000 7f3647800640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3640112b90 0x7f364019e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.291+0000 7f3647800640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3640074eb0 0x7f36401a4cd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.291+0000 7f3647800640 1 --2- 172.21.15.50:0/4050580472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3640074590 0x7f36401a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.291+0000 7f3647800640 1 -- 172.21.15.50:0/4050580472 >> 172.21.15.50:0/4050580472 conn(0x7f36400fd8c0 msgr2=0x7f36400ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.291+0000 7f3647800640 1 -- 172.21.15.50:0/4050580472 shutdown_connections 2024-09-10T10:11:31.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:31.291+0000 7f3647800640 1 -- 172.21.15.50:0/4050580472 wait complete. 2024-09-10T10:11:32.104 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":401,"stamp":"2024-09-10T10:11:30.807824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663289,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":886,"num_read_kb":566,"num_write":366,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":795,"ondisk_log_size":795,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366112,"kb_used_data":12704,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575712,"statfs":{"total":1151940427776,"available":1151565529088,"internally_reserved":0,"allocated":13008896,"data_stored":8425013,"data_compressed":498339,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5373,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":37,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003297"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:38.961695+0000","last_change":"2024-09-10T10:08:32.889755+0000","last_active":"2024-09-10T10:10:38.961695+0000","last_peered":"2024-09-10T10:10:38.961695+0000","last_clean":"2024-09-10T10:10:38.961695+0000","last_became_active":"2024-09-10T10:08:32.889455+0000","last_became_peered":"2024-09-10T10:08:32.889455+0000","last_unstale":"2024-09-10T10:10:38.961695+0000","last_undegraded":"2024-09-10T10:10:38.961695+0000","last_fullsized":"2024-09-10T10:10:38.961695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:53.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"95'5","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.760977+0000","last_change":"2024-09-10T10:10:00.974216+0000","last_active":"2024-09-10T10:10:58.760977+0000","last_peered":"2024-09-10T10:10:58.760977+0000","last_clean":"2024-09-10T10:10:58.760977+0000","last_became_active":"2024-09-10T10:10:00.973841+0000","last_became_peered":"2024-09-10T10:10:00.973841+0000","last_unstale":"2024-09-10T10:10:58.760977+0000","last_undegraded":"2024-09-10T10:10:58.760977+0000","last_fullsized":"2024-09-10T10:10:58.760977+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:30.575610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972516+0000","last_change":"2024-09-10T10:08:44.399836+0000","last_active":"2024-09-10T10:10:00.972516+0000","last_peered":"2024-09-10T10:10:00.972516+0000","last_clean":"2024-09-10T10:10:00.972516+0000","last_became_active":"2024-09-10T10:08:44.399510+0000","last_became_peered":"2024-09-10T10:08:44.399510+0000","last_unstale":"2024-09-10T10:10:00.972516+0000","last_undegraded":"2024-09-10T10:10:00.972516+0000","last_fullsized":"2024-09-10T10:10:00.972516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:47.372690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722255+0000","last_change":"2024-09-10T10:08:32.887099+0000","last_active":"2024-09-10T10:10:00.722255+0000","last_peered":"2024-09-10T10:10:00.722255+0000","last_clean":"2024-09-10T10:10:00.722255+0000","last_became_active":"2024-09-10T10:08:32.886730+0000","last_became_peered":"2024-09-10T10:08:32.886730+0000","last_unstale":"2024-09-10T10:10:00.722255+0000","last_undegraded":"2024-09-10T10:10:00.722255+0000","last_fullsized":"2024-09-10T10:10:00.722255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.277241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.777729+0000","last_change":"2024-09-10T10:08:35.375494+0000","last_active":"2024-09-10T10:10:58.777729+0000","last_peered":"2024-09-10T10:10:58.777729+0000","last_clean":"2024-09-10T10:10:58.777729+0000","last_became_active":"2024-09-10T10:08:35.373991+0000","last_became_peered":"2024-09-10T10:08:35.373991+0000","last_unstale":"2024-09-10T10:10:58.777729+0000","last_undegraded":"2024-09-10T10:10:58.777729+0000","last_fullsized":"2024-09-10T10:10:58.777729+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:25.858163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721597+0000","last_change":"2024-09-10T10:09:00.457967+0000","last_active":"2024-09-10T10:10:00.721597+0000","last_peered":"2024-09-10T10:10:00.721597+0000","last_clean":"2024-09-10T10:10:00.721597+0000","last_became_active":"2024-09-10T10:09:00.457446+0000","last_became_peered":"2024-09-10T10:09:00.457446+0000","last_unstale":"2024-09-10T10:10:00.721597+0000","last_undegraded":"2024-09-10T10:10:00.721597+0000","last_fullsized":"2024-09-10T10:10:00.721597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:00.550304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722817+0000","last_change":"2024-09-10T10:08:32.890270+0000","last_active":"2024-09-10T10:10:00.722817+0000","last_peered":"2024-09-10T10:10:00.722817+0000","last_clean":"2024-09-10T10:10:00.722817+0000","last_became_active":"2024-09-10T10:08:32.889887+0000","last_became_peered":"2024-09-10T10:08:32.889887+0000","last_unstale":"2024-09-10T10:10:00.722817+0000","last_undegraded":"2024-09-10T10:10:00.722817+0000","last_fullsized":"2024-09-10T10:10:00.722817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:39.757510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774008+0000","last_change":"2024-09-10T10:08:35.357257+0000","last_active":"2024-09-10T10:10:58.774008+0000","last_peered":"2024-09-10T10:10:58.774008+0000","last_clean":"2024-09-10T10:10:58.774008+0000","last_became_active":"2024-09-10T10:08:35.356918+0000","last_became_peered":"2024-09-10T10:08:35.356918+0000","last_unstale":"2024-09-10T10:10:58.774008+0000","last_undegraded":"2024-09-10T10:10:58.774008+0000","last_fullsized":"2024-09-10T10:10:58.774008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:04.387581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722105+0000","last_change":"2024-09-10T10:09:00.487116+0000","last_active":"2024-09-10T10:10:00.722105+0000","last_peered":"2024-09-10T10:10:00.722105+0000","last_clean":"2024-09-10T10:10:00.722105+0000","last_became_active":"2024-09-10T10:09:00.486646+0000","last_became_peered":"2024-09-10T10:09:00.486646+0000","last_unstale":"2024-09-10T10:10:00.722105+0000","last_undegraded":"2024-09-10T10:10:00.722105+0000","last_fullsized":"2024-09-10T10:10:00.722105+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:40.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722877+0000","last_change":"2024-09-10T10:08:32.891399+0000","last_active":"2024-09-10T10:10:00.722877+0000","last_peered":"2024-09-10T10:10:00.722877+0000","last_clean":"2024-09-10T10:10:00.722877+0000","last_became_active":"2024-09-10T10:08:32.891022+0000","last_became_peered":"2024-09-10T10:08:32.891022+0000","last_unstale":"2024-09-10T10:10:00.722877+0000","last_undegraded":"2024-09-10T10:10:00.722877+0000","last_fullsized":"2024-09-10T10:10:00.722877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:30.842443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771765+0000","last_change":"2024-09-10T10:08:35.370630+0000","last_active":"2024-09-10T10:10:58.771765+0000","last_peered":"2024-09-10T10:10:58.771765+0000","last_clean":"2024-09-10T10:10:58.771765+0000","last_became_active":"2024-09-10T10:08:35.370263+0000","last_became_peered":"2024-09-10T10:08:35.370263+0000","last_unstale":"2024-09-10T10:10:58.771765+0000","last_undegraded":"2024-09-10T10:10:58.771765+0000","last_fullsized":"2024-09-10T10:10:58.771765+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:41.549815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721697+0000","last_change":"2024-09-10T10:08:44.405298+0000","last_active":"2024-09-10T10:10:00.721697+0000","last_peered":"2024-09-10T10:10:00.721697+0000","last_clean":"2024-09-10T10:10:00.721697+0000","last_became_active":"2024-09-10T10:08:44.405027+0000","last_became_peered":"2024-09-10T10:08:44.405027+0000","last_unstale":"2024-09-10T10:10:00.721697+0000","last_undegraded":"2024-09-10T10:10:00.721697+0000","last_fullsized":"2024-09-10T10:10:00.721697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:08.486563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776546+0000","last_change":"2024-09-10T10:08:35.369040+0000","last_active":"2024-09-10T10:10:58.776546+0000","last_peered":"2024-09-10T10:10:58.776546+0000","last_clean":"2024-09-10T10:10:58.776546+0000","last_became_active":"2024-09-10T10:08:35.368576+0000","last_became_peered":"2024-09-10T10:08:35.368576+0000","last_unstale":"2024-09-10T10:10:58.776546+0000","last_undegraded":"2024-09-10T10:10:58.776546+0000","last_fullsized":"2024-09-10T10:10:58.776546+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:44.887554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722399+0000","last_change":"2024-09-10T10:08:32.889549+0000","last_active":"2024-09-10T10:10:00.722399+0000","last_peered":"2024-09-10T10:10:00.722399+0000","last_clean":"2024-09-10T10:10:00.722399+0000","last_became_active":"2024-09-10T10:08:32.889197+0000","last_became_peered":"2024-09-10T10:08:32.889197+0000","last_unstale":"2024-09-10T10:10:00.722399+0000","last_undegraded":"2024-09-10T10:10:00.722399+0000","last_fullsized":"2024-09-10T10:10:00.722399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:53.697069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721966+0000","last_change":"2024-09-10T10:08:44.929048+0000","last_active":"2024-09-10T10:10:00.721966+0000","last_peered":"2024-09-10T10:10:00.721966+0000","last_clean":"2024-09-10T10:10:00.721966+0000","last_became_active":"2024-09-10T10:08:44.928345+0000","last_became_peered":"2024-09-10T10:08:44.928345+0000","last_unstale":"2024-09-10T10:10:00.721966+0000","last_undegraded":"2024-09-10T10:10:00.721966+0000","last_fullsized":"2024-09-10T10:10:00.721966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:23.121853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776712+0000","last_change":"2024-09-10T10:08:35.377385+0000","last_active":"2024-09-10T10:10:58.776712+0000","last_peered":"2024-09-10T10:10:58.776712+0000","last_clean":"2024-09-10T10:10:58.776712+0000","last_became_active":"2024-09-10T10:08:35.377092+0000","last_became_peered":"2024-09-10T10:08:35.377092+0000","last_unstale":"2024-09-10T10:10:58.776712+0000","last_undegraded":"2024-09-10T10:10:58.776712+0000","last_fullsized":"2024-09-10T10:10:58.776712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:23.169370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972319+0000","last_change":"2024-09-10T10:08:32.891614+0000","last_active":"2024-09-10T10:10:00.972319+0000","last_peered":"2024-09-10T10:10:00.972319+0000","last_clean":"2024-09-10T10:10:00.972319+0000","last_became_active":"2024-09-10T10:08:32.891141+0000","last_became_peered":"2024-09-10T10:08:32.891141+0000","last_unstale":"2024-09-10T10:10:00.972319+0000","last_undegraded":"2024-09-10T10:10:00.972319+0000","last_fullsized":"2024-09-10T10:10:00.972319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:20.258863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721932+0000","last_change":"2024-09-10T10:08:44.401125+0000","last_active":"2024-09-10T10:10:00.721932+0000","last_peered":"2024-09-10T10:10:00.721932+0000","last_clean":"2024-09-10T10:10:00.721932+0000","last_became_active":"2024-09-10T10:08:44.400483+0000","last_became_peered":"2024-09-10T10:08:44.400483+0000","last_unstale":"2024-09-10T10:10:00.721932+0000","last_undegraded":"2024-09-10T10:10:00.721932+0000","last_fullsized":"2024-09-10T10:10:00.721932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:12.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766815+0000","last_change":"2024-09-10T10:08:35.376806+0000","last_active":"2024-09-10T10:10:58.766815+0000","last_peered":"2024-09-10T10:10:58.766815+0000","last_clean":"2024-09-10T10:10:58.766815+0000","last_became_active":"2024-09-10T10:08:35.376400+0000","last_became_peered":"2024-09-10T10:08:35.376400+0000","last_unstale":"2024-09-10T10:10:58.766815+0000","last_undegraded":"2024-09-10T10:10:58.766815+0000","last_fullsized":"2024-09-10T10:10:58.766815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:48.303039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721567+0000","last_change":"2024-09-10T10:08:32.883881+0000","last_active":"2024-09-10T10:10:00.721567+0000","last_peered":"2024-09-10T10:10:00.721567+0000","last_clean":"2024-09-10T10:10:00.721567+0000","last_became_active":"2024-09-10T10:08:32.883540+0000","last_became_peered":"2024-09-10T10:08:32.883540+0000","last_unstale":"2024-09-10T10:10:00.721567+0000","last_undegraded":"2024-09-10T10:10:00.721567+0000","last_fullsized":"2024-09-10T10:10:00.721567+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:57.359729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724324+0000","last_change":"2024-09-10T10:08:44.401548+0000","last_active":"2024-09-10T10:10:00.724324+0000","last_peered":"2024-09-10T10:10:00.724324+0000","last_clean":"2024-09-10T10:10:00.724324+0000","last_became_active":"2024-09-10T10:08:44.401034+0000","last_became_peered":"2024-09-10T10:08:44.401034+0000","last_unstale":"2024-09-10T10:10:00.724324+0000","last_undegraded":"2024-09-10T10:10:00.724324+0000","last_fullsized":"2024-09-10T10:10:00.724324+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:17.292973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"95'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.760304+0000","last_change":"2024-09-10T10:08:35.359969+0000","last_active":"2024-09-10T10:10:58.760304+0000","last_peered":"2024-09-10T10:10:58.760304+0000","last_clean":"2024-09-10T10:10:58.760304+0000","last_became_active":"2024-09-10T10:08:35.359599+0000","last_became_peered":"2024-09-10T10:08:35.359599+0000","last_unstale":"2024-09-10T10:10:58.760304+0000","last_undegraded":"2024-09-10T10:10:58.760304+0000","last_fullsized":"2024-09-10T10:10:58.760304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:00.778269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862147+0000","last_change":"2024-09-10T10:09:00.487582+0000","last_active":"2024-09-10T10:10:00.862147+0000","last_peered":"2024-09-10T10:10:00.862147+0000","last_clean":"2024-09-10T10:10:00.862147+0000","last_became_active":"2024-09-10T10:09:00.487229+0000","last_became_peered":"2024-09-10T10:09:00.487229+0000","last_unstale":"2024-09-10T10:10:00.862147+0000","last_undegraded":"2024-09-10T10:10:00.862147+0000","last_fullsized":"2024-09-10T10:10:00.862147+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:53.341736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722077+0000","last_change":"2024-09-10T10:08:44.929224+0000","last_active":"2024-09-10T10:10:00.722077+0000","last_peered":"2024-09-10T10:10:00.722077+0000","last_clean":"2024-09-10T10:10:00.722077+0000","last_became_active":"2024-09-10T10:08:44.928640+0000","last_became_peered":"2024-09-10T10:08:44.928640+0000","last_unstale":"2024-09-10T10:10:00.722077+0000","last_undegraded":"2024-09-10T10:10:00.722077+0000","last_fullsized":"2024-09-10T10:10:00.722077+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:42.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778123+0000","last_change":"2024-09-10T10:08:35.376585+0000","last_active":"2024-09-10T10:10:58.778123+0000","last_peered":"2024-09-10T10:10:58.778123+0000","last_clean":"2024-09-10T10:10:58.778123+0000","last_became_active":"2024-09-10T10:08:35.375693+0000","last_became_peered":"2024-09-10T10:08:35.375693+0000","last_unstale":"2024-09-10T10:10:58.778123+0000","last_undegraded":"2024-09-10T10:10:58.778123+0000","last_fullsized":"2024-09-10T10:10:58.778123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:59.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722314+0000","last_change":"2024-09-10T10:08:32.884542+0000","last_active":"2024-09-10T10:10:00.722314+0000","last_peered":"2024-09-10T10:10:00.722314+0000","last_clean":"2024-09-10T10:10:00.722314+0000","last_became_active":"2024-09-10T10:08:32.884192+0000","last_became_peered":"2024-09-10T10:08:32.884192+0000","last_unstale":"2024-09-10T10:10:00.722314+0000","last_undegraded":"2024-09-10T10:10:00.722314+0000","last_fullsized":"2024-09-10T10:10:00.722314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:57.756641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972690+0000","last_change":"2024-09-10T10:08:44.391514+0000","last_active":"2024-09-10T10:10:00.972690+0000","last_peered":"2024-09-10T10:10:00.972690+0000","last_clean":"2024-09-10T10:10:00.972690+0000","last_became_active":"2024-09-10T10:08:44.391116+0000","last_became_peered":"2024-09-10T10:08:44.391116+0000","last_unstale":"2024-09-10T10:10:00.972690+0000","last_undegraded":"2024-09-10T10:10:00.972690+0000","last_fullsized":"2024-09-10T10:10:00.972690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:41.586014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.768916+0000","last_change":"2024-09-10T10:08:35.365604+0000","last_active":"2024-09-10T10:10:58.768916+0000","last_peered":"2024-09-10T10:10:58.768916+0000","last_clean":"2024-09-10T10:10:58.768916+0000","last_became_active":"2024-09-10T10:08:35.364915+0000","last_became_peered":"2024-09-10T10:08:35.364915+0000","last_unstale":"2024-09-10T10:10:58.768916+0000","last_undegraded":"2024-09-10T10:10:58.768916+0000","last_fullsized":"2024-09-10T10:10:58.768916+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:12.885021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'13","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:59.381750+0000","last_change":"2024-09-10T10:08:32.888223+0000","last_active":"2024-09-10T10:10:59.381750+0000","last_peered":"2024-09-10T10:10:59.381750+0000","last_clean":"2024-09-10T10:10:59.381750+0000","last_became_active":"2024-09-10T10:08:32.887919+0000","last_became_peered":"2024-09-10T10:08:32.887919+0000","last_unstale":"2024-09-10T10:10:59.381750+0000","last_undegraded":"2024-09-10T10:10:59.381750+0000","last_fullsized":"2024-09-10T10:10:59.381750+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:19.781337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721073+0000","last_change":"2024-09-10T10:08:44.929322+0000","last_active":"2024-09-10T10:10:00.721073+0000","last_peered":"2024-09-10T10:10:00.721073+0000","last_clean":"2024-09-10T10:10:00.721073+0000","last_became_active":"2024-09-10T10:08:44.928252+0000","last_became_peered":"2024-09-10T10:08:44.928252+0000","last_unstale":"2024-09-10T10:10:00.721073+0000","last_undegraded":"2024-09-10T10:10:00.721073+0000","last_fullsized":"2024-09-10T10:10:00.721073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:33.048265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762075+0000","last_change":"2024-09-10T10:08:35.364168+0000","last_active":"2024-09-10T10:10:58.762075+0000","last_peered":"2024-09-10T10:10:58.762075+0000","last_clean":"2024-09-10T10:10:58.762075+0000","last_became_active":"2024-09-10T10:08:35.363739+0000","last_became_peered":"2024-09-10T10:08:35.363739+0000","last_unstale":"2024-09-10T10:10:58.762075+0000","last_undegraded":"2024-09-10T10:10:58.762075+0000","last_fullsized":"2024-09-10T10:10:58.762075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:43.029409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722836+0000","last_change":"2024-09-10T10:08:32.893021+0000","last_active":"2024-09-10T10:10:00.722836+0000","last_peered":"2024-09-10T10:10:00.722836+0000","last_clean":"2024-09-10T10:10:00.722836+0000","last_became_active":"2024-09-10T10:08:32.892667+0000","last_became_peered":"2024-09-10T10:08:32.892667+0000","last_unstale":"2024-09-10T10:10:00.722836+0000","last_undegraded":"2024-09-10T10:10:00.722836+0000","last_fullsized":"2024-09-10T10:10:00.722836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:52.427489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185575+0000","last_change":"2024-09-10T10:08:44.393831+0000","last_active":"2024-09-10T10:10:01.185575+0000","last_peered":"2024-09-10T10:10:01.185575+0000","last_clean":"2024-09-10T10:10:01.185575+0000","last_became_active":"2024-09-10T10:08:44.393415+0000","last_became_peered":"2024-09-10T10:08:44.393415+0000","last_unstale":"2024-09-10T10:10:01.185575+0000","last_undegraded":"2024-09-10T10:10:01.185575+0000","last_fullsized":"2024-09-10T10:10:01.185575+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:52.171292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769530+0000","last_change":"2024-09-10T10:08:35.374787+0000","last_active":"2024-09-10T10:10:58.769530+0000","last_peered":"2024-09-10T10:10:58.769530+0000","last_clean":"2024-09-10T10:10:58.769530+0000","last_became_active":"2024-09-10T10:08:35.374549+0000","last_became_peered":"2024-09-10T10:08:35.374549+0000","last_unstale":"2024-09-10T10:10:58.769530+0000","last_undegraded":"2024-09-10T10:10:58.769530+0000","last_fullsized":"2024-09-10T10:10:58.769530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:58.925515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724437+0000","last_change":"2024-09-10T10:08:32.886267+0000","last_active":"2024-09-10T10:10:00.724437+0000","last_peered":"2024-09-10T10:10:00.724437+0000","last_clean":"2024-09-10T10:10:00.724437+0000","last_became_active":"2024-09-10T10:08:32.885869+0000","last_became_peered":"2024-09-10T10:08:32.885869+0000","last_unstale":"2024-09-10T10:10:00.724437+0000","last_undegraded":"2024-09-10T10:10:00.724437+0000","last_fullsized":"2024-09-10T10:10:00.724437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:06.784839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722243+0000","last_change":"2024-09-10T10:09:00.486656+0000","last_active":"2024-09-10T10:10:00.722243+0000","last_peered":"2024-09-10T10:10:00.722243+0000","last_clean":"2024-09-10T10:10:00.722243+0000","last_became_active":"2024-09-10T10:09:00.486072+0000","last_became_peered":"2024-09-10T10:09:00.486072+0000","last_unstale":"2024-09-10T10:10:00.722243+0000","last_undegraded":"2024-09-10T10:10:00.722243+0000","last_fullsized":"2024-09-10T10:10:00.722243+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:26.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767023+0000","last_change":"2024-09-10T10:08:35.366130+0000","last_active":"2024-09-10T10:10:58.767023+0000","last_peered":"2024-09-10T10:10:58.767023+0000","last_clean":"2024-09-10T10:10:58.767023+0000","last_became_active":"2024-09-10T10:08:35.365785+0000","last_became_peered":"2024-09-10T10:08:35.365785+0000","last_unstale":"2024-09-10T10:10:58.767023+0000","last_undegraded":"2024-09-10T10:10:58.767023+0000","last_fullsized":"2024-09-10T10:10:58.767023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:35.771767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184987+0000","last_change":"2024-09-10T10:08:32.884113+0000","last_active":"2024-09-10T10:10:01.184987+0000","last_peered":"2024-09-10T10:10:01.184987+0000","last_clean":"2024-09-10T10:10:01.184987+0000","last_became_active":"2024-09-10T10:08:32.883503+0000","last_became_peered":"2024-09-10T10:08:32.883503+0000","last_unstale":"2024-09-10T10:10:01.184987+0000","last_undegraded":"2024-09-10T10:10:01.184987+0000","last_fullsized":"2024-09-10T10:10:01.184987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:20.513465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040285+0000","last_change":"2024-09-10T10:08:44.400137+0000","last_active":"2024-09-10T10:10:01.040285+0000","last_peered":"2024-09-10T10:10:01.040285+0000","last_clean":"2024-09-10T10:10:01.040285+0000","last_became_active":"2024-09-10T10:08:44.398736+0000","last_became_peered":"2024-09-10T10:08:44.398736+0000","last_unstale":"2024-09-10T10:10:01.040285+0000","last_undegraded":"2024-09-10T10:10:01.040285+0000","last_fullsized":"2024-09-10T10:10:01.040285+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:48.922732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.756485+0000","last_change":"2024-09-10T10:08:35.360818+0000","last_active":"2024-09-10T10:10:58.756485+0000","last_peered":"2024-09-10T10:10:58.756485+0000","last_clean":"2024-09-10T10:10:58.756485+0000","last_became_active":"2024-09-10T10:08:35.360504+0000","last_became_peered":"2024-09-10T10:08:35.360504+0000","last_unstale":"2024-09-10T10:10:58.756485+0000","last_undegraded":"2024-09-10T10:10:58.756485+0000","last_fullsized":"2024-09-10T10:10:58.756485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:45.396069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"95'5","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:25.715829+0000","last_change":"2024-09-10T10:08:32.883915+0000","last_active":"2024-09-10T10:11:25.715829+0000","last_peered":"2024-09-10T10:11:25.715829+0000","last_clean":"2024-09-10T10:11:25.715829+0000","last_became_active":"2024-09-10T10:08:32.883573+0000","last_became_peered":"2024-09-10T10:08:32.883573+0000","last_unstale":"2024-09-10T10:11:25.715829+0000","last_undegraded":"2024-09-10T10:11:25.715829+0000","last_fullsized":"2024-09-10T10:11:25.715829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:56.271267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040574+0000","last_change":"2024-09-10T10:08:44.928968+0000","last_active":"2024-09-10T10:10:01.040574+0000","last_peered":"2024-09-10T10:10:01.040574+0000","last_clean":"2024-09-10T10:10:01.040574+0000","last_became_active":"2024-09-10T10:08:44.928445+0000","last_became_peered":"2024-09-10T10:08:44.928445+0000","last_unstale":"2024-09-10T10:10:01.040574+0000","last_undegraded":"2024-09-10T10:10:01.040574+0000","last_fullsized":"2024-09-10T10:10:01.040574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:01.799454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.748248+0000","last_change":"2024-09-10T10:08:35.369027+0000","last_active":"2024-09-10T10:10:58.748248+0000","last_peered":"2024-09-10T10:10:58.748248+0000","last_clean":"2024-09-10T10:10:58.748248+0000","last_became_active":"2024-09-10T10:08:35.368692+0000","last_became_peered":"2024-09-10T10:08:35.368692+0000","last_unstale":"2024-09-10T10:10:58.748248+0000","last_undegraded":"2024-09-10T10:10:58.748248+0000","last_fullsized":"2024-09-10T10:10:58.748248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:09.500617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184814+0000","last_change":"2024-09-10T10:08:32.888661+0000","last_active":"2024-09-10T10:10:01.184814+0000","last_peered":"2024-09-10T10:10:01.184814+0000","last_clean":"2024-09-10T10:10:01.184814+0000","last_became_active":"2024-09-10T10:08:32.888312+0000","last_became_peered":"2024-09-10T10:08:32.888312+0000","last_unstale":"2024-09-10T10:10:01.184814+0000","last_undegraded":"2024-09-10T10:10:01.184814+0000","last_fullsized":"2024-09-10T10:10:01.184814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:47.293560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840405+0000","last_change":"2024-09-10T10:08:44.929512+0000","last_active":"2024-09-10T10:10:00.840405+0000","last_peered":"2024-09-10T10:10:00.840405+0000","last_clean":"2024-09-10T10:10:00.840405+0000","last_became_active":"2024-09-10T10:08:44.928992+0000","last_became_peered":"2024-09-10T10:08:44.928992+0000","last_unstale":"2024-09-10T10:10:00.840405+0000","last_undegraded":"2024-09-10T10:10:00.840405+0000","last_fullsized":"2024-09-10T10:10:00.840405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:31.827967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'8","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766202+0000","last_change":"2024-09-10T10:10:00.863430+0000","last_active":"2024-09-10T10:10:58.766202+0000","last_peered":"2024-09-10T10:10:58.766202+0000","last_clean":"2024-09-10T10:10:58.766202+0000","last_became_active":"2024-09-10T10:10:00.863082+0000","last_became_peered":"2024-09-10T10:10:00.863082+0000","last_unstale":"2024-09-10T10:10:58.766202+0000","last_undegraded":"2024-09-10T10:10:58.766202+0000","last_fullsized":"2024-09-10T10:10:58.766202+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:24.848797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722248+0000","last_change":"2024-09-10T10:08:32.885451+0000","last_active":"2024-09-10T10:10:00.722248+0000","last_peered":"2024-09-10T10:10:00.722248+0000","last_clean":"2024-09-10T10:10:00.722248+0000","last_became_active":"2024-09-10T10:08:32.885102+0000","last_became_peered":"2024-09-10T10:08:32.885102+0000","last_unstale":"2024-09-10T10:10:00.722248+0000","last_undegraded":"2024-09-10T10:10:00.722248+0000","last_fullsized":"2024-09-10T10:10:00.722248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:52.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":356,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185287+0000","last_change":"2024-09-10T10:07:13.661841+0000","last_active":"2024-09-10T10:10:01.185287+0000","last_peered":"2024-09-10T10:10:01.185287+0000","last_clean":"2024-09-10T10:10:01.185287+0000","last_became_active":"2024-09-10T10:07:13.661310+0000","last_became_peered":"2024-09-10T10:07:13.661310+0000","last_unstale":"2024-09-10T10:10:01.185287+0000","last_undegraded":"2024-09-10T10:10:01.185287+0000","last_fullsized":"2024-09-10T10:10:01.185287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_clean_scrub_stamp":"2024-09-10T10:03:29.327083+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:39.414636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185638+0000","last_change":"2024-09-10T10:08:44.391277+0000","last_active":"2024-09-10T10:10:01.185638+0000","last_peered":"2024-09-10T10:10:01.185638+0000","last_clean":"2024-09-10T10:10:01.185638+0000","last_became_active":"2024-09-10T10:08:44.390867+0000","last_became_peered":"2024-09-10T10:08:44.390867+0000","last_unstale":"2024-09-10T10:10:01.185638+0000","last_undegraded":"2024-09-10T10:10:01.185638+0000","last_fullsized":"2024-09-10T10:10:01.185638+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:23.299812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772994+0000","last_change":"2024-09-10T10:08:35.364750+0000","last_active":"2024-09-10T10:10:58.772994+0000","last_peered":"2024-09-10T10:10:58.772994+0000","last_clean":"2024-09-10T10:10:58.772994+0000","last_became_active":"2024-09-10T10:08:35.364034+0000","last_became_peered":"2024-09-10T10:08:35.364034+0000","last_unstale":"2024-09-10T10:10:58.772994+0000","last_undegraded":"2024-09-10T10:10:58.772994+0000","last_fullsized":"2024-09-10T10:10:58.772994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:15.296086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973375+0000","last_change":"2024-09-10T10:08:32.886884+0000","last_active":"2024-09-10T10:10:00.973375+0000","last_peered":"2024-09-10T10:10:00.973375+0000","last_clean":"2024-09-10T10:10:00.973375+0000","last_became_active":"2024-09-10T10:08:32.886544+0000","last_became_peered":"2024-09-10T10:08:32.886544+0000","last_unstale":"2024-09-10T10:10:00.973375+0000","last_undegraded":"2024-09-10T10:10:00.973375+0000","last_fullsized":"2024-09-10T10:10:00.973375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:30.511881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862240+0000","last_change":"2024-09-10T10:08:44.390761+0000","last_active":"2024-09-10T10:10:00.862240+0000","last_peered":"2024-09-10T10:10:00.862240+0000","last_clean":"2024-09-10T10:10:00.862240+0000","last_became_active":"2024-09-10T10:08:44.390190+0000","last_became_peered":"2024-09-10T10:08:44.390190+0000","last_unstale":"2024-09-10T10:10:00.862240+0000","last_undegraded":"2024-09-10T10:10:00.862240+0000","last_fullsized":"2024-09-10T10:10:00.862240+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:38.216171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767507+0000","last_change":"2024-09-10T10:08:35.362956+0000","last_active":"2024-09-10T10:10:58.767507+0000","last_peered":"2024-09-10T10:10:58.767507+0000","last_clean":"2024-09-10T10:10:58.767507+0000","last_became_active":"2024-09-10T10:08:35.362623+0000","last_became_peered":"2024-09-10T10:08:35.362623+0000","last_unstale":"2024-09-10T10:10:58.767507+0000","last_undegraded":"2024-09-10T10:10:58.767507+0000","last_fullsized":"2024-09-10T10:10:58.767507+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:50.162838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840553+0000","last_change":"2024-09-10T10:08:32.889741+0000","last_active":"2024-09-10T10:10:00.840553+0000","last_peered":"2024-09-10T10:10:00.840553+0000","last_clean":"2024-09-10T10:10:00.840553+0000","last_became_active":"2024-09-10T10:08:32.889394+0000","last_became_peered":"2024-09-10T10:08:32.889394+0000","last_unstale":"2024-09-10T10:10:00.840553+0000","last_undegraded":"2024-09-10T10:10:00.840553+0000","last_fullsized":"2024-09-10T10:10:00.840553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:16.845738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938314+0000","last_change":"2024-09-10T10:08:44.403781+0000","last_active":"2024-09-10T10:10:00.938314+0000","last_peered":"2024-09-10T10:10:00.938314+0000","last_clean":"2024-09-10T10:10:00.938314+0000","last_became_active":"2024-09-10T10:08:44.399601+0000","last_became_peered":"2024-09-10T10:08:44.399601+0000","last_unstale":"2024-09-10T10:10:00.938314+0000","last_undegraded":"2024-09-10T10:10:00.938314+0000","last_fullsized":"2024-09-10T10:10:00.938314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:45.587247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765508+0000","last_change":"2024-09-10T10:08:35.367825+0000","last_active":"2024-09-10T10:10:58.765508+0000","last_peered":"2024-09-10T10:10:58.765508+0000","last_clean":"2024-09-10T10:10:58.765508+0000","last_became_active":"2024-09-10T10:08:35.367511+0000","last_became_peered":"2024-09-10T10:08:35.367511+0000","last_unstale":"2024-09-10T10:10:58.765508+0000","last_undegraded":"2024-09-10T10:10:58.765508+0000","last_fullsized":"2024-09-10T10:10:58.765508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:03.356912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039782+0000","last_change":"2024-09-10T10:08:32.888524+0000","last_active":"2024-09-10T10:10:01.039782+0000","last_peered":"2024-09-10T10:10:01.039782+0000","last_clean":"2024-09-10T10:10:01.039782+0000","last_became_active":"2024-09-10T10:08:32.888148+0000","last_became_peered":"2024-09-10T10:08:32.888148+0000","last_unstale":"2024-09-10T10:10:01.039782+0000","last_undegraded":"2024-09-10T10:10:01.039782+0000","last_fullsized":"2024-09-10T10:10:01.039782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:34.342167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839577+0000","last_change":"2024-09-10T10:08:44.392952+0000","last_active":"2024-09-10T10:10:00.839577+0000","last_peered":"2024-09-10T10:10:00.839577+0000","last_clean":"2024-09-10T10:10:00.839577+0000","last_became_active":"2024-09-10T10:08:44.392476+0000","last_became_peered":"2024-09-10T10:08:44.392476+0000","last_unstale":"2024-09-10T10:10:00.839577+0000","last_undegraded":"2024-09-10T10:10:00.839577+0000","last_fullsized":"2024-09-10T10:10:00.839577+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:26.530305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761361+0000","last_change":"2024-09-10T10:08:35.364501+0000","last_active":"2024-09-10T10:10:58.761361+0000","last_peered":"2024-09-10T10:10:58.761361+0000","last_clean":"2024-09-10T10:10:58.761361+0000","last_became_active":"2024-09-10T10:08:35.364102+0000","last_became_peered":"2024-09-10T10:08:35.364102+0000","last_unstale":"2024-09-10T10:10:58.761361+0000","last_undegraded":"2024-09-10T10:10:58.761361+0000","last_fullsized":"2024-09-10T10:10:58.761361+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:42.743140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":22,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185891+0000","last_change":"2024-09-10T10:09:00.461639+0000","last_active":"2024-09-10T10:10:01.185891+0000","last_peered":"2024-09-10T10:10:01.185891+0000","last_clean":"2024-09-10T10:10:01.185891+0000","last_became_active":"2024-09-10T10:09:00.457246+0000","last_became_peered":"2024-09-10T10:09:00.457246+0000","last_unstale":"2024-09-10T10:10:01.185891+0000","last_undegraded":"2024-09-10T10:10:01.185891+0000","last_fullsized":"2024-09-10T10:10:01.185891+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:30.387035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840110+0000","last_change":"2024-09-10T10:08:44.401728+0000","last_active":"2024-09-10T10:10:00.840110+0000","last_peered":"2024-09-10T10:10:00.840110+0000","last_clean":"2024-09-10T10:10:00.840110+0000","last_became_active":"2024-09-10T10:08:44.401334+0000","last_became_peered":"2024-09-10T10:08:44.401334+0000","last_unstale":"2024-09-10T10:10:00.840110+0000","last_undegraded":"2024-09-10T10:10:00.840110+0000","last_fullsized":"2024-09-10T10:10:00.840110+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:57.496196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"95'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769526+0000","last_change":"2024-09-10T10:09:00.486353+0000","last_active":"2024-09-10T10:10:58.769526+0000","last_peered":"2024-09-10T10:10:58.769526+0000","last_clean":"2024-09-10T10:10:58.769526+0000","last_became_active":"2024-09-10T10:09:00.485938+0000","last_became_peered":"2024-09-10T10:09:00.485938+0000","last_unstale":"2024-09-10T10:10:58.769526+0000","last_undegraded":"2024-09-10T10:10:58.769526+0000","last_fullsized":"2024-09-10T10:10:58.769526+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:38.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722331+0000","last_change":"2024-09-10T10:08:32.893278+0000","last_active":"2024-09-10T10:10:00.722331+0000","last_peered":"2024-09-10T10:10:00.722331+0000","last_clean":"2024-09-10T10:10:00.722331+0000","last_became_active":"2024-09-10T10:08:32.892848+0000","last_became_peered":"2024-09-10T10:08:32.892848+0000","last_unstale":"2024-09-10T10:10:00.722331+0000","last_undegraded":"2024-09-10T10:10:00.722331+0000","last_fullsized":"2024-09-10T10:10:00.722331+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:09.336253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040465+0000","last_change":"2024-09-10T10:08:44.407213+0000","last_active":"2024-09-10T10:10:01.040465+0000","last_peered":"2024-09-10T10:10:01.040465+0000","last_clean":"2024-09-10T10:10:01.040465+0000","last_became_active":"2024-09-10T10:08:44.405198+0000","last_became_peered":"2024-09-10T10:08:44.405198+0000","last_unstale":"2024-09-10T10:10:01.040465+0000","last_undegraded":"2024-09-10T10:10:01.040465+0000","last_fullsized":"2024-09-10T10:10:01.040465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:15.921684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767621+0000","last_change":"2024-09-10T10:08:35.362683+0000","last_active":"2024-09-10T10:10:58.767621+0000","last_peered":"2024-09-10T10:10:58.767621+0000","last_clean":"2024-09-10T10:10:58.767621+0000","last_became_active":"2024-09-10T10:08:35.362353+0000","last_became_peered":"2024-09-10T10:08:35.362353+0000","last_unstale":"2024-09-10T10:10:58.767621+0000","last_undegraded":"2024-09-10T10:10:58.767621+0000","last_fullsized":"2024-09-10T10:10:58.767621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.489716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"95'5","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:28.720691+0000","last_change":"2024-09-10T10:08:32.881024+0000","last_active":"2024-09-10T10:11:28.720691+0000","last_peered":"2024-09-10T10:11:28.720691+0000","last_clean":"2024-09-10T10:11:28.720691+0000","last_became_active":"2024-09-10T10:08:32.880691+0000","last_became_peered":"2024-09-10T10:08:32.880691+0000","last_unstale":"2024-09-10T10:11:28.720691+0000","last_undegraded":"2024-09-10T10:11:28.720691+0000","last_fullsized":"2024-09-10T10:11:28.720691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:15.988063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724443+0000","last_change":"2024-09-10T10:08:44.400509+0000","last_active":"2024-09-10T10:10:00.724443+0000","last_peered":"2024-09-10T10:10:00.724443+0000","last_clean":"2024-09-10T10:10:00.724443+0000","last_became_active":"2024-09-10T10:08:44.400152+0000","last_became_peered":"2024-09-10T10:08:44.400152+0000","last_unstale":"2024-09-10T10:10:00.724443+0000","last_undegraded":"2024-09-10T10:10:00.724443+0000","last_fullsized":"2024-09-10T10:10:00.724443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:43.550208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.775766+0000","last_change":"2024-09-10T10:08:35.364208+0000","last_active":"2024-09-10T10:10:58.775766+0000","last_peered":"2024-09-10T10:10:58.775766+0000","last_clean":"2024-09-10T10:10:58.775766+0000","last_became_active":"2024-09-10T10:08:35.363751+0000","last_became_peered":"2024-09-10T10:08:35.363751+0000","last_unstale":"2024-09-10T10:10:58.775766+0000","last_undegraded":"2024-09-10T10:10:58.775766+0000","last_fullsized":"2024-09-10T10:10:58.775766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:21.791512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840204+0000","last_change":"2024-09-10T10:08:32.890611+0000","last_active":"2024-09-10T10:10:00.840204+0000","last_peered":"2024-09-10T10:10:00.840204+0000","last_clean":"2024-09-10T10:10:00.840204+0000","last_became_active":"2024-09-10T10:08:32.890296+0000","last_became_peered":"2024-09-10T10:08:32.890296+0000","last_unstale":"2024-09-10T10:10:00.840204+0000","last_undegraded":"2024-09-10T10:10:00.840204+0000","last_fullsized":"2024-09-10T10:10:00.840204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.977575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185624+0000","last_change":"2024-09-10T10:08:44.402607+0000","last_active":"2024-09-10T10:10:01.185624+0000","last_peered":"2024-09-10T10:10:01.185624+0000","last_clean":"2024-09-10T10:10:01.185624+0000","last_became_active":"2024-09-10T10:08:44.401623+0000","last_became_peered":"2024-09-10T10:08:44.401623+0000","last_unstale":"2024-09-10T10:10:01.185624+0000","last_undegraded":"2024-09-10T10:10:01.185624+0000","last_fullsized":"2024-09-10T10:10:01.185624+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:21.105349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.775534+0000","last_change":"2024-09-10T10:08:35.360642+0000","last_active":"2024-09-10T10:10:58.775534+0000","last_peered":"2024-09-10T10:10:58.775534+0000","last_clean":"2024-09-10T10:10:58.775534+0000","last_became_active":"2024-09-10T10:08:35.356667+0000","last_became_peered":"2024-09-10T10:08:35.356667+0000","last_unstale":"2024-09-10T10:10:58.775534+0000","last_undegraded":"2024-09-10T10:10:58.775534+0000","last_fullsized":"2024-09-10T10:10:58.775534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:08.404973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972507+0000","last_change":"2024-09-10T10:08:32.890418+0000","last_active":"2024-09-10T10:10:00.972507+0000","last_peered":"2024-09-10T10:10:00.972507+0000","last_clean":"2024-09-10T10:10:00.972507+0000","last_became_active":"2024-09-10T10:08:32.890081+0000","last_became_peered":"2024-09-10T10:08:32.890081+0000","last_unstale":"2024-09-10T10:10:00.972507+0000","last_undegraded":"2024-09-10T10:10:00.972507+0000","last_fullsized":"2024-09-10T10:10:00.972507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:52.839714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840379+0000","last_change":"2024-09-10T10:08:44.401322+0000","last_active":"2024-09-10T10:10:00.840379+0000","last_peered":"2024-09-10T10:10:00.840379+0000","last_clean":"2024-09-10T10:10:00.840379+0000","last_became_active":"2024-09-10T10:08:44.400906+0000","last_became_peered":"2024-09-10T10:08:44.400906+0000","last_unstale":"2024-09-10T10:10:00.840379+0000","last_undegraded":"2024-09-10T10:10:00.840379+0000","last_fullsized":"2024-09-10T10:10:00.840379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:08.616288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761674+0000","last_change":"2024-09-10T10:08:35.366580+0000","last_active":"2024-09-10T10:10:58.761674+0000","last_peered":"2024-09-10T10:10:58.761674+0000","last_clean":"2024-09-10T10:10:58.761674+0000","last_became_active":"2024-09-10T10:08:35.365943+0000","last_became_peered":"2024-09-10T10:08:35.365943+0000","last_unstale":"2024-09-10T10:10:58.761674+0000","last_undegraded":"2024-09-10T10:10:58.761674+0000","last_fullsized":"2024-09-10T10:10:58.761674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:58.351517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"95'39","reported_seq":331,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:25.715668+0000","last_change":"2024-09-10T10:08:32.888411+0000","last_active":"2024-09-10T10:11:25.715668+0000","last_peered":"2024-09-10T10:11:25.715668+0000","last_clean":"2024-09-10T10:11:25.715668+0000","last_became_active":"2024-09-10T10:08:32.888093+0000","last_became_peered":"2024-09-10T10:08:32.888093+0000","last_unstale":"2024-09-10T10:11:25.715668+0000","last_undegraded":"2024-09-10T10:11:25.715668+0000","last_fullsized":"2024-09-10T10:11:25.715668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.532868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68009,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":251,"num_read_kb":193,"num_write":40,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724453+0000","last_change":"2024-09-10T10:08:44.400432+0000","last_active":"2024-09-10T10:10:00.724453+0000","last_peered":"2024-09-10T10:10:00.724453+0000","last_clean":"2024-09-10T10:10:00.724453+0000","last_became_active":"2024-09-10T10:08:44.399981+0000","last_became_peered":"2024-09-10T10:08:44.399981+0000","last_unstale":"2024-09-10T10:10:00.724453+0000","last_undegraded":"2024-09-10T10:10:00.724453+0000","last_fullsized":"2024-09-10T10:10:00.724453+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:57.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"95'11","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765617+0000","last_change":"2024-09-10T10:09:00.460848+0000","last_active":"2024-09-10T10:10:58.765617+0000","last_peered":"2024-09-10T10:10:58.765617+0000","last_clean":"2024-09-10T10:10:58.765617+0000","last_became_active":"2024-09-10T10:09:00.460459+0000","last_became_peered":"2024-09-10T10:09:00.460459+0000","last_unstale":"2024-09-10T10:10:58.765617+0000","last_undegraded":"2024-09-10T10:10:58.765617+0000","last_fullsized":"2024-09-10T10:10:58.765617+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:06.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840557+0000","last_change":"2024-09-10T10:08:32.885909+0000","last_active":"2024-09-10T10:10:00.840557+0000","last_peered":"2024-09-10T10:10:00.840557+0000","last_clean":"2024-09-10T10:10:00.840557+0000","last_became_active":"2024-09-10T10:08:32.885512+0000","last_became_peered":"2024-09-10T10:08:32.885512+0000","last_unstale":"2024-09-10T10:10:00.840557+0000","last_undegraded":"2024-09-10T10:10:00.840557+0000","last_fullsized":"2024-09-10T10:10:00.840557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:44.850772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721902+0000","last_change":"2024-09-10T10:08:44.400323+0000","last_active":"2024-09-10T10:10:00.721902+0000","last_peered":"2024-09-10T10:10:00.721902+0000","last_clean":"2024-09-10T10:10:00.721902+0000","last_became_active":"2024-09-10T10:08:44.399923+0000","last_became_peered":"2024-09-10T10:08:44.399923+0000","last_unstale":"2024-09-10T10:10:00.721902+0000","last_undegraded":"2024-09-10T10:10:00.721902+0000","last_fullsized":"2024-09-10T10:10:00.721902+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:45.496392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771495+0000","last_change":"2024-09-10T10:08:35.375543+0000","last_active":"2024-09-10T10:10:58.771495+0000","last_peered":"2024-09-10T10:10:58.771495+0000","last_clean":"2024-09-10T10:10:58.771495+0000","last_became_active":"2024-09-10T10:08:35.374312+0000","last_became_peered":"2024-09-10T10:08:35.374312+0000","last_unstale":"2024-09-10T10:10:58.771495+0000","last_undegraded":"2024-09-10T10:10:58.771495+0000","last_fullsized":"2024-09-10T10:10:58.771495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:34.208716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184909+0000","last_change":"2024-09-10T10:08:32.888540+0000","last_active":"2024-09-10T10:10:01.184909+0000","last_peered":"2024-09-10T10:10:01.184909+0000","last_clean":"2024-09-10T10:10:01.184909+0000","last_became_active":"2024-09-10T10:08:32.888187+0000","last_became_peered":"2024-09-10T10:08:32.888187+0000","last_unstale":"2024-09-10T10:10:01.184909+0000","last_undegraded":"2024-09-10T10:10:01.184909+0000","last_fullsized":"2024-09-10T10:10:01.184909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:06.694533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.723713+0000","last_change":"2024-09-10T10:08:44.397995+0000","last_active":"2024-09-10T10:10:00.723713+0000","last_peered":"2024-09-10T10:10:00.723713+0000","last_clean":"2024-09-10T10:10:00.723713+0000","last_became_active":"2024-09-10T10:08:44.397583+0000","last_became_peered":"2024-09-10T10:08:44.397583+0000","last_unstale":"2024-09-10T10:10:00.723713+0000","last_undegraded":"2024-09-10T10:10:00.723713+0000","last_fullsized":"2024-09-10T10:10:00.723713+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:03.908014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773846+0000","last_change":"2024-09-10T10:08:35.361053+0000","last_active":"2024-09-10T10:10:58.773846+0000","last_peered":"2024-09-10T10:10:58.773846+0000","last_clean":"2024-09-10T10:10:58.773846+0000","last_became_active":"2024-09-10T10:08:35.360736+0000","last_became_peered":"2024-09-10T10:08:35.360736+0000","last_unstale":"2024-09-10T10:10:58.773846+0000","last_undegraded":"2024-09-10T10:10:58.773846+0000","last_fullsized":"2024-09-10T10:10:58.773846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:45.435384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"95'4","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:24.714269+0000","last_change":"2024-09-10T10:08:32.885067+0000","last_active":"2024-09-10T10:11:24.714269+0000","last_peered":"2024-09-10T10:11:24.714269+0000","last_clean":"2024-09-10T10:11:24.714269+0000","last_became_active":"2024-09-10T10:08:32.884676+0000","last_became_peered":"2024-09-10T10:08:32.884676+0000","last_unstale":"2024-09-10T10:11:24.714269+0000","last_undegraded":"2024-09-10T10:11:24.714269+0000","last_fullsized":"2024-09-10T10:11:24.714269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.667680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721235+0000","last_change":"2024-09-10T10:08:44.395892+0000","last_active":"2024-09-10T10:10:00.721235+0000","last_peered":"2024-09-10T10:10:00.721235+0000","last_clean":"2024-09-10T10:10:00.721235+0000","last_became_active":"2024-09-10T10:08:44.395188+0000","last_became_peered":"2024-09-10T10:08:44.395188+0000","last_unstale":"2024-09-10T10:10:00.721235+0000","last_undegraded":"2024-09-10T10:10:00.721235+0000","last_fullsized":"2024-09-10T10:10:00.721235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:27.562053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.939198+0000","last_change":"2024-09-10T10:08:44.403185+0000","last_active":"2024-09-10T10:10:00.939198+0000","last_peered":"2024-09-10T10:10:00.939198+0000","last_clean":"2024-09-10T10:10:00.939198+0000","last_became_active":"2024-09-10T10:08:44.399943+0000","last_became_peered":"2024-09-10T10:08:44.399943+0000","last_unstale":"2024-09-10T10:10:00.939198+0000","last_undegraded":"2024-09-10T10:10:00.939198+0000","last_fullsized":"2024-09-10T10:10:00.939198+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:07.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.770162+0000","last_change":"2024-09-10T10:08:35.367552+0000","last_active":"2024-09-10T10:10:58.770162+0000","last_peered":"2024-09-10T10:10:58.770162+0000","last_clean":"2024-09-10T10:10:58.770162+0000","last_became_active":"2024-09-10T10:08:35.367215+0000","last_became_peered":"2024-09-10T10:08:35.367215+0000","last_unstale":"2024-09-10T10:10:58.770162+0000","last_undegraded":"2024-09-10T10:10:58.770162+0000","last_fullsized":"2024-09-10T10:10:58.770162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:28.756769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840019+0000","last_change":"2024-09-10T10:08:32.885830+0000","last_active":"2024-09-10T10:10:00.840019+0000","last_peered":"2024-09-10T10:10:00.840019+0000","last_clean":"2024-09-10T10:10:00.840019+0000","last_became_active":"2024-09-10T10:08:32.885465+0000","last_became_peered":"2024-09-10T10:08:32.885465+0000","last_unstale":"2024-09-10T10:10:00.840019+0000","last_undegraded":"2024-09-10T10:10:00.840019+0000","last_fullsized":"2024-09-10T10:10:00.840019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:55.101364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185761+0000","last_change":"2024-09-10T10:09:00.487666+0000","last_active":"2024-09-10T10:10:01.185761+0000","last_peered":"2024-09-10T10:10:01.185761+0000","last_clean":"2024-09-10T10:10:01.185761+0000","last_became_active":"2024-09-10T10:09:00.487110+0000","last_became_peered":"2024-09-10T10:09:00.487110+0000","last_unstale":"2024-09-10T10:10:01.185761+0000","last_undegraded":"2024-09-10T10:10:01.185761+0000","last_fullsized":"2024-09-10T10:10:01.185761+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:28.817826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755501+0000","last_change":"2024-09-10T10:08:35.356247+0000","last_active":"2024-09-10T10:10:58.755501+0000","last_peered":"2024-09-10T10:10:58.755501+0000","last_clean":"2024-09-10T10:10:58.755501+0000","last_became_active":"2024-09-10T10:08:35.355953+0000","last_became_peered":"2024-09-10T10:08:35.355953+0000","last_unstale":"2024-09-10T10:10:58.755501+0000","last_undegraded":"2024-09-10T10:10:58.755501+0000","last_fullsized":"2024-09-10T10:10:58.755501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:24.625382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039784+0000","last_change":"2024-09-10T10:08:32.882151+0000","last_active":"2024-09-10T10:10:01.039784+0000","last_peered":"2024-09-10T10:10:01.039784+0000","last_clean":"2024-09-10T10:10:01.039784+0000","last_became_active":"2024-09-10T10:08:32.881688+0000","last_became_peered":"2024-09-10T10:08:32.881688+0000","last_unstale":"2024-09-10T10:10:01.039784+0000","last_undegraded":"2024-09-10T10:10:01.039784+0000","last_fullsized":"2024-09-10T10:10:01.039784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:49.186299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.109676+0000","last_change":"2024-09-10T10:08:32.887018+0000","last_active":"2024-09-10T10:10:01.109676+0000","last_peered":"2024-09-10T10:10:01.109676+0000","last_clean":"2024-09-10T10:10:01.109676+0000","last_became_active":"2024-09-10T10:08:32.886636+0000","last_became_peered":"2024-09-10T10:08:32.886636+0000","last_unstale":"2024-09-10T10:10:01.109676+0000","last_undegraded":"2024-09-10T10:10:01.109676+0000","last_fullsized":"2024-09-10T10:10:01.109676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:24.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762425+0000","last_change":"2024-09-10T10:08:35.363803+0000","last_active":"2024-09-10T10:10:58.762425+0000","last_peered":"2024-09-10T10:10:58.762425+0000","last_clean":"2024-09-10T10:10:58.762425+0000","last_became_active":"2024-09-10T10:08:35.363442+0000","last_became_peered":"2024-09-10T10:08:35.363442+0000","last_unstale":"2024-09-10T10:10:58.762425+0000","last_undegraded":"2024-09-10T10:10:58.762425+0000","last_fullsized":"2024-09-10T10:10:58.762425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:59.045347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972949+0000","last_change":"2024-09-10T10:08:44.403970+0000","last_active":"2024-09-10T10:10:00.972949+0000","last_peered":"2024-09-10T10:10:00.972949+0000","last_clean":"2024-09-10T10:10:00.972949+0000","last_became_active":"2024-09-10T10:08:44.403462+0000","last_became_peered":"2024-09-10T10:08:44.403462+0000","last_unstale":"2024-09-10T10:10:00.972949+0000","last_undegraded":"2024-09-10T10:10:00.972949+0000","last_fullsized":"2024-09-10T10:10:00.972949+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:09.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'7","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:25.716216+0000","last_change":"2024-09-10T10:08:32.893227+0000","last_active":"2024-09-10T10:11:25.716216+0000","last_peered":"2024-09-10T10:11:25.716216+0000","last_clean":"2024-09-10T10:11:25.716216+0000","last_became_active":"2024-09-10T10:08:32.892732+0000","last_became_peered":"2024-09-10T10:08:32.892732+0000","last_unstale":"2024-09-10T10:11:25.716216+0000","last_undegraded":"2024-09-10T10:11:25.716216+0000","last_fullsized":"2024-09-10T10:11:25.716216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:16.933955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761246+0000","last_change":"2024-09-10T10:08:35.368806+0000","last_active":"2024-09-10T10:10:58.761246+0000","last_peered":"2024-09-10T10:10:58.761246+0000","last_clean":"2024-09-10T10:10:58.761246+0000","last_became_active":"2024-09-10T10:08:35.368397+0000","last_became_peered":"2024-09-10T10:08:35.368397+0000","last_unstale":"2024-09-10T10:10:58.761246+0000","last_undegraded":"2024-09-10T10:10:58.761246+0000","last_fullsized":"2024-09-10T10:10:58.761246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:39.656295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973102+0000","last_change":"2024-09-10T10:08:44.391941+0000","last_active":"2024-09-10T10:10:00.973102+0000","last_peered":"2024-09-10T10:10:00.973102+0000","last_clean":"2024-09-10T10:10:00.973102+0000","last_became_active":"2024-09-10T10:08:44.391553+0000","last_became_peered":"2024-09-10T10:08:44.391553+0000","last_unstale":"2024-09-10T10:10:00.973102+0000","last_undegraded":"2024-09-10T10:10:00.973102+0000","last_fullsized":"2024-09-10T10:10:00.973102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:34.279772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762216+0000","last_change":"2024-09-10T10:08:35.363192+0000","last_active":"2024-09-10T10:10:58.762216+0000","last_peered":"2024-09-10T10:10:58.762216+0000","last_clean":"2024-09-10T10:10:58.762216+0000","last_became_active":"2024-09-10T10:08:35.362890+0000","last_became_peered":"2024-09-10T10:08:35.362890+0000","last_unstale":"2024-09-10T10:10:58.762216+0000","last_undegraded":"2024-09-10T10:10:58.762216+0000","last_fullsized":"2024-09-10T10:10:58.762216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:07.493539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"95'12","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.748590+0000","last_change":"2024-09-10T10:08:35.362471+0000","last_active":"2024-09-10T10:10:58.748590+0000","last_peered":"2024-09-10T10:10:58.748590+0000","last_clean":"2024-09-10T10:10:58.748590+0000","last_became_active":"2024-09-10T10:08:35.361553+0000","last_became_peered":"2024-09-10T10:08:35.361553+0000","last_unstale":"2024-09-10T10:10:58.748590+0000","last_undegraded":"2024-09-10T10:10:58.748590+0000","last_fullsized":"2024-09-10T10:10:58.748590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:24.511901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.777795+0000","last_change":"2024-09-10T10:08:35.371025+0000","last_active":"2024-09-10T10:10:58.777795+0000","last_peered":"2024-09-10T10:10:58.777795+0000","last_clean":"2024-09-10T10:10:58.777795+0000","last_became_active":"2024-09-10T10:08:35.370692+0000","last_became_peered":"2024-09-10T10:08:35.370692+0000","last_unstale":"2024-09-10T10:10:58.777795+0000","last_undegraded":"2024-09-10T10:10:58.777795+0000","last_fullsized":"2024-09-10T10:10:58.777795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:22.289843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776381+0000","last_change":"2024-09-10T10:08:35.373519+0000","last_active":"2024-09-10T10:10:58.776381+0000","last_peered":"2024-09-10T10:10:58.776381+0000","last_clean":"2024-09-10T10:10:58.776381+0000","last_became_active":"2024-09-10T10:08:35.372719+0000","last_became_peered":"2024-09-10T10:08:35.372719+0000","last_unstale":"2024-09-10T10:10:58.776381+0000","last_undegraded":"2024-09-10T10:10:58.776381+0000","last_fullsized":"2024-09-10T10:10:58.776381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:24.530809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"95'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778078+0000","last_change":"2024-09-10T10:09:00.489944+0000","last_active":"2024-09-10T10:10:58.778078+0000","last_peered":"2024-09-10T10:10:58.778078+0000","last_clean":"2024-09-10T10:10:58.778078+0000","last_became_active":"2024-09-10T10:09:00.489269+0000","last_became_peered":"2024-09-10T10:09:00.489269+0000","last_unstale":"2024-09-10T10:10:58.778078+0000","last_undegraded":"2024-09-10T10:10:58.778078+0000","last_fullsized":"2024-09-10T10:10:58.778078+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:46.561078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761792+0000","last_change":"2024-09-10T10:08:35.364779+0000","last_active":"2024-09-10T10:10:58.761792+0000","last_peered":"2024-09-10T10:10:58.761792+0000","last_clean":"2024-09-10T10:10:58.761792+0000","last_became_active":"2024-09-10T10:08:35.364455+0000","last_became_peered":"2024-09-10T10:08:35.364455+0000","last_unstale":"2024-09-10T10:10:58.761792+0000","last_undegraded":"2024-09-10T10:10:58.761792+0000","last_fullsized":"2024-09-10T10:10:58.761792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:08.552218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761074+0000","last_change":"2024-09-10T10:08:35.357147+0000","last_active":"2024-09-10T10:10:58.761074+0000","last_peered":"2024-09-10T10:10:58.761074+0000","last_clean":"2024-09-10T10:10:58.761074+0000","last_became_active":"2024-09-10T10:08:35.356808+0000","last_became_peered":"2024-09-10T10:08:35.356808+0000","last_unstale":"2024-09-10T10:10:58.761074+0000","last_undegraded":"2024-09-10T10:10:58.761074+0000","last_fullsized":"2024-09-10T10:10:58.761074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:35.731496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"95'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755499+0000","last_change":"2024-09-10T10:08:35.365795+0000","last_active":"2024-09-10T10:10:58.755499+0000","last_peered":"2024-09-10T10:10:58.755499+0000","last_clean":"2024-09-10T10:10:58.755499+0000","last_became_active":"2024-09-10T10:08:35.365342+0000","last_became_peered":"2024-09-10T10:08:35.365342+0000","last_unstale":"2024-09-10T10:10:58.755499+0000","last_undegraded":"2024-09-10T10:10:58.755499+0000","last_fullsized":"2024-09-10T10:10:58.755499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:20.012890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"95'6","reported_seq":22,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.763139+0000","last_change":"2024-09-10T10:09:00.486664+0000","last_active":"2024-09-10T10:10:58.763139+0000","last_peered":"2024-09-10T10:10:58.763139+0000","last_clean":"2024-09-10T10:10:58.763139+0000","last_became_active":"2024-09-10T10:09:00.486239+0000","last_became_peered":"2024-09-10T10:09:00.486239+0000","last_unstale":"2024-09-10T10:10:58.763139+0000","last_undegraded":"2024-09-10T10:10:58.763139+0000","last_fullsized":"2024-09-10T10:10:58.763139+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:47.472245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755183+0000","last_change":"2024-09-10T10:08:35.367403+0000","last_active":"2024-09-10T10:10:58.755183+0000","last_peered":"2024-09-10T10:10:58.755183+0000","last_clean":"2024-09-10T10:10:58.755183+0000","last_became_active":"2024-09-10T10:08:35.365969+0000","last_became_peered":"2024-09-10T10:08:35.365969+0000","last_unstale":"2024-09-10T10:10:58.755183+0000","last_undegraded":"2024-09-10T10:10:58.755183+0000","last_fullsized":"2024-09-10T10:10:58.755183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:27.657226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773597+0000","last_change":"2024-09-10T10:08:35.359185+0000","last_active":"2024-09-10T10:10:58.773597+0000","last_peered":"2024-09-10T10:10:58.773597+0000","last_clean":"2024-09-10T10:10:58.773597+0000","last_became_active":"2024-09-10T10:08:35.358825+0000","last_became_peered":"2024-09-10T10:08:35.358825+0000","last_unstale":"2024-09-10T10:10:58.773597+0000","last_undegraded":"2024-09-10T10:10:58.773597+0000","last_fullsized":"2024-09-10T10:10:58.773597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:31.884533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778457+0000","last_change":"2024-09-10T10:08:35.378151+0000","last_active":"2024-09-10T10:10:58.778457+0000","last_peered":"2024-09-10T10:10:58.778457+0000","last_clean":"2024-09-10T10:10:58.778457+0000","last_became_active":"2024-09-10T10:08:35.377784+0000","last_became_peered":"2024-09-10T10:08:35.377784+0000","last_unstale":"2024-09-10T10:10:58.778457+0000","last_undegraded":"2024-09-10T10:10:58.778457+0000","last_fullsized":"2024-09-10T10:10:58.778457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.027310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762465+0000","last_change":"2024-09-10T10:08:35.364550+0000","last_active":"2024-09-10T10:10:58.762465+0000","last_peered":"2024-09-10T10:10:58.762465+0000","last_clean":"2024-09-10T10:10:58.762465+0000","last_became_active":"2024-09-10T10:08:35.364224+0000","last_became_peered":"2024-09-10T10:08:35.364224+0000","last_unstale":"2024-09-10T10:10:58.762465+0000","last_undegraded":"2024-09-10T10:10:58.762465+0000","last_fullsized":"2024-09-10T10:10:58.762465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:38.584494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.750237+0000","last_change":"2024-09-10T10:08:35.357333+0000","last_active":"2024-09-10T10:10:58.750237+0000","last_peered":"2024-09-10T10:10:58.750237+0000","last_clean":"2024-09-10T10:10:58.750237+0000","last_became_active":"2024-09-10T10:08:35.356940+0000","last_became_peered":"2024-09-10T10:08:35.356940+0000","last_unstale":"2024-09-10T10:10:58.750237+0000","last_undegraded":"2024-09-10T10:10:58.750237+0000","last_fullsized":"2024-09-10T10:10:58.750237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:40.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769367+0000","last_change":"2024-09-10T10:08:35.367208+0000","last_active":"2024-09-10T10:10:58.769367+0000","last_peered":"2024-09-10T10:10:58.769367+0000","last_clean":"2024-09-10T10:10:58.769367+0000","last_became_active":"2024-09-10T10:08:35.361942+0000","last_became_peered":"2024-09-10T10:08:35.361942+0000","last_unstale":"2024-09-10T10:10:58.769367+0000","last_undegraded":"2024-09-10T10:10:58.769367+0000","last_fullsized":"2024-09-10T10:10:58.769367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:19.030623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773220+0000","last_change":"2024-09-10T10:08:35.377164+0000","last_active":"2024-09-10T10:10:58.773220+0000","last_peered":"2024-09-10T10:10:58.773220+0000","last_clean":"2024-09-10T10:10:58.773220+0000","last_became_active":"2024-09-10T10:08:35.376457+0000","last_became_peered":"2024-09-10T10:08:35.376457+0000","last_unstale":"2024-09-10T10:10:58.773220+0000","last_undegraded":"2024-09-10T10:10:58.773220+0000","last_fullsized":"2024-09-10T10:10:58.773220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.291635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772661+0000","last_change":"2024-09-10T10:08:35.365096+0000","last_active":"2024-09-10T10:10:58.772661+0000","last_peered":"2024-09-10T10:10:58.772661+0000","last_clean":"2024-09-10T10:10:58.772661+0000","last_became_active":"2024-09-10T10:08:35.364780+0000","last_became_peered":"2024-09-10T10:08:35.364780+0000","last_unstale":"2024-09-10T10:10:58.772661+0000","last_undegraded":"2024-09-10T10:10:58.772661+0000","last_fullsized":"2024-09-10T10:10:58.772661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:30.177904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774627+0000","last_change":"2024-09-10T10:08:35.377017+0000","last_active":"2024-09-10T10:10:58.774627+0000","last_peered":"2024-09-10T10:10:58.774627+0000","last_clean":"2024-09-10T10:10:58.774627+0000","last_became_active":"2024-09-10T10:08:35.372243+0000","last_became_peered":"2024-09-10T10:08:35.372243+0000","last_unstale":"2024-09-10T10:10:58.774627+0000","last_undegraded":"2024-09-10T10:10:58.774627+0000","last_fullsized":"2024-09-10T10:10:58.774627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:26.105505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774291+0000","last_change":"2024-09-10T10:08:35.379782+0000","last_active":"2024-09-10T10:10:58.774291+0000","last_peered":"2024-09-10T10:10:58.774291+0000","last_clean":"2024-09-10T10:10:58.774291+0000","last_became_active":"2024-09-10T10:08:35.377109+0000","last_became_peered":"2024-09-10T10:08:35.377109+0000","last_unstale":"2024-09-10T10:10:58.774291+0000","last_undegraded":"2024-09-10T10:10:58.774291+0000","last_fullsized":"2024-09-10T10:10:58.774291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:10.761016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.764497+0000","last_change":"2024-09-10T10:08:35.364891+0000","last_active":"2024-09-10T10:10:58.764497+0000","last_peered":"2024-09-10T10:10:58.764497+0000","last_clean":"2024-09-10T10:10:58.764497+0000","last_became_active":"2024-09-10T10:08:35.363845+0000","last_became_peered":"2024-09-10T10:08:35.363845+0000","last_unstale":"2024-09-10T10:10:58.764497+0000","last_undegraded":"2024-09-10T10:10:58.764497+0000","last_fullsized":"2024-09-10T10:10:58.764497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:03.346994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766501+0000","last_change":"2024-09-10T10:08:35.363548+0000","last_active":"2024-09-10T10:10:58.766501+0000","last_peered":"2024-09-10T10:10:58.766501+0000","last_clean":"2024-09-10T10:10:58.766501+0000","last_became_active":"2024-09-10T10:08:35.363229+0000","last_became_peered":"2024-09-10T10:08:35.363229+0000","last_unstale":"2024-09-10T10:10:58.766501+0000","last_undegraded":"2024-09-10T10:10:58.766501+0000","last_fullsized":"2024-09-10T10:10:58.766501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:38.773445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773111+0000","last_change":"2024-09-10T10:08:35.360717+0000","last_active":"2024-09-10T10:10:58.773111+0000","last_peered":"2024-09-10T10:10:58.773111+0000","last_clean":"2024-09-10T10:10:58.773111+0000","last_became_active":"2024-09-10T10:08:35.360410+0000","last_became_peered":"2024-09-10T10:08:35.360410+0000","last_unstale":"2024-09-10T10:10:58.773111+0000","last_undegraded":"2024-09-10T10:10:58.773111+0000","last_fullsized":"2024-09-10T10:10:58.773111+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:59.322524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'16","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772823+0000","last_change":"2024-09-10T10:08:35.362359+0000","last_active":"2024-09-10T10:10:58.772823+0000","last_peered":"2024-09-10T10:10:58.772823+0000","last_clean":"2024-09-10T10:10:58.772823+0000","last_became_active":"2024-09-10T10:08:35.361580+0000","last_became_peered":"2024-09-10T10:08:35.361580+0000","last_unstale":"2024-09-10T10:10:58.772823+0000","last_undegraded":"2024-09-10T10:10:58.772823+0000","last_fullsized":"2024-09-10T10:10:58.772823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:23.265237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771033+0000","last_change":"2024-09-10T10:08:35.367305+0000","last_active":"2024-09-10T10:10:58.771033+0000","last_peered":"2024-09-10T10:10:58.771033+0000","last_clean":"2024-09-10T10:10:58.771033+0000","last_became_active":"2024-09-10T10:08:35.366936+0000","last_became_peered":"2024-09-10T10:08:35.366936+0000","last_unstale":"2024-09-10T10:10:58.771033+0000","last_undegraded":"2024-09-10T10:10:58.771033+0000","last_fullsized":"2024-09-10T10:10:58.771033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:28.158474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765168+0000","last_change":"2024-09-10T10:08:35.369983+0000","last_active":"2024-09-10T10:10:58.765168+0000","last_peered":"2024-09-10T10:10:58.765168+0000","last_clean":"2024-09-10T10:10:58.765168+0000","last_became_active":"2024-09-10T10:08:35.367662+0000","last_became_peered":"2024-09-10T10:08:35.367662+0000","last_unstale":"2024-09-10T10:10:58.765168+0000","last_undegraded":"2024-09-10T10:10:58.765168+0000","last_fullsized":"2024-09-10T10:10:58.765168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771023+0000","last_change":"2024-09-10T10:08:35.369237+0000","last_active":"2024-09-10T10:10:58.771023+0000","last_peered":"2024-09-10T10:10:58.771023+0000","last_clean":"2024-09-10T10:10:58.771023+0000","last_became_active":"2024-09-10T10:08:35.368903+0000","last_became_peered":"2024-09-10T10:08:35.368903+0000","last_unstale":"2024-09-10T10:10:58.771023+0000","last_undegraded":"2024-09-10T10:10:58.771023+0000","last_fullsized":"2024-09-10T10:10:58.771023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:05.150549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773489+0000","last_change":"2024-09-10T10:08:35.367284+0000","last_active":"2024-09-10T10:10:58.773489+0000","last_peered":"2024-09-10T10:10:58.773489+0000","last_clean":"2024-09-10T10:10:58.773489+0000","last_became_active":"2024-09-10T10:08:35.366969+0000","last_became_peered":"2024-09-10T10:08:35.366969+0000","last_unstale":"2024-09-10T10:10:58.773489+0000","last_undegraded":"2024-09-10T10:10:58.773489+0000","last_fullsized":"2024-09-10T10:10:58.773489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:16.949804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.749286+0000","last_change":"2024-09-10T10:08:35.374559+0000","last_active":"2024-09-10T10:10:58.749286+0000","last_peered":"2024-09-10T10:10:58.749286+0000","last_clean":"2024-09-10T10:10:58.749286+0000","last_became_active":"2024-09-10T10:08:35.374191+0000","last_became_peered":"2024-09-10T10:08:35.374191+0000","last_unstale":"2024-09-10T10:10:58.749286+0000","last_undegraded":"2024-09-10T10:10:58.749286+0000","last_fullsized":"2024-09-10T10:10:58.749286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:48.292249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.757757+0000","last_change":"2024-09-10T10:08:35.368042+0000","last_active":"2024-09-10T10:10:58.757757+0000","last_peered":"2024-09-10T10:10:58.757757+0000","last_clean":"2024-09-10T10:10:58.757757+0000","last_became_active":"2024-09-10T10:08:35.365985+0000","last_became_peered":"2024-09-10T10:08:35.365985+0000","last_unstale":"2024-09-10T10:10:58.757757+0000","last_undegraded":"2024-09-10T10:10:58.757757+0000","last_fullsized":"2024-09-10T10:10:58.757757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:04.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774113+0000","last_change":"2024-09-10T10:08:35.375826+0000","last_active":"2024-09-10T10:10:58.774113+0000","last_peered":"2024-09-10T10:10:58.774113+0000","last_clean":"2024-09-10T10:10:58.774113+0000","last_became_active":"2024-09-10T10:08:35.375485+0000","last_became_peered":"2024-09-10T10:08:35.375485+0000","last_unstale":"2024-09-10T10:10:58.774113+0000","last_undegraded":"2024-09-10T10:10:58.774113+0000","last_fullsized":"2024-09-10T10:10:58.774113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:49.146648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.763221+0000","last_change":"2024-09-10T10:08:35.375745+0000","last_active":"2024-09-10T10:10:58.763221+0000","last_peered":"2024-09-10T10:10:58.763221+0000","last_clean":"2024-09-10T10:10:58.763221+0000","last_became_active":"2024-09-10T10:08:35.375427+0000","last_became_peered":"2024-09-10T10:08:35.375427+0000","last_unstale":"2024-09-10T10:10:58.763221+0000","last_undegraded":"2024-09-10T10:10:58.763221+0000","last_fullsized":"2024-09-10T10:10:58.763221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:48.743434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771465+0000","last_change":"2024-09-10T10:08:35.377092+0000","last_active":"2024-09-10T10:10:58.771465+0000","last_peered":"2024-09-10T10:10:58.771465+0000","last_clean":"2024-09-10T10:10:58.771465+0000","last_became_active":"2024-09-10T10:08:35.376761+0000","last_became_peered":"2024-09-10T10:08:35.376761+0000","last_unstale":"2024-09-10T10:10:58.771465+0000","last_undegraded":"2024-09-10T10:10:58.771465+0000","last_fullsized":"2024-09-10T10:10:58.771465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:58.631742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72687,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":760,"num_read_kb":457,"num_write":183,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":218061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286200,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449137,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":538290,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678071,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32348,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712804,"statfs":{"total":95995035648,"available":95961911296,"internally_reserved":0,"allocated":1191936,"data_stored":1194079,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841596,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":542600,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070530,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":538402,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299462,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":1135010,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462989,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":533680,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724627,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1114112,"data_stored":1130064,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888151,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1048576,"data_stored":538864,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149788,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":533874,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411428,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1134592,"data_stored":603483,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1110016,"data_stored":601599,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":535068,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:11:32.110 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T10:11:32.110 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:11:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:32 smithi050 ceph-mon[30354]: pgmap v401: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T10:11:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:32 smithi050 ceph-mon[30354]: from='client.25274 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:32.492 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:32.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:32 smithi189 ceph-mon[34999]: pgmap v401: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T10:11:32.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:32 smithi189 ceph-mon[34999]: from='client.25274 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:32.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:32 smithi084 ceph-mon[34812]: pgmap v401: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T10:11:32.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:32 smithi084 ceph-mon[34812]: from='client.25274 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:33.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.081+0000 7fe025600640 1 -- 172.21.15.50:0/364227621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0200745c0 msgr2=0x7fe0200749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.081+0000 7fe025600640 1 --2- 172.21.15.50:0/364227621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0200745c0 0x7fe0200749a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe010009900 tx=0x7fe01002a480 comp rx=0 tx=0).stop 2024-09-10T10:11:33.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.081+0000 7fe025600640 1 -- 172.21.15.50:0/364227621 shutdown_connections 2024-09-10T10:11:33.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.081+0000 7fe025600640 1 --2- 172.21.15.50:0/364227621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe02010e420 0x7fe020110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.081+0000 7fe025600640 1 --2- 172.21.15.50:0/364227621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe020074ee0 0x7fe02010dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.081+0000 7fe025600640 1 --2- 172.21.15.50:0/364227621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0200745c0 0x7fe0200749a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.081+0000 7fe025600640 1 -- 172.21.15.50:0/364227621 >> 172.21.15.50:0/364227621 conn(0x7fe0200fd8c0 msgr2=0x7fe0200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:33.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.081+0000 7fe025600640 1 -- 172.21.15.50:0/364227621 shutdown_connections 2024-09-10T10:11:33.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.081+0000 7fe025600640 1 -- 172.21.15.50:0/364227621 wait complete. 2024-09-10T10:11:33.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.082+0000 7fe025600640 1 Processor -- start 2024-09-10T10:11:33.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.082+0000 7fe025600640 1 -- start start 2024-09-10T10:11:33.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.082+0000 7fe025600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0200745c0 0x7fe02010ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:33.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.082+0000 7fe025600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe020074ee0 0x7fe02010ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:33.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.082+0000 7fe025600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02010e420 0x7fe02010b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:33.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.082+0000 7fe025600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe020114170 con 0x7fe0200745c0 2024-09-10T10:11:33.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.082+0000 7fe025600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe020113ff0 con 0x7fe02010e420 2024-09-10T10:11:33.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.082+0000 7fe025600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe0201142f0 con 0x7fe020074ee0 2024-09-10T10:11:33.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.083+0000 7fe01ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0200745c0 0x7fe02010ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:33.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.083+0000 7fe01ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0200745c0 0x7fe02010ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60014/0 (socket says 172.21.15.50:60014) 2024-09-10T10:11:33.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.083+0000 7fe01f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02010e420 0x7fe02010b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:33.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.083+0000 7fe01ea00640 1 -- 172.21.15.50:0/729201576 learned_addr learned my addr 172.21.15.50:0/729201576 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:33.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.083+0000 7fe016000640 1 --2- 172.21.15.50:0/729201576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe020074ee0 0x7fe02010ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:33.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.083+0000 7fe01f400640 1 -- 172.21.15.50:0/729201576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe020074ee0 msgr2=0x7fe02010ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.083+0000 7fe01f400640 1 --2- 172.21.15.50:0/729201576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe020074ee0 0x7fe02010ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.083+0000 7fe01f400640 1 -- 172.21.15.50:0/729201576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0200745c0 msgr2=0x7fe02010ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.083+0000 7fe01f400640 1 --2- 172.21.15.50:0/729201576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0200745c0 0x7fe02010ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.083+0000 7fe01f400640 1 -- 172.21.15.50:0/729201576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02010bcb0 con 0x7fe02010e420 2024-09-10T10:11:33.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.083+0000 7fe01f400640 1 --2- 172.21.15.50:0/729201576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02010e420 0x7fe02010b3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe018005fd0 tx=0x7fe01800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:33.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.084+0000 7fe017e00640 1 -- 172.21.15.50:0/729201576 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01800cdf0 con 0x7fe02010e420 2024-09-10T10:11:33.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.084+0000 7fe017e00640 1 -- 172.21.15.50:0/729201576 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe018005020 con 0x7fe02010e420 2024-09-10T10:11:33.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.084+0000 7fe025600640 1 -- 172.21.15.50:0/729201576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0201aafd0 con 0x7fe02010e420 2024-09-10T10:11:33.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.084+0000 7fe017e00640 1 -- 172.21.15.50:0/729201576 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0180106d0 con 0x7fe02010e420 2024-09-10T10:11:33.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.084+0000 7fe025600640 1 -- 172.21.15.50:0/729201576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0201ab490 con 0x7fe02010e420 2024-09-10T10:11:33.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.085+0000 7fe025600640 1 -- 172.21.15.50:0/729201576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe020075c70 con 0x7fe02010e420 2024-09-10T10:11:33.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.087+0000 7fe017e00640 1 -- 172.21.15.50:0/729201576 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe0180054d0 con 0x7fe02010e420 2024-09-10T10:11:33.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.088+0000 7fe017e00640 1 --2- 172.21.15.50:0/729201576 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe0040a2b80 0x7fe0040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:33.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.089+0000 7fe017e00640 1 -- 172.21.15.50:0/729201576 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe0180cfa40 con 0x7fe02010e420 2024-09-10T10:11:33.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.089+0000 7fe01ea00640 1 --2- 172.21.15.50:0/729201576 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe0040a2b80 0x7fe0040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:33.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.089+0000 7fe01ea00640 1 --2- 172.21.15.50:0/729201576 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe0040a2b80 0x7fe0040a5040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe0100096c0 tx=0x7fe010005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:33.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.090+0000 7fe017e00640 1 -- 172.21.15.50:0/729201576 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe01809c5b0 con 0x7fe02010e420 2024-09-10T10:11:33.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.274+0000 7fe025600640 1 -- 172.21.15.50:0/729201576 --> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe020062630 con 0x7fe0040a2b80 2024-09-10T10:11:33.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.283+0000 7fe017e00640 1 -- 172.21.15.50:0/729201576 <== mgr.14150 v2:172.21.15.50:6800/2546156966 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340754 (secure 0 0 0) 0x7fe020062630 con 0x7fe0040a2b80 2024-09-10T10:11:33.289 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:33.290 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-10T10:11:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.287+0000 7fe025600640 1 -- 172.21.15.50:0/729201576 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe0040a2b80 msgr2=0x7fe0040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.287+0000 7fe025600640 1 --2- 172.21.15.50:0/729201576 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe0040a2b80 0x7fe0040a5040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe0100096c0 tx=0x7fe010005a20 comp rx=0 tx=0).stop 2024-09-10T10:11:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.287+0000 7fe025600640 1 -- 172.21.15.50:0/729201576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02010e420 msgr2=0x7fe02010b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.287+0000 7fe025600640 1 --2- 172.21.15.50:0/729201576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02010e420 0x7fe02010b3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe018005fd0 tx=0x7fe01800ef10 comp rx=0 tx=0).stop 2024-09-10T10:11:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.288+0000 7fe025600640 1 -- 172.21.15.50:0/729201576 shutdown_connections 2024-09-10T10:11:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.288+0000 7fe025600640 1 --2- 172.21.15.50:0/729201576 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe0040a2b80 0x7fe0040a5040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.288+0000 7fe025600640 1 --2- 172.21.15.50:0/729201576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe02010e420 0x7fe02010b3f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.288+0000 7fe025600640 1 --2- 172.21.15.50:0/729201576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe020074ee0 0x7fe02010ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.288+0000 7fe025600640 1 --2- 172.21.15.50:0/729201576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0200745c0 0x7fe02010ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:33.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.288+0000 7fe025600640 1 -- 172.21.15.50:0/729201576 >> 172.21.15.50:0/729201576 conn(0x7fe0200fd8c0 msgr2=0x7fe0200fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.288+0000 7fe025600640 1 -- 172.21.15.50:0/729201576 shutdown_connections 2024-09-10T10:11:33.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:33.288+0000 7fe025600640 1 -- 172.21.15.50:0/729201576 wait complete. 2024-09-10T10:11:34.071 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":402,"stamp":"2024-09-10T10:11:32.808338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663289,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":912,"num_read_kb":582,"num_write":366,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":795,"ondisk_log_size":795,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366112,"kb_used_data":12704,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575712,"statfs":{"total":1151940427776,"available":1151565529088,"internally_reserved":0,"allocated":13008896,"data_stored":8425013,"data_compressed":498339,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5373,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":53,"num_write":1,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:38.961695+0000","last_change":"2024-09-10T10:08:32.889755+0000","last_active":"2024-09-10T10:10:38.961695+0000","last_peered":"2024-09-10T10:10:38.961695+0000","last_clean":"2024-09-10T10:10:38.961695+0000","last_became_active":"2024-09-10T10:08:32.889455+0000","last_became_peered":"2024-09-10T10:08:32.889455+0000","last_unstale":"2024-09-10T10:10:38.961695+0000","last_undegraded":"2024-09-10T10:10:38.961695+0000","last_fullsized":"2024-09-10T10:10:38.961695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:53.750196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"95'5","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.760977+0000","last_change":"2024-09-10T10:10:00.974216+0000","last_active":"2024-09-10T10:10:58.760977+0000","last_peered":"2024-09-10T10:10:58.760977+0000","last_clean":"2024-09-10T10:10:58.760977+0000","last_became_active":"2024-09-10T10:10:00.973841+0000","last_became_peered":"2024-09-10T10:10:00.973841+0000","last_unstale":"2024-09-10T10:10:58.760977+0000","last_undegraded":"2024-09-10T10:10:58.760977+0000","last_fullsized":"2024-09-10T10:10:58.760977+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:30.575610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972516+0000","last_change":"2024-09-10T10:08:44.399836+0000","last_active":"2024-09-10T10:10:00.972516+0000","last_peered":"2024-09-10T10:10:00.972516+0000","last_clean":"2024-09-10T10:10:00.972516+0000","last_became_active":"2024-09-10T10:08:44.399510+0000","last_became_peered":"2024-09-10T10:08:44.399510+0000","last_unstale":"2024-09-10T10:10:00.972516+0000","last_undegraded":"2024-09-10T10:10:00.972516+0000","last_fullsized":"2024-09-10T10:10:00.972516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:47.372690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722255+0000","last_change":"2024-09-10T10:08:32.887099+0000","last_active":"2024-09-10T10:10:00.722255+0000","last_peered":"2024-09-10T10:10:00.722255+0000","last_clean":"2024-09-10T10:10:00.722255+0000","last_became_active":"2024-09-10T10:08:32.886730+0000","last_became_peered":"2024-09-10T10:08:32.886730+0000","last_unstale":"2024-09-10T10:10:00.722255+0000","last_undegraded":"2024-09-10T10:10:00.722255+0000","last_fullsized":"2024-09-10T10:10:00.722255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.277241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.777729+0000","last_change":"2024-09-10T10:08:35.375494+0000","last_active":"2024-09-10T10:10:58.777729+0000","last_peered":"2024-09-10T10:10:58.777729+0000","last_clean":"2024-09-10T10:10:58.777729+0000","last_became_active":"2024-09-10T10:08:35.373991+0000","last_became_peered":"2024-09-10T10:08:35.373991+0000","last_unstale":"2024-09-10T10:10:58.777729+0000","last_undegraded":"2024-09-10T10:10:58.777729+0000","last_fullsized":"2024-09-10T10:10:58.777729+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:25.858163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721597+0000","last_change":"2024-09-10T10:09:00.457967+0000","last_active":"2024-09-10T10:10:00.721597+0000","last_peered":"2024-09-10T10:10:00.721597+0000","last_clean":"2024-09-10T10:10:00.721597+0000","last_became_active":"2024-09-10T10:09:00.457446+0000","last_became_peered":"2024-09-10T10:09:00.457446+0000","last_unstale":"2024-09-10T10:10:00.721597+0000","last_undegraded":"2024-09-10T10:10:00.721597+0000","last_fullsized":"2024-09-10T10:10:00.721597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:00.550304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722817+0000","last_change":"2024-09-10T10:08:32.890270+0000","last_active":"2024-09-10T10:10:00.722817+0000","last_peered":"2024-09-10T10:10:00.722817+0000","last_clean":"2024-09-10T10:10:00.722817+0000","last_became_active":"2024-09-10T10:08:32.889887+0000","last_became_peered":"2024-09-10T10:08:32.889887+0000","last_unstale":"2024-09-10T10:10:00.722817+0000","last_undegraded":"2024-09-10T10:10:00.722817+0000","last_fullsized":"2024-09-10T10:10:00.722817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:39.757510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774008+0000","last_change":"2024-09-10T10:08:35.357257+0000","last_active":"2024-09-10T10:10:58.774008+0000","last_peered":"2024-09-10T10:10:58.774008+0000","last_clean":"2024-09-10T10:10:58.774008+0000","last_became_active":"2024-09-10T10:08:35.356918+0000","last_became_peered":"2024-09-10T10:08:35.356918+0000","last_unstale":"2024-09-10T10:10:58.774008+0000","last_undegraded":"2024-09-10T10:10:58.774008+0000","last_fullsized":"2024-09-10T10:10:58.774008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:04.387581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722105+0000","last_change":"2024-09-10T10:09:00.487116+0000","last_active":"2024-09-10T10:10:00.722105+0000","last_peered":"2024-09-10T10:10:00.722105+0000","last_clean":"2024-09-10T10:10:00.722105+0000","last_became_active":"2024-09-10T10:09:00.486646+0000","last_became_peered":"2024-09-10T10:09:00.486646+0000","last_unstale":"2024-09-10T10:10:00.722105+0000","last_undegraded":"2024-09-10T10:10:00.722105+0000","last_fullsized":"2024-09-10T10:10:00.722105+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:40.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722877+0000","last_change":"2024-09-10T10:08:32.891399+0000","last_active":"2024-09-10T10:10:00.722877+0000","last_peered":"2024-09-10T10:10:00.722877+0000","last_clean":"2024-09-10T10:10:00.722877+0000","last_became_active":"2024-09-10T10:08:32.891022+0000","last_became_peered":"2024-09-10T10:08:32.891022+0000","last_unstale":"2024-09-10T10:10:00.722877+0000","last_undegraded":"2024-09-10T10:10:00.722877+0000","last_fullsized":"2024-09-10T10:10:00.722877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:30.842443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771765+0000","last_change":"2024-09-10T10:08:35.370630+0000","last_active":"2024-09-10T10:10:58.771765+0000","last_peered":"2024-09-10T10:10:58.771765+0000","last_clean":"2024-09-10T10:10:58.771765+0000","last_became_active":"2024-09-10T10:08:35.370263+0000","last_became_peered":"2024-09-10T10:08:35.370263+0000","last_unstale":"2024-09-10T10:10:58.771765+0000","last_undegraded":"2024-09-10T10:10:58.771765+0000","last_fullsized":"2024-09-10T10:10:58.771765+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:41.549815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721697+0000","last_change":"2024-09-10T10:08:44.405298+0000","last_active":"2024-09-10T10:10:00.721697+0000","last_peered":"2024-09-10T10:10:00.721697+0000","last_clean":"2024-09-10T10:10:00.721697+0000","last_became_active":"2024-09-10T10:08:44.405027+0000","last_became_peered":"2024-09-10T10:08:44.405027+0000","last_unstale":"2024-09-10T10:10:00.721697+0000","last_undegraded":"2024-09-10T10:10:00.721697+0000","last_fullsized":"2024-09-10T10:10:00.721697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:08.486563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776546+0000","last_change":"2024-09-10T10:08:35.369040+0000","last_active":"2024-09-10T10:10:58.776546+0000","last_peered":"2024-09-10T10:10:58.776546+0000","last_clean":"2024-09-10T10:10:58.776546+0000","last_became_active":"2024-09-10T10:08:35.368576+0000","last_became_peered":"2024-09-10T10:08:35.368576+0000","last_unstale":"2024-09-10T10:10:58.776546+0000","last_undegraded":"2024-09-10T10:10:58.776546+0000","last_fullsized":"2024-09-10T10:10:58.776546+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:44.887554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722399+0000","last_change":"2024-09-10T10:08:32.889549+0000","last_active":"2024-09-10T10:10:00.722399+0000","last_peered":"2024-09-10T10:10:00.722399+0000","last_clean":"2024-09-10T10:10:00.722399+0000","last_became_active":"2024-09-10T10:08:32.889197+0000","last_became_peered":"2024-09-10T10:08:32.889197+0000","last_unstale":"2024-09-10T10:10:00.722399+0000","last_undegraded":"2024-09-10T10:10:00.722399+0000","last_fullsized":"2024-09-10T10:10:00.722399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:53.697069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721966+0000","last_change":"2024-09-10T10:08:44.929048+0000","last_active":"2024-09-10T10:10:00.721966+0000","last_peered":"2024-09-10T10:10:00.721966+0000","last_clean":"2024-09-10T10:10:00.721966+0000","last_became_active":"2024-09-10T10:08:44.928345+0000","last_became_peered":"2024-09-10T10:08:44.928345+0000","last_unstale":"2024-09-10T10:10:00.721966+0000","last_undegraded":"2024-09-10T10:10:00.721966+0000","last_fullsized":"2024-09-10T10:10:00.721966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:23.121853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776712+0000","last_change":"2024-09-10T10:08:35.377385+0000","last_active":"2024-09-10T10:10:58.776712+0000","last_peered":"2024-09-10T10:10:58.776712+0000","last_clean":"2024-09-10T10:10:58.776712+0000","last_became_active":"2024-09-10T10:08:35.377092+0000","last_became_peered":"2024-09-10T10:08:35.377092+0000","last_unstale":"2024-09-10T10:10:58.776712+0000","last_undegraded":"2024-09-10T10:10:58.776712+0000","last_fullsized":"2024-09-10T10:10:58.776712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:23.169370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972319+0000","last_change":"2024-09-10T10:08:32.891614+0000","last_active":"2024-09-10T10:10:00.972319+0000","last_peered":"2024-09-10T10:10:00.972319+0000","last_clean":"2024-09-10T10:10:00.972319+0000","last_became_active":"2024-09-10T10:08:32.891141+0000","last_became_peered":"2024-09-10T10:08:32.891141+0000","last_unstale":"2024-09-10T10:10:00.972319+0000","last_undegraded":"2024-09-10T10:10:00.972319+0000","last_fullsized":"2024-09-10T10:10:00.972319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:20.258863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721932+0000","last_change":"2024-09-10T10:08:44.401125+0000","last_active":"2024-09-10T10:10:00.721932+0000","last_peered":"2024-09-10T10:10:00.721932+0000","last_clean":"2024-09-10T10:10:00.721932+0000","last_became_active":"2024-09-10T10:08:44.400483+0000","last_became_peered":"2024-09-10T10:08:44.400483+0000","last_unstale":"2024-09-10T10:10:00.721932+0000","last_undegraded":"2024-09-10T10:10:00.721932+0000","last_fullsized":"2024-09-10T10:10:00.721932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:12.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766815+0000","last_change":"2024-09-10T10:08:35.376806+0000","last_active":"2024-09-10T10:10:58.766815+0000","last_peered":"2024-09-10T10:10:58.766815+0000","last_clean":"2024-09-10T10:10:58.766815+0000","last_became_active":"2024-09-10T10:08:35.376400+0000","last_became_peered":"2024-09-10T10:08:35.376400+0000","last_unstale":"2024-09-10T10:10:58.766815+0000","last_undegraded":"2024-09-10T10:10:58.766815+0000","last_fullsized":"2024-09-10T10:10:58.766815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:48.303039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721567+0000","last_change":"2024-09-10T10:08:32.883881+0000","last_active":"2024-09-10T10:10:00.721567+0000","last_peered":"2024-09-10T10:10:00.721567+0000","last_clean":"2024-09-10T10:10:00.721567+0000","last_became_active":"2024-09-10T10:08:32.883540+0000","last_became_peered":"2024-09-10T10:08:32.883540+0000","last_unstale":"2024-09-10T10:10:00.721567+0000","last_undegraded":"2024-09-10T10:10:00.721567+0000","last_fullsized":"2024-09-10T10:10:00.721567+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:03:57.359729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724324+0000","last_change":"2024-09-10T10:08:44.401548+0000","last_active":"2024-09-10T10:10:00.724324+0000","last_peered":"2024-09-10T10:10:00.724324+0000","last_clean":"2024-09-10T10:10:00.724324+0000","last_became_active":"2024-09-10T10:08:44.401034+0000","last_became_peered":"2024-09-10T10:08:44.401034+0000","last_unstale":"2024-09-10T10:10:00.724324+0000","last_undegraded":"2024-09-10T10:10:00.724324+0000","last_fullsized":"2024-09-10T10:10:00.724324+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:17.292973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"95'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.760304+0000","last_change":"2024-09-10T10:08:35.359969+0000","last_active":"2024-09-10T10:10:58.760304+0000","last_peered":"2024-09-10T10:10:58.760304+0000","last_clean":"2024-09-10T10:10:58.760304+0000","last_became_active":"2024-09-10T10:08:35.359599+0000","last_became_peered":"2024-09-10T10:08:35.359599+0000","last_unstale":"2024-09-10T10:10:58.760304+0000","last_undegraded":"2024-09-10T10:10:58.760304+0000","last_fullsized":"2024-09-10T10:10:58.760304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:00.778269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862147+0000","last_change":"2024-09-10T10:09:00.487582+0000","last_active":"2024-09-10T10:10:00.862147+0000","last_peered":"2024-09-10T10:10:00.862147+0000","last_clean":"2024-09-10T10:10:00.862147+0000","last_became_active":"2024-09-10T10:09:00.487229+0000","last_became_peered":"2024-09-10T10:09:00.487229+0000","last_unstale":"2024-09-10T10:10:00.862147+0000","last_undegraded":"2024-09-10T10:10:00.862147+0000","last_fullsized":"2024-09-10T10:10:00.862147+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:53.341736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722077+0000","last_change":"2024-09-10T10:08:44.929224+0000","last_active":"2024-09-10T10:10:00.722077+0000","last_peered":"2024-09-10T10:10:00.722077+0000","last_clean":"2024-09-10T10:10:00.722077+0000","last_became_active":"2024-09-10T10:08:44.928640+0000","last_became_peered":"2024-09-10T10:08:44.928640+0000","last_unstale":"2024-09-10T10:10:00.722077+0000","last_undegraded":"2024-09-10T10:10:00.722077+0000","last_fullsized":"2024-09-10T10:10:00.722077+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:42.741723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778123+0000","last_change":"2024-09-10T10:08:35.376585+0000","last_active":"2024-09-10T10:10:58.778123+0000","last_peered":"2024-09-10T10:10:58.778123+0000","last_clean":"2024-09-10T10:10:58.778123+0000","last_became_active":"2024-09-10T10:08:35.375693+0000","last_became_peered":"2024-09-10T10:08:35.375693+0000","last_unstale":"2024-09-10T10:10:58.778123+0000","last_undegraded":"2024-09-10T10:10:58.778123+0000","last_fullsized":"2024-09-10T10:10:58.778123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:59.377543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722314+0000","last_change":"2024-09-10T10:08:32.884542+0000","last_active":"2024-09-10T10:10:00.722314+0000","last_peered":"2024-09-10T10:10:00.722314+0000","last_clean":"2024-09-10T10:10:00.722314+0000","last_became_active":"2024-09-10T10:08:32.884192+0000","last_became_peered":"2024-09-10T10:08:32.884192+0000","last_unstale":"2024-09-10T10:10:00.722314+0000","last_undegraded":"2024-09-10T10:10:00.722314+0000","last_fullsized":"2024-09-10T10:10:00.722314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:57.756641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972690+0000","last_change":"2024-09-10T10:08:44.391514+0000","last_active":"2024-09-10T10:10:00.972690+0000","last_peered":"2024-09-10T10:10:00.972690+0000","last_clean":"2024-09-10T10:10:00.972690+0000","last_became_active":"2024-09-10T10:08:44.391116+0000","last_became_peered":"2024-09-10T10:08:44.391116+0000","last_unstale":"2024-09-10T10:10:00.972690+0000","last_undegraded":"2024-09-10T10:10:00.972690+0000","last_fullsized":"2024-09-10T10:10:00.972690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:41.586014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.768916+0000","last_change":"2024-09-10T10:08:35.365604+0000","last_active":"2024-09-10T10:10:58.768916+0000","last_peered":"2024-09-10T10:10:58.768916+0000","last_clean":"2024-09-10T10:10:58.768916+0000","last_became_active":"2024-09-10T10:08:35.364915+0000","last_became_peered":"2024-09-10T10:08:35.364915+0000","last_unstale":"2024-09-10T10:10:58.768916+0000","last_undegraded":"2024-09-10T10:10:58.768916+0000","last_fullsized":"2024-09-10T10:10:58.768916+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:12.885021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'13","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:59.381750+0000","last_change":"2024-09-10T10:08:32.888223+0000","last_active":"2024-09-10T10:10:59.381750+0000","last_peered":"2024-09-10T10:10:59.381750+0000","last_clean":"2024-09-10T10:10:59.381750+0000","last_became_active":"2024-09-10T10:08:32.887919+0000","last_became_peered":"2024-09-10T10:08:32.887919+0000","last_unstale":"2024-09-10T10:10:59.381750+0000","last_undegraded":"2024-09-10T10:10:59.381750+0000","last_fullsized":"2024-09-10T10:10:59.381750+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:19.781337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721073+0000","last_change":"2024-09-10T10:08:44.929322+0000","last_active":"2024-09-10T10:10:00.721073+0000","last_peered":"2024-09-10T10:10:00.721073+0000","last_clean":"2024-09-10T10:10:00.721073+0000","last_became_active":"2024-09-10T10:08:44.928252+0000","last_became_peered":"2024-09-10T10:08:44.928252+0000","last_unstale":"2024-09-10T10:10:00.721073+0000","last_undegraded":"2024-09-10T10:10:00.721073+0000","last_fullsized":"2024-09-10T10:10:00.721073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:33.048265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762075+0000","last_change":"2024-09-10T10:08:35.364168+0000","last_active":"2024-09-10T10:10:58.762075+0000","last_peered":"2024-09-10T10:10:58.762075+0000","last_clean":"2024-09-10T10:10:58.762075+0000","last_became_active":"2024-09-10T10:08:35.363739+0000","last_became_peered":"2024-09-10T10:08:35.363739+0000","last_unstale":"2024-09-10T10:10:58.762075+0000","last_undegraded":"2024-09-10T10:10:58.762075+0000","last_fullsized":"2024-09-10T10:10:58.762075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:43.029409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722836+0000","last_change":"2024-09-10T10:08:32.893021+0000","last_active":"2024-09-10T10:10:00.722836+0000","last_peered":"2024-09-10T10:10:00.722836+0000","last_clean":"2024-09-10T10:10:00.722836+0000","last_became_active":"2024-09-10T10:08:32.892667+0000","last_became_peered":"2024-09-10T10:08:32.892667+0000","last_unstale":"2024-09-10T10:10:00.722836+0000","last_undegraded":"2024-09-10T10:10:00.722836+0000","last_fullsized":"2024-09-10T10:10:00.722836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:52.427489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185575+0000","last_change":"2024-09-10T10:08:44.393831+0000","last_active":"2024-09-10T10:10:01.185575+0000","last_peered":"2024-09-10T10:10:01.185575+0000","last_clean":"2024-09-10T10:10:01.185575+0000","last_became_active":"2024-09-10T10:08:44.393415+0000","last_became_peered":"2024-09-10T10:08:44.393415+0000","last_unstale":"2024-09-10T10:10:01.185575+0000","last_undegraded":"2024-09-10T10:10:01.185575+0000","last_fullsized":"2024-09-10T10:10:01.185575+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:52.171292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769530+0000","last_change":"2024-09-10T10:08:35.374787+0000","last_active":"2024-09-10T10:10:58.769530+0000","last_peered":"2024-09-10T10:10:58.769530+0000","last_clean":"2024-09-10T10:10:58.769530+0000","last_became_active":"2024-09-10T10:08:35.374549+0000","last_became_peered":"2024-09-10T10:08:35.374549+0000","last_unstale":"2024-09-10T10:10:58.769530+0000","last_undegraded":"2024-09-10T10:10:58.769530+0000","last_fullsized":"2024-09-10T10:10:58.769530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:58.925515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724437+0000","last_change":"2024-09-10T10:08:32.886267+0000","last_active":"2024-09-10T10:10:00.724437+0000","last_peered":"2024-09-10T10:10:00.724437+0000","last_clean":"2024-09-10T10:10:00.724437+0000","last_became_active":"2024-09-10T10:08:32.885869+0000","last_became_peered":"2024-09-10T10:08:32.885869+0000","last_unstale":"2024-09-10T10:10:00.724437+0000","last_undegraded":"2024-09-10T10:10:00.724437+0000","last_fullsized":"2024-09-10T10:10:00.724437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:06.784839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722243+0000","last_change":"2024-09-10T10:09:00.486656+0000","last_active":"2024-09-10T10:10:00.722243+0000","last_peered":"2024-09-10T10:10:00.722243+0000","last_clean":"2024-09-10T10:10:00.722243+0000","last_became_active":"2024-09-10T10:09:00.486072+0000","last_became_peered":"2024-09-10T10:09:00.486072+0000","last_unstale":"2024-09-10T10:10:00.722243+0000","last_undegraded":"2024-09-10T10:10:00.722243+0000","last_fullsized":"2024-09-10T10:10:00.722243+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:26.076881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767023+0000","last_change":"2024-09-10T10:08:35.366130+0000","last_active":"2024-09-10T10:10:58.767023+0000","last_peered":"2024-09-10T10:10:58.767023+0000","last_clean":"2024-09-10T10:10:58.767023+0000","last_became_active":"2024-09-10T10:08:35.365785+0000","last_became_peered":"2024-09-10T10:08:35.365785+0000","last_unstale":"2024-09-10T10:10:58.767023+0000","last_undegraded":"2024-09-10T10:10:58.767023+0000","last_fullsized":"2024-09-10T10:10:58.767023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:35.771767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184987+0000","last_change":"2024-09-10T10:08:32.884113+0000","last_active":"2024-09-10T10:10:01.184987+0000","last_peered":"2024-09-10T10:10:01.184987+0000","last_clean":"2024-09-10T10:10:01.184987+0000","last_became_active":"2024-09-10T10:08:32.883503+0000","last_became_peered":"2024-09-10T10:08:32.883503+0000","last_unstale":"2024-09-10T10:10:01.184987+0000","last_undegraded":"2024-09-10T10:10:01.184987+0000","last_fullsized":"2024-09-10T10:10:01.184987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:20.513465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040285+0000","last_change":"2024-09-10T10:08:44.400137+0000","last_active":"2024-09-10T10:10:01.040285+0000","last_peered":"2024-09-10T10:10:01.040285+0000","last_clean":"2024-09-10T10:10:01.040285+0000","last_became_active":"2024-09-10T10:08:44.398736+0000","last_became_peered":"2024-09-10T10:08:44.398736+0000","last_unstale":"2024-09-10T10:10:01.040285+0000","last_undegraded":"2024-09-10T10:10:01.040285+0000","last_fullsized":"2024-09-10T10:10:01.040285+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:48.922732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.756485+0000","last_change":"2024-09-10T10:08:35.360818+0000","last_active":"2024-09-10T10:10:58.756485+0000","last_peered":"2024-09-10T10:10:58.756485+0000","last_clean":"2024-09-10T10:10:58.756485+0000","last_became_active":"2024-09-10T10:08:35.360504+0000","last_became_peered":"2024-09-10T10:08:35.360504+0000","last_unstale":"2024-09-10T10:10:58.756485+0000","last_undegraded":"2024-09-10T10:10:58.756485+0000","last_fullsized":"2024-09-10T10:10:58.756485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:45.396069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"95'5","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:30.723031+0000","last_change":"2024-09-10T10:08:32.883915+0000","last_active":"2024-09-10T10:11:30.723031+0000","last_peered":"2024-09-10T10:11:30.723031+0000","last_clean":"2024-09-10T10:11:30.723031+0000","last_became_active":"2024-09-10T10:08:32.883573+0000","last_became_peered":"2024-09-10T10:08:32.883573+0000","last_unstale":"2024-09-10T10:11:30.723031+0000","last_undegraded":"2024-09-10T10:11:30.723031+0000","last_fullsized":"2024-09-10T10:11:30.723031+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:56.271267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":126,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040574+0000","last_change":"2024-09-10T10:08:44.928968+0000","last_active":"2024-09-10T10:10:01.040574+0000","last_peered":"2024-09-10T10:10:01.040574+0000","last_clean":"2024-09-10T10:10:01.040574+0000","last_became_active":"2024-09-10T10:08:44.928445+0000","last_became_peered":"2024-09-10T10:08:44.928445+0000","last_unstale":"2024-09-10T10:10:01.040574+0000","last_undegraded":"2024-09-10T10:10:01.040574+0000","last_fullsized":"2024-09-10T10:10:01.040574+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:01.799454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.748248+0000","last_change":"2024-09-10T10:08:35.369027+0000","last_active":"2024-09-10T10:10:58.748248+0000","last_peered":"2024-09-10T10:10:58.748248+0000","last_clean":"2024-09-10T10:10:58.748248+0000","last_became_active":"2024-09-10T10:08:35.368692+0000","last_became_peered":"2024-09-10T10:08:35.368692+0000","last_unstale":"2024-09-10T10:10:58.748248+0000","last_undegraded":"2024-09-10T10:10:58.748248+0000","last_fullsized":"2024-09-10T10:10:58.748248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:09.500617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184814+0000","last_change":"2024-09-10T10:08:32.888661+0000","last_active":"2024-09-10T10:10:01.184814+0000","last_peered":"2024-09-10T10:10:01.184814+0000","last_clean":"2024-09-10T10:10:01.184814+0000","last_became_active":"2024-09-10T10:08:32.888312+0000","last_became_peered":"2024-09-10T10:08:32.888312+0000","last_unstale":"2024-09-10T10:10:01.184814+0000","last_undegraded":"2024-09-10T10:10:01.184814+0000","last_fullsized":"2024-09-10T10:10:01.184814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:47.293560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840405+0000","last_change":"2024-09-10T10:08:44.929512+0000","last_active":"2024-09-10T10:10:00.840405+0000","last_peered":"2024-09-10T10:10:00.840405+0000","last_clean":"2024-09-10T10:10:00.840405+0000","last_became_active":"2024-09-10T10:08:44.928992+0000","last_became_peered":"2024-09-10T10:08:44.928992+0000","last_unstale":"2024-09-10T10:10:00.840405+0000","last_undegraded":"2024-09-10T10:10:00.840405+0000","last_fullsized":"2024-09-10T10:10:00.840405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:31.827967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'8","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766202+0000","last_change":"2024-09-10T10:10:00.863430+0000","last_active":"2024-09-10T10:10:58.766202+0000","last_peered":"2024-09-10T10:10:58.766202+0000","last_clean":"2024-09-10T10:10:58.766202+0000","last_became_active":"2024-09-10T10:10:00.863082+0000","last_became_peered":"2024-09-10T10:10:00.863082+0000","last_unstale":"2024-09-10T10:10:58.766202+0000","last_undegraded":"2024-09-10T10:10:58.766202+0000","last_fullsized":"2024-09-10T10:10:58.766202+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:24.848797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722248+0000","last_change":"2024-09-10T10:08:32.885451+0000","last_active":"2024-09-10T10:10:00.722248+0000","last_peered":"2024-09-10T10:10:00.722248+0000","last_clean":"2024-09-10T10:10:00.722248+0000","last_became_active":"2024-09-10T10:08:32.885102+0000","last_became_peered":"2024-09-10T10:08:32.885102+0000","last_unstale":"2024-09-10T10:10:00.722248+0000","last_undegraded":"2024-09-10T10:10:00.722248+0000","last_fullsized":"2024-09-10T10:10:00.722248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:52.310192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":356,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185287+0000","last_change":"2024-09-10T10:07:13.661841+0000","last_active":"2024-09-10T10:10:01.185287+0000","last_peered":"2024-09-10T10:10:01.185287+0000","last_clean":"2024-09-10T10:10:01.185287+0000","last_became_active":"2024-09-10T10:07:13.661310+0000","last_became_peered":"2024-09-10T10:07:13.661310+0000","last_unstale":"2024-09-10T10:10:01.185287+0000","last_undegraded":"2024-09-10T10:10:01.185287+0000","last_fullsized":"2024-09-10T10:10:01.185287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:03:29.327083+0000","last_clean_scrub_stamp":"2024-09-10T10:03:29.327083+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:39.414636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185638+0000","last_change":"2024-09-10T10:08:44.391277+0000","last_active":"2024-09-10T10:10:01.185638+0000","last_peered":"2024-09-10T10:10:01.185638+0000","last_clean":"2024-09-10T10:10:01.185638+0000","last_became_active":"2024-09-10T10:08:44.390867+0000","last_became_peered":"2024-09-10T10:08:44.390867+0000","last_unstale":"2024-09-10T10:10:01.185638+0000","last_undegraded":"2024-09-10T10:10:01.185638+0000","last_fullsized":"2024-09-10T10:10:01.185638+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:23.299812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772994+0000","last_change":"2024-09-10T10:08:35.364750+0000","last_active":"2024-09-10T10:10:58.772994+0000","last_peered":"2024-09-10T10:10:58.772994+0000","last_clean":"2024-09-10T10:10:58.772994+0000","last_became_active":"2024-09-10T10:08:35.364034+0000","last_became_peered":"2024-09-10T10:08:35.364034+0000","last_unstale":"2024-09-10T10:10:58.772994+0000","last_undegraded":"2024-09-10T10:10:58.772994+0000","last_fullsized":"2024-09-10T10:10:58.772994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:15.296086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973375+0000","last_change":"2024-09-10T10:08:32.886884+0000","last_active":"2024-09-10T10:10:00.973375+0000","last_peered":"2024-09-10T10:10:00.973375+0000","last_clean":"2024-09-10T10:10:00.973375+0000","last_became_active":"2024-09-10T10:08:32.886544+0000","last_became_peered":"2024-09-10T10:08:32.886544+0000","last_unstale":"2024-09-10T10:10:00.973375+0000","last_undegraded":"2024-09-10T10:10:00.973375+0000","last_fullsized":"2024-09-10T10:10:00.973375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:30.511881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.862240+0000","last_change":"2024-09-10T10:08:44.390761+0000","last_active":"2024-09-10T10:10:00.862240+0000","last_peered":"2024-09-10T10:10:00.862240+0000","last_clean":"2024-09-10T10:10:00.862240+0000","last_became_active":"2024-09-10T10:08:44.390190+0000","last_became_peered":"2024-09-10T10:08:44.390190+0000","last_unstale":"2024-09-10T10:10:00.862240+0000","last_undegraded":"2024-09-10T10:10:00.862240+0000","last_fullsized":"2024-09-10T10:10:00.862240+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:38.216171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767507+0000","last_change":"2024-09-10T10:08:35.362956+0000","last_active":"2024-09-10T10:10:58.767507+0000","last_peered":"2024-09-10T10:10:58.767507+0000","last_clean":"2024-09-10T10:10:58.767507+0000","last_became_active":"2024-09-10T10:08:35.362623+0000","last_became_peered":"2024-09-10T10:08:35.362623+0000","last_unstale":"2024-09-10T10:10:58.767507+0000","last_undegraded":"2024-09-10T10:10:58.767507+0000","last_fullsized":"2024-09-10T10:10:58.767507+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:50.162838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840553+0000","last_change":"2024-09-10T10:08:32.889741+0000","last_active":"2024-09-10T10:10:00.840553+0000","last_peered":"2024-09-10T10:10:00.840553+0000","last_clean":"2024-09-10T10:10:00.840553+0000","last_became_active":"2024-09-10T10:08:32.889394+0000","last_became_peered":"2024-09-10T10:08:32.889394+0000","last_unstale":"2024-09-10T10:10:00.840553+0000","last_undegraded":"2024-09-10T10:10:00.840553+0000","last_fullsized":"2024-09-10T10:10:00.840553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:16.845738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.938314+0000","last_change":"2024-09-10T10:08:44.403781+0000","last_active":"2024-09-10T10:10:00.938314+0000","last_peered":"2024-09-10T10:10:00.938314+0000","last_clean":"2024-09-10T10:10:00.938314+0000","last_became_active":"2024-09-10T10:08:44.399601+0000","last_became_peered":"2024-09-10T10:08:44.399601+0000","last_unstale":"2024-09-10T10:10:00.938314+0000","last_undegraded":"2024-09-10T10:10:00.938314+0000","last_fullsized":"2024-09-10T10:10:00.938314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:45.587247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765508+0000","last_change":"2024-09-10T10:08:35.367825+0000","last_active":"2024-09-10T10:10:58.765508+0000","last_peered":"2024-09-10T10:10:58.765508+0000","last_clean":"2024-09-10T10:10:58.765508+0000","last_became_active":"2024-09-10T10:08:35.367511+0000","last_became_peered":"2024-09-10T10:08:35.367511+0000","last_unstale":"2024-09-10T10:10:58.765508+0000","last_undegraded":"2024-09-10T10:10:58.765508+0000","last_fullsized":"2024-09-10T10:10:58.765508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:03.356912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039782+0000","last_change":"2024-09-10T10:08:32.888524+0000","last_active":"2024-09-10T10:10:01.039782+0000","last_peered":"2024-09-10T10:10:01.039782+0000","last_clean":"2024-09-10T10:10:01.039782+0000","last_became_active":"2024-09-10T10:08:32.888148+0000","last_became_peered":"2024-09-10T10:08:32.888148+0000","last_unstale":"2024-09-10T10:10:01.039782+0000","last_undegraded":"2024-09-10T10:10:01.039782+0000","last_fullsized":"2024-09-10T10:10:01.039782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:34.342167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.839577+0000","last_change":"2024-09-10T10:08:44.392952+0000","last_active":"2024-09-10T10:10:00.839577+0000","last_peered":"2024-09-10T10:10:00.839577+0000","last_clean":"2024-09-10T10:10:00.839577+0000","last_became_active":"2024-09-10T10:08:44.392476+0000","last_became_peered":"2024-09-10T10:08:44.392476+0000","last_unstale":"2024-09-10T10:10:00.839577+0000","last_undegraded":"2024-09-10T10:10:00.839577+0000","last_fullsized":"2024-09-10T10:10:00.839577+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:26.530305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761361+0000","last_change":"2024-09-10T10:08:35.364501+0000","last_active":"2024-09-10T10:10:58.761361+0000","last_peered":"2024-09-10T10:10:58.761361+0000","last_clean":"2024-09-10T10:10:58.761361+0000","last_became_active":"2024-09-10T10:08:35.364102+0000","last_became_peered":"2024-09-10T10:08:35.364102+0000","last_unstale":"2024-09-10T10:10:58.761361+0000","last_undegraded":"2024-09-10T10:10:58.761361+0000","last_fullsized":"2024-09-10T10:10:58.761361+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:42.743140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":22,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185891+0000","last_change":"2024-09-10T10:09:00.461639+0000","last_active":"2024-09-10T10:10:01.185891+0000","last_peered":"2024-09-10T10:10:01.185891+0000","last_clean":"2024-09-10T10:10:01.185891+0000","last_became_active":"2024-09-10T10:09:00.457246+0000","last_became_peered":"2024-09-10T10:09:00.457246+0000","last_unstale":"2024-09-10T10:10:01.185891+0000","last_undegraded":"2024-09-10T10:10:01.185891+0000","last_fullsized":"2024-09-10T10:10:01.185891+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:30.387035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840110+0000","last_change":"2024-09-10T10:08:44.401728+0000","last_active":"2024-09-10T10:10:00.840110+0000","last_peered":"2024-09-10T10:10:00.840110+0000","last_clean":"2024-09-10T10:10:00.840110+0000","last_became_active":"2024-09-10T10:08:44.401334+0000","last_became_peered":"2024-09-10T10:08:44.401334+0000","last_unstale":"2024-09-10T10:10:00.840110+0000","last_undegraded":"2024-09-10T10:10:00.840110+0000","last_fullsized":"2024-09-10T10:10:00.840110+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:57.496196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"95'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769526+0000","last_change":"2024-09-10T10:09:00.486353+0000","last_active":"2024-09-10T10:10:58.769526+0000","last_peered":"2024-09-10T10:10:58.769526+0000","last_clean":"2024-09-10T10:10:58.769526+0000","last_became_active":"2024-09-10T10:09:00.485938+0000","last_became_peered":"2024-09-10T10:09:00.485938+0000","last_unstale":"2024-09-10T10:10:58.769526+0000","last_undegraded":"2024-09-10T10:10:58.769526+0000","last_fullsized":"2024-09-10T10:10:58.769526+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:38.367159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.722331+0000","last_change":"2024-09-10T10:08:32.893278+0000","last_active":"2024-09-10T10:10:00.722331+0000","last_peered":"2024-09-10T10:10:00.722331+0000","last_clean":"2024-09-10T10:10:00.722331+0000","last_became_active":"2024-09-10T10:08:32.892848+0000","last_became_peered":"2024-09-10T10:08:32.892848+0000","last_unstale":"2024-09-10T10:10:00.722331+0000","last_undegraded":"2024-09-10T10:10:00.722331+0000","last_fullsized":"2024-09-10T10:10:00.722331+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:09.336253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.040465+0000","last_change":"2024-09-10T10:08:44.407213+0000","last_active":"2024-09-10T10:10:01.040465+0000","last_peered":"2024-09-10T10:10:01.040465+0000","last_clean":"2024-09-10T10:10:01.040465+0000","last_became_active":"2024-09-10T10:08:44.405198+0000","last_became_peered":"2024-09-10T10:08:44.405198+0000","last_unstale":"2024-09-10T10:10:01.040465+0000","last_undegraded":"2024-09-10T10:10:01.040465+0000","last_fullsized":"2024-09-10T10:10:01.040465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:15.921684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.767621+0000","last_change":"2024-09-10T10:08:35.362683+0000","last_active":"2024-09-10T10:10:58.767621+0000","last_peered":"2024-09-10T10:10:58.767621+0000","last_clean":"2024-09-10T10:10:58.767621+0000","last_became_active":"2024-09-10T10:08:35.362353+0000","last_became_peered":"2024-09-10T10:08:35.362353+0000","last_unstale":"2024-09-10T10:10:58.767621+0000","last_undegraded":"2024-09-10T10:10:58.767621+0000","last_fullsized":"2024-09-10T10:10:58.767621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.489716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"95'5","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:28.720691+0000","last_change":"2024-09-10T10:08:32.881024+0000","last_active":"2024-09-10T10:11:28.720691+0000","last_peered":"2024-09-10T10:11:28.720691+0000","last_clean":"2024-09-10T10:11:28.720691+0000","last_became_active":"2024-09-10T10:08:32.880691+0000","last_became_peered":"2024-09-10T10:08:32.880691+0000","last_unstale":"2024-09-10T10:11:28.720691+0000","last_undegraded":"2024-09-10T10:11:28.720691+0000","last_fullsized":"2024-09-10T10:11:28.720691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:15.988063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724443+0000","last_change":"2024-09-10T10:08:44.400509+0000","last_active":"2024-09-10T10:10:00.724443+0000","last_peered":"2024-09-10T10:10:00.724443+0000","last_clean":"2024-09-10T10:10:00.724443+0000","last_became_active":"2024-09-10T10:08:44.400152+0000","last_became_peered":"2024-09-10T10:08:44.400152+0000","last_unstale":"2024-09-10T10:10:00.724443+0000","last_undegraded":"2024-09-10T10:10:00.724443+0000","last_fullsized":"2024-09-10T10:10:00.724443+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:43.550208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.775766+0000","last_change":"2024-09-10T10:08:35.364208+0000","last_active":"2024-09-10T10:10:58.775766+0000","last_peered":"2024-09-10T10:10:58.775766+0000","last_clean":"2024-09-10T10:10:58.775766+0000","last_became_active":"2024-09-10T10:08:35.363751+0000","last_became_peered":"2024-09-10T10:08:35.363751+0000","last_unstale":"2024-09-10T10:10:58.775766+0000","last_undegraded":"2024-09-10T10:10:58.775766+0000","last_fullsized":"2024-09-10T10:10:58.775766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:21.791512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840204+0000","last_change":"2024-09-10T10:08:32.890611+0000","last_active":"2024-09-10T10:10:00.840204+0000","last_peered":"2024-09-10T10:10:00.840204+0000","last_clean":"2024-09-10T10:10:00.840204+0000","last_became_active":"2024-09-10T10:08:32.890296+0000","last_became_peered":"2024-09-10T10:08:32.890296+0000","last_unstale":"2024-09-10T10:10:00.840204+0000","last_undegraded":"2024-09-10T10:10:00.840204+0000","last_fullsized":"2024-09-10T10:10:00.840204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:26.977575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185624+0000","last_change":"2024-09-10T10:08:44.402607+0000","last_active":"2024-09-10T10:10:01.185624+0000","last_peered":"2024-09-10T10:10:01.185624+0000","last_clean":"2024-09-10T10:10:01.185624+0000","last_became_active":"2024-09-10T10:08:44.401623+0000","last_became_peered":"2024-09-10T10:08:44.401623+0000","last_unstale":"2024-09-10T10:10:01.185624+0000","last_undegraded":"2024-09-10T10:10:01.185624+0000","last_fullsized":"2024-09-10T10:10:01.185624+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:21.105349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.775534+0000","last_change":"2024-09-10T10:08:35.360642+0000","last_active":"2024-09-10T10:10:58.775534+0000","last_peered":"2024-09-10T10:10:58.775534+0000","last_clean":"2024-09-10T10:10:58.775534+0000","last_became_active":"2024-09-10T10:08:35.356667+0000","last_became_peered":"2024-09-10T10:08:35.356667+0000","last_unstale":"2024-09-10T10:10:58.775534+0000","last_undegraded":"2024-09-10T10:10:58.775534+0000","last_fullsized":"2024-09-10T10:10:58.775534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:08.404973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972507+0000","last_change":"2024-09-10T10:08:32.890418+0000","last_active":"2024-09-10T10:10:00.972507+0000","last_peered":"2024-09-10T10:10:00.972507+0000","last_clean":"2024-09-10T10:10:00.972507+0000","last_became_active":"2024-09-10T10:08:32.890081+0000","last_became_peered":"2024-09-10T10:08:32.890081+0000","last_unstale":"2024-09-10T10:10:00.972507+0000","last_undegraded":"2024-09-10T10:10:00.972507+0000","last_fullsized":"2024-09-10T10:10:00.972507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:52.839714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840379+0000","last_change":"2024-09-10T10:08:44.401322+0000","last_active":"2024-09-10T10:10:00.840379+0000","last_peered":"2024-09-10T10:10:00.840379+0000","last_clean":"2024-09-10T10:10:00.840379+0000","last_became_active":"2024-09-10T10:08:44.400906+0000","last_became_peered":"2024-09-10T10:08:44.400906+0000","last_unstale":"2024-09-10T10:10:00.840379+0000","last_undegraded":"2024-09-10T10:10:00.840379+0000","last_fullsized":"2024-09-10T10:10:00.840379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:08.616288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761674+0000","last_change":"2024-09-10T10:08:35.366580+0000","last_active":"2024-09-10T10:10:58.761674+0000","last_peered":"2024-09-10T10:10:58.761674+0000","last_clean":"2024-09-10T10:10:58.761674+0000","last_became_active":"2024-09-10T10:08:35.365943+0000","last_became_peered":"2024-09-10T10:08:35.365943+0000","last_unstale":"2024-09-10T10:10:58.761674+0000","last_undegraded":"2024-09-10T10:10:58.761674+0000","last_fullsized":"2024-09-10T10:10:58.761674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:58.351517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"95'39","reported_seq":342,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:30.723173+0000","last_change":"2024-09-10T10:08:32.888411+0000","last_active":"2024-09-10T10:11:30.723173+0000","last_peered":"2024-09-10T10:11:30.723173+0000","last_clean":"2024-09-10T10:11:30.723173+0000","last_became_active":"2024-09-10T10:08:32.888093+0000","last_became_peered":"2024-09-10T10:08:32.888093+0000","last_unstale":"2024-09-10T10:11:30.723173+0000","last_undegraded":"2024-09-10T10:11:30.723173+0000","last_fullsized":"2024-09-10T10:11:30.723173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.532868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68009,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":262,"num_read_kb":199,"num_write":40,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.724453+0000","last_change":"2024-09-10T10:08:44.400432+0000","last_active":"2024-09-10T10:10:00.724453+0000","last_peered":"2024-09-10T10:10:00.724453+0000","last_clean":"2024-09-10T10:10:00.724453+0000","last_became_active":"2024-09-10T10:08:44.399981+0000","last_became_peered":"2024-09-10T10:08:44.399981+0000","last_unstale":"2024-09-10T10:10:00.724453+0000","last_undegraded":"2024-09-10T10:10:00.724453+0000","last_fullsized":"2024-09-10T10:10:00.724453+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:57.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"95'11","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765617+0000","last_change":"2024-09-10T10:09:00.460848+0000","last_active":"2024-09-10T10:10:58.765617+0000","last_peered":"2024-09-10T10:10:58.765617+0000","last_clean":"2024-09-10T10:10:58.765617+0000","last_became_active":"2024-09-10T10:09:00.460459+0000","last_became_peered":"2024-09-10T10:09:00.460459+0000","last_unstale":"2024-09-10T10:10:58.765617+0000","last_undegraded":"2024-09-10T10:10:58.765617+0000","last_fullsized":"2024-09-10T10:10:58.765617+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:06.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840557+0000","last_change":"2024-09-10T10:08:32.885909+0000","last_active":"2024-09-10T10:10:00.840557+0000","last_peered":"2024-09-10T10:10:00.840557+0000","last_clean":"2024-09-10T10:10:00.840557+0000","last_became_active":"2024-09-10T10:08:32.885512+0000","last_became_peered":"2024-09-10T10:08:32.885512+0000","last_unstale":"2024-09-10T10:10:00.840557+0000","last_undegraded":"2024-09-10T10:10:00.840557+0000","last_fullsized":"2024-09-10T10:10:00.840557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:44.850772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721902+0000","last_change":"2024-09-10T10:08:44.400323+0000","last_active":"2024-09-10T10:10:00.721902+0000","last_peered":"2024-09-10T10:10:00.721902+0000","last_clean":"2024-09-10T10:10:00.721902+0000","last_became_active":"2024-09-10T10:08:44.399923+0000","last_became_peered":"2024-09-10T10:08:44.399923+0000","last_unstale":"2024-09-10T10:10:00.721902+0000","last_undegraded":"2024-09-10T10:10:00.721902+0000","last_fullsized":"2024-09-10T10:10:00.721902+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:45.496392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771495+0000","last_change":"2024-09-10T10:08:35.375543+0000","last_active":"2024-09-10T10:10:58.771495+0000","last_peered":"2024-09-10T10:10:58.771495+0000","last_clean":"2024-09-10T10:10:58.771495+0000","last_became_active":"2024-09-10T10:08:35.374312+0000","last_became_peered":"2024-09-10T10:08:35.374312+0000","last_unstale":"2024-09-10T10:10:58.771495+0000","last_undegraded":"2024-09-10T10:10:58.771495+0000","last_fullsized":"2024-09-10T10:10:58.771495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:34.208716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.184909+0000","last_change":"2024-09-10T10:08:32.888540+0000","last_active":"2024-09-10T10:10:01.184909+0000","last_peered":"2024-09-10T10:10:01.184909+0000","last_clean":"2024-09-10T10:10:01.184909+0000","last_became_active":"2024-09-10T10:08:32.888187+0000","last_became_peered":"2024-09-10T10:08:32.888187+0000","last_unstale":"2024-09-10T10:10:01.184909+0000","last_undegraded":"2024-09-10T10:10:01.184909+0000","last_fullsized":"2024-09-10T10:10:01.184909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:06.694533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.723713+0000","last_change":"2024-09-10T10:08:44.397995+0000","last_active":"2024-09-10T10:10:00.723713+0000","last_peered":"2024-09-10T10:10:00.723713+0000","last_clean":"2024-09-10T10:10:00.723713+0000","last_became_active":"2024-09-10T10:08:44.397583+0000","last_became_peered":"2024-09-10T10:08:44.397583+0000","last_unstale":"2024-09-10T10:10:00.723713+0000","last_undegraded":"2024-09-10T10:10:00.723713+0000","last_fullsized":"2024-09-10T10:10:00.723713+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:03.908014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773846+0000","last_change":"2024-09-10T10:08:35.361053+0000","last_active":"2024-09-10T10:10:58.773846+0000","last_peered":"2024-09-10T10:10:58.773846+0000","last_clean":"2024-09-10T10:10:58.773846+0000","last_became_active":"2024-09-10T10:08:35.360736+0000","last_became_peered":"2024-09-10T10:08:35.360736+0000","last_unstale":"2024-09-10T10:10:58.773846+0000","last_undegraded":"2024-09-10T10:10:58.773846+0000","last_fullsized":"2024-09-10T10:10:58.773846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:45.435384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"95'4","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:29.721715+0000","last_change":"2024-09-10T10:08:32.885067+0000","last_active":"2024-09-10T10:11:29.721715+0000","last_peered":"2024-09-10T10:11:29.721715+0000","last_clean":"2024-09-10T10:11:29.721715+0000","last_became_active":"2024-09-10T10:08:32.884676+0000","last_became_peered":"2024-09-10T10:08:32.884676+0000","last_unstale":"2024-09-10T10:11:29.721715+0000","last_undegraded":"2024-09-10T10:11:29.721715+0000","last_fullsized":"2024-09-10T10:11:29.721715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:59.667680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":125,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.721235+0000","last_change":"2024-09-10T10:08:44.395892+0000","last_active":"2024-09-10T10:10:00.721235+0000","last_peered":"2024-09-10T10:10:00.721235+0000","last_clean":"2024-09-10T10:10:00.721235+0000","last_became_active":"2024-09-10T10:08:44.395188+0000","last_became_peered":"2024-09-10T10:08:44.395188+0000","last_unstale":"2024-09-10T10:10:00.721235+0000","last_undegraded":"2024-09-10T10:10:00.721235+0000","last_fullsized":"2024-09-10T10:10:00.721235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:27.562053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.939198+0000","last_change":"2024-09-10T10:08:44.403185+0000","last_active":"2024-09-10T10:10:00.939198+0000","last_peered":"2024-09-10T10:10:00.939198+0000","last_clean":"2024-09-10T10:10:00.939198+0000","last_became_active":"2024-09-10T10:08:44.399943+0000","last_became_peered":"2024-09-10T10:08:44.399943+0000","last_unstale":"2024-09-10T10:10:00.939198+0000","last_undegraded":"2024-09-10T10:10:00.939198+0000","last_fullsized":"2024-09-10T10:10:00.939198+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:07.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.770162+0000","last_change":"2024-09-10T10:08:35.367552+0000","last_active":"2024-09-10T10:10:58.770162+0000","last_peered":"2024-09-10T10:10:58.770162+0000","last_clean":"2024-09-10T10:10:58.770162+0000","last_became_active":"2024-09-10T10:08:35.367215+0000","last_became_peered":"2024-09-10T10:08:35.367215+0000","last_unstale":"2024-09-10T10:10:58.770162+0000","last_undegraded":"2024-09-10T10:10:58.770162+0000","last_fullsized":"2024-09-10T10:10:58.770162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:28.756769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.840019+0000","last_change":"2024-09-10T10:08:32.885830+0000","last_active":"2024-09-10T10:10:00.840019+0000","last_peered":"2024-09-10T10:10:00.840019+0000","last_clean":"2024-09-10T10:10:00.840019+0000","last_became_active":"2024-09-10T10:08:32.885465+0000","last_became_peered":"2024-09-10T10:08:32.885465+0000","last_unstale":"2024-09-10T10:10:00.840019+0000","last_undegraded":"2024-09-10T10:10:00.840019+0000","last_fullsized":"2024-09-10T10:10:00.840019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:55.101364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.185761+0000","last_change":"2024-09-10T10:09:00.487666+0000","last_active":"2024-09-10T10:10:01.185761+0000","last_peered":"2024-09-10T10:10:01.185761+0000","last_clean":"2024-09-10T10:10:01.185761+0000","last_became_active":"2024-09-10T10:09:00.487110+0000","last_became_peered":"2024-09-10T10:09:00.487110+0000","last_unstale":"2024-09-10T10:10:01.185761+0000","last_undegraded":"2024-09-10T10:10:01.185761+0000","last_fullsized":"2024-09-10T10:10:01.185761+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:28.817826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755501+0000","last_change":"2024-09-10T10:08:35.356247+0000","last_active":"2024-09-10T10:10:58.755501+0000","last_peered":"2024-09-10T10:10:58.755501+0000","last_clean":"2024-09-10T10:10:58.755501+0000","last_became_active":"2024-09-10T10:08:35.355953+0000","last_became_peered":"2024-09-10T10:08:35.355953+0000","last_unstale":"2024-09-10T10:10:58.755501+0000","last_undegraded":"2024-09-10T10:10:58.755501+0000","last_fullsized":"2024-09-10T10:10:58.755501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:24.625382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.039784+0000","last_change":"2024-09-10T10:08:32.882151+0000","last_active":"2024-09-10T10:10:01.039784+0000","last_peered":"2024-09-10T10:10:01.039784+0000","last_clean":"2024-09-10T10:10:01.039784+0000","last_became_active":"2024-09-10T10:08:32.881688+0000","last_became_peered":"2024-09-10T10:08:32.881688+0000","last_unstale":"2024-09-10T10:10:01.039784+0000","last_undegraded":"2024-09-10T10:10:01.039784+0000","last_fullsized":"2024-09-10T10:10:01.039784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:49.186299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:01.109676+0000","last_change":"2024-09-10T10:08:32.887018+0000","last_active":"2024-09-10T10:10:01.109676+0000","last_peered":"2024-09-10T10:10:01.109676+0000","last_clean":"2024-09-10T10:10:01.109676+0000","last_became_active":"2024-09-10T10:08:32.886636+0000","last_became_peered":"2024-09-10T10:08:32.886636+0000","last_unstale":"2024-09-10T10:10:01.109676+0000","last_undegraded":"2024-09-10T10:10:01.109676+0000","last_fullsized":"2024-09-10T10:10:01.109676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:24.445309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762425+0000","last_change":"2024-09-10T10:08:35.363803+0000","last_active":"2024-09-10T10:10:58.762425+0000","last_peered":"2024-09-10T10:10:58.762425+0000","last_clean":"2024-09-10T10:10:58.762425+0000","last_became_active":"2024-09-10T10:08:35.363442+0000","last_became_peered":"2024-09-10T10:08:35.363442+0000","last_unstale":"2024-09-10T10:10:58.762425+0000","last_undegraded":"2024-09-10T10:10:58.762425+0000","last_fullsized":"2024-09-10T10:10:58.762425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:59.045347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.972949+0000","last_change":"2024-09-10T10:08:44.403970+0000","last_active":"2024-09-10T10:10:00.972949+0000","last_peered":"2024-09-10T10:10:00.972949+0000","last_clean":"2024-09-10T10:10:00.972949+0000","last_became_active":"2024-09-10T10:08:44.403462+0000","last_became_peered":"2024-09-10T10:08:44.403462+0000","last_unstale":"2024-09-10T10:10:00.972949+0000","last_undegraded":"2024-09-10T10:10:00.972949+0000","last_fullsized":"2024-09-10T10:10:00.972949+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:09.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'7","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:11:30.723723+0000","last_change":"2024-09-10T10:08:32.893227+0000","last_active":"2024-09-10T10:11:30.723723+0000","last_peered":"2024-09-10T10:11:30.723723+0000","last_clean":"2024-09-10T10:11:30.723723+0000","last_became_active":"2024-09-10T10:08:32.892732+0000","last_became_peered":"2024-09-10T10:08:32.892732+0000","last_unstale":"2024-09-10T10:11:30.723723+0000","last_undegraded":"2024-09-10T10:11:30.723723+0000","last_fullsized":"2024-09-10T10:11:30.723723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:31.862876+0000","last_clean_scrub_stamp":"2024-09-10T10:08:31.862876+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:16.933955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761246+0000","last_change":"2024-09-10T10:08:35.368806+0000","last_active":"2024-09-10T10:10:58.761246+0000","last_peered":"2024-09-10T10:10:58.761246+0000","last_clean":"2024-09-10T10:10:58.761246+0000","last_became_active":"2024-09-10T10:08:35.368397+0000","last_became_peered":"2024-09-10T10:08:35.368397+0000","last_unstale":"2024-09-10T10:10:58.761246+0000","last_undegraded":"2024-09-10T10:10:58.761246+0000","last_fullsized":"2024-09-10T10:10:58.761246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:39.656295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:00.973102+0000","last_change":"2024-09-10T10:08:44.391941+0000","last_active":"2024-09-10T10:10:00.973102+0000","last_peered":"2024-09-10T10:10:00.973102+0000","last_clean":"2024-09-10T10:10:00.973102+0000","last_became_active":"2024-09-10T10:08:44.391553+0000","last_became_peered":"2024-09-10T10:08:44.391553+0000","last_unstale":"2024-09-10T10:10:00.973102+0000","last_undegraded":"2024-09-10T10:10:00.973102+0000","last_fullsized":"2024-09-10T10:10:00.973102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:43.368162+0000","last_clean_scrub_stamp":"2024-09-10T10:08:43.368162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:34.279772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762216+0000","last_change":"2024-09-10T10:08:35.363192+0000","last_active":"2024-09-10T10:10:58.762216+0000","last_peered":"2024-09-10T10:10:58.762216+0000","last_clean":"2024-09-10T10:10:58.762216+0000","last_became_active":"2024-09-10T10:08:35.362890+0000","last_became_peered":"2024-09-10T10:08:35.362890+0000","last_unstale":"2024-09-10T10:10:58.762216+0000","last_undegraded":"2024-09-10T10:10:58.762216+0000","last_fullsized":"2024-09-10T10:10:58.762216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:07.493539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"95'12","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.748590+0000","last_change":"2024-09-10T10:08:35.362471+0000","last_active":"2024-09-10T10:10:58.748590+0000","last_peered":"2024-09-10T10:10:58.748590+0000","last_clean":"2024-09-10T10:10:58.748590+0000","last_became_active":"2024-09-10T10:08:35.361553+0000","last_became_peered":"2024-09-10T10:08:35.361553+0000","last_unstale":"2024-09-10T10:10:58.748590+0000","last_undegraded":"2024-09-10T10:10:58.748590+0000","last_fullsized":"2024-09-10T10:10:58.748590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:24.511901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.777795+0000","last_change":"2024-09-10T10:08:35.371025+0000","last_active":"2024-09-10T10:10:58.777795+0000","last_peered":"2024-09-10T10:10:58.777795+0000","last_clean":"2024-09-10T10:10:58.777795+0000","last_became_active":"2024-09-10T10:08:35.370692+0000","last_became_peered":"2024-09-10T10:08:35.370692+0000","last_unstale":"2024-09-10T10:10:58.777795+0000","last_undegraded":"2024-09-10T10:10:58.777795+0000","last_fullsized":"2024-09-10T10:10:58.777795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:22.289843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.776381+0000","last_change":"2024-09-10T10:08:35.373519+0000","last_active":"2024-09-10T10:10:58.776381+0000","last_peered":"2024-09-10T10:10:58.776381+0000","last_clean":"2024-09-10T10:10:58.776381+0000","last_became_active":"2024-09-10T10:08:35.372719+0000","last_became_peered":"2024-09-10T10:08:35.372719+0000","last_unstale":"2024-09-10T10:10:58.776381+0000","last_undegraded":"2024-09-10T10:10:58.776381+0000","last_fullsized":"2024-09-10T10:10:58.776381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:24.530809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"95'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778078+0000","last_change":"2024-09-10T10:09:00.489944+0000","last_active":"2024-09-10T10:10:58.778078+0000","last_peered":"2024-09-10T10:10:58.778078+0000","last_clean":"2024-09-10T10:10:58.778078+0000","last_became_active":"2024-09-10T10:09:00.489269+0000","last_became_peered":"2024-09-10T10:09:00.489269+0000","last_unstale":"2024-09-10T10:10:58.778078+0000","last_undegraded":"2024-09-10T10:10:58.778078+0000","last_fullsized":"2024-09-10T10:10:58.778078+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:46.561078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761792+0000","last_change":"2024-09-10T10:08:35.364779+0000","last_active":"2024-09-10T10:10:58.761792+0000","last_peered":"2024-09-10T10:10:58.761792+0000","last_clean":"2024-09-10T10:10:58.761792+0000","last_became_active":"2024-09-10T10:08:35.364455+0000","last_became_peered":"2024-09-10T10:08:35.364455+0000","last_unstale":"2024-09-10T10:10:58.761792+0000","last_undegraded":"2024-09-10T10:10:58.761792+0000","last_fullsized":"2024-09-10T10:10:58.761792+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:08.552218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"95'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.761074+0000","last_change":"2024-09-10T10:08:35.357147+0000","last_active":"2024-09-10T10:10:58.761074+0000","last_peered":"2024-09-10T10:10:58.761074+0000","last_clean":"2024-09-10T10:10:58.761074+0000","last_became_active":"2024-09-10T10:08:35.356808+0000","last_became_peered":"2024-09-10T10:08:35.356808+0000","last_unstale":"2024-09-10T10:10:58.761074+0000","last_undegraded":"2024-09-10T10:10:58.761074+0000","last_fullsized":"2024-09-10T10:10:58.761074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:35.731496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"95'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755499+0000","last_change":"2024-09-10T10:08:35.365795+0000","last_active":"2024-09-10T10:10:58.755499+0000","last_peered":"2024-09-10T10:10:58.755499+0000","last_clean":"2024-09-10T10:10:58.755499+0000","last_became_active":"2024-09-10T10:08:35.365342+0000","last_became_peered":"2024-09-10T10:08:35.365342+0000","last_unstale":"2024-09-10T10:10:58.755499+0000","last_undegraded":"2024-09-10T10:10:58.755499+0000","last_fullsized":"2024-09-10T10:10:58.755499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:20.012890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"95'6","reported_seq":22,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.763139+0000","last_change":"2024-09-10T10:09:00.486664+0000","last_active":"2024-09-10T10:10:58.763139+0000","last_peered":"2024-09-10T10:10:58.763139+0000","last_clean":"2024-09-10T10:10:58.763139+0000","last_became_active":"2024-09-10T10:09:00.486239+0000","last_became_peered":"2024-09-10T10:09:00.486239+0000","last_unstale":"2024-09-10T10:10:58.763139+0000","last_undegraded":"2024-09-10T10:10:58.763139+0000","last_fullsized":"2024-09-10T10:10:58.763139+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:47.472245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.29","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.755183+0000","last_change":"2024-09-10T10:08:35.367403+0000","last_active":"2024-09-10T10:10:58.755183+0000","last_peered":"2024-09-10T10:10:58.755183+0000","last_clean":"2024-09-10T10:10:58.755183+0000","last_became_active":"2024-09-10T10:08:35.365969+0000","last_became_peered":"2024-09-10T10:08:35.365969+0000","last_unstale":"2024-09-10T10:10:58.755183+0000","last_undegraded":"2024-09-10T10:10:58.755183+0000","last_fullsized":"2024-09-10T10:10:58.755183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:27.657226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773597+0000","last_change":"2024-09-10T10:08:35.359185+0000","last_active":"2024-09-10T10:10:58.773597+0000","last_peered":"2024-09-10T10:10:58.773597+0000","last_clean":"2024-09-10T10:10:58.773597+0000","last_became_active":"2024-09-10T10:08:35.358825+0000","last_became_peered":"2024-09-10T10:08:35.358825+0000","last_unstale":"2024-09-10T10:10:58.773597+0000","last_undegraded":"2024-09-10T10:10:58.773597+0000","last_fullsized":"2024-09-10T10:10:58.773597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:31.884533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.778457+0000","last_change":"2024-09-10T10:08:35.378151+0000","last_active":"2024-09-10T10:10:58.778457+0000","last_peered":"2024-09-10T10:10:58.778457+0000","last_clean":"2024-09-10T10:10:58.778457+0000","last_became_active":"2024-09-10T10:08:35.377784+0000","last_became_peered":"2024-09-10T10:08:35.377784+0000","last_unstale":"2024-09-10T10:10:58.778457+0000","last_undegraded":"2024-09-10T10:10:58.778457+0000","last_fullsized":"2024-09-10T10:10:58.778457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.027310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.762465+0000","last_change":"2024-09-10T10:08:35.364550+0000","last_active":"2024-09-10T10:10:58.762465+0000","last_peered":"2024-09-10T10:10:58.762465+0000","last_clean":"2024-09-10T10:10:58.762465+0000","last_became_active":"2024-09-10T10:08:35.364224+0000","last_became_peered":"2024-09-10T10:08:35.364224+0000","last_unstale":"2024-09-10T10:10:58.762465+0000","last_undegraded":"2024-09-10T10:10:58.762465+0000","last_fullsized":"2024-09-10T10:10:58.762465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:38.584494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.750237+0000","last_change":"2024-09-10T10:08:35.357333+0000","last_active":"2024-09-10T10:10:58.750237+0000","last_peered":"2024-09-10T10:10:58.750237+0000","last_clean":"2024-09-10T10:10:58.750237+0000","last_became_active":"2024-09-10T10:08:35.356940+0000","last_became_peered":"2024-09-10T10:08:35.356940+0000","last_unstale":"2024-09-10T10:10:58.750237+0000","last_undegraded":"2024-09-10T10:10:58.750237+0000","last_fullsized":"2024-09-10T10:10:58.750237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:40.745737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.769367+0000","last_change":"2024-09-10T10:08:35.367208+0000","last_active":"2024-09-10T10:10:58.769367+0000","last_peered":"2024-09-10T10:10:58.769367+0000","last_clean":"2024-09-10T10:10:58.769367+0000","last_became_active":"2024-09-10T10:08:35.361942+0000","last_became_peered":"2024-09-10T10:08:35.361942+0000","last_unstale":"2024-09-10T10:10:58.769367+0000","last_undegraded":"2024-09-10T10:10:58.769367+0000","last_fullsized":"2024-09-10T10:10:58.769367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:19.030623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773220+0000","last_change":"2024-09-10T10:08:35.377164+0000","last_active":"2024-09-10T10:10:58.773220+0000","last_peered":"2024-09-10T10:10:58.773220+0000","last_clean":"2024-09-10T10:10:58.773220+0000","last_became_active":"2024-09-10T10:08:35.376457+0000","last_became_peered":"2024-09-10T10:08:35.376457+0000","last_unstale":"2024-09-10T10:10:58.773220+0000","last_undegraded":"2024-09-10T10:10:58.773220+0000","last_fullsized":"2024-09-10T10:10:58.773220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.291635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772661+0000","last_change":"2024-09-10T10:08:35.365096+0000","last_active":"2024-09-10T10:10:58.772661+0000","last_peered":"2024-09-10T10:10:58.772661+0000","last_clean":"2024-09-10T10:10:58.772661+0000","last_became_active":"2024-09-10T10:08:35.364780+0000","last_became_peered":"2024-09-10T10:08:35.364780+0000","last_unstale":"2024-09-10T10:10:58.772661+0000","last_undegraded":"2024-09-10T10:10:58.772661+0000","last_fullsized":"2024-09-10T10:10:58.772661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:30.177904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774627+0000","last_change":"2024-09-10T10:08:35.377017+0000","last_active":"2024-09-10T10:10:58.774627+0000","last_peered":"2024-09-10T10:10:58.774627+0000","last_clean":"2024-09-10T10:10:58.774627+0000","last_became_active":"2024-09-10T10:08:35.372243+0000","last_became_peered":"2024-09-10T10:08:35.372243+0000","last_unstale":"2024-09-10T10:10:58.774627+0000","last_undegraded":"2024-09-10T10:10:58.774627+0000","last_fullsized":"2024-09-10T10:10:58.774627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:26.105505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774291+0000","last_change":"2024-09-10T10:08:35.379782+0000","last_active":"2024-09-10T10:10:58.774291+0000","last_peered":"2024-09-10T10:10:58.774291+0000","last_clean":"2024-09-10T10:10:58.774291+0000","last_became_active":"2024-09-10T10:08:35.377109+0000","last_became_peered":"2024-09-10T10:08:35.377109+0000","last_unstale":"2024-09-10T10:10:58.774291+0000","last_undegraded":"2024-09-10T10:10:58.774291+0000","last_fullsized":"2024-09-10T10:10:58.774291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:10.761016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"95'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.764497+0000","last_change":"2024-09-10T10:08:35.364891+0000","last_active":"2024-09-10T10:10:58.764497+0000","last_peered":"2024-09-10T10:10:58.764497+0000","last_clean":"2024-09-10T10:10:58.764497+0000","last_became_active":"2024-09-10T10:08:35.363845+0000","last_became_peered":"2024-09-10T10:08:35.363845+0000","last_unstale":"2024-09-10T10:10:58.764497+0000","last_undegraded":"2024-09-10T10:10:58.764497+0000","last_fullsized":"2024-09-10T10:10:58.764497+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:03.346994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.766501+0000","last_change":"2024-09-10T10:08:35.363548+0000","last_active":"2024-09-10T10:10:58.766501+0000","last_peered":"2024-09-10T10:10:58.766501+0000","last_clean":"2024-09-10T10:10:58.766501+0000","last_became_active":"2024-09-10T10:08:35.363229+0000","last_became_peered":"2024-09-10T10:08:35.363229+0000","last_unstale":"2024-09-10T10:10:58.766501+0000","last_undegraded":"2024-09-10T10:10:58.766501+0000","last_fullsized":"2024-09-10T10:10:58.766501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:38.773445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773111+0000","last_change":"2024-09-10T10:08:35.360717+0000","last_active":"2024-09-10T10:10:58.773111+0000","last_peered":"2024-09-10T10:10:58.773111+0000","last_clean":"2024-09-10T10:10:58.773111+0000","last_became_active":"2024-09-10T10:08:35.360410+0000","last_became_peered":"2024-09-10T10:08:35.360410+0000","last_unstale":"2024-09-10T10:10:58.773111+0000","last_undegraded":"2024-09-10T10:10:58.773111+0000","last_fullsized":"2024-09-10T10:10:58.773111+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:59.322524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'16","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.772823+0000","last_change":"2024-09-10T10:08:35.362359+0000","last_active":"2024-09-10T10:10:58.772823+0000","last_peered":"2024-09-10T10:10:58.772823+0000","last_clean":"2024-09-10T10:10:58.772823+0000","last_became_active":"2024-09-10T10:08:35.361580+0000","last_became_peered":"2024-09-10T10:08:35.361580+0000","last_unstale":"2024-09-10T10:10:58.772823+0000","last_undegraded":"2024-09-10T10:10:58.772823+0000","last_fullsized":"2024-09-10T10:10:58.772823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:23.265237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"95'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771033+0000","last_change":"2024-09-10T10:08:35.367305+0000","last_active":"2024-09-10T10:10:58.771033+0000","last_peered":"2024-09-10T10:10:58.771033+0000","last_clean":"2024-09-10T10:10:58.771033+0000","last_became_active":"2024-09-10T10:08:35.366936+0000","last_became_peered":"2024-09-10T10:08:35.366936+0000","last_unstale":"2024-09-10T10:10:58.771033+0000","last_undegraded":"2024-09-10T10:10:58.771033+0000","last_fullsized":"2024-09-10T10:10:58.771033+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:28.158474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"95'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.765168+0000","last_change":"2024-09-10T10:08:35.369983+0000","last_active":"2024-09-10T10:10:58.765168+0000","last_peered":"2024-09-10T10:10:58.765168+0000","last_clean":"2024-09-10T10:10:58.765168+0000","last_became_active":"2024-09-10T10:08:35.367662+0000","last_became_peered":"2024-09-10T10:08:35.367662+0000","last_unstale":"2024-09-10T10:10:58.765168+0000","last_undegraded":"2024-09-10T10:10:58.765168+0000","last_fullsized":"2024-09-10T10:10:58.765168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"95'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771023+0000","last_change":"2024-09-10T10:08:35.369237+0000","last_active":"2024-09-10T10:10:58.771023+0000","last_peered":"2024-09-10T10:10:58.771023+0000","last_clean":"2024-09-10T10:10:58.771023+0000","last_became_active":"2024-09-10T10:08:35.368903+0000","last_became_peered":"2024-09-10T10:08:35.368903+0000","last_unstale":"2024-09-10T10:10:58.771023+0000","last_undegraded":"2024-09-10T10:10:58.771023+0000","last_fullsized":"2024-09-10T10:10:58.771023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:05.150549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"95'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.773489+0000","last_change":"2024-09-10T10:08:35.367284+0000","last_active":"2024-09-10T10:10:58.773489+0000","last_peered":"2024-09-10T10:10:58.773489+0000","last_clean":"2024-09-10T10:10:58.773489+0000","last_became_active":"2024-09-10T10:08:35.366969+0000","last_became_peered":"2024-09-10T10:08:35.366969+0000","last_unstale":"2024-09-10T10:10:58.773489+0000","last_undegraded":"2024-09-10T10:10:58.773489+0000","last_fullsized":"2024-09-10T10:10:58.773489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:16.949804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.749286+0000","last_change":"2024-09-10T10:08:35.374559+0000","last_active":"2024-09-10T10:10:58.749286+0000","last_peered":"2024-09-10T10:10:58.749286+0000","last_clean":"2024-09-10T10:10:58.749286+0000","last_became_active":"2024-09-10T10:08:35.374191+0000","last_became_peered":"2024-09-10T10:08:35.374191+0000","last_unstale":"2024-09-10T10:10:58.749286+0000","last_undegraded":"2024-09-10T10:10:58.749286+0000","last_fullsized":"2024-09-10T10:10:58.749286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:48.292249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.757757+0000","last_change":"2024-09-10T10:08:35.368042+0000","last_active":"2024-09-10T10:10:58.757757+0000","last_peered":"2024-09-10T10:10:58.757757+0000","last_clean":"2024-09-10T10:10:58.757757+0000","last_became_active":"2024-09-10T10:08:35.365985+0000","last_became_peered":"2024-09-10T10:08:35.365985+0000","last_unstale":"2024-09-10T10:10:58.757757+0000","last_undegraded":"2024-09-10T10:10:58.757757+0000","last_fullsized":"2024-09-10T10:10:58.757757+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:04.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"95'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.774113+0000","last_change":"2024-09-10T10:08:35.375826+0000","last_active":"2024-09-10T10:10:58.774113+0000","last_peered":"2024-09-10T10:10:58.774113+0000","last_clean":"2024-09-10T10:10:58.774113+0000","last_became_active":"2024-09-10T10:08:35.375485+0000","last_became_peered":"2024-09-10T10:08:35.375485+0000","last_unstale":"2024-09-10T10:10:58.774113+0000","last_undegraded":"2024-09-10T10:10:58.774113+0000","last_fullsized":"2024-09-10T10:10:58.774113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:49.146648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"95'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.763221+0000","last_change":"2024-09-10T10:08:35.375745+0000","last_active":"2024-09-10T10:10:58.763221+0000","last_peered":"2024-09-10T10:10:58.763221+0000","last_clean":"2024-09-10T10:10:58.763221+0000","last_became_active":"2024-09-10T10:08:35.375427+0000","last_became_peered":"2024-09-10T10:08:35.375427+0000","last_unstale":"2024-09-10T10:10:58.763221+0000","last_undegraded":"2024-09-10T10:10:58.763221+0000","last_fullsized":"2024-09-10T10:10:58.763221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:48.743434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"95'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T10:10:58.771465+0000","last_change":"2024-09-10T10:08:35.377092+0000","last_active":"2024-09-10T10:10:58.771465+0000","last_peered":"2024-09-10T10:10:58.771465+0000","last_clean":"2024-09-10T10:10:58.771465+0000","last_became_active":"2024-09-10T10:08:35.376761+0000","last_became_peered":"2024-09-10T10:08:35.376761+0000","last_unstale":"2024-09-10T10:10:58.771465+0000","last_undegraded":"2024-09-10T10:10:58.771465+0000","last_fullsized":"2024-09-10T10:10:58.771465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:08:34.331577+0000","last_clean_scrub_stamp":"2024-09-10T10:08:34.331577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:58.631742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72687,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":786,"num_read_kb":473,"num_write":183,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":218061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":286200,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449137,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":538290,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678072,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32348,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712804,"statfs":{"total":95995035648,"available":95961911296,"internally_reserved":0,"allocated":1191936,"data_stored":1194079,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841596,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":542600,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070530,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":538402,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299462,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":1135010,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462990,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":533680,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724628,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1114112,"data_stored":1130064,"data_compressed":68823,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888151,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1048576,"data_stored":538864,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149789,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":533874,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411428,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1134592,"data_stored":603483,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1110016,"data_stored":601599,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":535068,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34745,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36393,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:11:34.142 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:11:34.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:34 smithi050 ceph-mon[30354]: pgmap v402: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-10T10:11:34.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:34 smithi050 ceph-mon[30354]: from='client.25280 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:34.524 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:34.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:34 smithi189 ceph-mon[34999]: pgmap v402: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-10T10:11:34.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:34 smithi189 ceph-mon[34999]: from='client.25280 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:34.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:34 smithi084 ceph-mon[34812]: pgmap v402: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-10T10:11:34.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:34 smithi084 ceph-mon[34812]: from='client.25280 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:11:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.097+0000 7f5f34c00640 1 -- 172.21.15.50:0/3763890816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f30109120 msgr2=0x7f5f30110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.097+0000 7f5f34c00640 1 --2- 172.21.15.50:0/3763890816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f30109120 0x7f5f30110ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009ca0 tx=0x7f5f2802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:11:35.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.098+0000 7f5f34c00640 1 -- 172.21.15.50:0/3763890816 shutdown_connections 2024-09-10T10:11:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.098+0000 7f5f34c00640 1 --2- 172.21.15.50:0/3763890816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f30109120 0x7f5f30110ca0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.098+0000 7f5f34c00640 1 --2- 172.21.15.50:0/3763890816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f301049a0 0x7f5f301089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.098+0000 7f5f34c00640 1 --2- 172.21.15.50:0/3763890816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f30103ff0 0x7f5f301043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.098+0000 7f5f34c00640 1 -- 172.21.15.50:0/3763890816 >> 172.21.15.50:0/3763890816 conn(0x7f5f300ffa90 msgr2=0x7f5f30101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.098+0000 7f5f34c00640 1 -- 172.21.15.50:0/3763890816 shutdown_connections 2024-09-10T10:11:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.098+0000 7f5f34c00640 1 -- 172.21.15.50:0/3763890816 wait complete. 2024-09-10T10:11:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.099+0000 7f5f34c00640 1 Processor -- start 2024-09-10T10:11:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.099+0000 7f5f34c00640 1 -- start start 2024-09-10T10:11:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f34c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f30103ff0 0x7f5f3019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f34c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f301049a0 0x7f5f3019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f34c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f30109120 0x7f5f3019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f34c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5f30114130 con 0x7f5f30109120 2024-09-10T10:11:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f34c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f30113fb0 con 0x7f5f30103ff0 2024-09-10T10:11:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f34c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301142b0 con 0x7f5f301049a0 2024-09-10T10:11:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f2de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f30103ff0 0x7f5f3019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f2e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f30109120 0x7f5f3019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f2de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f30103ff0 0x7f5f3019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:59790/0 (socket says 172.21.15.50:59790) 2024-09-10T10:11:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f2de00640 1 -- 172.21.15.50:0/1472666865 learned_addr learned my addr 172.21.15.50:0/1472666865 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f25400640 1 --2- 172.21.15.50:0/1472666865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f301049a0 0x7f5f3019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f2de00640 1 -- 172.21.15.50:0/1472666865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f301049a0 msgr2=0x7f5f3019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f2de00640 1 --2- 172.21.15.50:0/1472666865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f301049a0 0x7f5f3019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f2de00640 1 -- 172.21.15.50:0/1472666865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f30109120 msgr2=0x7f5f3019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f2de00640 1 --2- 172.21.15.50:0/1472666865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f30109120 0x7f5f3019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.100+0000 7f5f2de00640 1 -- 172.21.15.50:0/1472666865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3019f540 con 0x7f5f30103ff0 2024-09-10T10:11:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.101+0000 7f5f2de00640 1 --2- 172.21.15.50:0/1472666865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f30103ff0 0x7f5f3019a590 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000e9f0 tx=0x7f5f2000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:35.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.101+0000 7f5f27400640 1 -- 172.21.15.50:0/1472666865 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2000cd80 con 0x7f5f30103ff0 2024-09-10T10:11:35.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.101+0000 7f5f27400640 1 -- 172.21.15.50:0/1472666865 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f20010910 con 0x7f5f30103ff0 2024-09-10T10:11:35.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.101+0000 7f5f34c00640 1 -- 172.21.15.50:0/1472666865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f3019f830 con 0x7f5f30103ff0 2024-09-10T10:11:35.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.101+0000 7f5f27400640 1 -- 172.21.15.50:0/1472666865 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f200188f0 con 0x7f5f30103ff0 2024-09-10T10:11:35.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.101+0000 7f5f34c00640 1 -- 172.21.15.50:0/1472666865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f301a7110 con 0x7f5f30103ff0 2024-09-10T10:11:35.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.102+0000 7f5f34c00640 1 -- 172.21.15.50:0/1472666865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f301043d0 con 0x7f5f30103ff0 2024-09-10T10:11:35.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.104+0000 7f5f27400640 1 -- 172.21.15.50:0/1472666865 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5f20010ac0 con 0x7f5f30103ff0 2024-09-10T10:11:35.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.106+0000 7f5f27400640 1 --2- 172.21.15.50:0/1472666865 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f140a2b80 0x7f5f140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:35.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.106+0000 7f5f27400640 1 -- 172.21.15.50:0/1472666865 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f5f200cfbc0 con 0x7f5f30103ff0 2024-09-10T10:11:35.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.106+0000 7f5f25400640 1 --2- 172.21.15.50:0/1472666865 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f140a2b80 0x7f5f140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:35.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.107+0000 7f5f25400640 1 --2- 172.21.15.50:0/1472666865 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f140a2b80 0x7f5f140a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5f300ffeb0 tx=0x7f5f1800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:35.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.108+0000 7f5f27400640 1 -- 172.21.15.50:0/1472666865 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f2009c0e0 con 0x7f5f30103ff0 2024-09-10T10:11:35.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.327+0000 7f5f34c00640 1 -- 172.21.15.50:0/1472666865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f301a73b0 con 0x7f5f30103ff0 2024-09-10T10:11:35.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.328+0000 7f5f27400640 1 -- 172.21.15.50:0/1472666865 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f5f200a03e0 con 0x7f5f30103ff0 2024-09-10T10:11:35.330 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:35.330 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:11:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:11:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.331+0000 7f5f34c00640 1 -- 172.21.15.50:0/1472666865 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f140a2b80 msgr2=0x7f5f140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.331+0000 7f5f34c00640 1 --2- 172.21.15.50:0/1472666865 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f140a2b80 0x7f5f140a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5f300ffeb0 tx=0x7f5f1800b410 comp rx=0 tx=0).stop 2024-09-10T10:11:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.331+0000 7f5f34c00640 1 -- 172.21.15.50:0/1472666865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f30103ff0 msgr2=0x7f5f3019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.331+0000 7f5f34c00640 1 --2- 172.21.15.50:0/1472666865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f30103ff0 0x7f5f3019a590 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000e9f0 tx=0x7f5f2000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:11:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.331+0000 7f5f34c00640 1 -- 172.21.15.50:0/1472666865 shutdown_connections 2024-09-10T10:11:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.331+0000 7f5f34c00640 1 --2- 172.21.15.50:0/1472666865 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5f140a2b80 0x7f5f140a5040 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.331+0000 7f5f34c00640 1 --2- 172.21.15.50:0/1472666865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f30109120 0x7f5f3019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.331+0000 7f5f34c00640 1 --2- 172.21.15.50:0/1472666865 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f301049a0 0x7f5f3019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.331+0000 7f5f34c00640 1 --2- 172.21.15.50:0/1472666865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f30103ff0 0x7f5f3019a590 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.331+0000 7f5f34c00640 1 -- 172.21.15.50:0/1472666865 >> 172.21.15.50:0/1472666865 conn(0x7f5f300ffa90 msgr2=0x7f5f30101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.331+0000 7f5f34c00640 1 -- 172.21.15.50:0/1472666865 shutdown_connections 2024-09-10T10:11:35.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:35.331+0000 7f5f34c00640 1 -- 172.21.15.50:0/1472666865 wait complete. 2024-09-10T10:11:36.046 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:11:36.425 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:36.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:36 smithi050 ceph-mon[30354]: pgmap v403: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T10:11:36.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:36 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1472666865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:36.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:36 smithi189 ceph-mon[34999]: pgmap v403: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T10:11:36.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:36 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1472666865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:36.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:36 smithi084 ceph-mon[34812]: pgmap v403: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T10:11:36.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:36 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1472666865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:36.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.969+0000 7f7775200640 1 -- 172.21.15.50:0/1857302497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7770103e30 msgr2=0x7f7770104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:36.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.969+0000 7f7775200640 1 --2- 172.21.15.50:0/1857302497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7770103e30 0x7f7770104210 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7760009900 tx=0x7f776002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:11:36.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.969+0000 7f7775200640 1 -- 172.21.15.50:0/1857302497 shutdown_connections 2024-09-10T10:11:36.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.969+0000 7f7775200640 1 --2- 172.21.15.50:0/1857302497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7770108f60 0x7f7770110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:36.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.969+0000 7f7775200640 1 --2- 172.21.15.50:0/1857302497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77701047e0 0x7f7770108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:36.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.969+0000 7f7775200640 1 --2- 172.21.15.50:0/1857302497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7770103e30 0x7f7770104210 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:36.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.969+0000 7f7775200640 1 -- 172.21.15.50:0/1857302497 >> 172.21.15.50:0/1857302497 conn(0x7f77700ff8d0 msgr2=0x7f7770101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:36.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.969+0000 7f7775200640 1 -- 172.21.15.50:0/1857302497 shutdown_connections 2024-09-10T10:11:36.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.969+0000 7f7775200640 1 -- 172.21.15.50:0/1857302497 wait complete. 2024-09-10T10:11:36.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.970+0000 7f7775200640 1 Processor -- start 2024-09-10T10:11:36.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.970+0000 7f7775200640 1 -- start start 2024-09-10T10:11:36.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.971+0000 7f7775200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770103e30 0x7f777019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:36.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.971+0000 7f7775200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77701047e0 0x7f777019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:36.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.971+0000 7f7775200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7770108f60 0x7f777019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:36.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.971+0000 7f7775200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7770114010 con 0x7f77701047e0 2024-09-10T10:11:36.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.971+0000 7f7775200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7770113e90 con 0x7f7770108f60 2024-09-10T10:11:36.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.971+0000 7f7775200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7770114190 con 0x7f7770103e30 2024-09-10T10:11:36.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.971+0000 7f776ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77701047e0 0x7f777019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:36.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.971+0000 7f776f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770103e30 0x7f777019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:36.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.971+0000 7f776f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770103e30 0x7f777019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:34036/0 (socket says 172.21.15.50:34036) 2024-09-10T10:11:36.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.971+0000 7f776f400640 1 -- 172.21.15.50:0/269923236 learned_addr learned my addr 172.21.15.50:0/269923236 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:36.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.972+0000 7f776fe00640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7770108f60 0x7f777019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:36.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.972+0000 7f776f400640 1 -- 172.21.15.50:0/269923236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7770108f60 msgr2=0x7f777019ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.972+0000 7f776f400640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7770108f60 0x7f777019ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.972+0000 7f776f400640 1 -- 172.21.15.50:0/269923236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77701047e0 msgr2=0x7f777019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.972+0000 7f776f400640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77701047e0 0x7f777019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.972+0000 7f776f400640 1 -- 172.21.15.50:0/269923236 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777019f450 con 0x7f7770103e30 2024-09-10T10:11:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.972+0000 7f776ea00640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77701047e0 0x7f777019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.972+0000 7f776f400640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770103e30 0x7f777019a4a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7760004770 tx=0x7f7760003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.973+0000 7f7767e00640 1 -- 172.21.15.50:0/269923236 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776003f070 con 0x7f7770103e30 2024-09-10T10:11:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.973+0000 7f7767e00640 1 -- 172.21.15.50:0/269923236 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7760031ca0 con 0x7f7770103e30 2024-09-10T10:11:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.973+0000 7f7775200640 1 -- 172.21.15.50:0/269923236 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777019f6e0 con 0x7f7770103e30 2024-09-10T10:11:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.973+0000 7f7767e00640 1 -- 172.21.15.50:0/269923236 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7760035030 con 0x7f7770103e30 2024-09-10T10:11:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.973+0000 7f7775200640 1 -- 172.21.15.50:0/269923236 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77701a7020 con 0x7f7770103e30 2024-09-10T10:11:36.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.975+0000 7f7775200640 1 -- 172.21.15.50:0/269923236 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7770105310 con 0x7f7770103e30 2024-09-10T10:11:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.977+0000 7f7767e00640 1 -- 172.21.15.50:0/269923236 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f776004c060 con 0x7f7770103e30 2024-09-10T10:11:36.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.978+0000 7f7767e00640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f77540a2b80 0x7f77540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:36.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.978+0000 7f7767e00640 1 -- 172.21.15.50:0/269923236 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f776004a070 con 0x7f7770103e30 2024-09-10T10:11:36.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.978+0000 7f776ea00640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f77540a2b80 0x7f77540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:36.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.979+0000 7f776ea00640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f77540a2b80 0x7f77540a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f77700ffd60 tx=0x7f775c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:36.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:36.980+0000 7f7767e00640 1 -- 172.21.15.50:0/269923236 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77600bc8e0 con 0x7f7770103e30 2024-09-10T10:11:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.201+0000 7f7775200640 1 -- 172.21.15.50:0/269923236 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f777010c140 con 0x7f7770103e30 2024-09-10T10:11:37.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.202+0000 7f7767e00640 1 -- 172.21.15.50:0/269923236 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f77600dae20 con 0x7f7770103e30 2024-09-10T10:11:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:37.204 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:11:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:11:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.205+0000 7f7775200640 1 -- 172.21.15.50:0/269923236 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f77540a2b80 msgr2=0x7f77540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.205+0000 7f7775200640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f77540a2b80 0x7f77540a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f77700ffd60 tx=0x7f775c005f90 comp rx=0 tx=0).stop 2024-09-10T10:11:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.205+0000 7f7775200640 1 -- 172.21.15.50:0/269923236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770103e30 msgr2=0x7f777019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.205+0000 7f7775200640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770103e30 0x7f777019a4a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7760004770 tx=0x7f7760003c10 comp rx=0 tx=0).stop 2024-09-10T10:11:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.205+0000 7f7775200640 1 -- 172.21.15.50:0/269923236 shutdown_connections 2024-09-10T10:11:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.205+0000 7f7775200640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f77540a2b80 0x7f77540a5040 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.205+0000 7f7775200640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7770108f60 0x7f777019ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.205+0000 7f7775200640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77701047e0 0x7f777019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.205+0000 7f7775200640 1 --2- 172.21.15.50:0/269923236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7770103e30 0x7f777019a4a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.205+0000 7f7775200640 1 -- 172.21.15.50:0/269923236 >> 172.21.15.50:0/269923236 conn(0x7f77700ff8d0 msgr2=0x7f7770100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.205+0000 7f7775200640 1 -- 172.21.15.50:0/269923236 shutdown_connections 2024-09-10T10:11:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:37.205+0000 7f7775200640 1 -- 172.21.15.50:0/269923236 wait complete. 2024-09-10T10:11:38.034 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:11:38.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:38 smithi050 ceph-mon[30354]: pgmap v404: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-10T10:11:38.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:38 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/269923236' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:38.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:38 smithi084 ceph-mon[34812]: pgmap v404: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-10T10:11:38.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:38 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/269923236' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:38.426 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:38.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:38 smithi189 ceph-mon[34999]: pgmap v404: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-10T10:11:38.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:38 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/269923236' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.997+0000 7f918b200640 1 -- 172.21.15.50:0/3686480486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f918c1079c0 msgr2=0x7f918c107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.997+0000 7f918b200640 1 --2- 172.21.15.50:0/3686480486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f918c1079c0 0x7f918c107da0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f917c009930 tx=0x7f917c02a420 comp rx=0 tx=0).stop 2024-09-10T10:11:39.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.997+0000 7f918b200640 1 -- 172.21.15.50:0/3686480486 shutdown_connections 2024-09-10T10:11:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.997+0000 7f918b200640 1 --2- 172.21.15.50:0/3686480486 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f918c102360 0x7f918c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.997+0000 7f918b200640 1 --2- 172.21.15.50:0/3686480486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918c1019c0 0x7f918c101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.997+0000 7f918b200640 1 --2- 172.21.15.50:0/3686480486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f918c1079c0 0x7f918c107da0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.997+0000 7f918b200640 1 -- 172.21.15.50:0/3686480486 >> 172.21.15.50:0/3686480486 conn(0x7f918c0fd740 msgr2=0x7f918c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.997+0000 7f918b200640 1 -- 172.21.15.50:0/3686480486 shutdown_connections 2024-09-10T10:11:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.998+0000 7f918b200640 1 -- 172.21.15.50:0/3686480486 wait complete. 2024-09-10T10:11:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.999+0000 7f918b200640 1 Processor -- start 2024-09-10T10:11:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.999+0000 7f918b200640 1 -- start start 2024-09-10T10:11:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.999+0000 7f918b200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f918c1019c0 0x7f918c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.999+0000 7f918b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918c102360 0x7f918c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:39.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.999+0000 7f918b200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f918c1079c0 0x7f918c19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.999+0000 7f918b200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f918c111e10 con 0x7f918c1079c0 2024-09-10T10:11:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.999+0000 7f918b200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f918c111c90 con 0x7f918c102360 2024-09-10T10:11:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.999+0000 7f918b200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f918c111f90 con 0x7f918c1019c0 2024-09-10T10:11:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:38.999+0000 7f918a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f918c1079c0 0x7f918c19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.000+0000 7f9189400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918c102360 0x7f918c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.000+0000 7f918a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f918c1079c0 0x7f918c19ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51762/0 (socket says 172.21.15.50:51762) 2024-09-10T10:11:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.000+0000 7f918a800640 1 -- 172.21.15.50:0/2411445281 learned_addr learned my addr 172.21.15.50:0/2411445281 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.000+0000 7f9189e00640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f918c1019c0 0x7f918c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.000+0000 7f918a800640 1 -- 172.21.15.50:0/2411445281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f918c1019c0 msgr2=0x7f918c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.000+0000 7f918a800640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f918c1019c0 0x7f918c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.000+0000 7f918a800640 1 -- 172.21.15.50:0/2411445281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918c102360 msgr2=0x7f918c19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:39.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.000+0000 7f918a800640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918c102360 0x7f918c19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.000+0000 7f918a800640 1 -- 172.21.15.50:0/2411445281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918c19f430 con 0x7f918c1079c0 2024-09-10T10:11:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.000+0000 7f9189400640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918c102360 0x7f918c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.000+0000 7f918a800640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f918c1079c0 0x7f918c19ed50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f918400eb10 tx=0x7f918400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.000+0000 7f9182a00640 1 -- 172.21.15.50:0/2411445281 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184004b20 con 0x7f918c1079c0 2024-09-10T10:11:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.001+0000 7f9182a00640 1 -- 172.21.15.50:0/2411445281 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9184004cc0 con 0x7f918c1079c0 2024-09-10T10:11:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.001+0000 7f918b200640 1 -- 172.21.15.50:0/2411445281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f918c19f720 con 0x7f918c1079c0 2024-09-10T10:11:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.001+0000 7f9182a00640 1 -- 172.21.15.50:0/2411445281 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184010760 con 0x7f918c1079c0 2024-09-10T10:11:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.001+0000 7f918b200640 1 -- 172.21.15.50:0/2411445281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f918c1a7000 con 0x7f918c1079c0 2024-09-10T10:11:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.002+0000 7f918b200640 1 -- 172.21.15.50:0/2411445281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f918c101e20 con 0x7f918c1079c0 2024-09-10T10:11:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.004+0000 7f9182a00640 1 -- 172.21.15.50:0/2411445281 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9184005020 con 0x7f918c1079c0 2024-09-10T10:11:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.005+0000 7f9182a00640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f91700a2c00 0x7f91700a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.005+0000 7f9182a00640 1 -- 172.21.15.50:0/2411445281 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f91840cf9e0 con 0x7f918c1079c0 2024-09-10T10:11:39.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.005+0000 7f9189e00640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f91700a2c00 0x7f91700a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.006+0000 7f9189e00640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f91700a2c00 0x7f91700a50c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f917c006010 tx=0x7f917c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:39.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.009+0000 7f9182a00640 1 -- 172.21.15.50:0/2411445281 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f918409c550 con 0x7f918c1079c0 2024-09-10T10:11:39.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.198+0000 7f918b200640 1 -- 172.21.15.50:0/2411445281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f918c1a7340 con 0x7f918c1079c0 2024-09-10T10:11:39.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.199+0000 7f9182a00640 1 -- 172.21.15.50:0/2411445281 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24775 (secure 0 0 0) 0x7f918409be50 con 0x7f918c1079c0 2024-09-10T10:11:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:39.201 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:10:00.717554+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:11:39.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.202+0000 7f918b200640 1 -- 172.21.15.50:0/2411445281 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f91700a2c00 msgr2=0x7f91700a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:39.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.202+0000 7f918b200640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f91700a2c00 0x7f91700a50c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f917c006010 tx=0x7f917c000bc0 comp rx=0 tx=0).stop 2024-09-10T10:11:39.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.202+0000 7f918b200640 1 -- 172.21.15.50:0/2411445281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f918c1079c0 msgr2=0x7f918c19ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:39.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.202+0000 7f918b200640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f918c1079c0 0x7f918c19ed50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f918400eb10 tx=0x7f918400c2d0 comp rx=0 tx=0).stop 2024-09-10T10:11:39.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.202+0000 7f918b200640 1 -- 172.21.15.50:0/2411445281 shutdown_connections 2024-09-10T10:11:39.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.202+0000 7f918b200640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f91700a2c00 0x7f91700a50c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:39.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.202+0000 7f918b200640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f918c1079c0 0x7f918c19ed50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:39.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.202+0000 7f918b200640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f918c102360 0x7f918c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:39.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.202+0000 7f918b200640 1 --2- 172.21.15.50:0/2411445281 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f918c1019c0 0x7f918c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:39.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.202+0000 7f918b200640 1 -- 172.21.15.50:0/2411445281 >> 172.21.15.50:0/2411445281 conn(0x7f918c0fd740 msgr2=0x7f918c10cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:39.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.202+0000 7f918b200640 1 -- 172.21.15.50:0/2411445281 shutdown_connections 2024-09-10T10:11:39.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:39.202+0000 7f918b200640 1 -- 172.21.15.50:0/2411445281 wait complete. 2024-09-10T10:11:39.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:39 smithi050 ceph-mon[30354]: scrub summary: idle 2024-09-10T10:11:39.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:39 smithi189 ceph-mon[34999]: scrub summary: idle 2024-09-10T10:11:39.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:39 smithi084 ceph-mon[34812]: scrub summary: idle 2024-09-10T10:11:40.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-10T10:11:40.419 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:40.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:40 smithi050 ceph-mon[30354]: pgmap v405: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-10T10:11:40.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:40 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2411445281' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:11:40.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:40 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:40.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:40 smithi189 ceph-mon[34999]: pgmap v405: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-10T10:11:40.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:40 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2411445281' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:11:40.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:40 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:40.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:40 smithi084 ceph-mon[34812]: pgmap v405: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-10T10:11:40.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:40 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2411445281' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:11:40.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:40 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:11:41.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:41.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:11:41.587 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:41 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:41 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:41 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:41 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:41 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:41 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:41 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:41.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:41 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:11:41.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:41 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:11:41.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:11:41.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:11:41.881 INFO:teuthology.orchestra.run.smithi050.stdout:{"run_dir":"/var/run/ceph"} 2024-09-10T10:11:41.882 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-10T10:11:41.882 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 9893 2024-09-10T10:11:41.882 DEBUG:tasks.quiescer:Yielding 2024-09-10T10:11:41.882 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T10:11:41.897 INFO:tasks.workunit:Pulling workunits from ref 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:11:41.898 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T10:11:41.898 INFO:tasks.workunit:timeout=3h 2024-09-10T10:11:41.898 INFO:tasks.workunit:cleanup=True 2024-09-10T10:11:41.898 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T10:11:41.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:11:41.936 INFO:teuthology.orchestra.run.smithi050.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T10:11:41.936 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-10T10:11:41.936 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-10T10:11:41.936 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:11:41.936 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-10T10:11:41.936 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-10 10:09:36.811437469 +0000 2024-09-10T10:11:41.936 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-10 10:09:36.811437469 +0000 2024-09-10T10:11:41.936 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-10 10:11:14.810014367 +0000 2024-09-10T10:11:41.936 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-09-10 10:09:36.811437469 +0000 2024-09-10T10:11:41.937 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T10:11:41.937 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T10:11:42.044 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:11:42.083 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T10:11:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:42.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:42 smithi050 ceph-mon[30354]: pgmap v406: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T10:11:42.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:42 smithi189 ceph-mon[34999]: pgmap v406: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T10:11:42.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:42 smithi084 ceph-mon[34812]: pgmap v406: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T10:11:42.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.919+0000 7f0cd8600640 1 -- 172.21.15.50:0/736636638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd01049a0 msgr2=0x7f0cd01089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.919+0000 7f0cd8600640 1 --2- 172.21.15.50:0/736636638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd01049a0 0x7f0cd01089f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009900 tx=0x7f0cbc02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:11:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.919+0000 7f0cd8600640 1 -- 172.21.15.50:0/736636638 shutdown_connections 2024-09-10T10:11:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.919+0000 7f0cd8600640 1 --2- 172.21.15.50:0/736636638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cd0109120 0x7f0cd0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.919+0000 7f0cd8600640 1 --2- 172.21.15.50:0/736636638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd01049a0 0x7f0cd01089f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.919+0000 7f0cd8600640 1 --2- 172.21.15.50:0/736636638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cd0103ff0 0x7f0cd01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.919+0000 7f0cd8600640 1 -- 172.21.15.50:0/736636638 >> 172.21.15.50:0/736636638 conn(0x7f0cd00ffa90 msgr2=0x7f0cd0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.919+0000 7f0cd8600640 1 -- 172.21.15.50:0/736636638 shutdown_connections 2024-09-10T10:11:42.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.919+0000 7f0cd8600640 1 -- 172.21.15.50:0/736636638 wait complete. 2024-09-10T10:11:42.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.920+0000 7f0cd8600640 1 Processor -- start 2024-09-10T10:11:42.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.920+0000 7f0cd8600640 1 -- start start 2024-09-10T10:11:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.920+0000 7f0cd8600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd0103ff0 0x7f0cd019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.920+0000 7f0cd8600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cd01049a0 0x7f0cd019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.920+0000 7f0cd8600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cd0109120 0x7f0cd019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.920+0000 7f0cd8600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd0114140 con 0x7f0cd0103ff0 2024-09-10T10:11:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.920+0000 7f0cd8600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd0113fc0 con 0x7f0cd0109120 2024-09-10T10:11:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.920+0000 7f0cd8600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01142c0 con 0x7f0cd01049a0 2024-09-10T10:11:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.921+0000 7f0cd5c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd0103ff0 0x7f0cd019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.921+0000 7f0cd5200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cd01049a0 0x7f0cd019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.921+0000 7f0cd5c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd0103ff0 0x7f0cd019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51788/0 (socket says 172.21.15.50:51788) 2024-09-10T10:11:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.921+0000 7f0cd5c00640 1 -- 172.21.15.50:0/4048001349 learned_addr learned my addr 172.21.15.50:0/4048001349 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.921+0000 7f0cd6600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cd0109120 0x7f0cd019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.921+0000 7f0cd5c00640 1 -- 172.21.15.50:0/4048001349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cd01049a0 msgr2=0x7f0cd019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:42.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.921+0000 7f0cd5c00640 1 --2- 172.21.15.50:0/4048001349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cd01049a0 0x7f0cd019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.921+0000 7f0cd5c00640 1 -- 172.21.15.50:0/4048001349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cd0109120 msgr2=0x7f0cd019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.921+0000 7f0cd5c00640 1 --2- 172.21.15.50:0/4048001349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cd0109120 0x7f0cd019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.921+0000 7f0cd5c00640 1 -- 172.21.15.50:0/4048001349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd019f650 con 0x7f0cd0103ff0 2024-09-10T10:11:42.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.922+0000 7f0cd5c00640 1 --2- 172.21.15.50:0/4048001349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd0103ff0 0x7f0cd019a6a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400d950 tx=0x7f0cc400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.922+0000 7f0cce000640 1 -- 172.21.15.50:0/4048001349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4017030 con 0x7f0cd0103ff0 2024-09-10T10:11:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.922+0000 7f0cce000640 1 -- 172.21.15.50:0/4048001349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cc4004020 con 0x7f0cd0103ff0 2024-09-10T10:11:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.922+0000 7f0cd8600640 1 -- 172.21.15.50:0/4048001349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd019f940 con 0x7f0cd0103ff0 2024-09-10T10:11:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.922+0000 7f0cce000640 1 -- 172.21.15.50:0/4048001349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc40047a0 con 0x7f0cd0103ff0 2024-09-10T10:11:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.922+0000 7f0cd8600640 1 -- 172.21.15.50:0/4048001349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd01a7220 con 0x7f0cd0103ff0 2024-09-10T10:11:42.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.923+0000 7f0cd8600640 1 -- 172.21.15.50:0/4048001349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd01043d0 con 0x7f0cd0103ff0 2024-09-10T10:11:42.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.925+0000 7f0cce000640 1 -- 172.21.15.50:0/4048001349 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0cc40041d0 con 0x7f0cd0103ff0 2024-09-10T10:11:42.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.926+0000 7f0cce000640 1 --2- 172.21.15.50:0/4048001349 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0cb80a2b80 0x7f0cb80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:42.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.927+0000 7f0cce000640 1 -- 172.21.15.50:0/4048001349 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f0cc40ced80 con 0x7f0cd0103ff0 2024-09-10T10:11:42.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.927+0000 7f0cd5200640 1 --2- 172.21.15.50:0/4048001349 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0cb80a2b80 0x7f0cb80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:42.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.927+0000 7f0cd5200640 1 --2- 172.21.15.50:0/4048001349 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0cb80a2b80 0x7f0cb80a5040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009230 tx=0x7f0cbc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:42.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:42.931+0000 7f0cce000640 1 -- 172.21.15.50:0/4048001349 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0cc409b8f0 con 0x7f0cd0103ff0 2024-09-10T10:11:43.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.156+0000 7f0cd8600640 1 -- 172.21.15.50:0/4048001349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cd019ba00 con 0x7f0cd0103ff0 2024-09-10T10:11:43.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.157+0000 7f0cce000640 1 -- 172.21.15.50:0/4048001349 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f0cc409b1f0 con 0x7f0cd0103ff0 2024-09-10T10:11:43.159 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:11:43.159 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:11:43.159 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:11:43.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.160+0000 7f0cd8600640 1 -- 172.21.15.50:0/4048001349 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0cb80a2b80 msgr2=0x7f0cb80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:43.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.160+0000 7f0cd8600640 1 --2- 172.21.15.50:0/4048001349 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0cb80a2b80 0x7f0cb80a5040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009230 tx=0x7f0cbc0058d0 comp rx=0 tx=0).stop 2024-09-10T10:11:43.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.160+0000 7f0cd8600640 1 -- 172.21.15.50:0/4048001349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd0103ff0 msgr2=0x7f0cd019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:43.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.160+0000 7f0cd8600640 1 --2- 172.21.15.50:0/4048001349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd0103ff0 0x7f0cd019a6a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400d950 tx=0x7f0cc400de10 comp rx=0 tx=0).stop 2024-09-10T10:11:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.160+0000 7f0cd8600640 1 -- 172.21.15.50:0/4048001349 shutdown_connections 2024-09-10T10:11:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.160+0000 7f0cd8600640 1 --2- 172.21.15.50:0/4048001349 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0cb80a2b80 0x7f0cb80a5040 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.160+0000 7f0cd8600640 1 --2- 172.21.15.50:0/4048001349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cd0109120 0x7f0cd019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.160+0000 7f0cd8600640 1 --2- 172.21.15.50:0/4048001349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0cd01049a0 0x7f0cd019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.160+0000 7f0cd8600640 1 --2- 172.21.15.50:0/4048001349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cd0103ff0 0x7f0cd019a6a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:43.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.160+0000 7f0cd8600640 1 -- 172.21.15.50:0/4048001349 >> 172.21.15.50:0/4048001349 conn(0x7f0cd00ffa90 msgr2=0x7f0cd0100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:43.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.161+0000 7f0cd8600640 1 -- 172.21.15.50:0/4048001349 shutdown_connections 2024-09-10T10:11:43.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:43.161+0000 7f0cd8600640 1 -- 172.21.15.50:0/4048001349 wait complete. 2024-09-10T10:11:43.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:43 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4048001349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:43.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:43 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4048001349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:43.936 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:43 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4048001349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:11:43.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T10:08:36.316040+0000', 'modified': '2024-09-10T10:11:15.689239+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24560, 'mds_1': 24521, 'mds_2': 24517}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24493': {'gid': 24493, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/1101442212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 1101442212}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 1101442212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.84:6835/1698924277', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 1698924277}, {'type': 'v1', 'addr': '172.21.15.84:6835', 'nonce': 1698924277}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/251140305', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 251140305}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 251140305}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.189:6839/2768859315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 2768859315}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 2768859315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24521': {'gid': 24521, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.84:6837/1457195028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 1457195028}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 1457195028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.84:6839/4235486934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6838', 'nonce': 4235486934}, {'type': 'v1', 'addr': '172.21.15.84:6839', 'nonce': 4235486934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24560, 'qdb_cluster': [24560, 24521, 24517]} 2024-09-10T10:11:43.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T10:11:43.979 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T10:11:44.398 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:44.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:44 smithi189 ceph-mon[34999]: pgmap v407: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T10:11:44.847 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:44 smithi050 ceph-mon[30354]: pgmap v407: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T10:11:44.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:44 smithi084 ceph-mon[34812]: pgmap v407: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T10:11:44.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.963+0000 7ff33fc00640 1 -- 172.21.15.50:0/1380669200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff338109120 msgr2=0x7ff338110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:44.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.963+0000 7ff33fc00640 1 --2- 172.21.15.50:0/1380669200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff338109120 0x7ff338110ca0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff330009ca0 tx=0x7ff33002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.963+0000 7ff33fc00640 1 -- 172.21.15.50:0/1380669200 shutdown_connections 2024-09-10T10:11:44.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.963+0000 7ff33fc00640 1 --2- 172.21.15.50:0/1380669200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff338109120 0x7ff338110ca0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.963+0000 7ff33fc00640 1 --2- 172.21.15.50:0/1380669200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3381049a0 0x7ff3381089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.963+0000 7ff33fc00640 1 --2- 172.21.15.50:0/1380669200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff338103ff0 0x7ff3381043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.963+0000 7ff33fc00640 1 -- 172.21.15.50:0/1380669200 >> 172.21.15.50:0/1380669200 conn(0x7ff3380ffa90 msgr2=0x7ff338101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:44.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.963+0000 7ff33fc00640 1 -- 172.21.15.50:0/1380669200 shutdown_connections 2024-09-10T10:11:44.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.963+0000 7ff33fc00640 1 -- 172.21.15.50:0/1380669200 wait complete. 2024-09-10T10:11:44.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.964+0000 7ff33fc00640 1 Processor -- start 2024-09-10T10:11:44.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.964+0000 7ff33fc00640 1 -- start start 2024-09-10T10:11:44.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.964+0000 7ff33fc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff338103ff0 0x7ff33819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.964+0000 7ff33fc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3381049a0 0x7ff33819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.964+0000 7ff33fc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff338109120 0x7ff33819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.965+0000 7ff33fc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff3381141a0 con 0x7ff3381049a0 2024-09-10T10:11:44.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.965+0000 7ff33fc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff338114020 con 0x7ff338109120 2024-09-10T10:11:44.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.965+0000 7ff33fc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff338114320 con 0x7ff338103ff0 2024-09-10T10:11:44.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.965+0000 7ff337e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3381049a0 0x7ff33819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:44.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.965+0000 7ff33dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff338109120 0x7ff33819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:44.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.965+0000 7ff33dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff338109120 0x7ff33819eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:55264/0 (socket says 172.21.15.50:55264) 2024-09-10T10:11:44.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.965+0000 7ff33dc00640 1 -- 172.21.15.50:0/428526341 learned_addr learned my addr 172.21.15.50:0/428526341 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:44.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.965+0000 7ff33d200640 1 --2- 172.21.15.50:0/428526341 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff338103ff0 0x7ff33819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:44.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.965+0000 7ff33d200640 1 -- 172.21.15.50:0/428526341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff338109120 msgr2=0x7ff33819eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:44.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.965+0000 7ff33d200640 1 --2- 172.21.15.50:0/428526341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff338109120 0x7ff33819eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.965+0000 7ff33d200640 1 -- 172.21.15.50:0/428526341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3381049a0 msgr2=0x7ff33819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:44.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.965+0000 7ff33d200640 1 --2- 172.21.15.50:0/428526341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3381049a0 0x7ff33819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.965+0000 7ff33d200640 1 -- 172.21.15.50:0/428526341 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33819f590 con 0x7ff338103ff0 2024-09-10T10:11:44.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.966+0000 7ff33d200640 1 --2- 172.21.15.50:0/428526341 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff338103ff0 0x7ff33819a5e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00e9f0 tx=0x7ff32c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:44.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.966+0000 7ff335600640 1 -- 172.21.15.50:0/428526341 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00ccc0 con 0x7ff338103ff0 2024-09-10T10:11:44.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.966+0000 7ff33fc00640 1 -- 172.21.15.50:0/428526341 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33819f880 con 0x7ff338103ff0 2024-09-10T10:11:44.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.966+0000 7ff335600640 1 -- 172.21.15.50:0/428526341 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff32c010910 con 0x7ff338103ff0 2024-09-10T10:11:44.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.966+0000 7ff335600640 1 -- 172.21.15.50:0/428526341 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c018960 con 0x7ff338103ff0 2024-09-10T10:11:44.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.966+0000 7ff33fc00640 1 -- 172.21.15.50:0/428526341 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3381a7160 con 0x7ff338103ff0 2024-09-10T10:11:44.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.969+0000 7ff34286f740 1 Processor -- start 2024-09-10T10:11:44.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.969+0000 7ff34286f740 1 -- start start 2024-09-10T10:11:44.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.969+0000 7ff335600640 1 -- 172.21.15.50:0/428526341 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff32c010ac0 con 0x7ff338103ff0 2024-09-10T10:11:44.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.970+0000 7ff34286f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7c330 0x56132ea7c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.970+0000 7ff34286f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7cc50 0x56132ea86fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.970+0000 7ff34286f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea87510 0x56132ea89900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.970+0000 7ff34286f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56132e9e20b0 con 0x56132ea87510 2024-09-10T10:11:44.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.970+0000 7ff34286f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56132e989ab0 con 0x56132ea7c330 2024-09-10T10:11:44.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.970+0000 7ff34286f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56132e9de070 con 0x56132ea7cc50 2024-09-10T10:11:44.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.970+0000 7ff33dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7c330 0x56132ea7c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:44.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.970+0000 7ff33dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7c330 0x56132ea7c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:55272/0 (socket says 172.21.15.50:55272) 2024-09-10T10:11:44.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.970+0000 7ff33dc00640 1 -- 172.21.15.50:0/2836980974 learned_addr learned my addr 172.21.15.50:0/2836980974 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:44.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.970+0000 7ff337e00640 1 --2- 172.21.15.50:0/2836980974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea87510 0x56132ea89900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:44.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.970+0000 7ff33d200640 1 --2- 172.21.15.50:0/2836980974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7cc50 0x56132ea86fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.971+0000 7ff33dc00640 1 -- 172.21.15.50:0/2836980974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7cc50 msgr2=0x56132ea86fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.971+0000 7ff33dc00640 1 --2- 172.21.15.50:0/2836980974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7cc50 0x56132ea86fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.971+0000 7ff33dc00640 1 -- 172.21.15.50:0/2836980974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea87510 msgr2=0x56132ea89900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.971+0000 7ff33dc00640 1 --2- 172.21.15.50:0/2836980974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea87510 0x56132ea89900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.971+0000 7ff33dc00640 1 -- 172.21.15.50:0/2836980974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56132e9964a0 con 0x56132ea7c330 2024-09-10T10:11:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.971+0000 7ff33dc00640 1 --2- 172.21.15.50:0/2836980974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7c330 0x56132ea7c710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff330005fb0 tx=0x7ff330009a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b2c0ec5464c67a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.971+0000 7ff335600640 1 --2- 172.21.15.50:0/428526341 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ff3200a2b80 0x7ff3200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.971+0000 7ff32a000640 1 -- 172.21.15.50:0/2836980974 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330031db0 con 0x56132ea7c330 2024-09-10T10:11:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.972+0000 7ff32a000640 1 -- 172.21.15.50:0/2836980974 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff330036030 con 0x56132ea7c330 2024-09-10T10:11:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.972+0000 7ff32a000640 1 -- 172.21.15.50:0/2836980974 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3300042a0 con 0x56132ea7c330 2024-09-10T10:11:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.972+0000 7ff335600640 1 -- 172.21.15.50:0/428526341 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7ff32c0cf7c0 con 0x7ff338103ff0 2024-09-10T10:11:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.972+0000 7ff33d200640 1 --2- 172.21.15.50:0/428526341 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ff3200a2b80 0x7ff3200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.972+0000 7ff34286f740 1 -- 172.21.15.50:0/2836980974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7c330 msgr2=0x56132ea7c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.972+0000 7ff34286f740 1 --2- 172.21.15.50:0/2836980974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7c330 0x56132ea7c710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff330005fb0 tx=0x7ff330009a10 comp rx=0 tx=0).stop 2024-09-10T10:11:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.972+0000 7ff33d200640 1 --2- 172.21.15.50:0/428526341 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ff3200a2b80 0x7ff3200a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0986b0 tx=0x7ff32c0ddd40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.973+0000 7ff34286f740 1 -- 172.21.15.50:0/2836980974 shutdown_connections 2024-09-10T10:11:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.973+0000 7ff34286f740 1 --2- 172.21.15.50:0/2836980974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea87510 0x56132ea89900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.973+0000 7ff34286f740 1 --2- 172.21.15.50:0/2836980974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7cc50 0x56132ea86fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.973+0000 7ff34286f740 1 --2- 172.21.15.50:0/2836980974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7c330 0x56132ea7c710 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.973+0000 7ff34286f740 1 -- 172.21.15.50:0/2836980974 >> 172.21.15.50:0/2836980974 conn(0x56132ea788c0 msgr2=0x56132ea78ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.973+0000 7ff34286f740 1 -- 172.21.15.50:0/2836980974 shutdown_connections 2024-09-10T10:11:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.973+0000 7ff34286f740 1 -- 172.21.15.50:0/2836980974 wait complete. 2024-09-10T10:11:44.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.973+0000 7ff34286f740 1 -- start start 2024-09-10T10:11:44.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.973+0000 7ff34286f740 1 Processor -- start 2024-09-10T10:11:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.974+0000 7ff34286f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7c330 0x56132ea844e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.974+0000 7ff34286f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 0x56132ea84a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.974+0000 7ff34286f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea87510 0x56132ea84f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.974+0000 7ff34286f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56132ea89f60 con 0x56132ea7cc50 2024-09-10T10:11:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.974+0000 7ff34286f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56132e96a920 con 0x56132ea7c330 2024-09-10T10:11:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.974+0000 7ff34286f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56132ea8a0e0 con 0x56132ea87510 2024-09-10T10:11:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.974+0000 7ff34286f740 10 client.0 _ll_register_callbacks cb 0x56132e98e8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.974+0000 7ff337e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 0x56132ea84a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.974+0000 7ff337e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 0x56132ea84a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51828/0 (socket says 172.21.15.50:51828) 2024-09-10T10:11:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.974+0000 7ff337e00640 1 -- 172.21.15.50:0/2930018021 learned_addr learned my addr 172.21.15.50:0/2930018021 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.974+0000 7ff33dc00640 1 --2- 172.21.15.50:0/2930018021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea87510 0x56132ea84f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.974+0000 7ff33dc00640 1 --2- 172.21.15.50:0/2930018021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7c330 0x56132ea844e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:44.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.975+0000 7ff337e00640 1 -- 172.21.15.50:0/2930018021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea87510 msgr2=0x56132ea84f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.975+0000 7ff337e00640 1 --2- 172.21.15.50:0/2930018021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea87510 0x56132ea84f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.975+0000 7ff337e00640 1 -- 172.21.15.50:0/2930018021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7c330 msgr2=0x56132ea844e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.975+0000 7ff337e00640 1 --2- 172.21.15.50:0/2930018021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7c330 0x56132ea844e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.975+0000 7ff337e00640 1 -- 172.21.15.50:0/2930018021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56132e7532b0 con 0x56132ea7cc50 2024-09-10T10:11:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.975+0000 7ff337e00640 1 --2- 172.21.15.50:0/2930018021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 0x56132ea84a20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff324012700 tx=0x7ff324012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1001ded195b9fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.975+0000 7ff31ea00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:11:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.975+0000 7ff31ea00640 1 -- 172.21.15.50:0/2930018021 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32400f8c0 con 0x56132ea7cc50 2024-09-10T10:11:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.975+0000 7ff31ea00640 1 -- 172.21.15.50:0/2930018021 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7ff32400fa60 con 0x56132ea7cc50 2024-09-10T10:11:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.975+0000 7ff34286f740 1 -- 172.21.15.50:0/2930018021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff330036030 con 0x56132ea7cc50 2024-09-10T10:11:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.976+0000 7ff31ea00640 1 -- 172.21.15.50:0/2930018021 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff324025050 con 0x56132ea7cc50 2024-09-10T10:11:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.976+0000 7ff34286f740 10 client.15267 fetch_fsmap learned FSMap version 25 2024-09-10T10:11:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.976+0000 7ff34286f740 1 -- 172.21.15.50:0/2930018021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56132ea95c30 con 0x56132ea7cc50 2024-09-10T10:11:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.976+0000 7ff31ea00640 1 -- 172.21.15.50:0/2930018021 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff330036030 con 0x56132ea7cc50 2024-09-10T10:11:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.976+0000 7ff31ea00640 1 -- 172.21.15.50:0/2930018021 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff324010430 con 0x56132ea7cc50 2024-09-10T10:11:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.976+0000 7ff34286f740 10 client.15267 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:11:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.976+0000 7ff34286f740 10 client.15267 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T10:11:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.976+0000 7ff34286f740 20 client.15267 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.976+0000 7ff34286f740 1 --2- 172.21.15.50:0/2930018021 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56132ea98260 0x56132ea996d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.976+0000 7ff34286f740 4 client.15267 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:11:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.976+0000 7ff34286f740 1 -- 172.21.15.50:0/2930018021 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56132e9ef620 con 0x56132ea98260 2024-09-10T10:11:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.977+0000 7ff33dc00640 1 --2- 172.21.15.50:0/2930018021 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56132ea98260 0x56132ea996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.977+0000 7ff33dc00640 1 --2- 172.21.15.50:0/2930018021 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56132ea98260 0x56132ea996d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d733d261b9a66390 server_cookie=1ba6e942e79d1462 in_seq=0 out_seq=0 2024-09-10T10:11:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.977+0000 7ff31ea00640 10 client.15267 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:11:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.978+0000 7ff31ea00640 1 -- 172.21.15.50:0/2930018021 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56132e9ef620 con 0x56132ea98260 2024-09-10T10:11:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.978+0000 7ff31ea00640 10 client.15267 handle_command_reply: tid=0 2024-09-10T10:11:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.978+0000 7ff34286f740 1 client.15267 shutdown 2024-09-10T10:11:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.978+0000 7ff34286f740 1 -- 172.21.15.50:0/2930018021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 msgr2=0x56132ea84a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.978+0000 7ff34286f740 1 --2- 172.21.15.50:0/2930018021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 0x56132ea84a20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff324012700 tx=0x7ff324012bc0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.978+0000 7ff34286f740 1 -- 172.21.15.50:0/2930018021 shutdown_connections 2024-09-10T10:11:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.979+0000 7ff34286f740 1 --2- 172.21.15.50:0/2930018021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea87510 0x56132ea84f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.979+0000 7ff34286f740 1 --2- 172.21.15.50:0/2930018021 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56132ea98260 0x56132ea996d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.979+0000 7ff34286f740 1 --2- 172.21.15.50:0/2930018021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 0x56132ea84a20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.979+0000 7ff34286f740 1 --2- 172.21.15.50:0/2930018021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7c330 0x56132ea844e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.979+0000 7ff34286f740 1 -- 172.21.15.50:0/2930018021 >> 172.21.15.50:0/2930018021 conn(0x56132ea788c0 msgr2=0x56132ea7e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.979+0000 7ff31ea00640 0 client.15267 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:11:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.979+0000 7ff34286f740 1 -- 172.21.15.50:0/2930018021 shutdown_connections 2024-09-10T10:11:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.979+0000 7ff34286f740 1 -- 172.21.15.50:0/2930018021 wait complete. 2024-09-10T10:11:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.979+0000 7ff34286f740 20 client.15267 trim_cache size 0 max 16384 2024-09-10T10:11:44.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.997+0000 7ff34286f740 1 Processor -- start 2024-09-10T10:11:44.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.997+0000 7ff34286f740 1 -- start start 2024-09-10T10:11:44.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff34286f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7c330 0x56132ea996d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff34286f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 0x56132ea84dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff34286f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea87510 0x56132ea817c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:44.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff34286f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56132ea97a10 con 0x56132ea7cc50 2024-09-10T10:11:44.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff34286f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56132ea980e0 con 0x56132ea87510 2024-09-10T10:11:44.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff34286f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56132ea987b0 con 0x56132ea7c330 2024-09-10T10:11:45.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff337e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 0x56132ea84dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:45.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff337e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 0x56132ea84dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51834/0 (socket says 172.21.15.50:51834) 2024-09-10T10:11:45.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff337e00640 1 -- 172.21.15.50:0/3233512038 learned_addr learned my addr 172.21.15.50:0/3233512038 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:45.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff33dc00640 1 --2- 172.21.15.50:0/3233512038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7c330 0x56132ea996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:45.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff33dc00640 1 --2- 172.21.15.50:0/3233512038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea87510 0x56132ea817c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:45.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff33dc00640 1 -- 172.21.15.50:0/3233512038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea87510 msgr2=0x56132ea817c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:45.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff33dc00640 1 --2- 172.21.15.50:0/3233512038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea87510 0x56132ea817c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff33dc00640 1 -- 172.21.15.50:0/3233512038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 msgr2=0x56132ea84dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:45.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff33dc00640 1 --2- 172.21.15.50:0/3233512038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 0x56132ea84dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff33dc00640 1 -- 172.21.15.50:0/3233512038 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56132ea82a90 con 0x56132ea7c330 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.998+0000 7ff337e00640 1 --2- 172.21.15.50:0/3233512038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 0x56132ea84dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.999+0000 7ff33dc00640 1 --2- 172.21.15.50:0/3233512038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7c330 0x56132ea996d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff330009bf0 tx=0x7ff330047040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d60b36779c23234 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.999+0000 7ff329600640 1 -- 172.21.15.50:0/3233512038 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3300098e0 con 0x56132ea7c330 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.999+0000 7ff329600640 1 -- 172.21.15.50:0/3233512038 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff330060030 con 0x56132ea7c330 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:44.999+0000 7ff329600640 1 -- 172.21.15.50:0/3233512038 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3300305c0 con 0x56132ea7c330 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.000+0000 7ff34286f740 1 -- 172.21.15.50:0/3233512038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7c330 msgr2=0x56132ea996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.000+0000 7ff34286f740 1 --2- 172.21.15.50:0/3233512038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7c330 0x56132ea996d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff330009bf0 tx=0x7ff330047040 comp rx=0 tx=0).stop 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.000+0000 7ff34286f740 1 -- 172.21.15.50:0/3233512038 shutdown_connections 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.000+0000 7ff34286f740 1 --2- 172.21.15.50:0/3233512038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea87510 0x56132ea817c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.000+0000 7ff34286f740 1 --2- 172.21.15.50:0/3233512038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea7cc50 0x56132ea84dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.000+0000 7ff34286f740 1 --2- 172.21.15.50:0/3233512038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7c330 0x56132ea996d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.000+0000 7ff34286f740 1 -- 172.21.15.50:0/3233512038 >> 172.21.15.50:0/3233512038 conn(0x56132ea788c0 msgr2=0x56132ea82e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:45.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.000+0000 7ff34286f740 1 -- 172.21.15.50:0/3233512038 shutdown_connections 2024-09-10T10:11:45.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.000+0000 7ff34286f740 1 -- 172.21.15.50:0/3233512038 wait complete. 2024-09-10T10:11:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.000+0000 7ff34286f740 1 -- start start 2024-09-10T10:11:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.000+0000 7ff34286f740 1 Processor -- start 2024-09-10T10:11:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.001+0000 7ff34286f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7c330 0x56132eaa1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.001+0000 7ff34286f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7cc50 0x56132eaa2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.001+0000 7ff34286f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea87510 0x56132ea80e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.001+0000 7ff34286f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56132ea99550 con 0x56132ea87510 2024-09-10T10:11:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.001+0000 7ff34286f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56132ea98e80 con 0x56132ea7cc50 2024-09-10T10:11:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.001+0000 7ff34286f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56132ea99c20 con 0x56132ea7c330 2024-09-10T10:11:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.001+0000 7ff34286f740 10 client.0 _ll_register_callbacks cb 0x7ff324009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:45.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.001+0000 7ff33dc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7c330 0x56132eaa1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.001+0000 7ff33dc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea87510 0x56132ea80e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.001+0000 7ff33dc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7c330 0x56132eaa1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:34106/0 (socket says 172.21.15.50:34106) 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.001+0000 7ff33dc00640 1 -- 172.21.15.50:0/1059105000 learned_addr learned my addr 172.21.15.50:0/1059105000 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.001+0000 7ff337e00640 1 --2- 172.21.15.50:0/1059105000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7cc50 0x56132eaa2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.002+0000 7ff33dc00640 1 -- 172.21.15.50:0/1059105000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7cc50 msgr2=0x56132eaa2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.002+0000 7ff33dc00640 1 --2- 172.21.15.50:0/1059105000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7cc50 0x56132eaa2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.002+0000 7ff33dc00640 1 -- 172.21.15.50:0/1059105000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea87510 msgr2=0x56132ea80e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.002+0000 7ff33dc00640 1 --2- 172.21.15.50:0/1059105000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea87510 0x56132ea80e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.002+0000 7ff33dc00640 1 -- 172.21.15.50:0/1059105000 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56132ea816d0 con 0x56132ea7c330 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.002+0000 7ff33dc00640 1 --2- 172.21.15.50:0/1059105000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7c330 0x56132eaa1bc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff330009620 tx=0x7ff33002b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebd52f7242ef2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.002+0000 7ff31ea00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.002+0000 7ff31ea00640 1 -- 172.21.15.50:0/1059105000 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330031bb0 con 0x56132ea7c330 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.002+0000 7ff34286f740 1 -- 172.21.15.50:0/1059105000 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff330060030 con 0x56132ea7c330 2024-09-10T10:11:45.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.002+0000 7ff31ea00640 1 -- 172.21.15.50:0/1059105000 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7ff330031d50 con 0x56132ea7c330 2024-09-10T10:11:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.003+0000 7ff31ea00640 1 -- 172.21.15.50:0/1059105000 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff330003970 con 0x56132ea7c330 2024-09-10T10:11:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.003+0000 7ff34286f740 10 client.25291 fetch_fsmap learned FSMap version 25 2024-09-10T10:11:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.003+0000 7ff34286f740 1 -- 172.21.15.50:0/1059105000 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56132eaa1450 con 0x56132ea7c330 2024-09-10T10:11:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.003+0000 7ff31ea00640 1 -- 172.21.15.50:0/1059105000 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff330060030 con 0x56132ea7c330 2024-09-10T10:11:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.003+0000 7ff31ea00640 1 -- 172.21.15.50:0/1059105000 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff330043070 con 0x56132ea7c330 2024-09-10T10:11:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.003+0000 7ff34286f740 10 client.25291 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:11:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.003+0000 7ff34286f740 10 client.25291 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T10:11:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.003+0000 7ff34286f740 20 client.25291 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.003+0000 7ff34286f740 1 --2- 172.21.15.50:0/1059105000 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56132eb06cb0 0x56132eb059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.003+0000 7ff34286f740 4 client.25291 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:11:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.003+0000 7ff34286f740 1 -- 172.21.15.50:0/1059105000 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "status"}) -- 0x56132e9e9b30 con 0x56132eb06cb0 2024-09-10T10:11:45.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.004+0000 7ff337e00640 1 --2- 172.21.15.50:0/1059105000 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56132eb06cb0 0x56132eb059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:45.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.004+0000 7ff337e00640 1 --2- 172.21.15.50:0/1059105000 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56132eb06cb0 0x56132eb059c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f7a80ad594223262 server_cookie=795a711f5c099654 in_seq=0 out_seq=0 2024-09-10T10:11:45.008 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.004+0000 7ff31ea00640 10 client.25291 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:11:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.004+0000 7ff31ea00640 1 -- 172.21.15.50:0/1059105000 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56132e9e9b30 con 0x56132eb06cb0 2024-09-10T10:11:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.004+0000 7ff31ea00640 10 client.25291 handle_command_reply: tid=0 2024-09-10T10:11:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.004+0000 7ff34286f740 1 client.25291 shutdown 2024-09-10T10:11:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.004+0000 7ff34286f740 1 -- 172.21.15.50:0/1059105000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7c330 msgr2=0x56132eaa1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.004+0000 7ff34286f740 1 --2- 172.21.15.50:0/1059105000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7c330 0x56132eaa1bc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff330009620 tx=0x7ff33002b040 comp rx=0 tx=0).stop 2024-09-10T10:11:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff34286f740 1 -- 172.21.15.50:0/1059105000 shutdown_connections 2024-09-10T10:11:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff34286f740 1 --2- 172.21.15.50:0/1059105000 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56132eb06cb0 0x56132eb059c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff34286f740 1 --2- 172.21.15.50:0/1059105000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56132ea87510 0x56132ea80e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff34286f740 1 --2- 172.21.15.50:0/1059105000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132ea7cc50 0x56132eaa2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff34286f740 1 --2- 172.21.15.50:0/1059105000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56132ea7c330 0x56132eaa1bc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff31ea00640 0 client.25291 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:11:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff34286f740 1 -- 172.21.15.50:0/1059105000 >> 172.21.15.50:0/1059105000 conn(0x56132ea788c0 msgr2=0x56132ea7dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:45.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff34286f740 1 -- 172.21.15.50:0/1059105000 shutdown_connections 2024-09-10T10:11:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff34286f740 1 -- 172.21.15.50:0/1059105000 wait complete. 2024-09-10T10:11:45.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff34286f740 20 client.25291 trim_cache size 0 max 16384 2024-09-10T10:11:45.010 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:11:45.010 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "4d54e0f8-6f5b-11ef-bcea-c7b262605968", 2024-09-10T10:11:45.010 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 2, 2024-09-10T10:11:45.010 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24517, 2024-09-10T10:11:45.010 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-10T10:11:45.010 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-10T10:11:45.010 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-10T10:11:45.010 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 139.47300488600001, 2024-09-10T10:11:45.011 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 25, 2024-09-10T10:11:45.011 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 95, 2024-09-10T10:11:45.011 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 95, 2024-09-10T10:11:45.011 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 211.77435654799999 2024-09-10T10:11:45.011 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:11:45.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff33fc00640 1 -- 172.21.15.50:0/428526341 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ff3200a2b80 msgr2=0x7ff3200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff33fc00640 1 --2- 172.21.15.50:0/428526341 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ff3200a2b80 0x7ff3200a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0986b0 tx=0x7ff32c0ddd40 comp rx=0 tx=0).stop 2024-09-10T10:11:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff33fc00640 1 -- 172.21.15.50:0/428526341 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff338103ff0 msgr2=0x7ff33819a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.005+0000 7ff33fc00640 1 --2- 172.21.15.50:0/428526341 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff338103ff0 0x7ff33819a5e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00e9f0 tx=0x7ff32c00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.006+0000 7ff33fc00640 1 -- 172.21.15.50:0/428526341 shutdown_connections 2024-09-10T10:11:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.006+0000 7ff33fc00640 1 --2- 172.21.15.50:0/428526341 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ff3200a2b80 0x7ff3200a5040 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.006+0000 7ff33fc00640 1 --2- 172.21.15.50:0/428526341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff338109120 0x7ff33819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.006+0000 7ff33fc00640 1 --2- 172.21.15.50:0/428526341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3381049a0 0x7ff33819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.006+0000 7ff33fc00640 1 --2- 172.21.15.50:0/428526341 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff338103ff0 0x7ff33819a5e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.006+0000 7ff33fc00640 1 -- 172.21.15.50:0/428526341 >> 172.21.15.50:0/428526341 conn(0x7ff3380ffa90 msgr2=0x7ff3381004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.006+0000 7ff33fc00640 1 -- 172.21.15.50:0/428526341 shutdown_connections 2024-09-10T10:11:45.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:45.006+0000 7ff33fc00640 1 -- 172.21.15.50:0/428526341 wait complete. 2024-09-10T10:11:45.752 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T10:11:46.130 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:46.600 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:46 smithi050 ceph-mon[30354]: pgmap v408: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T10:11:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.713+0000 7f04b4c00640 1 -- 172.21.15.50:0/258640884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b01049a0 msgr2=0x7f04b01089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.713+0000 7f04b4c00640 1 --2- 172.21.15.50:0/258640884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b01049a0 0x7f04b01089f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f049c009900 tx=0x7f049c02a410 comp rx=0 tx=0).stop 2024-09-10T10:11:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.713+0000 7f04b4c00640 1 -- 172.21.15.50:0/258640884 shutdown_connections 2024-09-10T10:11:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.713+0000 7f04b4c00640 1 --2- 172.21.15.50:0/258640884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04b0109120 0x7f04b0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.713+0000 7f04b4c00640 1 --2- 172.21.15.50:0/258640884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b01049a0 0x7f04b01089f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.713+0000 7f04b4c00640 1 --2- 172.21.15.50:0/258640884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04b0103ff0 0x7f04b01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.713+0000 7f04b4c00640 1 -- 172.21.15.50:0/258640884 >> 172.21.15.50:0/258640884 conn(0x7f04b00ffa90 msgr2=0x7f04b0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.713+0000 7f04b4c00640 1 -- 172.21.15.50:0/258640884 shutdown_connections 2024-09-10T10:11:46.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.713+0000 7f04b4c00640 1 -- 172.21.15.50:0/258640884 wait complete. 2024-09-10T10:11:46.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.714+0000 7f04b4c00640 1 Processor -- start 2024-09-10T10:11:46.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.714+0000 7f04b4c00640 1 -- start start 2024-09-10T10:11:46.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.715+0000 7f04b4c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b0103ff0 0x7f04b019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.715+0000 7f04b4c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04b01049a0 0x7f04b019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.715+0000 7f04b4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04b0109120 0x7f04b019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.715+0000 7f04b4c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04b0114190 con 0x7f04b0103ff0 2024-09-10T10:11:46.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.715+0000 7f04b4c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f04b0114010 con 0x7f04b0109120 2024-09-10T10:11:46.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.715+0000 7f04b4c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f04b0114310 con 0x7f04b01049a0 2024-09-10T10:11:46.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.715+0000 7f04ade00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b0103ff0 0x7f04b019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.715+0000 7f04ade00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b0103ff0 0x7f04b019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51850/0 (socket says 172.21.15.50:51850) 2024-09-10T10:11:46.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.715+0000 7f04ade00640 1 -- 172.21.15.50:0/4148025713 learned_addr learned my addr 172.21.15.50:0/4148025713 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:46.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.715+0000 7f04ad400640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04b01049a0 0x7f04b019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.715+0000 7f04ae800640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04b0109120 0x7f04b019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.716+0000 7f04ade00640 1 -- 172.21.15.50:0/4148025713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04b01049a0 msgr2=0x7f04b019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:46.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.716+0000 7f04ade00640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04b01049a0 0x7f04b019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.716+0000 7f04ade00640 1 -- 172.21.15.50:0/4148025713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04b0109120 msgr2=0x7f04b019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:46.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.716+0000 7f04ade00640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04b0109120 0x7f04b019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.716+0000 7f04ade00640 1 -- 172.21.15.50:0/4148025713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b019f620 con 0x7f04b0103ff0 2024-09-10T10:11:46.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.716+0000 7f04ade00640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b0103ff0 0x7f04b019a670 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f04a000e9f0 tx=0x7f04a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:46.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.716+0000 7f04a6a00640 1 -- 172.21.15.50:0/4148025713 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a000cd80 con 0x7f04b0103ff0 2024-09-10T10:11:46.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.716+0000 7f04a6a00640 1 -- 172.21.15.50:0/4148025713 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04a0005500 con 0x7f04b0103ff0 2024-09-10T10:11:46.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.716+0000 7f04a6a00640 1 -- 172.21.15.50:0/4148025713 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0010690 con 0x7f04b0103ff0 2024-09-10T10:11:46.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.716+0000 7f04b4c00640 1 -- 172.21.15.50:0/4148025713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b019f910 con 0x7f04b0103ff0 2024-09-10T10:11:46.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.716+0000 7f04b4c00640 1 -- 172.21.15.50:0/4148025713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b01a71f0 con 0x7f04b0103ff0 2024-09-10T10:11:46.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.720+0000 7f04b7830740 1 Processor -- start 2024-09-10T10:11:46.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.720+0000 7f04a6a00640 1 -- 172.21.15.50:0/4148025713 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f04a00046c0 con 0x7f04b0103ff0 2024-09-10T10:11:46.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.720+0000 7f04b7830740 1 -- start start 2024-09-10T10:11:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.720+0000 7f04b7830740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a9883710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.720+0000 7f04b7830740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a988dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.720+0000 7f04b7830740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a9890900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.720+0000 7f04b7830740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5616a97e90b0 con 0x5616a9883330 2024-09-10T10:11:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.720+0000 7f04b7830740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5616a9790ab0 con 0x5616a988e510 2024-09-10T10:11:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.720+0000 7f04b7830740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616a97e5070 con 0x5616a9883c50 2024-09-10T10:11:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.720+0000 7f04ae800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a9883710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.720+0000 7f04ae800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a9883710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51860/0 (socket says 172.21.15.50:51860) 2024-09-10T10:11:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.720+0000 7f04ae800640 1 -- 172.21.15.50:0/3189068991 learned_addr learned my addr 172.21.15.50:0/3189068991 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.721+0000 7f04ad400640 1 --2- 172.21.15.50:0/3189068991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a9890900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.721+0000 7f04ade00640 1 --2- 172.21.15.50:0/3189068991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a988dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.721+0000 7f04ae800640 1 -- 172.21.15.50:0/3189068991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 msgr2=0x5616a988dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.721+0000 7f04ae800640 1 --2- 172.21.15.50:0/3189068991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a988dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.721+0000 7f04ae800640 1 -- 172.21.15.50:0/3189068991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 msgr2=0x5616a9890900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.721+0000 7f04ae800640 1 --2- 172.21.15.50:0/3189068991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a9890900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.721+0000 7f04ae800640 1 -- 172.21.15.50:0/3189068991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a979d4a0 con 0x5616a9883330 2024-09-10T10:11:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.721+0000 7f04ad400640 1 --2- 172.21.15.50:0/3189068991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a9890900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.721+0000 7f04ae800640 1 --2- 172.21.15.50:0/3189068991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a9883710 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009f90 tx=0x7f04a8010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3269c05cb3d896 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.722+0000 7f049b000640 1 -- 172.21.15.50:0/3189068991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8011700 con 0x5616a9883330 2024-09-10T10:11:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.722+0000 7f049b000640 1 -- 172.21.15.50:0/3189068991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04a8011d80 con 0x5616a9883330 2024-09-10T10:11:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.722+0000 7f049b000640 1 -- 172.21.15.50:0/3189068991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8018380 con 0x5616a9883330 2024-09-10T10:11:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.722+0000 7f04a6a00640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f04940a2c80 0x7f04940a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.722+0000 7f04a6a00640 1 -- 172.21.15.50:0/4148025713 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f04a00cf7b0 con 0x7f04b0103ff0 2024-09-10T10:11:46.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.722+0000 7f04ade00640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f04940a2c80 0x7f04940a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.723+0000 7f04b7830740 1 -- 172.21.15.50:0/3189068991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 msgr2=0x5616a9883710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.723+0000 7f04b7830740 1 --2- 172.21.15.50:0/3189068991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a9883710 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009f90 tx=0x7f04a8010860 comp rx=0 tx=0).stop 2024-09-10T10:11:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.723+0000 7f04b7830740 1 -- 172.21.15.50:0/3189068991 shutdown_connections 2024-09-10T10:11:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.723+0000 7f04ade00640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f04940a2c80 0x7f04940a5140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f04a00985f0 tx=0x7f04a00d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.723+0000 7f04b7830740 1 --2- 172.21.15.50:0/3189068991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a9890900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.723+0000 7f04b7830740 1 --2- 172.21.15.50:0/3189068991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a988dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.723+0000 7f04b7830740 1 --2- 172.21.15.50:0/3189068991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a9883710 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.723+0000 7f04b7830740 1 -- 172.21.15.50:0/3189068991 >> 172.21.15.50:0/3189068991 conn(0x5616a987f8c0 msgr2=0x5616a987fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.723+0000 7f04b7830740 1 -- 172.21.15.50:0/3189068991 shutdown_connections 2024-09-10T10:11:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.723+0000 7f04b7830740 1 -- 172.21.15.50:0/3189068991 wait complete. 2024-09-10T10:11:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.724+0000 7f04b7830740 1 -- start start 2024-09-10T10:11:46.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.724+0000 7f04b7830740 1 Processor -- start 2024-09-10T10:11:46.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.724+0000 7f04b7830740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a988b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.724+0000 7f04b7830740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a988bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.724+0000 7f04b7830740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a988c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.724+0000 7f04b7830740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5616a9891060 con 0x5616a9883330 2024-09-10T10:11:46.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.724+0000 7f04b7830740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5616a9771920 con 0x5616a988e510 2024-09-10T10:11:46.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.724+0000 7f04b7830740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616a98911e0 con 0x5616a9883c50 2024-09-10T10:11:46.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.724+0000 7f04b7830740 10 client.0 _ll_register_callbacks cb 0x5616a97958a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:46.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.725+0000 7f04ad400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a988bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.725+0000 7f04ad400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a988bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:34136/0 (socket says 172.21.15.50:34136) 2024-09-10T10:11:46.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.725+0000 7f04ad400640 1 -- 172.21.15.50:0/814928507 learned_addr learned my addr 172.21.15.50:0/814928507 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:46.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.725+0000 7f04ae800640 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a988b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.725+0000 7f04ae800640 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a988c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.725+0000 7f04ad400640 1 -- 172.21.15.50:0/814928507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 msgr2=0x5616a988c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:46.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.725+0000 7f04ad400640 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a988c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.725+0000 7f04ad400640 1 -- 172.21.15.50:0/814928507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 msgr2=0x5616a988b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:46.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.725+0000 7f04ad400640 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a988b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.725+0000 7f04ad400640 1 -- 172.21.15.50:0/814928507 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a955a2b0 con 0x5616a9883c50 2024-09-10T10:11:46.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.725+0000 7f04ae800640 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a988c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:11:46.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.725+0000 7f04ad400640 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a988bac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f049c009230 tx=0x7f049c0043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94bb3a4c4cf663b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:46.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.726+0000 7f048f400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:11:46.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.726+0000 7f048f400640 1 -- 172.21.15.50:0/814928507 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c035040 con 0x5616a9883c50 2024-09-10T10:11:46.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.726+0000 7f04b7830740 1 -- 172.21.15.50:0/814928507 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04a8011d80 con 0x5616a9883c50 2024-09-10T10:11:46.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.726+0000 7f048f400640 1 -- 172.21.15.50:0/814928507 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f049c005450 con 0x5616a9883c50 2024-09-10T10:11:46.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.726+0000 7f048f400640 1 -- 172.21.15.50:0/814928507 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f049c04f050 con 0x5616a9883c50 2024-09-10T10:11:46.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.726+0000 7f04b7830740 10 client.25303 fetch_fsmap learned FSMap version 25 2024-09-10T10:11:46.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.726+0000 7f04b7830740 1 -- 172.21.15.50:0/814928507 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5616a989ce60 con 0x5616a9883c50 2024-09-10T10:11:46.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.726+0000 7f048f400640 1 -- 172.21.15.50:0/814928507 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04a8011d80 con 0x5616a9883c50 2024-09-10T10:11:46.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.727+0000 7f048f400640 1 -- 172.21.15.50:0/814928507 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f049c003920 con 0x5616a9883c50 2024-09-10T10:11:46.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.727+0000 7f04b7830740 10 client.25303 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:11:46.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.727+0000 7f04b7830740 10 client.25303 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T10:11:46.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.727+0000 7f04b7830740 20 client.25303 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:46.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.727+0000 7f04b7830740 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5616a989f430 0x5616a98a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.727+0000 7f04b7830740 4 client.25303 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:11:46.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.727+0000 7f04b7830740 1 -- 172.21.15.50:0/814928507 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616a97f6620 con 0x5616a989f430 2024-09-10T10:11:46.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.727+0000 7f04ae800640 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5616a989f430 0x5616a98a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.728+0000 7f04ae800640 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5616a989f430 0x5616a98a08a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5408f99a625392f5 server_cookie=2c1cb52df10399d8 in_seq=0 out_seq=0 2024-09-10T10:11:46.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.728+0000 7f048f400640 10 client.25303 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:11:46.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f048f400640 1 -- 172.21.15.50:0/814928507 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5616a97f6620 con 0x5616a989f430 2024-09-10T10:11:46.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f048f400640 10 client.25303 handle_command_reply: tid=0 2024-09-10T10:11:46.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f04b7830740 1 client.25303 shutdown 2024-09-10T10:11:46.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f04b7830740 1 -- 172.21.15.50:0/814928507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 msgr2=0x5616a988bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:46.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f04b7830740 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a988bac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f049c009230 tx=0x7f049c0043b0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f04b7830740 1 -- 172.21.15.50:0/814928507 shutdown_connections 2024-09-10T10:11:46.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f04b7830740 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5616a989f430 0x5616a98a08a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f04b7830740 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a988c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f04b7830740 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a988bac0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f048f400640 0 client.25303 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:11:46.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f04b7830740 1 --2- 172.21.15.50:0/814928507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a988b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f04b7830740 1 -- 172.21.15.50:0/814928507 >> 172.21.15.50:0/814928507 conn(0x5616a987f8c0 msgr2=0x5616a98855a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:46.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f04b7830740 1 -- 172.21.15.50:0/814928507 shutdown_connections 2024-09-10T10:11:46.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f04b7830740 1 -- 172.21.15.50:0/814928507 wait complete. 2024-09-10T10:11:46.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.729+0000 7f04b7830740 20 client.25303 trim_cache size 0 max 16384 2024-09-10T10:11:46.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.748+0000 7f04b7830740 1 Processor -- start 2024-09-10T10:11:46.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.748+0000 7f04b7830740 1 -- start start 2024-09-10T10:11:46.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04b7830740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a989ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04b7830740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a9885d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04b7830740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a9888820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04b7830740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5616a989ebe0 con 0x5616a9883330 2024-09-10T10:11:46.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04b7830740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5616a989f2b0 con 0x5616a988e510 2024-09-10T10:11:46.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04b7830740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616a989f980 con 0x5616a9883c50 2024-09-10T10:11:46.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04ad400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a9885d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04ae800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a989ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04ad400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a9885d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:34146/0 (socket says 172.21.15.50:34146) 2024-09-10T10:11:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04ad400640 1 -- 172.21.15.50:0/1687908934 learned_addr learned my addr 172.21.15.50:0/1687908934 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04ae800640 1 --2- 172.21.15.50:0/1687908934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a9888820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04ad400640 1 -- 172.21.15.50:0/1687908934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 msgr2=0x5616a9888820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04ad400640 1 --2- 172.21.15.50:0/1687908934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a9888820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04ad400640 1 -- 172.21.15.50:0/1687908934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 msgr2=0x5616a989ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04ad400640 1 --2- 172.21.15.50:0/1687908934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a989ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.749+0000 7f04ad400640 1 -- 172.21.15.50:0/1687908934 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a9883a80 con 0x5616a9883c50 2024-09-10T10:11:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.750+0000 7f04ad400640 1 --2- 172.21.15.50:0/1687908934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a9885d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f049c02aa00 tx=0x7f049c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=605e9a3cc4473615 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.750+0000 7f049a600640 1 -- 172.21.15.50:0/1687908934 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c035070 con 0x5616a9883c50 2024-09-10T10:11:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.750+0000 7f049a600640 1 -- 172.21.15.50:0/1687908934 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f049c041070 con 0x5616a9883c50 2024-09-10T10:11:46.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.750+0000 7f049a600640 1 -- 172.21.15.50:0/1687908934 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c031880 con 0x5616a9883c50 2024-09-10T10:11:46.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.750+0000 7f04b7830740 1 -- 172.21.15.50:0/1687908934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 msgr2=0x5616a9885d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:46.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.751+0000 7f04b7830740 1 --2- 172.21.15.50:0/1687908934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a9885d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f049c02aa00 tx=0x7f049c0045e0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.751+0000 7f04b7830740 1 -- 172.21.15.50:0/1687908934 shutdown_connections 2024-09-10T10:11:46.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.751+0000 7f04b7830740 1 --2- 172.21.15.50:0/1687908934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a9888820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.751+0000 7f04b7830740 1 --2- 172.21.15.50:0/1687908934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883c50 0x5616a9885d90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.751+0000 7f04b7830740 1 --2- 172.21.15.50:0/1687908934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883330 0x5616a989ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.751+0000 7f04b7830740 1 -- 172.21.15.50:0/1687908934 >> 172.21.15.50:0/1687908934 conn(0x5616a987f8c0 msgr2=0x5616a9889e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:46.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.751+0000 7f04b7830740 1 -- 172.21.15.50:0/1687908934 shutdown_connections 2024-09-10T10:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.751+0000 7f04b7830740 1 -- 172.21.15.50:0/1687908934 wait complete. 2024-09-10T10:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.751+0000 7f04b7830740 1 -- start start 2024-09-10T10:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.751+0000 7f04b7830740 1 Processor -- start 2024-09-10T10:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.752+0000 7f04b7830740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883330 0x5616a98a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.752+0000 7f04b7830740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883c50 0x5616a98a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.752+0000 7f04b7830740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a98a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.752+0000 7f04b7830740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5616a98a0720 con 0x5616a9883c50 2024-09-10T10:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.752+0000 7f04b7830740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5616a98a0050 con 0x5616a988e510 2024-09-10T10:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.752+0000 7f04b7830740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5616a98a0df0 con 0x5616a9883330 2024-09-10T10:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.752+0000 7f04b7830740 10 client.0 _ll_register_callbacks cb 0x7f049c004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.752+0000 7f04ad400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883c50 0x5616a98a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.752+0000 7f04ad400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883c50 0x5616a98a9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51882/0 (socket says 172.21.15.50:51882) 2024-09-10T10:11:46.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.752+0000 7f04ad400640 1 -- 172.21.15.50:0/3005906805 learned_addr learned my addr 172.21.15.50:0/3005906805 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.752+0000 7f04ae800640 1 --2- 172.21.15.50:0/3005906805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883330 0x5616a98a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.752+0000 7f04ae800640 1 --2- 172.21.15.50:0/3005906805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a98a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.753+0000 7f04ad400640 1 -- 172.21.15.50:0/3005906805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883330 msgr2=0x5616a98a8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.753+0000 7f04ad400640 1 --2- 172.21.15.50:0/3005906805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883330 0x5616a98a8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.753+0000 7f04ad400640 1 -- 172.21.15.50:0/3005906805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 msgr2=0x5616a98a3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.753+0000 7f04ad400640 1 --2- 172.21.15.50:0/3005906805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a98a3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.753+0000 7f04ad400640 1 -- 172.21.15.50:0/3005906805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a98a3ff0 con 0x5616a9883c50 2024-09-10T10:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.753+0000 7f04ad400640 1 --2- 172.21.15.50:0/3005906805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883c50 0x5616a98a9040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f049c0057c0 tx=0x7f049c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd6021b56f162d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.753+0000 7f048f400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.753+0000 7f048f400640 1 -- 172.21.15.50:0/3005906805 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c060060 con 0x5616a9883c50 2024-09-10T10:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.753+0000 7f048f400640 1 -- 172.21.15.50:0/3005906805 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f049c04c040 con 0x5616a9883c50 2024-09-10T10:11:46.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.753+0000 7f04b7830740 1 -- 172.21.15.50:0/3005906805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f049c041070 con 0x5616a9883c50 2024-09-10T10:11:46.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.754+0000 7f048f400640 1 -- 172.21.15.50:0/3005906805 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f049c035030 con 0x5616a9883c50 2024-09-10T10:11:46.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.754+0000 7f04b7830740 10 client.15291 fetch_fsmap learned FSMap version 25 2024-09-10T10:11:46.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.754+0000 7f04b7830740 1 -- 172.21.15.50:0/3005906805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5616a990a1d0 con 0x5616a9883c50 2024-09-10T10:11:46.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.754+0000 7f048f400640 1 -- 172.21.15.50:0/3005906805 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f049c041070 con 0x5616a9883c50 2024-09-10T10:11:46.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.754+0000 7f048f400640 1 -- 172.21.15.50:0/3005906805 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f049c031a60 con 0x5616a9883c50 2024-09-10T10:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.754+0000 7f04b7830740 10 client.15291 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.754+0000 7f04b7830740 10 client.15291 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T10:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.754+0000 7f04b7830740 20 client.15291 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.754+0000 7f04b7830740 1 --2- 172.21.15.50:0/3005906805 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5616a990e9f0 0x5616a990d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.754+0000 7f04b7830740 4 client.15291 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.754+0000 7f04b7830740 1 -- 172.21.15.50:0/3005906805 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "status"}) -- 0x5616a97f0b30 con 0x5616a990e9f0 2024-09-10T10:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.755+0000 7f04ae800640 1 --2- 172.21.15.50:0/3005906805 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5616a990e9f0 0x5616a990d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.755+0000 7f04ae800640 1 --2- 172.21.15.50:0/3005906805 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5616a990e9f0 0x5616a990d700 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2defbff7f68a181b server_cookie=f3fefd4f8358b3e5 in_seq=0 out_seq=0 2024-09-10T10:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.755+0000 7f048f400640 10 client.15291 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.755+0000 7f048f400640 1 -- 172.21.15.50:0/3005906805 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5616a97f0b30 con 0x5616a990e9f0 2024-09-10T10:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.755+0000 7f048f400640 10 client.15291 handle_command_reply: tid=0 2024-09-10T10:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.755+0000 7f04b7830740 1 client.15291 shutdown 2024-09-10T10:11:46.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.756+0000 7f04b7830740 1 -- 172.21.15.50:0/3005906805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883c50 msgr2=0x5616a98a9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:46.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.756+0000 7f04b7830740 1 --2- 172.21.15.50:0/3005906805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883c50 0x5616a98a9040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f049c0057c0 tx=0x7f049c02a410 comp rx=0 tx=0).stop 2024-09-10T10:11:46.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.756+0000 7f04b7830740 1 -- 172.21.15.50:0/3005906805 shutdown_connections 2024-09-10T10:11:46.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.756+0000 7f04b7830740 1 --2- 172.21.15.50:0/3005906805 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5616a990e9f0 0x5616a990d700 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.756+0000 7f04b7830740 1 --2- 172.21.15.50:0/3005906805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616a988e510 0x5616a98a3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.756+0000 7f04b7830740 1 --2- 172.21.15.50:0/3005906805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5616a9883c50 0x5616a98a9040 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.756+0000 7f04b7830740 1 --2- 172.21.15.50:0/3005906805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5616a9883330 0x5616a98a8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.756+0000 7f04b7830740 1 -- 172.21.15.50:0/3005906805 >> 172.21.15.50:0/3005906805 conn(0x5616a987f8c0 msgr2=0x5616a9899430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:46.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.756+0000 7f048f400640 0 client.15291 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:11:46.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.756+0000 7f04b7830740 1 -- 172.21.15.50:0/3005906805 shutdown_connections 2024-09-10T10:11:46.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.756+0000 7f04b7830740 1 -- 172.21.15.50:0/3005906805 wait complete. 2024-09-10T10:11:46.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.756+0000 7f04b7830740 20 client.15291 trim_cache size 0 max 16384 2024-09-10T10:11:46.762 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:11:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "4d54e0f8-6f5b-11ef-bcea-c7b262605968", 2024-09-10T10:11:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 1, 2024-09-10T10:11:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24521, 2024-09-10T10:11:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-10T10:11:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-10T10:11:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-10T10:11:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 142.23792178400001, 2024-09-10T10:11:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 25, 2024-09-10T10:11:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 95, 2024-09-10T10:11:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 95, 2024-09-10T10:11:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 216.33194627699999 2024-09-10T10:11:46.763 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:11:46.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.757+0000 7f04b4c00640 1 -- 172.21.15.50:0/4148025713 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f04940a2c80 msgr2=0x7f04940a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:46.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.757+0000 7f04b4c00640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f04940a2c80 0x7f04940a5140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f04a00985f0 tx=0x7f04a00d5530 comp rx=0 tx=0).stop 2024-09-10T10:11:46.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.757+0000 7f04b4c00640 1 -- 172.21.15.50:0/4148025713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b0103ff0 msgr2=0x7f04b019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:46.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.757+0000 7f04b4c00640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b0103ff0 0x7f04b019a670 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f04a000e9f0 tx=0x7f04a000edf0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.757+0000 7f04b4c00640 1 -- 172.21.15.50:0/4148025713 shutdown_connections 2024-09-10T10:11:46.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.757+0000 7f04b4c00640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f04940a2c80 0x7f04940a5140 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.757+0000 7f04b4c00640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04b0109120 0x7f04b019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.757+0000 7f04b4c00640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04b01049a0 0x7f04b019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.757+0000 7f04b4c00640 1 --2- 172.21.15.50:0/4148025713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04b0103ff0 0x7f04b019a670 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:46.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.757+0000 7f04b4c00640 1 -- 172.21.15.50:0/4148025713 >> 172.21.15.50:0/4148025713 conn(0x7f04b00ffa90 msgr2=0x7f04b0100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:46.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.757+0000 7f04b4c00640 1 -- 172.21.15.50:0/4148025713 shutdown_connections 2024-09-10T10:11:46.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:46.757+0000 7f04b4c00640 1 -- 172.21.15.50:0/4148025713 wait complete. 2024-09-10T10:11:46.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:46 smithi189 ceph-mon[34999]: pgmap v408: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T10:11:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:46 smithi084 ceph-mon[34812]: pgmap v408: 129 pgs: 129 active+clean; 648 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T10:11:47.517 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T10:11:47.894 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:11:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.449+0000 7fa9bf800640 1 -- 172.21.15.50:0/2491567721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9b8103ff0 msgr2=0x7fa9b81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.449+0000 7fa9bf800640 1 --2- 172.21.15.50:0/2491567721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9b8103ff0 0x7fa9b81043d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009900 tx=0x7fa9ac02a410 comp rx=0 tx=0).stop 2024-09-10T10:11:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.449+0000 7fa9bf800640 1 -- 172.21.15.50:0/2491567721 shutdown_connections 2024-09-10T10:11:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.449+0000 7fa9bf800640 1 --2- 172.21.15.50:0/2491567721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9b8109120 0x7fa9b8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.449+0000 7fa9bf800640 1 --2- 172.21.15.50:0/2491567721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b81049a0 0x7fa9b81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.449+0000 7fa9bf800640 1 --2- 172.21.15.50:0/2491567721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9b8103ff0 0x7fa9b81043d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.449+0000 7fa9bf800640 1 -- 172.21.15.50:0/2491567721 >> 172.21.15.50:0/2491567721 conn(0x7fa9b80ffa90 msgr2=0x7fa9b8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:48.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.449+0000 7fa9bf800640 1 -- 172.21.15.50:0/2491567721 shutdown_connections 2024-09-10T10:11:48.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.449+0000 7fa9bf800640 1 -- 172.21.15.50:0/2491567721 wait complete. 2024-09-10T10:11:48.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.450+0000 7fa9bf800640 1 Processor -- start 2024-09-10T10:11:48.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.451+0000 7fa9bf800640 1 -- start start 2024-09-10T10:11:48.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.451+0000 7fa9bf800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9b8103ff0 0x7fa9b819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.451+0000 7fa9bf800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b81049a0 0x7fa9b819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.451+0000 7fa9bf800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9b8109120 0x7fa9b819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.451+0000 7fa9bf800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b81141a0 con 0x7fa9b8109120 2024-09-10T10:11:48.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.451+0000 7fa9bf800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b8114020 con 0x7fa9b81049a0 2024-09-10T10:11:48.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.451+0000 7fa9bf800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b8114320 con 0x7fa9b8103ff0 2024-09-10T10:11:48.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.451+0000 7fa9b7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b81049a0 0x7fa9b819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.451+0000 7fa9bd800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9b8109120 0x7fa9b819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.451+0000 7fa9b7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b81049a0 0x7fa9b819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:34544/0 (socket says 172.21.15.50:34544) 2024-09-10T10:11:48.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.451+0000 7fa9bce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9b8103ff0 0x7fa9b819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.451+0000 7fa9b7e00640 1 -- 172.21.15.50:0/1480380883 learned_addr learned my addr 172.21.15.50:0/1480380883 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:48.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.452+0000 7fa9b7e00640 1 -- 172.21.15.50:0/1480380883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9b8103ff0 msgr2=0x7fa9b819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:48.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.452+0000 7fa9b7e00640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9b8103ff0 0x7fa9b819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.452+0000 7fa9b7e00640 1 -- 172.21.15.50:0/1480380883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9b8109120 msgr2=0x7fa9b819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.452+0000 7fa9b7e00640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9b8109120 0x7fa9b819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.452+0000 7fa9b7e00640 1 -- 172.21.15.50:0/1480380883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b819f5d0 con 0x7fa9b81049a0 2024-09-10T10:11:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.452+0000 7fa9bce00640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9b8103ff0 0x7fa9b819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.452+0000 7fa9bd800640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9b8109120 0x7fa9b819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.452+0000 7fa9b7e00640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b81049a0 0x7fa9b819ab60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400ea60 tx=0x7fa9a400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.453+0000 7fa9b5600640 1 -- 172.21.15.50:0/1480380883 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a400cde0 con 0x7fa9b81049a0 2024-09-10T10:11:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.453+0000 7fa9bf800640 1 -- 172.21.15.50:0/1480380883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b819f8c0 con 0x7fa9b81049a0 2024-09-10T10:11:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.453+0000 7fa9b5600640 1 -- 172.21.15.50:0/1480380883 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9a40035f0 con 0x7fa9b81049a0 2024-09-10T10:11:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.453+0000 7fa9b5600640 1 -- 172.21.15.50:0/1480380883 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4010670 con 0x7fa9b81049a0 2024-09-10T10:11:48.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.453+0000 7fa9bf800640 1 -- 172.21.15.50:0/1480380883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b81a71a0 con 0x7fa9b81049a0 2024-09-10T10:11:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.456+0000 7fa9c2299740 1 Processor -- start 2024-09-10T10:11:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.456+0000 7fa9c2299740 1 -- start start 2024-09-10T10:11:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.456+0000 7fa9b5600640 1 -- 172.21.15.50:0/1480380883 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa9a40037a0 con 0x7fa9b81049a0 2024-09-10T10:11:48.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.456+0000 7fa9c2299740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.456+0000 7fa9c2299740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0c50 0x55e2cbccafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.456+0000 7fa9c2299740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbccb510 0x55e2cbccd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.456+0000 7fa9c2299740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbc260b0 con 0x55e2cbccb510 2024-09-10T10:11:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.456+0000 7fa9c2299740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbbcdab0 con 0x55e2cbcc0c50 2024-09-10T10:11:48.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.456+0000 7fa9c2299740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbc22070 con 0x55e2cbcc0330 2024-09-10T10:11:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.457+0000 7fa9bce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0c50 0x55e2cbccafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.457+0000 7fa9bd800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.457+0000 7fa9b7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbccb510 0x55e2cbccd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.457+0000 7fa9bd800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:52640/0 (socket says 172.21.15.50:52640) 2024-09-10T10:11:48.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.457+0000 7fa9bd800640 1 -- 172.21.15.50:0/179837000 learned_addr learned my addr 172.21.15.50:0/179837000 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.457+0000 7fa9bd800640 1 -- 172.21.15.50:0/179837000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0c50 msgr2=0x55e2cbccafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.457+0000 7fa9bd800640 1 --2- 172.21.15.50:0/179837000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0c50 0x55e2cbccafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.457+0000 7fa9bd800640 1 -- 172.21.15.50:0/179837000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbccb510 msgr2=0x55e2cbccd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.457+0000 7fa9bd800640 1 --2- 172.21.15.50:0/179837000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbccb510 0x55e2cbccd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.457+0000 7fa9bd800640 1 -- 172.21.15.50:0/179837000 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2cbbda4a0 con 0x55e2cbcc0330 2024-09-10T10:11:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.457+0000 7fa9bd800640 1 --2- 172.21.15.50:0/179837000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc0710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0011790 tx=0x7fa9b0011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6406395a1961871 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.458+0000 7fa9aa000640 1 -- 172.21.15.50:0/179837000 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0003c30 con 0x55e2cbcc0330 2024-09-10T10:11:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.458+0000 7fa9b5600640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa9a00a2b80 0x7fa9a00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.458+0000 7fa9b5600640 1 -- 172.21.15.50:0/1480380883 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa9a40cf6e0 con 0x7fa9b81049a0 2024-09-10T10:11:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.458+0000 7fa9aa000640 1 -- 172.21.15.50:0/179837000 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9b000fe80 con 0x55e2cbcc0330 2024-09-10T10:11:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.458+0000 7fa9aa000640 1 -- 172.21.15.50:0/179837000 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00193e0 con 0x55e2cbcc0330 2024-09-10T10:11:48.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.458+0000 7fa9bce00640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa9a00a2b80 0x7fa9a00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.459+0000 7fa9c2299740 1 -- 172.21.15.50:0/179837000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0330 msgr2=0x55e2cbcc0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:48.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.459+0000 7fa9c2299740 1 --2- 172.21.15.50:0/179837000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc0710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0011790 tx=0x7fa9b0011c50 comp rx=0 tx=0).stop 2024-09-10T10:11:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.459+0000 7fa9c2299740 1 -- 172.21.15.50:0/179837000 shutdown_connections 2024-09-10T10:11:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.459+0000 7fa9c2299740 1 --2- 172.21.15.50:0/179837000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbccb510 0x55e2cbccd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.459+0000 7fa9c2299740 1 --2- 172.21.15.50:0/179837000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0c50 0x55e2cbccafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.459+0000 7fa9c2299740 1 --2- 172.21.15.50:0/179837000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc0710 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.459+0000 7fa9c2299740 1 -- 172.21.15.50:0/179837000 >> 172.21.15.50:0/179837000 conn(0x55e2cbcbc8c0 msgr2=0x55e2cbcbcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.459+0000 7fa9bce00640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa9a00a2b80 0x7fa9a00a5040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000c00 tx=0x7fa9ac031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.459+0000 7fa9c2299740 1 -- 172.21.15.50:0/179837000 shutdown_connections 2024-09-10T10:11:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.459+0000 7fa9c2299740 1 -- 172.21.15.50:0/179837000 wait complete. 2024-09-10T10:11:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.459+0000 7fa9c2299740 1 -- start start 2024-09-10T10:11:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.460+0000 7fa9c2299740 1 Processor -- start 2024-09-10T10:11:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.460+0000 7fa9c2299740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.460+0000 7fa9c2299740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbcc0c50 0x55e2cbcc8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.460+0000 7fa9c2299740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbccb510 0x55e2cbcc90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.460+0000 7fa9c2299740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbcce060 con 0x55e2cbcc0c50 2024-09-10T10:11:48.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.460+0000 7fa9c2299740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbbae920 con 0x55e2cbcc0330 2024-09-10T10:11:48.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.460+0000 7fa9c2299740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbcce1e0 con 0x55e2cbccb510 2024-09-10T10:11:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.460+0000 7fa9c2299740 10 client.0 _ll_register_callbacks cb 0x55e2cbbd28a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.461+0000 7fa9b7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbcc0c50 0x55e2cbcc8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.461+0000 7fa9bce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.461+0000 7fa9bce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:34558/0 (socket says 172.21.15.50:34558) 2024-09-10T10:11:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.461+0000 7fa9bce00640 1 -- 172.21.15.50:0/4268209472 learned_addr learned my addr 172.21.15.50:0/4268209472 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.461+0000 7fa9bd800640 1 --2- 172.21.15.50:0/4268209472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbccb510 0x55e2cbcc90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.461+0000 7fa9b7e00640 1 -- 172.21.15.50:0/4268209472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbccb510 msgr2=0x55e2cbcc90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.461+0000 7fa9b7e00640 1 --2- 172.21.15.50:0/4268209472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbccb510 0x55e2cbcc90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.461+0000 7fa9b7e00640 1 -- 172.21.15.50:0/4268209472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0330 msgr2=0x55e2cbcc8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:48.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.461+0000 7fa9b7e00640 1 --2- 172.21.15.50:0/4268209472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.461+0000 7fa9b7e00640 1 -- 172.21.15.50:0/4268209472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2cb9972b0 con 0x55e2cbcc0c50 2024-09-10T10:11:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.461+0000 7fa9bce00640 1 --2- 172.21.15.50:0/4268209472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:11:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.461+0000 7fa9b7e00640 1 --2- 172.21.15.50:0/4268209472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbcc0c50 0x55e2cbcc8b60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55e2cbcbdc40 tx=0x7fa9a4097df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb71120e8aef7126 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.461+0000 7fa99ea00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:11:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.462+0000 7fa99ea00640 1 -- 172.21.15.50:0/4268209472 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a409b4b0 con 0x55e2cbcc0c50 2024-09-10T10:11:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.462+0000 7fa99ea00640 1 -- 172.21.15.50:0/4268209472 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa9a40cf3a0 con 0x55e2cbcc0c50 2024-09-10T10:11:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.462+0000 7fa9c2299740 1 -- 172.21.15.50:0/4268209472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e2cbc33620 con 0x55e2cbcc0c50 2024-09-10T10:11:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.462+0000 7fa99ea00640 1 -- 172.21.15.50:0/4268209472 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa9a409c250 con 0x55e2cbcc0c50 2024-09-10T10:11:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.462+0000 7fa9c2299740 10 client.15303 fetch_fsmap learned FSMap version 25 2024-09-10T10:11:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.462+0000 7fa9c2299740 1 -- 172.21.15.50:0/4268209472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e2cbcd9e80 con 0x55e2cbcc0c50 2024-09-10T10:11:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.462+0000 7fa99ea00640 1 -- 172.21.15.50:0/4268209472 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e2cbc33620 con 0x55e2cbcc0c50 2024-09-10T10:11:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.462+0000 7fa99ea00640 1 -- 172.21.15.50:0/4268209472 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fa9a40d1be0 con 0x55e2cbcc0c50 2024-09-10T10:11:48.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.463+0000 7fa9c2299740 10 client.15303 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:11:48.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.463+0000 7fa9c2299740 10 client.15303 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T10:11:48.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.463+0000 7fa9c2299740 20 client.15303 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:48.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.463+0000 7fa9c2299740 1 --2- 172.21.15.50:0/4268209472 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e2cbcdc490 0x55e2cbcdd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.463+0000 7fa9c2299740 4 client.15303 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:11:48.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.463+0000 7fa9c2299740 1 -- 172.21.15.50:0/4268209472 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2cbc2db30 con 0x55e2cbcdc490 2024-09-10T10:11:48.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.463+0000 7fa9bce00640 1 --2- 172.21.15.50:0/4268209472 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e2cbcdc490 0x55e2cbcdd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.464+0000 7fa9bce00640 1 --2- 172.21.15.50:0/4268209472 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e2cbcdc490 0x55e2cbcdd900 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=857c8887cfdf2222 server_cookie=79a66775d10d0f23 in_seq=0 out_seq=0 2024-09-10T10:11:48.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.464+0000 7fa99ea00640 10 client.15303 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.464+0000 7fa99ea00640 1 -- 172.21.15.50:0/4268209472 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e2cbc2db30 con 0x55e2cbcdc490 2024-09-10T10:11:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.464+0000 7fa99ea00640 10 client.15303 handle_command_reply: tid=0 2024-09-10T10:11:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.464+0000 7fa9c2299740 1 client.15303 shutdown 2024-09-10T10:11:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.465+0000 7fa9c2299740 1 -- 172.21.15.50:0/4268209472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbcc0c50 msgr2=0x55e2cbcc8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.465+0000 7fa9c2299740 1 --2- 172.21.15.50:0/4268209472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbcc0c50 0x55e2cbcc8b60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55e2cbcbdc40 tx=0x7fa9a4097df0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.465+0000 7fa9c2299740 1 -- 172.21.15.50:0/4268209472 shutdown_connections 2024-09-10T10:11:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.465+0000 7fa9c2299740 1 --2- 172.21.15.50:0/4268209472 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e2cbcdc490 0x55e2cbcdd900 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.465+0000 7fa9c2299740 1 --2- 172.21.15.50:0/4268209472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbccb510 0x55e2cbcc90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.465+0000 7fa9c2299740 1 --2- 172.21.15.50:0/4268209472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbcc0c50 0x55e2cbcc8b60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.465+0000 7fa9c2299740 1 --2- 172.21.15.50:0/4268209472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.465+0000 7fa9c2299740 1 -- 172.21.15.50:0/4268209472 >> 172.21.15.50:0/4268209472 conn(0x55e2cbcbc8c0 msgr2=0x55e2cbcc25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.465+0000 7fa99ea00640 0 client.15303 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.465+0000 7fa9c2299740 1 -- 172.21.15.50:0/4268209472 shutdown_connections 2024-09-10T10:11:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.465+0000 7fa9c2299740 1 -- 172.21.15.50:0/4268209472 wait complete. 2024-09-10T10:11:48.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.465+0000 7fa9c2299740 20 client.15303 trim_cache size 0 max 16384 2024-09-10T10:11:48.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.484+0000 7fa9c2299740 1 Processor -- start 2024-09-10T10:11:48.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.484+0000 7fa9c2299740 1 -- start start 2024-09-10T10:11:48.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.484+0000 7fa9c2299740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.484+0000 7fa9c2299740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0c50 0x55e2cbcc7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.484+0000 7fa9c2299740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbccb510 0x55e2cbcc78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.484+0000 7fa9c2299740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbcdbc40 con 0x55e2cbcc0330 2024-09-10T10:11:48.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.484+0000 7fa9c2299740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbcdc310 con 0x55e2cbccb510 2024-09-10T10:11:48.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.484+0000 7fa9c2299740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbcdc9e0 con 0x55e2cbcc0c50 2024-09-10T10:11:48.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.485+0000 7fa9bce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.485+0000 7fa9bce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57204/0 (socket says 172.21.15.50:57204) 2024-09-10T10:11:48.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.485+0000 7fa9bce00640 1 -- 172.21.15.50:0/518853689 learned_addr learned my addr 172.21.15.50:0/518853689 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:48.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.485+0000 7fa9bd800640 1 --2- 172.21.15.50:0/518853689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbccb510 0x55e2cbcc78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.485+0000 7fa9b7e00640 1 --2- 172.21.15.50:0/518853689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0c50 0x55e2cbcc7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.485+0000 7fa9bce00640 1 -- 172.21.15.50:0/518853689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0c50 msgr2=0x55e2cbcc7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.485+0000 7fa9bce00640 1 --2- 172.21.15.50:0/518853689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0c50 0x55e2cbcc7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.485+0000 7fa9bce00640 1 -- 172.21.15.50:0/518853689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbccb510 msgr2=0x55e2cbcc78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.485+0000 7fa9bce00640 1 --2- 172.21.15.50:0/518853689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbccb510 0x55e2cbcc78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.485+0000 7fa9bce00640 1 -- 172.21.15.50:0/518853689 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2cbcc0a80 con 0x55e2cbcc0330 2024-09-10T10:11:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.485+0000 7fa9bce00640 1 --2- 172.21.15.50:0/518853689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc6e20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009900 tx=0x7fa9ac040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0d6e70e768293a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.486+0000 7fa9a9600640 1 -- 172.21.15.50:0/518853689 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac035040 con 0x55e2cbcc0330 2024-09-10T10:11:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.486+0000 7fa9a9600640 1 -- 172.21.15.50:0/518853689 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9ac004c40 con 0x55e2cbcc0330 2024-09-10T10:11:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.486+0000 7fa9a9600640 1 -- 172.21.15.50:0/518853689 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac031c30 con 0x55e2cbcc0330 2024-09-10T10:11:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.486+0000 7fa9c2299740 1 -- 172.21.15.50:0/518853689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbcc0330 msgr2=0x55e2cbcc6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.486+0000 7fa9c2299740 1 --2- 172.21.15.50:0/518853689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc6e20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009900 tx=0x7fa9ac040000 comp rx=0 tx=0).stop 2024-09-10T10:11:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.486+0000 7fa9c2299740 1 -- 172.21.15.50:0/518853689 shutdown_connections 2024-09-10T10:11:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.486+0000 7fa9c2299740 1 --2- 172.21.15.50:0/518853689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbccb510 0x55e2cbcc78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.486+0000 7fa9c2299740 1 --2- 172.21.15.50:0/518853689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0c50 0x55e2cbcc7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.486+0000 7fa9c2299740 1 --2- 172.21.15.50:0/518853689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbcc0330 0x55e2cbcc6e20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.486+0000 7fa9c2299740 1 -- 172.21.15.50:0/518853689 >> 172.21.15.50:0/518853689 conn(0x55e2cbcbc8c0 msgr2=0x55e2cbcc39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.486+0000 7fa9c2299740 1 -- 172.21.15.50:0/518853689 shutdown_connections 2024-09-10T10:11:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.486+0000 7fa9c2299740 1 -- 172.21.15.50:0/518853689 wait complete. 2024-09-10T10:11:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.487+0000 7fa9c2299740 1 -- start start 2024-09-10T10:11:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.487+0000 7fa9c2299740 1 Processor -- start 2024-09-10T10:11:48.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.487+0000 7fa9c2299740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0330 0x55e2cbce5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.487+0000 7fa9c2299740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0c50 0x55e2cbce6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.487+0000 7fa9c2299740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbccb510 0x55e2cbcc50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.487+0000 7fa9c2299740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbcdd780 con 0x55e2cbccb510 2024-09-10T10:11:48.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.487+0000 7fa9c2299740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbcdd0b0 con 0x55e2cbcc0330 2024-09-10T10:11:48.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.487+0000 7fa9c2299740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbcdde50 con 0x55e2cbcc0c50 2024-09-10T10:11:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.487+0000 7fa9c2299740 10 client.0 _ll_register_callbacks cb 0x7fa9a40976d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:11:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.488+0000 7fa9b7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0c50 0x55e2cbce6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.488+0000 7fa9bd800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbccb510 0x55e2cbcc50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.488+0000 7fa9bce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0330 0x55e2cbce5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.488+0000 7fa9b7e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0c50 0x55e2cbce6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:52662/0 (socket says 172.21.15.50:52662) 2024-09-10T10:11:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.488+0000 7fa9b7e00640 1 -- 172.21.15.50:0/2824573729 learned_addr learned my addr 172.21.15.50:0/2824573729 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:11:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.488+0000 7fa9bce00640 1 -- 172.21.15.50:0/2824573729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0c50 msgr2=0x55e2cbce6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.488+0000 7fa9bce00640 1 --2- 172.21.15.50:0/2824573729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0c50 0x55e2cbce6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.488+0000 7fa9bce00640 1 -- 172.21.15.50:0/2824573729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbccb510 msgr2=0x55e2cbcc50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:11:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.488+0000 7fa9bce00640 1 --2- 172.21.15.50:0/2824573729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbccb510 0x55e2cbcc50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.488+0000 7fa9bce00640 1 -- 172.21.15.50:0/2824573729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2cbcc58d0 con 0x55e2cbcc0330 2024-09-10T10:11:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.488+0000 7fa9bce00640 1 --2- 172.21.15.50:0/2824573729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0330 0x55e2cbce5ed0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac02a930 tx=0x7fa9ac0051e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c00de592a0987c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:11:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.488+0000 7fa99ea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:11:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.489+0000 7fa99ea00640 1 -- 172.21.15.50:0/2824573729 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac060070 con 0x55e2cbcc0330 2024-09-10T10:11:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.489+0000 7fa9c2299740 1 -- 172.21.15.50:0/2824573729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9ac004c40 con 0x55e2cbcc0330 2024-09-10T10:11:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.489+0000 7fa99ea00640 1 -- 172.21.15.50:0/2824573729 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa9ac004760 con 0x55e2cbcc0330 2024-09-10T10:11:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.489+0000 7fa99ea00640 1 -- 172.21.15.50:0/2824573729 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa9ac0049a0 con 0x55e2cbcc0330 2024-09-10T10:11:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.489+0000 7fa9c2299740 10 client.25358 fetch_fsmap learned FSMap version 25 2024-09-10T10:11:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.489+0000 7fa9c2299740 1 -- 172.21.15.50:0/2824573729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e2cbce5850 con 0x55e2cbcc0330 2024-09-10T10:11:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.489+0000 7fa99ea00640 1 -- 172.21.15.50:0/2824573729 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9ac004c40 con 0x55e2cbcc0330 2024-09-10T10:11:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.490+0000 7fa99ea00640 1 -- 172.21.15.50:0/2824573729 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fa9ac044070 con 0x55e2cbcc0330 2024-09-10T10:11:48.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.490+0000 7fa9c2299740 10 client.25358 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:11:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.490+0000 7fa9c2299740 10 client.25358 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T10:11:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.490+0000 7fa9c2299740 20 client.25358 populate_metadata read hostname 'smithi050' 2024-09-10T10:11:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.490+0000 7fa9c2299740 1 --2- 172.21.15.50:0/2824573729 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e2cbd4adb0 0x55e2cbd49ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:11:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.490+0000 7fa9c2299740 4 client.25358 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:11:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.490+0000 7fa9c2299740 1 -- 172.21.15.50:0/2824573729 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "status"}) -- 0x55e2cbba9f80 con 0x55e2cbd4adb0 2024-09-10T10:11:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.490+0000 7fa9b7e00640 1 --2- 172.21.15.50:0/2824573729 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e2cbd4adb0 0x55e2cbd49ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:11:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.491+0000 7fa9b7e00640 1 --2- 172.21.15.50:0/2824573729 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e2cbd4adb0 0x55e2cbd49ac0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eccb657487d35b1 server_cookie=6ea188ea23c30b5d in_seq=0 out_seq=0 2024-09-10T10:11:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.491+0000 7fa99ea00640 10 client.25358 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.491+0000 7fa99ea00640 1 -- 172.21.15.50:0/2824573729 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55e2cbba9f80 con 0x55e2cbd4adb0 2024-09-10T10:11:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.491+0000 7fa99ea00640 10 client.25358 handle_command_reply: tid=0 2024-09-10T10:11:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.491+0000 7fa9c2299740 1 client.25358 shutdown 2024-09-10T10:11:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.492+0000 7fa9c2299740 1 -- 172.21.15.50:0/2824573729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0330 msgr2=0x55e2cbce5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.492+0000 7fa9c2299740 1 --2- 172.21.15.50:0/2824573729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0330 0x55e2cbce5ed0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac02a930 tx=0x7fa9ac0051e0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.492+0000 7fa9c2299740 1 -- 172.21.15.50:0/2824573729 shutdown_connections 2024-09-10T10:11:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.492+0000 7fa9c2299740 1 --2- 172.21.15.50:0/2824573729 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e2cbd4adb0 0x55e2cbd49ac0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.492+0000 7fa9c2299740 1 --2- 172.21.15.50:0/2824573729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2cbccb510 0x55e2cbcc50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.492+0000 7fa99ea00640 0 client.25358 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:11:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.492+0000 7fa9c2299740 1 --2- 172.21.15.50:0/2824573729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e2cbcc0c50 0x55e2cbce6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.492+0000 7fa9c2299740 1 --2- 172.21.15.50:0/2824573729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2cbcc0330 0x55e2cbce5ed0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.492+0000 7fa9c2299740 1 -- 172.21.15.50:0/2824573729 >> 172.21.15.50:0/2824573729 conn(0x55e2cbcbc8c0 msgr2=0x55e2cbcc6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.492+0000 7fa9c2299740 1 -- 172.21.15.50:0/2824573729 shutdown_connections 2024-09-10T10:11:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.492+0000 7fa9c2299740 1 -- 172.21.15.50:0/2824573729 wait complete. 2024-09-10T10:11:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.492+0000 7fa9c2299740 20 client.25358 trim_cache size 0 max 16384 2024-09-10T10:11:48.498 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:11:48.498 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "4d54e0f8-6f5b-11ef-bcea-c7b262605968", 2024-09-10T10:11:48.498 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-09-10T10:11:48.498 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24560, 2024-09-10T10:11:48.498 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-09-10T10:11:48.498 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-09-10T10:11:48.498 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-09-10T10:11:48.498 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 192.135709711, 2024-09-10T10:11:48.499 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 25, 2024-09-10T10:11:48.499 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 95, 2024-09-10T10:11:48.499 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 95, 2024-09-10T10:11:48.499 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 204.97439695 2024-09-10T10:11:48.499 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:11:48.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.493+0000 7fa9bf800640 1 -- 172.21.15.50:0/1480380883 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa9a00a2b80 msgr2=0x7fa9a00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.493+0000 7fa9bf800640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa9a00a2b80 0x7fa9a00a5040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000c00 tx=0x7fa9ac031510 comp rx=0 tx=0).stop 2024-09-10T10:11:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.493+0000 7fa9bf800640 1 -- 172.21.15.50:0/1480380883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b81049a0 msgr2=0x7fa9b819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:11:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.493+0000 7fa9bf800640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b81049a0 0x7fa9b819ab60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400ea60 tx=0x7fa9a400ef20 comp rx=0 tx=0).stop 2024-09-10T10:11:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.493+0000 7fa9bf800640 1 -- 172.21.15.50:0/1480380883 shutdown_connections 2024-09-10T10:11:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.493+0000 7fa9bf800640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa9a00a2b80 0x7fa9a00a5040 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.493+0000 7fa9bf800640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9b8109120 0x7fa9b819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.493+0000 7fa9bf800640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9b81049a0 0x7fa9b819ab60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.493+0000 7fa9bf800640 1 --2- 172.21.15.50:0/1480380883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa9b8103ff0 0x7fa9b819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:11:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.493+0000 7fa9bf800640 1 -- 172.21.15.50:0/1480380883 >> 172.21.15.50:0/1480380883 conn(0x7fa9b80ffa90 msgr2=0x7fa9b8100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:11:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.493+0000 7fa9bf800640 1 -- 172.21.15.50:0/1480380883 shutdown_connections 2024-09-10T10:11:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:11:48.493+0000 7fa9bf800640 1 -- 172.21.15.50:0/1480380883 wait complete. 2024-09-10T10:11:48.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:48 smithi050 ceph-mon[30354]: pgmap v409: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-10T10:11:48.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:48 smithi189 ceph-mon[34999]: pgmap v409: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-10T10:11:48.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:48 smithi084 ceph-mon[34812]: pgmap v409: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-10T10:11:49.246 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-10T10:11:50.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:50 smithi189 ceph-mon[34999]: pgmap v410: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-10T10:11:50.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:50 smithi084 ceph-mon[34812]: pgmap v410: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-10T10:11:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:50 smithi050 ceph-mon[30354]: pgmap v410: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-10T10:11:52.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:52 smithi189 ceph-mon[34999]: pgmap v411: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-10T10:11:52.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:52 smithi084 ceph-mon[34812]: pgmap v411: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-10T10:11:52.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:52 smithi050 ceph-mon[30354]: pgmap v411: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-10T10:11:54.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:54 smithi189 ceph-mon[34999]: pgmap v412: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-10T10:11:54.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:54 smithi084 ceph-mon[34812]: pgmap v412: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-10T10:11:54.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:54 smithi050 ceph-mon[30354]: pgmap v412: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-10T10:11:56.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:56 smithi189 ceph-mon[34999]: pgmap v413: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T10:11:56.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:56 smithi084 ceph-mon[34812]: pgmap v413: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T10:11:56.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:56 smithi050 ceph-mon[30354]: pgmap v413: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T10:11:58.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:11:58 smithi189 ceph-mon[34999]: pgmap v414: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-10T10:11:58.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:11:58 smithi084 ceph-mon[34812]: pgmap v414: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-10T10:11:58.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:11:58 smithi050 ceph-mon[30354]: pgmap v414: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-10T10:12:00.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:12:00.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:00 smithi189 ceph-mon[34999]: pgmap v415: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T10:12:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:00 smithi084 ceph-mon[34812]: pgmap v415: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T10:12:00.964 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:00 smithi050 ceph-mon[30354]: pgmap v415: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-10T10:12:00.983 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.579+0000 7fae49800640 1 -- 172.21.15.50:0/3693649852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae44102370 msgr2=0x7fae4410e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.579+0000 7fae49800640 1 --2- 172.21.15.50:0/3693649852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae44102370 0x7fae4410e8a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009930 tx=0x7fae3c02a420 comp rx=0 tx=0).stop 2024-09-10T10:12:01.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.579+0000 7fae49800640 1 -- 172.21.15.50:0/3693649852 shutdown_connections 2024-09-10T10:12:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.580+0000 7fae49800640 1 --2- 172.21.15.50:0/3693649852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae44102370 0x7fae4410e8a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.580+0000 7fae49800640 1 --2- 172.21.15.50:0/3693649852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae441019d0 0x7fae44101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.580+0000 7fae49800640 1 --2- 172.21.15.50:0/3693649852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae441079d0 0x7fae44107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.580+0000 7fae49800640 1 -- 172.21.15.50:0/3693649852 >> 172.21.15.50:0/3693649852 conn(0x7fae440fd710 msgr2=0x7fae440ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.580+0000 7fae49800640 1 -- 172.21.15.50:0/3693649852 shutdown_connections 2024-09-10T10:12:01.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.580+0000 7fae49800640 1 -- 172.21.15.50:0/3693649852 wait complete. 2024-09-10T10:12:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.581+0000 7fae49800640 1 Processor -- start 2024-09-10T10:12:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.581+0000 7fae49800640 1 -- start start 2024-09-10T10:12:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae49800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae441019d0 0x7fae4419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae49800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae44102370 0x7fae4419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae49800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae441079d0 0x7fae4419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae49800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fae44111dd0 con 0x7fae441079d0 2024-09-10T10:12:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae49800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fae44111c50 con 0x7fae441019d0 2024-09-10T10:12:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae49800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fae44111f50 con 0x7fae44102370 2024-09-10T10:12:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae43e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae441019d0 0x7fae4419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae48e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae441079d0 0x7fae4419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae43e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae441019d0 0x7fae4419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:36516/0 (socket says 172.21.15.50:36516) 2024-09-10T10:12:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae43e00640 1 -- 172.21.15.50:0/3116544703 learned_addr learned my addr 172.21.15.50:0/3116544703 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:01.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae3b400640 1 --2- 172.21.15.50:0/3116544703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae44102370 0x7fae4419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae43e00640 1 -- 172.21.15.50:0/3116544703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae44102370 msgr2=0x7fae4419a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:01.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae43e00640 1 --2- 172.21.15.50:0/3116544703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae44102370 0x7fae4419a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae43e00640 1 -- 172.21.15.50:0/3116544703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae441079d0 msgr2=0x7fae4419ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:01.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae43e00640 1 --2- 172.21.15.50:0/3116544703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae441079d0 0x7fae4419ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.582+0000 7fae43e00640 1 -- 172.21.15.50:0/3116544703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4419f410 con 0x7fae441019d0 2024-09-10T10:12:01.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.583+0000 7fae43e00640 1 --2- 172.21.15.50:0/3116544703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae441019d0 0x7fae4419a460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fae3400eb90 tx=0x7fae3400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:01.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.583+0000 7fae41600640 1 -- 172.21.15.50:0/3116544703 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34004d20 con 0x7fae441019d0 2024-09-10T10:12:01.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.583+0000 7fae49800640 1 -- 172.21.15.50:0/3116544703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae4419f700 con 0x7fae441019d0 2024-09-10T10:12:01.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.583+0000 7fae41600640 1 -- 172.21.15.50:0/3116544703 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae3400ee90 con 0x7fae441019d0 2024-09-10T10:12:01.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.583+0000 7fae41600640 1 -- 172.21.15.50:0/3116544703 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34010830 con 0x7fae441019d0 2024-09-10T10:12:01.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.583+0000 7fae49800640 1 -- 172.21.15.50:0/3116544703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae441a6fe0 con 0x7fae441019d0 2024-09-10T10:12:01.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.586+0000 7fae41600640 1 -- 172.21.15.50:0/3116544703 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fae34005020 con 0x7fae441019d0 2024-09-10T10:12:01.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.586+0000 7fae4d83c740 1 Processor -- start 2024-09-10T10:12:01.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.587+0000 7fae4d83c740 1 -- start start 2024-09-10T10:12:01.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.587+0000 7fae4d83c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981ad50 0x563a0981b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.587+0000 7fae4d83c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0981b670 0x563a098259f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.587+0000 7fae4d83c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a09825f30 0x563a09828320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.587+0000 7fae4d83c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563a097813e0 con 0x563a09825f30 2024-09-10T10:12:01.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.587+0000 7fae4d83c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563a09728d80 con 0x563a0981ad50 2024-09-10T10:12:01.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.587+0000 7fae4d83c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563a0977d3a0 con 0x563a0981b670 2024-09-10T10:12:01.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.587+0000 7fae3b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a09825f30 0x563a09828320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.587+0000 7fae43e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0981b670 0x563a098259f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.587+0000 7fae48e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981ad50 0x563a0981b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.587+0000 7fae3b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a09825f30 0x563a09828320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41384/0 (socket says 172.21.15.50:41384) 2024-09-10T10:12:01.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.588+0000 7fae3b400640 1 -- 172.21.15.50:0/3731285929 learned_addr learned my addr 172.21.15.50:0/3731285929 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:01.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.588+0000 7fae41600640 1 --2- 172.21.15.50:0/3116544703 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fae280a2b80 0x7fae280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.588+0000 7fae41600640 1 -- 172.21.15.50:0/3116544703 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fae340cf9f0 con 0x7fae441019d0 2024-09-10T10:12:01.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.588+0000 7fae43e00640 1 -- 172.21.15.50:0/3731285929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981ad50 msgr2=0x563a0981b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:01.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.588+0000 7fae43e00640 1 --2- 172.21.15.50:0/3731285929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981ad50 0x563a0981b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.588+0000 7fae43e00640 1 -- 172.21.15.50:0/3731285929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a09825f30 msgr2=0x563a09828320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:01.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.588+0000 7fae48e00640 1 --2- 172.21.15.50:0/3116544703 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fae280a2b80 0x7fae280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.588+0000 7fae43e00640 1 --2- 172.21.15.50:0/3731285929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a09825f30 0x563a09828320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.588+0000 7fae43e00640 1 -- 172.21.15.50:0/3731285929 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a09747ae0 con 0x563a0981b670 2024-09-10T10:12:01.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.588+0000 7fae3b400640 1 --2- 172.21.15.50:0/3731285929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a09825f30 0x563a09828320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:01.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.589+0000 7fae43e00640 1 --2- 172.21.15.50:0/3731285929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0981b670 0x563a098259f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fae340cd0d0 tx=0x7fae3400cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e2be9a6b1425fe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:01.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.589+0000 7fae48e00640 1 --2- 172.21.15.50:0/3116544703 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fae280a2b80 0x7fae280a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fae3c006010 tx=0x7fae3c02a420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:01.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.589+0000 7fae39600640 1 -- 172.21.15.50:0/3731285929 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3409bc30 con 0x563a0981b670 2024-09-10T10:12:01.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.589+0000 7fae39600640 1 -- 172.21.15.50:0/3731285929 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae3409c560 con 0x563a0981b670 2024-09-10T10:12:01.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.589+0000 7fae39600640 1 -- 172.21.15.50:0/3731285929 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3409b7c0 con 0x563a0981b670 2024-09-10T10:12:01.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.590+0000 7fae4d83c740 1 -- 172.21.15.50:0/3731285929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0981b670 msgr2=0x563a098259f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:01.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.590+0000 7fae4d83c740 1 --2- 172.21.15.50:0/3731285929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0981b670 0x563a098259f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fae340cd0d0 tx=0x7fae3400cf90 comp rx=0 tx=0).stop 2024-09-10T10:12:01.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.590+0000 7fae4d83c740 1 -- 172.21.15.50:0/3731285929 shutdown_connections 2024-09-10T10:12:01.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.590+0000 7fae4d83c740 1 --2- 172.21.15.50:0/3731285929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a09825f30 0x563a09828320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.590+0000 7fae4d83c740 1 --2- 172.21.15.50:0/3731285929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a0981b670 0x563a098259f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.590+0000 7fae4d83c740 1 --2- 172.21.15.50:0/3731285929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981ad50 0x563a0981b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.590+0000 7fae4d83c740 1 -- 172.21.15.50:0/3731285929 >> 172.21.15.50:0/3731285929 conn(0x563a098172e0 msgr2=0x563a098176c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:01.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.590+0000 7fae4d83c740 1 -- 172.21.15.50:0/3731285929 shutdown_connections 2024-09-10T10:12:01.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.590+0000 7fae4d83c740 1 -- 172.21.15.50:0/3731285929 wait complete. 2024-09-10T10:12:01.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.591+0000 7fae4d83c740 1 -- start start 2024-09-10T10:12:01.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.591+0000 7fae4d83c740 1 Processor -- start 2024-09-10T10:12:01.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.591+0000 7fae4d83c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981ad50 0x563a09822db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae4d83c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981b670 0x563a098232f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae4d83c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 0x563a09823830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae4d83c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563a09828ba0 con 0x563a0981ad50 2024-09-10T10:12:01.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae4d83c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563a0973c0f0 con 0x563a0981b670 2024-09-10T10:12:01.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae4d83c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563a09828d20 con 0x563a09825f30 2024-09-10T10:12:01.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae4d83c740 10 client.0 _ll_register_callbacks cb 0x563a0972d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:01.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae43e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981ad50 0x563a09822db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae43e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981ad50 0x563a09822db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41396/0 (socket says 172.21.15.50:41396) 2024-09-10T10:12:01.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae43e00640 1 -- 172.21.15.50:0/3304969395 learned_addr learned my addr 172.21.15.50:0/3304969395 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:01.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae48e00640 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 0x563a09823830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae3b400640 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981b670 0x563a098232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae43e00640 1 -- 172.21.15.50:0/3304969395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 msgr2=0x563a09823830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:01.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae43e00640 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 0x563a09823830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae43e00640 1 -- 172.21.15.50:0/3304969395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981b670 msgr2=0x563a098232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:01.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae43e00640 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981b670 0x563a098232f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae43e00640 1 -- 172.21.15.50:0/3304969395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a094f23c0 con 0x563a0981ad50 2024-09-10T10:12:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.592+0000 7fae3b400640 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981b670 0x563a098232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:12:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.593+0000 7fae43e00640 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981ad50 0x563a09822db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fae340cfce0 tx=0x7fae340d5380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5719b595d55b9f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.593+0000 7fae32000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:12:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.593+0000 7fae32000640 1 -- 172.21.15.50:0/3304969395 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3409b9a0 con 0x563a0981ad50 2024-09-10T10:12:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.593+0000 7fae32000640 1 -- 172.21.15.50:0/3304969395 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fae34005590 con 0x563a0981ad50 2024-09-10T10:12:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.593+0000 7fae4d83c740 1 -- 172.21.15.50:0/3304969395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae3409c560 con 0x563a0981ad50 2024-09-10T10:12:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.593+0000 7fae32000640 1 -- 172.21.15.50:0/3304969395 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fae3409bc30 con 0x563a0981ad50 2024-09-10T10:12:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.593+0000 7fae4d83c740 10 client.15321 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.593+0000 7fae4d83c740 1 -- 172.21.15.50:0/3304969395 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563a09834810 con 0x563a0981ad50 2024-09-10T10:12:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.594+0000 7fae32000640 1 -- 172.21.15.50:0/3304969395 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae3409c560 con 0x563a0981ad50 2024-09-10T10:12:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.594+0000 7fae32000640 1 -- 172.21.15.50:0/3304969395 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fae3409ad20 con 0x563a0981ad50 2024-09-10T10:12:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.594+0000 7fae4d83c740 10 client.15321 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:01.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.594+0000 7fae4d83c740 10 client.15321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:12:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.594+0000 7fae4d83c740 20 client.15321 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.594+0000 7fae4d83c740 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a09835b60 0x563a09837f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.594+0000 7fae4d83c740 4 client.15321 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:12:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.594+0000 7fae4d83c740 1 -- 172.21.15.50:0/3304969395 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a0978e950 con 0x563a09835b60 2024-09-10T10:12:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.594+0000 7fae3b400640 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a09835b60 0x563a09837f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.595+0000 7fae3b400640 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a09835b60 0x563a09837f50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=154af4000286df7e server_cookie=33935d7f5171fd8f in_seq=0 out_seq=0 2024-09-10T10:12:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.595+0000 7fae32000640 10 client.15321 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.596+0000 7fae32000640 1 -- 172.21.15.50:0/3304969395 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a0978e950 con 0x563a09835b60 2024-09-10T10:12:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.596+0000 7fae32000640 10 client.15321 handle_command_reply: tid=0 2024-09-10T10:12:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.596+0000 7fae4d83c740 1 client.15321 shutdown 2024-09-10T10:12:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.596+0000 7fae4d83c740 1 -- 172.21.15.50:0/3304969395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981ad50 msgr2=0x563a09822db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:01.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.596+0000 7fae4d83c740 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981ad50 0x563a09822db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fae340cfce0 tx=0x7fae340d5380 comp rx=0 tx=0).stop 2024-09-10T10:12:01.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.596+0000 7fae4d83c740 1 -- 172.21.15.50:0/3304969395 shutdown_connections 2024-09-10T10:12:01.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.596+0000 7fae4d83c740 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a09835b60 0x563a09837f50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.596+0000 7fae4d83c740 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 0x563a09823830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.596+0000 7fae4d83c740 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981b670 0x563a098232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.596+0000 7fae4d83c740 1 --2- 172.21.15.50:0/3304969395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981ad50 0x563a09822db0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.596+0000 7fae4d83c740 1 -- 172.21.15.50:0/3304969395 >> 172.21.15.50:0/3304969395 conn(0x563a098172e0 msgr2=0x563a0981cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:01.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.596+0000 7fae32000640 0 client.15321 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:01.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.596+0000 7fae4d83c740 1 -- 172.21.15.50:0/3304969395 shutdown_connections 2024-09-10T10:12:01.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.597+0000 7fae4d83c740 1 -- 172.21.15.50:0/3304969395 wait complete. 2024-09-10T10:12:01.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.597+0000 7fae4d83c740 20 client.15321 trim_cache size 0 max 16384 2024-09-10T10:12:01.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.615+0000 7fae4d83c740 1 Processor -- start 2024-09-10T10:12:01.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.615+0000 7fae4d83c740 1 -- start start 2024-09-10T10:12:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.615+0000 7fae4d83c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981ad50 0x563a09812060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.615+0000 7fae4d83c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981b670 0x563a0983ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.615+0000 7fae4d83c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 0x563a0983b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.615+0000 7fae4d83c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fae441b3670 con 0x563a0981b670 2024-09-10T10:12:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.615+0000 7fae4d83c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fae441b0f40 con 0x563a0981ad50 2024-09-10T10:12:01.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.615+0000 7fae4d83c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fae441aed90 con 0x563a09825f30 2024-09-10T10:12:01.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.616+0000 7fae43e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981ad50 0x563a09812060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.616+0000 7fae3b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981b670 0x563a0983ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.616+0000 7fae43e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981ad50 0x563a09812060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:36544/0 (socket says 172.21.15.50:36544) 2024-09-10T10:12:01.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.616+0000 7fae43e00640 1 -- 172.21.15.50:0/2619112304 learned_addr learned my addr 172.21.15.50:0/2619112304 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:01.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.616+0000 7fae48e00640 1 --2- 172.21.15.50:0/2619112304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 0x563a0983b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.616+0000 7fae43e00640 1 -- 172.21.15.50:0/2619112304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 msgr2=0x563a0983b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:01.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.616+0000 7fae43e00640 1 --2- 172.21.15.50:0/2619112304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 0x563a0983b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.616+0000 7fae43e00640 1 -- 172.21.15.50:0/2619112304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981b670 msgr2=0x563a0983ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:01.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.616+0000 7fae43e00640 1 --2- 172.21.15.50:0/2619112304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981b670 0x563a0983ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.616+0000 7fae43e00640 1 -- 172.21.15.50:0/2619112304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a0981aad0 con 0x563a0981ad50 2024-09-10T10:12:01.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.616+0000 7fae43e00640 1 --2- 172.21.15.50:0/2619112304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981ad50 0x563a09812060 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae3409a110 tx=0x7fae340cfc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e55b9886ab8aa7c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.617+0000 7fae38c00640 1 -- 172.21.15.50:0/2619112304 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3409b9a0 con 0x563a0981ad50 2024-09-10T10:12:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.617+0000 7fae38c00640 1 -- 172.21.15.50:0/2619112304 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae3409c560 con 0x563a0981ad50 2024-09-10T10:12:01.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.617+0000 7fae38c00640 1 -- 172.21.15.50:0/2619112304 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae340984d0 con 0x563a0981ad50 2024-09-10T10:12:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.618+0000 7fae4d83c740 1 -- 172.21.15.50:0/2619112304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981ad50 msgr2=0x563a09812060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.618+0000 7fae4d83c740 1 --2- 172.21.15.50:0/2619112304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981ad50 0x563a09812060 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae3409a110 tx=0x7fae340cfc70 comp rx=0 tx=0).stop 2024-09-10T10:12:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.618+0000 7fae4d83c740 1 -- 172.21.15.50:0/2619112304 shutdown_connections 2024-09-10T10:12:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.618+0000 7fae4d83c740 1 --2- 172.21.15.50:0/2619112304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 0x563a0983b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.618+0000 7fae4d83c740 1 --2- 172.21.15.50:0/2619112304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981b670 0x563a0983ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.618+0000 7fae4d83c740 1 --2- 172.21.15.50:0/2619112304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981ad50 0x563a09812060 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.618+0000 7fae4d83c740 1 -- 172.21.15.50:0/2619112304 >> 172.21.15.50:0/2619112304 conn(0x563a098172e0 msgr2=0x563a0981cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.618+0000 7fae4d83c740 1 -- 172.21.15.50:0/2619112304 shutdown_connections 2024-09-10T10:12:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.618+0000 7fae4d83c740 1 -- 172.21.15.50:0/2619112304 wait complete. 2024-09-10T10:12:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.618+0000 7fae4d83c740 1 -- start start 2024-09-10T10:12:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.619+0000 7fae4d83c740 1 Processor -- start 2024-09-10T10:12:01.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.619+0000 7fae4d83c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981ad50 0x563a09838150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.619+0000 7fae4d83c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981b670 0x563a09838690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.619+0000 7fae4d83c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 0x563a09898460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.619+0000 7fae4d83c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fae441af400 con 0x563a0981ad50 2024-09-10T10:12:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.619+0000 7fae4d83c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fae441b0870 con 0x563a0981b670 2024-09-10T10:12:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.619+0000 7fae4d83c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fae441afad0 con 0x563a09825f30 2024-09-10T10:12:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.619+0000 7fae4d83c740 10 client.0 _ll_register_callbacks cb 0x7fae340093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.619+0000 7fae3b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981b670 0x563a09838690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.619+0000 7fae3b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981b670 0x563a09838690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:36558/0 (socket says 172.21.15.50:36558) 2024-09-10T10:12:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.619+0000 7fae43e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981ad50 0x563a09838150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.619+0000 7fae3b400640 1 -- 172.21.15.50:0/609999680 learned_addr learned my addr 172.21.15.50:0/609999680 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.619+0000 7fae48e00640 1 --2- 172.21.15.50:0/609999680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 0x563a09898460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.620+0000 7fae3b400640 1 -- 172.21.15.50:0/609999680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 msgr2=0x563a09898460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.620+0000 7fae3b400640 1 --2- 172.21.15.50:0/609999680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 0x563a09898460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.620+0000 7fae3b400640 1 -- 172.21.15.50:0/609999680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981ad50 msgr2=0x563a09838150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:01.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.620+0000 7fae3b400640 1 --2- 172.21.15.50:0/609999680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981ad50 0x563a09838150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.620+0000 7fae3b400640 1 -- 172.21.15.50:0/609999680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a09898a50 con 0x563a0981b670 2024-09-10T10:12:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.620+0000 7fae3b400640 1 --2- 172.21.15.50:0/609999680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981b670 0x563a09838690 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0058c0 tx=0x7fae2c010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b5a43b8b8bfac99 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.620+0000 7fae32000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:12:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.620+0000 7fae32000640 1 -- 172.21.15.50:0/609999680 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2c004220 con 0x563a0981b670 2024-09-10T10:12:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.621+0000 7fae4d83c740 1 -- 172.21.15.50:0/609999680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae3409c560 con 0x563a0981b670 2024-09-10T10:12:01.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.621+0000 7fae32000640 1 -- 172.21.15.50:0/609999680 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fae2c0043c0 con 0x563a0981b670 2024-09-10T10:12:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.621+0000 7fae32000640 1 -- 172.21.15.50:0/609999680 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fae2c02e050 con 0x563a0981b670 2024-09-10T10:12:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.621+0000 7fae4d83c740 10 client.25376 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.621+0000 7fae4d83c740 1 -- 172.21.15.50:0/609999680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563a0989fec0 con 0x563a0981b670 2024-09-10T10:12:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.621+0000 7fae32000640 1 -- 172.21.15.50:0/609999680 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae3409c560 con 0x563a0981b670 2024-09-10T10:12:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.621+0000 7fae32000640 1 -- 172.21.15.50:0/609999680 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fae2c003a10 con 0x563a0981b670 2024-09-10T10:12:01.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.621+0000 7fae4d83c740 10 client.25376 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.621+0000 7fae4d83c740 10 client.25376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:12:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.621+0000 7fae4d83c740 20 client.25376 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.622+0000 7fae4d83c740 1 --2- 172.21.15.50:0/609999680 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a098a0620 0x563a098a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.622+0000 7fae4d83c740 4 client.25376 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:12:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.622+0000 7fae4d83c740 1 -- 172.21.15.50:0/609999680 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563a09788e60 con 0x563a098a0620 2024-09-10T10:12:01.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.622+0000 7fae43e00640 1 --2- 172.21.15.50:0/609999680 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a098a0620 0x563a098a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae43e00640 1 --2- 172.21.15.50:0/609999680 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a098a0620 0x563a098a2a40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44f6b70e2efe6162 server_cookie=e890a05b3be0abfe in_seq=0 out_seq=0 2024-09-10T10:12:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae32000640 10 client.25376 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae32000640 1 -- 172.21.15.50:0/609999680 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563a09788e60 con 0x563a098a0620 2024-09-10T10:12:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae32000640 10 client.25376 handle_command_reply: tid=0 2024-09-10T10:12:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae4d83c740 1 client.25376 shutdown 2024-09-10T10:12:01.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae4d83c740 1 -- 172.21.15.50:0/609999680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981b670 msgr2=0x563a09838690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae4d83c740 1 --2- 172.21.15.50:0/609999680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981b670 0x563a09838690 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0058c0 tx=0x7fae2c010800 comp rx=0 tx=0).stop 2024-09-10T10:12:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae4d83c740 1 -- 172.21.15.50:0/609999680 shutdown_connections 2024-09-10T10:12:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae4d83c740 1 --2- 172.21.15.50:0/609999680 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a098a0620 0x563a098a2a40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae4d83c740 1 --2- 172.21.15.50:0/609999680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a09825f30 0x563a09898460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae4d83c740 1 --2- 172.21.15.50:0/609999680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a0981b670 0x563a09838690 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae4d83c740 1 --2- 172.21.15.50:0/609999680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a0981ad50 0x563a09838150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae4d83c740 1 -- 172.21.15.50:0/609999680 >> 172.21.15.50:0/609999680 conn(0x563a098172e0 msgr2=0x563a09821680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae32000640 0 client.25376 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae4d83c740 1 -- 172.21.15.50:0/609999680 shutdown_connections 2024-09-10T10:12:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.623+0000 7fae4d83c740 1 -- 172.21.15.50:0/609999680 wait complete. 2024-09-10T10:12:01.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.624+0000 7fae4d83c740 20 client.25376 trim_cache size 0 max 16384 2024-09-10T10:12:01.637 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:12:01.637 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-10T10:12:01.637 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-10T10:12:01.637 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:12:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.624+0000 7fae49800640 1 -- 172.21.15.50:0/3116544703 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fae280a2b80 msgr2=0x7fae280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.624+0000 7fae49800640 1 --2- 172.21.15.50:0/3116544703 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fae280a2b80 0x7fae280a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fae3c006010 tx=0x7fae3c02a420 comp rx=0 tx=0).stop 2024-09-10T10:12:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.624+0000 7fae49800640 1 -- 172.21.15.50:0/3116544703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae441019d0 msgr2=0x7fae4419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.624+0000 7fae49800640 1 --2- 172.21.15.50:0/3116544703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae441019d0 0x7fae4419a460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fae3400eb90 tx=0x7fae3400c6a0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.624+0000 7fae49800640 1 -- 172.21.15.50:0/3116544703 shutdown_connections 2024-09-10T10:12:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.624+0000 7fae49800640 1 --2- 172.21.15.50:0/3116544703 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fae280a2b80 0x7fae280a5040 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.624+0000 7fae49800640 1 --2- 172.21.15.50:0/3116544703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae441079d0 0x7fae4419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.624+0000 7fae49800640 1 --2- 172.21.15.50:0/3116544703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fae44102370 0x7fae4419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.624+0000 7fae49800640 1 --2- 172.21.15.50:0/3116544703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae441019d0 0x7fae4419a460 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:01.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.625+0000 7fae49800640 1 -- 172.21.15.50:0/3116544703 >> 172.21.15.50:0/3116544703 conn(0x7fae440fd710 msgr2=0x7fae4410d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.625+0000 7fae49800640 1 -- 172.21.15.50:0/3116544703 shutdown_connections 2024-09-10T10:12:01.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:01.625+0000 7fae49800640 1 -- 172.21.15.50:0/3116544703 wait complete. 2024-09-10T10:12:02.407 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T10:12:02.407 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:12:02.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:02 smithi050 ceph-mon[30354]: pgmap v416: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:12:02.799 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:02.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:02 smithi189 ceph-mon[34999]: pgmap v416: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:12:02.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:02 smithi084 ceph-mon[34812]: pgmap v416: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:12:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.412+0000 7f582f200640 1 -- 172.21.15.50:0/84618874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5830077040 msgr2=0x7f5830112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.412+0000 7f582f200640 1 --2- 172.21.15.50:0/84618874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5830077040 0x7f5830112330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f581c009900 tx=0x7f581c02a410 comp rx=0 tx=0).stop 2024-09-10T10:12:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.412+0000 7f582f200640 1 -- 172.21.15.50:0/84618874 shutdown_connections 2024-09-10T10:12:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.412+0000 7f582f200640 1 --2- 172.21.15.50:0/84618874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5830112870 0x7f5830114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.412+0000 7f582f200640 1 --2- 172.21.15.50:0/84618874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5830077040 0x7f5830112330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:03.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.412+0000 7f582f200640 1 --2- 172.21.15.50:0/84618874 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5830076720 0x7f5830076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.412+0000 7f582f200640 1 -- 172.21.15.50:0/84618874 >> 172.21.15.50:0/84618874 conn(0x7f58300ff910 msgr2=0x7f5830101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.413+0000 7f582f200640 1 -- 172.21.15.50:0/84618874 shutdown_connections 2024-09-10T10:12:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.413+0000 7f582f200640 1 -- 172.21.15.50:0/84618874 wait complete. 2024-09-10T10:12:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.414+0000 7f582f200640 1 Processor -- start 2024-09-10T10:12:03.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.414+0000 7f582f200640 1 -- start start 2024-09-10T10:12:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.414+0000 7f582f200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5830076720 0x7f58301a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.414+0000 7f582f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5830077040 0x7f58301a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:03.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.414+0000 7f582f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5830112870 0x7f583019e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.414+0000 7f582f200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5830118450 con 0x7f5830076720 2024-09-10T10:12:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.414+0000 7f582f200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f58301182d0 con 0x7f5830077040 2024-09-10T10:12:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.414+0000 7f582f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f58301185d0 con 0x7f5830112870 2024-09-10T10:12:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.415+0000 7f582de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5830076720 0x7f58301a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.415+0000 7f582de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5830076720 0x7f58301a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41428/0 (socket says 172.21.15.50:41428) 2024-09-10T10:12:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.415+0000 7f582de00640 1 -- 172.21.15.50:0/2236261223 learned_addr learned my addr 172.21.15.50:0/2236261223 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.415+0000 7f582d400640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5830077040 0x7f58301a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.415+0000 7f582e800640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5830112870 0x7f583019e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.415+0000 7f582de00640 1 -- 172.21.15.50:0/2236261223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5830112870 msgr2=0x7f583019e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.415+0000 7f582de00640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5830112870 0x7f583019e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.415+0000 7f582de00640 1 -- 172.21.15.50:0/2236261223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5830077040 msgr2=0x7f58301a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.415+0000 7f582de00640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5830077040 0x7f58301a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:03.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.415+0000 7f582de00640 1 -- 172.21.15.50:0/2236261223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f583019ef60 con 0x7f5830076720 2024-09-10T10:12:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.416+0000 7f582de00640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5830076720 0x7f58301a4640 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f582000e9f0 tx=0x7f582000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.416+0000 7f5826a00640 1 -- 172.21.15.50:0/2236261223 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582000cd80 con 0x7f5830076720 2024-09-10T10:12:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.416+0000 7f5826a00640 1 -- 172.21.15.50:0/2236261223 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5820005500 con 0x7f5830076720 2024-09-10T10:12:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.416+0000 7f582f200640 1 -- 172.21.15.50:0/2236261223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f583019f250 con 0x7f5830076720 2024-09-10T10:12:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.416+0000 7f5826a00640 1 -- 172.21.15.50:0/2236261223 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820010690 con 0x7f5830076720 2024-09-10T10:12:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.416+0000 7f582f200640 1 -- 172.21.15.50:0/2236261223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58301ab4a0 con 0x7f5830076720 2024-09-10T10:12:03.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.418+0000 7f582f200640 1 -- 172.21.15.50:0/2236261223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5830077e60 con 0x7f5830076720 2024-09-10T10:12:03.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.419+0000 7f5826a00640 1 -- 172.21.15.50:0/2236261223 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f58200046c0 con 0x7f5830076720 2024-09-10T10:12:03.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.421+0000 7f5826a00640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f58140a2c00 0x7f58140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:03.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.422+0000 7f5826a00640 1 -- 172.21.15.50:0/2236261223 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f58200cf7b0 con 0x7f5830076720 2024-09-10T10:12:03.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.422+0000 7f582d400640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f58140a2c00 0x7f58140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:03.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.422+0000 7f582d400640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f58140a2c00 0x7f58140a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f581c000c00 tx=0x7f581c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:03.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.426+0000 7f5826a00640 1 -- 172.21.15.50:0/2236261223 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f582009c320 con 0x7f5830076720 2024-09-10T10:12:03.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.721+0000 7f582f200640 1 -- 172.21.15.50:0/2236261223 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f583010da00 con 0x7f5830076720 2024-09-10T10:12:03.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.722+0000 7f5826a00640 1 -- 172.21.15.50:0/2236261223 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f5820086020 con 0x7f5830076720 2024-09-10T10:12:03.723 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:12:03.724 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:12:03.724 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:12:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.724+0000 7f582f200640 1 -- 172.21.15.50:0/2236261223 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f58140a2c00 msgr2=0x7f58140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.724+0000 7f582f200640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f58140a2c00 0x7f58140a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f581c000c00 tx=0x7f581c005b50 comp rx=0 tx=0).stop 2024-09-10T10:12:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.724+0000 7f582f200640 1 -- 172.21.15.50:0/2236261223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5830076720 msgr2=0x7f58301a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.724+0000 7f582f200640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5830076720 0x7f58301a4640 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f582000e9f0 tx=0x7f582000edf0 comp rx=0 tx=0).stop 2024-09-10T10:12:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.724+0000 7f582f200640 1 -- 172.21.15.50:0/2236261223 shutdown_connections 2024-09-10T10:12:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.724+0000 7f582f200640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f58140a2c00 0x7f58140a50c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.724+0000 7f582f200640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5830112870 0x7f583019e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.724+0000 7f582f200640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5830077040 0x7f58301a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.724+0000 7f582f200640 1 --2- 172.21.15.50:0/2236261223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5830076720 0x7f58301a4640 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.724+0000 7f582f200640 1 -- 172.21.15.50:0/2236261223 >> 172.21.15.50:0/2236261223 conn(0x7f58300ff910 msgr2=0x7f5830101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:03.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.725+0000 7f582f200640 1 -- 172.21.15.50:0/2236261223 shutdown_connections 2024-09-10T10:12:03.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:03.725+0000 7f582f200640 1 -- 172.21.15.50:0/2236261223 wait complete. 2024-09-10T10:12:04.246 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-10T10:12:04.247 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-10T10:12:04.247 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:12:04.465 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T10:12:04.708 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:04.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:04 smithi050 ceph-mon[30354]: pgmap v417: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:12:04.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:04 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2236261223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:04.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:04 smithi189 ceph-mon[34999]: pgmap v417: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:12:04.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:04 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2236261223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:04.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:04 smithi084 ceph-mon[34812]: pgmap v417: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:12:04.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:04 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2236261223' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.447+0000 7f6e51a00640 1 -- 172.21.15.50:0/447981750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e4c1129e0 msgr2=0x7f6e4c114dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.447+0000 7f6e51a00640 1 --2- 172.21.15.50:0/447981750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e4c1129e0 0x7f6e4c114dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009be0 tx=0x7f6e4402a750 comp rx=0 tx=0).stop 2024-09-10T10:12:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.448+0000 7f6e51a00640 1 -- 172.21.15.50:0/447981750 shutdown_connections 2024-09-10T10:12:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.448+0000 7f6e51a00640 1 --2- 172.21.15.50:0/447981750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e4c1129e0 0x7f6e4c114dd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.448+0000 7f6e51a00640 1 --2- 172.21.15.50:0/447981750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e4c074eb0 0x7f6e4c1124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.448+0000 7f6e51a00640 1 --2- 172.21.15.50:0/447981750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c074590 0x7f6e4c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.448+0000 7f6e51a00640 1 -- 172.21.15.50:0/447981750 >> 172.21.15.50:0/447981750 conn(0x7f6e4c0fd710 msgr2=0x7f6e4c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.448+0000 7f6e51a00640 1 -- 172.21.15.50:0/447981750 shutdown_connections 2024-09-10T10:12:05.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.448+0000 7f6e51a00640 1 -- 172.21.15.50:0/447981750 wait complete. 2024-09-10T10:12:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.449+0000 7f6e51a00640 1 Processor -- start 2024-09-10T10:12:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.449+0000 7f6e51a00640 1 -- start start 2024-09-10T10:12:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.449+0000 7f6e51a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e4c074590 0x7f6e4c1a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e51a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c074eb0 0x7f6e4c1a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e51a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e4c1129e0 0x7f6e4c19e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e51a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c118350 con 0x7f6e4c074eb0 2024-09-10T10:12:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e51a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c1181d0 con 0x7f6e4c1129e0 2024-09-10T10:12:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e51a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c1184d0 con 0x7f6e4c074590 2024-09-10T10:12:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e4b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c074eb0 0x7f6e4c1a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e51000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e4c1129e0 0x7f6e4c19e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e4b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c074eb0 0x7f6e4c1a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41440/0 (socket says 172.21.15.50:41440) 2024-09-10T10:12:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e51000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e4c1129e0 0x7f6e4c19e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:36608/0 (socket says 172.21.15.50:36608) 2024-09-10T10:12:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e4b400640 1 -- 172.21.15.50:0/27085992 learned_addr learned my addr 172.21.15.50:0/27085992 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e4b400640 1 -- 172.21.15.50:0/27085992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e4c074590 msgr2=0x7f6e4c1a4620 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T10:12:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e4b400640 1 --2- 172.21.15.50:0/27085992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e4c074590 0x7f6e4c1a4620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e4b400640 1 -- 172.21.15.50:0/27085992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e4c1129e0 msgr2=0x7f6e4c19e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e4b400640 1 --2- 172.21.15.50:0/27085992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e4c1129e0 0x7f6e4c19e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.450+0000 7f6e4b400640 1 -- 172.21.15.50:0/27085992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4c19ef60 con 0x7f6e4c074eb0 2024-09-10T10:12:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.451+0000 7f6e4b400640 1 --2- 172.21.15.50:0/27085992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c074eb0 0x7f6e4c1a4b60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800ea60 tx=0x7f6e3800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.451+0000 7f6e48c00640 1 -- 172.21.15.50:0/27085992 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3800cde0 con 0x7f6e4c074eb0 2024-09-10T10:12:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.451+0000 7f6e51a00640 1 -- 172.21.15.50:0/27085992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e4c19f250 con 0x7f6e4c074eb0 2024-09-10T10:12:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.451+0000 7f6e48c00640 1 -- 172.21.15.50:0/27085992 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e380035f0 con 0x7f6e4c074eb0 2024-09-10T10:12:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.451+0000 7f6e48c00640 1 -- 172.21.15.50:0/27085992 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e38010720 con 0x7f6e4c074eb0 2024-09-10T10:12:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.451+0000 7f6e51a00640 1 -- 172.21.15.50:0/27085992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e4c1ab5a0 con 0x7f6e4c074eb0 2024-09-10T10:12:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.453+0000 7f6e51a00640 1 -- 172.21.15.50:0/27085992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e4c075cd0 con 0x7f6e4c074eb0 2024-09-10T10:12:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.456+0000 7f6e48c00640 1 -- 172.21.15.50:0/27085992 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6e38003b30 con 0x7f6e4c074eb0 2024-09-10T10:12:05.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.458+0000 7f6e48c00640 1 --2- 172.21.15.50:0/27085992 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e300a2c80 0x7f6e300a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.459+0000 7f6e48c00640 1 -- 172.21.15.50:0/27085992 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f6e380cf670 con 0x7f6e4c074eb0 2024-09-10T10:12:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.459+0000 7f6e4be00640 1 --2- 172.21.15.50:0/27085992 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e300a2c80 0x7f6e300a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.460+0000 7f6e4be00640 1 --2- 172.21.15.50:0/27085992 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e300a2c80 0x7f6e300a5140 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c005fd0 tx=0x7f6e3c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:05.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.462+0000 7f6e48c00640 1 -- 172.21.15.50:0/27085992 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e3809c1e0 con 0x7f6e4c074eb0 2024-09-10T10:12:05.502 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:05.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.709+0000 7f6e51a00640 1 -- 172.21.15.50:0/27085992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e4c104e20 con 0x7f6e4c074eb0 2024-09-10T10:12:05.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.710+0000 7f6e48c00640 1 -- 172.21.15.50:0/27085992 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f6e3809bae0 con 0x7f6e4c074eb0 2024-09-10T10:12:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:12:05.712 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:12:05.712 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:12:05.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.713+0000 7f6e51a00640 1 -- 172.21.15.50:0/27085992 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e300a2c80 msgr2=0x7f6e300a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.713+0000 7f6e51a00640 1 --2- 172.21.15.50:0/27085992 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e300a2c80 0x7f6e300a5140 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c005fd0 tx=0x7f6e3c009260 comp rx=0 tx=0).stop 2024-09-10T10:12:05.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.713+0000 7f6e51a00640 1 -- 172.21.15.50:0/27085992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c074eb0 msgr2=0x7f6e4c1a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:05.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.713+0000 7f6e51a00640 1 --2- 172.21.15.50:0/27085992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c074eb0 0x7f6e4c1a4b60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800ea60 tx=0x7f6e3800ef20 comp rx=0 tx=0).stop 2024-09-10T10:12:05.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.713+0000 7f6e51a00640 1 -- 172.21.15.50:0/27085992 shutdown_connections 2024-09-10T10:12:05.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.713+0000 7f6e51a00640 1 --2- 172.21.15.50:0/27085992 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e300a2c80 0x7f6e300a5140 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.713+0000 7f6e51a00640 1 --2- 172.21.15.50:0/27085992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e4c1129e0 0x7f6e4c19e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.713+0000 7f6e51a00640 1 --2- 172.21.15.50:0/27085992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c074eb0 0x7f6e4c1a4b60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.713+0000 7f6e51a00640 1 --2- 172.21.15.50:0/27085992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e4c074590 0x7f6e4c1a4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:05.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.713+0000 7f6e51a00640 1 -- 172.21.15.50:0/27085992 >> 172.21.15.50:0/27085992 conn(0x7f6e4c0fd710 msgr2=0x7f6e4c0ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:05.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.713+0000 7f6e51a00640 1 -- 172.21.15.50:0/27085992 shutdown_connections 2024-09-10T10:12:05.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:05.713+0000 7f6e51a00640 1 -- 172.21.15.50:0/27085992 wait complete. 2024-09-10T10:12:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.418+0000 7f8ac4a00640 1 -- 172.21.15.50:0/3360619368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ac01034b0 msgr2=0x7f8ac010b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.418+0000 7f8ac4a00640 1 --2- 172.21.15.50:0/3360619368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ac01034b0 0x7f8ac010b9a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009900 tx=0x7f8aac02a480 comp rx=0 tx=0).stop 2024-09-10T10:12:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.419+0000 7f8ac4a00640 1 -- 172.21.15.50:0/3360619368 shutdown_connections 2024-09-10T10:12:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.419+0000 7f8ac4a00640 1 --2- 172.21.15.50:0/3360619368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac010bfc0 0x7f8ac010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.419+0000 7f8ac4a00640 1 --2- 172.21.15.50:0/3360619368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ac01034b0 0x7f8ac010b9a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.419+0000 7f8ac4a00640 1 --2- 172.21.15.50:0/3360619368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac0102b90 0x7f8ac0102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.419+0000 7f8ac4a00640 1 -- 172.21.15.50:0/3360619368 >> 172.21.15.50:0/3360619368 conn(0x7f8ac00fc610 msgr2=0x7f8ac00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.419+0000 7f8ac4a00640 1 -- 172.21.15.50:0/3360619368 shutdown_connections 2024-09-10T10:12:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.419+0000 7f8ac4a00640 1 -- 172.21.15.50:0/3360619368 wait complete. 2024-09-10T10:12:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.420+0000 7f8ac4a00640 1 Processor -- start 2024-09-10T10:12:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.420+0000 7f8ac4a00640 1 -- start start 2024-09-10T10:12:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8ac4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac0102b90 0x7f8ac01982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8ac4a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ac01034b0 0x7f8ac0198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8ac4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac010bfc0 0x7f8ac019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8ac4a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac0111dc0 con 0x7f8ac010bfc0 2024-09-10T10:12:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8ac4a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac0111c40 con 0x7f8ac0102b90 2024-09-10T10:12:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8ac4a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac0111f40 con 0x7f8ac01034b0 2024-09-10T10:12:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8abe800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac0102b90 0x7f8ac01982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8abe800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac0102b90 0x7f8ac01982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:36612/0 (socket says 172.21.15.50:36612) 2024-09-10T10:12:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8abe800640 1 -- 172.21.15.50:0/3911208314 learned_addr learned my addr 172.21.15.50:0/3911208314 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8abde00640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ac01034b0 0x7f8ac0198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8abf200640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac010bfc0 0x7f8ac019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8abe800640 1 -- 172.21.15.50:0/3911208314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ac01034b0 msgr2=0x7f8ac0198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8abe800640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ac01034b0 0x7f8ac0198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8abe800640 1 -- 172.21.15.50:0/3911208314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac010bfc0 msgr2=0x7f8ac019cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8abe800640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac010bfc0 0x7f8ac019cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.421+0000 7f8abe800640 1 -- 172.21.15.50:0/3911208314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac019d280 con 0x7f8ac0102b90 2024-09-10T10:12:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.422+0000 7f8abe800640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac0102b90 0x7f8ac01982d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000ea60 tx=0x7f8ab000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.422+0000 7f8ab7400640 1 -- 172.21.15.50:0/3911208314 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab000cde0 con 0x7f8ac0102b90 2024-09-10T10:12:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.422+0000 7f8ab7400640 1 -- 172.21.15.50:0/3911208314 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ab00035f0 con 0x7f8ac0102b90 2024-09-10T10:12:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.422+0000 7f8ab7400640 1 -- 172.21.15.50:0/3911208314 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0010670 con 0x7f8ac0102b90 2024-09-10T10:12:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.422+0000 7f8ac4a00640 1 -- 172.21.15.50:0/3911208314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac019d570 con 0x7f8ac0102b90 2024-09-10T10:12:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.422+0000 7f8ac4a00640 1 -- 172.21.15.50:0/3911208314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac01a4e50 con 0x7f8ac0102b90 2024-09-10T10:12:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.425+0000 7f8ac806b740 1 Processor -- start 2024-09-10T10:12:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.426+0000 7f8ac806b740 1 -- start start 2024-09-10T10:12:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.426+0000 7f8ac806b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47ee40 0x55deeb47f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.426+0000 7f8ac806b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb47f760 0x55deeb489ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.426+0000 7f8ac806b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb48a020 0x55deeb48c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.426+0000 7f8ac806b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55deeb3e53e0 con 0x55deeb47ee40 2024-09-10T10:12:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.426+0000 7f8ac806b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55deeb38cd80 con 0x55deeb47f760 2024-09-10T10:12:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.426+0000 7f8ac806b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55deeb3e13a0 con 0x55deeb48a020 2024-09-10T10:12:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.426+0000 7f8abf200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47ee40 0x55deeb47f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.426+0000 7f8abf200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47ee40 0x55deeb47f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41464/0 (socket says 172.21.15.50:41464) 2024-09-10T10:12:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.426+0000 7f8abf200640 1 -- 172.21.15.50:0/1465005497 learned_addr learned my addr 172.21.15.50:0/1465005497 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.427+0000 7f8abf200640 1 -- 172.21.15.50:0/1465005497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb48a020 msgr2=0x55deeb48c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.427+0000 7f8abf200640 1 --2- 172.21.15.50:0/1465005497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb48a020 0x55deeb48c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.427+0000 7f8abf200640 1 -- 172.21.15.50:0/1465005497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb47f760 msgr2=0x55deeb489ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:12:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.427+0000 7f8abf200640 1 --2- 172.21.15.50:0/1465005497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb47f760 0x55deeb489ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.427+0000 7f8abf200640 1 -- 172.21.15.50:0/1465005497 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deeb3abae0 con 0x55deeb47ee40 2024-09-10T10:12:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.427+0000 7f8ab7400640 1 -- 172.21.15.50:0/3911208314 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8ab00037a0 con 0x7f8ac0102b90 2024-09-10T10:12:06.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.427+0000 7f8abf200640 1 --2- 172.21.15.50:0/1465005497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47ee40 0x55deeb47f220 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009f50 tx=0x7f8ab80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145748cf8b7d90ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.427+0000 7f8aab400640 1 -- 172.21.15.50:0/1465005497 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8004d20 con 0x55deeb47ee40 2024-09-10T10:12:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.427+0000 7f8aab400640 1 -- 172.21.15.50:0/1465005497 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ab8004050 con 0x55deeb47ee40 2024-09-10T10:12:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.427+0000 7f8aab400640 1 -- 172.21.15.50:0/1465005497 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8005280 con 0x55deeb47ee40 2024-09-10T10:12:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.428+0000 7f8ac806b740 1 -- 172.21.15.50:0/1465005497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47ee40 msgr2=0x55deeb47f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.428+0000 7f8ac806b740 1 --2- 172.21.15.50:0/1465005497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47ee40 0x55deeb47f220 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009f50 tx=0x7f8ab80118d0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.429+0000 7f8ac806b740 1 -- 172.21.15.50:0/1465005497 shutdown_connections 2024-09-10T10:12:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.429+0000 7f8ac806b740 1 --2- 172.21.15.50:0/1465005497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb48a020 0x55deeb48c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.429+0000 7f8ac806b740 1 --2- 172.21.15.50:0/1465005497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb47f760 0x55deeb489ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.429+0000 7f8ac806b740 1 --2- 172.21.15.50:0/1465005497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47ee40 0x55deeb47f220 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.429+0000 7f8ac806b740 1 -- 172.21.15.50:0/1465005497 >> 172.21.15.50:0/1465005497 conn(0x55deeb47b3d0 msgr2=0x55deeb47b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.429+0000 7f8ab7400640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8aa40a2bb0 0x7f8aa40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.429+0000 7f8ac806b740 1 -- 172.21.15.50:0/1465005497 shutdown_connections 2024-09-10T10:12:06.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.429+0000 7f8ab7400640 1 -- 172.21.15.50:0/3911208314 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f8ab00cf640 con 0x7f8ac0102b90 2024-09-10T10:12:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.429+0000 7f8ac806b740 1 -- 172.21.15.50:0/1465005497 wait complete. 2024-09-10T10:12:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.429+0000 7f8abde00640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8aa40a2bb0 0x7f8aa40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.429+0000 7f8ac806b740 1 -- start start 2024-09-10T10:12:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.430+0000 7f8ac806b740 1 Processor -- start 2024-09-10T10:12:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.430+0000 7f8abde00640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8aa40a2bb0 0x7f8aa40a5070 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009230 tx=0x7f8aac000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.430+0000 7f8ac806b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb486eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.430+0000 7f8ac806b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47f760 0x55deeb4873f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.430+0000 7f8ac806b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb48a020 0x55deeb487930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.430+0000 7f8ac806b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55deeb48cbf0 con 0x55deeb47f760 2024-09-10T10:12:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.430+0000 7f8ac806b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55deeb3a00f0 con 0x55deeb48a020 2024-09-10T10:12:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.430+0000 7f8ac806b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55deeb48cd70 con 0x55deeb47ee40 2024-09-10T10:12:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.430+0000 7f8ac806b740 10 client.0 _ll_register_callbacks cb 0x55deeb387bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:06.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.431+0000 7f8abde00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47f760 0x55deeb4873f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.431+0000 7f8abde00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47f760 0x55deeb4873f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41466/0 (socket says 172.21.15.50:41466) 2024-09-10T10:12:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.431+0000 7f8abde00640 1 -- 172.21.15.50:0/47516432 learned_addr learned my addr 172.21.15.50:0/47516432 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.431+0000 7f8abe800640 1 --2- 172.21.15.50:0/47516432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb486eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.431+0000 7f8abf200640 1 --2- 172.21.15.50:0/47516432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb48a020 0x55deeb487930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.431+0000 7f8abe800640 1 -- 172.21.15.50:0/47516432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb48a020 msgr2=0x55deeb487930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.431+0000 7f8abe800640 1 --2- 172.21.15.50:0/47516432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb48a020 0x55deeb487930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.431+0000 7f8abe800640 1 -- 172.21.15.50:0/47516432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47f760 msgr2=0x55deeb4873f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.431+0000 7f8abe800640 1 --2- 172.21.15.50:0/47516432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47f760 0x55deeb4873f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.431+0000 7f8abe800640 1 -- 172.21.15.50:0/47516432 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deeb1563c0 con 0x55deeb47ee40 2024-09-10T10:12:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.431+0000 7f8abe800640 1 --2- 172.21.15.50:0/47516432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb486eb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55deeb47c230 tx=0x7f8ab009b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaea7f28e6de7ff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.431+0000 7f8a9fe00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:12:06.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.432+0000 7f8a9fe00640 1 -- 172.21.15.50:0/47516432 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab009bb10 con 0x55deeb47ee40 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.432+0000 7f8ac806b740 1 -- 172.21.15.50:0/47516432 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ab8004050 con 0x55deeb47ee40 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.432+0000 7f8a9fe00640 1 -- 172.21.15.50:0/47516432 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f8ab0003b30 con 0x55deeb47ee40 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.432+0000 7f8a9fe00640 1 -- 172.21.15.50:0/47516432 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8ab009fec0 con 0x55deeb47ee40 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.432+0000 7f8ac806b740 10 client.25363 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.432+0000 7f8ac806b740 1 -- 172.21.15.50:0/47516432 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55deeb498c40 con 0x55deeb47ee40 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.432+0000 7f8a9fe00640 1 -- 172.21.15.50:0/47516432 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ab8004050 con 0x55deeb47ee40 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.432+0000 7f8a9fe00640 1 -- 172.21.15.50:0/47516432 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f8ab0097860 con 0x55deeb47ee40 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.433+0000 7f8ac806b740 10 client.25363 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.433+0000 7f8ac806b740 10 client.25363 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.433+0000 7f8ac806b740 20 client.25363 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.433+0000 7f8ac806b740 1 --2- 172.21.15.50:0/47516432 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55deeb49a050 0x55deeb49c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.433+0000 7f8ac806b740 4 client.25363 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.433+0000 7f8ac806b740 1 -- 172.21.15.50:0/47516432 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55deeb3f2950 con 0x55deeb49a050 2024-09-10T10:12:06.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.433+0000 7f8abde00640 1 --2- 172.21.15.50:0/47516432 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55deeb49a050 0x55deeb49c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.433+0000 7f8abde00640 1 --2- 172.21.15.50:0/47516432 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55deeb49a050 0x55deeb49c440 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ef1e92a5c3e51d66 server_cookie=76f5eff4bce37e17 in_seq=0 out_seq=0 2024-09-10T10:12:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.433+0000 7f8a9fe00640 10 client.25363 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:12:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.434+0000 7f8a9fe00640 1 -- 172.21.15.50:0/47516432 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55deeb3f2950 con 0x55deeb49a050 2024-09-10T10:12:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.434+0000 7f8a9fe00640 10 client.25363 handle_command_reply: tid=0 2024-09-10T10:12:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.434+0000 7f8ac806b740 1 client.25363 shutdown 2024-09-10T10:12:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.434+0000 7f8ac806b740 1 -- 172.21.15.50:0/47516432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 msgr2=0x55deeb486eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.434+0000 7f8ac806b740 1 --2- 172.21.15.50:0/47516432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb486eb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55deeb47c230 tx=0x7f8ab009b710 comp rx=0 tx=0).stop 2024-09-10T10:12:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.435+0000 7f8ac806b740 1 -- 172.21.15.50:0/47516432 shutdown_connections 2024-09-10T10:12:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.435+0000 7f8ac806b740 1 --2- 172.21.15.50:0/47516432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb48a020 0x55deeb487930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.435+0000 7f8ac806b740 1 --2- 172.21.15.50:0/47516432 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55deeb49a050 0x55deeb49c440 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.435+0000 7f8ac806b740 1 --2- 172.21.15.50:0/47516432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47f760 0x55deeb4873f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.435+0000 7f8ac806b740 1 --2- 172.21.15.50:0/47516432 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb486eb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.435+0000 7f8a9fe00640 0 client.25363 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:12:06.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.435+0000 7f8ac806b740 1 -- 172.21.15.50:0/47516432 >> 172.21.15.50:0/47516432 conn(0x55deeb47b3d0 msgr2=0x55deeb481100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:06.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.435+0000 7f8ac806b740 1 -- 172.21.15.50:0/47516432 shutdown_connections 2024-09-10T10:12:06.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.435+0000 7f8ac806b740 1 -- 172.21.15.50:0/47516432 wait complete. 2024-09-10T10:12:06.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.435+0000 7f8ac806b740 20 client.25363 trim_cache size 0 max 16384 2024-09-10T10:12:06.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.449+0000 7f8ac806b740 1 Processor -- start 2024-09-10T10:12:06.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.450+0000 7f8ac806b740 1 -- start start 2024-09-10T10:12:06.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.450+0000 7f8ac806b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb4a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.450+0000 7f8ac806b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb47f760 0x55deeb4a2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.450+0000 7f8ac806b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb48a020 0x55deeb484130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.450+0000 7f8ac806b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac01b1440 con 0x55deeb48a020 2024-09-10T10:12:06.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.450+0000 7f8ac806b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac01aed10 con 0x55deeb47f760 2024-09-10T10:12:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.450+0000 7f8ac806b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac01acb60 con 0x55deeb47ee40 2024-09-10T10:12:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.450+0000 7f8abf200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb48a020 0x55deeb484130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.450+0000 7f8abde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb47f760 0x55deeb4a2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.450+0000 7f8abe800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb4a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.450+0000 7f8abde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb47f760 0x55deeb4a2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:36626/0 (socket says 172.21.15.50:36626) 2024-09-10T10:12:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.450+0000 7f8abf200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb48a020 0x55deeb484130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41480/0 (socket says 172.21.15.50:41480) 2024-09-10T10:12:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.450+0000 7f8abde00640 1 -- 172.21.15.50:0/858365847 learned_addr learned my addr 172.21.15.50:0/858365847 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.451+0000 7f8abde00640 1 -- 172.21.15.50:0/858365847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 msgr2=0x55deeb4a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.451+0000 7f8abde00640 1 --2- 172.21.15.50:0/858365847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb4a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.451+0000 7f8abde00640 1 -- 172.21.15.50:0/858365847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb48a020 msgr2=0x55deeb484130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.451+0000 7f8abde00640 1 --2- 172.21.15.50:0/858365847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb48a020 0x55deeb484130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.451+0000 7f8abde00640 1 -- 172.21.15.50:0/858365847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deeb47ae70 con 0x55deeb47f760 2024-09-10T10:12:06.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.451+0000 7f8abde00640 1 --2- 172.21.15.50:0/858365847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb47f760 0x55deeb4a2200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8aac006010 tx=0x7f8aac040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=863b778e3b608e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.451+0000 7f8aaaa00640 1 -- 172.21.15.50:0/858365847 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac035040 con 0x55deeb47f760 2024-09-10T10:12:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.452+0000 7f8aaaa00640 1 -- 172.21.15.50:0/858365847 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8aac004490 con 0x55deeb47f760 2024-09-10T10:12:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.452+0000 7f8aaaa00640 1 -- 172.21.15.50:0/858365847 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0538f0 con 0x55deeb47f760 2024-09-10T10:12:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.452+0000 7f8ac806b740 1 -- 172.21.15.50:0/858365847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb47f760 msgr2=0x55deeb4a2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.452+0000 7f8ac806b740 1 --2- 172.21.15.50:0/858365847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb47f760 0x55deeb4a2200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8aac006010 tx=0x7f8aac040000 comp rx=0 tx=0).stop 2024-09-10T10:12:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.453+0000 7f8ac806b740 1 -- 172.21.15.50:0/858365847 shutdown_connections 2024-09-10T10:12:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.453+0000 7f8ac806b740 1 --2- 172.21.15.50:0/858365847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb48a020 0x55deeb484130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.453+0000 7f8ac806b740 1 --2- 172.21.15.50:0/858365847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb47f760 0x55deeb4a2200 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.453+0000 7f8ac806b740 1 --2- 172.21.15.50:0/858365847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb4a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.453+0000 7f8ac806b740 1 -- 172.21.15.50:0/858365847 >> 172.21.15.50:0/858365847 conn(0x55deeb47b3d0 msgr2=0x55deeb4810b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.453+0000 7f8ac806b740 1 -- 172.21.15.50:0/858365847 shutdown_connections 2024-09-10T10:12:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.453+0000 7f8ac806b740 1 -- 172.21.15.50:0/858365847 wait complete. 2024-09-10T10:12:06.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.453+0000 7f8ac806b740 1 -- start start 2024-09-10T10:12:06.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.453+0000 7f8ac806b740 1 Processor -- start 2024-09-10T10:12:06.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.454+0000 7f8ac806b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb4fce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.454+0000 7f8ac806b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47f760 0x55deeb4fd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.454+0000 7f8ac806b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb48a020 0x55deeb500de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.454+0000 7f8ac806b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac01ad1d0 con 0x55deeb47f760 2024-09-10T10:12:06.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.454+0000 7f8ac806b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac01ae640 con 0x55deeb48a020 2024-09-10T10:12:06.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.454+0000 7f8ac806b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac01ad8a0 con 0x55deeb47ee40 2024-09-10T10:12:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.454+0000 7f8ac806b740 10 client.0 _ll_register_callbacks cb 0x7f8ab000e9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.454+0000 7f8abde00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47f760 0x55deeb4fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.454+0000 7f8abde00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47f760 0x55deeb4fd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41484/0 (socket says 172.21.15.50:41484) 2024-09-10T10:12:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.454+0000 7f8abde00640 1 -- 172.21.15.50:0/3972878384 learned_addr learned my addr 172.21.15.50:0/3972878384 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8abe800640 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb4fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8abf200640 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb48a020 0x55deeb500de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8abde00640 1 -- 172.21.15.50:0/3972878384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 msgr2=0x55deeb4fce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8abde00640 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb4fce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8abde00640 1 -- 172.21.15.50:0/3972878384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb48a020 msgr2=0x55deeb500de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8abde00640 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb48a020 0x55deeb500de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8abde00640 1 -- 172.21.15.50:0/3972878384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deeb501480 con 0x55deeb47f760 2024-09-10T10:12:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8abe800640 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb4fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:12:06.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8abf200640 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb48a020 0x55deeb500de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8abde00640 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47f760 0x55deeb4fd370 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8aac004770 tx=0x7f8aac009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377c651031ad647c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8a9fe00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8a9fe00640 1 -- 172.21.15.50:0/3972878384 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac035050 con 0x55deeb47f760 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8a9fe00640 1 -- 172.21.15.50:0/3972878384 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f8aac053880 con 0x55deeb47f760 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.455+0000 7f8ac806b740 1 -- 172.21.15.50:0/3972878384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8aac004490 con 0x55deeb47f760 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.456+0000 7f8a9fe00640 1 -- 172.21.15.50:0/3972878384 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8aac053a80 con 0x55deeb47f760 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.456+0000 7f8ac806b740 10 client.15357 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.456+0000 7f8ac806b740 1 -- 172.21.15.50:0/3972878384 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55deeb509a10 con 0x55deeb47f760 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.456+0000 7f8a9fe00640 1 -- 172.21.15.50:0/3972878384 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8aac004490 con 0x55deeb47f760 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.456+0000 7f8a9fe00640 1 -- 172.21.15.50:0/3972878384 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f8aac03c540 con 0x55deeb47f760 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.456+0000 7f8ac806b740 10 client.15357 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.456+0000 7f8ac806b740 10 client.15357 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.456+0000 7f8ac806b740 20 client.15357 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:06.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.456+0000 7f8ac806b740 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55deeb50a160 0x55deeb50c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:06.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.456+0000 7f8ac806b740 4 client.15357 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:12:06.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.456+0000 7f8ac806b740 1 -- 172.21.15.50:0/3972878384 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55deeb3ece60 con 0x55deeb50a160 2024-09-10T10:12:06.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.457+0000 7f8abe800640 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55deeb50a160 0x55deeb50c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:06.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.457+0000 7f8abe800640 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55deeb50a160 0x55deeb50c580 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bc07d5a55c9a4067 server_cookie=47825b04e042ecbf in_seq=0 out_seq=0 2024-09-10T10:12:06.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.457+0000 7f8a9fe00640 10 client.15357 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:12:06.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8a9fe00640 1 -- 172.21.15.50:0/3972878384 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55deeb3ece60 con 0x55deeb50a160 2024-09-10T10:12:06.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8a9fe00640 10 client.15357 handle_command_reply: tid=0 2024-09-10T10:12:06.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8ac806b740 1 client.15357 shutdown 2024-09-10T10:12:06.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8ac806b740 1 -- 172.21.15.50:0/3972878384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47f760 msgr2=0x55deeb4fd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8ac806b740 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47f760 0x55deeb4fd370 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8aac004770 tx=0x7f8aac009260 comp rx=0 tx=0).stop 2024-09-10T10:12:06.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8ac806b740 1 -- 172.21.15.50:0/3972878384 shutdown_connections 2024-09-10T10:12:06.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8ac806b740 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55deeb48a020 0x55deeb500de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8ac806b740 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55deeb50a160 0x55deeb50c580 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8ac806b740 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55deeb47f760 0x55deeb4fd370 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8ac806b740 1 --2- 172.21.15.50:0/3972878384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55deeb47ee40 0x55deeb4fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8ac806b740 1 -- 172.21.15.50:0/3972878384 >> 172.21.15.50:0/3972878384 conn(0x55deeb47b3d0 msgr2=0x55deeb479c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:06.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8a9fe00640 0 client.15357 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:12:06.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8ac806b740 1 -- 172.21.15.50:0/3972878384 shutdown_connections 2024-09-10T10:12:06.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.458+0000 7f8ac806b740 1 -- 172.21.15.50:0/3972878384 wait complete. 2024-09-10T10:12:06.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.459+0000 7f8ac806b740 20 client.15357 trim_cache size 0 max 16384 2024-09-10T10:12:06.464 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:12:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.459+0000 7f8ac4a00640 1 -- 172.21.15.50:0/3911208314 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8aa40a2bb0 msgr2=0x7f8aa40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.459+0000 7f8ac4a00640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8aa40a2bb0 0x7f8aa40a5070 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009230 tx=0x7f8aac000bc0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.459+0000 7f8ac4a00640 1 -- 172.21.15.50:0/3911208314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac0102b90 msgr2=0x7f8ac01982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.459+0000 7f8ac4a00640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac0102b90 0x7f8ac01982d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000ea60 tx=0x7f8ab000ef20 comp rx=0 tx=0).stop 2024-09-10T10:12:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.460+0000 7f8ac4a00640 1 -- 172.21.15.50:0/3911208314 shutdown_connections 2024-09-10T10:12:06.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.460+0000 7f8ac4a00640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8aa40a2bb0 0x7f8aa40a5070 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.460+0000 7f8ac4a00640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ac010bfc0 0x7f8ac019cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.460+0000 7f8ac4a00640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8ac01034b0 0x7f8ac0198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.460+0000 7f8ac4a00640 1 --2- 172.21.15.50:0/3911208314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ac0102b90 0x7f8ac01982d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.460+0000 7f8ac4a00640 1 -- 172.21.15.50:0/3911208314 >> 172.21.15.50:0/3911208314 conn(0x7f8ac00fc610 msgr2=0x7f8ac00fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.460+0000 7f8ac4a00640 1 -- 172.21.15.50:0/3911208314 shutdown_connections 2024-09-10T10:12:06.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:06.460+0000 7f8ac4a00640 1 -- 172.21.15.50:0/3911208314 wait complete. 2024-09-10T10:12:06.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:06 smithi189 ceph-mon[34999]: pgmap v418: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:12:06.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:06 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/27085992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:06.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:06 smithi084 ceph-mon[34812]: pgmap v418: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:12:06.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:06 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/27085992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:06.853 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:06 smithi050 ceph-mon[30354]: pgmap v418: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:12:06.853 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:06 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/27085992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:06.892 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-10T10:12:06.892 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-10T10:12:07.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T10:12:07.772 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:08.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.402+0000 7fea20200640 1 -- 172.21.15.50:0/144148081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea1810e470 msgr2=0x7fea18110860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:08.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.402+0000 7fea20200640 1 --2- 172.21.15.50:0/144148081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea1810e470 0x7fea18110860 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea10009be0 tx=0x7fea1002a6c0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.402+0000 7fea20200640 1 -- 172.21.15.50:0/144148081 shutdown_connections 2024-09-10T10:12:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.402+0000 7fea20200640 1 --2- 172.21.15.50:0/144148081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea1810e470 0x7fea18110860 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.402+0000 7fea20200640 1 --2- 172.21.15.50:0/144148081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea18101270 0x7fea1810df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.402+0000 7fea20200640 1 --2- 172.21.15.50:0/144148081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea181008c0 0x7fea18100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.402+0000 7fea20200640 1 -- 172.21.15.50:0/144148081 >> 172.21.15.50:0/144148081 conn(0x7fea180fc790 msgr2=0x7fea180febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.402+0000 7fea20200640 1 -- 172.21.15.50:0/144148081 shutdown_connections 2024-09-10T10:12:08.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.402+0000 7fea20200640 1 -- 172.21.15.50:0/144148081 wait complete. 2024-09-10T10:12:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.403+0000 7fea20200640 1 Processor -- start 2024-09-10T10:12:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.404+0000 7fea20200640 1 -- start start 2024-09-10T10:12:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.404+0000 7fea20200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea181008c0 0x7fea1819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.404+0000 7fea20200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea18101270 0x7fea1819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.404+0000 7fea20200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1810e470 0x7fea1819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.404+0000 7fea20200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea18114150 con 0x7fea18101270 2024-09-10T10:12:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.404+0000 7fea20200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fea18113fd0 con 0x7fea1810e470 2024-09-10T10:12:08.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.404+0000 7fea20200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fea181142d0 con 0x7fea181008c0 2024-09-10T10:12:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.405+0000 7fea1ce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea18101270 0x7fea1819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.405+0000 7fea1ce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea18101270 0x7fea1819ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38788/0 (socket says 172.21.15.50:38788) 2024-09-10T10:12:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.405+0000 7fea1ce00640 1 -- 172.21.15.50:0/4155515759 learned_addr learned my addr 172.21.15.50:0/4155515759 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.405+0000 7fea1d800640 1 --2- 172.21.15.50:0/4155515759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea181008c0 0x7fea1819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.405+0000 7fea1d800640 1 -- 172.21.15.50:0/4155515759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1810e470 msgr2=0x7fea1819ef10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T10:12:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.405+0000 7fea1d800640 1 --2- 172.21.15.50:0/4155515759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1810e470 0x7fea1819ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.405+0000 7fea1d800640 1 -- 172.21.15.50:0/4155515759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea18101270 msgr2=0x7fea1819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.405+0000 7fea1d800640 1 --2- 172.21.15.50:0/4155515759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea18101270 0x7fea1819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.405+0000 7fea1d800640 1 -- 172.21.15.50:0/4155515759 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1819f5f0 con 0x7fea181008c0 2024-09-10T10:12:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.406+0000 7fea1d800640 1 --2- 172.21.15.50:0/4155515759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea181008c0 0x7fea1819a640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fea0c005fd0 tx=0x7fea0c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.406+0000 7fea16000640 1 -- 172.21.15.50:0/4155515759 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00cd00 con 0x7fea181008c0 2024-09-10T10:12:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.406+0000 7fea16000640 1 -- 172.21.15.50:0/4155515759 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea0c0035f0 con 0x7fea181008c0 2024-09-10T10:12:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.406+0000 7fea16000640 1 -- 172.21.15.50:0/4155515759 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c010670 con 0x7fea181008c0 2024-09-10T10:12:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.406+0000 7fea20200640 1 -- 172.21.15.50:0/4155515759 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1819f8e0 con 0x7fea181008c0 2024-09-10T10:12:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.406+0000 7fea20200640 1 -- 172.21.15.50:0/4155515759 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea181a71c0 con 0x7fea181008c0 2024-09-10T10:12:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.410+0000 7fea16000640 1 -- 172.21.15.50:0/4155515759 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fea0c0037a0 con 0x7fea181008c0 2024-09-10T10:12:08.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.411+0000 7fea22c7d740 1 Processor -- start 2024-09-10T10:12:08.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.412+0000 7fea22c7d740 1 -- start start 2024-09-10T10:12:08.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.413+0000 7fea22c7d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da513b0 0x557b9da51790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.413+0000 7fea22c7d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da51cd0 0x557b9da64860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.413+0000 7fea22c7d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da64da0 0x557b9da67190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.413+0000 7fea22c7d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557b9d9b7530 con 0x557b9da64da0 2024-09-10T10:12:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.413+0000 7fea22c7d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557b9d95e860 con 0x557b9da51cd0 2024-09-10T10:12:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.413+0000 7fea22c7d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557b9d9b34f0 con 0x557b9da513b0 2024-09-10T10:12:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.413+0000 7fea16000640 1 --2- 172.21.15.50:0/4155515759 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea000a2b80 0x7fea000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.413+0000 7fea16000640 1 -- 172.21.15.50:0/4155515759 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fea0c0cf640 con 0x7fea181008c0 2024-09-10T10:12:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.413+0000 7fea1d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da51cd0 0x557b9da64860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.413+0000 7fea1e200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da513b0 0x557b9da51790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.413+0000 7fea1d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da51cd0 0x557b9da64860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:38606/0 (socket says 172.21.15.50:38606) 2024-09-10T10:12:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.413+0000 7fea1d800640 1 -- 172.21.15.50:0/1907137542 learned_addr learned my addr 172.21.15.50:0/1907137542 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:08.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.413+0000 7fea1ce00640 1 --2- 172.21.15.50:0/1907137542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da64da0 0x557b9da67190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.414+0000 7fea1d800640 1 -- 172.21.15.50:0/1907137542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da513b0 msgr2=0x557b9da51790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.414+0000 7fea1d800640 1 --2- 172.21.15.50:0/1907137542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da513b0 0x557b9da51790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.414+0000 7fea1d800640 1 -- 172.21.15.50:0/1907137542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da64da0 msgr2=0x557b9da67190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.414+0000 7fea1d800640 1 --2- 172.21.15.50:0/1907137542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da64da0 0x557b9da67190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.414+0000 7fea1d800640 1 -- 172.21.15.50:0/1907137542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9d728b90 con 0x557b9da51cd0 2024-09-10T10:12:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.414+0000 7fea1d800640 1 --2- 172.21.15.50:0/1907137542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da51cd0 0x557b9da64860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0a4250 tx=0x7fea0c09b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=972114071cd1c596 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.414+0000 7fea0aa00640 1 -- 172.21.15.50:0/1907137542 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c09c210 con 0x557b9da51cd0 2024-09-10T10:12:08.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.414+0000 7fea0aa00640 1 -- 172.21.15.50:0/1907137542 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea0c0b4030 con 0x557b9da51cd0 2024-09-10T10:12:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.414+0000 7fea0aa00640 1 -- 172.21.15.50:0/1907137542 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0cf380 con 0x557b9da51cd0 2024-09-10T10:12:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.415+0000 7fea22c7d740 1 -- 172.21.15.50:0/1907137542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da51cd0 msgr2=0x557b9da64860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.415+0000 7fea22c7d740 1 --2- 172.21.15.50:0/1907137542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da51cd0 0x557b9da64860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0a4250 tx=0x7fea0c09b710 comp rx=0 tx=0).stop 2024-09-10T10:12:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.416+0000 7fea1e200640 1 --2- 172.21.15.50:0/4155515759 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea000a2b80 0x7fea000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.416+0000 7fea22c7d740 1 -- 172.21.15.50:0/1907137542 shutdown_connections 2024-09-10T10:12:08.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.416+0000 7fea22c7d740 1 --2- 172.21.15.50:0/1907137542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da64da0 0x557b9da67190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.416+0000 7fea22c7d740 1 --2- 172.21.15.50:0/1907137542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da51cd0 0x557b9da64860 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.416+0000 7fea22c7d740 1 --2- 172.21.15.50:0/1907137542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da513b0 0x557b9da51790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.416+0000 7fea22c7d740 1 -- 172.21.15.50:0/1907137542 >> 172.21.15.50:0/1907137542 conn(0x557b9da4d940 msgr2=0x557b9da4dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.416+0000 7fea22c7d740 1 -- 172.21.15.50:0/1907137542 shutdown_connections 2024-09-10T10:12:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.416+0000 7fea22c7d740 1 -- 172.21.15.50:0/1907137542 wait complete. 2024-09-10T10:12:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.417+0000 7fea1e200640 1 --2- 172.21.15.50:0/4155515759 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea000a2b80 0x7fea000a5040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fea10034040 tx=0x7fea10009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.417+0000 7fea22c7d740 1 -- start start 2024-09-10T10:12:08.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.417+0000 7fea22c7d740 1 Processor -- start 2024-09-10T10:12:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.418+0000 7fea22c7d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da513b0 0x557b9da56fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.418+0000 7fea22c7d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da51cd0 0x557b9da574e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.418+0000 7fea22c7d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da64da0 0x557b9da57a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.418+0000 7fea22c7d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557b9da67970 con 0x557b9da51cd0 2024-09-10T10:12:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.418+0000 7fea22c7d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557b9d971e60 con 0x557b9da513b0 2024-09-10T10:12:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.418+0000 7fea22c7d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557b9da67af0 con 0x557b9da64da0 2024-09-10T10:12:08.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.418+0000 7fea22c7d740 10 client.0 _ll_register_callbacks cb 0x557b9d976cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:08.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.418+0000 7fea1d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da513b0 0x557b9da56fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.418+0000 7fea1d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da513b0 0x557b9da56fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:38616/0 (socket says 172.21.15.50:38616) 2024-09-10T10:12:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.418+0000 7fea1d800640 1 -- 172.21.15.50:0/723917808 learned_addr learned my addr 172.21.15.50:0/723917808 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.419+0000 7fea1d800640 1 -- 172.21.15.50:0/723917808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da64da0 msgr2=0x557b9da57a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:12:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.419+0000 7fea1d800640 1 --2- 172.21.15.50:0/723917808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da64da0 0x557b9da57a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.419+0000 7fea1d800640 1 -- 172.21.15.50:0/723917808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da51cd0 msgr2=0x557b9da574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.419+0000 7fea1ce00640 1 --2- 172.21.15.50:0/723917808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da51cd0 0x557b9da574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.419+0000 7fea1d800640 1 --2- 172.21.15.50:0/723917808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da51cd0 0x557b9da574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.419+0000 7fea1d800640 1 -- 172.21.15.50:0/723917808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b9d97d990 con 0x557b9da513b0 2024-09-10T10:12:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.419+0000 7fea1ce00640 1 --2- 172.21.15.50:0/723917808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da51cd0 0x557b9da574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:12:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.419+0000 7fea1d800640 1 --2- 172.21.15.50:0/723917808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da513b0 0x557b9da56fa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0977f0 tx=0x7fea0c09bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c3eed701db2fbb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.419+0000 7fe9ff400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:12:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.419+0000 7fe9ff400640 1 -- 172.21.15.50:0/723917808 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c065020 con 0x557b9da513b0 2024-09-10T10:12:08.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.420+0000 7fea22c7d740 1 -- 172.21.15.50:0/723917808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea0c0b4030 con 0x557b9da513b0 2024-09-10T10:12:08.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.420+0000 7fe9ff400640 1 -- 172.21.15.50:0/723917808 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fea0c098180 con 0x557b9da513b0 2024-09-10T10:12:08.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.420+0000 7fe9ff400640 1 -- 172.21.15.50:0/723917808 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fea0c0ba050 con 0x557b9da513b0 2024-09-10T10:12:08.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.420+0000 7fea22c7d740 10 client.25412 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:08.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.420+0000 7fea22c7d740 1 -- 172.21.15.50:0/723917808 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557b9da735a0 con 0x557b9da513b0 2024-09-10T10:12:08.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.421+0000 7fe9ff400640 1 -- 172.21.15.50:0/723917808 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea0c0b4030 con 0x557b9da513b0 2024-09-10T10:12:08.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.421+0000 7fe9ff400640 1 -- 172.21.15.50:0/723917808 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fea0c004000 con 0x557b9da513b0 2024-09-10T10:12:08.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.421+0000 7fea22c7d740 10 client.25412 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:08.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.421+0000 7fea22c7d740 10 client.25412 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:12:08.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.421+0000 7fea22c7d740 20 client.25412 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:08.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.421+0000 7fea22c7d740 1 --2- 172.21.15.50:0/723917808 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557b9da748f0 0x557b9da76ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.421+0000 7fea22c7d740 4 client.25412 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:12:08.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.421+0000 7fea22c7d740 1 -- 172.21.15.50:0/723917808 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b9d95a310 con 0x557b9da748f0 2024-09-10T10:12:08.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.422+0000 7fea1ce00640 1 --2- 172.21.15.50:0/723917808 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557b9da748f0 0x557b9da76ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.423+0000 7fea1ce00640 1 --2- 172.21.15.50:0/723917808 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557b9da748f0 0x557b9da76ce0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d68e6d7ee7371048 server_cookie=d30e78e16a0dbeaa in_seq=0 out_seq=0 2024-09-10T10:12:08.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.423+0000 7fe9ff400640 10 client.25412 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:08.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.423+0000 7fe9ff400640 1 -- 172.21.15.50:0/723917808 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b9d95a310 con 0x557b9da748f0 2024-09-10T10:12:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.423+0000 7fe9ff400640 10 client.25412 handle_command_reply: tid=0 2024-09-10T10:12:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.423+0000 7fea22c7d740 1 client.25412 shutdown 2024-09-10T10:12:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.424+0000 7fea22c7d740 1 -- 172.21.15.50:0/723917808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da513b0 msgr2=0x557b9da56fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.424+0000 7fea22c7d740 1 --2- 172.21.15.50:0/723917808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da513b0 0x557b9da56fa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0977f0 tx=0x7fea0c09bc50 comp rx=0 tx=0).stop 2024-09-10T10:12:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.424+0000 7fea22c7d740 1 -- 172.21.15.50:0/723917808 shutdown_connections 2024-09-10T10:12:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.424+0000 7fea22c7d740 1 --2- 172.21.15.50:0/723917808 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557b9da748f0 0x557b9da76ce0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.424+0000 7fea22c7d740 1 --2- 172.21.15.50:0/723917808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da64da0 0x557b9da57a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.424+0000 7fea22c7d740 1 --2- 172.21.15.50:0/723917808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da51cd0 0x557b9da574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.424+0000 7fea22c7d740 1 --2- 172.21.15.50:0/723917808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da513b0 0x557b9da56fa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.424+0000 7fea22c7d740 1 -- 172.21.15.50:0/723917808 >> 172.21.15.50:0/723917808 conn(0x557b9da4d940 msgr2=0x557b9da4cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.424+0000 7fe9ff400640 0 client.25412 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:08.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.424+0000 7fea22c7d740 1 -- 172.21.15.50:0/723917808 shutdown_connections 2024-09-10T10:12:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.424+0000 7fea22c7d740 1 -- 172.21.15.50:0/723917808 wait complete. 2024-09-10T10:12:08.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.424+0000 7fea22c7d740 20 client.25412 trim_cache size 0 max 16384 2024-09-10T10:12:08.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.444+0000 7fea22c7d740 1 Processor -- start 2024-09-10T10:12:08.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.444+0000 7fea22c7d740 1 -- start start 2024-09-10T10:12:08.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.444+0000 7fea22c7d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da513b0 0x557b9da67120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.444+0000 7fea22c7d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da51cd0 0x557b9da7c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.444+0000 7fea22c7d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da64da0 0x557b9da7c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.444+0000 7fea22c7d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea181af410 con 0x557b9da51cd0 2024-09-10T10:12:08.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.444+0000 7fea22c7d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fea181acce0 con 0x557b9da64da0 2024-09-10T10:12:08.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.444+0000 7fea22c7d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fea181aab30 con 0x557b9da513b0 2024-09-10T10:12:08.447 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:08.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.445+0000 7fea1ce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da51cd0 0x557b9da7c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.445+0000 7fea1ce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da51cd0 0x557b9da7c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38804/0 (socket says 172.21.15.50:38804) 2024-09-10T10:12:08.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.445+0000 7fea1ce00640 1 -- 172.21.15.50:0/477777256 learned_addr learned my addr 172.21.15.50:0/477777256 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:08.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.445+0000 7fea1d800640 1 --2- 172.21.15.50:0/477777256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da513b0 0x557b9da67120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.445+0000 7fea1e200640 1 --2- 172.21.15.50:0/477777256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da64da0 0x557b9da7c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.445+0000 7fea1d800640 1 -- 172.21.15.50:0/477777256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da64da0 msgr2=0x557b9da7c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.445+0000 7fea1d800640 1 --2- 172.21.15.50:0/477777256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da64da0 0x557b9da7c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.445+0000 7fea1d800640 1 -- 172.21.15.50:0/477777256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da51cd0 msgr2=0x557b9da7c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.445+0000 7fea1d800640 1 --2- 172.21.15.50:0/477777256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da51cd0 0x557b9da7c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.445+0000 7fea1d800640 1 -- 172.21.15.50:0/477777256 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9da4d770 con 0x557b9da513b0 2024-09-10T10:12:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.446+0000 7fea1d800640 1 --2- 172.21.15.50:0/477777256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da513b0 0x557b9da67120 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0a4250 tx=0x7fea0c09b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e170ed1ef3fedfb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:08.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.446+0000 7fea0a000640 1 -- 172.21.15.50:0/477777256 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c065070 con 0x557b9da513b0 2024-09-10T10:12:08.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.446+0000 7fea0a000640 1 -- 172.21.15.50:0/477777256 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea0c0b4070 con 0x557b9da513b0 2024-09-10T10:12:08.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.446+0000 7fea0a000640 1 -- 172.21.15.50:0/477777256 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c097ae0 con 0x557b9da513b0 2024-09-10T10:12:08.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.447+0000 7fea22c7d740 1 -- 172.21.15.50:0/477777256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da513b0 msgr2=0x557b9da67120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:08.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.447+0000 7fea22c7d740 1 --2- 172.21.15.50:0/477777256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da513b0 0x557b9da67120 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0a4250 tx=0x7fea0c09b9b0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.447+0000 7fea22c7d740 1 -- 172.21.15.50:0/477777256 shutdown_connections 2024-09-10T10:12:08.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.447+0000 7fea22c7d740 1 --2- 172.21.15.50:0/477777256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da64da0 0x557b9da7c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.447+0000 7fea22c7d740 1 --2- 172.21.15.50:0/477777256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da51cd0 0x557b9da7c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.447+0000 7fea22c7d740 1 --2- 172.21.15.50:0/477777256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da513b0 0x557b9da67120 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.447+0000 7fea22c7d740 1 -- 172.21.15.50:0/477777256 >> 172.21.15.50:0/477777256 conn(0x557b9da4d940 msgr2=0x557b9da4cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.447+0000 7fea22c7d740 1 -- 172.21.15.50:0/477777256 shutdown_connections 2024-09-10T10:12:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.447+0000 7fea22c7d740 1 -- 172.21.15.50:0/477777256 wait complete. 2024-09-10T10:12:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.448+0000 7fea22c7d740 1 -- start start 2024-09-10T10:12:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.448+0000 7fea22c7d740 1 Processor -- start 2024-09-10T10:12:08.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.449+0000 7fea22c7d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da513b0 0x557b9da6ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.449+0000 7fea22c7d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da51cd0 0x557b9da6b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.449+0000 7fea22c7d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da64da0 0x557b9da6b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.449+0000 7fea22c7d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea181ab1a0 con 0x557b9da64da0 2024-09-10T10:12:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.449+0000 7fea22c7d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fea181ac610 con 0x557b9da513b0 2024-09-10T10:12:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.449+0000 7fea22c7d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fea181ab870 con 0x557b9da51cd0 2024-09-10T10:12:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.449+0000 7fea22c7d740 10 client.0 _ll_register_callbacks cb 0x7fea10034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.449+0000 7fea1ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da51cd0 0x557b9da6b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.449+0000 7fea1ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da51cd0 0x557b9da6b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:57822/0 (socket says 172.21.15.50:57822) 2024-09-10T10:12:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.449+0000 7fea1ce00640 1 -- 172.21.15.50:0/1983645557 learned_addr learned my addr 172.21.15.50:0/1983645557 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.450+0000 7fea1d800640 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da513b0 0x557b9da6ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.450+0000 7fea1ce00640 1 -- 172.21.15.50:0/1983645557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da513b0 msgr2=0x557b9da6ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:08.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.450+0000 7fea1ce00640 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da513b0 0x557b9da6ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.450+0000 7fea1ce00640 1 -- 172.21.15.50:0/1983645557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da64da0 msgr2=0x557b9da6b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.450+0000 7fea1e200640 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da64da0 0x557b9da6b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.450+0000 7fea1ce00640 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da64da0 0x557b9da6b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.450+0000 7fea1ce00640 1 -- 172.21.15.50:0/1983645557 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b9dade520 con 0x557b9da51cd0 2024-09-10T10:12:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.450+0000 7fea1e200640 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da64da0 0x557b9da6b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:12:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.451+0000 7fea1ce00640 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da51cd0 0x557b9da6b1b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea0400b8b0 tx=0x7fea04014840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7537cc8c6fcec698 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.451+0000 7fe9ff400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:12:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.451+0000 7fe9ff400640 1 -- 172.21.15.50:0/1983645557 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea04004250 con 0x557b9da51cd0 2024-09-10T10:12:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.451+0000 7fea22c7d740 1 -- 172.21.15.50:0/1983645557 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea0c0b4070 con 0x557b9da51cd0 2024-09-10T10:12:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.451+0000 7fe9ff400640 1 -- 172.21.15.50:0/1983645557 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fea040043f0 con 0x557b9da51cd0 2024-09-10T10:12:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.452+0000 7fe9ff400640 1 -- 172.21.15.50:0/1983645557 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fea040035f0 con 0x557b9da51cd0 2024-09-10T10:12:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.452+0000 7fea22c7d740 10 client.25384 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:08.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.452+0000 7fea22c7d740 1 -- 172.21.15.50:0/1983645557 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557b9dadf810 con 0x557b9da51cd0 2024-09-10T10:12:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.452+0000 7fe9ff400640 1 -- 172.21.15.50:0/1983645557 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea0c0b4070 con 0x557b9da51cd0 2024-09-10T10:12:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.453+0000 7fe9ff400640 1 -- 172.21.15.50:0/1983645557 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fea04022020 con 0x557b9da51cd0 2024-09-10T10:12:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.453+0000 7fea22c7d740 10 client.25384 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.453+0000 7fea22c7d740 10 client.25384 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:12:08.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.453+0000 7fea22c7d740 20 client.25384 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.453+0000 7fea22c7d740 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557b9dadffe0 0x557b9dae2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.453+0000 7fea22c7d740 4 client.25384 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-10T10:12:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.453+0000 7fea22c7d740 1 -- 172.21.15.50:0/1983645557 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x557b9d9c4c60 con 0x557b9dadffe0 2024-09-10T10:12:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.453+0000 7fea1d800640 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557b9dadffe0 0x557b9dae2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.454+0000 7fe9ff400640 10 client.25384 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:08.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.454+0000 7fea1d800640 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557b9dadffe0 0x557b9dae2400 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7216539e677affc server_cookie=1cbe8fc1d2a63337 in_seq=0 out_seq=0 2024-09-10T10:12:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.465+0000 7fe9ff400640 1 -- 172.21.15.50:0/1983645557 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x557b9d9c4c60 con 0x557b9dadffe0 2024-09-10T10:12:08.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.465+0000 7fe9ff400640 10 client.25384 handle_command_reply: tid=0 2024-09-10T10:12:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.465+0000 7fea22c7d740 1 client.25384 shutdown 2024-09-10T10:12:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.466+0000 7fea22c7d740 1 -- 172.21.15.50:0/1983645557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da51cd0 msgr2=0x557b9da6b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.466+0000 7fea22c7d740 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da51cd0 0x557b9da6b1b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea0400b8b0 tx=0x7fea04014840 comp rx=0 tx=0).stop 2024-09-10T10:12:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.466+0000 7fea22c7d740 1 -- 172.21.15.50:0/1983645557 shutdown_connections 2024-09-10T10:12:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.466+0000 7fea22c7d740 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557b9dadffe0 0x557b9dae2400 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.466+0000 7fea22c7d740 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b9da64da0 0x557b9da6b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.466+0000 7fea22c7d740 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557b9da51cd0 0x557b9da6b1b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.466+0000 7fea22c7d740 1 --2- 172.21.15.50:0/1983645557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b9da513b0 0x557b9da6ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.466+0000 7fea22c7d740 1 -- 172.21.15.50:0/1983645557 >> 172.21.15.50:0/1983645557 conn(0x557b9da4d940 msgr2=0x557b9da55740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.466+0000 7fe9ff400640 0 client.25384 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:08.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.466+0000 7fea22c7d740 1 -- 172.21.15.50:0/1983645557 shutdown_connections 2024-09-10T10:12:08.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.466+0000 7fea22c7d740 1 -- 172.21.15.50:0/1983645557 wait complete. 2024-09-10T10:12:08.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.467+0000 7fea22c7d740 20 client.25384 trim_cache size 0 max 16384 2024-09-10T10:12:08.469 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:12:08.469 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 25, 2024-09-10T10:12:08.469 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24560, 2024-09-10T10:12:08.469 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 2, 2024-09-10T10:12:08.469 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-09-10T10:12:08.470 INFO:teuthology.orchestra.run.smithi050.stdout: "f981f249": { 2024-09-10T10:12:08.470 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 2, 2024-09-10T10:12:08.470 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-09-10T10:12:08.470 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:12:08.470 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-09-10T10:12:08.470 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:12:08.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:12:08.470 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-09-10T10:12:08.470 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 150.0, 2024-09-10T10:12:08.470 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-09-10T10:12:08.470 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-09-10T10:12:08.470 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-09-10T10:12:08.470 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:12:08.471 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-09-10T10:12:08.471 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:12:08.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:08.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:08.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:08.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:08.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:08.471 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:12:08.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.468+0000 7fea20200640 1 -- 172.21.15.50:0/4155515759 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea000a2b80 msgr2=0x7fea000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:08.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.468+0000 7fea20200640 1 --2- 172.21.15.50:0/4155515759 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea000a2b80 0x7fea000a5040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fea10034040 tx=0x7fea10009500 comp rx=0 tx=0).stop 2024-09-10T10:12:08.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.468+0000 7fea20200640 1 -- 172.21.15.50:0/4155515759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea181008c0 msgr2=0x7fea1819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:08.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.468+0000 7fea20200640 1 --2- 172.21.15.50:0/4155515759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea181008c0 0x7fea1819a640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fea0c005fd0 tx=0x7fea0c00ee50 comp rx=0 tx=0).stop 2024-09-10T10:12:08.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.468+0000 7fea20200640 1 -- 172.21.15.50:0/4155515759 shutdown_connections 2024-09-10T10:12:08.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.468+0000 7fea20200640 1 --2- 172.21.15.50:0/4155515759 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fea000a2b80 0x7fea000a5040 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.468+0000 7fea20200640 1 --2- 172.21.15.50:0/4155515759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea1810e470 0x7fea1819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.468+0000 7fea20200640 1 --2- 172.21.15.50:0/4155515759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea18101270 0x7fea1819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.468+0000 7fea20200640 1 --2- 172.21.15.50:0/4155515759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea181008c0 0x7fea1819a640 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:08.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.468+0000 7fea20200640 1 -- 172.21.15.50:0/4155515759 >> 172.21.15.50:0/4155515759 conn(0x7fea180fc790 msgr2=0x7fea180feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:08.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.468+0000 7fea20200640 1 -- 172.21.15.50:0/4155515759 shutdown_connections 2024-09-10T10:12:08.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:08.468+0000 7fea20200640 1 -- 172.21.15.50:0/4155515759 wait complete. 2024-09-10T10:12:09.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:08 smithi189 ceph-mon[34999]: pgmap v419: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:12:09.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:08 smithi084 ceph-mon[34812]: pgmap v419: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:12:09.117 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:08 smithi050 ceph-mon[30354]: pgmap v419: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:12:09.254 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f981f249', quiesce took 5.0 seconds. Will release after: 25.0 2024-09-10T10:12:09.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.829+0000 7f118be00640 1 -- 172.21.15.50:0/1042914774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118c102b90 msgr2=0x7f118c102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:09.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.829+0000 7f118be00640 1 --2- 172.21.15.50:0/1042914774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118c102b90 0x7f118c102f70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f117c009860 tx=0x7f117c02a3d0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.829+0000 7f118be00640 1 -- 172.21.15.50:0/1042914774 shutdown_connections 2024-09-10T10:12:09.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.829+0000 7f118be00640 1 --2- 172.21.15.50:0/1042914774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f118c10bfc0 0x7f118c10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.829+0000 7f118be00640 1 --2- 172.21.15.50:0/1042914774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f118c1034b0 0x7f118c10b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.829+0000 7f118be00640 1 --2- 172.21.15.50:0/1042914774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118c102b90 0x7f118c102f70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.829+0000 7f118be00640 1 -- 172.21.15.50:0/1042914774 >> 172.21.15.50:0/1042914774 conn(0x7f118c0fc610 msgr2=0x7f118c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:09.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.830+0000 7f118be00640 1 -- 172.21.15.50:0/1042914774 shutdown_connections 2024-09-10T10:12:09.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.830+0000 7f118be00640 1 -- 172.21.15.50:0/1042914774 wait complete. 2024-09-10T10:12:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.831+0000 7f118be00640 1 Processor -- start 2024-09-10T10:12:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.831+0000 7f118be00640 1 -- start start 2024-09-10T10:12:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.831+0000 7f118be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f118c102b90 0x7f118c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.831+0000 7f118be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f118c1034b0 0x7f118c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.831+0000 7f118be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118c10bfc0 0x7f118c19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.831+0000 7f118be00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f118c111e10 con 0x7f118c102b90 2024-09-10T10:12:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.831+0000 7f118be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f118c111c90 con 0x7f118c10bfc0 2024-09-10T10:12:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.831+0000 7f118be00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f118c111f90 con 0x7f118c1034b0 2024-09-10T10:12:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.832+0000 7f118aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f118c102b90 0x7f118c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.832+0000 7f118aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f118c102b90 0x7f118c19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38834/0 (socket says 172.21.15.50:38834) 2024-09-10T10:12:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.832+0000 7f118aa00640 1 -- 172.21.15.50:0/1725961356 learned_addr learned my addr 172.21.15.50:0/1725961356 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.832+0000 7f118b400640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118c10bfc0 0x7f118c19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.832+0000 7f1183e00640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f118c1034b0 0x7f118c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.832+0000 7f118aa00640 1 -- 172.21.15.50:0/1725961356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f118c1034b0 msgr2=0x7f118c19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:09.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.832+0000 7f118aa00640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f118c1034b0 0x7f118c19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.832+0000 7f118aa00640 1 -- 172.21.15.50:0/1725961356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118c10bfc0 msgr2=0x7f118c19ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:09.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.832+0000 7f118aa00640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118c10bfc0 0x7f118c19ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.832+0000 7f118aa00640 1 -- 172.21.15.50:0/1725961356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c19f450 con 0x7f118c102b90 2024-09-10T10:12:09.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.832+0000 7f118b400640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118c10bfc0 0x7f118c19ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:09.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.832+0000 7f118aa00640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f118c102b90 0x7f118c19a4a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f117c009980 tx=0x7f117c0309a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.833+0000 7f1190a00640 1 -- 172.21.15.50:0/1725961356 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c040070 con 0x7f118c102b90 2024-09-10T10:12:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.833+0000 7f1190a00640 1 -- 172.21.15.50:0/1725961356 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117c005620 con 0x7f118c102b90 2024-09-10T10:12:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.833+0000 7f118be00640 1 -- 172.21.15.50:0/1725961356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118c19f6e0 con 0x7f118c102b90 2024-09-10T10:12:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.833+0000 7f1190a00640 1 -- 172.21.15.50:0/1725961356 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c0049b0 con 0x7f118c102b90 2024-09-10T10:12:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.833+0000 7f118be00640 1 -- 172.21.15.50:0/1725961356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f118c1a7020 con 0x7f118c102b90 2024-09-10T10:12:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.837+0000 7f1190a00640 1 -- 172.21.15.50:0/1725961356 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f117c043070 con 0x7f118c102b90 2024-09-10T10:12:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.838+0000 7f1194a54740 1 Processor -- start 2024-09-10T10:12:09.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.838+0000 7f1194a54740 1 -- start start 2024-09-10T10:12:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.838+0000 7f1194a54740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de8e40 0x562694de9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.838+0000 7f1194a54740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 0x562694df3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.838+0000 7f1194a54740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694df4020 0x562694df6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.838+0000 7f1194a54740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562694d4f3e0 con 0x562694de8e40 2024-09-10T10:12:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.838+0000 7f1194a54740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562694cf6d80 con 0x562694de9760 2024-09-10T10:12:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.838+0000 7f1194a54740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562694d4b3a0 con 0x562694df4020 2024-09-10T10:12:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.839+0000 7f118aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 0x562694df3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.839+0000 7f118aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 0x562694df3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:38662/0 (socket says 172.21.15.50:38662) 2024-09-10T10:12:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.839+0000 7f118aa00640 1 -- 172.21.15.50:0/3885982191 learned_addr learned my addr 172.21.15.50:0/3885982191 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:09.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.839+0000 7f118b400640 1 --2- 172.21.15.50:0/3885982191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de8e40 0x562694de9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.839+0000 7f118aa00640 1 -- 172.21.15.50:0/3885982191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694df4020 msgr2=0x562694df6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.839+0000 7f118aa00640 1 --2- 172.21.15.50:0/3885982191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694df4020 0x562694df6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.839+0000 7f118aa00640 1 -- 172.21.15.50:0/3885982191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de8e40 msgr2=0x562694de9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.839+0000 7f118aa00640 1 --2- 172.21.15.50:0/3885982191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de8e40 0x562694de9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.839+0000 7f118aa00640 1 -- 172.21.15.50:0/3885982191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562694d15ae0 con 0x562694de9760 2024-09-10T10:12:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.839+0000 7f118b400640 1 --2- 172.21.15.50:0/3885982191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de8e40 0x562694de9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:12:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.839+0000 7f1190a00640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f11700a2c00 0x7f11700a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.840+0000 7f118aa00640 1 --2- 172.21.15.50:0/3885982191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 0x562694df3ae0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f117c0f82a0 tx=0x7f117c0f8390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c34ef7c25d9f3ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.840+0000 7f117be00640 1 -- 172.21.15.50:0/3885982191 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c0b88e0 con 0x562694de9760 2024-09-10T10:12:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.840+0000 7f1190a00640 1 -- 172.21.15.50:0/1725961356 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f117c0f0120 con 0x7f118c102b90 2024-09-10T10:12:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.840+0000 7f118b400640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f11700a2c00 0x7f11700a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.840+0000 7f117be00640 1 -- 172.21.15.50:0/3885982191 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117c095420 con 0x562694de9760 2024-09-10T10:12:09.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.840+0000 7f117be00640 1 -- 172.21.15.50:0/3885982191 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c0bbfa0 con 0x562694de9760 2024-09-10T10:12:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.841+0000 7f1194a54740 1 -- 172.21.15.50:0/3885982191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 msgr2=0x562694df3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.841+0000 7f1194a54740 1 --2- 172.21.15.50:0/3885982191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 0x562694df3ae0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f117c0f82a0 tx=0x7f117c0f8390 comp rx=0 tx=0).stop 2024-09-10T10:12:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.841+0000 7f118b400640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f11700a2c00 0x7f11700a50c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1184005fd0 tx=0x7f1184009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:09.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.841+0000 7f1194a54740 1 -- 172.21.15.50:0/3885982191 shutdown_connections 2024-09-10T10:12:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.841+0000 7f1194a54740 1 --2- 172.21.15.50:0/3885982191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694df4020 0x562694df6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.841+0000 7f1194a54740 1 --2- 172.21.15.50:0/3885982191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 0x562694df3ae0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.841+0000 7f1194a54740 1 --2- 172.21.15.50:0/3885982191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de8e40 0x562694de9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.841+0000 7f1194a54740 1 -- 172.21.15.50:0/3885982191 >> 172.21.15.50:0/3885982191 conn(0x562694de53d0 msgr2=0x562694de57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.841+0000 7f1194a54740 1 -- 172.21.15.50:0/3885982191 shutdown_connections 2024-09-10T10:12:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.841+0000 7f1194a54740 1 -- 172.21.15.50:0/3885982191 wait complete. 2024-09-10T10:12:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.842+0000 7f1194a54740 1 -- start start 2024-09-10T10:12:09.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.842+0000 7f1194a54740 1 Processor -- start 2024-09-10T10:12:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.843+0000 7f1194a54740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694de8e40 0x562694df0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.843+0000 7f1194a54740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de9760 0x562694df14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.843+0000 7f1194a54740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694df4020 0x562694df19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.843+0000 7f1194a54740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562694df69b0 con 0x562694de9760 2024-09-10T10:12:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.843+0000 7f1194a54740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562694d0a0f0 con 0x562694df4020 2024-09-10T10:12:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.843+0000 7f1194a54740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562694df6b30 con 0x562694de8e40 2024-09-10T10:12:09.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.843+0000 7f1194a54740 10 client.0 _ll_register_callbacks cb 0x562694cf1bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.843+0000 7f118aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694de8e40 0x562694df0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.843+0000 7f1183e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de9760 0x562694df14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.843+0000 7f118aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694de8e40 0x562694df0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:57848/0 (socket says 172.21.15.50:57848) 2024-09-10T10:12:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.843+0000 7f118aa00640 1 -- 172.21.15.50:0/446462256 learned_addr learned my addr 172.21.15.50:0/446462256 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.843+0000 7f118b400640 1 --2- 172.21.15.50:0/446462256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694df4020 0x562694df19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.844+0000 7f118aa00640 1 -- 172.21.15.50:0/446462256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694df4020 msgr2=0x562694df19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.844+0000 7f118aa00640 1 --2- 172.21.15.50:0/446462256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694df4020 0x562694df19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.844+0000 7f118aa00640 1 -- 172.21.15.50:0/446462256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de9760 msgr2=0x562694df14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.844+0000 7f118aa00640 1 --2- 172.21.15.50:0/446462256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de9760 0x562694df14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.844+0000 7f118aa00640 1 -- 172.21.15.50:0/446462256 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562694ac03c0 con 0x562694de8e40 2024-09-10T10:12:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.844+0000 7f118aa00640 1 --2- 172.21.15.50:0/446462256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694de8e40 0x562694df0f70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f117c000c00 tx=0x7f117c004520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=521ec5307bce2c5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:09.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.844+0000 7f1178c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:12:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.844+0000 7f1178c00640 1 -- 172.21.15.50:0/446462256 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c04a070 con 0x562694de8e40 2024-09-10T10:12:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.844+0000 7f1194a54740 1 -- 172.21.15.50:0/446462256 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f117c095420 con 0x562694de8e40 2024-09-10T10:12:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.844+0000 7f1178c00640 1 -- 172.21.15.50:0/446462256 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f117c031400 con 0x562694de8e40 2024-09-10T10:12:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.845+0000 7f1178c00640 1 -- 172.21.15.50:0/446462256 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f117c0bc180 con 0x562694de8e40 2024-09-10T10:12:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.845+0000 7f1194a54740 10 client.25393 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.845+0000 7f1194a54740 1 -- 172.21.15.50:0/446462256 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562694df69b0 con 0x562694de8e40 2024-09-10T10:12:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.845+0000 7f1178c00640 1 -- 172.21.15.50:0/446462256 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117c095420 con 0x562694de8e40 2024-09-10T10:12:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.845+0000 7f1178c00640 1 -- 172.21.15.50:0/446462256 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f117c031620 con 0x562694de8e40 2024-09-10T10:12:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.845+0000 7f1194a54740 10 client.25393 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.845+0000 7f1194a54740 10 client.25393 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:12:09.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.845+0000 7f1194a54740 20 client.25393 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.845+0000 7f1194a54740 1 --2- 172.21.15.50:0/446462256 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562694e0c2c0 0x562694e0e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.845+0000 7f1194a54740 4 client.25393 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:12:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.845+0000 7f1194a54740 1 -- 172.21.15.50:0/446462256 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562694d5c950 con 0x562694e0c2c0 2024-09-10T10:12:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.846+0000 7f1183e00640 1 --2- 172.21.15.50:0/446462256 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562694e0c2c0 0x562694e0e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.846+0000 7f1183e00640 1 --2- 172.21.15.50:0/446462256 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562694e0c2c0 0x562694e0e6b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=355d9d75d4a3a026 server_cookie=d57a3711bf858cab in_seq=0 out_seq=0 2024-09-10T10:12:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.846+0000 7f1178c00640 10 client.25393 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:12:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.847+0000 7f1178c00640 1 -- 172.21.15.50:0/446462256 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562694d5c950 con 0x562694e0c2c0 2024-09-10T10:12:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.847+0000 7f1178c00640 10 client.25393 handle_command_reply: tid=0 2024-09-10T10:12:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.847+0000 7f1194a54740 1 client.25393 shutdown 2024-09-10T10:12:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.848+0000 7f1194a54740 1 -- 172.21.15.50:0/446462256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694de8e40 msgr2=0x562694df0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.848+0000 7f1194a54740 1 --2- 172.21.15.50:0/446462256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694de8e40 0x562694df0f70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f117c000c00 tx=0x7f117c004520 comp rx=0 tx=0).stop 2024-09-10T10:12:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.848+0000 7f1194a54740 1 -- 172.21.15.50:0/446462256 shutdown_connections 2024-09-10T10:12:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.848+0000 7f1194a54740 1 --2- 172.21.15.50:0/446462256 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562694e0c2c0 0x562694e0e6b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.848+0000 7f1194a54740 1 --2- 172.21.15.50:0/446462256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694df4020 0x562694df19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.848+0000 7f1194a54740 1 --2- 172.21.15.50:0/446462256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de9760 0x562694df14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.848+0000 7f1194a54740 1 --2- 172.21.15.50:0/446462256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694de8e40 0x562694df0f70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.848+0000 7f1194a54740 1 -- 172.21.15.50:0/446462256 >> 172.21.15.50:0/446462256 conn(0x562694de53d0 msgr2=0x562694deb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.848+0000 7f1178c00640 0 client.25393 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:12:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.848+0000 7f1194a54740 1 -- 172.21.15.50:0/446462256 shutdown_connections 2024-09-10T10:12:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.848+0000 7f1194a54740 1 -- 172.21.15.50:0/446462256 wait complete. 2024-09-10T10:12:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.848+0000 7f1194a54740 20 client.25393 trim_cache size 0 max 16384 2024-09-10T10:12:09.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.862+0000 7f1194a54740 1 Processor -- start 2024-09-10T10:12:09.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.862+0000 7f1194a54740 1 -- start start 2024-09-10T10:12:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.862+0000 7f1194a54740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694de8e40 0x562694dec2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.862+0000 7f1194a54740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 0x562694e13f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.862+0000 7f1194a54740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694df4020 0x562694e14470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.862+0000 7f1194a54740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f118c1af250 con 0x562694df4020 2024-09-10T10:12:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.862+0000 7f1194a54740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f118c1acb20 con 0x562694de9760 2024-09-10T10:12:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.862+0000 7f1194a54740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f118c1aa9b0 con 0x562694de8e40 2024-09-10T10:12:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.862+0000 7f1183e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 0x562694e13f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.863+0000 7f118b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694df4020 0x562694e14470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.863+0000 7f1183e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 0x562694e13f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:38674/0 (socket says 172.21.15.50:38674) 2024-09-10T10:12:09.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.863+0000 7f1183e00640 1 -- 172.21.15.50:0/4230397227 learned_addr learned my addr 172.21.15.50:0/4230397227 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:09.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.863+0000 7f118aa00640 1 --2- 172.21.15.50:0/4230397227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694de8e40 0x562694dec2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.863+0000 7f1183e00640 1 -- 172.21.15.50:0/4230397227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694de8e40 msgr2=0x562694dec2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:09.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.863+0000 7f1183e00640 1 --2- 172.21.15.50:0/4230397227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694de8e40 0x562694dec2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.863+0000 7f1183e00640 1 -- 172.21.15.50:0/4230397227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694df4020 msgr2=0x562694e14470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:09.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.863+0000 7f1183e00640 1 --2- 172.21.15.50:0/4230397227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694df4020 0x562694e14470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.863+0000 7f1183e00640 1 -- 172.21.15.50:0/4230397227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562694de6560 con 0x562694de9760 2024-09-10T10:12:09.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.863+0000 7f1183e00640 1 --2- 172.21.15.50:0/4230397227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 0x562694e13f30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x562694de6750 tx=0x7f1174009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9b3b0ff018661f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:09.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.864+0000 7f117b400640 1 -- 172.21.15.50:0/4230397227 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117401c420 con 0x562694de9760 2024-09-10T10:12:09.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.864+0000 7f117b400640 1 -- 172.21.15.50:0/4230397227 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117401caa0 con 0x562694de9760 2024-09-10T10:12:09.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.864+0000 7f117b400640 1 -- 172.21.15.50:0/4230397227 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117401bb10 con 0x562694de9760 2024-09-10T10:12:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.865+0000 7f1194a54740 1 -- 172.21.15.50:0/4230397227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 msgr2=0x562694e13f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.865+0000 7f1194a54740 1 --2- 172.21.15.50:0/4230397227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 0x562694e13f30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x562694de6750 tx=0x7f1174009f90 comp rx=0 tx=0).stop 2024-09-10T10:12:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.865+0000 7f1194a54740 1 -- 172.21.15.50:0/4230397227 shutdown_connections 2024-09-10T10:12:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.865+0000 7f1194a54740 1 --2- 172.21.15.50:0/4230397227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694df4020 0x562694e14470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.865+0000 7f1194a54740 1 --2- 172.21.15.50:0/4230397227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de9760 0x562694e13f30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.865+0000 7f1194a54740 1 --2- 172.21.15.50:0/4230397227 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694de8e40 0x562694dec2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.865+0000 7f1194a54740 1 -- 172.21.15.50:0/4230397227 >> 172.21.15.50:0/4230397227 conn(0x562694de53d0 msgr2=0x562694de4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.865+0000 7f1194a54740 1 -- 172.21.15.50:0/4230397227 shutdown_connections 2024-09-10T10:12:09.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.865+0000 7f1194a54740 1 -- 172.21.15.50:0/4230397227 wait complete. 2024-09-10T10:12:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.865+0000 7f1194a54740 1 -- start start 2024-09-10T10:12:09.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.866+0000 7f1194a54740 1 Processor -- start 2024-09-10T10:12:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.866+0000 7f1194a54740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de8e40 0x562694e04c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.866+0000 7f1194a54740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de9760 0x562694dfffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.866+0000 7f1194a54740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694df4020 0x562694e004f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.866+0000 7f1194a54740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f118c1ab000 con 0x562694de9760 2024-09-10T10:12:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.866+0000 7f1194a54740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f118c1ac450 con 0x562694de8e40 2024-09-10T10:12:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.866+0000 7f1194a54740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f118c1ab6b0 con 0x562694df4020 2024-09-10T10:12:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.866+0000 7f1194a54740 10 client.0 _ll_register_callbacks cb 0x7f117c090070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.866+0000 7f118aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de8e40 0x562694e04c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f118aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de8e40 0x562694e04c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:38690/0 (socket says 172.21.15.50:38690) 2024-09-10T10:12:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f118aa00640 1 -- 172.21.15.50:0/2548181807 learned_addr learned my addr 172.21.15.50:0/2548181807 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f1183e00640 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de9760 0x562694dfffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f118b400640 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694df4020 0x562694e004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f118aa00640 1 -- 172.21.15.50:0/2548181807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694df4020 msgr2=0x562694e004f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f118aa00640 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694df4020 0x562694e004f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f118aa00640 1 -- 172.21.15.50:0/2548181807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de9760 msgr2=0x562694dfffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f118aa00640 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de9760 0x562694dfffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f118aa00640 1 -- 172.21.15.50:0/2548181807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562694e00cd0 con 0x562694de8e40 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f118b400640 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694df4020 0x562694e004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f118aa00640 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de8e40 0x562694e04c80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f117c009230 tx=0x7f117c0f8390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81fa12ee09fb93aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f1178c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f1178c00640 1 -- 172.21.15.50:0/2548181807 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c04a040 con 0x562694de8e40 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f1178c00640 1 -- 172.21.15.50:0/2548181807 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f117c031400 con 0x562694de8e40 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.867+0000 7f1194a54740 1 -- 172.21.15.50:0/2548181807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f117401caa0 con 0x562694de8e40 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.868+0000 7f1178c00640 1 -- 172.21.15.50:0/2548181807 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f117c0bc410 con 0x562694de8e40 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.868+0000 7f1194a54740 10 client.25433 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:09.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.868+0000 7f1194a54740 1 -- 172.21.15.50:0/2548181807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562694e00cd0 con 0x562694de8e40 2024-09-10T10:12:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.868+0000 7f1178c00640 1 -- 172.21.15.50:0/2548181807 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117401caa0 con 0x562694de8e40 2024-09-10T10:12:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.868+0000 7f1178c00640 1 -- 172.21.15.50:0/2548181807 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f117c0f3940 con 0x562694de8e40 2024-09-10T10:12:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.868+0000 7f1194a54740 10 client.25433 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.868+0000 7f1194a54740 10 client.25433 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:12:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.868+0000 7f1194a54740 20 client.25433 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.868+0000 7f1194a54740 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562694e77210 0x562694e79600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.868+0000 7f1194a54740 4 client.25433 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:12:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.868+0000 7f1194a54740 1 -- 172.21.15.50:0/2548181807 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562694d56e60 con 0x562694e77210 2024-09-10T10:12:09.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.868+0000 7f1183e00640 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562694e77210 0x562694e79600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1183e00640 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562694e77210 0x562694e79600 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e8c5689e4d9cd892 server_cookie=345b24d0c630506b in_seq=0 out_seq=0 2024-09-10T10:12:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1178c00640 10 client.25433 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:12:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1178c00640 1 -- 172.21.15.50:0/2548181807 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562694d56e60 con 0x562694e77210 2024-09-10T10:12:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1178c00640 10 client.25433 handle_command_reply: tid=0 2024-09-10T10:12:09.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1194a54740 1 client.25433 shutdown 2024-09-10T10:12:09.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1194a54740 1 -- 172.21.15.50:0/2548181807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de8e40 msgr2=0x562694e04c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:09.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1194a54740 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de8e40 0x562694e04c80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f117c009230 tx=0x7f117c0f8390 comp rx=0 tx=0).stop 2024-09-10T10:12:09.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1194a54740 1 -- 172.21.15.50:0/2548181807 shutdown_connections 2024-09-10T10:12:09.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1194a54740 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562694e77210 0x562694e79600 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1194a54740 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562694df4020 0x562694e004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1194a54740 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562694de9760 0x562694dfffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1194a54740 1 --2- 172.21.15.50:0/2548181807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562694de8e40 0x562694e04c80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1194a54740 1 -- 172.21.15.50:0/2548181807 >> 172.21.15.50:0/2548181807 conn(0x562694de53d0 msgr2=0x562694def710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:09.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.869+0000 7f1178c00640 0 client.25433 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:12:09.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.870+0000 7f1194a54740 1 -- 172.21.15.50:0/2548181807 shutdown_connections 2024-09-10T10:12:09.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.870+0000 7f1194a54740 1 -- 172.21.15.50:0/2548181807 wait complete. 2024-09-10T10:12:09.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.870+0000 7f1194a54740 20 client.25433 trim_cache size 0 max 16384 2024-09-10T10:12:09.876 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:12:09.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.870+0000 7f118be00640 1 -- 172.21.15.50:0/1725961356 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f11700a2c00 msgr2=0x7f11700a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:09.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.870+0000 7f118be00640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f11700a2c00 0x7f11700a50c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1184005fd0 tx=0x7f1184009500 comp rx=0 tx=0).stop 2024-09-10T10:12:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.870+0000 7f118be00640 1 -- 172.21.15.50:0/1725961356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f118c102b90 msgr2=0x7f118c19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.870+0000 7f118be00640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f118c102b90 0x7f118c19a4a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f117c009980 tx=0x7f117c0309a0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.871+0000 7f118be00640 1 -- 172.21.15.50:0/1725961356 shutdown_connections 2024-09-10T10:12:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.871+0000 7f118be00640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f11700a2c00 0x7f11700a50c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.871+0000 7f118be00640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f118c10bfc0 0x7f118c19ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.871+0000 7f118be00640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f118c1034b0 0x7f118c19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.871+0000 7f118be00640 1 --2- 172.21.15.50:0/1725961356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f118c102b90 0x7f118c19a4a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.871+0000 7f118be00640 1 -- 172.21.15.50:0/1725961356 >> 172.21.15.50:0/1725961356 conn(0x7f118c0fc610 msgr2=0x7f118c10d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.871+0000 7f118be00640 1 -- 172.21.15.50:0/1725961356 shutdown_connections 2024-09-10T10:12:09.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:09.871+0000 7f118be00640 1 -- 172.21.15.50:0/1725961356 wait complete. 2024-09-10T10:12:10.753 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T10:12:11.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:10 smithi189 ceph-mon[34999]: pgmap v420: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:12:11.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:10 smithi084 ceph-mon[34812]: pgmap v420: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:12:11.159 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:11.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:10 smithi050 ceph-mon[30354]: pgmap v420: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:12:11.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.729+0000 7f2512000640 1 -- 172.21.15.50:0/2658998197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f250c074e30 msgr2=0x7f250c10df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:11.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.729+0000 7f2512000640 1 --2- 172.21.15.50:0/2658998197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f250c074e30 0x7f250c10df10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009900 tx=0x7f24f802a480 comp rx=0 tx=0).stop 2024-09-10T10:12:11.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.729+0000 7f2512000640 1 -- 172.21.15.50:0/2658998197 shutdown_connections 2024-09-10T10:12:11.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.729+0000 7f2512000640 1 --2- 172.21.15.50:0/2658998197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f250c10e450 0x7f250c110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.729+0000 7f2512000640 1 --2- 172.21.15.50:0/2658998197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f250c074e30 0x7f250c10df10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.729+0000 7f2512000640 1 --2- 172.21.15.50:0/2658998197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f250c074510 0x7f250c0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.729+0000 7f2512000640 1 -- 172.21.15.50:0/2658998197 >> 172.21.15.50:0/2658998197 conn(0x7f250c0fd8b0 msgr2=0x7f250c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.729+0000 7f2512000640 1 -- 172.21.15.50:0/2658998197 shutdown_connections 2024-09-10T10:12:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.729+0000 7f2512000640 1 -- 172.21.15.50:0/2658998197 wait complete. 2024-09-10T10:12:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.730+0000 7f2512000640 1 Processor -- start 2024-09-10T10:12:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.731+0000 7f2512000640 1 -- start start 2024-09-10T10:12:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.731+0000 7f2512000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f250c074510 0x7f250c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.731+0000 7f2512000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f250c074e30 0x7f250c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.731+0000 7f2512000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f250c10e450 0x7f250c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.731+0000 7f2512000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f250c1141c0 con 0x7f250c10e450 2024-09-10T10:12:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.731+0000 7f2512000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f250c114040 con 0x7f250c074e30 2024-09-10T10:12:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.731+0000 7f2512000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f250c114340 con 0x7f250c074510 2024-09-10T10:12:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.731+0000 7f250b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f250c074510 0x7f250c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.731+0000 7f250b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f250c074510 0x7f250c19a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:57874/0 (socket says 172.21.15.50:57874) 2024-09-10T10:12:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.731+0000 7f250be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f250c10e450 0x7f250c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.731+0000 7f250b400640 1 -- 172.21.15.50:0/3227722644 learned_addr learned my addr 172.21.15.50:0/3227722644 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.732+0000 7f250aa00640 1 --2- 172.21.15.50:0/3227722644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f250c074e30 0x7f250c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.732+0000 7f250b400640 1 -- 172.21.15.50:0/3227722644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f250c074e30 msgr2=0x7f250c19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.732+0000 7f250b400640 1 --2- 172.21.15.50:0/3227722644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f250c074e30 0x7f250c19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.732+0000 7f250b400640 1 -- 172.21.15.50:0/3227722644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f250c10e450 msgr2=0x7f250c19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.732+0000 7f250b400640 1 --2- 172.21.15.50:0/3227722644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f250c10e450 0x7f250c19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.732+0000 7f250b400640 1 -- 172.21.15.50:0/3227722644 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250c19f640 con 0x7f250c074510 2024-09-10T10:12:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.732+0000 7f250b400640 1 --2- 172.21.15.50:0/3227722644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f250c074510 0x7f250c19a690 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00ea60 tx=0x7f24fc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.732+0000 7f2503e00640 1 -- 172.21.15.50:0/3227722644 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00cde0 con 0x7f250c074510 2024-09-10T10:12:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.733+0000 7f2503e00640 1 -- 172.21.15.50:0/3227722644 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24fc0035f0 con 0x7f250c074510 2024-09-10T10:12:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.733+0000 7f2503e00640 1 -- 172.21.15.50:0/3227722644 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc010670 con 0x7f250c074510 2024-09-10T10:12:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.733+0000 7f2512000640 1 -- 172.21.15.50:0/3227722644 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250c19f930 con 0x7f250c074510 2024-09-10T10:12:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.733+0000 7f2512000640 1 -- 172.21.15.50:0/3227722644 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250c1a7210 con 0x7f250c074510 2024-09-10T10:12:11.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.737+0000 7f2503e00640 1 -- 172.21.15.50:0/3227722644 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f24fc0037a0 con 0x7f250c074510 2024-09-10T10:12:11.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.737+0000 7f2514a5e740 1 Processor -- start 2024-09-10T10:12:11.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.737+0000 7f2514a5e740 1 -- start start 2024-09-10T10:12:11.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.737+0000 7f2514a5e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 0x558c3542d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.737+0000 7f2514a5e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3542d590 0x558c35437910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.738+0000 7f2514a5e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c35437e50 0x558c3543a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.738+0000 7f2514a5e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558c353933e0 con 0x558c3542d590 2024-09-10T10:12:11.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.738+0000 7f2514a5e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558c3533ad80 con 0x558c35437e50 2024-09-10T10:12:11.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.738+0000 7f2514a5e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558c3538f3a0 con 0x558c3542cc70 2024-09-10T10:12:11.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.738+0000 7f250b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3542d590 0x558c35437910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.738+0000 7f250aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c35437e50 0x558c3543a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.738+0000 7f250aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c35437e50 0x558c3543a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:38722/0 (socket says 172.21.15.50:38722) 2024-09-10T10:12:11.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.738+0000 7f250aa00640 1 -- 172.21.15.50:0/1052244973 learned_addr learned my addr 172.21.15.50:0/1052244973 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.738+0000 7f250be00640 1 --2- 172.21.15.50:0/1052244973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 0x558c3542d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.738+0000 7f2503e00640 1 --2- 172.21.15.50:0/3227722644 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f24f00a2b80 0x7f24f00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.739+0000 7f250aa00640 1 -- 172.21.15.50:0/1052244973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 msgr2=0x558c3542d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.739+0000 7f250aa00640 1 --2- 172.21.15.50:0/1052244973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 0x558c3542d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.739+0000 7f250aa00640 1 -- 172.21.15.50:0/1052244973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3542d590 msgr2=0x558c35437910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.739+0000 7f2503e00640 1 -- 172.21.15.50:0/3227722644 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f24fc0cf700 con 0x7f250c074510 2024-09-10T10:12:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.739+0000 7f250aa00640 1 --2- 172.21.15.50:0/1052244973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3542d590 0x558c35437910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.739+0000 7f250aa00640 1 -- 172.21.15.50:0/1052244973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c35359ae0 con 0x558c35437e50 2024-09-10T10:12:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.739+0000 7f250be00640 1 --2- 172.21.15.50:0/3227722644 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f24f00a2b80 0x7f24f00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.739+0000 7f250aa00640 1 --2- 172.21.15.50:0/1052244973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c35437e50 0x558c3543a240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009900 tx=0x7f24f8005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63af5b3f8c66a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.740+0000 7f24f7e00640 1 -- 172.21.15.50:0/1052244973 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8035040 con 0x558c35437e50 2024-09-10T10:12:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.740+0000 7f24f7e00640 1 -- 172.21.15.50:0/1052244973 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24f8004400 con 0x558c35437e50 2024-09-10T10:12:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.740+0000 7f24f7e00640 1 -- 172.21.15.50:0/1052244973 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f80035f0 con 0x558c35437e50 2024-09-10T10:12:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.740+0000 7f2514a5e740 1 -- 172.21.15.50:0/1052244973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c35437e50 msgr2=0x558c3543a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.740+0000 7f2514a5e740 1 --2- 172.21.15.50:0/1052244973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c35437e50 0x558c3543a240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009900 tx=0x7f24f8005de0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.740+0000 7f250be00640 1 --2- 172.21.15.50:0/3227722644 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f24f00a2b80 0x7f24f00a5040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2504005c40 tx=0x7f2504004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.741+0000 7f2514a5e740 1 -- 172.21.15.50:0/1052244973 shutdown_connections 2024-09-10T10:12:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.741+0000 7f2514a5e740 1 --2- 172.21.15.50:0/1052244973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c35437e50 0x558c3543a240 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.741+0000 7f2514a5e740 1 --2- 172.21.15.50:0/1052244973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3542d590 0x558c35437910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.741+0000 7f2514a5e740 1 --2- 172.21.15.50:0/1052244973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 0x558c3542d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.741+0000 7f2514a5e740 1 -- 172.21.15.50:0/1052244973 >> 172.21.15.50:0/1052244973 conn(0x558c35429200 msgr2=0x558c354295e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.741+0000 7f2514a5e740 1 -- 172.21.15.50:0/1052244973 shutdown_connections 2024-09-10T10:12:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.741+0000 7f2514a5e740 1 -- 172.21.15.50:0/1052244973 wait complete. 2024-09-10T10:12:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.741+0000 7f2514a5e740 1 -- start start 2024-09-10T10:12:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.741+0000 7f2514a5e740 1 Processor -- start 2024-09-10T10:12:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.742+0000 7f2514a5e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 0x558c35434d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.742+0000 7f2514a5e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c35435260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.742+0000 7f2514a5e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c35437e50 0x558c354357a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.742+0000 7f2514a5e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558c3543aa20 con 0x558c35437e50 2024-09-10T10:12:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.742+0000 7f2514a5e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558c3534e0f0 con 0x558c3542d590 2024-09-10T10:12:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.742+0000 7f2514a5e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558c3543aba0 con 0x558c3542cc70 2024-09-10T10:12:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.742+0000 7f2514a5e740 10 client.0 _ll_register_callbacks cb 0x558c35335bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.742+0000 7f250aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c35435260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.742+0000 7f250aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c35435260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:38726/0 (socket says 172.21.15.50:38726) 2024-09-10T10:12:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.742+0000 7f250aa00640 1 -- 172.21.15.50:0/2353993658 learned_addr learned my addr 172.21.15.50:0/2353993658 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.743+0000 7f250b400640 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 0x558c35434d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.743+0000 7f250be00640 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c35437e50 0x558c354357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.743+0000 7f250aa00640 1 -- 172.21.15.50:0/2353993658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 msgr2=0x558c35434d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.743+0000 7f250aa00640 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 0x558c35434d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.743+0000 7f250aa00640 1 -- 172.21.15.50:0/2353993658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c35437e50 msgr2=0x558c354357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.743+0000 7f250aa00640 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c35437e50 0x558c354357a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.743+0000 7f250aa00640 1 -- 172.21.15.50:0/2353993658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c351043c0 con 0x558c3542d590 2024-09-10T10:12:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.743+0000 7f250be00640 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c35437e50 0x558c354357a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:12:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.743+0000 7f250aa00640 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c35435260 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f24f80048f0 tx=0x7f24f802a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14e3e52ca8265b71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.743+0000 7f24f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:12:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.744+0000 7f24f4c00640 1 -- 172.21.15.50:0/2353993658 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8052060 con 0x558c3542d590 2024-09-10T10:12:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.744+0000 7f2514a5e740 1 -- 172.21.15.50:0/2353993658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24f8004400 con 0x558c3542d590 2024-09-10T10:12:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.744+0000 7f24f4c00640 1 -- 172.21.15.50:0/2353993658 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f24f8004200 con 0x558c3542d590 2024-09-10T10:12:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.744+0000 7f24f4c00640 1 -- 172.21.15.50:0/2353993658 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f24f8059050 con 0x558c3542d590 2024-09-10T10:12:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.744+0000 7f2514a5e740 10 client.25445 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.744+0000 7f2514a5e740 1 -- 172.21.15.50:0/2353993658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558c3544f250 con 0x558c3542d590 2024-09-10T10:12:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.744+0000 7f24f4c00640 1 -- 172.21.15.50:0/2353993658 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24f8004400 con 0x558c3542d590 2024-09-10T10:12:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.744+0000 7f24f4c00640 1 -- 172.21.15.50:0/2353993658 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f24f80038d0 con 0x558c3542d590 2024-09-10T10:12:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.745+0000 7f2514a5e740 10 client.25445 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.745+0000 7f2514a5e740 10 client.25445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:12:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.745+0000 7f2514a5e740 20 client.25445 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.745+0000 7f2514a5e740 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x558c354505a0 0x558c35452990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.745+0000 7f2514a5e740 4 client.25445 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:12:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.745+0000 7f2514a5e740 1 -- 172.21.15.50:0/2353993658 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c353a0950 con 0x558c354505a0 2024-09-10T10:12:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.745+0000 7f250b400640 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x558c354505a0 0x558c35452990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.746+0000 7f24f4c00640 10 client.25445 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.746+0000 7f250b400640 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x558c354505a0 0x558c35452990 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f053937b3ca45b34 server_cookie=6fe034ef91e796bb in_seq=0 out_seq=0 2024-09-10T10:12:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.746+0000 7f24f4c00640 1 -- 172.21.15.50:0/2353993658 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c353a0950 con 0x558c354505a0 2024-09-10T10:12:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.746+0000 7f24f4c00640 10 client.25445 handle_command_reply: tid=0 2024-09-10T10:12:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.746+0000 7f2514a5e740 1 client.25445 shutdown 2024-09-10T10:12:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.747+0000 7f2514a5e740 1 -- 172.21.15.50:0/2353993658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 msgr2=0x558c35435260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.747+0000 7f2514a5e740 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c35435260 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f24f80048f0 tx=0x7f24f802a480 comp rx=0 tx=0).stop 2024-09-10T10:12:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.747+0000 7f2514a5e740 1 -- 172.21.15.50:0/2353993658 shutdown_connections 2024-09-10T10:12:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.747+0000 7f2514a5e740 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x558c354505a0 0x558c35452990 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.747+0000 7f2514a5e740 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c35437e50 0x558c354357a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.747+0000 7f2514a5e740 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c35435260 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.747+0000 7f2514a5e740 1 --2- 172.21.15.50:0/2353993658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 0x558c35434d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.747+0000 7f24f4c00640 0 client.25445 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.747+0000 7f2514a5e740 1 -- 172.21.15.50:0/2353993658 >> 172.21.15.50:0/2353993658 conn(0x558c35429200 msgr2=0x558c3542ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.747+0000 7f2514a5e740 1 -- 172.21.15.50:0/2353993658 shutdown_connections 2024-09-10T10:12:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.747+0000 7f2514a5e740 1 -- 172.21.15.50:0/2353993658 wait complete. 2024-09-10T10:12:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.747+0000 7f2514a5e740 20 client.25445 trim_cache size 0 max 16384 2024-09-10T10:12:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.761+0000 7f2514a5e740 1 Processor -- start 2024-09-10T10:12:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.761+0000 7f2514a5e740 1 -- start start 2024-09-10T10:12:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.762+0000 7f2514a5e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3542cc70 0x558c35428630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.762+0000 7f2514a5e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c354559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.762+0000 7f2514a5e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c35437e50 0x558c35455ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.762+0000 7f2514a5e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f250c1af450 con 0x558c3542cc70 2024-09-10T10:12:11.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.762+0000 7f2514a5e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f250c1acd20 con 0x558c3542d590 2024-09-10T10:12:11.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.762+0000 7f2514a5e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f250c1aab70 con 0x558c35437e50 2024-09-10T10:12:11.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.762+0000 7f250b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3542cc70 0x558c35428630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.762+0000 7f250b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3542cc70 0x558c35428630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38922/0 (socket says 172.21.15.50:38922) 2024-09-10T10:12:11.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.762+0000 7f250b400640 1 -- 172.21.15.50:0/4052181840 learned_addr learned my addr 172.21.15.50:0/4052181840 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.762+0000 7f250aa00640 1 --2- 172.21.15.50:0/4052181840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c354559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.762+0000 7f250be00640 1 --2- 172.21.15.50:0/4052181840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c35437e50 0x558c35455ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.763+0000 7f250aa00640 1 -- 172.21.15.50:0/4052181840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c35437e50 msgr2=0x558c35455ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.763+0000 7f250aa00640 1 --2- 172.21.15.50:0/4052181840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c35437e50 0x558c35455ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.763+0000 7f250aa00640 1 -- 172.21.15.50:0/4052181840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3542cc70 msgr2=0x558c35428630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:11.767 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.763+0000 7f250aa00640 1 --2- 172.21.15.50:0/4052181840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3542cc70 0x558c35428630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.763+0000 7f250aa00640 1 -- 172.21.15.50:0/4052181840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c35424770 con 0x558c3542d590 2024-09-10T10:12:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.763+0000 7f250b400640 1 --2- 172.21.15.50:0/4052181840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3542cc70 0x558c35428630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.763+0000 7f250aa00640 1 --2- 172.21.15.50:0/4052181840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c354559b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f24f8003cd0 tx=0x7f24f8005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2d455a7d9387f30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.763+0000 7f24f7400640 1 -- 172.21.15.50:0/4052181840 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8052070 con 0x558c3542d590 2024-09-10T10:12:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.763+0000 7f24f7400640 1 -- 172.21.15.50:0/4052181840 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24f8003ad0 con 0x558c3542d590 2024-09-10T10:12:11.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.763+0000 7f24f7400640 1 -- 172.21.15.50:0/4052181840 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8035070 con 0x558c3542d590 2024-09-10T10:12:11.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.764+0000 7f2514a5e740 1 -- 172.21.15.50:0/4052181840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 msgr2=0x558c354559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.764+0000 7f2514a5e740 1 --2- 172.21.15.50:0/4052181840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c354559b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f24f8003cd0 tx=0x7f24f8005e80 comp rx=0 tx=0).stop 2024-09-10T10:12:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.764+0000 7f2514a5e740 1 -- 172.21.15.50:0/4052181840 shutdown_connections 2024-09-10T10:12:11.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.764+0000 7f2514a5e740 1 --2- 172.21.15.50:0/4052181840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c35437e50 0x558c35455ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.764+0000 7f2514a5e740 1 --2- 172.21.15.50:0/4052181840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c354559b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.764+0000 7f2514a5e740 1 --2- 172.21.15.50:0/4052181840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c3542cc70 0x558c35428630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.764+0000 7f2514a5e740 1 -- 172.21.15.50:0/4052181840 >> 172.21.15.50:0/4052181840 conn(0x558c35429200 msgr2=0x558c35436da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.764+0000 7f2514a5e740 1 -- 172.21.15.50:0/4052181840 shutdown_connections 2024-09-10T10:12:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.764+0000 7f2514a5e740 1 -- 172.21.15.50:0/4052181840 wait complete. 2024-09-10T10:12:11.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.765+0000 7f2514a5e740 1 -- start start 2024-09-10T10:12:11.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.765+0000 7f2514a5e740 1 Processor -- start 2024-09-10T10:12:11.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.765+0000 7f2514a5e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 0x558c35453760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.765+0000 7f2514a5e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c35453ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.765+0000 7f2514a5e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c35437e50 0x558c354541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.766+0000 7f2514a5e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f250c1ab1e0 con 0x558c35437e50 2024-09-10T10:12:11.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.766+0000 7f2514a5e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f250c1ac650 con 0x558c3542d590 2024-09-10T10:12:11.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.766+0000 7f2514a5e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f250c1ab8b0 con 0x558c3542cc70 2024-09-10T10:12:11.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.766+0000 7f250aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c35453ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.766+0000 7f2514a5e740 10 client.0 _ll_register_callbacks cb 0x7f24fc0d5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:11.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.766+0000 7f250aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c35453ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:38736/0 (socket says 172.21.15.50:38736) 2024-09-10T10:12:11.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.766+0000 7f250be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c35437e50 0x558c354541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.766+0000 7f250aa00640 1 -- 172.21.15.50:0/1158023294 learned_addr learned my addr 172.21.15.50:0/1158023294 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.766+0000 7f250b400640 1 --2- 172.21.15.50:0/1158023294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 0x558c35453760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.766+0000 7f250be00640 1 -- 172.21.15.50:0/1158023294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 msgr2=0x558c35453760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.766+0000 7f250be00640 1 --2- 172.21.15.50:0/1158023294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 0x558c35453760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.766+0000 7f250be00640 1 -- 172.21.15.50:0/1158023294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 msgr2=0x558c35453ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:11.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.766+0000 7f250be00640 1 --2- 172.21.15.50:0/1158023294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c35453ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.767+0000 7f250be00640 1 -- 172.21.15.50:0/1158023294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c35429e90 con 0x558c35437e50 2024-09-10T10:12:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.767+0000 7f250b400640 1 --2- 172.21.15.50:0/1158023294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 0x558c35453760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.767+0000 7f250be00640 1 --2- 172.21.15.50:0/1158023294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c35437e50 0x558c354541e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f250c0754f0 tx=0x7f2504004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3870a3c9f4607395 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.767+0000 7f24f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:12:11.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.767+0000 7f24f4c00640 1 -- 172.21.15.50:0/1158023294 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2504003b80 con 0x558c35437e50 2024-09-10T10:12:11.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.767+0000 7f24f4c00640 1 -- 172.21.15.50:0/1158023294 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f2504003d20 con 0x558c35437e50 2024-09-10T10:12:11.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.767+0000 7f2514a5e740 1 -- 172.21.15.50:0/1158023294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24f8003ad0 con 0x558c35437e50 2024-09-10T10:12:11.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.767+0000 7f24f4c00640 1 -- 172.21.15.50:0/1158023294 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2504004b20 con 0x558c35437e50 2024-09-10T10:12:11.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.767+0000 7f2514a5e740 10 client.15399 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:11.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.768+0000 7f2514a5e740 1 -- 172.21.15.50:0/1158023294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558c354bb060 con 0x558c35437e50 2024-09-10T10:12:11.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.768+0000 7f24f4c00640 1 -- 172.21.15.50:0/1158023294 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24f8003ad0 con 0x558c35437e50 2024-09-10T10:12:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.768+0000 7f24f4c00640 1 -- 172.21.15.50:0/1158023294 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f250401b5f0 con 0x558c35437e50 2024-09-10T10:12:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.768+0000 7f2514a5e740 10 client.15399 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.768+0000 7f2514a5e740 10 client.15399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:12:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.768+0000 7f2514a5e740 20 client.15399 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.768+0000 7f2514a5e740 1 --2- 172.21.15.50:0/1158023294 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x558c354bb830 0x558c354bdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.768+0000 7f2514a5e740 4 client.15399 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:12:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.768+0000 7f2514a5e740 1 -- 172.21.15.50:0/1158023294 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558c3539ae60 con 0x558c354bb830 2024-09-10T10:12:11.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.769+0000 7f250b400640 1 --2- 172.21.15.50:0/1158023294 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x558c354bb830 0x558c354bdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:11.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.769+0000 7f250b400640 1 --2- 172.21.15.50:0/1158023294 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x558c354bb830 0x558c354bdc50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f2e709f2710495f server_cookie=66262a738ec310e9 in_seq=0 out_seq=0 2024-09-10T10:12:11.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.769+0000 7f24f4c00640 10 client.15399 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:11.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.769+0000 7f24f4c00640 1 -- 172.21.15.50:0/1158023294 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558c3539ae60 con 0x558c354bb830 2024-09-10T10:12:11.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.769+0000 7f24f4c00640 10 client.15399 handle_command_reply: tid=0 2024-09-10T10:12:11.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.769+0000 7f2514a5e740 1 client.15399 shutdown 2024-09-10T10:12:11.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.769+0000 7f2514a5e740 1 -- 172.21.15.50:0/1158023294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c35437e50 msgr2=0x558c354541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:11.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.769+0000 7f2514a5e740 1 --2- 172.21.15.50:0/1158023294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c35437e50 0x558c354541e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f250c0754f0 tx=0x7f2504004ab0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.770+0000 7f2514a5e740 1 -- 172.21.15.50:0/1158023294 shutdown_connections 2024-09-10T10:12:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.770+0000 7f2514a5e740 1 --2- 172.21.15.50:0/1158023294 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x558c354bb830 0x558c354bdc50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.770+0000 7f2514a5e740 1 --2- 172.21.15.50:0/1158023294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558c35437e50 0x558c354541e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.770+0000 7f2514a5e740 1 --2- 172.21.15.50:0/1158023294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c3542d590 0x558c35453ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.770+0000 7f2514a5e740 1 --2- 172.21.15.50:0/1158023294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558c3542cc70 0x558c35453760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.770+0000 7f24f4c00640 0 client.15399 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:11.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.770+0000 7f2514a5e740 1 -- 172.21.15.50:0/1158023294 >> 172.21.15.50:0/1158023294 conn(0x558c35429200 msgr2=0x558c3544b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.770+0000 7f2514a5e740 1 -- 172.21.15.50:0/1158023294 shutdown_connections 2024-09-10T10:12:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.770+0000 7f2514a5e740 1 -- 172.21.15.50:0/1158023294 wait complete. 2024-09-10T10:12:11.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.770+0000 7f2514a5e740 20 client.15399 trim_cache size 0 max 16384 2024-09-10T10:12:11.786 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:12:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.771+0000 7f2512000640 1 -- 172.21.15.50:0/3227722644 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f24f00a2b80 msgr2=0x7f24f00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.771+0000 7f2512000640 1 --2- 172.21.15.50:0/3227722644 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f24f00a2b80 0x7f24f00a5040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2504005c40 tx=0x7f2504004a40 comp rx=0 tx=0).stop 2024-09-10T10:12:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.771+0000 7f2512000640 1 -- 172.21.15.50:0/3227722644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f250c074510 msgr2=0x7f250c19a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.771+0000 7f2512000640 1 --2- 172.21.15.50:0/3227722644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f250c074510 0x7f250c19a690 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00ea60 tx=0x7f24fc00ef20 comp rx=0 tx=0).stop 2024-09-10T10:12:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.771+0000 7f2512000640 1 -- 172.21.15.50:0/3227722644 shutdown_connections 2024-09-10T10:12:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.771+0000 7f2512000640 1 --2- 172.21.15.50:0/3227722644 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f24f00a2b80 0x7f24f00a5040 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.771+0000 7f2512000640 1 --2- 172.21.15.50:0/3227722644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f250c10e450 0x7f250c19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.771+0000 7f2512000640 1 --2- 172.21.15.50:0/3227722644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f250c074e30 0x7f250c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.771+0000 7f2512000640 1 --2- 172.21.15.50:0/3227722644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f250c074510 0x7f250c19a690 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.771+0000 7f2512000640 1 -- 172.21.15.50:0/3227722644 >> 172.21.15.50:0/3227722644 conn(0x7f250c0fd8b0 msgr2=0x7f250c0fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.771+0000 7f2512000640 1 -- 172.21.15.50:0/3227722644 shutdown_connections 2024-09-10T10:12:11.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:11.771+0000 7f2512000640 1 -- 172.21.15.50:0/3227722644 wait complete. 2024-09-10T10:12:12.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:12 smithi050 ceph-mon[30354]: pgmap v421: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:12:13.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:12 smithi189 ceph-mon[34999]: pgmap v421: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:12:13.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:12 smithi084 ceph-mon[34812]: pgmap v421: 129 pgs: 129 active+clean; 654 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:12:13.518 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T10:12:13.519 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T10:12:14.000 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.637+0000 7fe712200640 1 -- 172.21.15.50:0/3870329793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe70c101de0 msgr2=0x7fe70c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.637+0000 7fe712200640 1 --2- 172.21.15.50:0/3870329793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe70c101de0 0x7fe70c1021c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009ca0 tx=0x7fe6fc02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.637+0000 7fe712200640 1 -- 172.21.15.50:0/3870329793 shutdown_connections 2024-09-10T10:12:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.637+0000 7fe712200640 1 --2- 172.21.15.50:0/3870329793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70c106f10 0x7fe70c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.637+0000 7fe712200640 1 --2- 172.21.15.50:0/3870329793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe70c102790 0x7fe70c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.637+0000 7fe712200640 1 --2- 172.21.15.50:0/3870329793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe70c101de0 0x7fe70c1021c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.637+0000 7fe712200640 1 -- 172.21.15.50:0/3870329793 >> 172.21.15.50:0/3870329793 conn(0x7fe70c0fd8c0 msgr2=0x7fe70c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.637+0000 7fe712200640 1 -- 172.21.15.50:0/3870329793 shutdown_connections 2024-09-10T10:12:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.637+0000 7fe712200640 1 -- 172.21.15.50:0/3870329793 wait complete. 2024-09-10T10:12:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.639+0000 7fe712200640 1 Processor -- start 2024-09-10T10:12:14.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.639+0000 7fe712200640 1 -- start start 2024-09-10T10:12:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.639+0000 7fe712200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70c101de0 0x7fe70c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.639+0000 7fe712200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe70c102790 0x7fe70c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.639+0000 7fe712200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe70c106f10 0x7fe70c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.640+0000 7fe712200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c111f80 con 0x7fe70c106f10 2024-09-10T10:12:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.640+0000 7fe712200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c111e00 con 0x7fe70c101de0 2024-09-10T10:12:14.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.640+0000 7fe712200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c112100 con 0x7fe70c102790 2024-09-10T10:12:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.640+0000 7fe70be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe70c106f10 0x7fe70c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.640+0000 7fe70aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe70c102790 0x7fe70c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.640+0000 7fe70aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe70c102790 0x7fe70c19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:57916/0 (socket says 172.21.15.50:57916) 2024-09-10T10:12:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.640+0000 7fe70aa00640 1 -- 172.21.15.50:0/2043468133 learned_addr learned my addr 172.21.15.50:0/2043468133 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.640+0000 7fe70b400640 1 --2- 172.21.15.50:0/2043468133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70c101de0 0x7fe70c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.641+0000 7fe70be00640 1 -- 172.21.15.50:0/2043468133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe70c102790 msgr2=0x7fe70c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:14.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.641+0000 7fe70be00640 1 --2- 172.21.15.50:0/2043468133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe70c102790 0x7fe70c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.641+0000 7fe70be00640 1 -- 172.21.15.50:0/2043468133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70c101de0 msgr2=0x7fe70c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.641+0000 7fe70be00640 1 --2- 172.21.15.50:0/2043468133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70c101de0 0x7fe70c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.641+0000 7fe70be00640 1 -- 172.21.15.50:0/2043468133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70c19f620 con 0x7fe70c106f10 2024-09-10T10:12:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.641+0000 7fe70be00640 1 --2- 172.21.15.50:0/2043468133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe70c106f10 0x7fe70c19ef40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe70400e970 tx=0x7fe70400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.642+0000 7fe703e00640 1 -- 172.21.15.50:0/2043468133 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70400ccc0 con 0x7fe70c106f10 2024-09-10T10:12:14.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.642+0000 7fe703e00640 1 -- 172.21.15.50:0/2043468133 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe704005020 con 0x7fe70c106f10 2024-09-10T10:12:14.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.642+0000 7fe712200640 1 -- 172.21.15.50:0/2043468133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70c19f910 con 0x7fe70c106f10 2024-09-10T10:12:14.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.642+0000 7fe703e00640 1 -- 172.21.15.50:0/2043468133 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704004a00 con 0x7fe70c106f10 2024-09-10T10:12:14.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.643+0000 7fe712200640 1 -- 172.21.15.50:0/2043468133 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe70c1a71f0 con 0x7fe70c106f10 2024-09-10T10:12:14.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.647+0000 7fe703e00640 1 -- 172.21.15.50:0/2043468133 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe7040051d0 con 0x7fe70c106f10 2024-09-10T10:12:14.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.647+0000 7fe714ca2740 1 Processor -- start 2024-09-10T10:12:14.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.648+0000 7fe714ca2740 1 -- start start 2024-09-10T10:12:14.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.648+0000 7fe714ca2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145b42d0 0x55a1145b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.648+0000 7fe714ca2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b4bf0 0x55a1145bef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.648+0000 7fe714ca2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145bf4b0 0x55a1145c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.648+0000 7fe714ca2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a114512290 con 0x55a1145bf4b0 2024-09-10T10:12:14.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.648+0000 7fe714ca2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a1144b9b40 con 0x55a1145b42d0 2024-09-10T10:12:14.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.648+0000 7fe714ca2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a11450e250 con 0x55a1145b4bf0 2024-09-10T10:12:14.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.648+0000 7fe70b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b4bf0 0x55a1145bef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.648+0000 7fe70b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b4bf0 0x55a1145bef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:57922/0 (socket says 172.21.15.50:57922) 2024-09-10T10:12:14.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.648+0000 7fe70b400640 1 -- 172.21.15.50:0/10105241 learned_addr learned my addr 172.21.15.50:0/10105241 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:14.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.649+0000 7fe70b400640 1 -- 172.21.15.50:0/10105241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145b42d0 msgr2=0x55a1145b46b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:12:14.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.649+0000 7fe70b400640 1 --2- 172.21.15.50:0/10105241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145b42d0 0x55a1145b46b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.649+0000 7fe70b400640 1 -- 172.21.15.50:0/10105241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145bf4b0 msgr2=0x55a1145c18a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:12:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.649+0000 7fe70b400640 1 --2- 172.21.15.50:0/10105241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145bf4b0 0x55a1145c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.649+0000 7fe70b400640 1 -- 172.21.15.50:0/10105241 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1142836a0 con 0x55a1145b4bf0 2024-09-10T10:12:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.649+0000 7fe703e00640 1 --2- 172.21.15.50:0/2043468133 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6f00a2c00 0x7fe6f00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.650+0000 7fe703e00640 1 -- 172.21.15.50:0/2043468133 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe7040cf2d0 con 0x7fe70c106f10 2024-09-10T10:12:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.651+0000 7fe70aa00640 1 --2- 172.21.15.50:0/2043468133 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6f00a2c00 0x7fe6f00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.651+0000 7fe70b400640 1 --2- 172.21.15.50:0/10105241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b4bf0 0x55a1145bef70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc02ade0 tx=0x7fe6fc005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a9e6d1843a07622 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.651+0000 7fe6f7e00640 1 -- 172.21.15.50:0/10105241 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc031db0 con 0x55a1145b4bf0 2024-09-10T10:12:14.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.651+0000 7fe6f7e00640 1 -- 172.21.15.50:0/10105241 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6fc036030 con 0x55a1145b4bf0 2024-09-10T10:12:14.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.651+0000 7fe6f7e00640 1 -- 172.21.15.50:0/10105241 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc004280 con 0x55a1145b4bf0 2024-09-10T10:12:14.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.651+0000 7fe70aa00640 1 --2- 172.21.15.50:0/2043468133 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6f00a2c00 0x7fe6f00a50c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55a1145b1be0 tx=0x7fe6f8009950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:14.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.652+0000 7fe714ca2740 1 -- 172.21.15.50:0/10105241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b4bf0 msgr2=0x55a1145bef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:14.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.652+0000 7fe714ca2740 1 --2- 172.21.15.50:0/10105241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b4bf0 0x55a1145bef70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc02ade0 tx=0x7fe6fc005fa0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.652+0000 7fe714ca2740 1 -- 172.21.15.50:0/10105241 shutdown_connections 2024-09-10T10:12:14.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.652+0000 7fe714ca2740 1 --2- 172.21.15.50:0/10105241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145bf4b0 0x55a1145c18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.652+0000 7fe714ca2740 1 --2- 172.21.15.50:0/10105241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b4bf0 0x55a1145bef70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.652+0000 7fe714ca2740 1 --2- 172.21.15.50:0/10105241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145b42d0 0x55a1145b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.652+0000 7fe714ca2740 1 -- 172.21.15.50:0/10105241 >> 172.21.15.50:0/10105241 conn(0x55a1145b0860 msgr2=0x55a1145b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:14.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.653+0000 7fe714ca2740 1 -- 172.21.15.50:0/10105241 shutdown_connections 2024-09-10T10:12:14.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.653+0000 7fe714ca2740 1 -- 172.21.15.50:0/10105241 wait complete. 2024-09-10T10:12:14.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.654+0000 7fe714ca2740 1 -- start start 2024-09-10T10:12:14.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.654+0000 7fe714ca2740 1 Processor -- start 2024-09-10T10:12:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.655+0000 7fe714ca2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145b42d0 0x55a1145beda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.655+0000 7fe714ca2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.655+0000 7fe714ca2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145bf4b0 0x55a1145bc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.655+0000 7fe714ca2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a1145c1fa0 con 0x55a1145b4bf0 2024-09-10T10:12:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.655+0000 7fe714ca2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a1144ccfa0 con 0x55a1145b42d0 2024-09-10T10:12:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.655+0000 7fe714ca2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a1145c2120 con 0x55a1145bf4b0 2024-09-10T10:12:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.655+0000 7fe714ca2740 10 client.0 _ll_register_callbacks cb 0x55a114220ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.655+0000 7fe70b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145b42d0 0x55a1145beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.655+0000 7fe70b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145b42d0 0x55a1145beda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:38784/0 (socket says 172.21.15.50:38784) 2024-09-10T10:12:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.655+0000 7fe70b400640 1 -- 172.21.15.50:0/174409097 learned_addr learned my addr 172.21.15.50:0/174409097 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.655+0000 7fe70be00640 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145bf4b0 0x55a1145bc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.655+0000 7fe70aa00640 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.656+0000 7fe70b400640 1 -- 172.21.15.50:0/174409097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145bf4b0 msgr2=0x55a1145bc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:14.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.656+0000 7fe70b400640 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145bf4b0 0x55a1145bc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.656+0000 7fe70b400640 1 -- 172.21.15.50:0/174409097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 msgr2=0x55a1145bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.656+0000 7fe70b400640 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145bc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.656+0000 7fe70b400640 1 -- 172.21.15.50:0/174409097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1145bcd70 con 0x55a1145b42d0 2024-09-10T10:12:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.656+0000 7fe70aa00640 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145bc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:12:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.656+0000 7fe70b400640 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145b42d0 0x55a1145beda0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009ca0 tx=0x7fe6fc032df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd244fdcc15ffc16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.656+0000 7fe6f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:12:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.656+0000 7fe6f4c00640 1 -- 172.21.15.50:0/174409097 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc04a040 con 0x55a1145b42d0 2024-09-10T10:12:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.657+0000 7fe6f4c00640 1 -- 172.21.15.50:0/174409097 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe6fc003b70 con 0x55a1145b42d0 2024-09-10T10:12:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.657+0000 7fe714ca2740 1 -- 172.21.15.50:0/174409097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6fc036030 con 0x55a1145b42d0 2024-09-10T10:12:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.657+0000 7fe6f4c00640 1 -- 172.21.15.50:0/174409097 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe6fc0098e0 con 0x55a1145b42d0 2024-09-10T10:12:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.657+0000 7fe714ca2740 10 client.25460 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:14.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.657+0000 7fe714ca2740 1 -- 172.21.15.50:0/174409097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a1145c1fa0 con 0x55a1145b42d0 2024-09-10T10:12:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.657+0000 7fe6f4c00640 1 -- 172.21.15.50:0/174409097 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6fc036030 con 0x55a1145b42d0 2024-09-10T10:12:14.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.658+0000 7fe6f4c00640 1 -- 172.21.15.50:0/174409097 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe6fc04d030 con 0x55a1145b42d0 2024-09-10T10:12:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.658+0000 7fe714ca2740 10 client.25460 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.658+0000 7fe714ca2740 10 client.25460 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:12:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.658+0000 7fe714ca2740 20 client.25460 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.658+0000 7fe714ca2740 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55a1145cefe0 0x55a1145d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.658+0000 7fe714ca2740 4 client.25460 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:12:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.658+0000 7fe714ca2740 1 -- 172.21.15.50:0/174409097 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a11451f800 con 0x55a1145cefe0 2024-09-10T10:12:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.658+0000 7fe70aa00640 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55a1145cefe0 0x55a1145d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.659+0000 7fe6f4c00640 10 client.25460 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:14.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.663+0000 7fe70aa00640 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55a1145cefe0 0x55a1145d1440 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9f62773775af1f3 server_cookie=38dd8108490f6396 in_seq=0 out_seq=0 2024-09-10T10:12:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.664+0000 7fe6f4c00640 1 -- 172.21.15.50:0/174409097 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a11451f800 con 0x55a1145cefe0 2024-09-10T10:12:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.664+0000 7fe6f4c00640 10 client.25460 handle_command_reply: tid=0 2024-09-10T10:12:14.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.664+0000 7fe714ca2740 1 client.25460 shutdown 2024-09-10T10:12:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.664+0000 7fe714ca2740 1 -- 172.21.15.50:0/174409097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145b42d0 msgr2=0x55a1145beda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.664+0000 7fe714ca2740 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145b42d0 0x55a1145beda0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009ca0 tx=0x7fe6fc032df0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.665+0000 7fe714ca2740 1 -- 172.21.15.50:0/174409097 shutdown_connections 2024-09-10T10:12:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.665+0000 7fe714ca2740 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55a1145cefe0 0x55a1145d1440 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.665+0000 7fe714ca2740 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145bf4b0 0x55a1145bc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.665+0000 7fe714ca2740 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145bc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.665+0000 7fe714ca2740 1 --2- 172.21.15.50:0/174409097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145b42d0 0x55a1145beda0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.665+0000 7fe714ca2740 1 -- 172.21.15.50:0/174409097 >> 172.21.15.50:0/174409097 conn(0x55a1145b0860 msgr2=0x55a1145a71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.665+0000 7fe6f4c00640 0 client.25460 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.665+0000 7fe714ca2740 1 -- 172.21.15.50:0/174409097 shutdown_connections 2024-09-10T10:12:14.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.665+0000 7fe714ca2740 1 -- 172.21.15.50:0/174409097 wait complete. 2024-09-10T10:12:14.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.666+0000 7fe714ca2740 20 client.25460 trim_cache size 0 max 16384 2024-09-10T10:12:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.684+0000 7fe714ca2740 1 Processor -- start 2024-09-10T10:12:14.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.684+0000 7fe714ca2740 1 -- start start 2024-09-10T10:12:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.684+0000 7fe714ca2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b42d0 0x55a1145bdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe714ca2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145d6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe714ca2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145bf4b0 0x55a1145d7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe714ca2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c1af350 con 0x55a1145b4bf0 2024-09-10T10:12:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe714ca2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c1acc20 con 0x55a1145bf4b0 2024-09-10T10:12:14.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe714ca2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c1aaab0 con 0x55a1145b42d0 2024-09-10T10:12:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe70b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b42d0 0x55a1145bdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe70aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145d6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe70b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b42d0 0x55a1145bdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:57942/0 (socket says 172.21.15.50:57942) 2024-09-10T10:12:14.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe70b400640 1 -- 172.21.15.50:0/808262568 learned_addr learned my addr 172.21.15.50:0/808262568 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe70be00640 1 --2- 172.21.15.50:0/808262568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145bf4b0 0x55a1145d7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe70aa00640 1 -- 172.21.15.50:0/808262568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b42d0 msgr2=0x55a1145bdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe70aa00640 1 --2- 172.21.15.50:0/808262568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b42d0 0x55a1145bdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe70aa00640 1 -- 172.21.15.50:0/808262568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145bf4b0 msgr2=0x55a1145d7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe70aa00640 1 --2- 172.21.15.50:0/808262568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145bf4b0 0x55a1145d7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.685+0000 7fe70aa00640 1 -- 172.21.15.50:0/808262568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1145b0690 con 0x55a1145b4bf0 2024-09-10T10:12:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.686+0000 7fe70be00640 1 --2- 172.21.15.50:0/808262568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145bf4b0 0x55a1145d7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:12:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.686+0000 7fe70aa00640 1 --2- 172.21.15.50:0/808262568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145d6d10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55a1145d1cb0 tx=0x7fe6f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f077f7d4e6836b5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.686+0000 7fe6f7400640 1 -- 172.21.15.50:0/808262568 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f80252d0 con 0x55a1145b4bf0 2024-09-10T10:12:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.686+0000 7fe6f7400640 1 -- 172.21.15.50:0/808262568 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6f8029030 con 0x55a1145b4bf0 2024-09-10T10:12:14.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.686+0000 7fe6f7400640 1 -- 172.21.15.50:0/808262568 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f802d640 con 0x55a1145b4bf0 2024-09-10T10:12:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.687+0000 7fe714ca2740 1 -- 172.21.15.50:0/808262568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 msgr2=0x55a1145d6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.687+0000 7fe714ca2740 1 --2- 172.21.15.50:0/808262568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145d6d10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55a1145d1cb0 tx=0x7fe6f8014000 comp rx=0 tx=0).stop 2024-09-10T10:12:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.687+0000 7fe714ca2740 1 -- 172.21.15.50:0/808262568 shutdown_connections 2024-09-10T10:12:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.687+0000 7fe714ca2740 1 --2- 172.21.15.50:0/808262568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145bf4b0 0x55a1145d7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.687+0000 7fe714ca2740 1 --2- 172.21.15.50:0/808262568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145d6d10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.687+0000 7fe714ca2740 1 --2- 172.21.15.50:0/808262568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b42d0 0x55a1145bdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.687+0000 7fe714ca2740 1 -- 172.21.15.50:0/808262568 >> 172.21.15.50:0/808262568 conn(0x55a1145b0860 msgr2=0x55a1145bd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.688+0000 7fe714ca2740 1 -- 172.21.15.50:0/808262568 shutdown_connections 2024-09-10T10:12:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.688+0000 7fe714ca2740 1 -- 172.21.15.50:0/808262568 wait complete. 2024-09-10T10:12:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.688+0000 7fe714ca2740 1 -- start start 2024-09-10T10:12:14.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.689+0000 7fe714ca2740 1 Processor -- start 2024-09-10T10:12:14.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.689+0000 7fe714ca2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b42d0 0x55a1145c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.689+0000 7fe714ca2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.689+0000 7fe714ca2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145bf4b0 0x55a1145c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.689+0000 7fe714ca2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c1ab100 con 0x55a1145b4bf0 2024-09-10T10:12:14.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.689+0000 7fe714ca2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c1ac550 con 0x55a1145bf4b0 2024-09-10T10:12:14.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.689+0000 7fe714ca2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c1ab7b0 con 0x55a1145b42d0 2024-09-10T10:12:14.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.689+0000 7fe714ca2740 10 client.0 _ll_register_callbacks cb 0x7fe6fc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:14.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.690+0000 7fe70aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.690+0000 7fe70aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38980/0 (socket says 172.21.15.50:38980) 2024-09-10T10:12:14.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.690+0000 7fe70aa00640 1 -- 172.21.15.50:0/1670194940 learned_addr learned my addr 172.21.15.50:0/1670194940 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:14.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.690+0000 7fe70b400640 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b42d0 0x55a1145c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.690+0000 7fe70be00640 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145bf4b0 0x55a1145c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.690+0000 7fe70b400640 1 -- 172.21.15.50:0/1670194940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145bf4b0 msgr2=0x55a1145c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.690+0000 7fe70b400640 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145bf4b0 0x55a1145c4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.690+0000 7fe70b400640 1 -- 172.21.15.50:0/1670194940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 msgr2=0x55a1145c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.690+0000 7fe70b400640 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.690+0000 7fe70b400640 1 -- 172.21.15.50:0/1670194940 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1145c54d0 con 0x55a1145b42d0 2024-09-10T10:12:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.691+0000 7fe70aa00640 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.691+0000 7fe70be00640 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145bf4b0 0x55a1145c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.691+0000 7fe70b400640 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b42d0 0x55a1145c7700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009ca0 tx=0x7fe6fc009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3dc4fdf7a91dee9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.691+0000 7fe6f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:12:14.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.691+0000 7fe6f4c00640 1 -- 172.21.15.50:0/1670194940 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc003970 con 0x55a1145b42d0 2024-09-10T10:12:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.691+0000 7fe714ca2740 1 -- 172.21.15.50:0/1670194940 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6f8029030 con 0x55a1145b42d0 2024-09-10T10:12:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.691+0000 7fe6f4c00640 1 -- 172.21.15.50:0/1670194940 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe6fc003b10 con 0x55a1145b42d0 2024-09-10T10:12:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.692+0000 7fe6f4c00640 1 -- 172.21.15.50:0/1670194940 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe6fc003d10 con 0x55a1145b42d0 2024-09-10T10:12:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.692+0000 7fe714ca2740 10 client.25435 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:14.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.692+0000 7fe714ca2740 1 -- 172.21.15.50:0/1670194940 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a114639990 con 0x55a1145b42d0 2024-09-10T10:12:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.692+0000 7fe6f4c00640 1 -- 172.21.15.50:0/1670194940 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6f8029030 con 0x55a1145b42d0 2024-09-10T10:12:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.692+0000 7fe6f4c00640 1 -- 172.21.15.50:0/1670194940 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe6fc04d040 con 0x55a1145b42d0 2024-09-10T10:12:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.692+0000 7fe714ca2740 10 client.25435 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.692+0000 7fe714ca2740 10 client.25435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:12:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.692+0000 7fe714ca2740 20 client.25435 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.692+0000 7fe714ca2740 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55a11463a020 0x55a11463c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.692+0000 7fe714ca2740 4 client.25435 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T10:12:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.692+0000 7fe714ca2740 1 -- 172.21.15.50:0/1670194940 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a114519d10 con 0x55a11463a020 2024-09-10T10:12:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.693+0000 7fe70aa00640 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55a11463a020 0x55a11463c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.693+0000 7fe70aa00640 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55a11463a020 0x55a11463c440 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b08fd28aa2527dd5 server_cookie=ced6942b97dc7bba in_seq=0 out_seq=0 2024-09-10T10:12:14.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.693+0000 7fe6f4c00640 10 client.25435 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe6f4c00640 1 -- 172.21.15.50:0/1670194940 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a114519d10 con 0x55a11463a020 2024-09-10T10:12:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe6f4c00640 10 client.25435 handle_command_reply: tid=0 2024-09-10T10:12:14.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe714ca2740 1 client.25435 shutdown 2024-09-10T10:12:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe714ca2740 1 -- 172.21.15.50:0/1670194940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b42d0 msgr2=0x55a1145c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe714ca2740 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b42d0 0x55a1145c7700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009ca0 tx=0x7fe6fc009650 comp rx=0 tx=0).stop 2024-09-10T10:12:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe714ca2740 1 -- 172.21.15.50:0/1670194940 shutdown_connections 2024-09-10T10:12:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe714ca2740 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55a11463a020 0x55a11463c440 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe714ca2740 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1145bf4b0 0x55a1145c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe714ca2740 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1145b4bf0 0x55a1145c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe714ca2740 1 --2- 172.21.15.50:0/1670194940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a1145b42d0 0x55a1145c7700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe714ca2740 1 -- 172.21.15.50:0/1670194940 >> 172.21.15.50:0/1670194940 conn(0x55a1145b0860 msgr2=0x55a1145a71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe6f4c00640 0 client.25435 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe714ca2740 1 -- 172.21.15.50:0/1670194940 shutdown_connections 2024-09-10T10:12:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.695+0000 7fe714ca2740 1 -- 172.21.15.50:0/1670194940 wait complete. 2024-09-10T10:12:14.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.696+0000 7fe714ca2740 20 client.25435 trim_cache size 0 max 16384 2024-09-10T10:12:14.698 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:12:14.698 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-10T10:12:14.698 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "2431fa90-0688-4fad-aef8-15904a680125", 2024-09-10T10:12:14.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-10T10:12:14.699 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:12:14.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.696+0000 7fe712200640 1 -- 172.21.15.50:0/2043468133 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6f00a2c00 msgr2=0x7fe6f00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:14.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.696+0000 7fe712200640 1 --2- 172.21.15.50:0/2043468133 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6f00a2c00 0x7fe6f00a50c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55a1145b1be0 tx=0x7fe6f8009950 comp rx=0 tx=0).stop 2024-09-10T10:12:14.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.696+0000 7fe712200640 1 -- 172.21.15.50:0/2043468133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe70c106f10 msgr2=0x7fe70c19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.696+0000 7fe712200640 1 --2- 172.21.15.50:0/2043468133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe70c106f10 0x7fe70c19ef40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe70400e970 tx=0x7fe70400ee30 comp rx=0 tx=0).stop 2024-09-10T10:12:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.697+0000 7fe712200640 1 -- 172.21.15.50:0/2043468133 shutdown_connections 2024-09-10T10:12:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.697+0000 7fe712200640 1 --2- 172.21.15.50:0/2043468133 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe6f00a2c00 0x7fe6f00a50c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.697+0000 7fe712200640 1 --2- 172.21.15.50:0/2043468133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe70c106f10 0x7fe70c19ef40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.697+0000 7fe712200640 1 --2- 172.21.15.50:0/2043468133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe70c102790 0x7fe70c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.697+0000 7fe712200640 1 --2- 172.21.15.50:0/2043468133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe70c101de0 0x7fe70c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.697+0000 7fe712200640 1 -- 172.21.15.50:0/2043468133 >> 172.21.15.50:0/2043468133 conn(0x7fe70c0fd8c0 msgr2=0x7fe70c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.697+0000 7fe712200640 1 -- 172.21.15.50:0/2043468133 shutdown_connections 2024-09-10T10:12:14.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:14.697+0000 7fe712200640 1 -- 172.21.15.50:0/2043468133 wait complete. 2024-09-10T10:12:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:14 smithi050 ceph-mon[30354]: pgmap v422: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T10:12:15.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:14 smithi189 ceph-mon[34999]: pgmap v422: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T10:12:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:14 smithi084 ceph-mon[34812]: pgmap v422: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T10:12:15.499 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:12:15.940 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:16.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:15 smithi189 ceph-mon[34999]: scrub queued for path: / 2024-09-10T10:12:16.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:15 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:12:16.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:15 smithi189 ceph-mon[34999]: scrub summary: active paths [/] 2024-09-10T10:12:16.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:15 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:12:16.091 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:15 smithi050 ceph-mon[30354]: scrub queued for path: / 2024-09-10T10:12:16.091 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:15 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:12:16.092 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:15 smithi050 ceph-mon[30354]: scrub summary: active paths [/] 2024-09-10T10:12:16.092 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:15 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:12:16.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:15 smithi084 ceph-mon[34812]: scrub queued for path: / 2024-09-10T10:12:16.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:15 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:12:16.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:15 smithi084 ceph-mon[34812]: scrub summary: active paths [/] 2024-09-10T10:12:16.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:15 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:12:16.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.544+0000 7f75efe00640 1 -- 172.21.15.50:0/3601350297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75f0103e30 msgr2=0x7f75f0104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.544+0000 7f75efe00640 1 --2- 172.21.15.50:0/3601350297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75f0103e30 0x7f75f0104210 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009860 tx=0x7f75e002a340 comp rx=0 tx=0).stop 2024-09-10T10:12:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.544+0000 7f75efe00640 1 -- 172.21.15.50:0/3601350297 shutdown_connections 2024-09-10T10:12:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.544+0000 7f75efe00640 1 --2- 172.21.15.50:0/3601350297 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75f0108f60 0x7f75f0110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.544+0000 7f75efe00640 1 --2- 172.21.15.50:0/3601350297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75f01047e0 0x7f75f0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.544+0000 7f75efe00640 1 --2- 172.21.15.50:0/3601350297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75f0103e30 0x7f75f0104210 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.545+0000 7f75efe00640 1 -- 172.21.15.50:0/3601350297 >> 172.21.15.50:0/3601350297 conn(0x7f75f00ff910 msgr2=0x7f75f0101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.545+0000 7f75efe00640 1 -- 172.21.15.50:0/3601350297 shutdown_connections 2024-09-10T10:12:16.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.545+0000 7f75efe00640 1 -- 172.21.15.50:0/3601350297 wait complete. 2024-09-10T10:12:16.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.546+0000 7f75efe00640 1 Processor -- start 2024-09-10T10:12:16.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.546+0000 7f75efe00640 1 -- start start 2024-09-10T10:12:16.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.547+0000 7f75efe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75f0103e30 0x7f75f019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.547+0000 7f75efe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75f01047e0 0x7f75f019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.547+0000 7f75efe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75f0108f60 0x7f75f019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.547+0000 7f75efe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f75f0113f80 con 0x7f75f01047e0 2024-09-10T10:12:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.547+0000 7f75efe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f75f0113e00 con 0x7f75f0103e30 2024-09-10T10:12:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.547+0000 7f75efe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f75f0114100 con 0x7f75f0108f60 2024-09-10T10:12:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.547+0000 7f75eea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75f0103e30 0x7f75f019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.547+0000 7f75ef400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75f0108f60 0x7f75f019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.547+0000 7f75ef400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75f0108f60 0x7f75f019ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:57968/0 (socket says 172.21.15.50:57968) 2024-09-10T10:12:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.547+0000 7f75ef400640 1 -- 172.21.15.50:0/360312908 learned_addr learned my addr 172.21.15.50:0/360312908 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:16.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.547+0000 7f75ee000640 1 --2- 172.21.15.50:0/360312908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75f01047e0 0x7f75f019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.548+0000 7f75ef400640 1 -- 172.21.15.50:0/360312908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75f0103e30 msgr2=0x7f75f019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.548+0000 7f75ef400640 1 --2- 172.21.15.50:0/360312908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75f0103e30 0x7f75f019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.548+0000 7f75ef400640 1 -- 172.21.15.50:0/360312908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75f01047e0 msgr2=0x7f75f019a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.548+0000 7f75ef400640 1 --2- 172.21.15.50:0/360312908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75f01047e0 0x7f75f019a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.548+0000 7f75ef400640 1 -- 172.21.15.50:0/360312908 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f019f410 con 0x7f75f0108f60 2024-09-10T10:12:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.548+0000 7f75ef400640 1 --2- 172.21.15.50:0/360312908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75f0108f60 0x7f75f019ed30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f75e800eb10 tx=0x7f75e800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.549+0000 7f75e7400640 1 -- 172.21.15.50:0/360312908 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e800ce20 con 0x7f75f0108f60 2024-09-10T10:12:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.549+0000 7f75efe00640 1 -- 172.21.15.50:0/360312908 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f019f700 con 0x7f75f0108f60 2024-09-10T10:12:16.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.549+0000 7f75efe00640 1 -- 172.21.15.50:0/360312908 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f01a6fe0 con 0x7f75f0108f60 2024-09-10T10:12:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.549+0000 7f75e7400640 1 -- 172.21.15.50:0/360312908 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75e8005020 con 0x7f75f0108f60 2024-09-10T10:12:16.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.549+0000 7f75e7400640 1 -- 172.21.15.50:0/360312908 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e8010670 con 0x7f75f0108f60 2024-09-10T10:12:16.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.553+0000 7f75f845c740 1 Processor -- start 2024-09-10T10:12:16.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.554+0000 7f75e7400640 1 -- 172.21.15.50:0/360312908 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f75e8004a40 con 0x7f75f0108f60 2024-09-10T10:12:16.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.555+0000 7f75f845c740 1 -- start start 2024-09-10T10:12:16.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.555+0000 7f75f845c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1c4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.555+0000 7f75f845c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1c4670 0x56082a1ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.555+0000 7f75f845c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1cef30 0x56082a1d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.555+0000 7f75f845c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56082a12a3e0 con 0x56082a1c4670 2024-09-10T10:12:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.555+0000 7f75f845c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56082a0d1d80 con 0x56082a1cef30 2024-09-10T10:12:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.555+0000 7f75f845c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56082a1263a0 con 0x56082a1c3d50 2024-09-10T10:12:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.556+0000 7f75ee000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.556+0000 7f75eea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1c4670 0x56082a1ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.556+0000 7f75ee000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1c4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:57984/0 (socket says 172.21.15.50:57984) 2024-09-10T10:12:16.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.556+0000 7f75ee000640 1 -- 172.21.15.50:0/3869457984 learned_addr learned my addr 172.21.15.50:0/3869457984 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:16.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.556+0000 7f75ee000640 1 -- 172.21.15.50:0/3869457984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1cef30 msgr2=0x56082a1d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:16.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.556+0000 7f75ee000640 1 --2- 172.21.15.50:0/3869457984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1cef30 0x56082a1d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.556+0000 7f75ee000640 1 -- 172.21.15.50:0/3869457984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1c4670 msgr2=0x56082a1ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:16.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.556+0000 7f75ee000640 1 --2- 172.21.15.50:0/3869457984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1c4670 0x56082a1ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.556+0000 7f75ee000640 1 -- 172.21.15.50:0/3869457984 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56082a0f0ae0 con 0x56082a1c3d50 2024-09-10T10:12:16.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.556+0000 7f75e7400640 1 --2- 172.21.15.50:0/360312908 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f75d40a2b80 0x7f75d40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.557+0000 7f75ee000640 1 --2- 172.21.15.50:0/3869457984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1c4130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009690 tx=0x7f75dc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58db738cfb91ef80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:16.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.557+0000 7f75e7400640 1 -- 172.21.15.50:0/360312908 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f75e80cf8d0 con 0x7f75f0108f60 2024-09-10T10:12:16.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.557+0000 7f75eea00640 1 --2- 172.21.15.50:0/360312908 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f75d40a2b80 0x7f75d40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:16.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.557+0000 7f75dbe00640 1 -- 172.21.15.50:0/3869457984 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc004250 con 0x56082a1c3d50 2024-09-10T10:12:16.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.557+0000 7f75dbe00640 1 -- 172.21.15.50:0/3869457984 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75dc0043f0 con 0x56082a1c3d50 2024-09-10T10:12:16.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.557+0000 7f75dbe00640 1 -- 172.21.15.50:0/3869457984 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc004e60 con 0x56082a1c3d50 2024-09-10T10:12:16.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.558+0000 7f75f845c740 1 -- 172.21.15.50:0/3869457984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 msgr2=0x56082a1c4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:16.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.558+0000 7f75f845c740 1 --2- 172.21.15.50:0/3869457984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1c4130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009690 tx=0x7f75dc011810 comp rx=0 tx=0).stop 2024-09-10T10:12:16.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.558+0000 7f75eea00640 1 --2- 172.21.15.50:0/360312908 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f75d40a2b80 0x7f75d40a5040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f75e002a930 tx=0x7f75e00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:16.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.559+0000 7f75f845c740 1 -- 172.21.15.50:0/3869457984 shutdown_connections 2024-09-10T10:12:16.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.559+0000 7f75f845c740 1 --2- 172.21.15.50:0/3869457984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1cef30 0x56082a1d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.559+0000 7f75f845c740 1 --2- 172.21.15.50:0/3869457984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1c4670 0x56082a1ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.559+0000 7f75f845c740 1 --2- 172.21.15.50:0/3869457984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1c4130 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.559+0000 7f75f845c740 1 -- 172.21.15.50:0/3869457984 >> 172.21.15.50:0/3869457984 conn(0x56082a1c02e0 msgr2=0x56082a1c06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:16.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.559+0000 7f75f845c740 1 -- 172.21.15.50:0/3869457984 shutdown_connections 2024-09-10T10:12:16.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.559+0000 7f75f845c740 1 -- 172.21.15.50:0/3869457984 wait complete. 2024-09-10T10:12:16.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.560+0000 7f75f845c740 1 -- start start 2024-09-10T10:12:16.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.560+0000 7f75f845c740 1 Processor -- start 2024-09-10T10:12:16.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75f845c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75f845c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1c4670 0x56082a1cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75f845c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1cef30 0x56082a1cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75f845c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56082a1d1ba0 con 0x56082a1cef30 2024-09-10T10:12:16.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75f845c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56082a0e50f0 con 0x56082a1c4670 2024-09-10T10:12:16.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75f845c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56082a1d1d20 con 0x56082a1c3d50 2024-09-10T10:12:16.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75f845c740 10 client.0 _ll_register_callbacks cb 0x56082a0d69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:16.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75eea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75eea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:57988/0 (socket says 172.21.15.50:57988) 2024-09-10T10:12:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75eea00640 1 -- 172.21.15.50:0/829753102 learned_addr learned my addr 172.21.15.50:0/829753102 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75eea00640 1 -- 172.21.15.50:0/829753102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1c4670 msgr2=0x56082a1cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75eea00640 1 --2- 172.21.15.50:0/829753102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1c4670 0x56082a1cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75eea00640 1 -- 172.21.15.50:0/829753102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1cef30 msgr2=0x56082a1cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75eea00640 1 --2- 172.21.15.50:0/829753102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1cef30 0x56082a1cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.561+0000 7f75eea00640 1 -- 172.21.15.50:0/829753102 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560829e9b3c0 con 0x56082a1c3d50 2024-09-10T10:12:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.562+0000 7f75eea00640 1 --2- 172.21.15.50:0/829753102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1cbe90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009860 tx=0x7f75e002a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9c56f3bfb014b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.562+0000 7f75d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:12:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.562+0000 7f75d8c00640 1 -- 172.21.15.50:0/829753102 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0037040 con 0x56082a1c3d50 2024-09-10T10:12:16.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.562+0000 7f75d8c00640 1 -- 172.21.15.50:0/829753102 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f75e0003a00 con 0x56082a1c3d50 2024-09-10T10:12:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.562+0000 7f75f845c740 1 -- 172.21.15.50:0/829753102 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75dc0043f0 con 0x56082a1c3d50 2024-09-10T10:12:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.563+0000 7f75d8c00640 1 -- 172.21.15.50:0/829753102 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f75e0057050 con 0x56082a1c3d50 2024-09-10T10:12:16.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.563+0000 7f75f845c740 10 client.25447 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:16.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.563+0000 7f75f845c740 1 -- 172.21.15.50:0/829753102 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56082a1dd960 con 0x56082a1c3d50 2024-09-10T10:12:16.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.563+0000 7f75d8c00640 1 -- 172.21.15.50:0/829753102 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75dc0043f0 con 0x56082a1c3d50 2024-09-10T10:12:16.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.563+0000 7f75d8c00640 1 -- 172.21.15.50:0/829753102 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f75e0049be0 con 0x56082a1c3d50 2024-09-10T10:12:16.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.564+0000 7f75f845c740 10 client.25447 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:16.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.564+0000 7f75f845c740 10 client.25447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:12:16.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.564+0000 7f75f845c740 20 client.25447 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:16.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.564+0000 7f75f845c740 1 --2- 172.21.15.50:0/829753102 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56082a1def30 0x56082a1e13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.564+0000 7f75f845c740 4 client.25447 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:12:16.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.564+0000 7f75f845c740 1 -- 172.21.15.50:0/829753102 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56082a137950 con 0x56082a1def30 2024-09-10T10:12:16.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.564+0000 7f75ee000640 1 --2- 172.21.15.50:0/829753102 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56082a1def30 0x56082a1e13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:16.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.565+0000 7f75ee000640 1 --2- 172.21.15.50:0/829753102 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56082a1def30 0x56082a1e13f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88c200644e49a0ba server_cookie=7a69705556f7ff06 in_seq=0 out_seq=0 2024-09-10T10:12:16.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.565+0000 7f75d8c00640 10 client.25447 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:16.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.566+0000 7f75d8c00640 1 -- 172.21.15.50:0/829753102 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56082a137950 con 0x56082a1def30 2024-09-10T10:12:16.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.566+0000 7f75d8c00640 10 client.25447 handle_command_reply: tid=0 2024-09-10T10:12:16.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.566+0000 7f75f845c740 1 client.25447 shutdown 2024-09-10T10:12:16.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.566+0000 7f75f845c740 1 -- 172.21.15.50:0/829753102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 msgr2=0x56082a1cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:16.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.566+0000 7f75f845c740 1 --2- 172.21.15.50:0/829753102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1cbe90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009860 tx=0x7f75e002a340 comp rx=0 tx=0).stop 2024-09-10T10:12:16.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.566+0000 7f75f845c740 1 -- 172.21.15.50:0/829753102 shutdown_connections 2024-09-10T10:12:16.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.566+0000 7f75f845c740 1 --2- 172.21.15.50:0/829753102 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56082a1def30 0x56082a1e13f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.566+0000 7f75f845c740 1 --2- 172.21.15.50:0/829753102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1cef30 0x56082a1cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.566+0000 7f75d8c00640 0 client.25447 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:16.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.566+0000 7f75f845c740 1 --2- 172.21.15.50:0/829753102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1c4670 0x56082a1cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.566+0000 7f75f845c740 1 --2- 172.21.15.50:0/829753102 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1cbe90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.567+0000 7f75f845c740 1 -- 172.21.15.50:0/829753102 >> 172.21.15.50:0/829753102 conn(0x56082a1c02e0 msgr2=0x56082a1c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:16.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.567+0000 7f75f845c740 1 -- 172.21.15.50:0/829753102 shutdown_connections 2024-09-10T10:12:16.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.567+0000 7f75f845c740 1 -- 172.21.15.50:0/829753102 wait complete. 2024-09-10T10:12:16.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.567+0000 7f75f845c740 20 client.25447 trim_cache size 0 max 16384 2024-09-10T10:12:16.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.585+0000 7f75f845c740 1 Processor -- start 2024-09-10T10:12:16.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.585+0000 7f75f845c740 1 -- start start 2024-09-10T10:12:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.586+0000 7f75f845c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1e6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.586+0000 7f75f845c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1c4670 0x56082a1e7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.586+0000 7f75f845c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1cef30 0x56082a1c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.586+0000 7f75f845c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f75d0012460 con 0x56082a1c4670 2024-09-10T10:12:16.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.586+0000 7f75f845c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f75d000fd30 con 0x56082a1cef30 2024-09-10T10:12:16.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.586+0000 7f75f845c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f75d000db80 con 0x56082a1c3d50 2024-09-10T10:12:16.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.586+0000 7f75ee000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1c4670 0x56082a1e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:16.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.586+0000 7f75ee000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1c4670 0x56082a1e7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39006/0 (socket says 172.21.15.50:39006) 2024-09-10T10:12:16.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.586+0000 7f75ee000640 1 -- 172.21.15.50:0/908353487 learned_addr learned my addr 172.21.15.50:0/908353487 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:16.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.586+0000 7f75eea00640 1 --2- 172.21.15.50:0/908353487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1e6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:16.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.587+0000 7f75ee000640 1 -- 172.21.15.50:0/908353487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 msgr2=0x56082a1e6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:16.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.587+0000 7f75ee000640 1 --2- 172.21.15.50:0/908353487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1e6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.587+0000 7f75ee000640 1 -- 172.21.15.50:0/908353487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1cef30 msgr2=0x56082a1c90f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:12:16.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.587+0000 7f75ee000640 1 --2- 172.21.15.50:0/908353487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1cef30 0x56082a1c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.587+0000 7f75ee000640 1 -- 172.21.15.50:0/908353487 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56082a1d1660 con 0x56082a1c4670 2024-09-10T10:12:16.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.587+0000 7f75ee000640 1 --2- 172.21.15.50:0/908353487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1c4670 0x56082a1e7240 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f75dc011d10 tx=0x7f75dc005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fd56a53c94d959 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:16.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.587+0000 7f75db400640 1 -- 172.21.15.50:0/908353487 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc004380 con 0x56082a1c4670 2024-09-10T10:12:16.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.587+0000 7f75db400640 1 -- 172.21.15.50:0/908353487 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75dc029070 con 0x56082a1c4670 2024-09-10T10:12:16.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.588+0000 7f75db400640 1 -- 172.21.15.50:0/908353487 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc019690 con 0x56082a1c4670 2024-09-10T10:12:16.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.589+0000 7f75f845c740 1 -- 172.21.15.50:0/908353487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1c4670 msgr2=0x56082a1e7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:16.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.589+0000 7f75f845c740 1 --2- 172.21.15.50:0/908353487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1c4670 0x56082a1e7240 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f75dc011d10 tx=0x7f75dc005850 comp rx=0 tx=0).stop 2024-09-10T10:12:16.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.589+0000 7f75f845c740 1 -- 172.21.15.50:0/908353487 shutdown_connections 2024-09-10T10:12:16.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.589+0000 7f75f845c740 1 --2- 172.21.15.50:0/908353487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1cef30 0x56082a1c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.589+0000 7f75f845c740 1 --2- 172.21.15.50:0/908353487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1c4670 0x56082a1e7240 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.589+0000 7f75f845c740 1 --2- 172.21.15.50:0/908353487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c3d50 0x56082a1e6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.589+0000 7f75f845c740 1 -- 172.21.15.50:0/908353487 >> 172.21.15.50:0/908353487 conn(0x56082a1c02e0 msgr2=0x56082a1bf380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:16.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.589+0000 7f75f845c740 1 -- 172.21.15.50:0/908353487 shutdown_connections 2024-09-10T10:12:16.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.589+0000 7f75f845c740 1 -- 172.21.15.50:0/908353487 wait complete. 2024-09-10T10:12:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.590+0000 7f75f845c740 1 -- start start 2024-09-10T10:12:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.590+0000 7f75f845c740 1 Processor -- start 2024-09-10T10:12:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.591+0000 7f75f845c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1c3d50 0x56082a1d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.591+0000 7f75f845c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c4670 0x56082a1d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.591+0000 7f75f845c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1cef30 0x56082a1d3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.591+0000 7f75f845c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f75d000e1f0 con 0x56082a1cef30 2024-09-10T10:12:16.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.591+0000 7f75f845c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f75d000f660 con 0x56082a1c3d50 2024-09-10T10:12:16.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.591+0000 7f75f845c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f75d000e8c0 con 0x56082a1c4670 2024-09-10T10:12:16.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.591+0000 7f75f845c740 10 client.0 _ll_register_callbacks cb 0x7f75e0004420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:16.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.591+0000 7f75ee000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c4670 0x56082a1d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:16.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.592+0000 7f75ee000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c4670 0x56082a1d3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:57992/0 (socket says 172.21.15.50:57992) 2024-09-10T10:12:16.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.592+0000 7f75ee000640 1 -- 172.21.15.50:0/4018354676 learned_addr learned my addr 172.21.15.50:0/4018354676 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:16.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.592+0000 7f75eea00640 1 --2- 172.21.15.50:0/4018354676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1c3d50 0x56082a1d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:16.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.592+0000 7f75eea00640 1 -- 172.21.15.50:0/4018354676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c4670 msgr2=0x56082a1d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:16.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.592+0000 7f75eea00640 1 --2- 172.21.15.50:0/4018354676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c4670 0x56082a1d3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.592+0000 7f75eea00640 1 -- 172.21.15.50:0/4018354676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1cef30 msgr2=0x56082a1d3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.592+0000 7f75eea00640 1 --2- 172.21.15.50:0/4018354676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1cef30 0x56082a1d3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.592+0000 7f75eea00640 1 -- 172.21.15.50:0/4018354676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56082a248fc0 con 0x56082a1c3d50 2024-09-10T10:12:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.593+0000 7f75eea00640 1 --2- 172.21.15.50:0/4018354676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1c3d50 0x56082a1d3030 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f75e002a860 tx=0x7f75e00309a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e501443bd850867 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.593+0000 7f75d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:12:16.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.593+0000 7f75d8c00640 1 -- 172.21.15.50:0/4018354676 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0037040 con 0x56082a1c3d50 2024-09-10T10:12:16.600 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:12:16.600 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T10:12:16.600 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-10T10:12:16.600 INFO:teuthology.orchestra.run.smithi050.stdout: "2431fa90-0688-4fad-aef8-15904a680125": { 2024-09-10T10:12:16.600 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-10T10:12:16.600 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "2431fa90-0688-4fad-aef8-15904a680125", 2024-09-10T10:12:16.600 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2024-09-10T10:12:16.600 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:16.600 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:16.601 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:12:16.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.593+0000 7f75d8c00640 1 -- 172.21.15.50:0/4018354676 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f75e003ddf0 con 0x56082a1c3d50 2024-09-10T10:12:16.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.593+0000 7f75f845c740 1 -- 172.21.15.50:0/4018354676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75dc029070 con 0x56082a1c3d50 2024-09-10T10:12:16.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.593+0000 7f75d8c00640 1 -- 172.21.15.50:0/4018354676 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f75e006b050 con 0x56082a1c3d50 2024-09-10T10:12:16.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.593+0000 7f75f845c740 10 client.25475 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:16.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.593+0000 7f75f845c740 1 -- 172.21.15.50:0/4018354676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56082a24a2d0 con 0x56082a1c3d50 2024-09-10T10:12:16.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.594+0000 7f75d8c00640 1 -- 172.21.15.50:0/4018354676 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75dc029070 con 0x56082a1c3d50 2024-09-10T10:12:16.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.594+0000 7f75d8c00640 1 -- 172.21.15.50:0/4018354676 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f75e0049860 con 0x56082a1c3d50 2024-09-10T10:12:16.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.594+0000 7f75f845c740 10 client.25475 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:16.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.594+0000 7f75f845c740 10 client.25475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:12:16.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.594+0000 7f75f845c740 20 client.25475 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:16.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.594+0000 7f75f845c740 1 --2- 172.21.15.50:0/4018354676 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56082a24a990 0x56082a24cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:16.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.594+0000 7f75f845c740 4 client.25475 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:12:16.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.594+0000 7f75f845c740 1 -- 172.21.15.50:0/4018354676 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56082a131e60 con 0x56082a24a990 2024-09-10T10:12:16.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.595+0000 7f75ee000640 1 --2- 172.21.15.50:0/4018354676 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56082a24a990 0x56082a24cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:16.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.595+0000 7f75ee000640 1 --2- 172.21.15.50:0/4018354676 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56082a24a990 0x56082a24cdd0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4db6a72c6e596ead server_cookie=864216e220d29896 in_seq=0 out_seq=0 2024-09-10T10:12:16.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.595+0000 7f75d8c00640 10 client.25475 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:16.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75d8c00640 1 -- 172.21.15.50:0/4018354676 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56082a131e60 con 0x56082a24a990 2024-09-10T10:12:16.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75d8c00640 10 client.25475 handle_command_reply: tid=0 2024-09-10T10:12:16.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75f845c740 1 client.25475 shutdown 2024-09-10T10:12:16.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75f845c740 1 -- 172.21.15.50:0/4018354676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1c3d50 msgr2=0x56082a1d3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:16.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75f845c740 1 --2- 172.21.15.50:0/4018354676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1c3d50 0x56082a1d3030 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f75e002a860 tx=0x7f75e00309a0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75f845c740 1 -- 172.21.15.50:0/4018354676 shutdown_connections 2024-09-10T10:12:16.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75f845c740 1 --2- 172.21.15.50:0/4018354676 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56082a24a990 0x56082a24cdd0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75f845c740 1 --2- 172.21.15.50:0/4018354676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56082a1cef30 0x56082a1d3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75f845c740 1 --2- 172.21.15.50:0/4018354676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56082a1c4670 0x56082a1d3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75f845c740 1 --2- 172.21.15.50:0/4018354676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56082a1c3d50 0x56082a1d3030 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75f845c740 1 -- 172.21.15.50:0/4018354676 >> 172.21.15.50:0/4018354676 conn(0x56082a1c02e0 msgr2=0x56082a1c57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:16.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75d8c00640 0 client.25475 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:16.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75f845c740 1 -- 172.21.15.50:0/4018354676 shutdown_connections 2024-09-10T10:12:16.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75f845c740 1 -- 172.21.15.50:0/4018354676 wait complete. 2024-09-10T10:12:16.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.596+0000 7f75f845c740 20 client.25475 trim_cache size 0 max 16384 2024-09-10T10:12:16.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.597+0000 7f75efe00640 1 -- 172.21.15.50:0/360312908 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f75d40a2b80 msgr2=0x7f75d40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:16.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.597+0000 7f75efe00640 1 --2- 172.21.15.50:0/360312908 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f75d40a2b80 0x7f75d40a5040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f75e002a930 tx=0x7f75e00058d0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.597+0000 7f75efe00640 1 -- 172.21.15.50:0/360312908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75f0108f60 msgr2=0x7f75f019ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:16.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.597+0000 7f75efe00640 1 --2- 172.21.15.50:0/360312908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75f0108f60 0x7f75f019ed30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f75e800eb10 tx=0x7f75e800ef10 comp rx=0 tx=0).stop 2024-09-10T10:12:16.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.598+0000 7f75efe00640 1 -- 172.21.15.50:0/360312908 shutdown_connections 2024-09-10T10:12:16.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.598+0000 7f75efe00640 1 --2- 172.21.15.50:0/360312908 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f75d40a2b80 0x7f75d40a5040 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.598+0000 7f75efe00640 1 --2- 172.21.15.50:0/360312908 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f75f0108f60 0x7f75f019ed30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.598+0000 7f75efe00640 1 --2- 172.21.15.50:0/360312908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75f01047e0 0x7f75f019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.598+0000 7f75efe00640 1 --2- 172.21.15.50:0/360312908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75f0103e30 0x7f75f019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:16.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.598+0000 7f75efe00640 1 -- 172.21.15.50:0/360312908 >> 172.21.15.50:0/360312908 conn(0x7f75f00ff910 msgr2=0x7f75f0100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:16.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.598+0000 7f75efe00640 1 -- 172.21.15.50:0/360312908 shutdown_connections 2024-09-10T10:12:16.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:16.598+0000 7f75efe00640 1 -- 172.21.15.50:0/360312908 wait complete. 2024-09-10T10:12:17.035 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:16 smithi050 ceph-mon[30354]: pgmap v423: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T10:12:17.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:16 smithi189 ceph-mon[34999]: pgmap v423: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T10:12:17.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:16 smithi084 ceph-mon[34812]: pgmap v423: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T10:12:17.430 INFO:tasks.cephfs.filesystem:scrub status for tag:2431fa90-0688-4fad-aef8-15904a680125 - {'path': '/', 'tag': '2431fa90-0688-4fad-aef8-15904a680125', 'options': 'recursive,force'} 2024-09-10T10:12:18.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:17 smithi189 ceph-mon[34999]: pgmap v424: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:12:18.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:17 smithi084 ceph-mon[34812]: pgmap v424: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:12:18.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:17 smithi050 ceph-mon[30354]: pgmap v424: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:12:19.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:18 smithi189 ceph-mon[34999]: scrub summary: idle 2024-09-10T10:12:19.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:18 smithi084 ceph-mon[34812]: scrub summary: idle 2024-09-10T10:12:19.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:18 smithi050 ceph-mon[30354]: scrub summary: idle 2024-09-10T10:12:20.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:19 smithi189 ceph-mon[34999]: pgmap v425: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:12:20.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:19 smithi084 ceph-mon[34812]: pgmap v425: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:12:20.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:19 smithi050 ceph-mon[30354]: pgmap v425: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T10:12:22.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:21 smithi050 ceph-mon[30354]: pgmap v426: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-10T10:12:22.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:21 smithi189 ceph-mon[34999]: pgmap v426: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-10T10:12:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:21 smithi084 ceph-mon[34812]: pgmap v426: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-10T10:12:24.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:23 smithi050 ceph-mon[30354]: pgmap v427: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-10T10:12:24.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:23 smithi189 ceph-mon[34999]: pgmap v427: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-10T10:12:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:23 smithi084 ceph-mon[34812]: pgmap v427: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-10T10:12:26.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:25 smithi050 ceph-mon[30354]: pgmap v428: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:12:26.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:25 smithi189 ceph-mon[34999]: pgmap v428: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:12:26.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:25 smithi084 ceph-mon[34812]: pgmap v428: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:12:28.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:27 smithi050 ceph-mon[30354]: pgmap v429: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T10:12:28.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:27 smithi189 ceph-mon[34999]: pgmap v429: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T10:12:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:27 smithi084 ceph-mon[34812]: pgmap v429: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T10:12:30.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:29 smithi050 ceph-mon[30354]: pgmap v430: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T10:12:30.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:29 smithi189 ceph-mon[34999]: pgmap v430: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T10:12:30.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:29 smithi084 ceph-mon[34812]: pgmap v430: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T10:12:32.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:31 smithi050 ceph-mon[30354]: pgmap v431: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:12:32.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:31 smithi189 ceph-mon[34999]: pgmap v431: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:12:32.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:31 smithi084 ceph-mon[34812]: pgmap v431: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:12:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:33 smithi050 ceph-mon[30354]: pgmap v432: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:12:34.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:12:34.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:33 smithi189 ceph-mon[34999]: pgmap v432: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:12:34.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:33 smithi084 ceph-mon[34812]: pgmap v432: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:12:34.755 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:35.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.453+0000 7f762e400640 1 -- 172.21.15.50:0/1110522475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76281079c0 msgr2=0x7f7628107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:35.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.453+0000 7f762e400640 1 --2- 172.21.15.50:0/1110522475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76281079c0 0x7f7628107da0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f761c009860 tx=0x7f761c02a340 comp rx=0 tx=0).stop 2024-09-10T10:12:35.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.453+0000 7f762e400640 1 -- 172.21.15.50:0/1110522475 shutdown_connections 2024-09-10T10:12:35.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.453+0000 7f762e400640 1 --2- 172.21.15.50:0/1110522475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7628102360 0x7f762810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.453+0000 7f762e400640 1 --2- 172.21.15.50:0/1110522475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76281019c0 0x7f7628101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.453+0000 7f762e400640 1 --2- 172.21.15.50:0/1110522475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76281079c0 0x7f7628107da0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.453+0000 7f762e400640 1 -- 172.21.15.50:0/1110522475 >> 172.21.15.50:0/1110522475 conn(0x7f76280fd740 msgr2=0x7f76280ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.453+0000 7f762e400640 1 -- 172.21.15.50:0/1110522475 shutdown_connections 2024-09-10T10:12:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.453+0000 7f762e400640 1 -- 172.21.15.50:0/1110522475 wait complete. 2024-09-10T10:12:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.455+0000 7f762e400640 1 Processor -- start 2024-09-10T10:12:35.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.455+0000 7f762e400640 1 -- start start 2024-09-10T10:12:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.455+0000 7f762e400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76281019c0 0x7f762810dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.456+0000 7f762e400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7628102360 0x7f762810e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.456+0000 7f762e400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76281079c0 0x7f76281a3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.456+0000 7f762e400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7628111d90 con 0x7f7628102360 2024-09-10T10:12:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.456+0000 7f762e400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7628111c10 con 0x7f76281019c0 2024-09-10T10:12:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.456+0000 7f762e400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7628111f10 con 0x7f76281079c0 2024-09-10T10:12:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.456+0000 7f762d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76281019c0 0x7f762810dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.456+0000 7f762d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76281019c0 0x7f762810dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:54554/0 (socket says 172.21.15.50:54554) 2024-09-10T10:12:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.456+0000 7f762d000640 1 -- 172.21.15.50:0/2085523403 learned_addr learned my addr 172.21.15.50:0/2085523403 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.456+0000 7f7627e00640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7628102360 0x7f762810e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.456+0000 7f762d000640 1 -- 172.21.15.50:0/2085523403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76281079c0 msgr2=0x7f76281a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.457+0000 7f762d000640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76281079c0 0x7f76281a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.457+0000 7f762d000640 1 -- 172.21.15.50:0/2085523403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7628102360 msgr2=0x7f762810e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.457+0000 7f762d000640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7628102360 0x7f762810e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.457+0000 7f762d000640 1 -- 172.21.15.50:0/2085523403 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76281a3890 con 0x7f76281019c0 2024-09-10T10:12:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.457+0000 7f7627e00640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7628102360 0x7f762810e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:12:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.457+0000 7f762d000640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76281019c0 0x7f762810dc00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f761c035040 tx=0x7f761c033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.458+0000 7f7625600640 1 -- 172.21.15.50:0/2085523403 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c037040 con 0x7f76281019c0 2024-09-10T10:12:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.458+0000 7f7625600640 1 -- 172.21.15.50:0/2085523403 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f761c040070 con 0x7f76281019c0 2024-09-10T10:12:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.458+0000 7f7625600640 1 -- 172.21.15.50:0/2085523403 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c003a10 con 0x7f76281019c0 2024-09-10T10:12:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.458+0000 7f762e400640 1 -- 172.21.15.50:0/2085523403 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76281a3b20 con 0x7f76281019c0 2024-09-10T10:12:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.458+0000 7f762e400640 1 -- 172.21.15.50:0/2085523403 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76281a3fb0 con 0x7f76281019c0 2024-09-10T10:12:35.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.460+0000 7f762e400640 1 -- 172.21.15.50:0/2085523403 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7628101e20 con 0x7f76281019c0 2024-09-10T10:12:35.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.463+0000 7f7625600640 1 -- 172.21.15.50:0/2085523403 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f761c06bd10 con 0x7f76281019c0 2024-09-10T10:12:35.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.466+0000 7f7625600640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f76100a2c00 0x7f76100a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:35.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.466+0000 7f7625600640 1 -- 172.21.15.50:0/2085523403 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f761c0eee80 con 0x7f76281019c0 2024-09-10T10:12:35.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.466+0000 7f7627e00640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f76100a2c00 0x7f76100a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:35.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.466+0000 7f7625600640 1 -- 172.21.15.50:0/2085523403 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f761c049020 con 0x7f76281019c0 2024-09-10T10:12:35.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.467+0000 7f7627e00640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f76100a2c00 0x7f76100a50c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f762810ec90 tx=0x7f7614009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:35.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.785+0000 7f762e400640 1 -- 172.21.15.50:0/2085523403 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76281ab5f0 con 0x7f76281019c0 2024-09-10T10:12:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.786+0000 7f7625600640 1 -- 172.21.15.50:0/2085523403 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f761c0bb9f0 con 0x7f76281019c0 2024-09-10T10:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:12:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:12:35.789 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:12:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.789+0000 7f762e400640 1 -- 172.21.15.50:0/2085523403 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f76100a2c00 msgr2=0x7f76100a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.789+0000 7f762e400640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f76100a2c00 0x7f76100a50c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f762810ec90 tx=0x7f7614009260 comp rx=0 tx=0).stop 2024-09-10T10:12:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.789+0000 7f762e400640 1 -- 172.21.15.50:0/2085523403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76281019c0 msgr2=0x7f762810dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.789+0000 7f762e400640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76281019c0 0x7f762810dc00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f761c035040 tx=0x7f761c033b60 comp rx=0 tx=0).stop 2024-09-10T10:12:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.789+0000 7f762e400640 1 -- 172.21.15.50:0/2085523403 shutdown_connections 2024-09-10T10:12:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.789+0000 7f762e400640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f76100a2c00 0x7f76100a50c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.789+0000 7f762e400640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76281079c0 0x7f76281a3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.789+0000 7f762e400640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7628102360 0x7f762810e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.789+0000 7f762e400640 1 --2- 172.21.15.50:0/2085523403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76281019c0 0x7f762810dc00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.789+0000 7f762e400640 1 -- 172.21.15.50:0/2085523403 >> 172.21.15.50:0/2085523403 conn(0x7f76280fd740 msgr2=0x7f76280fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.790+0000 7f762e400640 1 -- 172.21.15.50:0/2085523403 shutdown_connections 2024-09-10T10:12:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:35.790+0000 7f762e400640 1 -- 172.21.15.50:0/2085523403 wait complete. 2024-09-10T10:12:36.182 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:35 smithi050 ceph-mon[30354]: pgmap v433: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:12:36.182 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:35 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2085523403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:36.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:35 smithi189 ceph-mon[34999]: pgmap v433: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:12:36.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:35 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2085523403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:36.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:35 smithi084 ceph-mon[34812]: pgmap v433: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:12:36.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:35 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2085523403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:36.738 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id f981f249 --release --await' 2024-09-10T10:12:36.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24560 quiesce db --set-id f981f249 --release --await 2024-09-10T10:12:37.192 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:37.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.846+0000 7fdd43000640 1 -- 172.21.15.50:0/850493641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd3c074510 msgr2=0x7fdd3c0748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.846+0000 7fdd43000640 1 --2- 172.21.15.50:0/850493641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd3c074510 0x7fdd3c0748f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009900 tx=0x7fdd3002a490 comp rx=0 tx=0).stop 2024-09-10T10:12:37.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.847+0000 7fdd43000640 1 -- 172.21.15.50:0/850493641 shutdown_connections 2024-09-10T10:12:37.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.847+0000 7fdd43000640 1 --2- 172.21.15.50:0/850493641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd3c10e280 0x7fdd3c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.847+0000 7fdd43000640 1 --2- 172.21.15.50:0/850493641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd3c074e30 0x7fdd3c10dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.847+0000 7fdd43000640 1 --2- 172.21.15.50:0/850493641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd3c074510 0x7fdd3c0748f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.847+0000 7fdd43000640 1 -- 172.21.15.50:0/850493641 >> 172.21.15.50:0/850493641 conn(0x7fdd3c0fd740 msgr2=0x7fdd3c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:37.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.848+0000 7fdd43000640 1 -- 172.21.15.50:0/850493641 shutdown_connections 2024-09-10T10:12:37.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.848+0000 7fdd43000640 1 -- 172.21.15.50:0/850493641 wait complete. 2024-09-10T10:12:37.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.850+0000 7fdd43000640 1 Processor -- start 2024-09-10T10:12:37.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.850+0000 7fdd43000640 1 -- start start 2024-09-10T10:12:37.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.851+0000 7fdd43000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd3c074510 0x7fdd3c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.851+0000 7fdd43000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd3c074e30 0x7fdd3c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.851+0000 7fdd43000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd3c10e280 0x7fdd3c19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.851+0000 7fdd43000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c114000 con 0x7fdd3c10e280 2024-09-10T10:12:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.851+0000 7fdd43000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c113e80 con 0x7fdd3c074e30 2024-09-10T10:12:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.851+0000 7fdd43000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c114180 con 0x7fdd3c074510 2024-09-10T10:12:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.851+0000 7fdd41c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd3c074510 0x7fdd3c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.851+0000 7fdd41c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd3c074510 0x7fdd3c19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:54762/0 (socket says 172.21.15.50:54762) 2024-09-10T10:12:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.851+0000 7fdd41c00640 1 -- 172.21.15.50:0/1835250932 learned_addr learned my addr 172.21.15.50:0/1835250932 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.852+0000 7fdd41c00640 1 -- 172.21.15.50:0/1835250932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd3c074e30 msgr2=0x7fdd3c19a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T10:12:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.852+0000 7fdd41c00640 1 --2- 172.21.15.50:0/1835250932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd3c074e30 0x7fdd3c19a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.852+0000 7fdd41c00640 1 -- 172.21.15.50:0/1835250932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd3c10e280 msgr2=0x7fdd3c19ed70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:12:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.852+0000 7fdd42600640 1 --2- 172.21.15.50:0/1835250932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd3c10e280 0x7fdd3c19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.852+0000 7fdd41c00640 1 --2- 172.21.15.50:0/1835250932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd3c10e280 0x7fdd3c19ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.852+0000 7fdd41c00640 1 -- 172.21.15.50:0/1835250932 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3c19f450 con 0x7fdd3c074510 2024-09-10T10:12:37.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.853+0000 7fdd41c00640 1 --2- 172.21.15.50:0/1835250932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd3c074510 0x7fdd3c19a4a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd30004770 tx=0x7fdd30003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:37.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.853+0000 7fdd3a000640 1 -- 172.21.15.50:0/1835250932 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3003f070 con 0x7fdd3c074510 2024-09-10T10:12:37.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.853+0000 7fdd3a000640 1 -- 172.21.15.50:0/1835250932 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd30031ca0 con 0x7fdd3c074510 2024-09-10T10:12:37.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.853+0000 7fdd43000640 1 -- 172.21.15.50:0/1835250932 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3c19f6e0 con 0x7fdd3c074510 2024-09-10T10:12:37.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.853+0000 7fdd3a000640 1 -- 172.21.15.50:0/1835250932 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30035030 con 0x7fdd3c074510 2024-09-10T10:12:37.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.854+0000 7fdd43000640 1 -- 172.21.15.50:0/1835250932 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd3c1a7020 con 0x7fdd3c074510 2024-09-10T10:12:37.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.858+0000 7fdd47030740 1 Processor -- start 2024-09-10T10:12:37.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.859+0000 7fdd47030740 1 -- start start 2024-09-10T10:12:37.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.859+0000 7fdd47030740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931883e0 0x5640931887c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.859+0000 7fdd47030740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564093188d00 0x5640931a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.859+0000 7fdd47030740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640931a4710 0x5640931a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.859+0000 7fdd47030740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5640930ee650 con 0x5640931883e0 2024-09-10T10:12:37.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.859+0000 7fdd47030740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564093095f10 con 0x5640931a4710 2024-09-10T10:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.859+0000 7fdd47030740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5640930ea610 con 0x564093188d00 2024-09-10T10:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.860+0000 7fdd42600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931883e0 0x5640931887c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.860+0000 7fdd42600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931883e0 0x5640931887c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60782/0 (socket says 172.21.15.50:60782) 2024-09-10T10:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.860+0000 7fdd42600640 1 -- 172.21.15.50:0/1250193759 learned_addr learned my addr 172.21.15.50:0/1250193759 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.860+0000 7fdd41200640 1 --2- 172.21.15.50:0/1250193759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640931a4710 0x5640931a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.861+0000 7fdd42600640 1 -- 172.21.15.50:0/1250193759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564093188d00 msgr2=0x5640931a41d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.861+0000 7fdd42600640 1 --2- 172.21.15.50:0/1250193759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564093188d00 0x5640931a41d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.861+0000 7fdd42600640 1 -- 172.21.15.50:0/1250193759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640931a4710 msgr2=0x5640931a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.861+0000 7fdd42600640 1 --2- 172.21.15.50:0/1250193759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640931a4710 0x5640931a6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.861+0000 7fdd42600640 1 -- 172.21.15.50:0/1250193759 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564092dfd580 con 0x5640931883e0 2024-09-10T10:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.861+0000 7fdd41200640 1 --2- 172.21.15.50:0/1250193759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640931a4710 0x5640931a6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:12:37.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.861+0000 7fdd42600640 1 --2- 172.21.15.50:0/1250193759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931883e0 0x5640931887c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009d30 tx=0x7fdd34031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48b07fe154ab3ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.862+0000 7fdd3a000640 1 -- 172.21.15.50:0/1835250932 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdd30042070 con 0x7fdd3c074510 2024-09-10T10:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.862+0000 7fdd2ea00640 1 -- 172.21.15.50:0/1250193759 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34003b70 con 0x5640931883e0 2024-09-10T10:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.862+0000 7fdd2ea00640 1 -- 172.21.15.50:0/1250193759 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd34009e20 con 0x5640931883e0 2024-09-10T10:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.862+0000 7fdd2ea00640 1 -- 172.21.15.50:0/1250193759 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd340338b0 con 0x5640931883e0 2024-09-10T10:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.864+0000 7fdd47030740 1 -- 172.21.15.50:0/1250193759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931883e0 msgr2=0x5640931887c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.864+0000 7fdd47030740 1 --2- 172.21.15.50:0/1250193759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931883e0 0x5640931887c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009d30 tx=0x7fdd34031740 comp rx=0 tx=0).stop 2024-09-10T10:12:37.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.864+0000 7fdd47030740 1 -- 172.21.15.50:0/1250193759 shutdown_connections 2024-09-10T10:12:37.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.864+0000 7fdd47030740 1 --2- 172.21.15.50:0/1250193759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640931a4710 0x5640931a6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.864+0000 7fdd47030740 1 --2- 172.21.15.50:0/1250193759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564093188d00 0x5640931a41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.864+0000 7fdd47030740 1 --2- 172.21.15.50:0/1250193759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931883e0 0x5640931887c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.864+0000 7fdd47030740 1 -- 172.21.15.50:0/1250193759 >> 172.21.15.50:0/1250193759 conn(0x564093184ab0 msgr2=0x564093184e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:37.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.864+0000 7fdd47030740 1 -- 172.21.15.50:0/1250193759 shutdown_connections 2024-09-10T10:12:37.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.864+0000 7fdd47030740 1 -- 172.21.15.50:0/1250193759 wait complete. 2024-09-10T10:12:37.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.865+0000 7fdd47030740 1 -- start start 2024-09-10T10:12:37.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.865+0000 7fdd47030740 1 Processor -- start 2024-09-10T10:12:37.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.866+0000 7fdd3a000640 1 --2- 172.21.15.50:0/1835250932 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdd240a2bb0 0x7fdd240a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.866+0000 7fdd47030740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931883e0 0x56409319e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.866+0000 7fdd47030740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564093188d00 0x56409319e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.866+0000 7fdd47030740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640931a4710 0x5640931a3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.866+0000 7fdd47030740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56409318b3a0 con 0x5640931883e0 2024-09-10T10:12:37.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.866+0000 7fdd47030740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5640930a9350 con 0x564093188d00 2024-09-10T10:12:37.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.866+0000 7fdd47030740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56409318b520 con 0x5640931a4710 2024-09-10T10:12:37.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.866+0000 7fdd47030740 10 client.0 _ll_register_callbacks cb 0x5640930cc290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:37.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.867+0000 7fdd41c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931883e0 0x56409319e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.867+0000 7fdd41c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931883e0 0x56409319e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60786/0 (socket says 172.21.15.50:60786) 2024-09-10T10:12:37.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.867+0000 7fdd41c00640 1 -- 172.21.15.50:0/1592004556 learned_addr learned my addr 172.21.15.50:0/1592004556 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:37.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.867+0000 7fdd41200640 1 --2- 172.21.15.50:0/1592004556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564093188d00 0x56409319e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.867+0000 7fdd3a000640 1 -- 172.21.15.50:0/1835250932 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fdd300efb60 con 0x7fdd3c074510 2024-09-10T10:12:37.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.868+0000 7fdd41200640 1 -- 172.21.15.50:0/1592004556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640931a4710 msgr2=0x5640931a3f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:12:37.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.868+0000 7fdd41200640 1 --2- 172.21.15.50:0/1592004556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640931a4710 0x5640931a3f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.868+0000 7fdd41200640 1 -- 172.21.15.50:0/1592004556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931883e0 msgr2=0x56409319e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.868+0000 7fdd41200640 1 --2- 172.21.15.50:0/1592004556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931883e0 0x56409319e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.868+0000 7fdd41200640 1 -- 172.21.15.50:0/1592004556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564092ec7960 con 0x564093188d00 2024-09-10T10:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.868+0000 7fdd41200640 1 --2- 172.21.15.50:0/1592004556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564093188d00 0x56409319e7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0ffd40 tx=0x7fdd28010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db304d4913872a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:37.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.868+0000 7fdd23400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:12:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.868+0000 7fdd42600640 1 --2- 172.21.15.50:0/1835250932 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdd240a2bb0 0x7fdd240a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.868+0000 7fdd23400640 1 -- 172.21.15.50:0/1592004556 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28004230 con 0x564093188d00 2024-09-10T10:12:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.869+0000 7fdd23400640 1 -- 172.21.15.50:0/1592004556 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fdd280043d0 con 0x564093188d00 2024-09-10T10:12:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.869+0000 7fdd47030740 1 -- 172.21.15.50:0/1592004556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd34009e20 con 0x564093188d00 2024-09-10T10:12:37.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.869+0000 7fdd23400640 1 -- 172.21.15.50:0/1592004556 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdd28005020 con 0x564093188d00 2024-09-10T10:12:37.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.869+0000 7fdd47030740 10 client.25487 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:37.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.869+0000 7fdd47030740 1 -- 172.21.15.50:0/1592004556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5640931aa910 con 0x564093188d00 2024-09-10T10:12:37.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.869+0000 7fdd42600640 1 --2- 172.21.15.50:0/1835250932 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdd240a2bb0 0x7fdd240a5070 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x56409319ee80 tx=0x7fdd34004910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:37.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.869+0000 7fdd23400640 1 -- 172.21.15.50:0/1592004556 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd280047a0 con 0x564093188d00 2024-09-10T10:12:37.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.870+0000 7fdd23400640 1 -- 172.21.15.50:0/1592004556 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fdd2800f040 con 0x564093188d00 2024-09-10T10:12:37.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.870+0000 7fdd47030740 10 client.25487 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:37.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.870+0000 7fdd47030740 10 client.25487 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:12:37.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.870+0000 7fdd47030740 20 client.25487 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.870+0000 7fdd47030740 1 --2- 172.21.15.50:0/1592004556 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5640931ac290 0x5640931ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.870+0000 7fdd47030740 4 client.25487 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:12:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.870+0000 7fdd47030740 1 -- 172.21.15.50:0/1592004556 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdd34009e20 con 0x5640931ac290 2024-09-10T10:12:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.870+0000 7fdd41c00640 1 --2- 172.21.15.50:0/1592004556 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5640931ac290 0x5640931ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.871+0000 7fdd41c00640 1 --2- 172.21.15.50:0/1592004556 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5640931ac290 0x5640931ae6b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9060f0edd751ce70 server_cookie=c8e85378f5e26a8c in_seq=0 out_seq=0 2024-09-10T10:12:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.871+0000 7fdd23400640 10 client.25487 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.872+0000 7fdd23400640 1 -- 172.21.15.50:0/1592004556 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fdd34009e20 con 0x5640931ac290 2024-09-10T10:12:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.872+0000 7fdd23400640 10 client.25487 handle_command_reply: tid=0 2024-09-10T10:12:37.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.872+0000 7fdd47030740 1 client.25487 shutdown 2024-09-10T10:12:37.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.872+0000 7fdd47030740 1 -- 172.21.15.50:0/1592004556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564093188d00 msgr2=0x56409319e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.872+0000 7fdd47030740 1 --2- 172.21.15.50:0/1592004556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564093188d00 0x56409319e7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0ffd40 tx=0x7fdd28010800 comp rx=0 tx=0).stop 2024-09-10T10:12:37.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.875+0000 7fdd47030740 1 -- 172.21.15.50:0/1592004556 shutdown_connections 2024-09-10T10:12:37.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.875+0000 7fdd47030740 1 --2- 172.21.15.50:0/1592004556 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5640931ac290 0x5640931ae6b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.875+0000 7fdd47030740 1 --2- 172.21.15.50:0/1592004556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640931a4710 0x5640931a3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.875+0000 7fdd47030740 1 --2- 172.21.15.50:0/1592004556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564093188d00 0x56409319e7a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.875+0000 7fdd47030740 1 --2- 172.21.15.50:0/1592004556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931883e0 0x56409319e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.875+0000 7fdd23400640 0 client.25487 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:37.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.875+0000 7fdd47030740 1 -- 172.21.15.50:0/1592004556 >> 172.21.15.50:0/1592004556 conn(0x564093184ab0 msgr2=0x56409318a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:37.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.875+0000 7fdd47030740 1 -- 172.21.15.50:0/1592004556 shutdown_connections 2024-09-10T10:12:37.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.875+0000 7fdd47030740 1 -- 172.21.15.50:0/1592004556 wait complete. 2024-09-10T10:12:37.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.875+0000 7fdd47030740 20 client.25487 trim_cache size 0 max 16384 2024-09-10T10:12:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.911+0000 7fdd47030740 1 Processor -- start 2024-09-10T10:12:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.911+0000 7fdd47030740 1 -- start start 2024-09-10T10:12:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.911+0000 7fdd47030740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640931883e0 0x5640931a3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.911+0000 7fdd47030740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564093188d00 0x564093198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.911+0000 7fdd47030740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931a4710 0x5640931b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.912+0000 7fdd47030740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c073c70 con 0x5640931a4710 2024-09-10T10:12:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.912+0000 7fdd47030740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c071540 con 0x564093188d00 2024-09-10T10:12:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.912+0000 7fdd47030740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c06f390 con 0x5640931883e0 2024-09-10T10:12:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.912+0000 7fdd41c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640931883e0 0x5640931a3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.912+0000 7fdd41c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640931883e0 0x5640931a3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:54776/0 (socket says 172.21.15.50:54776) 2024-09-10T10:12:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.912+0000 7fdd41c00640 1 -- 172.21.15.50:0/4163345630 learned_addr learned my addr 172.21.15.50:0/4163345630 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.912+0000 7fdd42600640 1 --2- 172.21.15.50:0/4163345630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931a4710 0x5640931b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.912+0000 7fdd41200640 1 --2- 172.21.15.50:0/4163345630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564093188d00 0x564093198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.912+0000 7fdd41c00640 1 -- 172.21.15.50:0/4163345630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564093188d00 msgr2=0x564093198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.912+0000 7fdd41c00640 1 --2- 172.21.15.50:0/4163345630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564093188d00 0x564093198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.912+0000 7fdd41c00640 1 -- 172.21.15.50:0/4163345630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931a4710 msgr2=0x5640931b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.912+0000 7fdd41c00640 1 --2- 172.21.15.50:0/4163345630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931a4710 0x5640931b3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.913+0000 7fdd41c00640 1 -- 172.21.15.50:0/4163345630 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640931aed10 con 0x5640931883e0 2024-09-10T10:12:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.913+0000 7fdd41c00640 1 --2- 172.21.15.50:0/4163345630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640931883e0 0x5640931a3ee0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdd300c4710 tx=0x7fdd3003b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55155fb108269a09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.914+0000 7fdd2e000640 1 -- 172.21.15.50:0/4163345630 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd300bbfd0 con 0x5640931883e0 2024-09-10T10:12:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.914+0000 7fdd2e000640 1 -- 172.21.15.50:0/4163345630 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd300c0380 con 0x5640931883e0 2024-09-10T10:12:37.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.914+0000 7fdd2e000640 1 -- 172.21.15.50:0/4163345630 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd300b8640 con 0x5640931883e0 2024-09-10T10:12:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.915+0000 7fdd47030740 1 -- 172.21.15.50:0/4163345630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640931883e0 msgr2=0x5640931a3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.915+0000 7fdd47030740 1 --2- 172.21.15.50:0/4163345630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640931883e0 0x5640931a3ee0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdd300c4710 tx=0x7fdd3003b890 comp rx=0 tx=0).stop 2024-09-10T10:12:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.915+0000 7fdd47030740 1 -- 172.21.15.50:0/4163345630 shutdown_connections 2024-09-10T10:12:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.915+0000 7fdd47030740 1 --2- 172.21.15.50:0/4163345630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931a4710 0x5640931b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.915+0000 7fdd47030740 1 --2- 172.21.15.50:0/4163345630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564093188d00 0x564093198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.915+0000 7fdd47030740 1 --2- 172.21.15.50:0/4163345630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5640931883e0 0x5640931a3ee0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.915+0000 7fdd47030740 1 -- 172.21.15.50:0/4163345630 >> 172.21.15.50:0/4163345630 conn(0x564093184ab0 msgr2=0x564093198590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:37.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.915+0000 7fdd47030740 1 -- 172.21.15.50:0/4163345630 shutdown_connections 2024-09-10T10:12:37.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.916+0000 7fdd47030740 1 -- 172.21.15.50:0/4163345630 wait complete. 2024-09-10T10:12:37.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.916+0000 7fdd47030740 1 -- start start 2024-09-10T10:12:37.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.916+0000 7fdd47030740 1 Processor -- start 2024-09-10T10:12:37.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.917+0000 7fdd47030740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640931883e0 0x564093191d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.917+0000 7fdd47030740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564093188d00 0x5640931922a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.917+0000 7fdd47030740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931a4710 0x564093218f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.918+0000 7fdd47030740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c06fa00 con 0x5640931a4710 2024-09-10T10:12:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.918+0000 7fdd47030740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c070e70 con 0x5640931883e0 2024-09-10T10:12:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.918+0000 7fdd47030740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c0700d0 con 0x564093188d00 2024-09-10T10:12:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.918+0000 7fdd47030740 10 client.0 _ll_register_callbacks cb 0x7fdd280093f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.918+0000 7fdd41c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640931883e0 0x564093191d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.918+0000 7fdd41c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640931883e0 0x564093191d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:39796/0 (socket says 172.21.15.50:39796) 2024-09-10T10:12:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.918+0000 7fdd41c00640 1 -- 172.21.15.50:0/1929766662 learned_addr learned my addr 172.21.15.50:0/1929766662 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:37.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.918+0000 7fdd42600640 1 --2- 172.21.15.50:0/1929766662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931a4710 0x564093218f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.918+0000 7fdd41c00640 1 -- 172.21.15.50:0/1929766662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564093188d00 msgr2=0x5640931922a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.918+0000 7fdd41c00640 1 --2- 172.21.15.50:0/1929766662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564093188d00 0x5640931922a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.918+0000 7fdd41c00640 1 -- 172.21.15.50:0/1929766662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931a4710 msgr2=0x564093218f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.919+0000 7fdd41c00640 1 --2- 172.21.15.50:0/1929766662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931a4710 0x564093218f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.919+0000 7fdd41c00640 1 -- 172.21.15.50:0/1929766662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564093184360 con 0x5640931883e0 2024-09-10T10:12:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.919+0000 7fdd41c00640 1 --2- 172.21.15.50:0/1929766662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640931883e0 0x564093191d60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdd30005c40 tx=0x7fdd300057b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11046d34af29c1c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.919+0000 7fdd23400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:12:37.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.919+0000 7fdd23400640 1 -- 172.21.15.50:0/1929766662 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd300c9070 con 0x5640931883e0 2024-09-10T10:12:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.920+0000 7fdd23400640 1 -- 172.21.15.50:0/1929766662 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fdd3003fdf0 con 0x5640931883e0 2024-09-10T10:12:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.920+0000 7fdd47030740 1 -- 172.21.15.50:0/1929766662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd300c0380 con 0x5640931883e0 2024-09-10T10:12:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.920+0000 7fdd23400640 1 -- 172.21.15.50:0/1929766662 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdd300bbfd0 con 0x5640931883e0 2024-09-10T10:12:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.920+0000 7fdd47030740 10 client.25493 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.920+0000 7fdd47030740 1 -- 172.21.15.50:0/1929766662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56409319eb10 con 0x5640931883e0 2024-09-10T10:12:37.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.920+0000 7fdd23400640 1 -- 172.21.15.50:0/1929766662 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd300c0380 con 0x5640931883e0 2024-09-10T10:12:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.921+0000 7fdd23400640 1 -- 172.21.15.50:0/1929766662 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fdd300a6ce0 con 0x5640931883e0 2024-09-10T10:12:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.921+0000 7fdd47030740 10 client.25493 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.921+0000 7fdd47030740 10 client.25493 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:12:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.921+0000 7fdd47030740 20 client.25493 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.921+0000 7fdd47030740 1 --2- 172.21.15.50:0/1929766662 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564093220c00 0x564093223020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.921+0000 7fdd47030740 4 client.25493 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f981f249", "release": true, "await": true}] 2024-09-10T10:12:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.921+0000 7fdd47030740 1 -- 172.21.15.50:0/1929766662 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f981f249", "release": true, "await": true}) -- 0x5640930fbbc0 con 0x564093220c00 2024-09-10T10:12:37.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.921+0000 7fdd41200640 1 --2- 172.21.15.50:0/1929766662 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564093220c00 0x564093223020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:37.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.922+0000 7fdd41200640 1 --2- 172.21.15.50:0/1929766662 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564093220c00 0x564093223020 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=429b209b228808b9 server_cookie=2be7f7e064e638bb in_seq=0 out_seq=0 2024-09-10T10:12:37.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.922+0000 7fdd23400640 10 client.25493 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.924+0000 7fdd23400640 1 -- 172.21.15.50:0/1929766662 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5640930fbbc0 con 0x564093220c00 2024-09-10T10:12:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.924+0000 7fdd23400640 10 client.25493 handle_command_reply: tid=0 2024-09-10T10:12:37.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.924+0000 7fdd47030740 1 client.25493 shutdown 2024-09-10T10:12:37.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.924+0000 7fdd47030740 1 -- 172.21.15.50:0/1929766662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640931883e0 msgr2=0x564093191d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.924+0000 7fdd47030740 1 --2- 172.21.15.50:0/1929766662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640931883e0 0x564093191d60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdd30005c40 tx=0x7fdd300057b0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.925+0000 7fdd47030740 1 -- 172.21.15.50:0/1929766662 shutdown_connections 2024-09-10T10:12:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.925+0000 7fdd47030740 1 --2- 172.21.15.50:0/1929766662 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564093220c00 0x564093223020 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.925+0000 7fdd47030740 1 --2- 172.21.15.50:0/1929766662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5640931a4710 0x564093218f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.925+0000 7fdd23400640 0 client.25493 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.925+0000 7fdd47030740 1 --2- 172.21.15.50:0/1929766662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564093188d00 0x5640931922a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.925+0000 7fdd47030740 1 --2- 172.21.15.50:0/1929766662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640931883e0 0x564093191d60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.925+0000 7fdd47030740 1 -- 172.21.15.50:0/1929766662 >> 172.21.15.50:0/1929766662 conn(0x564093184ab0 msgr2=0x564093198db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:37.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.926+0000 7fdd47030740 1 -- 172.21.15.50:0/1929766662 shutdown_connections 2024-09-10T10:12:37.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.926+0000 7fdd47030740 1 -- 172.21.15.50:0/1929766662 wait complete. 2024-09-10T10:12:37.930 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:12:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 25, 2024-09-10T10:12:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24560, 2024-09-10T10:12:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 4, 2024-09-10T10:12:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-09-10T10:12:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "f981f249": { 2024-09-10T10:12:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 4, 2024-09-10T10:12:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-09-10T10:12:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:12:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-09-10T10:12:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:12:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:12:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-09-10T10:12:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 150.0, 2024-09-10T10:12:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-09-10T10:12:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-09-10T10:12:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-09-10T10:12:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:12:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-09-10T10:12:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:12:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:37.932 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:12:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.926+0000 7fdd47030740 20 client.25493 trim_cache size 0 max 16384 2024-09-10T10:12:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.929+0000 7fdd43000640 1 -- 172.21.15.50:0/1835250932 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdd240a2bb0 msgr2=0x7fdd240a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.929+0000 7fdd43000640 1 --2- 172.21.15.50:0/1835250932 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdd240a2bb0 0x7fdd240a5070 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x56409319ee80 tx=0x7fdd34004910 comp rx=0 tx=0).stop 2024-09-10T10:12:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.929+0000 7fdd43000640 1 -- 172.21.15.50:0/1835250932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd3c074510 msgr2=0x7fdd3c19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.929+0000 7fdd43000640 1 --2- 172.21.15.50:0/1835250932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd3c074510 0x7fdd3c19a4a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd30004770 tx=0x7fdd30003c10 comp rx=0 tx=0).stop 2024-09-10T10:12:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.929+0000 7fdd43000640 1 -- 172.21.15.50:0/1835250932 shutdown_connections 2024-09-10T10:12:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.929+0000 7fdd43000640 1 --2- 172.21.15.50:0/1835250932 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fdd240a2bb0 0x7fdd240a5070 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.929+0000 7fdd43000640 1 --2- 172.21.15.50:0/1835250932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdd3c10e280 0x7fdd3c19ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.929+0000 7fdd43000640 1 --2- 172.21.15.50:0/1835250932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd3c074e30 0x7fdd3c19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.929+0000 7fdd43000640 1 --2- 172.21.15.50:0/1835250932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdd3c074510 0x7fdd3c19a4a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:37.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.929+0000 7fdd43000640 1 -- 172.21.15.50:0/1835250932 >> 172.21.15.50:0/1835250932 conn(0x7fdd3c0fd740 msgr2=0x7fdd3c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:37.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.929+0000 7fdd43000640 1 -- 172.21.15.50:0/1835250932 shutdown_connections 2024-09-10T10:12:37.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:37.930+0000 7fdd43000640 1 -- 172.21.15.50:0/1835250932 wait complete. 2024-09-10T10:12:37.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:37 smithi050 ceph-mon[30354]: pgmap v434: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:12:38.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:37 smithi189 ceph-mon[34999]: pgmap v434: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:12:38.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:37 smithi084 ceph-mon[34812]: pgmap v434: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:12:38.942 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f981f249', total seconds elapsed: 34.7 2024-09-10T10:12:38.942 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-10T10:12:38.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:12:39.359 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:40.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.043+0000 7fb239800640 1 -- 172.21.15.50:0/2243366740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234074510 msgr2=0x7fb2340748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:40.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.043+0000 7fb239800640 1 --2- 172.21.15.50:0/2243366740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234074510 0x7fb2340748f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb224009860 tx=0x7fb22402a3d0 comp rx=0 tx=0).stop 2024-09-10T10:12:40.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.043+0000 7fb239800640 1 -- 172.21.15.50:0/2243366740 shutdown_connections 2024-09-10T10:12:40.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.043+0000 7fb239800640 1 --2- 172.21.15.50:0/2243366740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb23410e280 0x7fb234110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:40.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.043+0000 7fb239800640 1 --2- 172.21.15.50:0/2243366740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb234074e30 0x7fb23410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:40.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.043+0000 7fb239800640 1 --2- 172.21.15.50:0/2243366740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb234074510 0x7fb2340748f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:40.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.043+0000 7fb239800640 1 -- 172.21.15.50:0/2243366740 >> 172.21.15.50:0/2243366740 conn(0x7fb2340fd740 msgr2=0x7fb2340ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:40.046 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:39 smithi050 ceph-mon[30354]: pgmap v435: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:12:40.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.045+0000 7fb239800640 1 -- 172.21.15.50:0/2243366740 shutdown_connections 2024-09-10T10:12:40.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.045+0000 7fb239800640 1 -- 172.21.15.50:0/2243366740 wait complete. 2024-09-10T10:12:40.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.046+0000 7fb239800640 1 Processor -- start 2024-09-10T10:12:40.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.046+0000 7fb239800640 1 -- start start 2024-09-10T10:12:40.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.047+0000 7fb239800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234074510 0x7fb23419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:40.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.047+0000 7fb239800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb234074e30 0x7fb23419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:40.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.047+0000 7fb239800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb23410e280 0x7fb23419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:40.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.047+0000 7fb239800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb234114000 con 0x7fb234074510 2024-09-10T10:12:40.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.047+0000 7fb239800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb234113e80 con 0x7fb23410e280 2024-09-10T10:12:40.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.047+0000 7fb239800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb234114180 con 0x7fb234074e30 2024-09-10T10:12:40.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.047+0000 7fb233400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb234074e30 0x7fb23419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:40.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.047+0000 7fb238e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb23410e280 0x7fb23419ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:40.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.047+0000 7fb238e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb23410e280 0x7fb23419ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:39816/0 (socket says 172.21.15.50:39816) 2024-09-10T10:12:40.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.047+0000 7fb238e00640 1 -- 172.21.15.50:0/4011737163 learned_addr learned my addr 172.21.15.50:0/4011737163 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:40.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.048+0000 7fb233e00640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234074510 0x7fb23419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:40.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.048+0000 7fb238e00640 1 -- 172.21.15.50:0/4011737163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb234074e30 msgr2=0x7fb23419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:40.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.048+0000 7fb238e00640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb234074e30 0x7fb23419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:40.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.048+0000 7fb238e00640 1 -- 172.21.15.50:0/4011737163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234074510 msgr2=0x7fb23419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:40.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.048+0000 7fb238e00640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234074510 0x7fb23419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:40.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.048+0000 7fb238e00640 1 -- 172.21.15.50:0/4011737163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23419f510 con 0x7fb23410e280 2024-09-10T10:12:40.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.049+0000 7fb233e00640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234074510 0x7fb23419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:40.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.049+0000 7fb238e00640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb23410e280 0x7fb23419ee30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c3c0 tx=0x7fb22c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:40.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.049+0000 7fb230c00640 1 -- 172.21.15.50:0/4011737163 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c01b070 con 0x7fb23410e280 2024-09-10T10:12:40.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.049+0000 7fb233400640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb234074e30 0x7fb23419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:12:40.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.049+0000 7fb230c00640 1 -- 172.21.15.50:0/4011737163 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb22c00bb10 con 0x7fb23410e280 2024-09-10T10:12:40.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.049+0000 7fb230c00640 1 -- 172.21.15.50:0/4011737163 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c016d30 con 0x7fb23410e280 2024-09-10T10:12:40.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.049+0000 7fb239800640 1 -- 172.21.15.50:0/4011737163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23419f800 con 0x7fb23410e280 2024-09-10T10:12:40.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.049+0000 7fb239800640 1 -- 172.21.15.50:0/4011737163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2341a70e0 con 0x7fb23410e280 2024-09-10T10:12:40.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.051+0000 7fb239800640 1 -- 172.21.15.50:0/4011737163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb214005290 con 0x7fb23410e280 2024-09-10T10:12:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.053+0000 7fb230c00640 1 -- 172.21.15.50:0/4011737163 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb22c01e070 con 0x7fb23410e280 2024-09-10T10:12:40.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.054+0000 7fb230c00640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb2180a2c00 0x7fb2180a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.054+0000 7fb230c00640 1 -- 172.21.15.50:0/4011737163 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb22c0cf0f0 con 0x7fb23410e280 2024-09-10T10:12:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.054+0000 7fb233e00640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb2180a2c00 0x7fb2180a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:40.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.055+0000 7fb233e00640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb2180a2c00 0x7fb2180a50c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb2240095f0 tx=0x7fb224005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:40.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.058+0000 7fb230c00640 1 -- 172.21.15.50:0/4011737163 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb22c09b610 con 0x7fb23410e280 2024-09-10T10:12:40.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.280+0000 7fb239800640 1 -- 172.21.15.50:0/4011737163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb214005580 con 0x7fb23410e280 2024-09-10T10:12:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.281+0000 7fb230c00640 1 -- 172.21.15.50:0/4011737163 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7fb22c09f910 con 0x7fb23410e280 2024-09-10T10:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:12:40.283 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:12:40.283 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:12:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.284+0000 7fb239800640 1 -- 172.21.15.50:0/4011737163 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb2180a2c00 msgr2=0x7fb2180a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.284+0000 7fb239800640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb2180a2c00 0x7fb2180a50c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb2240095f0 tx=0x7fb224005c90 comp rx=0 tx=0).stop 2024-09-10T10:12:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.284+0000 7fb239800640 1 -- 172.21.15.50:0/4011737163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb23410e280 msgr2=0x7fb23419ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:40.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.284+0000 7fb239800640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb23410e280 0x7fb23419ee30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c3c0 tx=0x7fb22c00c880 comp rx=0 tx=0).stop 2024-09-10T10:12:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.284+0000 7fb239800640 1 -- 172.21.15.50:0/4011737163 shutdown_connections 2024-09-10T10:12:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.284+0000 7fb239800640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb2180a2c00 0x7fb2180a50c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.284+0000 7fb239800640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb23410e280 0x7fb23419ee30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.284+0000 7fb239800640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb234074e30 0x7fb23419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.284+0000 7fb239800640 1 --2- 172.21.15.50:0/4011737163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb234074510 0x7fb23419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.284+0000 7fb239800640 1 -- 172.21.15.50:0/4011737163 >> 172.21.15.50:0/4011737163 conn(0x7fb2340fd740 msgr2=0x7fb2340fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.284+0000 7fb239800640 1 -- 172.21.15.50:0/4011737163 shutdown_connections 2024-09-10T10:12:40.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:40.284+0000 7fb239800640 1 -- 172.21.15.50:0/4011737163 wait complete. 2024-09-10T10:12:40.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:39 smithi189 ceph-mon[34999]: pgmap v435: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:12:40.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:39 smithi084 ceph-mon[34812]: pgmap v435: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:12:40.919 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:40 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4011737163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:41.149 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-10T10:12:41.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-10T10:12:41.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:40 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4011737163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:41.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:40 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4011737163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:41.643 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:42.135 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:41 smithi050 ceph-mon[30354]: pgmap v436: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:12:42.135 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:41 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:42.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.282+0000 7feade000640 1 -- 172.21.15.50:0/539333423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead81079c0 msgr2=0x7fead8107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:42.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.282+0000 7feade000640 1 --2- 172.21.15.50:0/539333423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead81079c0 0x7fead8107da0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feacc009900 tx=0x7feacc02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.283+0000 7feade000640 1 -- 172.21.15.50:0/539333423 shutdown_connections 2024-09-10T10:12:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.283+0000 7feade000640 1 --2- 172.21.15.50:0/539333423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead8102360 0x7fead810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.283+0000 7feade000640 1 --2- 172.21.15.50:0/539333423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fead81019c0 0x7fead8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.283+0000 7feade000640 1 --2- 172.21.15.50:0/539333423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead81079c0 0x7fead8107da0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.283+0000 7feade000640 1 -- 172.21.15.50:0/539333423 >> 172.21.15.50:0/539333423 conn(0x7fead80fd740 msgr2=0x7fead80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.283+0000 7feade000640 1 -- 172.21.15.50:0/539333423 shutdown_connections 2024-09-10T10:12:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.283+0000 7feade000640 1 -- 172.21.15.50:0/539333423 wait complete. 2024-09-10T10:12:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.284+0000 7feade000640 1 Processor -- start 2024-09-10T10:12:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.285+0000 7feade000640 1 -- start start 2024-09-10T10:12:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.286+0000 7feade000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead81019c0 0x7fead81a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.286+0000 7feade000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead8102360 0x7fead81a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.286+0000 7feade000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fead81079c0 0x7fead810da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.286+0000 7feade000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fead8111e10 con 0x7fead81019c0 2024-09-10T10:12:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.286+0000 7feade000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fead8111c90 con 0x7fead8102360 2024-09-10T10:12:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.286+0000 7feade000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fead8111f90 con 0x7fead81079c0 2024-09-10T10:12:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.286+0000 7feadd600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fead81079c0 0x7fead810da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.286+0000 7feadd600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fead81079c0 0x7fead810da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:54834/0 (socket says 172.21.15.50:54834) 2024-09-10T10:12:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.286+0000 7feadd600640 1 -- 172.21.15.50:0/1266261977 learned_addr learned my addr 172.21.15.50:0/1266261977 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.287+0000 7feadd600640 1 -- 172.21.15.50:0/1266261977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead8102360 msgr2=0x7fead81a4b30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T10:12:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.287+0000 7feadd600640 1 --2- 172.21.15.50:0/1266261977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead8102360 0x7fead81a4b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.287+0000 7feadd600640 1 -- 172.21.15.50:0/1266261977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead81019c0 msgr2=0x7fead81a45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.287+0000 7feadd600640 1 --2- 172.21.15.50:0/1266261977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead81019c0 0x7fead81a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.287+0000 7feadd600640 1 -- 172.21.15.50:0/1266261977 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead810e270 con 0x7fead81079c0 2024-09-10T10:12:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.287+0000 7feadd600640 1 --2- 172.21.15.50:0/1266261977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fead81079c0 0x7fead810da00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fead000efd0 tx=0x7fead000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.288+0000 7fead5600640 1 -- 172.21.15.50:0/1266261977 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead0003b70 con 0x7fead81079c0 2024-09-10T10:12:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.288+0000 7feade000640 1 -- 172.21.15.50:0/1266261977 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead810e560 con 0x7fead81079c0 2024-09-10T10:12:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.288+0000 7feade000640 1 -- 172.21.15.50:0/1266261977 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead81ab570 con 0x7fead81079c0 2024-09-10T10:12:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.288+0000 7fead5600640 1 -- 172.21.15.50:0/1266261977 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fead0009820 con 0x7fead81079c0 2024-09-10T10:12:42.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.289+0000 7fead5600640 1 -- 172.21.15.50:0/1266261977 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead0004220 con 0x7fead81079c0 2024-09-10T10:12:42.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.293+0000 7feae222f740 1 Processor -- start 2024-09-10T10:12:42.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.294+0000 7fead5600640 1 -- 172.21.15.50:0/1266261977 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fead00043c0 con 0x7fead81079c0 2024-09-10T10:12:42.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.296+0000 7feae222f740 1 -- start start 2024-09-10T10:12:42.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.296+0000 7feae222f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7560 0x5609634f7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.296+0000 7fead5600640 1 --2- 172.21.15.50:0/1266261977 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7feac00a2d80 0x7feac00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.297+0000 7feae222f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7e80 0x560963502200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.297+0000 7feae222f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 0x560963504b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.297+0000 7feae222f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56096345d530 con 0x5609634f7e80 2024-09-10T10:12:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.297+0000 7feae222f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560963404860 con 0x5609634f7560 2024-09-10T10:12:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.297+0000 7feae222f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5609634594f0 con 0x560963502740 2024-09-10T10:12:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.297+0000 7fead5600640 1 -- 172.21.15.50:0/1266261977 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fead0004020 con 0x7fead81079c0 2024-09-10T10:12:42.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.298+0000 7fead7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7560 0x5609634f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.298+0000 7feadcc00640 1 --2- 172.21.15.50:0/1266261977 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7feac00a2d80 0x7feac00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.298+0000 7feadd600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 0x560963504b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.298+0000 7fead7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7560 0x5609634f7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:39836/0 (socket says 172.21.15.50:39836) 2024-09-10T10:12:42.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.298+0000 7fead7e00640 1 -- 172.21.15.50:0/842365751 learned_addr learned my addr 172.21.15.50:0/842365751 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:42.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.299+0000 7feadd600640 1 -- 172.21.15.50:0/842365751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7560 msgr2=0x5609634f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:42.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.299+0000 7feadd600640 1 --2- 172.21.15.50:0/842365751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7560 0x5609634f7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.299+0000 7feadd600640 1 -- 172.21.15.50:0/842365751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7e80 msgr2=0x560963502200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:42.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.299+0000 7feadd600640 1 --2- 172.21.15.50:0/842365751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7e80 0x560963502200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.299+0000 7feadd600640 1 -- 172.21.15.50:0/842365751 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609631ceb90 con 0x560963502740 2024-09-10T10:12:42.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.299+0000 7feadcc00640 1 --2- 172.21.15.50:0/1266261977 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7feac00a2d80 0x7feac00a5240 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feacc0096c0 tx=0x7feacc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:42.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.299+0000 7feadd600640 1 --2- 172.21.15.50:0/842365751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 0x560963504b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fead00cce20 tx=0x7fead009b590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e990bb7293eb7c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:42.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.300+0000 7feac9c00640 1 -- 172.21.15.50:0/842365751 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead009ce60 con 0x560963502740 2024-09-10T10:12:42.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.300+0000 7feac9c00640 1 -- 172.21.15.50:0/842365751 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fead009bb30 con 0x560963502740 2024-09-10T10:12:42.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.300+0000 7feac9c00640 1 -- 172.21.15.50:0/842365751 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead00981a0 con 0x560963502740 2024-09-10T10:12:42.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.301+0000 7feae222f740 1 -- 172.21.15.50:0/842365751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 msgr2=0x560963504b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:42.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.301+0000 7feae222f740 1 --2- 172.21.15.50:0/842365751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 0x560963504b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fead00cce20 tx=0x7fead009b590 comp rx=0 tx=0).stop 2024-09-10T10:12:42.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.301+0000 7feae222f740 1 -- 172.21.15.50:0/842365751 shutdown_connections 2024-09-10T10:12:42.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.301+0000 7feae222f740 1 --2- 172.21.15.50:0/842365751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 0x560963504b30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.301+0000 7feae222f740 1 --2- 172.21.15.50:0/842365751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7e80 0x560963502200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.301+0000 7feae222f740 1 --2- 172.21.15.50:0/842365751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7560 0x5609634f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.301+0000 7feae222f740 1 -- 172.21.15.50:0/842365751 >> 172.21.15.50:0/842365751 conn(0x5609634f3af0 msgr2=0x5609634f3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:42.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.302+0000 7feae222f740 1 -- 172.21.15.50:0/842365751 shutdown_connections 2024-09-10T10:12:42.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.302+0000 7feae222f740 1 -- 172.21.15.50:0/842365751 wait complete. 2024-09-10T10:12:42.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.302+0000 7feae222f740 1 -- start start 2024-09-10T10:12:42.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.303+0000 7feae222f740 1 Processor -- start 2024-09-10T10:12:42.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.304+0000 7feae222f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7560 0x5609634ff610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.304+0000 7feae222f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x5609634ffb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.304+0000 7feae222f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 0x560963500090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.304+0000 7feae222f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560963505360 con 0x5609634f7560 2024-09-10T10:12:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.304+0000 7feae222f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560963417e60 con 0x5609634f7e80 2024-09-10T10:12:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.304+0000 7feae222f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5609635054e0 con 0x560963502740 2024-09-10T10:12:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.304+0000 7feae222f740 10 client.0 _ll_register_callbacks cb 0x56096341ccc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:42.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.304+0000 7feadcc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7560 0x5609634ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.305+0000 7feadcc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7560 0x5609634ff610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60874/0 (socket says 172.21.15.50:60874) 2024-09-10T10:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.305+0000 7feadcc00640 1 -- 172.21.15.50:0/549738818 learned_addr learned my addr 172.21.15.50:0/549738818 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.305+0000 7fead7e00640 1 --2- 172.21.15.50:0/549738818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x5609634ffb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.305+0000 7feadd600640 1 --2- 172.21.15.50:0/549738818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 0x560963500090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.305+0000 7fead7e00640 1 -- 172.21.15.50:0/549738818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 msgr2=0x560963500090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.305+0000 7fead7e00640 1 --2- 172.21.15.50:0/549738818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 0x560963500090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.305+0000 7fead7e00640 1 -- 172.21.15.50:0/549738818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7560 msgr2=0x5609634ff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.305+0000 7fead7e00640 1 --2- 172.21.15.50:0/549738818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7560 0x5609634ff610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.305+0000 7fead7e00640 1 -- 172.21.15.50:0/549738818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560963423990 con 0x5609634f7e80 2024-09-10T10:12:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.305+0000 7fead7e00640 1 --2- 172.21.15.50:0/549738818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x5609634ffb50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feac4005fd0 tx=0x7feac4011af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1660aaa7ef81e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:42.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.305+0000 7feabe000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:12:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.306+0000 7feabe000640 1 -- 172.21.15.50:0/549738818 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4012920 con 0x5609634f7e80 2024-09-10T10:12:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.306+0000 7feabe000640 1 -- 172.21.15.50:0/549738818 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7feac4012ac0 con 0x5609634f7e80 2024-09-10T10:12:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.306+0000 7feae222f740 1 -- 172.21.15.50:0/549738818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fead009bb30 con 0x5609634f7e80 2024-09-10T10:12:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.306+0000 7feabe000640 1 -- 172.21.15.50:0/549738818 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feac4012cc0 con 0x5609634f7e80 2024-09-10T10:12:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.306+0000 7feae222f740 10 client.25508 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.306+0000 7feae222f740 1 -- 172.21.15.50:0/549738818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560963511050 con 0x5609634f7e80 2024-09-10T10:12:42.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.307+0000 7feabe000640 1 -- 172.21.15.50:0/549738818 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fead009bb30 con 0x5609634f7e80 2024-09-10T10:12:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.307+0000 7feabe000640 1 -- 172.21.15.50:0/549738818 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7feac400f040 con 0x5609634f7e80 2024-09-10T10:12:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.307+0000 7feae222f740 10 client.25508 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.307+0000 7feae222f740 10 client.25508 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:12:42.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.307+0000 7feae222f740 20 client.25508 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.307+0000 7feae222f740 1 --2- 172.21.15.50:0/549738818 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x560963512560 0x560963514990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.307+0000 7feae222f740 4 client.25508 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:12:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.307+0000 7feae222f740 1 -- 172.21.15.50:0/549738818 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560963400310 con 0x560963512560 2024-09-10T10:12:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.308+0000 7feadcc00640 1 --2- 172.21.15.50:0/549738818 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x560963512560 0x560963514990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.308+0000 7feadcc00640 1 --2- 172.21.15.50:0/549738818 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x560963512560 0x560963514990 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d2222cbe3add919 server_cookie=d8bdc717c3c1cdb in_seq=0 out_seq=0 2024-09-10T10:12:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.308+0000 7feabe000640 10 client.25508 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:42.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.309+0000 7feabe000640 1 -- 172.21.15.50:0/549738818 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560963400310 con 0x560963512560 2024-09-10T10:12:42.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.309+0000 7feabe000640 10 client.25508 handle_command_reply: tid=0 2024-09-10T10:12:42.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.309+0000 7feae222f740 1 client.25508 shutdown 2024-09-10T10:12:42.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.310+0000 7feae222f740 1 -- 172.21.15.50:0/549738818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 msgr2=0x5609634ffb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:42.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.310+0000 7feae222f740 1 --2- 172.21.15.50:0/549738818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x5609634ffb50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feac4005fd0 tx=0x7feac4011af0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.310+0000 7feae222f740 1 -- 172.21.15.50:0/549738818 shutdown_connections 2024-09-10T10:12:42.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.310+0000 7feae222f740 1 --2- 172.21.15.50:0/549738818 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x560963512560 0x560963514990 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.310+0000 7feae222f740 1 --2- 172.21.15.50:0/549738818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 0x560963500090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.310+0000 7feae222f740 1 --2- 172.21.15.50:0/549738818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x5609634ffb50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.310+0000 7feae222f740 1 --2- 172.21.15.50:0/549738818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7560 0x5609634ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.310+0000 7feae222f740 1 -- 172.21.15.50:0/549738818 >> 172.21.15.50:0/549738818 conn(0x5609634f3af0 msgr2=0x5609634f9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:42.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.310+0000 7feabe000640 0 client.25508 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:42.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.311+0000 7feae222f740 1 -- 172.21.15.50:0/549738818 shutdown_connections 2024-09-10T10:12:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.311+0000 7feae222f740 1 -- 172.21.15.50:0/549738818 wait complete. 2024-09-10T10:12:42.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.311+0000 7feae222f740 20 client.25508 trim_cache size 0 max 16384 2024-09-10T10:12:42.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:41 smithi189 ceph-mon[34999]: pgmap v436: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:12:42.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:41 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:42.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:41 smithi084 ceph-mon[34812]: pgmap v436: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:12:42.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:41 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:12:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.347+0000 7feae222f740 1 Processor -- start 2024-09-10T10:12:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.348+0000 7feae222f740 1 -- start start 2024-09-10T10:12:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.348+0000 7feae222f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7560 0x5609634fef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.348+0000 7feae222f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x56096351a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.348+0000 7feae222f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 0x56096351a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.348+0000 7feae222f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feab8012570 con 0x5609634f7560 2024-09-10T10:12:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.348+0000 7feae222f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feab800fe40 con 0x5609634f7e80 2024-09-10T10:12:42.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.348+0000 7feae222f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feab800dc50 con 0x560963502740 2024-09-10T10:12:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.349+0000 7fead7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x56096351a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.349+0000 7fead7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x56096351a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:39858/0 (socket says 172.21.15.50:39858) 2024-09-10T10:12:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.349+0000 7fead7e00640 1 -- 172.21.15.50:0/2023791623 learned_addr learned my addr 172.21.15.50:0/2023791623 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.349+0000 7feadcc00640 1 --2- 172.21.15.50:0/2023791623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7560 0x5609634fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.349+0000 7feadd600640 1 --2- 172.21.15.50:0/2023791623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 0x56096351a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.350+0000 7fead7e00640 1 -- 172.21.15.50:0/2023791623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 msgr2=0x56096351a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:42.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.350+0000 7fead7e00640 1 --2- 172.21.15.50:0/2023791623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 0x56096351a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.350+0000 7fead7e00640 1 -- 172.21.15.50:0/2023791623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7560 msgr2=0x5609634fef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.350+0000 7fead7e00640 1 --2- 172.21.15.50:0/2023791623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7560 0x5609634fef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.350+0000 7fead7e00640 1 -- 172.21.15.50:0/2023791623 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609634f7cb0 con 0x5609634f7e80 2024-09-10T10:12:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.350+0000 7feadcc00640 1 --2- 172.21.15.50:0/2023791623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7560 0x5609634fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:42.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.351+0000 7fead7e00640 1 --2- 172.21.15.50:0/2023791623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x56096351a260 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feac4001eb0 tx=0x7feac400d3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71cd79370a6debe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:42.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.351+0000 7feac9200640 1 -- 172.21.15.50:0/2023791623 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4028040 con 0x5609634f7e80 2024-09-10T10:12:42.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.351+0000 7feac9200640 1 -- 172.21.15.50:0/2023791623 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feac4005850 con 0x5609634f7e80 2024-09-10T10:12:42.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.351+0000 7feac9200640 1 -- 172.21.15.50:0/2023791623 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4012cc0 con 0x5609634f7e80 2024-09-10T10:12:42.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.352+0000 7feae222f740 1 -- 172.21.15.50:0/2023791623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 msgr2=0x56096351a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:42.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.352+0000 7feae222f740 1 --2- 172.21.15.50:0/2023791623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x56096351a260 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feac4001eb0 tx=0x7feac400d3f0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.352+0000 7feae222f740 1 -- 172.21.15.50:0/2023791623 shutdown_connections 2024-09-10T10:12:42.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.353+0000 7feae222f740 1 --2- 172.21.15.50:0/2023791623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560963502740 0x56096351a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.353+0000 7feae222f740 1 --2- 172.21.15.50:0/2023791623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x56096351a260 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.353+0000 7feae222f740 1 --2- 172.21.15.50:0/2023791623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5609634f7560 0x5609634fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.353+0000 7feae222f740 1 -- 172.21.15.50:0/2023791623 >> 172.21.15.50:0/2023791623 conn(0x5609634f3af0 msgr2=0x5609634f9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:42.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.353+0000 7feae222f740 1 -- 172.21.15.50:0/2023791623 shutdown_connections 2024-09-10T10:12:42.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.353+0000 7feae222f740 1 -- 172.21.15.50:0/2023791623 wait complete. 2024-09-10T10:12:42.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.353+0000 7feae222f740 1 -- start start 2024-09-10T10:12:42.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.354+0000 7feae222f740 1 Processor -- start 2024-09-10T10:12:42.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.354+0000 7feae222f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609634f7560 0x56096350a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.354+0000 7feae222f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x56096350acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.354+0000 7feae222f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560963502740 0x560963507760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.354+0000 7feae222f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feab800e300 con 0x560963502740 2024-09-10T10:12:42.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.354+0000 7feae222f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feab800f770 con 0x5609634f7e80 2024-09-10T10:12:42.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.354+0000 7feae222f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feab800e9d0 con 0x5609634f7560 2024-09-10T10:12:42.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.354+0000 7feae222f740 10 client.0 _ll_register_callbacks cb 0x7feac4009630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:42.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.355+0000 7feadcc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609634f7560 0x56096350a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.355+0000 7fead7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x56096350acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.355+0000 7feadd600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560963502740 0x560963507760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.355+0000 7fead7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x56096350acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:39864/0 (socket says 172.21.15.50:39864) 2024-09-10T10:12:42.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.355+0000 7fead7e00640 1 -- 172.21.15.50:0/2283391374 learned_addr learned my addr 172.21.15.50:0/2283391374 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:42.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.356+0000 7fead7e00640 1 -- 172.21.15.50:0/2283391374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609634f7560 msgr2=0x56096350a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:42.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.356+0000 7fead7e00640 1 --2- 172.21.15.50:0/2283391374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609634f7560 0x56096350a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.356+0000 7fead7e00640 1 -- 172.21.15.50:0/2283391374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560963502740 msgr2=0x560963507760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:42.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.356+0000 7fead7e00640 1 --2- 172.21.15.50:0/2283391374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560963502740 0x560963507760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.356+0000 7fead7e00640 1 -- 172.21.15.50:0/2283391374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560963507ca0 con 0x5609634f7e80 2024-09-10T10:12:42.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.356+0000 7fead7e00640 1 --2- 172.21.15.50:0/2283391374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x56096350acd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feac400cb60 tx=0x7feac4009d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c05b6918615a624 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:42.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.356+0000 7feabe000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:12:42.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.357+0000 7feabe000640 1 -- 172.21.15.50:0/2283391374 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac403a060 con 0x5609634f7e80 2024-09-10T10:12:42.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.357+0000 7feae222f740 1 -- 172.21.15.50:0/2283391374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feac4005850 con 0x5609634f7e80 2024-09-10T10:12:42.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.357+0000 7feabe000640 1 -- 172.21.15.50:0/2283391374 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7feac400d800 con 0x5609634f7e80 2024-09-10T10:12:42.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.357+0000 7feabe000640 1 -- 172.21.15.50:0/2283391374 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feac4041050 con 0x5609634f7e80 2024-09-10T10:12:42.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.357+0000 7feae222f740 10 client.25514 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:42.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.357+0000 7feae222f740 1 -- 172.21.15.50:0/2283391374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56096357d900 con 0x5609634f7e80 2024-09-10T10:12:42.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.358+0000 7feabe000640 1 -- 172.21.15.50:0/2283391374 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feac4005850 con 0x5609634f7e80 2024-09-10T10:12:42.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.358+0000 7feabe000640 1 -- 172.21.15.50:0/2283391374 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7feac400f040 con 0x5609634f7e80 2024-09-10T10:12:42.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.358+0000 7feae222f740 10 client.25514 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:42.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.358+0000 7feae222f740 10 client.25514 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:12:42.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.358+0000 7feae222f740 20 client.25514 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:42.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.358+0000 7feae222f740 1 --2- 172.21.15.50:0/2283391374 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56096357dfa0 0x5609635803c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.359+0000 7feae222f740 4 client.25514 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-10T10:12:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.359+0000 7feae222f740 1 -- 172.21.15.50:0/2283391374 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x56096346ac60 con 0x56096357dfa0 2024-09-10T10:12:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.359+0000 7feadcc00640 1 --2- 172.21.15.50:0/2283391374 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56096357dfa0 0x5609635803c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.360+0000 7feadcc00640 1 --2- 172.21.15.50:0/2283391374 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56096357dfa0 0x5609635803c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e120ce775d264c75 server_cookie=9364ca332e9cee79 in_seq=0 out_seq=0 2024-09-10T10:12:42.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.360+0000 7feabe000640 10 client.25514 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:42.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.365+0000 7feabe000640 1 -- 172.21.15.50:0/2283391374 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56096346ac60 con 0x56096357dfa0 2024-09-10T10:12:42.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.365+0000 7feabe000640 10 client.25514 handle_command_reply: tid=0 2024-09-10T10:12:42.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.365+0000 7feae222f740 1 client.25514 shutdown 2024-09-10T10:12:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.366+0000 7feae222f740 1 -- 172.21.15.50:0/2283391374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 msgr2=0x56096350acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.366+0000 7feae222f740 1 --2- 172.21.15.50:0/2283391374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x56096350acd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feac400cb60 tx=0x7feac4009d70 comp rx=0 tx=0).stop 2024-09-10T10:12:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.366+0000 7feae222f740 1 -- 172.21.15.50:0/2283391374 shutdown_connections 2024-09-10T10:12:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.366+0000 7feae222f740 1 --2- 172.21.15.50:0/2283391374 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56096357dfa0 0x5609635803c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.366+0000 7feae222f740 1 --2- 172.21.15.50:0/2283391374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560963502740 0x560963507760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.366+0000 7feae222f740 1 --2- 172.21.15.50:0/2283391374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609634f7e80 0x56096350acd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.366+0000 7feae222f740 1 --2- 172.21.15.50:0/2283391374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609634f7560 0x56096350a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.366+0000 7feae222f740 1 -- 172.21.15.50:0/2283391374 >> 172.21.15.50:0/2283391374 conn(0x5609634f3af0 msgr2=0x5609634f2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:42.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.366+0000 7feabe000640 0 client.25514 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:42.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.366+0000 7feae222f740 1 -- 172.21.15.50:0/2283391374 shutdown_connections 2024-09-10T10:12:42.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.366+0000 7feae222f740 1 -- 172.21.15.50:0/2283391374 wait complete. 2024-09-10T10:12:42.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.366+0000 7feae222f740 20 client.25514 trim_cache size 0 max 16384 2024-09-10T10:12:42.369 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:12:42.369 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 25, 2024-09-10T10:12:42.369 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24560, 2024-09-10T10:12:42.369 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 6, 2024-09-10T10:12:42.369 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-09-10T10:12:42.369 INFO:teuthology.orchestra.run.smithi050.stdout: "3432dd54": { 2024-09-10T10:12:42.369 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 6, 2024-09-10T10:12:42.369 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-09-10T10:12:42.369 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:12:42.369 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-09-10T10:12:42.369 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:12:42.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:12:42.370 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-09-10T10:12:42.370 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 150.0, 2024-09-10T10:12:42.370 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-09-10T10:12:42.370 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-09-10T10:12:42.370 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-09-10T10:12:42.370 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:12:42.370 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-09-10T10:12:42.370 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:12:42.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:42.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:42.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:42.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:42.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:12:42.371 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:12:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.367+0000 7feade000640 1 -- 172.21.15.50:0/1266261977 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7feac00a2d80 msgr2=0x7feac00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.367+0000 7feade000640 1 --2- 172.21.15.50:0/1266261977 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7feac00a2d80 0x7feac00a5240 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feacc0096c0 tx=0x7feacc000bc0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.367+0000 7feade000640 1 -- 172.21.15.50:0/1266261977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fead81079c0 msgr2=0x7fead810da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.367+0000 7feade000640 1 --2- 172.21.15.50:0/1266261977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fead81079c0 0x7fead810da00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fead000efd0 tx=0x7fead000c6a0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.368+0000 7feade000640 1 -- 172.21.15.50:0/1266261977 shutdown_connections 2024-09-10T10:12:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.368+0000 7feade000640 1 --2- 172.21.15.50:0/1266261977 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7feac00a2d80 0x7feac00a5240 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.368+0000 7feade000640 1 --2- 172.21.15.50:0/1266261977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fead81079c0 0x7fead810da00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.368+0000 7feade000640 1 --2- 172.21.15.50:0/1266261977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead8102360 0x7fead81a4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.368+0000 7feade000640 1 --2- 172.21.15.50:0/1266261977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fead81019c0 0x7fead81a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.368+0000 7feade000640 1 -- 172.21.15.50:0/1266261977 >> 172.21.15.50:0/1266261977 conn(0x7fead80fd740 msgr2=0x7fead80fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.369+0000 7feade000640 1 -- 172.21.15.50:0/1266261977 shutdown_connections 2024-09-10T10:12:42.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:42.369+0000 7feade000640 1 -- 172.21.15.50:0/1266261977 wait complete. 2024-09-10T10:12:43.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:42 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:12:43.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:42 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:12:43.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:42 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:12:43.306 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3432dd54', quiesce took 4.4 seconds. Will release after: 25.6 2024-09-10T10:12:43.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:42 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:12:43.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:42 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:12:43.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:42 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:12:43.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:42 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:12:43.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:42 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:12:43.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:42 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:12:44.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:44 smithi050 ceph-mon[30354]: pgmap v437: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:12:45.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:44 smithi189 ceph-mon[34999]: pgmap v437: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:12:45.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:44 smithi084 ceph-mon[34812]: pgmap v437: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:12:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:46 smithi050 ceph-mon[30354]: pgmap v438: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:12:47.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:46 smithi189 ceph-mon[34999]: pgmap v438: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:12:47.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:46 smithi084 ceph-mon[34812]: pgmap v438: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:12:47.431 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:12:47.819 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:48.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:48 smithi050 ceph-mon[30354]: pgmap v439: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T10:12:49.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:48 smithi189 ceph-mon[34999]: pgmap v439: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T10:12:49.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:48 smithi084 ceph-mon[34812]: pgmap v439: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T10:12:50.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:50 smithi050 ceph-mon[30354]: pgmap v440: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:12:51.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:50 smithi189 ceph-mon[34999]: pgmap v440: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:12:51.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:50 smithi084 ceph-mon[34812]: pgmap v440: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:12:51.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.402+0000 7f7a54a00640 1 -- 172.21.15.50:0/2727104899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5010e210 msgr2=0x7f7a50110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.402+0000 7f7a54a00640 1 --2- 172.21.15.50:0/2727104899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5010e210 0x7f7a50110660 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009ca0 tx=0x7f7a4802a950 comp rx=0 tx=0).stop 2024-09-10T10:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.402+0000 7f7a54a00640 1 -- 172.21.15.50:0/2727104899 shutdown_connections 2024-09-10T10:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.402+0000 7f7a54a00640 1 --2- 172.21.15.50:0/2727104899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a5010e210 0x7f7a50110660 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.402+0000 7f7a54a00640 1 --2- 172.21.15.50:0/2727104899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a50074f40 0x7f7a5010dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.402+0000 7f7a54a00640 1 --2- 172.21.15.50:0/2727104899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a50074620 0x7f7a50074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.402+0000 7f7a54a00640 1 -- 172.21.15.50:0/2727104899 >> 172.21.15.50:0/2727104899 conn(0x7f7a500fd710 msgr2=0x7f7a500ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.402+0000 7f7a54a00640 1 -- 172.21.15.50:0/2727104899 shutdown_connections 2024-09-10T10:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.402+0000 7f7a54a00640 1 -- 172.21.15.50:0/2727104899 wait complete. 2024-09-10T10:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.403+0000 7f7a54a00640 1 Processor -- start 2024-09-10T10:12:51.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.403+0000 7f7a54a00640 1 -- start start 2024-09-10T10:12:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.404+0000 7f7a54a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a50074620 0x7f7a5019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.404+0000 7f7a54a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a50074f40 0x7f7a5019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.404+0000 7f7a54a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a5010e210 0x7f7a5019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.404+0000 7f7a54a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50113fd0 con 0x7f7a50074620 2024-09-10T10:12:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.404+0000 7f7a54a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50113e50 con 0x7f7a50074f40 2024-09-10T10:12:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.404+0000 7f7a54a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50114150 con 0x7f7a5010e210 2024-09-10T10:12:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.404+0000 7f7a4f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a50074620 0x7f7a5019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.404+0000 7f7a47e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a50074f40 0x7f7a5019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.404+0000 7f7a4f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a50074620 0x7f7a5019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57212/0 (socket says 172.21.15.50:57212) 2024-09-10T10:12:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.404+0000 7f7a4fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a5010e210 0x7f7a5019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.404+0000 7f7a4f400640 1 -- 172.21.15.50:0/767377317 learned_addr learned my addr 172.21.15.50:0/767377317 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.405+0000 7f7a4fe00640 1 -- 172.21.15.50:0/767377317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a50074f40 msgr2=0x7f7a5019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.405+0000 7f7a4fe00640 1 --2- 172.21.15.50:0/767377317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a50074f40 0x7f7a5019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.405+0000 7f7a4fe00640 1 -- 172.21.15.50:0/767377317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a50074620 msgr2=0x7f7a5019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.405+0000 7f7a4fe00640 1 --2- 172.21.15.50:0/767377317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a50074620 0x7f7a5019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.405+0000 7f7a4fe00640 1 -- 172.21.15.50:0/767377317 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5019f400 con 0x7f7a5010e210 2024-09-10T10:12:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.405+0000 7f7a4f400640 1 --2- 172.21.15.50:0/767377317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a50074620 0x7f7a5019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.405+0000 7f7a4fe00640 1 --2- 172.21.15.50:0/767377317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a5010e210 0x7f7a5019ed20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a48005e30 tx=0x7f7a48003b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.405+0000 7f7a4cc00640 1 -- 172.21.15.50:0/767377317 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48034040 con 0x7f7a5010e210 2024-09-10T10:12:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.406+0000 7f7a54a00640 1 -- 172.21.15.50:0/767377317 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a5019f690 con 0x7f7a5010e210 2024-09-10T10:12:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.406+0000 7f7a54a00640 1 -- 172.21.15.50:0/767377317 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a501a6fd0 con 0x7f7a5010e210 2024-09-10T10:12:51.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.406+0000 7f7a4cc00640 1 -- 172.21.15.50:0/767377317 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a4802f940 con 0x7f7a5010e210 2024-09-10T10:12:51.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.406+0000 7f7a4cc00640 1 -- 172.21.15.50:0/767377317 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48004600 con 0x7f7a5010e210 2024-09-10T10:12:51.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.409+0000 7f7a58a3c740 1 Processor -- start 2024-09-10T10:12:51.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.410+0000 7f7a4cc00640 1 -- 172.21.15.50:0/767377317 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7a48037020 con 0x7f7a5010e210 2024-09-10T10:12:51.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.411+0000 7f7a58a3c740 1 -- start start 2024-09-10T10:12:51.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.411+0000 7f7a58a3c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562504402d50 0x562504403130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.411+0000 7f7a58a3c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 0x56250440d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.411+0000 7f7a58a3c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56250440df30 0x562504410320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.411+0000 7f7a58a3c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5625043693e0 con 0x562504402d50 2024-09-10T10:12:51.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.411+0000 7f7a58a3c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562504310d80 con 0x56250440df30 2024-09-10T10:12:51.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.411+0000 7f7a58a3c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5625043653a0 con 0x562504403670 2024-09-10T10:12:51.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.411+0000 7f7a47e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562504402d50 0x562504403130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.411+0000 7f7a47e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562504402d50 0x562504403130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57216/0 (socket says 172.21.15.50:57216) 2024-09-10T10:12:51.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.411+0000 7f7a47e00640 1 -- 172.21.15.50:0/4054212505 learned_addr learned my addr 172.21.15.50:0/4054212505 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:51.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.411+0000 7f7a4f400640 1 --2- 172.21.15.50:0/4054212505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 0x56250440d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.412+0000 7f7a47e00640 1 --2- 172.21.15.50:0/4054212505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56250440df30 0x562504410320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.412+0000 7f7a4f400640 1 -- 172.21.15.50:0/4054212505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56250440df30 msgr2=0x562504410320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:51.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.412+0000 7f7a4f400640 1 --2- 172.21.15.50:0/4054212505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56250440df30 0x562504410320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.412+0000 7f7a4f400640 1 -- 172.21.15.50:0/4054212505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562504402d50 msgr2=0x562504403130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:51.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.412+0000 7f7a4f400640 1 --2- 172.21.15.50:0/4054212505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562504402d50 0x562504403130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.412+0000 7f7a4f400640 1 -- 172.21.15.50:0/4054212505 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56250432fae0 con 0x562504403670 2024-09-10T10:12:51.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.412+0000 7f7a4f400640 1 --2- 172.21.15.50:0/4054212505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 0x56250440d9f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7a400114f0 tx=0x7f7a400119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbce7e7e146e6bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:51.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.412+0000 7f7a4cc00640 1 --2- 172.21.15.50:0/767377317 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7a340a2b80 0x7f7a340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.413+0000 7f7a4cc00640 1 -- 172.21.15.50:0/767377317 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f7a480f00b0 con 0x7f7a5010e210 2024-09-10T10:12:51.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.413+0000 7f7a3fe00640 1 -- 172.21.15.50:0/4054212505 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40011250 con 0x562504403670 2024-09-10T10:12:51.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.413+0000 7f7a3fe00640 1 -- 172.21.15.50:0/4054212505 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a400035f0 con 0x562504403670 2024-09-10T10:12:51.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.413+0000 7f7a3fe00640 1 -- 172.21.15.50:0/4054212505 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000f820 con 0x562504403670 2024-09-10T10:12:51.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.413+0000 7f7a47e00640 1 --2- 172.21.15.50:0/767377317 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7a340a2b80 0x7f7a340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.413+0000 7f7a58a3c740 1 -- 172.21.15.50:0/4054212505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 msgr2=0x56250440d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:51.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.413+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/4054212505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 0x56250440d9f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7a400114f0 tx=0x7f7a400119b0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.413+0000 7f7a47e00640 1 --2- 172.21.15.50:0/767377317 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7a340a2b80 0x7f7a340a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009fd0 tx=0x7f7a38005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.414+0000 7f7a58a3c740 1 -- 172.21.15.50:0/4054212505 shutdown_connections 2024-09-10T10:12:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.414+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/4054212505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56250440df30 0x562504410320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.414+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/4054212505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 0x56250440d9f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.414+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/4054212505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562504402d50 0x562504403130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.414+0000 7f7a58a3c740 1 -- 172.21.15.50:0/4054212505 >> 172.21.15.50:0/4054212505 conn(0x5625043ff2e0 msgr2=0x5625043ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.414+0000 7f7a58a3c740 1 -- 172.21.15.50:0/4054212505 shutdown_connections 2024-09-10T10:12:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.414+0000 7f7a58a3c740 1 -- 172.21.15.50:0/4054212505 wait complete. 2024-09-10T10:12:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.414+0000 7f7a58a3c740 1 -- start start 2024-09-10T10:12:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.414+0000 7f7a58a3c740 1 Processor -- start 2024-09-10T10:12:51.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.415+0000 7f7a58a3c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504402d50 0x56250440add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.415+0000 7f7a58a3c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562504403670 0x56250440b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.415+0000 7f7a58a3c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 0x56250440b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.415+0000 7f7a58a3c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562504410ba0 con 0x56250440df30 2024-09-10T10:12:51.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.415+0000 7f7a58a3c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5625043240f0 con 0x562504403670 2024-09-10T10:12:51.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.415+0000 7f7a58a3c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562504410d20 con 0x562504402d50 2024-09-10T10:12:51.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.415+0000 7f7a58a3c740 10 client.0 _ll_register_callbacks cb 0x5625043159e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:51.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.415+0000 7f7a4fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 0x56250440b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.415+0000 7f7a4f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504402d50 0x56250440add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.415+0000 7f7a4fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 0x56250440b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57218/0 (socket says 172.21.15.50:57218) 2024-09-10T10:12:51.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.415+0000 7f7a4fe00640 1 -- 172.21.15.50:0/2232634274 learned_addr learned my addr 172.21.15.50:0/2232634274 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:51.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.415+0000 7f7a47e00640 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562504403670 0x56250440b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.416+0000 7f7a4fe00640 1 -- 172.21.15.50:0/2232634274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504402d50 msgr2=0x56250440add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:51.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.416+0000 7f7a4fe00640 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504402d50 0x56250440add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.416+0000 7f7a4fe00640 1 -- 172.21.15.50:0/2232634274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562504403670 msgr2=0x56250440b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:51.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.416+0000 7f7a4fe00640 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562504403670 0x56250440b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.416+0000 7f7a4fe00640 1 -- 172.21.15.50:0/2232634274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625040da3c0 con 0x56250440df30 2024-09-10T10:12:51.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.416+0000 7f7a4f400640 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504402d50 0x56250440add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:51.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.416+0000 7f7a47e00640 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562504403670 0x56250440b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:51.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.416+0000 7f7a4fe00640 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 0x56250440b850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7a480c4c60 tx=0x7f7a480bc060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e75513616a999 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:51.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.416+0000 7f7a3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:12:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.416+0000 7f7a3cc00640 1 -- 172.21.15.50:0/2232634274 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480d4020 con 0x56250440df30 2024-09-10T10:12:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.416+0000 7f7a58a3c740 1 -- 172.21.15.50:0/2232634274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a400035f0 con 0x56250440df30 2024-09-10T10:12:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.416+0000 7f7a3cc00640 1 -- 172.21.15.50:0/2232634274 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f7a480c4d00 con 0x56250440df30 2024-09-10T10:12:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.417+0000 7f7a3cc00640 1 -- 172.21.15.50:0/2232634274 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7a480bc520 con 0x56250440df30 2024-09-10T10:12:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.417+0000 7f7a58a3c740 10 client.15471 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.417+0000 7f7a58a3c740 1 -- 172.21.15.50:0/2232634274 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562504410ba0 con 0x56250440df30 2024-09-10T10:12:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.417+0000 7f7a3cc00640 1 -- 172.21.15.50:0/2232634274 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a400035f0 con 0x56250440df30 2024-09-10T10:12:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.417+0000 7f7a3cc00640 1 -- 172.21.15.50:0/2232634274 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7a4804d030 con 0x56250440df30 2024-09-10T10:12:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.417+0000 7f7a58a3c740 10 client.15471 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.417+0000 7f7a58a3c740 10 client.15471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:12:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.417+0000 7f7a58a3c740 20 client.15471 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:51.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.417+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56250441dc80 0x5625044200e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.417+0000 7f7a58a3c740 4 client.15471 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:12:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.417+0000 7f7a58a3c740 1 -- 172.21.15.50:0/2232634274 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562504376950 con 0x56250441dc80 2024-09-10T10:12:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.418+0000 7f7a4f400640 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56250441dc80 0x5625044200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.418+0000 7f7a4f400640 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56250441dc80 0x5625044200e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c07a0c8617f7be server_cookie=94a09efa27ca4643 in_seq=0 out_seq=0 2024-09-10T10:12:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.418+0000 7f7a3cc00640 10 client.15471 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.419+0000 7f7a3cc00640 1 -- 172.21.15.50:0/2232634274 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562504376950 con 0x56250441dc80 2024-09-10T10:12:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.419+0000 7f7a3cc00640 10 client.15471 handle_command_reply: tid=0 2024-09-10T10:12:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.419+0000 7f7a58a3c740 1 client.15471 shutdown 2024-09-10T10:12:51.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.419+0000 7f7a58a3c740 1 -- 172.21.15.50:0/2232634274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 msgr2=0x56250440b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:51.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.419+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 0x56250440b850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7a480c4c60 tx=0x7f7a480bc060 comp rx=0 tx=0).stop 2024-09-10T10:12:51.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.419+0000 7f7a58a3c740 1 -- 172.21.15.50:0/2232634274 shutdown_connections 2024-09-10T10:12:51.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.419+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56250441dc80 0x5625044200e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.419+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 0x56250440b850 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.419+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562504403670 0x56250440b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.419+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/2232634274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504402d50 0x56250440add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.419+0000 7f7a3cc00640 0 client.15471 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:51.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.419+0000 7f7a58a3c740 1 -- 172.21.15.50:0/2232634274 >> 172.21.15.50:0/2232634274 conn(0x5625043ff2e0 msgr2=0x562504405010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:51.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.420+0000 7f7a58a3c740 1 -- 172.21.15.50:0/2232634274 shutdown_connections 2024-09-10T10:12:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.420+0000 7f7a58a3c740 1 -- 172.21.15.50:0/2232634274 wait complete. 2024-09-10T10:12:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.420+0000 7f7a58a3c740 20 client.15471 trim_cache size 0 max 16384 2024-09-10T10:12:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.438+0000 7f7a58a3c740 1 Processor -- start 2024-09-10T10:12:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.438+0000 7f7a58a3c740 1 -- start start 2024-09-10T10:12:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a58a3c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562504402d50 0x5625044057b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a58a3c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 0x5625044259f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a58a3c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 0x562504425f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a58a3c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501b3530 con 0x56250440df30 2024-09-10T10:12:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a58a3c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501b0e00 con 0x562504402d50 2024-09-10T10:12:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a58a3c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501aec50 con 0x562504403670 2024-09-10T10:12:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a4fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 0x562504425f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a4fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 0x562504425f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57226/0 (socket says 172.21.15.50:57226) 2024-09-10T10:12:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a4fe00640 1 -- 172.21.15.50:0/1321484705 learned_addr learned my addr 172.21.15.50:0/1321484705 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a4f400640 1 --2- 172.21.15.50:0/1321484705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562504402d50 0x5625044057b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a47e00640 1 --2- 172.21.15.50:0/1321484705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 0x5625044259f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a4fe00640 1 -- 172.21.15.50:0/1321484705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 msgr2=0x5625044259f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a4fe00640 1 --2- 172.21.15.50:0/1321484705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 0x5625044259f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a4fe00640 1 -- 172.21.15.50:0/1321484705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562504402d50 msgr2=0x5625044057b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a4fe00640 1 --2- 172.21.15.50:0/1321484705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562504402d50 0x5625044057b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.439+0000 7f7a4fe00640 1 -- 172.21.15.50:0/1321484705 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56250440d740 con 0x56250440df30 2024-09-10T10:12:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.440+0000 7f7a4fe00640 1 --2- 172.21.15.50:0/1321484705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 0x562504425f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a4802ae70 tx=0x7f7a480bc190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a1d9cb093d958f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:51.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.440+0000 7f7a3f400640 1 -- 172.21.15.50:0/1321484705 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480d4070 con 0x56250440df30 2024-09-10T10:12:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.440+0000 7f7a3f400640 1 -- 172.21.15.50:0/1321484705 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a480c08d0 con 0x56250440df30 2024-09-10T10:12:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.440+0000 7f7a3f400640 1 -- 172.21.15.50:0/1321484705 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480c4d00 con 0x56250440df30 2024-09-10T10:12:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.440+0000 7f7a58a3c740 1 -- 172.21.15.50:0/1321484705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 msgr2=0x562504425f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.441+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/1321484705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 0x562504425f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a4802ae70 tx=0x7f7a480bc190 comp rx=0 tx=0).stop 2024-09-10T10:12:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.441+0000 7f7a58a3c740 1 -- 172.21.15.50:0/1321484705 shutdown_connections 2024-09-10T10:12:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.441+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/1321484705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56250440df30 0x562504425f30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.441+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/1321484705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 0x5625044259f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.441+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/1321484705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562504402d50 0x5625044057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.441+0000 7f7a58a3c740 1 -- 172.21.15.50:0/1321484705 >> 172.21.15.50:0/1321484705 conn(0x5625043ff2e0 msgr2=0x56250440ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.441+0000 7f7a58a3c740 1 -- 172.21.15.50:0/1321484705 shutdown_connections 2024-09-10T10:12:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.441+0000 7f7a58a3c740 1 -- 172.21.15.50:0/1321484705 wait complete. 2024-09-10T10:12:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.441+0000 7f7a58a3c740 1 -- start start 2024-09-10T10:12:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.441+0000 7f7a58a3c740 1 Processor -- start 2024-09-10T10:12:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a58a3c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562504402d50 0x5625044165f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a58a3c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 0x562504411920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a58a3c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56250440df30 0x562504411e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a58a3c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501af2c0 con 0x562504402d50 2024-09-10T10:12:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a58a3c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501b0730 con 0x56250440df30 2024-09-10T10:12:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a58a3c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501af990 con 0x562504403670 2024-09-10T10:12:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a58a3c740 10 client.0 _ll_register_callbacks cb 0x7f7a480b88b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a4f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562504402d50 0x5625044165f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a4f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562504402d50 0x5625044165f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57234/0 (socket says 172.21.15.50:57234) 2024-09-10T10:12:51.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a4f400640 1 -- 172.21.15.50:0/3691221439 learned_addr learned my addr 172.21.15.50:0/3691221439 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a47e00640 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 0x562504411920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a4fe00640 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56250440df30 0x562504411e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a4f400640 1 -- 172.21.15.50:0/3691221439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 msgr2=0x562504411920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a4f400640 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 0x562504411920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a4f400640 1 -- 172.21.15.50:0/3691221439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56250440df30 msgr2=0x562504411e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.442+0000 7f7a4f400640 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56250440df30 0x562504411e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.443+0000 7f7a4f400640 1 -- 172.21.15.50:0/3691221439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562504412690 con 0x562504402d50 2024-09-10T10:12:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.443+0000 7f7a4fe00640 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56250440df30 0x562504411e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:12:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.443+0000 7f7a4f400640 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562504402d50 0x5625044165f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7a400114f0 tx=0x7f7a40005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f114709d2590869 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.443+0000 7f7a3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:12:51.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.443+0000 7f7a3cc00640 1 -- 172.21.15.50:0/3691221439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40003b50 con 0x562504402d50 2024-09-10T10:12:51.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.443+0000 7f7a58a3c740 1 -- 172.21.15.50:0/3691221439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a480c08d0 con 0x562504402d50 2024-09-10T10:12:51.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.443+0000 7f7a3cc00640 1 -- 172.21.15.50:0/3691221439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f7a40003cf0 con 0x562504402d50 2024-09-10T10:12:51.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.443+0000 7f7a3cc00640 1 -- 172.21.15.50:0/3691221439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7a4003a050 con 0x562504402d50 2024-09-10T10:12:51.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.443+0000 7f7a58a3c740 10 client.15477 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:51.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.443+0000 7f7a58a3c740 1 -- 172.21.15.50:0/3691221439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5625044888d0 con 0x562504402d50 2024-09-10T10:12:51.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.444+0000 7f7a3cc00640 1 -- 172.21.15.50:0/3691221439 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a480c08d0 con 0x562504402d50 2024-09-10T10:12:51.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.444+0000 7f7a3cc00640 1 -- 172.21.15.50:0/3691221439 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7a4000fa60 con 0x562504402d50 2024-09-10T10:12:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.444+0000 7f7a58a3c740 10 client.15477 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.444+0000 7f7a58a3c740 10 client.15477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:12:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.444+0000 7f7a58a3c740 20 client.15477 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.444+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562504488ee0 0x56250448b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.444+0000 7f7a58a3c740 4 client.15477 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:12:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.444+0000 7f7a58a3c740 1 -- 172.21.15.50:0/3691221439 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562504370e60 con 0x562504488ee0 2024-09-10T10:12:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.444+0000 7f7a47e00640 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562504488ee0 0x56250448b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:51.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a47e00640 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562504488ee0 0x56250448b300 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a51c1017165b2233 server_cookie=8e7d5472d2739ff2 in_seq=0 out_seq=0 2024-09-10T10:12:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a3cc00640 10 client.15477 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a3cc00640 1 -- 172.21.15.50:0/3691221439 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562504370e60 con 0x562504488ee0 2024-09-10T10:12:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a3cc00640 10 client.15477 handle_command_reply: tid=0 2024-09-10T10:12:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a58a3c740 1 client.15477 shutdown 2024-09-10T10:12:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a58a3c740 1 -- 172.21.15.50:0/3691221439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562504402d50 msgr2=0x5625044165f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562504402d50 0x5625044165f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7a400114f0 tx=0x7f7a40005f90 comp rx=0 tx=0).stop 2024-09-10T10:12:51.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a58a3c740 1 -- 172.21.15.50:0/3691221439 shutdown_connections 2024-09-10T10:12:51.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562504488ee0 0x56250448b300 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56250440df30 0x562504411e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562504403670 0x562504411920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a3cc00640 0 client.15477 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:51.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a58a3c740 1 --2- 172.21.15.50:0/3691221439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562504402d50 0x5625044165f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.445+0000 7f7a58a3c740 1 -- 172.21.15.50:0/3691221439 >> 172.21.15.50:0/3691221439 conn(0x5625043ff2e0 msgr2=0x56250440ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:51.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.446+0000 7f7a58a3c740 1 -- 172.21.15.50:0/3691221439 shutdown_connections 2024-09-10T10:12:51.396 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:12:51.397 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-10T10:12:51.397 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-10T10:12:51.397 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:12:51.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.446+0000 7f7a58a3c740 1 -- 172.21.15.50:0/3691221439 wait complete. 2024-09-10T10:12:51.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.446+0000 7f7a58a3c740 20 client.15477 trim_cache size 0 max 16384 2024-09-10T10:12:51.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.446+0000 7f7a54a00640 1 -- 172.21.15.50:0/767377317 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7a340a2b80 msgr2=0x7f7a340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.446+0000 7f7a54a00640 1 --2- 172.21.15.50:0/767377317 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7a340a2b80 0x7f7a340a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009fd0 tx=0x7f7a38005850 comp rx=0 tx=0).stop 2024-09-10T10:12:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.446+0000 7f7a54a00640 1 -- 172.21.15.50:0/767377317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a5010e210 msgr2=0x7f7a5019ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.446+0000 7f7a54a00640 1 --2- 172.21.15.50:0/767377317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a5010e210 0x7f7a5019ed20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a48005e30 tx=0x7f7a48003b80 comp rx=0 tx=0).stop 2024-09-10T10:12:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.446+0000 7f7a54a00640 1 -- 172.21.15.50:0/767377317 shutdown_connections 2024-09-10T10:12:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.446+0000 7f7a54a00640 1 --2- 172.21.15.50:0/767377317 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7a340a2b80 0x7f7a340a5040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.446+0000 7f7a54a00640 1 --2- 172.21.15.50:0/767377317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7a5010e210 0x7f7a5019ed20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.446+0000 7f7a54a00640 1 --2- 172.21.15.50:0/767377317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a50074f40 0x7f7a5019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.446+0000 7f7a54a00640 1 --2- 172.21.15.50:0/767377317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a50074620 0x7f7a5019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.446+0000 7f7a54a00640 1 -- 172.21.15.50:0/767377317 >> 172.21.15.50:0/767377317 conn(0x7f7a500fd710 msgr2=0x7f7a500fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.447+0000 7f7a54a00640 1 -- 172.21.15.50:0/767377317 shutdown_connections 2024-09-10T10:12:51.398 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:48.447+0000 7f7a54a00640 1 -- 172.21.15.50:0/767377317 wait complete. 2024-09-10T10:12:52.319 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T10:12:52.319 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:12:52.723 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:52.900 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:52 smithi050 ceph-mon[30354]: pgmap v441: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:12:53.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:52 smithi189 ceph-mon[34999]: pgmap v441: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:12:53.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:52 smithi084 ceph-mon[34812]: pgmap v441: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:12:53.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.382+0000 7f0b43c00640 1 -- 172.21.15.50:0/97429903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b3c109120 msgr2=0x7f0b3c110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:53.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.382+0000 7f0b43c00640 1 --2- 172.21.15.50:0/97429903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b3c109120 0x7f0b3c110ca0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009ca0 tx=0x7f0b3402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:12:53.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.382+0000 7f0b43c00640 1 -- 172.21.15.50:0/97429903 shutdown_connections 2024-09-10T10:12:53.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.382+0000 7f0b43c00640 1 --2- 172.21.15.50:0/97429903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b3c109120 0x7f0b3c110ca0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:53.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.382+0000 7f0b43c00640 1 --2- 172.21.15.50:0/97429903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c1049a0 0x7f0b3c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:53.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.382+0000 7f0b43c00640 1 --2- 172.21.15.50:0/97429903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3c103ff0 0x7f0b3c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:53.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.382+0000 7f0b43c00640 1 -- 172.21.15.50:0/97429903 >> 172.21.15.50:0/97429903 conn(0x7f0b3c0ffa90 msgr2=0x7f0b3c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:53.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.382+0000 7f0b43c00640 1 -- 172.21.15.50:0/97429903 shutdown_connections 2024-09-10T10:12:53.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.382+0000 7f0b43c00640 1 -- 172.21.15.50:0/97429903 wait complete. 2024-09-10T10:12:53.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.383+0000 7f0b43c00640 1 Processor -- start 2024-09-10T10:12:53.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.383+0000 7f0b43c00640 1 -- start start 2024-09-10T10:12:53.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.383+0000 7f0b43c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103ff0 0x7f0b3c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:53.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.383+0000 7f0b43c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3c1049a0 0x7f0b3c19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:53.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.383+0000 7f0b43c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b3c109120 0x7f0b3c19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:53.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.383+0000 7f0b43c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c1141a0 con 0x7f0b3c109120 2024-09-10T10:12:53.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.383+0000 7f0b43c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c114020 con 0x7f0b3c1049a0 2024-09-10T10:12:53.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.383+0000 7f0b43c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c114320 con 0x7f0b3c103ff0 2024-09-10T10:12:53.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.384+0000 7f0b3be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3c1049a0 0x7f0b3c19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:53.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.384+0000 7f0b41c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b3c109120 0x7f0b3c19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:53.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.384+0000 7f0b41200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103ff0 0x7f0b3c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:53.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.384+0000 7f0b41200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103ff0 0x7f0b3c19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:57504/0 (socket says 172.21.15.50:57504) 2024-09-10T10:12:53.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.384+0000 7f0b3be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3c1049a0 0x7f0b3c19ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:36578/0 (socket says 172.21.15.50:36578) 2024-09-10T10:12:53.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.384+0000 7f0b41c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b3c109120 0x7f0b3c19eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57254/0 (socket says 172.21.15.50:57254) 2024-09-10T10:12:53.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.384+0000 7f0b41200640 1 -- 172.21.15.50:0/1533547927 learned_addr learned my addr 172.21.15.50:0/1533547927 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.384+0000 7f0b41200640 1 -- 172.21.15.50:0/1533547927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3c1049a0 msgr2=0x7f0b3c19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.384+0000 7f0b41200640 1 --2- 172.21.15.50:0/1533547927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3c1049a0 0x7f0b3c19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.384+0000 7f0b41200640 1 -- 172.21.15.50:0/1533547927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b3c109120 msgr2=0x7f0b3c19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.384+0000 7f0b41200640 1 --2- 172.21.15.50:0/1533547927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b3c109120 0x7f0b3c19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.384+0000 7f0b41200640 1 -- 172.21.15.50:0/1533547927 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c19f590 con 0x7f0b3c103ff0 2024-09-10T10:12:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.385+0000 7f0b41200640 1 --2- 172.21.15.50:0/1533547927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103ff0 0x7f0b3c19a5e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000e9f0 tx=0x7f0b3000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:53.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.385+0000 7f0b39600640 1 -- 172.21.15.50:0/1533547927 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3000cd80 con 0x7f0b3c103ff0 2024-09-10T10:12:53.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.385+0000 7f0b43c00640 1 -- 172.21.15.50:0/1533547927 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3c19f880 con 0x7f0b3c103ff0 2024-09-10T10:12:53.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.385+0000 7f0b39600640 1 -- 172.21.15.50:0/1533547927 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b30010910 con 0x7f0b3c103ff0 2024-09-10T10:12:53.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.385+0000 7f0b39600640 1 -- 172.21.15.50:0/1533547927 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30018990 con 0x7f0b3c103ff0 2024-09-10T10:12:53.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.385+0000 7f0b43c00640 1 -- 172.21.15.50:0/1533547927 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b3c1a7160 con 0x7f0b3c103ff0 2024-09-10T10:12:53.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.386+0000 7f0b43c00640 1 -- 172.21.15.50:0/1533547927 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b3c1043d0 con 0x7f0b3c103ff0 2024-09-10T10:12:53.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.390+0000 7f0b39600640 1 -- 172.21.15.50:0/1533547927 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0b30010ac0 con 0x7f0b3c103ff0 2024-09-10T10:12:53.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.391+0000 7f0b39600640 1 --2- 172.21.15.50:0/1533547927 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b240a2b80 0x7f0b240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:53.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.391+0000 7f0b39600640 1 -- 172.21.15.50:0/1533547927 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f0b300cf740 con 0x7f0b3c103ff0 2024-09-10T10:12:53.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.392+0000 7f0b3be00640 1 --2- 172.21.15.50:0/1533547927 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b240a2b80 0x7f0b240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:53.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.392+0000 7f0b3be00640 1 --2- 172.21.15.50:0/1533547927 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b240a2b80 0x7f0b240a5040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c108a30 tx=0x7f0b28005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:53.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.395+0000 7f0b39600640 1 -- 172.21.15.50:0/1533547927 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b3009bc60 con 0x7f0b3c103ff0 2024-09-10T10:12:53.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.624+0000 7f0b43c00640 1 -- 172.21.15.50:0/1533547927 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b3c1a7440 con 0x7f0b3c103ff0 2024-09-10T10:12:53.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.624+0000 7f0b39600640 1 -- 172.21.15.50:0/1533547927 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f0b3009ff60 con 0x7f0b3c103ff0 2024-09-10T10:12:53.626 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:12:53.626 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:12:53.627 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:12:53.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.627+0000 7f0b43c00640 1 -- 172.21.15.50:0/1533547927 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b240a2b80 msgr2=0x7f0b240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:53.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.627+0000 7f0b43c00640 1 --2- 172.21.15.50:0/1533547927 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b240a2b80 0x7f0b240a5040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c108a30 tx=0x7f0b28005f90 comp rx=0 tx=0).stop 2024-09-10T10:12:53.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.627+0000 7f0b43c00640 1 -- 172.21.15.50:0/1533547927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103ff0 msgr2=0x7f0b3c19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:53.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.627+0000 7f0b43c00640 1 --2- 172.21.15.50:0/1533547927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103ff0 0x7f0b3c19a5e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000e9f0 tx=0x7f0b3000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:12:53.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.627+0000 7f0b43c00640 1 -- 172.21.15.50:0/1533547927 shutdown_connections 2024-09-10T10:12:53.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.627+0000 7f0b43c00640 1 --2- 172.21.15.50:0/1533547927 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0b240a2b80 0x7f0b240a5040 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:53.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.627+0000 7f0b43c00640 1 --2- 172.21.15.50:0/1533547927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b3c109120 0x7f0b3c19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:53.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.627+0000 7f0b43c00640 1 --2- 172.21.15.50:0/1533547927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b3c1049a0 0x7f0b3c19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:53.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.627+0000 7f0b43c00640 1 --2- 172.21.15.50:0/1533547927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103ff0 0x7f0b3c19a5e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:53.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.627+0000 7f0b43c00640 1 -- 172.21.15.50:0/1533547927 >> 172.21.15.50:0/1533547927 conn(0x7f0b3c0ffa90 msgr2=0x7f0b3c1004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:53.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.628+0000 7f0b43c00640 1 -- 172.21.15.50:0/1533547927 shutdown_connections 2024-09-10T10:12:53.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:53.628+0000 7f0b43c00640 1 -- 172.21.15.50:0/1533547927 wait complete. 2024-09-10T10:12:53.830 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 57% (7330/12697) Updating files: 58% (7365/12697) Updating files: 59% (7492/12697) Updating files: 60% (7619/12697) Updating files: 61% (7746/12697) Updating files: 62% (7873/12697) Updating files: 63% (8000/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 92% (11712/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-10T10:12:54.473 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T10:12:54.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:54 smithi050 ceph-mon[30354]: pgmap v442: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T10:12:54.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:54 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1533547927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:54.860 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:54.862 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to '1cf819b7212a6048e92fc78c4eff963344f6d56b'. 2024-09-10T10:12:54.862 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-09-10T10:12:54.863 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at 1cf819b7212 Merge PR #59672 into wip-rishabh-testing-20240909.165402-squid 2024-09-10T10:12:54.882 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T10:12:54.977 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T10:12:54.981 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T10:12:54.981 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T10:12:55.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:54 smithi189 ceph-mon[34999]: pgmap v442: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T10:12:55.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:54 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1533547927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:55.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:54 smithi084 ceph-mon[34812]: pgmap v442: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T10:12:55.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:54 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1533547927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:12:55.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.571+0000 7fb307200640 1 -- 172.21.15.50:0/1227439460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3081079c0 msgr2=0x7fb308107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:55.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.571+0000 7fb307200640 1 --2- 172.21.15.50:0/1227439460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3081079c0 0x7fb308107da0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009860 tx=0x7fb2f802a340 comp rx=0 tx=0).stop 2024-09-10T10:12:55.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.571+0000 7fb307200640 1 -- 172.21.15.50:0/1227439460 shutdown_connections 2024-09-10T10:12:55.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.571+0000 7fb307200640 1 --2- 172.21.15.50:0/1227439460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb308102360 0x7fb30810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.571+0000 7fb307200640 1 --2- 172.21.15.50:0/1227439460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3081019c0 0x7fb308101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.571+0000 7fb307200640 1 --2- 172.21.15.50:0/1227439460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3081079c0 0x7fb308107da0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.571+0000 7fb307200640 1 -- 172.21.15.50:0/1227439460 >> 172.21.15.50:0/1227439460 conn(0x7fb3080fd740 msgr2=0x7fb3080ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:55.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.571+0000 7fb307200640 1 -- 172.21.15.50:0/1227439460 shutdown_connections 2024-09-10T10:12:55.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.571+0000 7fb307200640 1 -- 172.21.15.50:0/1227439460 wait complete. 2024-09-10T10:12:55.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.573+0000 7fb307200640 1 Processor -- start 2024-09-10T10:12:55.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.573+0000 7fb307200640 1 -- start start 2024-09-10T10:12:55.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.573+0000 7fb307200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3081019c0 0x7fb30819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.573+0000 7fb307200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb308102360 0x7fb30819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.573+0000 7fb307200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3081079c0 0x7fb30819edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.573+0000 7fb307200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb308111dc0 con 0x7fb308102360 2024-09-10T10:12:55.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.573+0000 7fb307200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb308111c40 con 0x7fb3081019c0 2024-09-10T10:12:55.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.573+0000 7fb307200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb308111f40 con 0x7fb3081079c0 2024-09-10T10:12:55.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.574+0000 7fb2fd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb308102360 0x7fb30819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.574+0000 7fb305e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3081019c0 0x7fb30819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.574+0000 7fb2fd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb308102360 0x7fb30819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57276/0 (socket says 172.21.15.50:57276) 2024-09-10T10:12:55.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.574+0000 7fb2fd400640 1 -- 172.21.15.50:0/3147167625 learned_addr learned my addr 172.21.15.50:0/3147167625 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:55.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.574+0000 7fb306800640 1 --2- 172.21.15.50:0/3147167625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3081079c0 0x7fb30819edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.574+0000 7fb305e00640 1 -- 172.21.15.50:0/3147167625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3081079c0 msgr2=0x7fb30819edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:55.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.574+0000 7fb305e00640 1 --2- 172.21.15.50:0/3147167625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3081079c0 0x7fb30819edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.574+0000 7fb305e00640 1 -- 172.21.15.50:0/3147167625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb308102360 msgr2=0x7fb30819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:55.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.574+0000 7fb305e00640 1 --2- 172.21.15.50:0/3147167625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb308102360 0x7fb30819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.574+0000 7fb305e00640 1 -- 172.21.15.50:0/3147167625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30819f490 con 0x7fb3081019c0 2024-09-10T10:12:55.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.574+0000 7fb305e00640 1 --2- 172.21.15.50:0/3147167625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3081019c0 0x7fb30819a4e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb2f802a860 tx=0x7fb2f8033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:55.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.575+0000 7fb2ff400640 1 -- 172.21.15.50:0/3147167625 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8037040 con 0x7fb3081019c0 2024-09-10T10:12:55.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.575+0000 7fb2ff400640 1 -- 172.21.15.50:0/3147167625 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2f8033d50 con 0x7fb3081019c0 2024-09-10T10:12:55.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.575+0000 7fb2ff400640 1 -- 172.21.15.50:0/3147167625 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f80039e0 con 0x7fb3081019c0 2024-09-10T10:12:55.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.575+0000 7fb307200640 1 -- 172.21.15.50:0/3147167625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30819f720 con 0x7fb3081019c0 2024-09-10T10:12:55.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.575+0000 7fb307200640 1 -- 172.21.15.50:0/3147167625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30819fbb0 con 0x7fb3081019c0 2024-09-10T10:12:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.578+0000 7fb30f892740 1 Processor -- start 2024-09-10T10:12:55.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.578+0000 7fb30f892740 1 -- start start 2024-09-10T10:12:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.578+0000 7fb30f892740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 0x5610fefd4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.578+0000 7fb30f892740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefd4760 0x5610fefdeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.578+0000 7fb30f892740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefdf020 0x5610fefe1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.578+0000 7fb30f892740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5610fef3a3e0 con 0x5610fefd3e40 2024-09-10T10:12:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.578+0000 7fb30f892740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5610feee1d80 con 0x5610fefd4760 2024-09-10T10:12:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.578+0000 7fb30f892740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5610fef363a0 con 0x5610fefdf020 2024-09-10T10:12:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.578+0000 7fb2ff400640 1 -- 172.21.15.50:0/3147167625 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb2f8042020 con 0x7fb3081019c0 2024-09-10T10:12:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.579+0000 7fb306800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 0x5610fefd4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.579+0000 7fb306800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 0x5610fefd4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57282/0 (socket says 172.21.15.50:57282) 2024-09-10T10:12:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.579+0000 7fb306800640 1 -- 172.21.15.50:0/3959577685 learned_addr learned my addr 172.21.15.50:0/3959577685 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.579+0000 7fb305e00640 1 --2- 172.21.15.50:0/3959577685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefd4760 0x5610fefdeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.579+0000 7fb2fd400640 1 --2- 172.21.15.50:0/3959577685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefdf020 0x5610fefe1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.579+0000 7fb306800640 1 -- 172.21.15.50:0/3959577685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefdf020 msgr2=0x5610fefe1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:55.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.579+0000 7fb306800640 1 --2- 172.21.15.50:0/3959577685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefdf020 0x5610fefe1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.579+0000 7fb306800640 1 -- 172.21.15.50:0/3959577685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefd4760 msgr2=0x5610fefdeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:55.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.579+0000 7fb306800640 1 --2- 172.21.15.50:0/3959577685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefd4760 0x5610fefdeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.579+0000 7fb306800640 1 -- 172.21.15.50:0/3959577685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610fef00ae0 con 0x5610fefd3e40 2024-09-10T10:12:55.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.579+0000 7fb305e00640 1 --2- 172.21.15.50:0/3959577685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefd4760 0x5610fefdeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:12:55.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.580+0000 7fb306800640 1 --2- 172.21.15.50:0/3959577685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 0x5610fefd4220 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb30000e480 tx=0x7fb3000095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46731892c2d960b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.580+0000 7fb2f7400640 1 -- 172.21.15.50:0/3959577685 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300003970 con 0x5610fefd3e40 2024-09-10T10:12:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.580+0000 7fb2f7400640 1 -- 172.21.15.50:0/3959577685 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb30000d7d0 con 0x5610fefd3e40 2024-09-10T10:12:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.580+0000 7fb2f7400640 1 -- 172.21.15.50:0/3959577685 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300004560 con 0x5610fefd3e40 2024-09-10T10:12:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.581+0000 7fb30f892740 1 -- 172.21.15.50:0/3959577685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 msgr2=0x5610fefd4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.581+0000 7fb30f892740 1 --2- 172.21.15.50:0/3959577685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 0x5610fefd4220 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb30000e480 tx=0x7fb3000095c0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.581+0000 7fb2ff400640 1 --2- 172.21.15.50:0/3147167625 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb2ec0a2c00 0x7fb2ec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.581+0000 7fb30f892740 1 -- 172.21.15.50:0/3959577685 shutdown_connections 2024-09-10T10:12:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.581+0000 7fb30f892740 1 --2- 172.21.15.50:0/3959577685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefdf020 0x5610fefe1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.581+0000 7fb30f892740 1 --2- 172.21.15.50:0/3959577685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefd4760 0x5610fefdeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.581+0000 7fb30f892740 1 --2- 172.21.15.50:0/3959577685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 0x5610fefd4220 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.581+0000 7fb30f892740 1 -- 172.21.15.50:0/3959577685 >> 172.21.15.50:0/3959577685 conn(0x5610fefd03d0 msgr2=0x5610fefd07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.581+0000 7fb2ff400640 1 -- 172.21.15.50:0/3147167625 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb2f80ee910 con 0x7fb3081019c0 2024-09-10T10:12:55.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.581+0000 7fb305e00640 1 --2- 172.21.15.50:0/3147167625 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb2ec0a2c00 0x7fb2ec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.581+0000 7fb30f892740 1 -- 172.21.15.50:0/3959577685 shutdown_connections 2024-09-10T10:12:55.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.581+0000 7fb30f892740 1 -- 172.21.15.50:0/3959577685 wait complete. 2024-09-10T10:12:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.582+0000 7fb30f892740 1 -- start start 2024-09-10T10:12:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.582+0000 7fb305e00640 1 --2- 172.21.15.50:0/3147167625 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb2ec0a2c00 0x7fb2ec0a50c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8000c00 tx=0x7fb2f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.582+0000 7fb30f892740 1 Processor -- start 2024-09-10T10:12:55.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.582+0000 7fb30f892740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 0x5610fefdbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.582+0000 7fb30f892740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd4760 0x5610fefdc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.582+0000 7fb30f892740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 0x5610fefdc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.582+0000 7fb30f892740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5610fefe1bf0 con 0x5610fefd3e40 2024-09-10T10:12:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.582+0000 7fb30f892740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5610feef50f0 con 0x5610fefdf020 2024-09-10T10:12:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.582+0000 7fb30f892740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5610fefe1d70 con 0x5610fefd4760 2024-09-10T10:12:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.582+0000 7fb30f892740 10 client.0 _ll_register_callbacks cb 0x5610feedcbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.582+0000 7fb306800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 0x5610fefdbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.583+0000 7fb306800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 0x5610fefdbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57294/0 (socket says 172.21.15.50:57294) 2024-09-10T10:12:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.583+0000 7fb306800640 1 -- 172.21.15.50:0/2879783367 learned_addr learned my addr 172.21.15.50:0/2879783367 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.583+0000 7fb2fd400640 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd4760 0x5610fefdc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.583+0000 7fb306800640 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 0x5610fefdc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.583+0000 7fb306800640 1 -- 172.21.15.50:0/2879783367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd4760 msgr2=0x5610fefdc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:55.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.583+0000 7fb306800640 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd4760 0x5610fefdc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.583+0000 7fb306800640 1 -- 172.21.15.50:0/2879783367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 msgr2=0x5610fefdc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.583+0000 7fb306800640 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 0x5610fefdc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.583+0000 7fb306800640 1 -- 172.21.15.50:0/2879783367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610fecab3c0 con 0x5610fefd3e40 2024-09-10T10:12:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.583+0000 7fb2fd400640 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd4760 0x5610fefdc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.583+0000 7fb306800640 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 0x5610fefdbf00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb300005b40 tx=0x7fb300005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc19c304ce5b059 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.583+0000 7fb2ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:12:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.584+0000 7fb2ebe00640 1 -- 172.21.15.50:0/2879783367 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300003d40 con 0x5610fefd3e40 2024-09-10T10:12:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.584+0000 7fb30f892740 1 -- 172.21.15.50:0/2879783367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb30000d7d0 con 0x5610fefd3e40 2024-09-10T10:12:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.584+0000 7fb2ebe00640 1 -- 172.21.15.50:0/2879783367 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb30001c040 con 0x5610fefd3e40 2024-09-10T10:12:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.584+0000 7fb2ebe00640 1 -- 172.21.15.50:0/2879783367 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb300003ee0 con 0x5610fefd3e40 2024-09-10T10:12:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.584+0000 7fb30f892740 10 client.15495 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.584+0000 7fb30f892740 1 -- 172.21.15.50:0/2879783367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5610fefedc60 con 0x5610fefd3e40 2024-09-10T10:12:55.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.584+0000 7fb2ebe00640 1 -- 172.21.15.50:0/2879783367 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb30000d7d0 con 0x5610fefd3e40 2024-09-10T10:12:55.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.584+0000 7fb2ebe00640 1 -- 172.21.15.50:0/2879783367 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb30000b040 con 0x5610fefd3e40 2024-09-10T10:12:55.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.584+0000 7fb30f892740 10 client.15495 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:55.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.584+0000 7fb30f892740 10 client.15495 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:12:55.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.585+0000 7fb30f892740 20 client.15495 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:55.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.585+0000 7fb30f892740 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5610fefef070 0x5610feff1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.585+0000 7fb30f892740 4 client.15495 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:12:55.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.585+0000 7fb30f892740 1 -- 172.21.15.50:0/2879783367 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610fef47950 con 0x5610fefef070 2024-09-10T10:12:55.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.585+0000 7fb2fd400640 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5610fefef070 0x5610feff1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.586+0000 7fb2fd400640 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5610fefef070 0x5610feff1460 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d7d78521ad70d31 server_cookie=aa5567b0f0c24813 in_seq=0 out_seq=0 2024-09-10T10:12:55.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.586+0000 7fb2ebe00640 10 client.15495 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:12:55.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.586+0000 7fb2ebe00640 1 -- 172.21.15.50:0/2879783367 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5610fef47950 con 0x5610fefef070 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.586+0000 7fb2ebe00640 10 client.15495 handle_command_reply: tid=0 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.587+0000 7fb30f892740 1 client.15495 shutdown 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.587+0000 7fb30f892740 1 -- 172.21.15.50:0/2879783367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 msgr2=0x5610fefdbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.587+0000 7fb30f892740 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 0x5610fefdbf00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb300005b40 tx=0x7fb300005a50 comp rx=0 tx=0).stop 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.587+0000 7fb30f892740 1 -- 172.21.15.50:0/2879783367 shutdown_connections 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.587+0000 7fb30f892740 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 0x5610fefdc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.587+0000 7fb30f892740 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd4760 0x5610fefdc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.587+0000 7fb30f892740 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5610fefef070 0x5610feff1460 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.587+0000 7fb30f892740 1 --2- 172.21.15.50:0/2879783367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd3e40 0x5610fefdbf00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.587+0000 7fb30f892740 1 -- 172.21.15.50:0/2879783367 >> 172.21.15.50:0/2879783367 conn(0x5610fefd03d0 msgr2=0x5610fefd6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.587+0000 7fb2ebe00640 0 client.15495 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.587+0000 7fb30f892740 1 -- 172.21.15.50:0/2879783367 shutdown_connections 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.587+0000 7fb30f892740 1 -- 172.21.15.50:0/2879783367 wait complete. 2024-09-10T10:12:55.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.587+0000 7fb30f892740 20 client.15495 trim_cache size 0 max 16384 2024-09-10T10:12:55.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.601+0000 7fb30f892740 1 Processor -- start 2024-09-10T10:12:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.601+0000 7fb30f892740 1 -- start start 2024-09-10T10:12:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb30f892740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd3e40 0x5610feff1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb30f892740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd4760 0x5610fefcfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb30f892740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 0x5610feff6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb30f892740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081b35f0 con 0x5610fefd4760 2024-09-10T10:12:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb30f892740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081b0ec0 con 0x5610fefdf020 2024-09-10T10:12:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb30f892740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081aed10 con 0x5610fefd3e40 2024-09-10T10:12:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb2fd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd4760 0x5610fefcfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb2fd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd4760 0x5610fefcfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57304/0 (socket says 172.21.15.50:57304) 2024-09-10T10:12:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb2fd400640 1 -- 172.21.15.50:0/1303773086 learned_addr learned my addr 172.21.15.50:0/1303773086 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:55.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb306800640 1 --2- 172.21.15.50:0/1303773086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd3e40 0x5610feff1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb306800640 1 --2- 172.21.15.50:0/1303773086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 0x5610feff6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb2fd400640 1 -- 172.21.15.50:0/1303773086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd3e40 msgr2=0x5610feff1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb2fd400640 1 --2- 172.21.15.50:0/1303773086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd3e40 0x5610feff1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb2fd400640 1 -- 172.21.15.50:0/1303773086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 msgr2=0x5610feff6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb2fd400640 1 --2- 172.21.15.50:0/1303773086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 0x5610feff6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb2fd400640 1 -- 172.21.15.50:0/1303773086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610fefd3c70 con 0x5610fefd4760 2024-09-10T10:12:55.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.602+0000 7fb306800640 1 --2- 172.21.15.50:0/1303773086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 0x5610feff6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:12:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.603+0000 7fb2fd400640 1 --2- 172.21.15.50:0/1303773086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd4760 0x5610fefcfca0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009620 tx=0x7fb2f0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5f6cb49236cd93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.603+0000 7fb2f6a00640 1 -- 172.21.15.50:0/1303773086 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0012970 con 0x5610fefd4760 2024-09-10T10:12:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.603+0000 7fb2f6a00640 1 -- 172.21.15.50:0/1303773086 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2f00035f0 con 0x5610fefd4760 2024-09-10T10:12:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.603+0000 7fb2f6a00640 1 -- 172.21.15.50:0/1303773086 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0010690 con 0x5610fefd4760 2024-09-10T10:12:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.604+0000 7fb30f892740 1 -- 172.21.15.50:0/1303773086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd4760 msgr2=0x5610fefcfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:55.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.604+0000 7fb30f892740 1 --2- 172.21.15.50:0/1303773086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd4760 0x5610fefcfca0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009620 tx=0x7fb2f0005f90 comp rx=0 tx=0).stop 2024-09-10T10:12:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.604+0000 7fb30f892740 1 -- 172.21.15.50:0/1303773086 shutdown_connections 2024-09-10T10:12:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.604+0000 7fb30f892740 1 --2- 172.21.15.50:0/1303773086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 0x5610feff6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.604+0000 7fb30f892740 1 --2- 172.21.15.50:0/1303773086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd4760 0x5610fefcfca0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.604+0000 7fb30f892740 1 --2- 172.21.15.50:0/1303773086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd3e40 0x5610feff1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.604+0000 7fb30f892740 1 -- 172.21.15.50:0/1303773086 >> 172.21.15.50:0/1303773086 conn(0x5610fefd03d0 msgr2=0x5610fefd60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.604+0000 7fb30f892740 1 -- 172.21.15.50:0/1303773086 shutdown_connections 2024-09-10T10:12:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.604+0000 7fb30f892740 1 -- 172.21.15.50:0/1303773086 wait complete. 2024-09-10T10:12:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.604+0000 7fb30f892740 1 -- start start 2024-09-10T10:12:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.605+0000 7fb30f892740 1 Processor -- start 2024-09-10T10:12:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.605+0000 7fb30f892740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd3e40 0x5610fefe1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.605+0000 7fb30f892740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd4760 0x5610fefe24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.605+0000 7fb30f892740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 0x5610fefe2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.605+0000 7fb30f892740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081af380 con 0x5610fefd4760 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.605+0000 7fb30f892740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081b07f0 con 0x5610fefdf020 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.605+0000 7fb30f892740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081afa50 con 0x5610fefd3e40 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.605+0000 7fb30f892740 10 client.0 _ll_register_callbacks cb 0x7fb2f0009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.605+0000 7fb2fd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd4760 0x5610fefe24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.605+0000 7fb306800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd3e40 0x5610fefe1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.605+0000 7fb306800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd3e40 0x5610fefe1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:57548/0 (socket says 172.21.15.50:57548) 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.605+0000 7fb306800640 1 -- 172.21.15.50:0/392153775 learned_addr learned my addr 172.21.15.50:0/392153775 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.606+0000 7fb306800640 1 --2- 172.21.15.50:0/392153775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 0x5610fefe2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.606+0000 7fb306800640 1 -- 172.21.15.50:0/392153775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 msgr2=0x5610fefe2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.606+0000 7fb306800640 1 --2- 172.21.15.50:0/392153775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 0x5610fefe2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.606+0000 7fb306800640 1 -- 172.21.15.50:0/392153775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd4760 msgr2=0x5610fefe24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.606+0000 7fb306800640 1 --2- 172.21.15.50:0/392153775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd4760 0x5610fefe24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.606+0000 7fb306800640 1 -- 172.21.15.50:0/392153775 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610ff057c30 con 0x5610fefd3e40 2024-09-10T10:12:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.606+0000 7fb2fd400640 1 --2- 172.21.15.50:0/392153775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd4760 0x5610fefe24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.606+0000 7fb306800640 1 --2- 172.21.15.50:0/392153775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd3e40 0x5610fefe1fb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb300009ba0 tx=0x7fb300005a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b650d95b929b6f26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:55.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.606+0000 7fb2ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:12:55.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.606+0000 7fb2ebe00640 1 -- 172.21.15.50:0/392153775 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30000d9e0 con 0x5610fefd3e40 2024-09-10T10:12:55.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.607+0000 7fb30f892740 1 -- 172.21.15.50:0/392153775 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2f00035f0 con 0x5610fefd3e40 2024-09-10T10:12:55.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.607+0000 7fb2ebe00640 1 -- 172.21.15.50:0/392153775 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb300002030 con 0x5610fefd3e40 2024-09-10T10:12:55.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.607+0000 7fb2ebe00640 1 -- 172.21.15.50:0/392153775 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb300017420 con 0x5610fefd3e40 2024-09-10T10:12:55.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.607+0000 7fb30f892740 10 client.25525 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:55.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.607+0000 7fb30f892740 1 -- 172.21.15.50:0/392153775 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5610ff058e80 con 0x5610fefd3e40 2024-09-10T10:12:55.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.607+0000 7fb2ebe00640 1 -- 172.21.15.50:0/392153775 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2f00035f0 con 0x5610fefd3e40 2024-09-10T10:12:55.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.607+0000 7fb2ebe00640 1 -- 172.21.15.50:0/392153775 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb30000b040 con 0x5610fefd3e40 2024-09-10T10:12:55.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.607+0000 7fb30f892740 10 client.25525 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:55.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.607+0000 7fb30f892740 10 client.25525 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:12:55.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.607+0000 7fb30f892740 20 client.25525 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:55.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.607+0000 7fb30f892740 1 --2- 172.21.15.50:0/392153775 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5610ff059550 0x5610ff05b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:55.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.607+0000 7fb30f892740 4 client.25525 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.607+0000 7fb30f892740 1 -- 172.21.15.50:0/392153775 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5610fef41e60 con 0x5610ff059550 2024-09-10T10:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.608+0000 7fb2fd400640 1 --2- 172.21.15.50:0/392153775 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5610ff059550 0x5610ff05b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.608+0000 7fb2fd400640 1 --2- 172.21.15.50:0/392153775 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5610ff059550 0x5610ff05b970 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f6d4134fdf335472 server_cookie=729fe530f4845fe in_seq=0 out_seq=0 2024-09-10T10:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.608+0000 7fb2ebe00640 10 client.25525 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb2ebe00640 1 -- 172.21.15.50:0/392153775 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5610fef41e60 con 0x5610ff059550 2024-09-10T10:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb2ebe00640 10 client.25525 handle_command_reply: tid=0 2024-09-10T10:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb30f892740 1 client.25525 shutdown 2024-09-10T10:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb30f892740 1 -- 172.21.15.50:0/392153775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd3e40 msgr2=0x5610fefe1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb30f892740 1 --2- 172.21.15.50:0/392153775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd3e40 0x5610fefe1fb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb300009ba0 tx=0x7fb300005a50 comp rx=0 tx=0).stop 2024-09-10T10:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb30f892740 1 -- 172.21.15.50:0/392153775 shutdown_connections 2024-09-10T10:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb30f892740 1 --2- 172.21.15.50:0/392153775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5610fefdf020 0x5610fefe2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb30f892740 1 --2- 172.21.15.50:0/392153775 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5610ff059550 0x5610ff05b970 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb30f892740 1 --2- 172.21.15.50:0/392153775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610fefd4760 0x5610fefe24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb30f892740 1 --2- 172.21.15.50:0/392153775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5610fefd3e40 0x5610fefe1fb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb2ebe00640 0 client.25525 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:12:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb30f892740 1 -- 172.21.15.50:0/392153775 >> 172.21.15.50:0/392153775 conn(0x5610fefd03d0 msgr2=0x5610fefdd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb30f892740 1 -- 172.21.15.50:0/392153775 shutdown_connections 2024-09-10T10:12:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb30f892740 1 -- 172.21.15.50:0/392153775 wait complete. 2024-09-10T10:12:55.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.609+0000 7fb30f892740 20 client.25525 trim_cache size 0 max 16384 2024-09-10T10:12:55.614 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.610+0000 7fb307200640 1 -- 172.21.15.50:0/3147167625 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb2ec0a2c00 msgr2=0x7fb2ec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.610+0000 7fb307200640 1 --2- 172.21.15.50:0/3147167625 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb2ec0a2c00 0x7fb2ec0a50c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8000c00 tx=0x7fb2f8005f90 comp rx=0 tx=0).stop 2024-09-10T10:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.610+0000 7fb307200640 1 -- 172.21.15.50:0/3147167625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3081019c0 msgr2=0x7fb30819a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.610+0000 7fb307200640 1 --2- 172.21.15.50:0/3147167625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3081019c0 0x7fb30819a4e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb2f802a860 tx=0x7fb2f8033b60 comp rx=0 tx=0).stop 2024-09-10T10:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.610+0000 7fb307200640 1 -- 172.21.15.50:0/3147167625 shutdown_connections 2024-09-10T10:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.610+0000 7fb307200640 1 --2- 172.21.15.50:0/3147167625 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb2ec0a2c00 0x7fb2ec0a50c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.610+0000 7fb307200640 1 --2- 172.21.15.50:0/3147167625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3081079c0 0x7fb30819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.610+0000 7fb307200640 1 --2- 172.21.15.50:0/3147167625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb308102360 0x7fb30819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.610+0000 7fb307200640 1 --2- 172.21.15.50:0/3147167625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3081019c0 0x7fb30819a4e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:55.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.610+0000 7fb307200640 1 -- 172.21.15.50:0/3147167625 >> 172.21.15.50:0/3147167625 conn(0x7fb3080fd740 msgr2=0x7fb30810d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:55.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.610+0000 7fb307200640 1 -- 172.21.15.50:0/3147167625 shutdown_connections 2024-09-10T10:12:55.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:55.610+0000 7fb307200640 1 -- 172.21.15.50:0/3147167625 wait complete. 2024-09-10T10:12:56.579 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T10:12:56.804 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T10:12:56.929 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T10:12:56.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:56 smithi050 ceph-mon[30354]: pgmap v443: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:12:56.973 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:57.004 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T10:12:57.009 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T10:12:57.009 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T10:12:57.075 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T10:12:57.083 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:12:57.083 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T10:12:57.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:56 smithi189 ceph-mon[34999]: pgmap v443: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:12:57.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:56 smithi084 ceph-mon[34812]: pgmap v443: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T10:12:57.119 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-09-10T10:12:57.120 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-09-10T10:12:57.121 DEBUG:teuthology.orchestra.run.smithi050:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-09-10T10:12:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.550+0000 7fecde600640 1 -- 172.21.15.50:0/2784535516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecd81079c0 msgr2=0x7fecd8107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.550+0000 7fecde600640 1 --2- 172.21.15.50:0/2784535516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecd81079c0 0x7fecd8107da0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feccc009930 tx=0x7feccc02a420 comp rx=0 tx=0).stop 2024-09-10T10:12:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.550+0000 7fecde600640 1 -- 172.21.15.50:0/2784535516 shutdown_connections 2024-09-10T10:12:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.550+0000 7fecde600640 1 --2- 172.21.15.50:0/2784535516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fecd8102360 0x7fecd810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.550+0000 7fecde600640 1 --2- 172.21.15.50:0/2784535516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecd81019c0 0x7fecd8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.550+0000 7fecde600640 1 --2- 172.21.15.50:0/2784535516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecd81079c0 0x7fecd8107da0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.550+0000 7fecde600640 1 -- 172.21.15.50:0/2784535516 >> 172.21.15.50:0/2784535516 conn(0x7fecd80fd6e0 msgr2=0x7fecd80ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.550+0000 7fecde600640 1 -- 172.21.15.50:0/2784535516 shutdown_connections 2024-09-10T10:12:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.550+0000 7fecde600640 1 -- 172.21.15.50:0/2784535516 wait complete. 2024-09-10T10:12:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.551+0000 7fecde600640 1 Processor -- start 2024-09-10T10:12:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.551+0000 7fecde600640 1 -- start start 2024-09-10T10:12:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecde600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecd81019c0 0x7fecd81982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecde600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fecd8102360 0x7fecd81987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecde600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecd81079c0 0x7fecd819cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecde600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fecd8111d90 con 0x7fecd81079c0 2024-09-10T10:12:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecde600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fecd8111c10 con 0x7fecd81019c0 2024-09-10T10:12:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecde600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fecd8111f10 con 0x7fecd8102360 2024-09-10T10:12:57.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecddc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecd81079c0 0x7fecd819cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecdd200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecd81019c0 0x7fecd81982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecddc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecd81079c0 0x7fecd819cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34426/0 (socket says 172.21.15.50:34426) 2024-09-10T10:12:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecddc00640 1 -- 172.21.15.50:0/375036292 learned_addr learned my addr 172.21.15.50:0/375036292 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecd7e00640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fecd8102360 0x7fecd81987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecdd200640 1 -- 172.21.15.50:0/375036292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fecd8102360 msgr2=0x7fecd81987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecdd200640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fecd8102360 0x7fecd81987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecdd200640 1 -- 172.21.15.50:0/375036292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecd81079c0 msgr2=0x7fecd819cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecdd200640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecd81079c0 0x7fecd819cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.552+0000 7fecdd200640 1 -- 172.21.15.50:0/375036292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd819d260 con 0x7fecd81019c0 2024-09-10T10:12:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.553+0000 7fecddc00640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecd81079c0 0x7fecd819cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.553+0000 7fecdd200640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecd81019c0 0x7fecd81982b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feccc005940 tx=0x7feccc031b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:57.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.553+0000 7fecd5600640 1 -- 172.21.15.50:0/375036292 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc03f070 con 0x7fecd81019c0 2024-09-10T10:12:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.553+0000 7fecde600640 1 -- 172.21.15.50:0/375036292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd819d4f0 con 0x7fecd81019c0 2024-09-10T10:12:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.553+0000 7fecd5600640 1 -- 172.21.15.50:0/375036292 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feccc003ad0 con 0x7fecd81019c0 2024-09-10T10:12:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.553+0000 7fecd5600640 1 -- 172.21.15.50:0/375036292 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc035070 con 0x7fecd81019c0 2024-09-10T10:12:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.553+0000 7fecde600640 1 -- 172.21.15.50:0/375036292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd81a4e30 con 0x7fecd81019c0 2024-09-10T10:12:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.556+0000 7fece263c740 1 Processor -- start 2024-09-10T10:12:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.557+0000 7fece263c740 1 -- start start 2024-09-10T10:12:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.557+0000 7fecd5600640 1 -- 172.21.15.50:0/375036292 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7feccc0035f0 con 0x7fecd81019c0 2024-09-10T10:12:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.557+0000 7fece263c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e647d60 0x56120e648140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.557+0000 7fece263c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e648680 0x56120e656ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.557+0000 7fece263c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e657430 0x56120e659820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.557+0000 7fece263c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56120e5ae3e0 con 0x56120e657430 2024-09-10T10:12:57.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.557+0000 7fece263c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56120e555d80 con 0x56120e647d60 2024-09-10T10:12:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.557+0000 7fece263c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56120e5aa3a0 con 0x56120e648680 2024-09-10T10:12:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.557+0000 7fecddc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e647d60 0x56120e648140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.557+0000 7fecdd200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e648680 0x56120e656ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.557+0000 7fecddc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e647d60 0x56120e648140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37454/0 (socket says 172.21.15.50:37454) 2024-09-10T10:12:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.557+0000 7fecddc00640 1 -- 172.21.15.50:0/1644671775 learned_addr learned my addr 172.21.15.50:0/1644671775 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.557+0000 7fecd7e00640 1 --2- 172.21.15.50:0/1644671775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e657430 0x56120e659820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.558+0000 7fecddc00640 1 -- 172.21.15.50:0/1644671775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e648680 msgr2=0x56120e656ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.558+0000 7fecddc00640 1 --2- 172.21.15.50:0/1644671775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e648680 0x56120e656ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.558+0000 7fecddc00640 1 -- 172.21.15.50:0/1644671775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e657430 msgr2=0x56120e659820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.558+0000 7fecddc00640 1 --2- 172.21.15.50:0/1644671775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e657430 0x56120e659820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.558+0000 7fecddc00640 1 -- 172.21.15.50:0/1644671775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120e574ae0 con 0x56120e647d60 2024-09-10T10:12:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.558+0000 7fecddc00640 1 --2- 172.21.15.50:0/1644671775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e647d60 0x56120e648140 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fecd0011850 tx=0x7fecd0011d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52d51ac37e4d2293 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:57.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.558+0000 7fecd5600640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fecc00a2b80 0x7fecc00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.558+0000 7fecd5600640 1 -- 172.21.15.50:0/375036292 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7feccc0ef880 con 0x7fecd81019c0 2024-09-10T10:12:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.558+0000 7fecca000640 1 -- 172.21.15.50:0/1644671775 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0011330 con 0x56120e647d60 2024-09-10T10:12:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.558+0000 7fecdd200640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fecc00a2b80 0x7fecc00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.559+0000 7fecca000640 1 -- 172.21.15.50:0/1644671775 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecd000fe80 con 0x56120e647d60 2024-09-10T10:12:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.559+0000 7fecca000640 1 -- 172.21.15.50:0/1644671775 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd00193e0 con 0x56120e647d60 2024-09-10T10:12:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.559+0000 7fece263c740 1 -- 172.21.15.50:0/1644671775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e647d60 msgr2=0x56120e648140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.559+0000 7fecdd200640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fecc00a2b80 0x7fecc00a5040 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feccc0c4430 tx=0x7feccc0f5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.559+0000 7fece263c740 1 --2- 172.21.15.50:0/1644671775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e647d60 0x56120e648140 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fecd0011850 tx=0x7fecd0011d10 comp rx=0 tx=0).stop 2024-09-10T10:12:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.559+0000 7fece263c740 1 -- 172.21.15.50:0/1644671775 shutdown_connections 2024-09-10T10:12:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.559+0000 7fece263c740 1 --2- 172.21.15.50:0/1644671775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e657430 0x56120e659820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.559+0000 7fece263c740 1 --2- 172.21.15.50:0/1644671775 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e648680 0x56120e656ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.559+0000 7fece263c740 1 --2- 172.21.15.50:0/1644671775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e647d60 0x56120e648140 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.559+0000 7fece263c740 1 -- 172.21.15.50:0/1644671775 >> 172.21.15.50:0/1644671775 conn(0x56120e6443d0 msgr2=0x56120e6447b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.559+0000 7fece263c740 1 -- 172.21.15.50:0/1644671775 shutdown_connections 2024-09-10T10:12:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.559+0000 7fece263c740 1 -- 172.21.15.50:0/1644671775 wait complete. 2024-09-10T10:12:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.560+0000 7fece263c740 1 -- start start 2024-09-10T10:12:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.560+0000 7fece263c740 1 Processor -- start 2024-09-10T10:12:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.560+0000 7fece263c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e647d60 0x56120e654270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fece263c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 0x56120e6547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fece263c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 0x56120e654cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fece263c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56120e659fa0 con 0x56120e648680 2024-09-10T10:12:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fece263c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56120e5690f0 con 0x56120e657430 2024-09-10T10:12:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fece263c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56120e65a120 con 0x56120e647d60 2024-09-10T10:12:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fece263c740 10 client.0 _ll_register_callbacks cb 0x56120e550bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:57.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fecd7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 0x56120e6547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fecd7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 0x56120e6547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34446/0 (socket says 172.21.15.50:34446) 2024-09-10T10:12:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fecd7e00640 1 -- 172.21.15.50:0/2501206288 learned_addr learned my addr 172.21.15.50:0/2501206288 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fecddc00640 1 --2- 172.21.15.50:0/2501206288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e647d60 0x56120e654270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fecddc00640 1 --2- 172.21.15.50:0/2501206288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 0x56120e654cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fecd7e00640 1 -- 172.21.15.50:0/2501206288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e647d60 msgr2=0x56120e654270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fecd7e00640 1 --2- 172.21.15.50:0/2501206288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e647d60 0x56120e654270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fecd7e00640 1 -- 172.21.15.50:0/2501206288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 msgr2=0x56120e654cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fecd7e00640 1 --2- 172.21.15.50:0/2501206288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 0x56120e654cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.561+0000 7fecd7e00640 1 -- 172.21.15.50:0/2501206288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120e31f3c0 con 0x56120e648680 2024-09-10T10:12:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.562+0000 7fecd7e00640 1 --2- 172.21.15.50:0/2501206288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 0x56120e6547b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fecc40126e0 tx=0x7fecc4012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792c42a1ace5ed5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.562+0000 7fecbea00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:12:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.562+0000 7fecbea00640 1 -- 172.21.15.50:0/2501206288 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc40120d0 con 0x56120e648680 2024-09-10T10:12:57.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.562+0000 7fece263c740 1 -- 172.21.15.50:0/2501206288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56120e5bb950 con 0x56120e648680 2024-09-10T10:12:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.562+0000 7fecbea00640 1 -- 172.21.15.50:0/2501206288 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fecc400f920 con 0x56120e648680 2024-09-10T10:12:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.562+0000 7fecbea00640 1 -- 172.21.15.50:0/2501206288 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fecc4012270 con 0x56120e648680 2024-09-10T10:12:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.562+0000 7fece263c740 10 client.15513 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.562+0000 7fece263c740 1 -- 172.21.15.50:0/2501206288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56120e666060 con 0x56120e648680 2024-09-10T10:12:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.562+0000 7fecbea00640 1 -- 172.21.15.50:0/2501206288 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56120e5bb950 con 0x56120e648680 2024-09-10T10:12:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.563+0000 7fecbea00640 1 -- 172.21.15.50:0/2501206288 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fecc401c420 con 0x56120e648680 2024-09-10T10:12:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.563+0000 7fece263c740 10 client.15513 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.563+0000 7fece263c740 10 client.15513 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:12:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.563+0000 7fece263c740 20 client.15513 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.563+0000 7fece263c740 1 --2- 172.21.15.50:0/2501206288 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x56120e667510 0x56120e669930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.563+0000 7fece263c740 4 client.15513 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:12:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.563+0000 7fece263c740 1 -- 172.21.15.50:0/2501206288 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56120e5b5e60 con 0x56120e667510 2024-09-10T10:12:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.563+0000 7fecddc00640 1 --2- 172.21.15.50:0/2501206288 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x56120e667510 0x56120e669930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.564+0000 7fecddc00640 1 --2- 172.21.15.50:0/2501206288 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x56120e667510 0x56120e669930 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c86d514d603786fb server_cookie=97acca9cc3a34f82 in_seq=0 out_seq=0 2024-09-10T10:12:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.564+0000 7fecbea00640 10 client.15513 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:12:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.564+0000 7fecbea00640 1 -- 172.21.15.50:0/2501206288 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56120e5b5e60 con 0x56120e667510 2024-09-10T10:12:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.564+0000 7fecbea00640 10 client.15513 handle_command_reply: tid=0 2024-09-10T10:12:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.564+0000 7fece263c740 1 client.15513 shutdown 2024-09-10T10:12:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.565+0000 7fece263c740 1 -- 172.21.15.50:0/2501206288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 msgr2=0x56120e6547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.565+0000 7fece263c740 1 --2- 172.21.15.50:0/2501206288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 0x56120e6547b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fecc40126e0 tx=0x7fecc4012ba0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.565+0000 7fece263c740 1 -- 172.21.15.50:0/2501206288 shutdown_connections 2024-09-10T10:12:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.565+0000 7fece263c740 1 --2- 172.21.15.50:0/2501206288 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x56120e667510 0x56120e669930 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.565+0000 7fece263c740 1 --2- 172.21.15.50:0/2501206288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 0x56120e654cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.565+0000 7fece263c740 1 --2- 172.21.15.50:0/2501206288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 0x56120e6547b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.565+0000 7fecbea00640 0 client.15513 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:12:57.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.565+0000 7fece263c740 1 --2- 172.21.15.50:0/2501206288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e647d60 0x56120e654270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.565+0000 7fece263c740 1 -- 172.21.15.50:0/2501206288 >> 172.21.15.50:0/2501206288 conn(0x56120e6443d0 msgr2=0x56120e64a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:57.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.565+0000 7fece263c740 1 -- 172.21.15.50:0/2501206288 shutdown_connections 2024-09-10T10:12:57.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.565+0000 7fece263c740 1 -- 172.21.15.50:0/2501206288 wait complete. 2024-09-10T10:12:57.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.565+0000 7fece263c740 20 client.15513 trim_cache size 0 max 16384 2024-09-10T10:12:57.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.579+0000 7fece263c740 1 Processor -- start 2024-09-10T10:12:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.579+0000 7fece263c740 1 -- start start 2024-09-10T10:12:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.579+0000 7fece263c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e647d60 0x56120e6561e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.579+0000 7fece263c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 0x56120e654b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.579+0000 7fece263c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 0x56120e66f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.579+0000 7fece263c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fecd81af230 con 0x56120e648680 2024-09-10T10:12:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.579+0000 7fece263c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fecd81acb00 con 0x56120e657430 2024-09-10T10:12:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.579+0000 7fece263c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fecd81aa950 con 0x56120e647d60 2024-09-10T10:12:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.580+0000 7fecd7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 0x56120e654b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.580+0000 7fecddc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e647d60 0x56120e6561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.580+0000 7fecd7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 0x56120e654b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34460/0 (socket says 172.21.15.50:34460) 2024-09-10T10:12:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.580+0000 7fecd7e00640 1 -- 172.21.15.50:0/210586077 learned_addr learned my addr 172.21.15.50:0/210586077 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:57.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.580+0000 7fecddc00640 1 --2- 172.21.15.50:0/210586077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 0x56120e66f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.580+0000 7fecd7e00640 1 -- 172.21.15.50:0/210586077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e647d60 msgr2=0x56120e6561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.580+0000 7fecd7e00640 1 --2- 172.21.15.50:0/210586077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e647d60 0x56120e6561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.580+0000 7fecd7e00640 1 -- 172.21.15.50:0/210586077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 msgr2=0x56120e66f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.580+0000 7fecd7e00640 1 --2- 172.21.15.50:0/210586077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 0x56120e66f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.580+0000 7fecd7e00640 1 -- 172.21.15.50:0/210586077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120e64f0c0 con 0x56120e648680 2024-09-10T10:12:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.580+0000 7fecddc00640 1 --2- 172.21.15.50:0/210586077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e647d60 0x56120e6561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:57.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.581+0000 7fecd7e00640 1 --2- 172.21.15.50:0/210586077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 0x56120e654b40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fecc40097e0 tx=0x7fecc400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b75143e1955aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:57.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.581+0000 7fecc9600640 1 -- 172.21.15.50:0/210586077 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc401c420 con 0x56120e648680 2024-09-10T10:12:57.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.581+0000 7fecc9600640 1 -- 172.21.15.50:0/210586077 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecc401c5c0 con 0x56120e648680 2024-09-10T10:12:57.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.581+0000 7fecc9600640 1 -- 172.21.15.50:0/210586077 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc40053d0 con 0x56120e648680 2024-09-10T10:12:57.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.581+0000 7fece263c740 1 -- 172.21.15.50:0/210586077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 msgr2=0x56120e654b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:57.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.581+0000 7fece263c740 1 --2- 172.21.15.50:0/210586077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 0x56120e654b40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fecc40097e0 tx=0x7fecc400f790 comp rx=0 tx=0).stop 2024-09-10T10:12:57.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.581+0000 7fece263c740 1 -- 172.21.15.50:0/210586077 shutdown_connections 2024-09-10T10:12:57.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.581+0000 7fece263c740 1 --2- 172.21.15.50:0/210586077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 0x56120e66f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.581+0000 7fece263c740 1 --2- 172.21.15.50:0/210586077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e648680 0x56120e654b40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.581+0000 7fece263c740 1 --2- 172.21.15.50:0/210586077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e647d60 0x56120e6561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.581+0000 7fece263c740 1 -- 172.21.15.50:0/210586077 >> 172.21.15.50:0/210586077 conn(0x56120e6443d0 msgr2=0x56120e655ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.582+0000 7fece263c740 1 -- 172.21.15.50:0/210586077 shutdown_connections 2024-09-10T10:12:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.582+0000 7fece263c740 1 -- 172.21.15.50:0/210586077 wait complete. 2024-09-10T10:12:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.582+0000 7fece263c740 1 -- start start 2024-09-10T10:12:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.582+0000 7fece263c740 1 Processor -- start 2024-09-10T10:12:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fece263c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e647d60 0x56120e65fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fece263c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e648680 0x56120e6510b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fece263c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 0x56120e6516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fece263c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fecd81aafc0 con 0x56120e647d60 2024-09-10T10:12:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fece263c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fecd81ac430 con 0x56120e657430 2024-09-10T10:12:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fece263c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fecd81ab690 con 0x56120e648680 2024-09-10T10:12:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fece263c740 10 client.0 _ll_register_callbacks cb 0x7fecc4009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fecddc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e647d60 0x56120e65fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fecddc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e647d60 0x56120e65fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34474/0 (socket says 172.21.15.50:34474) 2024-09-10T10:12:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fecddc00640 1 -- 172.21.15.50:0/1682223733 learned_addr learned my addr 172.21.15.50:0/1682223733 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fecd7e00640 1 --2- 172.21.15.50:0/1682223733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e648680 0x56120e6510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fecddc00640 1 --2- 172.21.15.50:0/1682223733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 0x56120e6516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fecddc00640 1 -- 172.21.15.50:0/1682223733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e648680 msgr2=0x56120e6510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fecddc00640 1 --2- 172.21.15.50:0/1682223733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e648680 0x56120e6510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fecddc00640 1 -- 172.21.15.50:0/1682223733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 msgr2=0x56120e6516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fecddc00640 1 --2- 172.21.15.50:0/1682223733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 0x56120e6516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.583+0000 7fecddc00640 1 -- 172.21.15.50:0/1682223733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120e651ed0 con 0x56120e647d60 2024-09-10T10:12:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.584+0000 7fecddc00640 1 --2- 172.21.15.50:0/1682223733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e647d60 0x56120e65fc40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fecd0010ee0 tx=0x7fecd0031040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cf3d64905490bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.584+0000 7fecbea00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:12:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.584+0000 7fecbea00640 1 -- 172.21.15.50:0/1682223733 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd000fa60 con 0x56120e647d60 2024-09-10T10:12:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.584+0000 7fecbea00640 1 -- 172.21.15.50:0/1682223733 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fecd000fc00 con 0x56120e647d60 2024-09-10T10:12:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.584+0000 7fece263c740 1 -- 172.21.15.50:0/1682223733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecc401c5c0 con 0x56120e647d60 2024-09-10T10:12:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.584+0000 7fecbea00640 1 -- 172.21.15.50:0/1682223733 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fecd003e050 con 0x56120e647d60 2024-09-10T10:12:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.584+0000 7fece263c740 10 client.15519 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.584+0000 7fece263c740 1 -- 172.21.15.50:0/1682223733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56120e6d22b0 con 0x56120e647d60 2024-09-10T10:12:57.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.585+0000 7fecbea00640 1 -- 172.21.15.50:0/1682223733 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecc401c5c0 con 0x56120e647d60 2024-09-10T10:12:57.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.585+0000 7fecbea00640 1 -- 172.21.15.50:0/1682223733 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fecd0025040 con 0x56120e647d60 2024-09-10T10:12:57.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.585+0000 7fece263c740 10 client.15519 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:57.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.585+0000 7fece263c740 10 client.15519 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:12:57.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.585+0000 7fece263c740 20 client.15519 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:57.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.585+0000 7fece263c740 1 --2- 172.21.15.50:0/1682223733 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x56120e6d27f0 0x56120e6d4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:57.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.585+0000 7fece263c740 4 client.15519 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:12:57.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.585+0000 7fece263c740 1 -- 172.21.15.50:0/1682223733 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56120e532010 con 0x56120e6d27f0 2024-09-10T10:12:57.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.585+0000 7fecd7e00640 1 --2- 172.21.15.50:0/1682223733 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x56120e6d27f0 0x56120e6d4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:57.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fecd7e00640 1 --2- 172.21.15.50:0/1682223733 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x56120e6d27f0 0x56120e6d4be0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=63b8fe24fd88143b server_cookie=e4f255d9affeda59 in_seq=0 out_seq=0 2024-09-10T10:12:57.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fecbea00640 10 client.15519 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:12:57.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fecbea00640 1 -- 172.21.15.50:0/1682223733 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56120e532010 con 0x56120e6d27f0 2024-09-10T10:12:57.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fecbea00640 10 client.15519 handle_command_reply: tid=0 2024-09-10T10:12:57.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fece263c740 1 client.15519 shutdown 2024-09-10T10:12:57.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fece263c740 1 -- 172.21.15.50:0/1682223733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e647d60 msgr2=0x56120e65fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:57.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fece263c740 1 --2- 172.21.15.50:0/1682223733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e647d60 0x56120e65fc40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fecd0010ee0 tx=0x7fecd0031040 comp rx=0 tx=0).stop 2024-09-10T10:12:57.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fece263c740 1 -- 172.21.15.50:0/1682223733 shutdown_connections 2024-09-10T10:12:57.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fece263c740 1 --2- 172.21.15.50:0/1682223733 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x56120e6d27f0 0x56120e6d4be0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fece263c740 1 --2- 172.21.15.50:0/1682223733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56120e657430 0x56120e6516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fece263c740 1 --2- 172.21.15.50:0/1682223733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56120e648680 0x56120e6510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fece263c740 1 --2- 172.21.15.50:0/1682223733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56120e647d60 0x56120e65fc40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fece263c740 1 -- 172.21.15.50:0/1682223733 >> 172.21.15.50:0/1682223733 conn(0x56120e6443d0 msgr2=0x56120e643490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:57.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.586+0000 7fecbea00640 0 client.15519 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:12:57.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.587+0000 7fece263c740 1 -- 172.21.15.50:0/1682223733 shutdown_connections 2024-09-10T10:12:57.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.587+0000 7fece263c740 1 -- 172.21.15.50:0/1682223733 wait complete. 2024-09-10T10:12:57.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.587+0000 7fece263c740 20 client.15519 trim_cache size 0 max 16384 2024-09-10T10:12:57.593 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:12:57.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.587+0000 7fecde600640 1 -- 172.21.15.50:0/375036292 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fecc00a2b80 msgr2=0x7fecc00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:57.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.587+0000 7fecde600640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fecc00a2b80 0x7fecc00a5040 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feccc0c4430 tx=0x7feccc0f5530 comp rx=0 tx=0).stop 2024-09-10T10:12:57.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.587+0000 7fecde600640 1 -- 172.21.15.50:0/375036292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecd81019c0 msgr2=0x7fecd81982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:57.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.587+0000 7fecde600640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecd81019c0 0x7fecd81982b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feccc005940 tx=0x7feccc031b50 comp rx=0 tx=0).stop 2024-09-10T10:12:57.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.587+0000 7fecde600640 1 -- 172.21.15.50:0/375036292 shutdown_connections 2024-09-10T10:12:57.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.588+0000 7fecde600640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fecc00a2b80 0x7fecc00a5040 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.588+0000 7fecde600640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecd81079c0 0x7fecd819cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.588+0000 7fecde600640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fecd8102360 0x7fecd81987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.588+0000 7fecde600640 1 --2- 172.21.15.50:0/375036292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecd81019c0 0x7fecd81982b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:57.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.588+0000 7fecde600640 1 -- 172.21.15.50:0/375036292 >> 172.21.15.50:0/375036292 conn(0x7fecd80fd6e0 msgr2=0x7fecd80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:57.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.588+0000 7fecde600640 1 -- 172.21.15.50:0/375036292 shutdown_connections 2024-09-10T10:12:57.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:57.588+0000 7fecde600640 1 -- 172.21.15.50:0/375036292 wait complete. 2024-09-10T10:12:58.473 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T10:12:58.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:12:58 smithi050 ceph-mon[30354]: pgmap v444: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:12:58.855 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:12:59.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:12:58 smithi189 ceph-mon[34999]: pgmap v444: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:12:59.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:12:58 smithi084 ceph-mon[34812]: pgmap v444: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:12:59.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.446+0000 7fb7f8000640 1 -- 172.21.15.50:0/3344342895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f0077040 msgr2=0x7fb7f01124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:59.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.446+0000 7fb7f8000640 1 --2- 172.21.15.50:0/3344342895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f0077040 0x7fb7f01124f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009900 tx=0x7fb7dc02a410 comp rx=0 tx=0).stop 2024-09-10T10:12:59.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.447+0000 7fb7f8000640 1 -- 172.21.15.50:0/3344342895 shutdown_connections 2024-09-10T10:12:59.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.447+0000 7fb7f8000640 1 --2- 172.21.15.50:0/3344342895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7f0112a30 0x7fb7f0114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.447+0000 7fb7f8000640 1 --2- 172.21.15.50:0/3344342895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f0077040 0x7fb7f01124f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.447+0000 7fb7f8000640 1 --2- 172.21.15.50:0/3344342895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7f0076720 0x7fb7f0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.447+0000 7fb7f8000640 1 -- 172.21.15.50:0/3344342895 >> 172.21.15.50:0/3344342895 conn(0x7fb7f00ffa90 msgr2=0x7fb7f0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:59.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.447+0000 7fb7f8000640 1 -- 172.21.15.50:0/3344342895 shutdown_connections 2024-09-10T10:12:59.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.447+0000 7fb7f8000640 1 -- 172.21.15.50:0/3344342895 wait complete. 2024-09-10T10:12:59.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.448+0000 7fb7f8000640 1 Processor -- start 2024-09-10T10:12:59.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.448+0000 7fb7f8000640 1 -- start start 2024-09-10T10:12:59.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.448+0000 7fb7f8000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7f0076720 0x7fb7f01a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.448+0000 7fb7f8000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7f0077040 0x7fb7f01a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.448+0000 7fb7f8000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f0112a30 0x7fb7f019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.448+0000 7fb7f8000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f01185f0 con 0x7fb7f0112a30 2024-09-10T10:12:59.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.448+0000 7fb7f8000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f0118470 con 0x7fb7f0077040 2024-09-10T10:12:59.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.448+0000 7fb7f8000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f0118770 con 0x7fb7f0076720 2024-09-10T10:12:59.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.448+0000 7fb7f4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7f0077040 0x7fb7f01a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.449+0000 7fb7f6000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f0112a30 0x7fb7f019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.449+0000 7fb7f5600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7f0076720 0x7fb7f01a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.449+0000 7fb7f4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7f0077040 0x7fb7f01a4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37496/0 (socket says 172.21.15.50:37496) 2024-09-10T10:12:59.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.449+0000 7fb7f4c00640 1 -- 172.21.15.50:0/2996784737 learned_addr learned my addr 172.21.15.50:0/2996784737 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:59.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.449+0000 7fb7f4c00640 1 -- 172.21.15.50:0/2996784737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7f0076720 msgr2=0x7fb7f01a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:59.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.449+0000 7fb7f4c00640 1 --2- 172.21.15.50:0/2996784737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7f0076720 0x7fb7f01a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.449+0000 7fb7f4c00640 1 -- 172.21.15.50:0/2996784737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f0112a30 msgr2=0x7fb7f019e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:59.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.449+0000 7fb7f4c00640 1 --2- 172.21.15.50:0/2996784737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f0112a30 0x7fb7f019e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.449+0000 7fb7f4c00640 1 -- 172.21.15.50:0/2996784737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f019efd0 con 0x7fb7f0077040 2024-09-10T10:12:59.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.449+0000 7fb7f6000640 1 --2- 172.21.15.50:0/2996784737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f0112a30 0x7fb7f019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:59.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.449+0000 7fb7f4c00640 1 --2- 172.21.15.50:0/2996784737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7f0077040 0x7fb7f01a4c20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc004770 tx=0x7fb7dc003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:59.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.450+0000 7fb7ee000640 1 -- 172.21.15.50:0/2996784737 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc03f070 con 0x7fb7f0077040 2024-09-10T10:12:59.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.450+0000 7fb7f8000640 1 -- 172.21.15.50:0/2996784737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f019f260 con 0x7fb7f0077040 2024-09-10T10:12:59.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.450+0000 7fb7ee000640 1 -- 172.21.15.50:0/2996784737 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7dc031ca0 con 0x7fb7f0077040 2024-09-10T10:12:59.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.450+0000 7fb7ee000640 1 -- 172.21.15.50:0/2996784737 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc035030 con 0x7fb7f0077040 2024-09-10T10:12:59.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.450+0000 7fb7f8000640 1 -- 172.21.15.50:0/2996784737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f01ab5b0 con 0x7fb7f0077040 2024-09-10T10:12:59.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.453+0000 7fb7fac3a740 1 Processor -- start 2024-09-10T10:12:59.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.453+0000 7fb7fac3a740 1 -- start start 2024-09-10T10:12:59.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.453+0000 7fb7ee000640 1 -- 172.21.15.50:0/2996784737 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb7dc042070 con 0x7fb7f0077040 2024-09-10T10:12:59.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7fac3a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116904c70 0x55f116905050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.455 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7fac3a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f11690f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7fac3a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f11690fe50 0x55f116912240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7fac3a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f11686b3e0 con 0x55f116905590 2024-09-10T10:12:59.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7fac3a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f116812d80 con 0x55f116904c70 2024-09-10T10:12:59.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7fac3a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f1168673a0 con 0x55f11690fe50 2024-09-10T10:12:59.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7f6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116904c70 0x55f116905050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7f5600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f11690f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7f6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116904c70 0x55f116905050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37508/0 (socket says 172.21.15.50:37508) 2024-09-10T10:12:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7f6000640 1 -- 172.21.15.50:0/238221173 learned_addr learned my addr 172.21.15.50:0/238221173 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7f4c00640 1 --2- 172.21.15.50:0/238221173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f11690fe50 0x55f116912240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7f6000640 1 -- 172.21.15.50:0/238221173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f11690fe50 msgr2=0x55f116912240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7f6000640 1 --2- 172.21.15.50:0/238221173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f11690fe50 0x55f116912240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7f6000640 1 -- 172.21.15.50:0/238221173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 msgr2=0x55f11690f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7f6000640 1 --2- 172.21.15.50:0/238221173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f11690f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7f6000640 1 -- 172.21.15.50:0/238221173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f116831ae0 con 0x55f116904c70 2024-09-10T10:12:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.454+0000 7fb7f5600640 1 --2- 172.21.15.50:0/238221173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f11690f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.455+0000 7fb7f6000640 1 --2- 172.21.15.50:0/238221173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116904c70 0x55f116905050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8010740 tx=0x7fb7e8010b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c1b4bc237a8dc9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:59.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.455+0000 7fb7e2600640 1 -- 172.21.15.50:0/238221173 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e800e8d0 con 0x55f116904c70 2024-09-10T10:12:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.455+0000 7fb7e2600640 1 -- 172.21.15.50:0/238221173 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7e8012450 con 0x55f116904c70 2024-09-10T10:12:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.455+0000 7fb7e2600640 1 -- 172.21.15.50:0/238221173 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e801c670 con 0x55f116904c70 2024-09-10T10:12:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.455+0000 7fb7ee000640 1 --2- 172.21.15.50:0/2996784737 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb7d80a2b80 0x7fb7d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.455+0000 7fb7ee000640 1 -- 172.21.15.50:0/2996784737 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb7dc0efba0 con 0x7fb7f0077040 2024-09-10T10:12:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.456+0000 7fb7f5600640 1 --2- 172.21.15.50:0/2996784737 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb7d80a2b80 0x7fb7d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.456+0000 7fb7fac3a740 1 -- 172.21.15.50:0/238221173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116904c70 msgr2=0x55f116905050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.456+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/238221173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116904c70 0x55f116905050 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8010740 tx=0x7fb7e8010b40 comp rx=0 tx=0).stop 2024-09-10T10:12:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.456+0000 7fb7fac3a740 1 -- 172.21.15.50:0/238221173 shutdown_connections 2024-09-10T10:12:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.456+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/238221173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f11690fe50 0x55f116912240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.456+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/238221173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f11690f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.456+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/238221173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116904c70 0x55f116905050 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.456+0000 7fb7fac3a740 1 -- 172.21.15.50:0/238221173 >> 172.21.15.50:0/238221173 conn(0x55f116901200 msgr2=0x55f1169015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:59.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.456+0000 7fb7fac3a740 1 -- 172.21.15.50:0/238221173 shutdown_connections 2024-09-10T10:12:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.456+0000 7fb7fac3a740 1 -- 172.21.15.50:0/238221173 wait complete. 2024-09-10T10:12:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.456+0000 7fb7f5600640 1 --2- 172.21.15.50:0/2996784737 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb7d80a2b80 0x7fb7d80a5040 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55f116902060 tx=0x7fb7e400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.457+0000 7fb7fac3a740 1 -- start start 2024-09-10T10:12:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.457+0000 7fb7fac3a740 1 Processor -- start 2024-09-10T10:12:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.457+0000 7fb7fac3a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f116904c70 0x55f11690cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.457+0000 7fb7fac3a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116905590 0x55f11690d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.457+0000 7fb7fac3a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f11690fe50 0x55f11690d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.457+0000 7fb7fac3a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f116912a20 con 0x55f11690fe50 2024-09-10T10:12:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.457+0000 7fb7fac3a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f1168260f0 con 0x55f116905590 2024-09-10T10:12:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.457+0000 7fb7fac3a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f116912ba0 con 0x55f116904c70 2024-09-10T10:12:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.458+0000 7fb7fac3a740 10 client.0 _ll_register_callbacks cb 0x55f11680dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.458+0000 7fb7f6000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f11690fe50 0x55f11690d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.458+0000 7fb7f4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116905590 0x55f11690d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.458+0000 7fb7f6000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f11690fe50 0x55f11690d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34524/0 (socket says 172.21.15.50:34524) 2024-09-10T10:12:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.458+0000 7fb7f5600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f116904c70 0x55f11690cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.458+0000 7fb7f4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116905590 0x55f11690d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37510/0 (socket says 172.21.15.50:37510) 2024-09-10T10:12:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.458+0000 7fb7f6000640 1 -- 172.21.15.50:0/3580141089 learned_addr learned my addr 172.21.15.50:0/3580141089 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.458+0000 7fb7f6000640 1 -- 172.21.15.50:0/3580141089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f116904c70 msgr2=0x55f11690cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.458+0000 7fb7f6000640 1 --2- 172.21.15.50:0/3580141089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f116904c70 0x55f11690cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.458+0000 7fb7f6000640 1 -- 172.21.15.50:0/3580141089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116905590 msgr2=0x55f11690d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.458+0000 7fb7f6000640 1 --2- 172.21.15.50:0/3580141089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116905590 0x55f11690d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.458+0000 7fb7f6000640 1 -- 172.21.15.50:0/3580141089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1165dc3c0 con 0x55f11690fe50 2024-09-10T10:12:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.458+0000 7fb7f4c00640 1 --2- 172.21.15.50:0/3580141089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116905590 0x55f11690d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.459+0000 7fb7f6000640 1 --2- 172.21.15.50:0/3580141089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f11690fe50 0x55f11690d7c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8010fc0 tx=0x7fb7e8012c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1f49a137bc6184 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:59.464 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.459+0000 7fb7d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:12:59.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.459+0000 7fb7d6a00640 1 -- 172.21.15.50:0/3580141089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8004c50 con 0x55f11690fe50 2024-09-10T10:12:59.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.459+0000 7fb7d6a00640 1 -- 172.21.15.50:0/3580141089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb7e8004df0 con 0x55f11690fe50 2024-09-10T10:12:59.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.459+0000 7fb7fac3a740 1 -- 172.21.15.50:0/3580141089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7e8012450 con 0x55f11690fe50 2024-09-10T10:12:59.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.459+0000 7fb7d6a00640 1 -- 172.21.15.50:0/3580141089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb7e800e870 con 0x55f11690fe50 2024-09-10T10:12:59.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.459+0000 7fb7fac3a740 10 client.15531 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:59.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.459+0000 7fb7fac3a740 1 -- 172.21.15.50:0/3580141089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f11691ea60 con 0x55f11690fe50 2024-09-10T10:12:59.465 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.460+0000 7fb7d6a00640 1 -- 172.21.15.50:0/3580141089 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7e8012450 con 0x55f11690fe50 2024-09-10T10:12:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.460+0000 7fb7d6a00640 1 -- 172.21.15.50:0/3580141089 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb7e800f040 con 0x55f11690fe50 2024-09-10T10:12:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.460+0000 7fb7fac3a740 10 client.15531 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.460+0000 7fb7fac3a740 10 client.15531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:12:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.460+0000 7fb7fac3a740 20 client.15531 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.460+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/3580141089 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f11691ff20 0x55f116922310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.460+0000 7fb7fac3a740 4 client.15531 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:12:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.460+0000 7fb7fac3a740 1 -- 172.21.15.50:0/3580141089 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f116878950 con 0x55f11691ff20 2024-09-10T10:12:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.460+0000 7fb7f5600640 1 --2- 172.21.15.50:0/3580141089 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f11691ff20 0x55f116922310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.461+0000 7fb7f5600640 1 --2- 172.21.15.50:0/3580141089 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f11691ff20 0x55f116922310 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c08171db62b15041 server_cookie=b95c2d5f3fdfc76e in_seq=0 out_seq=0 2024-09-10T10:12:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.461+0000 7fb7d6a00640 10 client.15531 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:59.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7d6a00640 1 -- 172.21.15.50:0/3580141089 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f116878950 con 0x55f11691ff20 2024-09-10T10:12:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7d6a00640 10 client.15531 handle_command_reply: tid=0 2024-09-10T10:12:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7fac3a740 1 client.15531 shutdown 2024-09-10T10:12:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7fac3a740 1 -- 172.21.15.50:0/3580141089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f11690fe50 msgr2=0x55f11690d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/3580141089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f11690fe50 0x55f11690d7c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8010fc0 tx=0x7fb7e8012c50 comp rx=0 tx=0).stop 2024-09-10T10:12:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7fac3a740 1 -- 172.21.15.50:0/3580141089 shutdown_connections 2024-09-10T10:12:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/3580141089 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f11691ff20 0x55f116922310 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/3580141089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f11690fe50 0x55f11690d7c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/3580141089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116905590 0x55f11690d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/3580141089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f116904c70 0x55f11690cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7fac3a740 1 -- 172.21.15.50:0/3580141089 >> 172.21.15.50:0/3580141089 conn(0x55f116901200 msgr2=0x55f116900380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7d6a00640 0 client.15531 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7fac3a740 1 -- 172.21.15.50:0/3580141089 shutdown_connections 2024-09-10T10:12:59.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7fac3a740 1 -- 172.21.15.50:0/3580141089 wait complete. 2024-09-10T10:12:59.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.462+0000 7fb7fac3a740 20 client.15531 trim_cache size 0 max 16384 2024-09-10T10:12:59.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.476+0000 7fb7fac3a740 1 Processor -- start 2024-09-10T10:12:59.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.476+0000 7fb7fac3a740 1 -- start start 2024-09-10T10:12:59.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.477+0000 7fb7fac3a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116904c70 0x55f11690bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.477+0000 7fb7fac3a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f116927a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.477+0000 7fb7fac3a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f11690fe50 0x55f116927f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.477+0000 7fb7fac3a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f01b7c10 con 0x55f116905590 2024-09-10T10:12:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.477+0000 7fb7fac3a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f01b54e0 con 0x55f116904c70 2024-09-10T10:12:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.477+0000 7fb7fac3a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f01b3330 con 0x55f11690fe50 2024-09-10T10:12:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.477+0000 7fb7f6000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f11690fe50 0x55f116927f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.477+0000 7fb7f4c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f116927a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.477+0000 7fb7f6000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f11690fe50 0x55f116927f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:44040/0 (socket says 172.21.15.50:44040) 2024-09-10T10:12:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.477+0000 7fb7f6000640 1 -- 172.21.15.50:0/1649879211 learned_addr learned my addr 172.21.15.50:0/1649879211 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.477+0000 7fb7f5600640 1 --2- 172.21.15.50:0/1649879211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116904c70 0x55f11690bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.477+0000 7fb7f6000640 1 -- 172.21.15.50:0/1649879211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116904c70 msgr2=0x55f11690bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:59.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.477+0000 7fb7f6000640 1 --2- 172.21.15.50:0/1649879211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116904c70 0x55f11690bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.478+0000 7fb7f6000640 1 -- 172.21.15.50:0/1649879211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 msgr2=0x55f116927a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:59.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.478+0000 7fb7f6000640 1 --2- 172.21.15.50:0/1649879211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f116927a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.478+0000 7fb7f6000640 1 -- 172.21.15.50:0/1649879211 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1168fc770 con 0x55f11690fe50 2024-09-10T10:12:59.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.478+0000 7fb7f6000640 1 --2- 172.21.15.50:0/1649879211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f11690fe50 0x55f116927f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8000f80 tx=0x7fb7e8009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdb3104a171bf6e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:59.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.478+0000 7fb7e1c00640 1 -- 172.21.15.50:0/1649879211 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8012450 con 0x55f11690fe50 2024-09-10T10:12:59.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.478+0000 7fb7e1c00640 1 -- 172.21.15.50:0/1649879211 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7e8026420 con 0x55f11690fe50 2024-09-10T10:12:59.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.478+0000 7fb7e1c00640 1 -- 172.21.15.50:0/1649879211 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8026b60 con 0x55f11690fe50 2024-09-10T10:12:59.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.479+0000 7fb7fac3a740 1 -- 172.21.15.50:0/1649879211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f11690fe50 msgr2=0x55f116927f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.479+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/1649879211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f11690fe50 0x55f116927f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8000f80 tx=0x7fb7e8009600 comp rx=0 tx=0).stop 2024-09-10T10:12:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.479+0000 7fb7fac3a740 1 -- 172.21.15.50:0/1649879211 shutdown_connections 2024-09-10T10:12:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.479+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/1649879211 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f11690fe50 0x55f116927f90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.479+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/1649879211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f116927a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.479+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/1649879211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f116904c70 0x55f11690bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.479+0000 7fb7fac3a740 1 -- 172.21.15.50:0/1649879211 >> 172.21.15.50:0/1649879211 conn(0x55f116901200 msgr2=0x55f11690b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.479+0000 7fb7fac3a740 1 -- 172.21.15.50:0/1649879211 shutdown_connections 2024-09-10T10:12:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.479+0000 7fb7fac3a740 1 -- 172.21.15.50:0/1649879211 wait complete. 2024-09-10T10:12:59.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.480+0000 7fb7fac3a740 1 -- start start 2024-09-10T10:12:59.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.480+0000 7fb7fac3a740 1 Processor -- start 2024-09-10T10:12:59.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.481+0000 7fb7fac3a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f116904c70 0x55f116918160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.481+0000 7fb7fac3a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f1169186a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.481+0000 7fb7fac3a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11690fe50 0x55f1169136e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.481+0000 7fb7fac3a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f01b39a0 con 0x55f116905590 2024-09-10T10:12:59.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.481+0000 7fb7fac3a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f01b4e10 con 0x55f11690fe50 2024-09-10T10:12:59.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.481+0000 7fb7fac3a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f01b4070 con 0x55f116904c70 2024-09-10T10:12:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.481+0000 7fb7fac3a740 10 client.0 _ll_register_callbacks cb 0x7fb7e8016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:12:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.481+0000 7fb7f4c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f1169186a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.481+0000 7fb7f4c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f1169186a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34556/0 (socket says 172.21.15.50:34556) 2024-09-10T10:12:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.481+0000 7fb7f4c00640 1 -- 172.21.15.50:0/546510951 learned_addr learned my addr 172.21.15.50:0/546510951 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:12:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.481+0000 7fb7f5600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f116904c70 0x55f116918160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.481+0000 7fb7f6000640 1 --2- 172.21.15.50:0/546510951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11690fe50 0x55f1169136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.482+0000 7fb7f5600640 1 -- 172.21.15.50:0/546510951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11690fe50 msgr2=0x55f1169136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.482+0000 7fb7f5600640 1 --2- 172.21.15.50:0/546510951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11690fe50 0x55f1169136e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.482+0000 7fb7f5600640 1 -- 172.21.15.50:0/546510951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 msgr2=0x55f1169186a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:12:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.482+0000 7fb7f5600640 1 --2- 172.21.15.50:0/546510951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f1169186a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.482+0000 7fb7f5600640 1 -- 172.21.15.50:0/546510951 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f11690dd10 con 0x55f116904c70 2024-09-10T10:12:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.482+0000 7fb7f4c00640 1 --2- 172.21.15.50:0/546510951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f1169186a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:12:59.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.482+0000 7fb7f5600640 1 --2- 172.21.15.50:0/546510951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f116904c70 0x55f116918160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55f1169229c0 tx=0x7fb7e40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f2332bd83250b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:12:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.482+0000 7fb7d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:12:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.482+0000 7fb7d6a00640 1 -- 172.21.15.50:0/546510951 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e401ecf0 con 0x55f116904c70 2024-09-10T10:12:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.482+0000 7fb7fac3a740 1 -- 172.21.15.50:0/546510951 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7e8026420 con 0x55f116904c70 2024-09-10T10:12:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.482+0000 7fb7d6a00640 1 -- 172.21.15.50:0/546510951 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb7e402a380 con 0x55f116904c70 2024-09-10T10:12:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.483+0000 7fb7d6a00640 1 -- 172.21.15.50:0/546510951 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb7e403c050 con 0x55f116904c70 2024-09-10T10:12:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.483+0000 7fb7fac3a740 10 client.25561 fetch_fsmap learned FSMap version 25 2024-09-10T10:12:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.483+0000 7fb7fac3a740 1 -- 172.21.15.50:0/546510951 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f116907a90 con 0x55f116904c70 2024-09-10T10:12:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.483+0000 7fb7d6a00640 1 -- 172.21.15.50:0/546510951 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7e8026420 con 0x55f116904c70 2024-09-10T10:12:59.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.483+0000 7fb7d6a00640 1 -- 172.21.15.50:0/546510951 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb7e40107a0 con 0x55f116904c70 2024-09-10T10:12:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.483+0000 7fb7fac3a740 10 client.25561 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:12:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.483+0000 7fb7fac3a740 10 client.25561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:12:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.483+0000 7fb7fac3a740 20 client.25561 populate_metadata read hostname 'smithi050' 2024-09-10T10:12:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.483+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/546510951 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f11698a9e0 0x55f11698ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:12:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.483+0000 7fb7fac3a740 4 client.25561 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:12:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.483+0000 7fb7fac3a740 1 -- 172.21.15.50:0/546510951 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f116872e60 con 0x55f11698a9e0 2024-09-10T10:12:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.483+0000 7fb7f4c00640 1 --2- 172.21.15.50:0/546510951 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f11698a9e0 0x55f11698ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:12:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7f4c00640 1 --2- 172.21.15.50:0/546510951 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f11698a9e0 0x55f11698ce00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d17175de1a20137f server_cookie=9bd0f17575f757d6 in_seq=0 out_seq=0 2024-09-10T10:12:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7d6a00640 10 client.25561 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7d6a00640 1 -- 172.21.15.50:0/546510951 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f116872e60 con 0x55f11698a9e0 2024-09-10T10:12:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7d6a00640 10 client.25561 handle_command_reply: tid=0 2024-09-10T10:12:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7fac3a740 1 client.25561 shutdown 2024-09-10T10:12:59.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7fac3a740 1 -- 172.21.15.50:0/546510951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f116904c70 msgr2=0x55f116918160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/546510951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f116904c70 0x55f116918160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55f1169229c0 tx=0x7fb7e40046c0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7fac3a740 1 -- 172.21.15.50:0/546510951 shutdown_connections 2024-09-10T10:12:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/546510951 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f11698a9e0 0x55f11698ce00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/546510951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11690fe50 0x55f1169136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/546510951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f116905590 0x55f1169186a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7d6a00640 0 client.25561 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:12:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7fac3a740 1 --2- 172.21.15.50:0/546510951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f116904c70 0x55f116918160 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.484+0000 7fb7fac3a740 1 -- 172.21.15.50:0/546510951 >> 172.21.15.50:0/546510951 conn(0x55f116901200 msgr2=0x55f11690be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:59.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.485+0000 7fb7fac3a740 1 -- 172.21.15.50:0/546510951 shutdown_connections 2024-09-10T10:12:59.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.485+0000 7fb7fac3a740 1 -- 172.21.15.50:0/546510951 wait complete. 2024-09-10T10:12:59.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.485+0000 7fb7fac3a740 20 client.25561 trim_cache size 0 max 16384 2024-09-10T10:12:59.492 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:12:59.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.485+0000 7fb7f8000640 1 -- 172.21.15.50:0/2996784737 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb7d80a2b80 msgr2=0x7fb7d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.485+0000 7fb7f8000640 1 --2- 172.21.15.50:0/2996784737 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb7d80a2b80 0x7fb7d80a5040 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55f116902060 tx=0x7fb7e400b410 comp rx=0 tx=0).stop 2024-09-10T10:12:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.485+0000 7fb7f8000640 1 -- 172.21.15.50:0/2996784737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7f0077040 msgr2=0x7fb7f01a4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:12:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.485+0000 7fb7f8000640 1 --2- 172.21.15.50:0/2996784737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7f0077040 0x7fb7f01a4c20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc004770 tx=0x7fb7dc003c10 comp rx=0 tx=0).stop 2024-09-10T10:12:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.486+0000 7fb7f8000640 1 -- 172.21.15.50:0/2996784737 shutdown_connections 2024-09-10T10:12:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.486+0000 7fb7f8000640 1 --2- 172.21.15.50:0/2996784737 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb7d80a2b80 0x7fb7d80a5040 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.486+0000 7fb7f8000640 1 --2- 172.21.15.50:0/2996784737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7f0112a30 0x7fb7f019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.486+0000 7fb7f8000640 1 --2- 172.21.15.50:0/2996784737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7f0077040 0x7fb7f01a4c20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.486+0000 7fb7f8000640 1 --2- 172.21.15.50:0/2996784737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb7f0076720 0x7fb7f01a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:12:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.486+0000 7fb7f8000640 1 -- 172.21.15.50:0/2996784737 >> 172.21.15.50:0/2996784737 conn(0x7fb7f00ffa90 msgr2=0x7fb7f0101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:12:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.486+0000 7fb7f8000640 1 -- 172.21.15.50:0/2996784737 shutdown_connections 2024-09-10T10:12:59.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:12:59.486+0000 7fb7f8000640 1 -- 172.21.15.50:0/2996784737 wait complete. 2024-09-10T10:13:00.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:00 smithi050 ceph-mon[30354]: pgmap v445: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:13:01.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:00 smithi189 ceph-mon[34999]: pgmap v445: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:13:01.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:00 smithi084 ceph-mon[34812]: pgmap v445: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:13:01.183 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T10:13:01.184 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T10:13:01.573 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:02.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.146+0000 7fb72e000640 1 -- 172.21.15.50:0/4170349195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb728103ff0 msgr2=0x7fb7281043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:02.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.146+0000 7fb72e000640 1 --2- 172.21.15.50:0/4170349195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb728103ff0 0x7fb7281043d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb718009900 tx=0x7fb71802a410 comp rx=0 tx=0).stop 2024-09-10T10:13:02.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.146+0000 7fb72e000640 1 -- 172.21.15.50:0/4170349195 shutdown_connections 2024-09-10T10:13:02.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.146+0000 7fb72e000640 1 --2- 172.21.15.50:0/4170349195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb728109120 0x7fb728110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.146+0000 7fb72e000640 1 --2- 172.21.15.50:0/4170349195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7281049a0 0x7fb7281089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.146+0000 7fb72e000640 1 --2- 172.21.15.50:0/4170349195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb728103ff0 0x7fb7281043d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.146+0000 7fb72e000640 1 -- 172.21.15.50:0/4170349195 >> 172.21.15.50:0/4170349195 conn(0x7fb7280ffa90 msgr2=0x7fb728101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.146+0000 7fb72e000640 1 -- 172.21.15.50:0/4170349195 shutdown_connections 2024-09-10T10:13:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.146+0000 7fb72e000640 1 -- 172.21.15.50:0/4170349195 wait complete. 2024-09-10T10:13:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.147+0000 7fb72e000640 1 Processor -- start 2024-09-10T10:13:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.147+0000 7fb72e000640 1 -- start start 2024-09-10T10:13:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.148+0000 7fb72e000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb728103ff0 0x7fb72819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.148+0000 7fb72e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7281049a0 0x7fb72819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.148+0000 7fb72e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb728109120 0x7fb72819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.148+0000 7fb72e000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb728114170 con 0x7fb728109120 2024-09-10T10:13:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.148+0000 7fb72e000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb728113ff0 con 0x7fb7281049a0 2024-09-10T10:13:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.148+0000 7fb72e000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7281142f0 con 0x7fb728103ff0 2024-09-10T10:13:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.148+0000 7fb727e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb728109120 0x7fb72819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.148+0000 7fb727e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb728109120 0x7fb72819ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34570/0 (socket says 172.21.15.50:34570) 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.148+0000 7fb727e00640 1 -- 172.21.15.50:0/4052208202 learned_addr learned my addr 172.21.15.50:0/4052208202 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.148+0000 7fb727400640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb728103ff0 0x7fb72819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.148+0000 7fb726a00640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7281049a0 0x7fb72819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.149+0000 7fb727e00640 1 -- 172.21.15.50:0/4052208202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb728103ff0 msgr2=0x7fb72819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.149+0000 7fb727e00640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb728103ff0 0x7fb72819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.149+0000 7fb727e00640 1 -- 172.21.15.50:0/4052208202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7281049a0 msgr2=0x7fb72819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.149+0000 7fb727e00640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7281049a0 0x7fb72819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.149+0000 7fb727e00640 1 -- 172.21.15.50:0/4052208202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72819f560 con 0x7fb728109120 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.149+0000 7fb727e00640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb728109120 0x7fb72819ee80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb72000cce0 tx=0x7fb72000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.149+0000 7fb71fe00640 1 -- 172.21.15.50:0/4052208202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72000f450 con 0x7fb728109120 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.149+0000 7fb71fe00640 1 -- 172.21.15.50:0/4052208202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb72000fad0 con 0x7fb728109120 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.149+0000 7fb71fe00640 1 -- 172.21.15.50:0/4052208202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720018c10 con 0x7fb728109120 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.149+0000 7fb72e000640 1 -- 172.21.15.50:0/4052208202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72819f850 con 0x7fb728109120 2024-09-10T10:13:02.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.150+0000 7fb72e000640 1 -- 172.21.15.50:0/4052208202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7281a7130 con 0x7fb728109120 2024-09-10T10:13:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.153+0000 7fb730a87740 1 Processor -- start 2024-09-10T10:13:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.153+0000 7fb71fe00640 1 -- 172.21.15.50:0/4052208202 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb72000f5f0 con 0x7fb728109120 2024-09-10T10:13:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.153+0000 7fb730a87740 1 -- start start 2024-09-10T10:13:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.153+0000 7fb730a87740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 0x557ae96d8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.153+0000 7fb730a87740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d93e0 0x557ae96e3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.153+0000 7fb730a87740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96e6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.153+0000 7fb730a87740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557ae963f290 con 0x557ae96e3ca0 2024-09-10T10:13:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.153+0000 7fb730a87740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557ae95e6b40 con 0x557ae96d8ac0 2024-09-10T10:13:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.153+0000 7fb730a87740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557ae963b250 con 0x557ae96d93e0 2024-09-10T10:13:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.154+0000 7fb726a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 0x557ae96d8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.154+0000 7fb726a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 0x557ae96d8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37576/0 (socket says 172.21.15.50:37576) 2024-09-10T10:13:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.154+0000 7fb726a00640 1 -- 172.21.15.50:0/1569819011 learned_addr learned my addr 172.21.15.50:0/1569819011 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.154+0000 7fb727400640 1 --2- 172.21.15.50:0/1569819011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d93e0 0x557ae96e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.154+0000 7fb726a00640 1 --2- 172.21.15.50:0/1569819011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.154+0000 7fb726a00640 1 -- 172.21.15.50:0/1569819011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d93e0 msgr2=0x557ae96e3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.154+0000 7fb726a00640 1 --2- 172.21.15.50:0/1569819011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d93e0 0x557ae96e3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.154+0000 7fb726a00640 1 -- 172.21.15.50:0/1569819011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 msgr2=0x557ae96e6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.154+0000 7fb726a00640 1 --2- 172.21.15.50:0/1569819011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96e6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.154+0000 7fb726a00640 1 -- 172.21.15.50:0/1569819011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ae93b06a0 con 0x557ae96d8ac0 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.154+0000 7fb726a00640 1 --2- 172.21.15.50:0/1569819011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 0x557ae96d8ea0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb714009fd0 tx=0x7fb714005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a82948f13c452258 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.155+0000 7fb71fe00640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb70c0a2b80 0x7fb70c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.155+0000 7fb71fe00640 1 -- 172.21.15.50:0/4052208202 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb7200cf9b0 con 0x7fb728109120 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.155+0000 7fb713e00640 1 -- 172.21.15.50:0/1569819011 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714004030 con 0x557ae96d8ac0 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.155+0000 7fb727400640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb70c0a2b80 0x7fb70c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.155+0000 7fb713e00640 1 -- 172.21.15.50:0/1569819011 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb714005500 con 0x557ae96d8ac0 2024-09-10T10:13:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.155+0000 7fb713e00640 1 -- 172.21.15.50:0/1569819011 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714004de0 con 0x557ae96d8ac0 2024-09-10T10:13:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.156+0000 7fb730a87740 1 -- 172.21.15.50:0/1569819011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 msgr2=0x557ae96d8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.156+0000 7fb727400640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb70c0a2b80 0x7fb70c0a5040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb718000c00 tx=0x7fb718009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.156+0000 7fb730a87740 1 --2- 172.21.15.50:0/1569819011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 0x557ae96d8ea0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb714009fd0 tx=0x7fb714005850 comp rx=0 tx=0).stop 2024-09-10T10:13:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.156+0000 7fb730a87740 1 -- 172.21.15.50:0/1569819011 shutdown_connections 2024-09-10T10:13:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.156+0000 7fb730a87740 1 --2- 172.21.15.50:0/1569819011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.156+0000 7fb730a87740 1 --2- 172.21.15.50:0/1569819011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d93e0 0x557ae96e3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.156+0000 7fb730a87740 1 --2- 172.21.15.50:0/1569819011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 0x557ae96d8ea0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.156+0000 7fb730a87740 1 -- 172.21.15.50:0/1569819011 >> 172.21.15.50:0/1569819011 conn(0x557ae96d5050 msgr2=0x557ae96d5430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.156+0000 7fb730a87740 1 -- 172.21.15.50:0/1569819011 shutdown_connections 2024-09-10T10:13:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.156+0000 7fb730a87740 1 -- 172.21.15.50:0/1569819011 wait complete. 2024-09-10T10:13:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.156+0000 7fb730a87740 1 -- start start 2024-09-10T10:13:02.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.157+0000 7fb730a87740 1 Processor -- start 2024-09-10T10:13:02.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.157+0000 7fb730a87740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 0x557ae96e3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.157+0000 7fb730a87740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d93e0 0x557ae96e0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.157+0000 7fb730a87740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96e0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.157+0000 7fb730a87740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557ae96e6910 con 0x557ae96e3ca0 2024-09-10T10:13:02.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.157+0000 7fb730a87740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557ae95f9fa0 con 0x557ae96d8ac0 2024-09-10T10:13:02.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.157+0000 7fb730a87740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557ae96e6a90 con 0x557ae96d93e0 2024-09-10T10:13:02.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.157+0000 7fb730a87740 10 client.0 _ll_register_callbacks cb 0x557ae934dba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:02.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb727e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96e0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb727400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 0x557ae96e3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb727400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 0x557ae96e3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37590/0 (socket says 172.21.15.50:37590) 2024-09-10T10:13:02.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb727400640 1 -- 172.21.15.50:0/82657055 learned_addr learned my addr 172.21.15.50:0/82657055 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:02.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb726a00640 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d93e0 0x557ae96e0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb727400640 1 -- 172.21.15.50:0/82657055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d93e0 msgr2=0x557ae96e0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:02.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb727400640 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d93e0 0x557ae96e0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb727400640 1 -- 172.21.15.50:0/82657055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 msgr2=0x557ae96e0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:02.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb727400640 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96e0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb727400640 1 -- 172.21.15.50:0/82657055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ae96e1710 con 0x557ae96d8ac0 2024-09-10T10:13:02.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb727e00640 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96e0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:02.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb726a00640 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d93e0 0x557ae96e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:02.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb727400640 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 0x557ae96e3670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb718009900 tx=0x7fb718009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=807ed17609da3d75 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.158+0000 7fb710c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.159+0000 7fb710c00640 1 -- 172.21.15.50:0/82657055 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71804e070 con 0x557ae96d8ac0 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.159+0000 7fb730a87740 1 -- 172.21.15.50:0/82657055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb714005500 con 0x557ae96d8ac0 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.159+0000 7fb710c00640 1 -- 172.21.15.50:0/82657055 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb718004b30 con 0x557ae96d8ac0 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.159+0000 7fb710c00640 1 -- 172.21.15.50:0/82657055 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb71805a050 con 0x557ae96d8ac0 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.159+0000 7fb730a87740 10 client.25601 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.159+0000 7fb730a87740 1 -- 172.21.15.50:0/82657055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557ae96f28f0 con 0x557ae96d8ac0 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.159+0000 7fb710c00640 1 -- 172.21.15.50:0/82657055 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb714005500 con 0x557ae96d8ac0 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.159+0000 7fb710c00640 1 -- 172.21.15.50:0/82657055 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb7180035f0 con 0x557ae96d8ac0 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.160+0000 7fb730a87740 10 client.25601 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.160+0000 7fb730a87740 10 client.25601 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.160+0000 7fb730a87740 20 client.25601 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.160+0000 7fb730a87740 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557ae96f3d50 0x557ae96f6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.160+0000 7fb730a87740 4 client.25601 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:02.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.160+0000 7fb730a87740 1 -- 172.21.15.50:0/82657055 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ae964c800 con 0x557ae96f3d50 2024-09-10T10:13:02.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.160+0000 7fb726a00640 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557ae96f3d50 0x557ae96f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.161+0000 7fb726a00640 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557ae96f3d50 0x557ae96f6190 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ef1aab93c38b7ed server_cookie=299547cd68e597db in_seq=0 out_seq=0 2024-09-10T10:13:02.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.161+0000 7fb710c00640 10 client.25601 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:02.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.161+0000 7fb710c00640 1 -- 172.21.15.50:0/82657055 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ae964c800 con 0x557ae96f3d50 2024-09-10T10:13:02.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.161+0000 7fb710c00640 10 client.25601 handle_command_reply: tid=0 2024-09-10T10:13:02.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.161+0000 7fb730a87740 1 client.25601 shutdown 2024-09-10T10:13:02.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.162+0000 7fb730a87740 1 -- 172.21.15.50:0/82657055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 msgr2=0x557ae96e3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:02.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.162+0000 7fb730a87740 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 0x557ae96e3670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb718009900 tx=0x7fb718009260 comp rx=0 tx=0).stop 2024-09-10T10:13:02.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.162+0000 7fb730a87740 1 -- 172.21.15.50:0/82657055 shutdown_connections 2024-09-10T10:13:02.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.162+0000 7fb730a87740 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557ae96f3d50 0x557ae96f6190 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.162+0000 7fb730a87740 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96e0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.162+0000 7fb730a87740 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d93e0 0x557ae96e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.162+0000 7fb730a87740 1 --2- 172.21.15.50:0/82657055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d8ac0 0x557ae96e3670 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.162+0000 7fb710c00640 0 client.25601 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:02.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.162+0000 7fb730a87740 1 -- 172.21.15.50:0/82657055 >> 172.21.15.50:0/82657055 conn(0x557ae96d5050 msgr2=0x557ae96dad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:02.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.162+0000 7fb730a87740 1 -- 172.21.15.50:0/82657055 shutdown_connections 2024-09-10T10:13:02.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.162+0000 7fb730a87740 1 -- 172.21.15.50:0/82657055 wait complete. 2024-09-10T10:13:02.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.162+0000 7fb730a87740 20 client.25601 trim_cache size 0 max 16384 2024-09-10T10:13:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.180+0000 7fb730a87740 1 Processor -- start 2024-09-10T10:13:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.180+0000 7fb730a87740 1 -- start start 2024-09-10T10:13:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb730a87740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d8ac0 0x557ae96e2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb730a87740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d93e0 0x557ae96fba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb730a87740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96fbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb730a87740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb7281b3690 con 0x557ae96e3ca0 2024-09-10T10:13:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb730a87740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb7281b0f60 con 0x557ae96d93e0 2024-09-10T10:13:02.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb730a87740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7281aedb0 con 0x557ae96d8ac0 2024-09-10T10:13:02.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb727e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96fbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb727400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d8ac0 0x557ae96e2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb727400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d8ac0 0x557ae96e2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:44080/0 (socket says 172.21.15.50:44080) 2024-09-10T10:13:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb727400640 1 -- 172.21.15.50:0/1392368936 learned_addr learned my addr 172.21.15.50:0/1392368936 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb727e00640 1 --2- 172.21.15.50:0/1392368936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96fbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34594/0 (socket says 172.21.15.50:34594) 2024-09-10T10:13:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb726a00640 1 --2- 172.21.15.50:0/1392368936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d93e0 0x557ae96fba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb727400640 1 -- 172.21.15.50:0/1392368936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d93e0 msgr2=0x557ae96fba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb727400640 1 --2- 172.21.15.50:0/1392368936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d93e0 0x557ae96fba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb727400640 1 -- 172.21.15.50:0/1392368936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 msgr2=0x557ae96fbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.181+0000 7fb727400640 1 --2- 172.21.15.50:0/1392368936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96fbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.182+0000 7fb727400640 1 -- 172.21.15.50:0/1392368936 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ae96df8d0 con 0x557ae96d8ac0 2024-09-10T10:13:02.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.182+0000 7fb727400640 1 --2- 172.21.15.50:0/1392368936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d8ac0 0x557ae96e2890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb7180039c0 tx=0x7fb7180044a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5db75127e5baa4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.182+0000 7fb713400640 1 -- 172.21.15.50:0/1392368936 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71804e070 con 0x557ae96d8ac0 2024-09-10T10:13:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.182+0000 7fb713400640 1 -- 172.21.15.50:0/1392368936 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb718063070 con 0x557ae96d8ac0 2024-09-10T10:13:02.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.182+0000 7fb713400640 1 -- 172.21.15.50:0/1392368936 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718035040 con 0x557ae96d8ac0 2024-09-10T10:13:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.183+0000 7fb730a87740 1 -- 172.21.15.50:0/1392368936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d8ac0 msgr2=0x557ae96e2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.183+0000 7fb730a87740 1 --2- 172.21.15.50:0/1392368936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d8ac0 0x557ae96e2890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb7180039c0 tx=0x7fb7180044a0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.183+0000 7fb730a87740 1 -- 172.21.15.50:0/1392368936 shutdown_connections 2024-09-10T10:13:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.183+0000 7fb730a87740 1 --2- 172.21.15.50:0/1392368936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96e3ca0 0x557ae96fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.183+0000 7fb730a87740 1 --2- 172.21.15.50:0/1392368936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d93e0 0x557ae96fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.183+0000 7fb730a87740 1 --2- 172.21.15.50:0/1392368936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96d8ac0 0x557ae96e2890 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.183+0000 7fb730a87740 1 -- 172.21.15.50:0/1392368936 >> 172.21.15.50:0/1392368936 conn(0x557ae96d5050 msgr2=0x557ae96e2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.183+0000 7fb730a87740 1 -- 172.21.15.50:0/1392368936 shutdown_connections 2024-09-10T10:13:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.183+0000 7fb730a87740 1 -- 172.21.15.50:0/1392368936 wait complete. 2024-09-10T10:13:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.184+0000 7fb730a87740 1 -- start start 2024-09-10T10:13:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.184+0000 7fb730a87740 1 Processor -- start 2024-09-10T10:13:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.184+0000 7fb730a87740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96d8ac0 0x557ae96ec370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.184+0000 7fb730a87740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d93e0 0x557ae96e9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.184+0000 7fb730a87740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96e3ca0 0x557ae96e9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.184+0000 7fb730a87740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb7281af420 con 0x557ae96d8ac0 2024-09-10T10:13:02.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.184+0000 7fb730a87740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb7281b0890 con 0x557ae96d93e0 2024-09-10T10:13:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.184+0000 7fb730a87740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7281afaf0 con 0x557ae96e3ca0 2024-09-10T10:13:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.184+0000 7fb730a87740 10 client.0 _ll_register_callbacks cb 0x7fb7180043b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.185+0000 7fb727400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96d8ac0 0x557ae96ec370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.185+0000 7fb727400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96d8ac0 0x557ae96ec370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34606/0 (socket says 172.21.15.50:34606) 2024-09-10T10:13:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.185+0000 7fb727400640 1 -- 172.21.15.50:0/2505159441 learned_addr learned my addr 172.21.15.50:0/2505159441 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.185+0000 7fb727e00640 1 --2- 172.21.15.50:0/2505159441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96e3ca0 0x557ae96e9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.185+0000 7fb726a00640 1 --2- 172.21.15.50:0/2505159441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d93e0 0x557ae96e9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.185+0000 7fb727400640 1 -- 172.21.15.50:0/2505159441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96e3ca0 msgr2=0x557ae96e9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.185+0000 7fb727400640 1 --2- 172.21.15.50:0/2505159441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96e3ca0 0x557ae96e9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.185+0000 7fb727400640 1 -- 172.21.15.50:0/2505159441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d93e0 msgr2=0x557ae96e9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.185+0000 7fb727400640 1 --2- 172.21.15.50:0/2505159441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d93e0 0x557ae96e9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.185+0000 7fb727400640 1 -- 172.21.15.50:0/2505159441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ae96ea430 con 0x557ae96d8ac0 2024-09-10T10:13:02.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.185+0000 7fb727400640 1 --2- 172.21.15.50:0/2505159441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96d8ac0 0x557ae96ec370 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb718004280 tx=0x7fb718005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f109176a53a00daa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:02.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.185+0000 7fb710c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:13:02.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.186+0000 7fb710c00640 1 -- 172.21.15.50:0/2505159441 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71806b020 con 0x557ae96d8ac0 2024-09-10T10:13:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.186+0000 7fb710c00640 1 -- 172.21.15.50:0/2505159441 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb718004b30 con 0x557ae96d8ac0 2024-09-10T10:13:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.186+0000 7fb730a87740 1 -- 172.21.15.50:0/2505159441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb718063070 con 0x557ae96d8ac0 2024-09-10T10:13:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.186+0000 7fb710c00640 1 -- 172.21.15.50:0/2505159441 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb71804e040 con 0x557ae96d8ac0 2024-09-10T10:13:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.186+0000 7fb730a87740 10 client.15555 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.186+0000 7fb730a87740 1 -- 172.21.15.50:0/2505159441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557ae975e9d0 con 0x557ae96d8ac0 2024-09-10T10:13:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.186+0000 7fb710c00640 1 -- 172.21.15.50:0/2505159441 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb718063070 con 0x557ae96d8ac0 2024-09-10T10:13:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.187+0000 7fb710c00640 1 -- 172.21.15.50:0/2505159441 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb71804a450 con 0x557ae96d8ac0 2024-09-10T10:13:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.187+0000 7fb730a87740 10 client.15555 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.187+0000 7fb730a87740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.187+0000 7fb730a87740 20 client.15555 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.187+0000 7fb730a87740 1 --2- 172.21.15.50:0/2505159441 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557ae975f030 0x557ae9761420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.187+0000 7fb730a87740 4 client.15555 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T10:13:02.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.187+0000 7fb730a87740 1 -- 172.21.15.50:0/2505159441 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557ae9646d10 con 0x557ae975f030 2024-09-10T10:13:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.187+0000 7fb726a00640 1 --2- 172.21.15.50:0/2505159441 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557ae975f030 0x557ae9761420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.187+0000 7fb726a00640 1 --2- 172.21.15.50:0/2505159441 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557ae975f030 0x557ae9761420 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d209637c04a29dc7 server_cookie=efd1bd722695e115 in_seq=0 out_seq=0 2024-09-10T10:13:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.188+0000 7fb710c00640 10 client.15555 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb710c00640 1 -- 172.21.15.50:0/2505159441 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557ae9646d10 con 0x557ae975f030 2024-09-10T10:13:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb710c00640 10 client.15555 handle_command_reply: tid=0 2024-09-10T10:13:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb730a87740 1 client.15555 shutdown 2024-09-10T10:13:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb730a87740 1 -- 172.21.15.50:0/2505159441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96d8ac0 msgr2=0x557ae96ec370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb730a87740 1 --2- 172.21.15.50:0/2505159441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96d8ac0 0x557ae96ec370 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb718004280 tx=0x7fb718005850 comp rx=0 tx=0).stop 2024-09-10T10:13:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb730a87740 1 -- 172.21.15.50:0/2505159441 shutdown_connections 2024-09-10T10:13:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb730a87740 1 --2- 172.21.15.50:0/2505159441 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x557ae975f030 0x557ae9761420 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb730a87740 1 --2- 172.21.15.50:0/2505159441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557ae96e3ca0 0x557ae96e9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb730a87740 1 --2- 172.21.15.50:0/2505159441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557ae96d93e0 0x557ae96e9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb730a87740 1 --2- 172.21.15.50:0/2505159441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557ae96d8ac0 0x557ae96ec370 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb730a87740 1 -- 172.21.15.50:0/2505159441 >> 172.21.15.50:0/2505159441 conn(0x557ae96d5050 msgr2=0x557ae96d41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:02.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb710c00640 0 client.15555 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:02.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb730a87740 1 -- 172.21.15.50:0/2505159441 shutdown_connections 2024-09-10T10:13:02.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb730a87740 1 -- 172.21.15.50:0/2505159441 wait complete. 2024-09-10T10:13:02.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.189+0000 7fb730a87740 20 client.15555 trim_cache size 0 max 16384 2024-09-10T10:13:02.193 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:13:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-10T10:13:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "c4d6c1aa-d36e-470f-934c-701b79c708ce", 2024-09-10T10:13:02.193 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-10T10:13:02.193 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:13:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.190+0000 7fb72e000640 1 -- 172.21.15.50:0/4052208202 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb70c0a2b80 msgr2=0x7fb70c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.190+0000 7fb72e000640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb70c0a2b80 0x7fb70c0a5040 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb718000c00 tx=0x7fb718009560 comp rx=0 tx=0).stop 2024-09-10T10:13:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.190+0000 7fb72e000640 1 -- 172.21.15.50:0/4052208202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb728109120 msgr2=0x7fb72819ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.190+0000 7fb72e000640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb728109120 0x7fb72819ee80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb72000cce0 tx=0x7fb72000a620 comp rx=0 tx=0).stop 2024-09-10T10:13:02.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.190+0000 7fb72e000640 1 -- 172.21.15.50:0/4052208202 shutdown_connections 2024-09-10T10:13:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.190+0000 7fb72e000640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb70c0a2b80 0x7fb70c0a5040 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.190+0000 7fb72e000640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb728109120 0x7fb72819ee80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.190+0000 7fb72e000640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7281049a0 0x7fb72819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.190+0000 7fb72e000640 1 --2- 172.21.15.50:0/4052208202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb728103ff0 0x7fb72819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.190+0000 7fb72e000640 1 -- 172.21.15.50:0/4052208202 >> 172.21.15.50:0/4052208202 conn(0x7fb7280ffa90 msgr2=0x7fb7280fffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.190+0000 7fb72e000640 1 -- 172.21.15.50:0/4052208202 shutdown_connections 2024-09-10T10:13:02.195 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:02.190+0000 7fb72e000640 1 -- 172.21.15.50:0/4052208202 wait complete. 2024-09-10T10:13:02.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:02 smithi050 ceph-mon[30354]: pgmap v446: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:13:02.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:02 smithi050 ceph-mon[30354]: scrub queued for path: / 2024-09-10T10:13:02.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:02 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:02.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:02 smithi050 ceph-mon[30354]: scrub summary: active paths [/] 2024-09-10T10:13:02.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:02 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:03.053 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:13:03.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:02 smithi189 ceph-mon[34999]: pgmap v446: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:13:03.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:02 smithi189 ceph-mon[34999]: scrub queued for path: / 2024-09-10T10:13:03.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:02 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:03.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:02 smithi189 ceph-mon[34999]: scrub summary: active paths [/] 2024-09-10T10:13:03.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:02 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:03.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:02 smithi084 ceph-mon[34812]: pgmap v446: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:13:03.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:02 smithi084 ceph-mon[34812]: scrub queued for path: / 2024-09-10T10:13:03.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:02 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:03.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:02 smithi084 ceph-mon[34812]: scrub summary: active paths [/] 2024-09-10T10:13:03.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:02 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:03.430 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:03.917 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:03 smithi050 ceph-mon[30354]: scrub summary: idle 2024-09-10T10:13:04.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.031+0000 7fd186400640 1 -- 172.21.15.50:0/1923047896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd180108f60 msgr2=0x7fd180110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:04.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.031+0000 7fd186400640 1 --2- 172.21.15.50:0/1923047896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd180108f60 0x7fd180110ae0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd178009be0 tx=0x7fd17802a6c0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.031+0000 7fd186400640 1 -- 172.21.15.50:0/1923047896 shutdown_connections 2024-09-10T10:13:04.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.031+0000 7fd186400640 1 --2- 172.21.15.50:0/1923047896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd180108f60 0x7fd180110ae0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.031+0000 7fd186400640 1 --2- 172.21.15.50:0/1923047896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1801047e0 0x7fd180108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.031+0000 7fd186400640 1 --2- 172.21.15.50:0/1923047896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd180103e30 0x7fd180104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.031+0000 7fd186400640 1 -- 172.21.15.50:0/1923047896 >> 172.21.15.50:0/1923047896 conn(0x7fd1800ff8d0 msgr2=0x7fd180101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:04.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.032+0000 7fd186400640 1 -- 172.21.15.50:0/1923047896 shutdown_connections 2024-09-10T10:13:04.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.032+0000 7fd186400640 1 -- 172.21.15.50:0/1923047896 wait complete. 2024-09-10T10:13:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.032+0000 7fd186400640 1 Processor -- start 2024-09-10T10:13:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.033+0000 7fd186400640 1 -- start start 2024-09-10T10:13:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.033+0000 7fd186400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd180103e30 0x7fd18019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.033+0000 7fd186400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1801047e0 0x7fd18019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.033+0000 7fd186400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd180108f60 0x7fd18019ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.033+0000 7fd186400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd180113f70 con 0x7fd1801047e0 2024-09-10T10:13:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.033+0000 7fd186400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd180113df0 con 0x7fd180103e30 2024-09-10T10:13:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.033+0000 7fd186400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd1801140f0 con 0x7fd180108f60 2024-09-10T10:13:04.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.033+0000 7fd185000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd180103e30 0x7fd18019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.033+0000 7fd185000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd180103e30 0x7fd18019a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37622/0 (socket says 172.21.15.50:37622) 2024-09-10T10:13:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.033+0000 7fd185000640 1 -- 172.21.15.50:0/1641372205 learned_addr learned my addr 172.21.15.50:0/1641372205 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.033+0000 7fd17fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1801047e0 0x7fd18019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.033+0000 7fd185a00640 1 --2- 172.21.15.50:0/1641372205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd180108f60 0x7fd18019ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.034+0000 7fd185000640 1 -- 172.21.15.50:0/1641372205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd180108f60 msgr2=0x7fd18019ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.034+0000 7fd185000640 1 --2- 172.21.15.50:0/1641372205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd180108f60 0x7fd18019ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.034+0000 7fd185000640 1 -- 172.21.15.50:0/1641372205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1801047e0 msgr2=0x7fd18019a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.034+0000 7fd185000640 1 --2- 172.21.15.50:0/1641372205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1801047e0 0x7fd18019a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.034+0000 7fd185000640 1 -- 172.21.15.50:0/1641372205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18019f3e0 con 0x7fd180103e30 2024-09-10T10:13:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.034+0000 7fd185000640 1 --2- 172.21.15.50:0/1641372205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd180103e30 0x7fd18019a430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd17400e9c0 tx=0x7fd17400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.034+0000 7fd17d600640 1 -- 172.21.15.50:0/1641372205 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17400ccc0 con 0x7fd180103e30 2024-09-10T10:13:04.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.034+0000 7fd186400640 1 -- 172.21.15.50:0/1641372205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18019f6d0 con 0x7fd180103e30 2024-09-10T10:13:04.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.034+0000 7fd17d600640 1 -- 172.21.15.50:0/1641372205 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd174005500 con 0x7fd180103e30 2024-09-10T10:13:04.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.034+0000 7fd17d600640 1 -- 172.21.15.50:0/1641372205 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd174010430 con 0x7fd180103e30 2024-09-10T10:13:04.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.035+0000 7fd186400640 1 -- 172.21.15.50:0/1641372205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1801a6fb0 con 0x7fd180103e30 2024-09-10T10:13:04.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.037+0000 7fd18a5e0740 1 Processor -- start 2024-09-10T10:13:04.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.038+0000 7fd18a5e0740 1 -- start start 2024-09-10T10:13:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.038+0000 7fd18a5e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a11d50 0x561283a12130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.038+0000 7fd18a5e0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a12670 0x561283a1c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.038+0000 7fd17d600640 1 -- 172.21.15.50:0/1641372205 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd1740046c0 con 0x7fd180103e30 2024-09-10T10:13:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.038+0000 7fd18a5e0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a1cf30 0x561283a1f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.038+0000 7fd18a5e0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5612839783e0 con 0x561283a1cf30 2024-09-10T10:13:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.038+0000 7fd18a5e0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56128391fd80 con 0x561283a12670 2024-09-10T10:13:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.038+0000 7fd18a5e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5612839743a0 con 0x561283a11d50 2024-09-10T10:13:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.038+0000 7fd185000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a12670 0x561283a1c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.038+0000 7fd185a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a11d50 0x561283a12130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.039+0000 7fd185a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a11d50 0x561283a12130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:44120/0 (socket says 172.21.15.50:44120) 2024-09-10T10:13:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.039+0000 7fd185a00640 1 -- 172.21.15.50:0/3811511188 learned_addr learned my addr 172.21.15.50:0/3811511188 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:04.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.039+0000 7fd17fe00640 1 --2- 172.21.15.50:0/3811511188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a1cf30 0x561283a1f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.039+0000 7fd185a00640 1 -- 172.21.15.50:0/3811511188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a12670 msgr2=0x561283a1c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.039+0000 7fd185a00640 1 --2- 172.21.15.50:0/3811511188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a12670 0x561283a1c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.039+0000 7fd185a00640 1 -- 172.21.15.50:0/3811511188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a1cf30 msgr2=0x561283a1f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.039+0000 7fd185a00640 1 --2- 172.21.15.50:0/3811511188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a1cf30 0x561283a1f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.039+0000 7fd185a00640 1 -- 172.21.15.50:0/3811511188 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56128393eae0 con 0x561283a11d50 2024-09-10T10:13:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.039+0000 7fd185a00640 1 --2- 172.21.15.50:0/3811511188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a11d50 0x561283a12130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd178009be0 tx=0x7fd178005c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be0a76cdc9d491ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.040+0000 7fd172000640 1 -- 172.21.15.50:0/3811511188 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178042030 con 0x561283a11d50 2024-09-10T10:13:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.040+0000 7fd172000640 1 -- 172.21.15.50:0/3811511188 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd178037040 con 0x561283a11d50 2024-09-10T10:13:04.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.040+0000 7fd172000640 1 -- 172.21.15.50:0/3811511188 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178036070 con 0x561283a11d50 2024-09-10T10:13:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.040+0000 7fd17d600640 1 --2- 172.21.15.50:0/1641372205 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd1680a2b80 0x7fd1680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.040+0000 7fd17d600640 1 -- 172.21.15.50:0/1641372205 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fd1740cf700 con 0x7fd180103e30 2024-09-10T10:13:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.040+0000 7fd185000640 1 --2- 172.21.15.50:0/1641372205 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd1680a2b80 0x7fd1680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.040+0000 7fd18a5e0740 1 -- 172.21.15.50:0/3811511188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a11d50 msgr2=0x561283a12130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.040+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/3811511188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a11d50 0x561283a12130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd178009be0 tx=0x7fd178005c60 comp rx=0 tx=0).stop 2024-09-10T10:13:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.041+0000 7fd18a5e0740 1 -- 172.21.15.50:0/3811511188 shutdown_connections 2024-09-10T10:13:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.041+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/3811511188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a1cf30 0x561283a1f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.041+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/3811511188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a12670 0x561283a1c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.041+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/3811511188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a11d50 0x561283a12130 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.041+0000 7fd18a5e0740 1 -- 172.21.15.50:0/3811511188 >> 172.21.15.50:0/3811511188 conn(0x561283a0e2e0 msgr2=0x561283a0e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.041+0000 7fd18a5e0740 1 -- 172.21.15.50:0/3811511188 shutdown_connections 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.041+0000 7fd18a5e0740 1 -- 172.21.15.50:0/3811511188 wait complete. 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.041+0000 7fd185000640 1 --2- 172.21.15.50:0/1641372205 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd1680a2b80 0x7fd1680a5040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd174098540 tx=0x7fd1740d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.041+0000 7fd18a5e0740 1 -- start start 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.041+0000 7fd18a5e0740 1 Processor -- start 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.042+0000 7fd18a5e0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a11d50 0x561283a19e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.042+0000 7fd18a5e0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a12670 0x561283a1a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.042+0000 7fd18a5e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a1cf30 0x561283a1a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.042+0000 7fd18a5e0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561283a1fba0 con 0x561283a12670 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.042+0000 7fd18a5e0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5612839330f0 con 0x561283a11d50 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.042+0000 7fd18a5e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561283a1fd20 con 0x561283a1cf30 2024-09-10T10:13:04.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.042+0000 7fd18a5e0740 10 client.0 _ll_register_callbacks cb 0x5612839249e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:04.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.042+0000 7fd17fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a12670 0x561283a1a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.042+0000 7fd17fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a12670 0x561283a1a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34638/0 (socket says 172.21.15.50:34638) 2024-09-10T10:13:04.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.042+0000 7fd17fe00640 1 -- 172.21.15.50:0/2081935169 learned_addr learned my addr 172.21.15.50:0/2081935169 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:04.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.042+0000 7fd185a00640 1 --2- 172.21.15.50:0/2081935169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a11d50 0x561283a19e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.042+0000 7fd185a00640 1 --2- 172.21.15.50:0/2081935169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a1cf30 0x561283a1a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.043+0000 7fd17fe00640 1 -- 172.21.15.50:0/2081935169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a1cf30 msgr2=0x561283a1a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:04.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.043+0000 7fd17fe00640 1 --2- 172.21.15.50:0/2081935169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a1cf30 0x561283a1a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.043+0000 7fd17fe00640 1 -- 172.21.15.50:0/2081935169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a11d50 msgr2=0x561283a19e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:04.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.043+0000 7fd17fe00640 1 --2- 172.21.15.50:0/2081935169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a11d50 0x561283a19e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.043+0000 7fd17fe00640 1 -- 172.21.15.50:0/2081935169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612836e93c0 con 0x561283a12670 2024-09-10T10:13:04.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.043+0000 7fd17fe00640 1 --2- 172.21.15.50:0/2081935169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a12670 0x561283a1a370 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd16c012700 tx=0x7fd16c012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727fa7616b8f0460 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:04.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.043+0000 7fd166a00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:13:04.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.043+0000 7fd166a00640 1 -- 172.21.15.50:0/2081935169 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c004050 con 0x561283a12670 2024-09-10T10:13:04.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.043+0000 7fd166a00640 1 -- 172.21.15.50:0/2081935169 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fd16c0041f0 con 0x561283a12670 2024-09-10T10:13:04.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.043+0000 7fd18a5e0740 1 -- 172.21.15.50:0/2081935169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd178037040 con 0x561283a12670 2024-09-10T10:13:04.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.044+0000 7fd166a00640 1 -- 172.21.15.50:0/2081935169 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd16c0043f0 con 0x561283a12670 2024-09-10T10:13:04.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.044+0000 7fd18a5e0740 10 client.15567 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:04.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.044+0000 7fd18a5e0740 1 -- 172.21.15.50:0/2081935169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561283a2b8c0 con 0x561283a12670 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.044+0000 7fd166a00640 1 -- 172.21.15.50:0/2081935169 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd178037040 con 0x561283a12670 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.044+0000 7fd166a00640 1 -- 172.21.15.50:0/2081935169 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fd16c003bf0 con 0x561283a12670 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.044+0000 7fd18a5e0740 10 client.15567 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.044+0000 7fd18a5e0740 10 client.15567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.044+0000 7fd18a5e0740 20 client.15567 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.044+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/2081935169 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561283a2cd80 0x561283a2f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.044+0000 7fd18a5e0740 4 client.15567 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.044+0000 7fd18a5e0740 1 -- 172.21.15.50:0/2081935169 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561283985950 con 0x561283a2cd80 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.045+0000 7fd185a00640 1 --2- 172.21.15.50:0/2081935169 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561283a2cd80 0x561283a2f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.045+0000 7fd185a00640 1 --2- 172.21.15.50:0/2081935169 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561283a2cd80 0x561283a2f1b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3efbbcd30665938b server_cookie=29b7d41aa0ad8d40 in_seq=0 out_seq=0 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.045+0000 7fd166a00640 10 client.15567 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.046+0000 7fd166a00640 1 -- 172.21.15.50:0/2081935169 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561283985950 con 0x561283a2cd80 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.046+0000 7fd166a00640 10 client.15567 handle_command_reply: tid=0 2024-09-10T10:13:04.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.046+0000 7fd18a5e0740 1 client.15567 shutdown 2024-09-10T10:13:04.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.046+0000 7fd18a5e0740 1 -- 172.21.15.50:0/2081935169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a12670 msgr2=0x561283a1a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:04.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.046+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/2081935169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a12670 0x561283a1a370 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd16c012700 tx=0x7fd16c012bc0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.046+0000 7fd18a5e0740 1 -- 172.21.15.50:0/2081935169 shutdown_connections 2024-09-10T10:13:04.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.047+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/2081935169 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561283a2cd80 0x561283a2f1b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.047+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/2081935169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a1cf30 0x561283a1a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.047+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/2081935169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a12670 0x561283a1a370 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.047+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/2081935169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a11d50 0x561283a19e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.047+0000 7fd166a00640 0 client.15567 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:04.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.047+0000 7fd18a5e0740 1 -- 172.21.15.50:0/2081935169 >> 172.21.15.50:0/2081935169 conn(0x561283a0e2e0 msgr2=0x561283a13fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:04.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.047+0000 7fd18a5e0740 1 -- 172.21.15.50:0/2081935169 shutdown_connections 2024-09-10T10:13:04.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.047+0000 7fd18a5e0740 1 -- 172.21.15.50:0/2081935169 wait complete. 2024-09-10T10:13:04.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.047+0000 7fd18a5e0740 20 client.15567 trim_cache size 0 max 16384 2024-09-10T10:13:04.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.065+0000 7fd18a5e0740 1 Processor -- start 2024-09-10T10:13:04.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.065+0000 7fd18a5e0740 1 -- start start 2024-09-10T10:13:04.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.065+0000 7fd18a5e0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a11d50 0x561283a147b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.065+0000 7fd18a5e0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a12670 0x561283a34ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.065+0000 7fd18a5e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a1cf30 0x561283a35000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.065+0000 7fd18a5e0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1801b35f0 con 0x561283a11d50 2024-09-10T10:13:04.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.065+0000 7fd18a5e0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd1801b0ec0 con 0x561283a12670 2024-09-10T10:13:04.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.065+0000 7fd18a5e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd1801aed10 con 0x561283a1cf30 2024-09-10T10:13:04.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.065+0000 7fd185a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a11d50 0x561283a147b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.065+0000 7fd185a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a11d50 0x561283a147b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34640/0 (socket says 172.21.15.50:34640) 2024-09-10T10:13:04.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.065+0000 7fd185a00640 1 -- 172.21.15.50:0/3718292600 learned_addr learned my addr 172.21.15.50:0/3718292600 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:04.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.066+0000 7fd17fe00640 1 --2- 172.21.15.50:0/3718292600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a12670 0x561283a34ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.066+0000 7fd185a00640 1 --2- 172.21.15.50:0/3718292600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a1cf30 0x561283a35000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.066+0000 7fd185a00640 1 -- 172.21.15.50:0/3718292600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a1cf30 msgr2=0x561283a35000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:04.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.066+0000 7fd185a00640 1 --2- 172.21.15.50:0/3718292600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a1cf30 0x561283a35000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.066+0000 7fd185a00640 1 -- 172.21.15.50:0/3718292600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a12670 msgr2=0x561283a34ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:04.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.066+0000 7fd185a00640 1 --2- 172.21.15.50:0/3718292600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a12670 0x561283a34ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.066+0000 7fd185a00640 1 -- 172.21.15.50:0/3718292600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561283a18380 con 0x561283a11d50 2024-09-10T10:13:04.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.066+0000 7fd185a00640 1 --2- 172.21.15.50:0/3718292600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a11d50 0x561283a147b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd178003bd0 tx=0x7fd178009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7c6f76b5043559 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:04.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.066+0000 7fd171600640 1 -- 172.21.15.50:0/3718292600 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178036040 con 0x561283a11d50 2024-09-10T10:13:04.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.066+0000 7fd171600640 1 -- 172.21.15.50:0/3718292600 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd178059020 con 0x561283a11d50 2024-09-10T10:13:04.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.066+0000 7fd171600640 1 -- 172.21.15.50:0/3718292600 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178042040 con 0x561283a11d50 2024-09-10T10:13:04.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.067+0000 7fd18a5e0740 1 -- 172.21.15.50:0/3718292600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a11d50 msgr2=0x561283a147b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:04.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.067+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/3718292600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a11d50 0x561283a147b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd178003bd0 tx=0x7fd178009280 comp rx=0 tx=0).stop 2024-09-10T10:13:04.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.067+0000 7fd18a5e0740 1 -- 172.21.15.50:0/3718292600 shutdown_connections 2024-09-10T10:13:04.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.067+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/3718292600 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a1cf30 0x561283a35000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.067+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/3718292600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a12670 0x561283a34ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.067+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/3718292600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a11d50 0x561283a147b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.067+0000 7fd18a5e0740 1 -- 172.21.15.50:0/3718292600 >> 172.21.15.50:0/3718292600 conn(0x561283a0e2e0 msgr2=0x561283a1beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:04.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.067+0000 7fd18a5e0740 1 -- 172.21.15.50:0/3718292600 shutdown_connections 2024-09-10T10:13:04.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.067+0000 7fd18a5e0740 1 -- 172.21.15.50:0/3718292600 wait complete. 2024-09-10T10:13:04.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.068+0000 7fd18a5e0740 1 -- start start 2024-09-10T10:13:04.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.068+0000 7fd18a5e0740 1 Processor -- start 2024-09-10T10:13:04.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.068+0000 7fd18a5e0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a11d50 0x561283a16f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.068+0000 7fd18a5e0740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a12670 0x561283a174c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.068+0000 7fd18a5e0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a1cf30 0x561283a17a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.068+0000 7fd18a5e0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1801af380 con 0x561283a1cf30 2024-09-10T10:13:04.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.068+0000 7fd18a5e0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd1801b07f0 con 0x561283a11d50 2024-09-10T10:13:04.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.068+0000 7fd18a5e0740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd1801afa50 con 0x561283a12670 2024-09-10T10:13:04.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.068+0000 7fd18a5e0740 10 client.0 _ll_register_callbacks cb 0x7fd16c009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:04.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.069+0000 7fd185a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a1cf30 0x561283a17a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.069+0000 7fd17fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a12670 0x561283a174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.069+0000 7fd185a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a1cf30 0x561283a17a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34644/0 (socket says 172.21.15.50:34644) 2024-09-10T10:13:04.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.069+0000 7fd185a00640 1 -- 172.21.15.50:0/1560682157 learned_addr learned my addr 172.21.15.50:0/1560682157 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:04.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.069+0000 7fd185a00640 1 --2- 172.21.15.50:0/1560682157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a11d50 0x561283a16f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.069+0000 7fd17fe00640 1 -- 172.21.15.50:0/1560682157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a11d50 msgr2=0x561283a16f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.069+0000 7fd17fe00640 1 --2- 172.21.15.50:0/1560682157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a11d50 0x561283a16f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.069+0000 7fd17fe00640 1 -- 172.21.15.50:0/1560682157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a1cf30 msgr2=0x561283a17a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.069+0000 7fd17fe00640 1 --2- 172.21.15.50:0/1560682157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a1cf30 0x561283a17a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.069+0000 7fd17fe00640 1 -- 172.21.15.50:0/1560682157 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561283a96bf0 con 0x561283a12670 2024-09-10T10:13:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.069+0000 7fd17fe00640 1 --2- 172.21.15.50:0/1560682157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a12670 0x561283a174c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0126d0 tx=0x7fd16c00fbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79afd7e1284e90c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.069+0000 7fd166a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:13:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.070+0000 7fd166a00640 1 -- 172.21.15.50:0/1560682157 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c00fdc0 con 0x561283a12670 2024-09-10T10:13:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.070+0000 7fd18a5e0740 1 -- 172.21.15.50:0/1560682157 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd178059020 con 0x561283a12670 2024-09-10T10:13:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.070+0000 7fd166a00640 1 -- 172.21.15.50:0/1560682157 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fd16c005250 con 0x561283a12670 2024-09-10T10:13:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.070+0000 7fd166a00640 1 -- 172.21.15.50:0/1560682157 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd16c03b050 con 0x561283a12670 2024-09-10T10:13:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.070+0000 7fd18a5e0740 10 client.25594 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.070+0000 7fd18a5e0740 1 -- 172.21.15.50:0/1560682157 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561283a97ec0 con 0x561283a12670 2024-09-10T10:13:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.070+0000 7fd166a00640 1 -- 172.21.15.50:0/1560682157 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd178059020 con 0x561283a12670 2024-09-10T10:13:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.070+0000 7fd166a00640 1 -- 172.21.15.50:0/1560682157 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fd16c004590 con 0x561283a12670 2024-09-10T10:13:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.070+0000 7fd18a5e0740 10 client.25594 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.070+0000 7fd18a5e0740 10 client.25594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.070+0000 7fd18a5e0740 20 client.25594 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.071+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/1560682157 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561283a985b0 0x561283a9a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.071+0000 7fd18a5e0740 4 client.25594 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:13:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.071+0000 7fd18a5e0740 1 -- 172.21.15.50:0/1560682157 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56128397fe60 con 0x561283a985b0 2024-09-10T10:13:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.071+0000 7fd185a00640 1 --2- 172.21.15.50:0/1560682157 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561283a985b0 0x561283a9a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:04.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.071+0000 7fd185a00640 1 --2- 172.21.15.50:0/1560682157 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561283a985b0 0x561283a9a9d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41e949306de40214 server_cookie=b64225dc88818f61 in_seq=0 out_seq=0 2024-09-10T10:13:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.071+0000 7fd166a00640 10 client.25594 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd166a00640 1 -- 172.21.15.50:0/1560682157 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56128397fe60 con 0x561283a985b0 2024-09-10T10:13:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd166a00640 10 client.25594 handle_command_reply: tid=0 2024-09-10T10:13:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd18a5e0740 1 client.25594 shutdown 2024-09-10T10:13:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd18a5e0740 1 -- 172.21.15.50:0/1560682157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a12670 msgr2=0x561283a174c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/1560682157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a12670 0x561283a174c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0126d0 tx=0x7fd16c00fbd0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd18a5e0740 1 -- 172.21.15.50:0/1560682157 shutdown_connections 2024-09-10T10:13:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/1560682157 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561283a985b0 0x561283a9a9d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/1560682157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561283a1cf30 0x561283a17a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/1560682157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561283a12670 0x561283a174c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd18a5e0740 1 --2- 172.21.15.50:0/1560682157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561283a11d50 0x561283a16f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd166a00640 0 client.25594 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd18a5e0740 1 -- 172.21.15.50:0/1560682157 >> 172.21.15.50:0/1560682157 conn(0x561283a0e2e0 msgr2=0x561283a0cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd18a5e0740 1 -- 172.21.15.50:0/1560682157 shutdown_connections 2024-09-10T10:13:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd18a5e0740 1 -- 172.21.15.50:0/1560682157 wait complete. 2024-09-10T10:13:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.072+0000 7fd18a5e0740 20 client.25594 trim_cache size 0 max 16384 2024-09-10T10:13:04.080 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:13:04.080 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-10T10:13:04.080 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-10T10:13:04.080 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:13:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.073+0000 7fd186400640 1 -- 172.21.15.50:0/1641372205 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd1680a2b80 msgr2=0x7fd1680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.073+0000 7fd186400640 1 --2- 172.21.15.50:0/1641372205 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd1680a2b80 0x7fd1680a5040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd174098540 tx=0x7fd1740d5530 comp rx=0 tx=0).stop 2024-09-10T10:13:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.073+0000 7fd186400640 1 -- 172.21.15.50:0/1641372205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd180103e30 msgr2=0x7fd18019a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.073+0000 7fd186400640 1 --2- 172.21.15.50:0/1641372205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd180103e30 0x7fd18019a430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd17400e9c0 tx=0x7fd17400ee80 comp rx=0 tx=0).stop 2024-09-10T10:13:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.073+0000 7fd186400640 1 -- 172.21.15.50:0/1641372205 shutdown_connections 2024-09-10T10:13:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.073+0000 7fd186400640 1 --2- 172.21.15.50:0/1641372205 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd1680a2b80 0x7fd1680a5040 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.073+0000 7fd186400640 1 --2- 172.21.15.50:0/1641372205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd180108f60 0x7fd18019ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.073+0000 7fd186400640 1 --2- 172.21.15.50:0/1641372205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1801047e0 0x7fd18019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.073+0000 7fd186400640 1 --2- 172.21.15.50:0/1641372205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd180103e30 0x7fd18019a430 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:04.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.073+0000 7fd186400640 1 -- 172.21.15.50:0/1641372205 >> 172.21.15.50:0/1641372205 conn(0x7fd1800ff8d0 msgr2=0x7fd180100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:04.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.073+0000 7fd186400640 1 -- 172.21.15.50:0/1641372205 shutdown_connections 2024-09-10T10:13:04.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:04.073+0000 7fd186400640 1 -- 172.21.15.50:0/1641372205 wait complete. 2024-09-10T10:13:04.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:03 smithi189 ceph-mon[34999]: scrub summary: idle 2024-09-10T10:13:04.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:03 smithi084 ceph-mon[34812]: scrub summary: idle 2024-09-10T10:13:04.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:04 smithi050 ceph-mon[30354]: pgmap v447: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T10:13:04.838 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T10:13:04.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:13:05.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:04 smithi189 ceph-mon[34999]: pgmap v447: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T10:13:05.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:04 smithi084 ceph-mon[34812]: pgmap v447: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-10T10:13:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:05.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.796+0000 7f7313e00640 1 -- 172.21.15.50:0/1793038155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f730c074eb0 msgr2=0x7f730c112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:05.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.796+0000 7f7313e00640 1 --2- 172.21.15.50:0/1793038155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f730c074eb0 0x7f730c112650 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009900 tx=0x7f72f802a490 comp rx=0 tx=0).stop 2024-09-10T10:13:05.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.797+0000 7f7313e00640 1 -- 172.21.15.50:0/1793038155 shutdown_connections 2024-09-10T10:13:05.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.797+0000 7f7313e00640 1 --2- 172.21.15.50:0/1793038155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f730c112b90 0x7f730c114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:05.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.797+0000 7f7313e00640 1 --2- 172.21.15.50:0/1793038155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f730c074eb0 0x7f730c112650 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:05.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.797+0000 7f7313e00640 1 --2- 172.21.15.50:0/1793038155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730c074590 0x7f730c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:05.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.797+0000 7f7313e00640 1 -- 172.21.15.50:0/1793038155 >> 172.21.15.50:0/1793038155 conn(0x7f730c0fd8c0 msgr2=0x7f730c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:05.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.797+0000 7f7313e00640 1 -- 172.21.15.50:0/1793038155 shutdown_connections 2024-09-10T10:13:05.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.797+0000 7f7313e00640 1 -- 172.21.15.50:0/1793038155 wait complete. 2024-09-10T10:13:05.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.798+0000 7f7313e00640 1 Processor -- start 2024-09-10T10:13:05.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.798+0000 7f7313e00640 1 -- start start 2024-09-10T10:13:05.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.798+0000 7f7313e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f730c074590 0x7f730c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:05.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.798+0000 7f7313e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f730c074eb0 0x7f730c19f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:05.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.798+0000 7f7313e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730c112b90 0x7f730c1a34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:05.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.798+0000 7f7313e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1185b0 con 0x7f730c074590 2024-09-10T10:13:05.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.798+0000 7f7313e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f730c118430 con 0x7f730c112b90 2024-09-10T10:13:05.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.798+0000 7f7313e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f730c118730 con 0x7f730c074eb0 2024-09-10T10:13:05.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.798+0000 7f7311400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f730c074590 0x7f730c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:05.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.798+0000 7f7310a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f730c074eb0 0x7f730c19f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:05.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.798+0000 7f7311400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f730c074590 0x7f730c19ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34668/0 (socket says 172.21.15.50:34668) 2024-09-10T10:13:05.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.798+0000 7f7311400640 1 -- 172.21.15.50:0/748244299 learned_addr learned my addr 172.21.15.50:0/748244299 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:05.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.799+0000 7f7311e00640 1 --2- 172.21.15.50:0/748244299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730c112b90 0x7f730c1a34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:05.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.799+0000 7f7311e00640 1 -- 172.21.15.50:0/748244299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f730c074eb0 msgr2=0x7f730c19f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:05.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.799+0000 7f7311e00640 1 --2- 172.21.15.50:0/748244299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f730c074eb0 0x7f730c19f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:05.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.799+0000 7f7311e00640 1 -- 172.21.15.50:0/748244299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f730c074590 msgr2=0x7f730c19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:05.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.799+0000 7f7311e00640 1 --2- 172.21.15.50:0/748244299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f730c074590 0x7f730c19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:05.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.799+0000 7f7311e00640 1 -- 172.21.15.50:0/748244299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c1a3c00 con 0x7f730c112b90 2024-09-10T10:13:05.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.799+0000 7f7311e00640 1 --2- 172.21.15.50:0/748244299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730c112b90 0x7f730c1a34d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7304005fd0 tx=0x7f730400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:05.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.799+0000 7f730a000640 1 -- 172.21.15.50:0/748244299 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730400cdf0 con 0x7f730c112b90 2024-09-10T10:13:05.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.800+0000 7f730a000640 1 -- 172.21.15.50:0/748244299 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7304005020 con 0x7f730c112b90 2024-09-10T10:13:05.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.800+0000 7f730a000640 1 -- 172.21.15.50:0/748244299 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73040106d0 con 0x7f730c112b90 2024-09-10T10:13:05.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.800+0000 7f7313e00640 1 -- 172.21.15.50:0/748244299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c1a3ef0 con 0x7f730c112b90 2024-09-10T10:13:05.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.800+0000 7f7313e00640 1 -- 172.21.15.50:0/748244299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c1ab780 con 0x7f730c112b90 2024-09-10T10:13:05.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.801+0000 7f7313e00640 1 -- 172.21.15.50:0/748244299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730c074970 con 0x7f730c112b90 2024-09-10T10:13:05.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.803+0000 7f730a000640 1 -- 172.21.15.50:0/748244299 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f73040054d0 con 0x7f730c112b90 2024-09-10T10:13:05.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.804+0000 7f730a000640 1 --2- 172.21.15.50:0/748244299 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f72f40a2c00 0x7f72f40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:05.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.804+0000 7f730a000640 1 -- 172.21.15.50:0/748244299 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f73040cf970 con 0x7f730c112b90 2024-09-10T10:13:05.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.804+0000 7f7311400640 1 --2- 172.21.15.50:0/748244299 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f72f40a2c00 0x7f72f40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:05.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.805+0000 7f7311400640 1 --2- 172.21.15.50:0/748244299 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f72f40a2c00 0x7f72f40a50c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7300009c90 tx=0x7f7300005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:05.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:05.808+0000 7f730a000640 1 -- 172.21.15.50:0/748244299 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f730409c4e0 con 0x7f730c112b90 2024-09-10T10:13:06.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.037+0000 7f7313e00640 1 -- 172.21.15.50:0/748244299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f730c105020 con 0x7f730c112b90 2024-09-10T10:13:06.039 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.038+0000 7f730a000640 1 -- 172.21.15.50:0/748244299 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f730c105020 con 0x7f730c112b90 2024-09-10T10:13:06.040 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:13:06.040 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:13:06.040 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:13:06.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.041+0000 7f7313e00640 1 -- 172.21.15.50:0/748244299 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f72f40a2c00 msgr2=0x7f72f40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.041+0000 7f7313e00640 1 --2- 172.21.15.50:0/748244299 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f72f40a2c00 0x7f72f40a50c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7300009c90 tx=0x7f7300005f90 comp rx=0 tx=0).stop 2024-09-10T10:13:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.041+0000 7f7313e00640 1 -- 172.21.15.50:0/748244299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730c112b90 msgr2=0x7f730c1a34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.041+0000 7f7313e00640 1 --2- 172.21.15.50:0/748244299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730c112b90 0x7f730c1a34d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7304005fd0 tx=0x7f730400ef10 comp rx=0 tx=0).stop 2024-09-10T10:13:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.041+0000 7f7313e00640 1 -- 172.21.15.50:0/748244299 shutdown_connections 2024-09-10T10:13:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.041+0000 7f7313e00640 1 --2- 172.21.15.50:0/748244299 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f72f40a2c00 0x7f72f40a50c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.041+0000 7f7313e00640 1 --2- 172.21.15.50:0/748244299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f730c112b90 0x7f730c1a34d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.041+0000 7f7313e00640 1 --2- 172.21.15.50:0/748244299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f730c074eb0 0x7f730c19f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.041+0000 7f7313e00640 1 --2- 172.21.15.50:0/748244299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f730c074590 0x7f730c19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.041+0000 7f7313e00640 1 -- 172.21.15.50:0/748244299 >> 172.21.15.50:0/748244299 conn(0x7f730c0fd8c0 msgr2=0x7f730c0ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.041+0000 7f7313e00640 1 -- 172.21.15.50:0/748244299 shutdown_connections 2024-09-10T10:13:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:06.041+0000 7f7313e00640 1 -- 172.21.15.50:0/748244299 wait complete. 2024-09-10T10:13:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:06 smithi050 ceph-mon[30354]: pgmap v448: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:13:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:06 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/748244299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:06.950 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T10:13:07.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:06 smithi189 ceph-mon[34999]: pgmap v448: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:13:07.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:06 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/748244299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:07.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:06 smithi084 ceph-mon[34812]: pgmap v448: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:13:07.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:06 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/748244299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:07.328 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.902+0000 7f69df200640 1 -- 172.21.15.50:0/2405956893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e0077040 msgr2=0x7f69e0112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.902+0000 7f69df200640 1 --2- 172.21.15.50:0/2405956893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e0077040 0x7f69e0112330 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f69c8009900 tx=0x7f69c802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.903+0000 7f69df200640 1 -- 172.21.15.50:0/2405956893 shutdown_connections 2024-09-10T10:13:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.903+0000 7f69df200640 1 --2- 172.21.15.50:0/2405956893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69e0112870 0x7f69e0114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.903+0000 7f69df200640 1 --2- 172.21.15.50:0/2405956893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e0077040 0x7f69e0112330 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.903+0000 7f69df200640 1 --2- 172.21.15.50:0/2405956893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e0076720 0x7f69e0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.903+0000 7f69df200640 1 -- 172.21.15.50:0/2405956893 >> 172.21.15.50:0/2405956893 conn(0x7f69e00ff8d0 msgr2=0x7f69e0101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.903+0000 7f69df200640 1 -- 172.21.15.50:0/2405956893 shutdown_connections 2024-09-10T10:13:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.903+0000 7f69df200640 1 -- 172.21.15.50:0/2405956893 wait complete. 2024-09-10T10:13:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.904+0000 7f69df200640 1 Processor -- start 2024-09-10T10:13:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.904+0000 7f69df200640 1 -- start start 2024-09-10T10:13:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69df200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e0076720 0x7f69e01a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69df200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69e0077040 0x7f69e01a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69df200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e0112870 0x7f69e019e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69df200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69e01183f0 con 0x7f69e0112870 2024-09-10T10:13:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69df200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f69e0118270 con 0x7f69e0076720 2024-09-10T10:13:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69df200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f69e0118570 con 0x7f69e0077040 2024-09-10T10:13:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69dde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e0076720 0x7f69e01a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69de800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e0112870 0x7f69e019e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69dde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e0076720 0x7f69e01a4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:57242/0 (socket says 172.21.15.50:57242) 2024-09-10T10:13:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69dde00640 1 -- 172.21.15.50:0/71701963 learned_addr learned my addr 172.21.15.50:0/71701963 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69d5400640 1 --2- 172.21.15.50:0/71701963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69e0077040 0x7f69e01a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69dde00640 1 -- 172.21.15.50:0/71701963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69e0077040 msgr2=0x7f69e01a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69dde00640 1 --2- 172.21.15.50:0/71701963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69e0077040 0x7f69e01a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69dde00640 1 -- 172.21.15.50:0/71701963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e0112870 msgr2=0x7f69e019e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69dde00640 1 --2- 172.21.15.50:0/71701963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e0112870 0x7f69e019e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.905+0000 7f69dde00640 1 -- 172.21.15.50:0/71701963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e019efd0 con 0x7f69e0076720 2024-09-10T10:13:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.906+0000 7f69dde00640 1 --2- 172.21.15.50:0/71701963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e0076720 0x7f69e01a4690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f69d000ebc0 tx=0x7f69d000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.906+0000 7f69d7400640 1 -- 172.21.15.50:0/71701963 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0010630 con 0x7f69e0076720 2024-09-10T10:13:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.906+0000 7f69d7400640 1 -- 172.21.15.50:0/71701963 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69d0010cb0 con 0x7f69e0076720 2024-09-10T10:13:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.906+0000 7f69d7400640 1 -- 172.21.15.50:0/71701963 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0018bd0 con 0x7f69e0076720 2024-09-10T10:13:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.906+0000 7f69df200640 1 -- 172.21.15.50:0/71701963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e019f2c0 con 0x7f69e0076720 2024-09-10T10:13:07.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.906+0000 7f69df200640 1 -- 172.21.15.50:0/71701963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e01ab610 con 0x7f69e0076720 2024-09-10T10:13:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.909+0000 7f69d7400640 1 -- 172.21.15.50:0/71701963 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f69d00107d0 con 0x7f69e0076720 2024-09-10T10:13:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.909+0000 7f69e760a740 1 Processor -- start 2024-09-10T10:13:07.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.909+0000 7f69e760a740 1 -- start start 2024-09-10T10:13:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.910+0000 7f69e760a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a67a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.910+0000 7f69e760a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a684ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.910+0000 7f69e760a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 0x556f5a687410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.910+0000 7f69e760a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556f5a5e03e0 con 0x556f5a685020 2024-09-10T10:13:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.910+0000 7f69e760a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556f5a587d80 con 0x556f5a679e40 2024-09-10T10:13:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.910+0000 7f69e760a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556f5a5dc3a0 con 0x556f5a67a760 2024-09-10T10:13:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.910+0000 7f69de800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a67a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.910+0000 7f69de800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a67a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:57244/0 (socket says 172.21.15.50:57244) 2024-09-10T10:13:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.910+0000 7f69de800640 1 -- 172.21.15.50:0/1678366461 learned_addr learned my addr 172.21.15.50:0/1678366461 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:07.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.910+0000 7f69d5400640 1 --2- 172.21.15.50:0/1678366461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 0x556f5a687410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.910+0000 7f69dde00640 1 --2- 172.21.15.50:0/1678366461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a684ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.911+0000 7f69de800640 1 -- 172.21.15.50:0/1678366461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 msgr2=0x556f5a684ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.911+0000 7f69de800640 1 --2- 172.21.15.50:0/1678366461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a684ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.911+0000 7f69de800640 1 -- 172.21.15.50:0/1678366461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 msgr2=0x556f5a687410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.911+0000 7f69de800640 1 --2- 172.21.15.50:0/1678366461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 0x556f5a687410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.911+0000 7f69de800640 1 -- 172.21.15.50:0/1678366461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f5a5a6ae0 con 0x556f5a679e40 2024-09-10T10:13:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.911+0000 7f69de800640 1 --2- 172.21.15.50:0/1678366461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a67a220 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009b80 tx=0x7f69d8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8db164dcbc1cb7a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.911+0000 7f69d7400640 1 --2- 172.21.15.50:0/71701963 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f69c40a2c00 0x7f69c40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.911+0000 7f69cf000640 1 -- 172.21.15.50:0/1678366461 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8004030 con 0x556f5a679e40 2024-09-10T10:13:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.911+0000 7f69d7400640 1 -- 172.21.15.50:0/71701963 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f69d00cf9d0 con 0x7f69e0076720 2024-09-10T10:13:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.912+0000 7f69dde00640 1 --2- 172.21.15.50:0/71701963 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f69c40a2c00 0x7f69c40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.912+0000 7f69cf000640 1 -- 172.21.15.50:0/1678366461 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69d80041d0 con 0x556f5a679e40 2024-09-10T10:13:07.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.912+0000 7f69cf000640 1 -- 172.21.15.50:0/1678366461 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8019710 con 0x556f5a679e40 2024-09-10T10:13:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.912+0000 7f69e760a740 1 -- 172.21.15.50:0/1678366461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 msgr2=0x556f5a67a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.912+0000 7f69e760a740 1 --2- 172.21.15.50:0/1678366461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a67a220 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009b80 tx=0x7f69d8011810 comp rx=0 tx=0).stop 2024-09-10T10:13:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.912+0000 7f69dde00640 1 --2- 172.21.15.50:0/71701963 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f69c40a2c00 0x7f69c40a50c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f69d0098350 tx=0x7f69d00d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.912+0000 7f69e760a740 1 -- 172.21.15.50:0/1678366461 shutdown_connections 2024-09-10T10:13:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.912+0000 7f69e760a740 1 --2- 172.21.15.50:0/1678366461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 0x556f5a687410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.912+0000 7f69e760a740 1 --2- 172.21.15.50:0/1678366461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a684ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.912+0000 7f69e760a740 1 --2- 172.21.15.50:0/1678366461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a67a220 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.912+0000 7f69e760a740 1 -- 172.21.15.50:0/1678366461 >> 172.21.15.50:0/1678366461 conn(0x556f5a6763d0 msgr2=0x556f5a6767b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.912+0000 7f69e760a740 1 -- 172.21.15.50:0/1678366461 shutdown_connections 2024-09-10T10:13:07.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.913+0000 7f69e760a740 1 -- 172.21.15.50:0/1678366461 wait complete. 2024-09-10T10:13:07.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.913+0000 7f69e760a740 1 -- start start 2024-09-10T10:13:07.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.913+0000 7f69e760a740 1 Processor -- start 2024-09-10T10:13:07.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69e760a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a681e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69e760a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a6823d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69e760a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 0x556f5a682910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69e760a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556f5a687bf0 con 0x556f5a685020 2024-09-10T10:13:07.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69e760a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556f5a59b0f0 con 0x556f5a679e40 2024-09-10T10:13:07.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69e760a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556f5a687d70 con 0x556f5a67a760 2024-09-10T10:13:07.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69e760a740 10 client.0 _ll_register_callbacks cb 0x556f5a582bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:07.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69de800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 0x556f5a682910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69d5400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a6823d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69de800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 0x556f5a682910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50792/0 (socket says 172.21.15.50:50792) 2024-09-10T10:13:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69de800640 1 -- 172.21.15.50:0/2702450768 learned_addr learned my addr 172.21.15.50:0/2702450768 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69de800640 1 --2- 172.21.15.50:0/2702450768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a681e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69d5400640 1 -- 172.21.15.50:0/2702450768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 msgr2=0x556f5a681e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69d5400640 1 --2- 172.21.15.50:0/2702450768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a681e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69d5400640 1 -- 172.21.15.50:0/2702450768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 msgr2=0x556f5a682910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69d5400640 1 --2- 172.21.15.50:0/2702450768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 0x556f5a682910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.914+0000 7f69d5400640 1 -- 172.21.15.50:0/2702450768 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f5a3513c0 con 0x556f5a67a760 2024-09-10T10:13:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.915+0000 7f69d5400640 1 --2- 172.21.15.50:0/2702450768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a6823d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f69c8005940 tx=0x7f69c80317e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d286bd76cdea11d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.915+0000 7f69c3400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:13:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.915+0000 7f69c3400640 1 -- 172.21.15.50:0/2702450768 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c8035040 con 0x556f5a67a760 2024-09-10T10:13:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.915+0000 7f69e760a740 1 -- 172.21.15.50:0/2702450768 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69d80041d0 con 0x556f5a67a760 2024-09-10T10:13:07.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.915+0000 7f69c3400640 1 -- 172.21.15.50:0/2702450768 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f69c8004240 con 0x556f5a67a760 2024-09-10T10:13:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.915+0000 7f69c3400640 1 -- 172.21.15.50:0/2702450768 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f69c804f050 con 0x556f5a67a760 2024-09-10T10:13:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.915+0000 7f69e760a740 10 client.25612 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.915+0000 7f69e760a740 1 -- 172.21.15.50:0/2702450768 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556f5a693c00 con 0x556f5a67a760 2024-09-10T10:13:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.916+0000 7f69c3400640 1 -- 172.21.15.50:0/2702450768 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69d80041d0 con 0x556f5a67a760 2024-09-10T10:13:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.916+0000 7f69c3400640 1 -- 172.21.15.50:0/2702450768 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f69c8004a10 con 0x556f5a67a760 2024-09-10T10:13:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.916+0000 7f69e760a740 10 client.25612 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.916+0000 7f69e760a740 10 client.25612 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:13:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.916+0000 7f69e760a740 20 client.25612 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.916+0000 7f69e760a740 1 --2- 172.21.15.50:0/2702450768 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x556f5a695010 0x556f5a697400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.916+0000 7f69e760a740 4 client.25612 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.916+0000 7f69e760a740 1 -- 172.21.15.50:0/2702450768 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f5a5ed950 con 0x556f5a695010 2024-09-10T10:13:07.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.917+0000 7f69de800640 1 --2- 172.21.15.50:0/2702450768 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x556f5a695010 0x556f5a697400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.917+0000 7f69de800640 1 --2- 172.21.15.50:0/2702450768 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x556f5a695010 0x556f5a697400 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca9f4d3816935a84 server_cookie=6c92f53915f8c517 in_seq=0 out_seq=0 2024-09-10T10:13:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.917+0000 7f69c3400640 10 client.25612 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.918+0000 7f69c3400640 1 -- 172.21.15.50:0/2702450768 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f5a5ed950 con 0x556f5a695010 2024-09-10T10:13:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.918+0000 7f69c3400640 10 client.25612 handle_command_reply: tid=0 2024-09-10T10:13:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.918+0000 7f69e760a740 1 client.25612 shutdown 2024-09-10T10:13:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.918+0000 7f69e760a740 1 -- 172.21.15.50:0/2702450768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 msgr2=0x556f5a6823d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.918+0000 7f69e760a740 1 --2- 172.21.15.50:0/2702450768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a6823d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f69c8005940 tx=0x7f69c80317e0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.918+0000 7f69e760a740 1 -- 172.21.15.50:0/2702450768 shutdown_connections 2024-09-10T10:13:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.918+0000 7f69e760a740 1 --2- 172.21.15.50:0/2702450768 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x556f5a695010 0x556f5a697400 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.919+0000 7f69e760a740 1 --2- 172.21.15.50:0/2702450768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 0x556f5a682910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.919+0000 7f69e760a740 1 --2- 172.21.15.50:0/2702450768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a6823d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.919+0000 7f69c3400640 0 client.25612 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.919+0000 7f69e760a740 1 --2- 172.21.15.50:0/2702450768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a681e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.919+0000 7f69e760a740 1 -- 172.21.15.50:0/2702450768 >> 172.21.15.50:0/2702450768 conn(0x556f5a6763d0 msgr2=0x556f5a67c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.919+0000 7f69e760a740 1 -- 172.21.15.50:0/2702450768 shutdown_connections 2024-09-10T10:13:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.919+0000 7f69e760a740 1 -- 172.21.15.50:0/2702450768 wait complete. 2024-09-10T10:13:07.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.919+0000 7f69e760a740 20 client.25612 trim_cache size 0 max 16384 2024-09-10T10:13:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.932+0000 7f69e760a740 1 Processor -- start 2024-09-10T10:13:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.933+0000 7f69e760a740 1 -- start start 2024-09-10T10:13:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.933+0000 7f69e760a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a679e40 0x556f5a6841c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.933+0000 7f69e760a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a682760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.933+0000 7f69e760a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a685020 0x556f5a69ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.933+0000 7f69e760a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69e01b7940 con 0x556f5a679e40 2024-09-10T10:13:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.933+0000 7f69e760a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f69e01b5210 con 0x556f5a685020 2024-09-10T10:13:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.933+0000 7f69e760a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f69e01b3060 con 0x556f5a67a760 2024-09-10T10:13:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.933+0000 7f69de800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a679e40 0x556f5a6841c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.933+0000 7f69de800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a679e40 0x556f5a6841c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50806/0 (socket says 172.21.15.50:50806) 2024-09-10T10:13:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.933+0000 7f69de800640 1 -- 172.21.15.50:0/8673752 learned_addr learned my addr 172.21.15.50:0/8673752 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.933+0000 7f69d5400640 1 --2- 172.21.15.50:0/8673752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a682760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.934+0000 7f69de800640 1 --2- 172.21.15.50:0/8673752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a685020 0x556f5a69ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.934+0000 7f69d5400640 1 -- 172.21.15.50:0/8673752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a685020 msgr2=0x556f5a69ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.934+0000 7f69d5400640 1 --2- 172.21.15.50:0/8673752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a685020 0x556f5a69ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.934+0000 7f69d5400640 1 -- 172.21.15.50:0/8673752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a679e40 msgr2=0x556f5a6841c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.934+0000 7f69d5400640 1 --2- 172.21.15.50:0/8673752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a679e40 0x556f5a6841c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.934+0000 7f69d5400640 1 -- 172.21.15.50:0/8673752 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f5a677480 con 0x556f5a67a760 2024-09-10T10:13:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.934+0000 7f69de800640 1 --2- 172.21.15.50:0/8673752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a685020 0x556f5a69ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:13:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.934+0000 7f69d5400640 1 --2- 172.21.15.50:0/8673752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a682760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f69c8031550 tx=0x7f69c8000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=153099d5fec5513f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.934+0000 7f69ce600640 1 -- 172.21.15.50:0/8673752 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c8057070 con 0x556f5a67a760 2024-09-10T10:13:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.934+0000 7f69ce600640 1 -- 172.21.15.50:0/8673752 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69c8031a10 con 0x556f5a67a760 2024-09-10T10:13:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.934+0000 7f69ce600640 1 -- 172.21.15.50:0/8673752 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c8000e60 con 0x556f5a67a760 2024-09-10T10:13:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.935+0000 7f69e760a740 1 -- 172.21.15.50:0/8673752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 msgr2=0x556f5a682760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.935+0000 7f69e760a740 1 --2- 172.21.15.50:0/8673752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a682760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f69c8031550 tx=0x7f69c8000bc0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.935+0000 7f69e760a740 1 -- 172.21.15.50:0/8673752 shutdown_connections 2024-09-10T10:13:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.935+0000 7f69e760a740 1 --2- 172.21.15.50:0/8673752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a685020 0x556f5a69ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.935+0000 7f69e760a740 1 --2- 172.21.15.50:0/8673752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a682760 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.935+0000 7f69e760a740 1 --2- 172.21.15.50:0/8673752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a679e40 0x556f5a6841c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.935+0000 7f69e760a740 1 -- 172.21.15.50:0/8673752 >> 172.21.15.50:0/8673752 conn(0x556f5a6763d0 msgr2=0x556f5a67c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.935+0000 7f69e760a740 1 -- 172.21.15.50:0/8673752 shutdown_connections 2024-09-10T10:13:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.935+0000 7f69e760a740 1 -- 172.21.15.50:0/8673752 wait complete. 2024-09-10T10:13:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.936+0000 7f69e760a740 1 -- start start 2024-09-10T10:13:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.936+0000 7f69e760a740 1 Processor -- start 2024-09-10T10:13:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.936+0000 7f69e760a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a689440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.936+0000 7f69e760a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a689980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.936+0000 7f69e760a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 0x556f5a6feca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.936+0000 7f69e760a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f69e01b36d0 con 0x556f5a685020 2024-09-10T10:13:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.936+0000 7f69e760a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f69e01b4b40 con 0x556f5a679e40 2024-09-10T10:13:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.936+0000 7f69e760a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f69e01b3da0 con 0x556f5a67a760 2024-09-10T10:13:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.936+0000 7f69e760a740 10 client.0 _ll_register_callbacks cb 0x7f69c8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.937+0000 7f69de800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a689440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.937+0000 7f69de800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a689440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:57272/0 (socket says 172.21.15.50:57272) 2024-09-10T10:13:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.937+0000 7f69de800640 1 -- 172.21.15.50:0/104299956 learned_addr learned my addr 172.21.15.50:0/104299956 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.937+0000 7f69de800640 1 --2- 172.21.15.50:0/104299956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 0x556f5a6feca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.937+0000 7f69d5400640 1 --2- 172.21.15.50:0/104299956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a689980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.937+0000 7f69de800640 1 -- 172.21.15.50:0/104299956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 msgr2=0x556f5a689980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.937+0000 7f69de800640 1 --2- 172.21.15.50:0/104299956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a689980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.937+0000 7f69de800640 1 -- 172.21.15.50:0/104299956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 msgr2=0x556f5a6feca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.937+0000 7f69de800640 1 --2- 172.21.15.50:0/104299956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 0x556f5a6feca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.937+0000 7f69de800640 1 -- 172.21.15.50:0/104299956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f5a675c80 con 0x556f5a679e40 2024-09-10T10:13:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.937+0000 7f69de800640 1 --2- 172.21.15.50:0/104299956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a689440 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009b20 tx=0x7f69d8005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29c9bee851029539 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.937+0000 7f69c3400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69c3400640 1 -- 172.21.15.50:0/104299956 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d80035f0 con 0x556f5a679e40 2024-09-10T10:13:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69e760a740 1 -- 172.21.15.50:0/104299956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556f5a677080 con 0x556f5a679e40 2024-09-10T10:13:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69c3400640 1 -- 172.21.15.50:0/104299956 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f69d8003790 con 0x556f5a679e40 2024-09-10T10:13:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69c3400640 1 -- 172.21.15.50:0/104299956 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f69d8003990 con 0x556f5a679e40 2024-09-10T10:13:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69e760a740 10 client.25646 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69e760a740 1 -- 172.21.15.50:0/104299956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556f5a679c70 con 0x556f5a679e40 2024-09-10T10:13:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69c3400640 1 -- 172.21.15.50:0/104299956 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x556f5a677080 con 0x556f5a679e40 2024-09-10T10:13:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69c3400640 1 -- 172.21.15.50:0/104299956 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f69d8025040 con 0x556f5a679e40 2024-09-10T10:13:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69e760a740 10 client.25646 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69e760a740 10 client.25646 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:13:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69e760a740 20 client.25646 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69e760a740 1 --2- 172.21.15.50:0/104299956 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x556f5a700530 0x556f5a702920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69e760a740 4 client.25646 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:13:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.938+0000 7f69e760a740 1 -- 172.21.15.50:0/104299956 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556f5a5e7e60 con 0x556f5a700530 2024-09-10T10:13:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.939+0000 7f69d5400640 1 --2- 172.21.15.50:0/104299956 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x556f5a700530 0x556f5a702920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.939+0000 7f69d5400640 1 --2- 172.21.15.50:0/104299956 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x556f5a700530 0x556f5a702920 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b5e43f44605d1f11 server_cookie=34e85e13334fe5b5 in_seq=0 out_seq=0 2024-09-10T10:13:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.939+0000 7f69c3400640 10 client.25646 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69c3400640 1 -- 172.21.15.50:0/104299956 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556f5a5e7e60 con 0x556f5a700530 2024-09-10T10:13:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69c3400640 10 client.25646 handle_command_reply: tid=0 2024-09-10T10:13:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69e760a740 1 client.25646 shutdown 2024-09-10T10:13:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69e760a740 1 -- 172.21.15.50:0/104299956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 msgr2=0x556f5a689440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69e760a740 1 --2- 172.21.15.50:0/104299956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a689440 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009b20 tx=0x7f69d8005040 comp rx=0 tx=0).stop 2024-09-10T10:13:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69e760a740 1 -- 172.21.15.50:0/104299956 shutdown_connections 2024-09-10T10:13:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69e760a740 1 --2- 172.21.15.50:0/104299956 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x556f5a700530 0x556f5a702920 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69e760a740 1 --2- 172.21.15.50:0/104299956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f5a685020 0x556f5a6feca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69e760a740 1 --2- 172.21.15.50:0/104299956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556f5a67a760 0x556f5a689980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69e760a740 1 --2- 172.21.15.50:0/104299956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f5a679e40 0x556f5a689440 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69c3400640 0 client.25646 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69e760a740 1 -- 172.21.15.50:0/104299956 >> 172.21.15.50:0/104299956 conn(0x556f5a6763d0 msgr2=0x556f5a67b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69e760a740 1 -- 172.21.15.50:0/104299956 shutdown_connections 2024-09-10T10:13:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69e760a740 1 -- 172.21.15.50:0/104299956 wait complete. 2024-09-10T10:13:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.940+0000 7f69e760a740 20 client.25646 trim_cache size 0 max 16384 2024-09-10T10:13:07.945 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:13:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.941+0000 7f69df200640 1 -- 172.21.15.50:0/71701963 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f69c40a2c00 msgr2=0x7f69c40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.941+0000 7f69df200640 1 --2- 172.21.15.50:0/71701963 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f69c40a2c00 0x7f69c40a50c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f69d0098350 tx=0x7f69d00d5530 comp rx=0 tx=0).stop 2024-09-10T10:13:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.941+0000 7f69df200640 1 -- 172.21.15.50:0/71701963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e0076720 msgr2=0x7f69e01a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.941+0000 7f69df200640 1 --2- 172.21.15.50:0/71701963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e0076720 0x7f69e01a4690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f69d000ebc0 tx=0x7f69d000c6a0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.941+0000 7f69df200640 1 -- 172.21.15.50:0/71701963 shutdown_connections 2024-09-10T10:13:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.941+0000 7f69df200640 1 --2- 172.21.15.50:0/71701963 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f69c40a2c00 0x7f69c40a50c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.941+0000 7f69df200640 1 --2- 172.21.15.50:0/71701963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f69e0112870 0x7f69e019e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.941+0000 7f69df200640 1 --2- 172.21.15.50:0/71701963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69e0077040 0x7f69e01a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.941+0000 7f69df200640 1 --2- 172.21.15.50:0/71701963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e0076720 0x7f69e01a4690 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.941+0000 7f69df200640 1 -- 172.21.15.50:0/71701963 >> 172.21.15.50:0/71701963 conn(0x7f69e00ff8d0 msgr2=0x7f69e0101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.941+0000 7f69df200640 1 -- 172.21.15.50:0/71701963 shutdown_connections 2024-09-10T10:13:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:07.941+0000 7f69df200640 1 -- 172.21.15.50:0/71701963 wait complete. 2024-09-10T10:13:08.704 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T10:13:08.907 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:13:08.961 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:08 smithi050 ceph-mon[30354]: pgmap v449: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T10:13:09.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:08 smithi189 ceph-mon[34999]: pgmap v449: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T10:13:09.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:08 smithi084 ceph-mon[34812]: pgmap v449: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T10:13:09.126 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:09.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.689+0000 7f8219000640 1 -- 172.21.15.50:0/3702199546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8214104010 msgr2=0x7f82141043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.689+0000 7f8219000640 1 --2- 172.21.15.50:0/3702199546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8214104010 0x7f82141043f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8204009900 tx=0x7f820402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.689+0000 7f8219000640 1 -- 172.21.15.50:0/3702199546 shutdown_connections 2024-09-10T10:13:09.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.689+0000 7f8219000640 1 --2- 172.21.15.50:0/3702199546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8214109140 0x7f8214110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.689+0000 7f8219000640 1 --2- 172.21.15.50:0/3702199546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82141049c0 0x7f8214108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.689+0000 7f8219000640 1 --2- 172.21.15.50:0/3702199546 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8214104010 0x7f82141043f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.689+0000 7f8219000640 1 -- 172.21.15.50:0/3702199546 >> 172.21.15.50:0/3702199546 conn(0x7f82140ffa50 msgr2=0x7f8214101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:09.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.689+0000 7f8219000640 1 -- 172.21.15.50:0/3702199546 shutdown_connections 2024-09-10T10:13:09.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.689+0000 7f8219000640 1 -- 172.21.15.50:0/3702199546 wait complete. 2024-09-10T10:13:09.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.690+0000 7f8219000640 1 Processor -- start 2024-09-10T10:13:09.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.691+0000 7f8219000640 1 -- start start 2024-09-10T10:13:09.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.691+0000 7f8219000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8214104010 0x7f821419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.691+0000 7f8219000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82141049c0 0x7f821419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.691+0000 7f8219000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8214109140 0x7f821419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.691+0000 7f8219000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82141141c0 con 0x7f82141049c0 2024-09-10T10:13:09.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.691+0000 7f8219000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8214114040 con 0x7f8214104010 2024-09-10T10:13:09.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.691+0000 7f8219000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8214114340 con 0x7f8214109140 2024-09-10T10:13:09.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.691+0000 7f8211e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8214104010 0x7f821419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.691+0000 7f8211400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82141049c0 0x7f821419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.691+0000 7f8211e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8214104010 0x7f821419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:57296/0 (socket says 172.21.15.50:57296) 2024-09-10T10:13:09.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.691+0000 7f8211e00640 1 -- 172.21.15.50:0/3117192578 learned_addr learned my addr 172.21.15.50:0/3117192578 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:09.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.692+0000 7f8212800640 1 --2- 172.21.15.50:0/3117192578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8214109140 0x7f821419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.692+0000 7f8211e00640 1 -- 172.21.15.50:0/3117192578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8214109140 msgr2=0x7f821419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.692+0000 7f8211e00640 1 --2- 172.21.15.50:0/3117192578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8214109140 0x7f821419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.692+0000 7f8211e00640 1 -- 172.21.15.50:0/3117192578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82141049c0 msgr2=0x7f821419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.692+0000 7f8211e00640 1 --2- 172.21.15.50:0/3117192578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82141049c0 0x7f821419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.692+0000 7f8211e00640 1 -- 172.21.15.50:0/3117192578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821419f5f0 con 0x7f8214104010 2024-09-10T10:13:09.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.692+0000 7f8211e00640 1 --2- 172.21.15.50:0/3117192578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8214104010 0x7f821419a640 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8204004770 tx=0x7f8204003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.693+0000 7f820aa00640 1 -- 172.21.15.50:0/3117192578 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820403f070 con 0x7f8214104010 2024-09-10T10:13:09.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.693+0000 7f8219000640 1 -- 172.21.15.50:0/3117192578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f821419f880 con 0x7f8214104010 2024-09-10T10:13:09.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.693+0000 7f820aa00640 1 -- 172.21.15.50:0/3117192578 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8204031ca0 con 0x7f8214104010 2024-09-10T10:13:09.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.693+0000 7f820aa00640 1 -- 172.21.15.50:0/3117192578 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204035030 con 0x7f8214104010 2024-09-10T10:13:09.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.693+0000 7f8219000640 1 -- 172.21.15.50:0/3117192578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82141a71c0 con 0x7f8214104010 2024-09-10T10:13:09.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.696+0000 7f820aa00640 1 -- 172.21.15.50:0/3117192578 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8204042070 con 0x7f8214104010 2024-09-10T10:13:09.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.697+0000 7f820aa00640 1 --2- 172.21.15.50:0/3117192578 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f81f80a2c00 0x7f81f80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.697+0000 7f821baca740 1 Processor -- start 2024-09-10T10:13:09.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.697+0000 7f820aa00640 1 -- 172.21.15.50:0/3117192578 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f82040ef940 con 0x7f8214104010 2024-09-10T10:13:09.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.697+0000 7f8211400640 1 --2- 172.21.15.50:0/3117192578 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f81f80a2c00 0x7f81f80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.698+0000 7f821baca740 1 -- start start 2024-09-10T10:13:09.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.698+0000 7f821baca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 0x558be12e4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.698+0000 7f821baca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e4590 0x558be12ee910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.698+0000 7f821baca740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12eee50 0x558be12f1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.698+0000 7f8211400640 1 --2- 172.21.15.50:0/3117192578 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f81f80a2c00 0x7f81f80a50c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f82140ffe70 tx=0x7f8200005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.698+0000 7f821baca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558be124a3e0 con 0x558be12e4590 2024-09-10T10:13:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.698+0000 7f821baca740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558be11f1d80 con 0x558be12eee50 2024-09-10T10:13:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.698+0000 7f821baca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558be12463a0 con 0x558be12e3c70 2024-09-10T10:13:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.698+0000 7f8211e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 0x558be12e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.698+0000 7f8211400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e4590 0x558be12ee910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.698+0000 7f8211e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 0x558be12e4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:43578/0 (socket says 172.21.15.50:43578) 2024-09-10T10:13:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.698+0000 7f8211e00640 1 -- 172.21.15.50:0/1789170133 learned_addr learned my addr 172.21.15.50:0/1789170133 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:09.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.698+0000 7f8212800640 1 --2- 172.21.15.50:0/1789170133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12eee50 0x558be12f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.699+0000 7f8211e00640 1 -- 172.21.15.50:0/1789170133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12eee50 msgr2=0x558be12f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.699+0000 7f8211e00640 1 --2- 172.21.15.50:0/1789170133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12eee50 0x558be12f1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.699+0000 7f8211e00640 1 -- 172.21.15.50:0/1789170133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e4590 msgr2=0x558be12ee910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.699+0000 7f8211e00640 1 --2- 172.21.15.50:0/1789170133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e4590 0x558be12ee910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.699+0000 7f8211e00640 1 -- 172.21.15.50:0/1789170133 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be1210ae0 con 0x558be12e3c70 2024-09-10T10:13:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.699+0000 7f8211e00640 1 --2- 172.21.15.50:0/1789170133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 0x558be12e4050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f82040bbeb0 tx=0x7f820403b460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70e787f99d83b6ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.699+0000 7f81ff400640 1 -- 172.21.15.50:0/1789170133 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82040d9070 con 0x558be12e3c70 2024-09-10T10:13:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.700+0000 7f81ff400640 1 -- 172.21.15.50:0/1789170133 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82040c0220 con 0x558be12e3c70 2024-09-10T10:13:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.700+0000 7f81ff400640 1 -- 172.21.15.50:0/1789170133 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204049070 con 0x558be12e3c70 2024-09-10T10:13:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.700+0000 7f821baca740 1 -- 172.21.15.50:0/1789170133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 msgr2=0x558be12e4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.700+0000 7f821baca740 1 --2- 172.21.15.50:0/1789170133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 0x558be12e4050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f82040bbeb0 tx=0x7f820403b460 comp rx=0 tx=0).stop 2024-09-10T10:13:09.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.700+0000 7f821baca740 1 -- 172.21.15.50:0/1789170133 shutdown_connections 2024-09-10T10:13:09.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.700+0000 7f821baca740 1 --2- 172.21.15.50:0/1789170133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12eee50 0x558be12f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.700+0000 7f821baca740 1 --2- 172.21.15.50:0/1789170133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e4590 0x558be12ee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.700+0000 7f821baca740 1 --2- 172.21.15.50:0/1789170133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 0x558be12e4050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.700+0000 7f821baca740 1 -- 172.21.15.50:0/1789170133 >> 172.21.15.50:0/1789170133 conn(0x558be12e0200 msgr2=0x558be12e05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:09.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.700+0000 7f821baca740 1 -- 172.21.15.50:0/1789170133 shutdown_connections 2024-09-10T10:13:09.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.701+0000 7f821baca740 1 -- 172.21.15.50:0/1789170133 wait complete. 2024-09-10T10:13:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.701+0000 7f821baca740 1 -- start start 2024-09-10T10:13:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.701+0000 7f821baca740 1 Processor -- start 2024-09-10T10:13:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f821baca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 0x558be12ebd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f821baca740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12e4590 0x558be12ec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f821baca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12eee50 0x558be12ec810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f821baca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558be12f17e0 con 0x558be12eee50 2024-09-10T10:13:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f821baca740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558be12050f0 con 0x558be12e4590 2024-09-10T10:13:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f821baca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558be12f1960 con 0x558be12e3c70 2024-09-10T10:13:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f821baca740 10 client.0 _ll_register_callbacks cb 0x558be11ecbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f8211e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 0x558be12ebd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f8211e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 0x558be12ebd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:43590/0 (socket says 172.21.15.50:43590) 2024-09-10T10:13:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f8211e00640 1 -- 172.21.15.50:0/2638658133 learned_addr learned my addr 172.21.15.50:0/2638658133 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f8212800640 1 --2- 172.21.15.50:0/2638658133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12eee50 0x558be12ec810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f8211400640 1 --2- 172.21.15.50:0/2638658133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12e4590 0x558be12ec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f8211e00640 1 -- 172.21.15.50:0/2638658133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12e4590 msgr2=0x558be12ec2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f8211e00640 1 --2- 172.21.15.50:0/2638658133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12e4590 0x558be12ec2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f8211e00640 1 -- 172.21.15.50:0/2638658133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12eee50 msgr2=0x558be12ec810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:09.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f8211e00640 1 --2- 172.21.15.50:0/2638658133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12eee50 0x558be12ec810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.702+0000 7f8211e00640 1 -- 172.21.15.50:0/2638658133 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be0fbb3c0 con 0x558be12e3c70 2024-09-10T10:13:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.703+0000 7f8211e00640 1 --2- 172.21.15.50:0/2638658133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 0x558be12ebd90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8204031550 tx=0x7f82040b8610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2925e6f24a25d60 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.703+0000 7f81f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:13:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.703+0000 7f81f3e00640 1 -- 172.21.15.50:0/2638658133 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82040d9070 con 0x558be12e3c70 2024-09-10T10:13:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.703+0000 7f81f3e00640 1 -- 172.21.15.50:0/2638658133 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f82040c4650 con 0x558be12e3c70 2024-09-10T10:13:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.703+0000 7f821baca740 1 -- 172.21.15.50:0/2638658133 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82040c0220 con 0x558be12e3c70 2024-09-10T10:13:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.703+0000 7f81f3e00640 1 -- 172.21.15.50:0/2638658133 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8204049050 con 0x558be12e3c70 2024-09-10T10:13:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.703+0000 7f821baca740 10 client.25630 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.703+0000 7f821baca740 1 -- 172.21.15.50:0/2638658133 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558be12f17e0 con 0x558be12e3c70 2024-09-10T10:13:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.704+0000 7f81f3e00640 1 -- 172.21.15.50:0/2638658133 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82040c0220 con 0x558be12e3c70 2024-09-10T10:13:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.704+0000 7f81f3e00640 1 -- 172.21.15.50:0/2638658133 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f82040ae030 con 0x558be12e3c70 2024-09-10T10:13:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.704+0000 7f821baca740 10 client.25630 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:09.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.704+0000 7f821baca740 10 client.25630 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:13:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.704+0000 7f821baca740 20 client.25630 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.704+0000 7f821baca740 1 --2- 172.21.15.50:0/2638658133 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558be12fe960 0x558be1300d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.704+0000 7f821baca740 4 client.25630 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.704+0000 7f821baca740 1 -- 172.21.15.50:0/2638658133 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558be1257950 con 0x558be12fe960 2024-09-10T10:13:09.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.704+0000 7f8211400640 1 --2- 172.21.15.50:0/2638658133 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558be12fe960 0x558be1300d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.705+0000 7f8211400640 1 --2- 172.21.15.50:0/2638658133 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558be12fe960 0x558be1300d50 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2dce602bd8df0301 server_cookie=1283e60f58dac3a0 in_seq=0 out_seq=0 2024-09-10T10:13:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.705+0000 7f81f3e00640 10 client.25630 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.706+0000 7f81f3e00640 1 -- 172.21.15.50:0/2638658133 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558be1257950 con 0x558be12fe960 2024-09-10T10:13:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.706+0000 7f81f3e00640 10 client.25630 handle_command_reply: tid=0 2024-09-10T10:13:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.706+0000 7f821baca740 1 client.25630 shutdown 2024-09-10T10:13:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.706+0000 7f821baca740 1 -- 172.21.15.50:0/2638658133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 msgr2=0x558be12ebd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.706+0000 7f821baca740 1 --2- 172.21.15.50:0/2638658133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 0x558be12ebd90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8204031550 tx=0x7f82040b8610 comp rx=0 tx=0).stop 2024-09-10T10:13:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.706+0000 7f821baca740 1 -- 172.21.15.50:0/2638658133 shutdown_connections 2024-09-10T10:13:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.706+0000 7f821baca740 1 --2- 172.21.15.50:0/2638658133 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558be12fe960 0x558be1300d50 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.706+0000 7f821baca740 1 --2- 172.21.15.50:0/2638658133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12eee50 0x558be12ec810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.706+0000 7f821baca740 1 --2- 172.21.15.50:0/2638658133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12e4590 0x558be12ec2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.706+0000 7f821baca740 1 --2- 172.21.15.50:0/2638658133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e3c70 0x558be12ebd90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.706+0000 7f821baca740 1 -- 172.21.15.50:0/2638658133 >> 172.21.15.50:0/2638658133 conn(0x558be12e0200 msgr2=0x558be12e5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.706+0000 7f81f3e00640 0 client.25630 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.707+0000 7f821baca740 1 -- 172.21.15.50:0/2638658133 shutdown_connections 2024-09-10T10:13:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.707+0000 7f821baca740 1 -- 172.21.15.50:0/2638658133 wait complete. 2024-09-10T10:13:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.707+0000 7f821baca740 20 client.25630 trim_cache size 0 max 16384 2024-09-10T10:13:09.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.722+0000 7f821baca740 1 Processor -- start 2024-09-10T10:13:09.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.722+0000 7f821baca740 1 -- start start 2024-09-10T10:13:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.722+0000 7f821baca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e3c70 0x558be12edd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.722+0000 7f821baca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e4590 0x558be1306530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.722+0000 7f821baca740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12eee50 0x558be1306a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.722+0000 7f821baca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82141b3820 con 0x558be12e3c70 2024-09-10T10:13:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.722+0000 7f821baca740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f82141b10f0 con 0x558be12eee50 2024-09-10T10:13:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.722+0000 7f821baca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f82141aef40 con 0x558be12e4590 2024-09-10T10:13:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.723+0000 7f8211e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e3c70 0x558be12edd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.723+0000 7f8211400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e4590 0x558be1306530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.723+0000 7f8211400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e4590 0x558be1306530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:43602/0 (socket says 172.21.15.50:43602) 2024-09-10T10:13:09.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.723+0000 7f8211400640 1 -- 172.21.15.50:0/567346990 learned_addr learned my addr 172.21.15.50:0/567346990 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.723+0000 7f8212800640 1 --2- 172.21.15.50:0/567346990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12eee50 0x558be1306a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.723+0000 7f8211400640 1 -- 172.21.15.50:0/567346990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12eee50 msgr2=0x558be1306a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.723+0000 7f8211400640 1 --2- 172.21.15.50:0/567346990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12eee50 0x558be1306a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.723+0000 7f8211400640 1 -- 172.21.15.50:0/567346990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e3c70 msgr2=0x558be12edd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:09.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.723+0000 7f8211400640 1 --2- 172.21.15.50:0/567346990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e3c70 0x558be12edd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.723+0000 7f8211400640 1 -- 172.21.15.50:0/567346990 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be12e12b0 con 0x558be12e4590 2024-09-10T10:13:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.723+0000 7f8212800640 1 --2- 172.21.15.50:0/567346990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12eee50 0x558be1306a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:13:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.723+0000 7f8211400640 1 --2- 172.21.15.50:0/567346990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e4590 0x558be1306530 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x558be12e1060 tx=0x7f8200014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=797ea10c6b05b7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.724+0000 7f81fea00640 1 -- 172.21.15.50:0/567346990 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200003cc0 con 0x558be12e4590 2024-09-10T10:13:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.724+0000 7f81fea00640 1 -- 172.21.15.50:0/567346990 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8200003e60 con 0x558be12e4590 2024-09-10T10:13:09.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.724+0000 7f81fea00640 1 -- 172.21.15.50:0/567346990 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200029760 con 0x558be12e4590 2024-09-10T10:13:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.725+0000 7f821baca740 1 -- 172.21.15.50:0/567346990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e4590 msgr2=0x558be1306530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.725+0000 7f821baca740 1 --2- 172.21.15.50:0/567346990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e4590 0x558be1306530 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x558be12e1060 tx=0x7f8200014000 comp rx=0 tx=0).stop 2024-09-10T10:13:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.725+0000 7f821baca740 1 -- 172.21.15.50:0/567346990 shutdown_connections 2024-09-10T10:13:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.725+0000 7f821baca740 1 --2- 172.21.15.50:0/567346990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12eee50 0x558be1306a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.725+0000 7f821baca740 1 --2- 172.21.15.50:0/567346990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12e4590 0x558be1306530 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.725+0000 7f821baca740 1 --2- 172.21.15.50:0/567346990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e3c70 0x558be12edd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.725+0000 7f821baca740 1 -- 172.21.15.50:0/567346990 >> 172.21.15.50:0/567346990 conn(0x558be12e0200 msgr2=0x558be12ed5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:09.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.725+0000 7f821baca740 1 -- 172.21.15.50:0/567346990 shutdown_connections 2024-09-10T10:13:09.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.725+0000 7f821baca740 1 -- 172.21.15.50:0/567346990 wait complete. 2024-09-10T10:13:09.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.726+0000 7f821baca740 1 -- start start 2024-09-10T10:13:09.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.726+0000 7f821baca740 1 Processor -- start 2024-09-10T10:13:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f821baca740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12e3c70 0x558be12f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f821baca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e4590 0x558be12f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f821baca740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12eee50 0x558be12f3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f821baca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82141af5b0 con 0x558be12e4590 2024-09-10T10:13:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f821baca740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f82141b0a20 con 0x558be12e3c70 2024-09-10T10:13:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f821baca740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f82141afc80 con 0x558be12eee50 2024-09-10T10:13:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f821baca740 10 client.0 _ll_register_callbacks cb 0x7f82040d7070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f8211e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12e3c70 0x558be12f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f8211e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12e3c70 0x558be12f28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:57332/0 (socket says 172.21.15.50:57332) 2024-09-10T10:13:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f8211e00640 1 -- 172.21.15.50:0/3477375335 learned_addr learned my addr 172.21.15.50:0/3477375335 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f8212800640 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12eee50 0x558be12f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f8211400640 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e4590 0x558be12f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f8211e00640 1 -- 172.21.15.50:0/3477375335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12eee50 msgr2=0x558be12f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f8211e00640 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12eee50 0x558be12f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f8211e00640 1 -- 172.21.15.50:0/3477375335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e4590 msgr2=0x558be12f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f8211e00640 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e4590 0x558be12f2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.727+0000 7f8211e00640 1 -- 172.21.15.50:0/3477375335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be12e0e90 con 0x558be12e3c70 2024-09-10T10:13:09.730 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.728+0000 7f8212800640 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12eee50 0x558be12f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.728+0000 7f8211e00640 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12e3c70 0x558be12f28e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f82040096c0 tx=0x7f82040ba080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a50bc28eb9f7df2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.728+0000 7f81f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.728+0000 7f81f3e00640 1 -- 172.21.15.50:0/3477375335 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82040d9070 con 0x558be12e3c70 2024-09-10T10:13:09.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.728+0000 7f81f3e00640 1 -- 172.21.15.50:0/3477375335 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f82040c4650 con 0x558be12e3c70 2024-09-10T10:13:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.728+0000 7f821baca740 1 -- 172.21.15.50:0/3477375335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8200003e60 con 0x558be12e3c70 2024-09-10T10:13:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.728+0000 7f81f3e00640 1 -- 172.21.15.50:0/3477375335 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f82040d1050 con 0x558be12e3c70 2024-09-10T10:13:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.728+0000 7f821baca740 10 client.25664 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.728+0000 7f821baca740 1 -- 172.21.15.50:0/3477375335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558be12db770 con 0x558be12e3c70 2024-09-10T10:13:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.729+0000 7f81f3e00640 1 -- 172.21.15.50:0/3477375335 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8200003e60 con 0x558be12e3c70 2024-09-10T10:13:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.729+0000 7f81f3e00640 1 -- 172.21.15.50:0/3477375335 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f82040cc030 con 0x558be12e3c70 2024-09-10T10:13:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.729+0000 7f821baca740 10 client.25664 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.729+0000 7f821baca740 10 client.25664 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:13:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.729+0000 7f821baca740 20 client.25664 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.729+0000 7f821baca740 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558be13697d0 0x558be136bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.729+0000 7f821baca740 4 client.25664 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:13:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.729+0000 7f821baca740 1 -- 172.21.15.50:0/3477375335 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558be1251e60 con 0x558be13697d0 2024-09-10T10:13:09.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.730+0000 7f8211400640 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558be13697d0 0x558be136bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.730+0000 7f8211400640 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558be13697d0 0x558be136bbc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2e32ce1f5a2a664b server_cookie=93ce41aac53bdf96 in_seq=0 out_seq=0 2024-09-10T10:13:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.730+0000 7f81f3e00640 10 client.25664 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.730+0000 7f81f3e00640 1 -- 172.21.15.50:0/3477375335 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558be1251e60 con 0x558be13697d0 2024-09-10T10:13:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.730+0000 7f81f3e00640 10 client.25664 handle_command_reply: tid=0 2024-09-10T10:13:09.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.730+0000 7f821baca740 1 client.25664 shutdown 2024-09-10T10:13:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.731+0000 7f821baca740 1 -- 172.21.15.50:0/3477375335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12e3c70 msgr2=0x558be12f28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.731+0000 7f821baca740 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12e3c70 0x558be12f28e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f82040096c0 tx=0x7f82040ba080 comp rx=0 tx=0).stop 2024-09-10T10:13:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.731+0000 7f821baca740 1 -- 172.21.15.50:0/3477375335 shutdown_connections 2024-09-10T10:13:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.731+0000 7f821baca740 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x558be13697d0 0x558be136bbc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.731+0000 7f821baca740 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558be12eee50 0x558be12f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.731+0000 7f821baca740 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558be12e4590 0x558be12f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.731+0000 7f821baca740 1 --2- 172.21.15.50:0/3477375335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558be12e3c70 0x558be12f28e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.731+0000 7f821baca740 1 -- 172.21.15.50:0/3477375335 >> 172.21.15.50:0/3477375335 conn(0x558be12e0200 msgr2=0x558be12ede10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.731+0000 7f81f3e00640 0 client.25664 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.731+0000 7f821baca740 1 -- 172.21.15.50:0/3477375335 shutdown_connections 2024-09-10T10:13:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.731+0000 7f821baca740 1 -- 172.21.15.50:0/3477375335 wait complete. 2024-09-10T10:13:09.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.731+0000 7f821baca740 20 client.25664 trim_cache size 0 max 16384 2024-09-10T10:13:09.735 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:13:09.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.732+0000 7f8219000640 1 -- 172.21.15.50:0/3117192578 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f81f80a2c00 msgr2=0x7f81f80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.732+0000 7f8219000640 1 --2- 172.21.15.50:0/3117192578 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f81f80a2c00 0x7f81f80a50c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f82140ffe70 tx=0x7f8200005f90 comp rx=0 tx=0).stop 2024-09-10T10:13:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.732+0000 7f8219000640 1 -- 172.21.15.50:0/3117192578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8214104010 msgr2=0x7f821419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.732+0000 7f8219000640 1 --2- 172.21.15.50:0/3117192578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8214104010 0x7f821419a640 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8204004770 tx=0x7f8204003c10 comp rx=0 tx=0).stop 2024-09-10T10:13:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.732+0000 7f8219000640 1 -- 172.21.15.50:0/3117192578 shutdown_connections 2024-09-10T10:13:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.732+0000 7f8219000640 1 --2- 172.21.15.50:0/3117192578 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f81f80a2c00 0x7f81f80a50c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.732+0000 7f8219000640 1 --2- 172.21.15.50:0/3117192578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8214109140 0x7f821419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.732+0000 7f8219000640 1 --2- 172.21.15.50:0/3117192578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82141049c0 0x7f821419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.732+0000 7f8219000640 1 --2- 172.21.15.50:0/3117192578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8214104010 0x7f821419a640 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.732+0000 7f8219000640 1 -- 172.21.15.50:0/3117192578 >> 172.21.15.50:0/3117192578 conn(0x7f82140ffa50 msgr2=0x7f8214100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.732+0000 7f8219000640 1 -- 172.21.15.50:0/3117192578 shutdown_connections 2024-09-10T10:13:09.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:09.732+0000 7f8219000640 1 -- 172.21.15.50:0/3117192578 wait complete. 2024-09-10T10:13:10.030 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:10.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T10:13:10.737 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:10 smithi050 ceph-mon[30354]: pgmap v450: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T10:13:11.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:10 smithi189 ceph-mon[34999]: pgmap v450: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T10:13:11.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:10 smithi084 ceph-mon[34812]: pgmap v450: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-10T10:13:11.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.152+0000 7f525d000640 1 -- 172.21.15.50:0/2127221183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52581047e0 msgr2=0x7f5258108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.152+0000 7f525d000640 1 --2- 172.21.15.50:0/2127221183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52581047e0 0x7f5258108830 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5244009860 tx=0x7f524402a340 comp rx=0 tx=0).stop 2024-09-10T10:13:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.153+0000 7f525d000640 1 -- 172.21.15.50:0/2127221183 shutdown_connections 2024-09-10T10:13:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.153+0000 7f525d000640 1 --2- 172.21.15.50:0/2127221183 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5258108f60 0x7f5258110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.153+0000 7f525d000640 1 --2- 172.21.15.50:0/2127221183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52581047e0 0x7f5258108830 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.153+0000 7f525d000640 1 --2- 172.21.15.50:0/2127221183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5258103e30 0x7f5258104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.153+0000 7f525d000640 1 -- 172.21.15.50:0/2127221183 >> 172.21.15.50:0/2127221183 conn(0x7f52580ff8d0 msgr2=0x7f5258101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.153+0000 7f525d000640 1 -- 172.21.15.50:0/2127221183 shutdown_connections 2024-09-10T10:13:11.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.153+0000 7f525d000640 1 -- 172.21.15.50:0/2127221183 wait complete. 2024-09-10T10:13:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.154+0000 7f525d000640 1 Processor -- start 2024-09-10T10:13:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.154+0000 7f525d000640 1 -- start start 2024-09-10T10:13:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.154+0000 7f525d000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5258103e30 0x7f525819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.154+0000 7f525d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52581047e0 0x7f525819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.154+0000 7f525d000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5258108f60 0x7f525819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.154+0000 7f525d000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5258113f80 con 0x7f5258108f60 2024-09-10T10:13:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.154+0000 7f525d000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5258113e00 con 0x7f52581047e0 2024-09-10T10:13:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.154+0000 7f525d000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5258114100 con 0x7f5258103e30 2024-09-10T10:13:11.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.155+0000 7f5257e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5258108f60 0x7f525819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.155+0000 7f5257400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5258103e30 0x7f525819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.155+0000 7f5257e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5258108f60 0x7f525819ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50912/0 (socket says 172.21.15.50:50912) 2024-09-10T10:13:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.155+0000 7f5257e00640 1 -- 172.21.15.50:0/3971994556 learned_addr learned my addr 172.21.15.50:0/3971994556 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.155+0000 7f5256a00640 1 --2- 172.21.15.50:0/3971994556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52581047e0 0x7f525819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.155+0000 7f5256a00640 1 -- 172.21.15.50:0/3971994556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5258103e30 msgr2=0x7f525819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.155+0000 7f5256a00640 1 --2- 172.21.15.50:0/3971994556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5258103e30 0x7f525819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.155+0000 7f5256a00640 1 -- 172.21.15.50:0/3971994556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5258108f60 msgr2=0x7f525819ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.155+0000 7f5256a00640 1 --2- 172.21.15.50:0/3971994556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5258108f60 0x7f525819ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.155+0000 7f5256a00640 1 -- 172.21.15.50:0/3971994556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525819f3f0 con 0x7f52581047e0 2024-09-10T10:13:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.155+0000 7f5256a00640 1 --2- 172.21.15.50:0/3971994556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52581047e0 0x7f525819a980 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f524402a860 tx=0x7f5244033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.156+0000 7f524fe00640 1 -- 172.21.15.50:0/3971994556 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244037040 con 0x7f52581047e0 2024-09-10T10:13:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.156+0000 7f525d000640 1 -- 172.21.15.50:0/3971994556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525819f680 con 0x7f52581047e0 2024-09-10T10:13:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.156+0000 7f524fe00640 1 -- 172.21.15.50:0/3971994556 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5244030550 con 0x7f52581047e0 2024-09-10T10:13:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.156+0000 7f524fe00640 1 -- 172.21.15.50:0/3971994556 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244003a30 con 0x7f52581047e0 2024-09-10T10:13:11.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.156+0000 7f525d000640 1 -- 172.21.15.50:0/3971994556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52581a6fc0 con 0x7f52581047e0 2024-09-10T10:13:11.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.157+0000 7f525d000640 1 -- 172.21.15.50:0/3971994556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5258104210 con 0x7f52581047e0 2024-09-10T10:13:11.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.159+0000 7f524fe00640 1 -- 172.21.15.50:0/3971994556 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5244042020 con 0x7f52581047e0 2024-09-10T10:13:11.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.160+0000 7f524fe00640 1 --2- 172.21.15.50:0/3971994556 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f523c0a2b80 0x7f523c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.161+0000 7f524fe00640 1 -- 172.21.15.50:0/3971994556 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f52440eea80 con 0x7f52581047e0 2024-09-10T10:13:11.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.161+0000 7f5257400640 1 --2- 172.21.15.50:0/3971994556 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f523c0a2b80 0x7f523c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.161+0000 7f5257400640 1 --2- 172.21.15.50:0/3971994556 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f523c0a2b80 0x7f523c0a5040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5248009530 tx=0x7f5248009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.165+0000 7f524fe00640 1 -- 172.21.15.50:0/3971994556 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52440f0e20 con 0x7f52581047e0 2024-09-10T10:13:11.219 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:11.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.408+0000 7f525d000640 1 -- 172.21.15.50:0/3971994556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f525810c170 con 0x7f52581047e0 2024-09-10T10:13:11.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.409+0000 7f524fe00640 1 -- 172.21.15.50:0/3971994556 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f5244049020 con 0x7f52581047e0 2024-09-10T10:13:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:13:11.411 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:13:11.411 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:13:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.411+0000 7f525d000640 1 -- 172.21.15.50:0/3971994556 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f523c0a2b80 msgr2=0x7f523c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.411+0000 7f525d000640 1 --2- 172.21.15.50:0/3971994556 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f523c0a2b80 0x7f523c0a5040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5248009530 tx=0x7f5248009260 comp rx=0 tx=0).stop 2024-09-10T10:13:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.411+0000 7f525d000640 1 -- 172.21.15.50:0/3971994556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52581047e0 msgr2=0x7f525819a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.411+0000 7f525d000640 1 --2- 172.21.15.50:0/3971994556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52581047e0 0x7f525819a980 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f524402a860 tx=0x7f5244033d90 comp rx=0 tx=0).stop 2024-09-10T10:13:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.411+0000 7f525d000640 1 -- 172.21.15.50:0/3971994556 shutdown_connections 2024-09-10T10:13:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.411+0000 7f525d000640 1 --2- 172.21.15.50:0/3971994556 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f523c0a2b80 0x7f523c0a5040 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.411+0000 7f525d000640 1 --2- 172.21.15.50:0/3971994556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5258108f60 0x7f525819ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.411+0000 7f525d000640 1 --2- 172.21.15.50:0/3971994556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52581047e0 0x7f525819a980 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.411+0000 7f525d000640 1 --2- 172.21.15.50:0/3971994556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5258103e30 0x7f525819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.411+0000 7f525d000640 1 -- 172.21.15.50:0/3971994556 >> 172.21.15.50:0/3971994556 conn(0x7f52580ff8d0 msgr2=0x7f5258100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.411+0000 7f525d000640 1 -- 172.21.15.50:0/3971994556 shutdown_connections 2024-09-10T10:13:11.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.411+0000 7f525d000640 1 -- 172.21.15.50:0/3971994556 wait complete. 2024-09-10T10:13:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.886+0000 7f5715200640 1 -- 172.21.15.50:0/3405901765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5710074eb0 msgr2=0x7f5710112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.886+0000 7f5715200640 1 --2- 172.21.15.50:0/3405901765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5710074eb0 0x7f5710112650 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009900 tx=0x7f56fc02a480 comp rx=0 tx=0).stop 2024-09-10T10:13:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.886+0000 7f5715200640 1 -- 172.21.15.50:0/3405901765 shutdown_connections 2024-09-10T10:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.886+0000 7f5715200640 1 --2- 172.21.15.50:0/3405901765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5710112b90 0x7f5710114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.886+0000 7f5715200640 1 --2- 172.21.15.50:0/3405901765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5710074eb0 0x7f5710112650 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.886+0000 7f5715200640 1 --2- 172.21.15.50:0/3405901765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5710074590 0x7f5710074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.886+0000 7f5715200640 1 -- 172.21.15.50:0/3405901765 >> 172.21.15.50:0/3405901765 conn(0x7f57100fd8c0 msgr2=0x7f57100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.886+0000 7f5715200640 1 -- 172.21.15.50:0/3405901765 shutdown_connections 2024-09-10T10:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.886+0000 7f5715200640 1 -- 172.21.15.50:0/3405901765 wait complete. 2024-09-10T10:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.887+0000 7f5715200640 1 Processor -- start 2024-09-10T10:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.887+0000 7f5715200640 1 -- start start 2024-09-10T10:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.887+0000 7f5715200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5710074590 0x7f57101a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.887+0000 7f5715200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5710074eb0 0x7f57101a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.887+0000 7f5715200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5710112b90 0x7f571019e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.887+0000 7f5715200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5710118560 con 0x7f5710112b90 2024-09-10T10:13:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.887+0000 7f5715200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f57101183e0 con 0x7f5710074590 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.887+0000 7f5715200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f57101186e0 con 0x7f5710074eb0 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.888+0000 7f570de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5710074590 0x7f57101a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.888+0000 7f570de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5710074590 0x7f57101a4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:57376/0 (socket says 172.21.15.50:57376) 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.888+0000 7f570de00640 1 -- 172.21.15.50:0/4190608442 learned_addr learned my addr 172.21.15.50:0/4190608442 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.888+0000 7f570e800640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5710112b90 0x7f571019e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.888+0000 7f570d400640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5710074eb0 0x7f57101a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.888+0000 7f570de00640 1 -- 172.21.15.50:0/4190608442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5710074eb0 msgr2=0x7f57101a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.888+0000 7f570de00640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5710074eb0 0x7f57101a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.888+0000 7f570de00640 1 -- 172.21.15.50:0/4190608442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5710112b90 msgr2=0x7f571019e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.888+0000 7f570de00640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5710112b90 0x7f571019e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.888+0000 7f570de00640 1 -- 172.21.15.50:0/4190608442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571019f020 con 0x7f5710074590 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.888+0000 7f570de00640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5710074590 0x7f57101a4730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f570000e9f0 tx=0x7f570000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.889+0000 7f5706a00640 1 -- 172.21.15.50:0/4190608442 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570000cd80 con 0x7f5710074590 2024-09-10T10:13:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.889+0000 7f5706a00640 1 -- 172.21.15.50:0/4190608442 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5700005500 con 0x7f5710074590 2024-09-10T10:13:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.889+0000 7f5715200640 1 -- 172.21.15.50:0/4190608442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571019f310 con 0x7f5710074590 2024-09-10T10:13:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.889+0000 7f5706a00640 1 -- 172.21.15.50:0/4190608442 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700010690 con 0x7f5710074590 2024-09-10T10:13:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.889+0000 7f5715200640 1 -- 172.21.15.50:0/4190608442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57101ab600 con 0x7f5710074590 2024-09-10T10:13:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.892+0000 7f5717de6740 1 Processor -- start 2024-09-10T10:13:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.892+0000 7f5717de6740 1 -- start start 2024-09-10T10:13:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.892+0000 7f5706a00640 1 -- 172.21.15.50:0/4190608442 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f57000046c0 con 0x7f5710074590 2024-09-10T10:13:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.892+0000 7f5717de6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500f2c70 0x55d8500f3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.892+0000 7f5717de6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f3590 0x55d8500fd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.892+0000 7f5717de6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500fde50 0x55d850100240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.892+0000 7f5717de6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d8500593e0 con 0x55d8500f3590 2024-09-10T10:13:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.892+0000 7f5717de6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d850000d80 con 0x55d8500fde50 2024-09-10T10:13:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.892+0000 7f5717de6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d8500553a0 con 0x55d8500f2c70 2024-09-10T10:13:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.893+0000 7f570de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f3590 0x55d8500fd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.893+0000 7f570e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500f2c70 0x55d8500f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.893+0000 7f570e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500f2c70 0x55d8500f3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:43684/0 (socket says 172.21.15.50:43684) 2024-09-10T10:13:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.893+0000 7f570e800640 1 -- 172.21.15.50:0/4136233107 learned_addr learned my addr 172.21.15.50:0/4136233107 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.893+0000 7f570d400640 1 --2- 172.21.15.50:0/4136233107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500fde50 0x55d850100240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.893+0000 7f570e800640 1 -- 172.21.15.50:0/4136233107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500fde50 msgr2=0x55d850100240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.893+0000 7f570e800640 1 --2- 172.21.15.50:0/4136233107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500fde50 0x55d850100240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.893+0000 7f570e800640 1 -- 172.21.15.50:0/4136233107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f3590 msgr2=0x55d8500fd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.893+0000 7f570e800640 1 --2- 172.21.15.50:0/4136233107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f3590 0x55d8500fd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.893+0000 7f570e800640 1 -- 172.21.15.50:0/4136233107 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d85001fae0 con 0x55d8500f2c70 2024-09-10T10:13:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.893+0000 7f570de00640 1 --2- 172.21.15.50:0/4136233107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f3590 0x55d8500fd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.893+0000 7f570e800640 1 --2- 172.21.15.50:0/4136233107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500f2c70 0x55d8500f3050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5708009f30 tx=0x7f57080118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d803ba68598c7b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.894+0000 7f56fb400640 1 -- 172.21.15.50:0/4136233107 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708004d20 con 0x55d8500f2c70 2024-09-10T10:13:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.894+0000 7f56fb400640 1 -- 172.21.15.50:0/4136233107 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5708004050 con 0x55d8500f2c70 2024-09-10T10:13:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.894+0000 7f56fb400640 1 -- 172.21.15.50:0/4136233107 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708005260 con 0x55d8500f2c70 2024-09-10T10:13:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.894+0000 7f5706a00640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f56f40a2c00 0x7f56f40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.894+0000 7f5706a00640 1 -- 172.21.15.50:0/4190608442 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f57000cf860 con 0x7f5710074590 2024-09-10T10:13:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.894+0000 7f570de00640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f56f40a2c00 0x7f56f40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.894+0000 7f5717de6740 1 -- 172.21.15.50:0/4136233107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500f2c70 msgr2=0x55d8500f3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.894+0000 7f5717de6740 1 --2- 172.21.15.50:0/4136233107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500f2c70 0x55d8500f3050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5708009f30 tx=0x7f57080118d0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.894+0000 7f5717de6740 1 -- 172.21.15.50:0/4136233107 shutdown_connections 2024-09-10T10:13:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.894+0000 7f5717de6740 1 --2- 172.21.15.50:0/4136233107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500fde50 0x55d850100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.894+0000 7f5717de6740 1 --2- 172.21.15.50:0/4136233107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f3590 0x55d8500fd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.895+0000 7f5717de6740 1 --2- 172.21.15.50:0/4136233107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500f2c70 0x55d8500f3050 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.895+0000 7f5717de6740 1 -- 172.21.15.50:0/4136233107 >> 172.21.15.50:0/4136233107 conn(0x55d8500ef200 msgr2=0x55d8500ef5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.895+0000 7f5717de6740 1 -- 172.21.15.50:0/4136233107 shutdown_connections 2024-09-10T10:13:11.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.895+0000 7f5717de6740 1 -- 172.21.15.50:0/4136233107 wait complete. 2024-09-10T10:13:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.895+0000 7f570de00640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f56f40a2c00 0x7f56f40a50c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f570009bc60 tx=0x7f57000d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.895+0000 7f5717de6740 1 -- start start 2024-09-10T10:13:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.895+0000 7f5717de6740 1 Processor -- start 2024-09-10T10:13:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.896+0000 7f5717de6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f2c70 0x55d8500fad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.896+0000 7f5717de6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500f3590 0x55d8500fb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.896+0000 7f5717de6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500fde50 0x55d8500fb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.896+0000 7f5717de6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d850100a20 con 0x55d8500fde50 2024-09-10T10:13:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.896+0000 7f5717de6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d8500140f0 con 0x55d8500f2c70 2024-09-10T10:13:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.896+0000 7f5717de6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d850100ba0 con 0x55d8500f3590 2024-09-10T10:13:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.896+0000 7f5717de6740 10 client.0 _ll_register_callbacks cb 0x55d84fffbbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.896+0000 7f570e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500fde50 0x55d8500fb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.920 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:11 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3971994556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:11.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.896+0000 7f570e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f2c70 0x55d8500fad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.896+0000 7f570d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500f3590 0x55d8500fb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.896+0000 7f570e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f2c70 0x55d8500fad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:57386/0 (socket says 172.21.15.50:57386) 2024-09-10T10:13:11.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.896+0000 7f570e800640 1 -- 172.21.15.50:0/904594165 learned_addr learned my addr 172.21.15.50:0/904594165 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:11.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.897+0000 7f570e800640 1 -- 172.21.15.50:0/904594165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500f3590 msgr2=0x55d8500fb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:11.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.897+0000 7f570e800640 1 --2- 172.21.15.50:0/904594165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500f3590 0x55d8500fb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.897+0000 7f570e800640 1 -- 172.21.15.50:0/904594165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500fde50 msgr2=0x55d8500fb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:11.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.897+0000 7f570e800640 1 --2- 172.21.15.50:0/904594165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500fde50 0x55d8500fb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.897+0000 7f570e800640 1 -- 172.21.15.50:0/904594165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d84fdca3c0 con 0x55d8500f2c70 2024-09-10T10:13:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.897+0000 7f570d400640 1 --2- 172.21.15.50:0/904594165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500f3590 0x55d8500fb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.897+0000 7f570e800640 1 --2- 172.21.15.50:0/904594165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f2c70 0x55d8500fad20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5708011dd0 tx=0x7f5708000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17ef84f37c456317 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.897+0000 7f56efe00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.897+0000 7f56efe00640 1 -- 172.21.15.50:0/904594165 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570802c020 con 0x55d8500f2c70 2024-09-10T10:13:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.897+0000 7f5717de6740 1 -- 172.21.15.50:0/904594165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5708004050 con 0x55d8500f2c70 2024-09-10T10:13:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.898+0000 7f56efe00640 1 -- 172.21.15.50:0/904594165 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f5708028650 con 0x55d8500f2c70 2024-09-10T10:13:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.898+0000 7f56efe00640 1 -- 172.21.15.50:0/904594165 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5708037050 con 0x55d8500f2c70 2024-09-10T10:13:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.898+0000 7f5717de6740 10 client.25682 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.898+0000 7f5717de6740 1 -- 172.21.15.50:0/904594165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d85010ca40 con 0x55d8500f2c70 2024-09-10T10:13:11.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.898+0000 7f56efe00640 1 -- 172.21.15.50:0/904594165 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5708004050 con 0x55d8500f2c70 2024-09-10T10:13:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.899+0000 7f56efe00640 1 -- 172.21.15.50:0/904594165 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f570800f6e0 con 0x55d8500f2c70 2024-09-10T10:13:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.899+0000 7f5717de6740 10 client.25682 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.899+0000 7f5717de6740 10 client.25682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.899+0000 7f5717de6740 20 client.25682 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.899+0000 7f5717de6740 1 --2- 172.21.15.50:0/904594165 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55d85010de50 0x55d850110240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.899+0000 7f5717de6740 4 client.25682 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.899+0000 7f5717de6740 1 -- 172.21.15.50:0/904594165 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d850066950 con 0x55d85010de50 2024-09-10T10:13:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.899+0000 7f570d400640 1 --2- 172.21.15.50:0/904594165 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55d85010de50 0x55d850110240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.900+0000 7f570d400640 1 --2- 172.21.15.50:0/904594165 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55d85010de50 0x55d850110240 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d16f21d3687268f4 server_cookie=bcb796607f07a829 in_seq=0 out_seq=0 2024-09-10T10:13:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.900+0000 7f56efe00640 10 client.25682 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:11.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.900+0000 7f56efe00640 1 -- 172.21.15.50:0/904594165 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d850066950 con 0x55d85010de50 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.900+0000 7f56efe00640 10 client.25682 handle_command_reply: tid=0 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.900+0000 7f5717de6740 1 client.25682 shutdown 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.901+0000 7f5717de6740 1 -- 172.21.15.50:0/904594165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f2c70 msgr2=0x55d8500fad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.901+0000 7f5717de6740 1 --2- 172.21.15.50:0/904594165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f2c70 0x55d8500fad20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5708011dd0 tx=0x7f5708000f40 comp rx=0 tx=0).stop 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.901+0000 7f5717de6740 1 -- 172.21.15.50:0/904594165 shutdown_connections 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.901+0000 7f5717de6740 1 --2- 172.21.15.50:0/904594165 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55d85010de50 0x55d850110240 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.901+0000 7f5717de6740 1 --2- 172.21.15.50:0/904594165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500fde50 0x55d8500fb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.901+0000 7f5717de6740 1 --2- 172.21.15.50:0/904594165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500f3590 0x55d8500fb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.901+0000 7f5717de6740 1 --2- 172.21.15.50:0/904594165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f2c70 0x55d8500fad20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.901+0000 7f56efe00640 0 client.25682 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.901+0000 7f5717de6740 1 -- 172.21.15.50:0/904594165 >> 172.21.15.50:0/904594165 conn(0x55d8500ef200 msgr2=0x55d8500ee380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.901+0000 7f5717de6740 1 -- 172.21.15.50:0/904594165 shutdown_connections 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.901+0000 7f5717de6740 1 -- 172.21.15.50:0/904594165 wait complete. 2024-09-10T10:13:11.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.901+0000 7f5717de6740 20 client.25682 trim_cache size 0 max 16384 2024-09-10T10:13:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.915+0000 7f5717de6740 1 Processor -- start 2024-09-10T10:13:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.915+0000 7f5717de6740 1 -- start start 2024-09-10T10:13:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.916+0000 7f5717de6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f2c70 0x55d850115980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.916+0000 7f5717de6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f3590 0x55d850115ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.916+0000 7f5717de6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500fde50 0x55d8500f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.916+0000 7f5717de6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f57101b7c20 con 0x55d8500f2c70 2024-09-10T10:13:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.916+0000 7f5717de6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f57101b54f0 con 0x55d8500f3590 2024-09-10T10:13:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.916+0000 7f5717de6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f57101b3340 con 0x55d8500fde50 2024-09-10T10:13:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.916+0000 7f570e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f2c70 0x55d850115980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.916+0000 7f570e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f2c70 0x55d850115980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50936/0 (socket says 172.21.15.50:50936) 2024-09-10T10:13:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.916+0000 7f570e800640 1 -- 172.21.15.50:0/2028338746 learned_addr learned my addr 172.21.15.50:0/2028338746 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.916+0000 7f570d400640 1 --2- 172.21.15.50:0/2028338746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f3590 0x55d850115ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.917+0000 7f570e800640 1 --2- 172.21.15.50:0/2028338746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500fde50 0x55d8500f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.917+0000 7f570e800640 1 -- 172.21.15.50:0/2028338746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500fde50 msgr2=0x55d8500f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.917+0000 7f570e800640 1 --2- 172.21.15.50:0/2028338746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500fde50 0x55d8500f46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.917+0000 7f570e800640 1 -- 172.21.15.50:0/2028338746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f3590 msgr2=0x55d850115ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.917+0000 7f570e800640 1 --2- 172.21.15.50:0/2028338746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f3590 0x55d850115ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.917+0000 7f570e800640 1 -- 172.21.15.50:0/2028338746 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8500efe90 con 0x55d8500f2c70 2024-09-10T10:13:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.917+0000 7f570e800640 1 --2- 172.21.15.50:0/2028338746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f2c70 0x55d850115980 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f57080048c0 tx=0x7f5708004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704f10df6c7efa8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.917+0000 7f56faa00640 1 -- 172.21.15.50:0/2028338746 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570802c070 con 0x55d8500f2c70 2024-09-10T10:13:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.917+0000 7f56faa00640 1 -- 172.21.15.50:0/2028338746 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f570800fcd0 con 0x55d8500f2c70 2024-09-10T10:13:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.917+0000 7f56faa00640 1 -- 172.21.15.50:0/2028338746 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57080197a0 con 0x55d8500f2c70 2024-09-10T10:13:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.918+0000 7f5717de6740 1 -- 172.21.15.50:0/2028338746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f2c70 msgr2=0x55d850115980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.918+0000 7f5717de6740 1 --2- 172.21.15.50:0/2028338746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f2c70 0x55d850115980 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f57080048c0 tx=0x7f5708004640 comp rx=0 tx=0).stop 2024-09-10T10:13:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.918+0000 7f5717de6740 1 -- 172.21.15.50:0/2028338746 shutdown_connections 2024-09-10T10:13:11.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.918+0000 7f5717de6740 1 --2- 172.21.15.50:0/2028338746 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500fde50 0x55d8500f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.918+0000 7f5717de6740 1 --2- 172.21.15.50:0/2028338746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f3590 0x55d850115ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.918+0000 7f5717de6740 1 --2- 172.21.15.50:0/2028338746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f2c70 0x55d850115980 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.918+0000 7f5717de6740 1 -- 172.21.15.50:0/2028338746 >> 172.21.15.50:0/2028338746 conn(0x55d8500ef200 msgr2=0x55d8500fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.918+0000 7f5717de6740 1 -- 172.21.15.50:0/2028338746 shutdown_connections 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.918+0000 7f5717de6740 1 -- 172.21.15.50:0/2028338746 wait complete. 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.919+0000 7f5717de6740 1 -- start start 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.919+0000 7f5717de6740 1 Processor -- start 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f5717de6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f2c70 0x55d850100db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f5717de6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f3590 0x55d8501012f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f5717de6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500fde50 0x55d850101830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f5717de6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f57101b39b0 con 0x55d8500f2c70 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f5717de6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f57101b4e20 con 0x55d8500f3590 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f5717de6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f57101b4080 con 0x55d8500fde50 2024-09-10T10:13:11.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f5717de6740 10 client.0 _ll_register_callbacks cb 0x7f57000d5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f570d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f3590 0x55d8501012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f570e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f2c70 0x55d850100db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f570d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f3590 0x55d8501012f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:57400/0 (socket says 172.21.15.50:57400) 2024-09-10T10:13:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f570d400640 1 -- 172.21.15.50:0/2439426417 learned_addr learned my addr 172.21.15.50:0/2439426417 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f570e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f2c70 0x55d850100db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50950/0 (socket says 172.21.15.50:50950) 2024-09-10T10:13:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f570e800640 1 --2- 172.21.15.50:0/2439426417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500fde50 0x55d850101830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f570d400640 1 -- 172.21.15.50:0/2439426417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500fde50 msgr2=0x55d850101830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.920+0000 7f570d400640 1 --2- 172.21.15.50:0/2439426417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500fde50 0x55d850101830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.921+0000 7f570d400640 1 -- 172.21.15.50:0/2439426417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f2c70 msgr2=0x55d850100db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.921+0000 7f570d400640 1 --2- 172.21.15.50:0/2439426417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f2c70 0x55d850100db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.921+0000 7f570d400640 1 -- 172.21.15.50:0/2439426417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d850176b60 con 0x55d8500f3590 2024-09-10T10:13:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.921+0000 7f570e800640 1 --2- 172.21.15.50:0/2439426417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500fde50 0x55d850101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:13:11.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.921+0000 7f570d400640 1 --2- 172.21.15.50:0/2439426417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f3590 0x55d8501012f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f56fc02a9a0 tx=0x7f56fc0041a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f81284472f27c55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.921+0000 7f56efe00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.921+0000 7f56efe00640 1 -- 172.21.15.50:0/2439426417 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc035040 con 0x55d8500f3590 2024-09-10T10:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.921+0000 7f56efe00640 1 -- 172.21.15.50:0/2439426417 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f56fc005240 con 0x55d8500f3590 2024-09-10T10:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.921+0000 7f5717de6740 1 -- 172.21.15.50:0/2439426417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f570800fcd0 con 0x55d8500f3590 2024-09-10T10:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.922+0000 7f56efe00640 1 -- 172.21.15.50:0/2439426417 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f56fc054050 con 0x55d8500f3590 2024-09-10T10:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.922+0000 7f5717de6740 10 client.25688 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.922+0000 7f5717de6740 1 -- 172.21.15.50:0/2439426417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d850177ef0 con 0x55d8500f3590 2024-09-10T10:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.922+0000 7f56efe00640 1 -- 172.21.15.50:0/2439426417 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f570800fcd0 con 0x55d8500f3590 2024-09-10T10:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.922+0000 7f56efe00640 1 -- 172.21.15.50:0/2439426417 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f56fc0046c0 con 0x55d8500f3590 2024-09-10T10:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.922+0000 7f5717de6740 10 client.25688 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.922+0000 7f5717de6740 10 client.25688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.922+0000 7f5717de6740 20 client.25688 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:11.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.922+0000 7f5717de6740 1 --2- 172.21.15.50:0/2439426417 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55d8501786a0 0x55d85017aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:11.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.922+0000 7f5717de6740 4 client.25688 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:13:11.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.922+0000 7f5717de6740 1 -- 172.21.15.50:0/2439426417 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d850060e60 con 0x55d8501786a0 2024-09-10T10:13:11.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.923+0000 7f570e800640 1 --2- 172.21.15.50:0/2439426417 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55d8501786a0 0x55d85017aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.923+0000 7f570e800640 1 --2- 172.21.15.50:0/2439426417 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55d8501786a0 0x55d85017aac0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=808f3ebe768901d server_cookie=9119ff47bf280332 in_seq=0 out_seq=0 2024-09-10T10:13:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.923+0000 7f56efe00640 10 client.25688 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.923+0000 7f56efe00640 1 -- 172.21.15.50:0/2439426417 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d850060e60 con 0x55d8501786a0 2024-09-10T10:13:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.923+0000 7f56efe00640 10 client.25688 handle_command_reply: tid=0 2024-09-10T10:13:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.923+0000 7f5717de6740 1 client.25688 shutdown 2024-09-10T10:13:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.924+0000 7f5717de6740 1 -- 172.21.15.50:0/2439426417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f3590 msgr2=0x55d8501012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.924+0000 7f5717de6740 1 --2- 172.21.15.50:0/2439426417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f3590 0x55d8501012f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f56fc02a9a0 tx=0x7f56fc0041a0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.924+0000 7f5717de6740 1 -- 172.21.15.50:0/2439426417 shutdown_connections 2024-09-10T10:13:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.924+0000 7f5717de6740 1 --2- 172.21.15.50:0/2439426417 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55d8501786a0 0x55d85017aac0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.924+0000 7f5717de6740 1 --2- 172.21.15.50:0/2439426417 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d8500fde50 0x55d850101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.924+0000 7f5717de6740 1 --2- 172.21.15.50:0/2439426417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8500f3590 0x55d8501012f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.924+0000 7f5717de6740 1 --2- 172.21.15.50:0/2439426417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8500f2c70 0x55d850100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.924+0000 7f56efe00640 0 client.25688 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.924+0000 7f5717de6740 1 -- 172.21.15.50:0/2439426417 >> 172.21.15.50:0/2439426417 conn(0x55d8500ef200 msgr2=0x55d8500face0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.924+0000 7f5717de6740 1 -- 172.21.15.50:0/2439426417 shutdown_connections 2024-09-10T10:13:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.924+0000 7f5717de6740 1 -- 172.21.15.50:0/2439426417 wait complete. 2024-09-10T10:13:11.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.924+0000 7f5717de6740 20 client.25688 trim_cache size 0 max 16384 2024-09-10T10:13:11.935 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:13:11.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.925+0000 7f5715200640 1 -- 172.21.15.50:0/4190608442 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f56f40a2c00 msgr2=0x7f56f40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.925+0000 7f5715200640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f56f40a2c00 0x7f56f40a50c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f570009bc60 tx=0x7f57000d5530 comp rx=0 tx=0).stop 2024-09-10T10:13:11.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.925+0000 7f5715200640 1 -- 172.21.15.50:0/4190608442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5710074590 msgr2=0x7f57101a4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:11.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.925+0000 7f5715200640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5710074590 0x7f57101a4730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f570000e9f0 tx=0x7f570000edf0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.925+0000 7f5715200640 1 -- 172.21.15.50:0/4190608442 shutdown_connections 2024-09-10T10:13:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.925+0000 7f5715200640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f56f40a2c00 0x7f56f40a50c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.925+0000 7f5715200640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5710112b90 0x7f571019e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.925+0000 7f5715200640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5710074eb0 0x7f57101a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.925+0000 7f5715200640 1 --2- 172.21.15.50:0/4190608442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5710074590 0x7f57101a4730 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.925+0000 7f5715200640 1 -- 172.21.15.50:0/4190608442 >> 172.21.15.50:0/4190608442 conn(0x7f57100fd8c0 msgr2=0x7f57100ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.925+0000 7f5715200640 1 -- 172.21.15.50:0/4190608442 shutdown_connections 2024-09-10T10:13:11.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:11.926+0000 7f5715200640 1 -- 172.21.15.50:0/4190608442 wait complete. 2024-09-10T10:13:12.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:11 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3971994556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:12.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:11 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3971994556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:12.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:12 smithi050 ceph-mon[30354]: pgmap v451: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:13:13.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:12 smithi189 ceph-mon[34999]: pgmap v451: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:13:13.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:12 smithi084 ceph-mon[34812]: pgmap v451: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-10T10:13:13.102 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id 3432dd54 --release --await' 2024-09-10T10:13:13.102 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24560 quiesce db --set-id 3432dd54 --release --await 2024-09-10T10:13:13.478 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:13.618 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T10:13:13.618 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T10:13:14.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.078+0000 7f9917200640 1 -- 172.21.15.50:0/2910724857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99101049a0 msgr2=0x7f99101089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:14.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.078+0000 7f9917200640 1 --2- 172.21.15.50:0/2910724857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99101049a0 0x7f99101089f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f98f8009900 tx=0x7f98f802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.078+0000 7f9917200640 1 -- 172.21.15.50:0/2910724857 shutdown_connections 2024-09-10T10:13:14.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.078+0000 7f9917200640 1 --2- 172.21.15.50:0/2910724857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910109120 0x7f9910110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.078+0000 7f9917200640 1 --2- 172.21.15.50:0/2910724857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99101049a0 0x7f99101089f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.078+0000 7f9917200640 1 --2- 172.21.15.50:0/2910724857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9910103ff0 0x7f99101043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.078+0000 7f9917200640 1 -- 172.21.15.50:0/2910724857 >> 172.21.15.50:0/2910724857 conn(0x7f99100ffa90 msgr2=0x7f9910101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:14.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.078+0000 7f9917200640 1 -- 172.21.15.50:0/2910724857 shutdown_connections 2024-09-10T10:13:14.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.078+0000 7f9917200640 1 -- 172.21.15.50:0/2910724857 wait complete. 2024-09-10T10:13:14.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.079+0000 7f9917200640 1 Processor -- start 2024-09-10T10:13:14.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.080+0000 7f9917200640 1 -- start start 2024-09-10T10:13:14.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.080+0000 7f9917200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910103ff0 0x7f991019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.080+0000 7f9917200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99101049a0 0x7f991019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.080+0000 7f9917200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9910109120 0x7f991019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.080+0000 7f9917200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9910114140 con 0x7f99101049a0 2024-09-10T10:13:14.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.080+0000 7f9917200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9910113fc0 con 0x7f9910103ff0 2024-09-10T10:13:14.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.080+0000 7f9917200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99101142c0 con 0x7f9910109120 2024-09-10T10:13:14.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.080+0000 7f9907400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99101049a0 0x7f991019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.080+0000 7f9907400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99101049a0 0x7f991019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50972/0 (socket says 172.21.15.50:50972) 2024-09-10T10:13:14.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.080+0000 7f9907400640 1 -- 172.21.15.50:0/2946681988 learned_addr learned my addr 172.21.15.50:0/2946681988 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:14.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.080+0000 7f990fe00640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910103ff0 0x7f991019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.081+0000 7f9915200640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9910109120 0x7f991019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.081+0000 7f990fe00640 1 -- 172.21.15.50:0/2946681988 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9910109120 msgr2=0x7f991019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:14.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.081+0000 7f990fe00640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9910109120 0x7f991019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.081+0000 7f990fe00640 1 -- 172.21.15.50:0/2946681988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99101049a0 msgr2=0x7f991019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:14.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.081+0000 7f990fe00640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99101049a0 0x7f991019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.081+0000 7f990fe00640 1 -- 172.21.15.50:0/2946681988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991019f5b0 con 0x7f9910103ff0 2024-09-10T10:13:14.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.081+0000 7f990fe00640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910103ff0 0x7f991019a600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9900009fd0 tx=0x7f990000ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:14.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.081+0000 7f990d600640 1 -- 172.21.15.50:0/2946681988 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900004b20 con 0x7f9910103ff0 2024-09-10T10:13:14.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.081+0000 7f990d600640 1 -- 172.21.15.50:0/2946681988 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9900004cc0 con 0x7f9910103ff0 2024-09-10T10:13:14.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.081+0000 7f9917200640 1 -- 172.21.15.50:0/2946681988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f991019f8a0 con 0x7f9910103ff0 2024-09-10T10:13:14.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.081+0000 7f990d600640 1 -- 172.21.15.50:0/2946681988 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99000107b0 con 0x7f9910103ff0 2024-09-10T10:13:14.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.082+0000 7f9917200640 1 -- 172.21.15.50:0/2946681988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99101a7180 con 0x7f9910103ff0 2024-09-10T10:13:14.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.084+0000 7f9919cbe740 1 Processor -- start 2024-09-10T10:13:14.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.085+0000 7f990d600640 1 -- 172.21.15.50:0/2946681988 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9900005020 con 0x7f9910103ff0 2024-09-10T10:13:14.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.085+0000 7f9919cbe740 1 -- start start 2024-09-10T10:13:14.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.085+0000 7f9919cbe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fe1310 0x55cec9fe16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.085+0000 7f9919cbe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1c30 0x55cec9febfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.085+0000 7f9919cbe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fec4f0 0x55cec9fee8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.085+0000 7f9919cbe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cec9f47650 con 0x55cec9fe1c30 2024-09-10T10:13:14.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.085+0000 7f9919cbe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cec9eeef10 con 0x55cec9fe1310 2024-09-10T10:13:14.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.085+0000 7f9919cbe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cec9f43610 con 0x55cec9fec4f0 2024-09-10T10:13:14.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.085+0000 7f9907400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fec4f0 0x55cec9fee8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.085+0000 7f990fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1c30 0x55cec9febfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.085+0000 7f9907400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fec4f0 0x55cec9fee8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:43724/0 (socket says 172.21.15.50:43724) 2024-09-10T10:13:14.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.085+0000 7f9907400640 1 -- 172.21.15.50:0/849782384 learned_addr learned my addr 172.21.15.50:0/849782384 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:14.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.085+0000 7f9915200640 1 --2- 172.21.15.50:0/849782384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fe1310 0x55cec9fe16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.086+0000 7f9907400640 1 -- 172.21.15.50:0/849782384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fe1310 msgr2=0x55cec9fe16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:14.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.086+0000 7f9907400640 1 --2- 172.21.15.50:0/849782384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fe1310 0x55cec9fe16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.086+0000 7f9907400640 1 -- 172.21.15.50:0/849782384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1c30 msgr2=0x55cec9febfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:14.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.086+0000 7f9907400640 1 --2- 172.21.15.50:0/849782384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1c30 0x55cec9febfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.086+0000 7f9907400640 1 -- 172.21.15.50:0/849782384 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec9c56580 con 0x55cec9fec4f0 2024-09-10T10:13:14.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.086+0000 7f9907400640 1 --2- 172.21.15.50:0/849782384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fec4f0 0x55cec9fee8e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f98f8000c00 tx=0x7f98f8005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e72fc636464a29e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:14.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.086+0000 7f990d600640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f98f40a2b80 0x7f98f40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.086+0000 7f9905600640 1 -- 172.21.15.50:0/849782384 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8040070 con 0x55cec9fec4f0 2024-09-10T10:13:14.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.086+0000 7f9905600640 1 -- 172.21.15.50:0/849782384 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f8004030 con 0x55cec9fec4f0 2024-09-10T10:13:14.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.086+0000 7f9905600640 1 -- 172.21.15.50:0/849782384 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8035040 con 0x55cec9fec4f0 2024-09-10T10:13:14.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.087+0000 7f990d600640 1 -- 172.21.15.50:0/2946681988 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f99000cfc60 con 0x7f9910103ff0 2024-09-10T10:13:14.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.087+0000 7f9915200640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f98f40a2b80 0x7f98f40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.087+0000 7f9919cbe740 1 -- 172.21.15.50:0/849782384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fec4f0 msgr2=0x55cec9fee8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:14.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.087+0000 7f9919cbe740 1 --2- 172.21.15.50:0/849782384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fec4f0 0x55cec9fee8e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f98f8000c00 tx=0x7f98f8005dd0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.087+0000 7f9919cbe740 1 -- 172.21.15.50:0/849782384 shutdown_connections 2024-09-10T10:13:14.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.087+0000 7f9919cbe740 1 --2- 172.21.15.50:0/849782384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fec4f0 0x55cec9fee8e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.087+0000 7f9919cbe740 1 --2- 172.21.15.50:0/849782384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1c30 0x55cec9febfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.087+0000 7f9919cbe740 1 --2- 172.21.15.50:0/849782384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fe1310 0x55cec9fe16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.087+0000 7f9919cbe740 1 -- 172.21.15.50:0/849782384 >> 172.21.15.50:0/849782384 conn(0x55cec9fdd8a0 msgr2=0x55cec9fddc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.087+0000 7f9919cbe740 1 -- 172.21.15.50:0/849782384 shutdown_connections 2024-09-10T10:13:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.087+0000 7f9915200640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f98f40a2b80 0x7f98f40a5040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9908009c70 tx=0x7f9908005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.088+0000 7f9919cbe740 1 -- 172.21.15.50:0/849782384 wait complete. 2024-09-10T10:13:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.088+0000 7f9919cbe740 1 -- start start 2024-09-10T10:13:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.088+0000 7f9919cbe740 1 Processor -- start 2024-09-10T10:13:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f9919cbe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 0x55cec9fe9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f9919cbe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fe1c30 0x55cec9fe98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f9919cbe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fec4f0 0x55cec9fe9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f9919cbe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cec9fef0c0 con 0x55cec9fe1310 2024-09-10T10:13:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f9919cbe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cec9f02350 con 0x55cec9fec4f0 2024-09-10T10:13:14.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f9919cbe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cec9fef240 con 0x55cec9fe1c30 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f9919cbe740 10 client.0 _ll_register_callbacks cb 0x55cec9f25290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f990fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 0x55cec9fe9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f990fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 0x55cec9fe9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50990/0 (socket says 172.21.15.50:50990) 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f990fe00640 1 -- 172.21.15.50:0/2700537034 learned_addr learned my addr 172.21.15.50:0/2700537034 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f9907400640 1 --2- 172.21.15.50:0/2700537034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fe1c30 0x55cec9fe98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f9915200640 1 --2- 172.21.15.50:0/2700537034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fec4f0 0x55cec9fe9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f990fe00640 1 -- 172.21.15.50:0/2700537034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fe1c30 msgr2=0x55cec9fe98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f990fe00640 1 --2- 172.21.15.50:0/2700537034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fe1c30 0x55cec9fe98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f990fe00640 1 -- 172.21.15.50:0/2700537034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fec4f0 msgr2=0x55cec9fe9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f990fe00640 1 --2- 172.21.15.50:0/2700537034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fec4f0 0x55cec9fe9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.089+0000 7f990fe00640 1 -- 172.21.15.50:0/2700537034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec9d20960 con 0x55cec9fe1310 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.090+0000 7f990fe00640 1 --2- 172.21.15.50:0/2700537034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 0x55cec9fe9390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9900098530 tx=0x7f990000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50fb60138ad519cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.090+0000 7f98fe000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:13:14.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.090+0000 7f98fe000640 1 -- 172.21.15.50:0/2700537034 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990009bc10 con 0x55cec9fe1310 2024-09-10T10:13:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.090+0000 7f98fe000640 1 -- 172.21.15.50:0/2700537034 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f99000bc0f0 con 0x55cec9fe1310 2024-09-10T10:13:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.090+0000 7f9919cbe740 1 -- 172.21.15.50:0/2700537034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98f8004030 con 0x55cec9fe1310 2024-09-10T10:13:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.090+0000 7f98fe000640 1 -- 172.21.15.50:0/2700537034 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f990009ba30 con 0x55cec9fe1310 2024-09-10T10:13:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.090+0000 7f9919cbe740 10 client.15651 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.090+0000 7f9919cbe740 1 -- 172.21.15.50:0/2700537034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cec9ffad20 con 0x55cec9fe1310 2024-09-10T10:13:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.091+0000 7f98fe000640 1 -- 172.21.15.50:0/2700537034 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f8004030 con 0x55cec9fe1310 2024-09-10T10:13:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.091+0000 7f98fe000640 1 -- 172.21.15.50:0/2700537034 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f9900098740 con 0x55cec9fe1310 2024-09-10T10:13:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.091+0000 7f9919cbe740 10 client.15651 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.091+0000 7f9919cbe740 10 client.15651 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:13:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.091+0000 7f9919cbe740 20 client.15651 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.091+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2700537034 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cec9ffc130 0x55cec9ffe540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.091+0000 7f9919cbe740 4 client.15651 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:14.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.091+0000 7f9919cbe740 1 -- 172.21.15.50:0/2700537034 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cec9f54bc0 con 0x55cec9ffc130 2024-09-10T10:13:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.091+0000 7f9907400640 1 --2- 172.21.15.50:0/2700537034 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cec9ffc130 0x55cec9ffe540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.092+0000 7f9907400640 1 --2- 172.21.15.50:0/2700537034 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cec9ffc130 0x55cec9ffe540 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2aca42d9dead9035 server_cookie=f32c578d7ba282f9 in_seq=0 out_seq=0 2024-09-10T10:13:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.092+0000 7f98fe000640 10 client.15651 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f98fe000640 1 -- 172.21.15.50:0/2700537034 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cec9f54bc0 con 0x55cec9ffc130 2024-09-10T10:13:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f98fe000640 10 client.15651 handle_command_reply: tid=0 2024-09-10T10:13:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f9919cbe740 1 client.15651 shutdown 2024-09-10T10:13:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f9919cbe740 1 -- 172.21.15.50:0/2700537034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 msgr2=0x55cec9fe9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2700537034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 0x55cec9fe9390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9900098530 tx=0x7f990000cf60 comp rx=0 tx=0).stop 2024-09-10T10:13:14.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f9919cbe740 1 -- 172.21.15.50:0/2700537034 shutdown_connections 2024-09-10T10:13:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2700537034 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cec9ffc130 0x55cec9ffe540 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2700537034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fec4f0 0x55cec9fe9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2700537034 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fe1c30 0x55cec9fe98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2700537034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 0x55cec9fe9390 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f9919cbe740 1 -- 172.21.15.50:0/2700537034 >> 172.21.15.50:0/2700537034 conn(0x55cec9fdd8a0 msgr2=0x55cec9fdcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f98fe000640 0 client.15651 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f9919cbe740 1 -- 172.21.15.50:0/2700537034 shutdown_connections 2024-09-10T10:13:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f9919cbe740 1 -- 172.21.15.50:0/2700537034 wait complete. 2024-09-10T10:13:14.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.093+0000 7f9919cbe740 20 client.15651 trim_cache size 0 max 16384 2024-09-10T10:13:14.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.111+0000 7f9919cbe740 1 Processor -- start 2024-09-10T10:13:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.111+0000 7f9919cbe740 1 -- start start 2024-09-10T10:13:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f9919cbe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 0x55cec9fe3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f9919cbe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fe1c30 0x55cec9fdcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f9919cbe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fec4f0 0x55ceca003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f9919cbe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99101b3610 con 0x55cec9fe1310 2024-09-10T10:13:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f9919cbe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f99101b0ee0 con 0x55cec9fec4f0 2024-09-10T10:13:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f9919cbe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99101aed30 con 0x55cec9fe1c30 2024-09-10T10:13:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f990fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 0x55cec9fe3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f990fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 0x55cec9fe3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50998/0 (socket says 172.21.15.50:50998) 2024-09-10T10:13:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f990fe00640 1 -- 172.21.15.50:0/2976309576 learned_addr learned my addr 172.21.15.50:0/2976309576 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f9907400640 1 --2- 172.21.15.50:0/2976309576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fe1c30 0x55cec9fdcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f9915200640 1 --2- 172.21.15.50:0/2976309576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fec4f0 0x55ceca003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f990fe00640 1 -- 172.21.15.50:0/2976309576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fe1c30 msgr2=0x55cec9fdcaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:14.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f990fe00640 1 --2- 172.21.15.50:0/2976309576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fe1c30 0x55cec9fdcaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f990fe00640 1 -- 172.21.15.50:0/2976309576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fec4f0 msgr2=0x55ceca003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:14.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f990fe00640 1 --2- 172.21.15.50:0/2976309576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fec4f0 0x55ceca003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.112+0000 7f990fe00640 1 -- 172.21.15.50:0/2976309576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec9fd9260 con 0x55cec9fe1310 2024-09-10T10:13:14.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.113+0000 7f990fe00640 1 --2- 172.21.15.50:0/2976309576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 0x55cec9fe3dc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f99000a4810 tx=0x7f9900004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4071b301cf78cba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:14.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.113+0000 7f9904c00640 1 -- 172.21.15.50:0/2976309576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990009bc10 con 0x55cec9fe1310 2024-09-10T10:13:14.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.113+0000 7f9904c00640 1 -- 172.21.15.50:0/2976309576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f990009c7d0 con 0x55cec9fe1310 2024-09-10T10:13:14.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.113+0000 7f9904c00640 1 -- 172.21.15.50:0/2976309576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990009c0d0 con 0x55cec9fe1310 2024-09-10T10:13:14.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.113+0000 7f9919cbe740 1 -- 172.21.15.50:0/2976309576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 msgr2=0x55cec9fe3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:14.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.113+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2976309576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 0x55cec9fe3dc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f99000a4810 tx=0x7f9900004ab0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.113+0000 7f9919cbe740 1 -- 172.21.15.50:0/2976309576 shutdown_connections 2024-09-10T10:13:14.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.114+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2976309576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fec4f0 0x55ceca003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.114+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2976309576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fe1c30 0x55cec9fdcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.114+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2976309576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1310 0x55cec9fe3dc0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.114+0000 7f9919cbe740 1 -- 172.21.15.50:0/2976309576 >> 172.21.15.50:0/2976309576 conn(0x55cec9fdd8a0 msgr2=0x55cec9fe8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.114+0000 7f9919cbe740 1 -- 172.21.15.50:0/2976309576 shutdown_connections 2024-09-10T10:13:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.114+0000 7f9919cbe740 1 -- 172.21.15.50:0/2976309576 wait complete. 2024-09-10T10:13:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.114+0000 7f9919cbe740 1 -- start start 2024-09-10T10:13:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.114+0000 7f9919cbe740 1 Processor -- start 2024-09-10T10:13:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.115+0000 7f9919cbe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fe1310 0x55cec9ff4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.115+0000 7f9919cbe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1c30 0x55cec9feff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.115+0000 7f9919cbe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fec4f0 0x55cec9ff0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.115+0000 7f9919cbe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99101af3a0 con 0x55cec9fe1c30 2024-09-10T10:13:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.115+0000 7f9919cbe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f99101b0810 con 0x55cec9fe1310 2024-09-10T10:13:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.115+0000 7f9919cbe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99101afa70 con 0x55cec9fec4f0 2024-09-10T10:13:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.115+0000 7f9919cbe740 10 client.0 _ll_register_callbacks cb 0x7f9900005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:14.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.115+0000 7f9907400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1c30 0x55cec9feff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.115+0000 7f9907400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1c30 0x55cec9feff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51012/0 (socket says 172.21.15.50:51012) 2024-09-10T10:13:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.115+0000 7f9907400640 1 -- 172.21.15.50:0/2321000667 learned_addr learned my addr 172.21.15.50:0/2321000667 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.115+0000 7f9915200640 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fec4f0 0x55cec9ff0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.115+0000 7f990fe00640 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fe1310 0x55cec9ff4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.116+0000 7f9907400640 1 -- 172.21.15.50:0/2321000667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fec4f0 msgr2=0x55cec9ff0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.116+0000 7f9907400640 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fec4f0 0x55cec9ff0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.116+0000 7f9907400640 1 -- 172.21.15.50:0/2321000667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fe1310 msgr2=0x55cec9ff4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.116+0000 7f9907400640 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fe1310 0x55cec9ff4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.116+0000 7f9907400640 1 -- 172.21.15.50:0/2321000667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec9ff0c60 con 0x55cec9fe1c30 2024-09-10T10:13:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.116+0000 7f990fe00640 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fe1310 0x55cec9ff4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:13:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.116+0000 7f9915200640 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fec4f0 0x55cec9ff0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.116+0000 7f9907400640 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1c30 0x55cec9feff40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f98f8005ec0 tx=0x7f98f8005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd2e047f3bd1ec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:14.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.116+0000 7f98fe000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:13:14.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.116+0000 7f98fe000640 1 -- 172.21.15.50:0/2321000667 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8040040 con 0x55cec9fe1c30 2024-09-10T10:13:14.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.116+0000 7f98fe000640 1 -- 172.21.15.50:0/2321000667 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f98f80051f0 con 0x55cec9fe1c30 2024-09-10T10:13:14.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.116+0000 7f9919cbe740 1 -- 172.21.15.50:0/2321000667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f990009c7d0 con 0x55cec9fe1c30 2024-09-10T10:13:14.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.117+0000 7f98fe000640 1 -- 172.21.15.50:0/2321000667 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f98f8035040 con 0x55cec9fe1c30 2024-09-10T10:13:14.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.117+0000 7f9919cbe740 10 client.15657 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:14.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.117+0000 7f9919cbe740 1 -- 172.21.15.50:0/2321000667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ceca066e00 con 0x55cec9fe1c30 2024-09-10T10:13:14.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.117+0000 7f98fe000640 1 -- 172.21.15.50:0/2321000667 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f990009c7d0 con 0x55cec9fe1c30 2024-09-10T10:13:14.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.117+0000 7f98fe000640 1 -- 172.21.15.50:0/2321000667 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f98f804f040 con 0x55cec9fe1c30 2024-09-10T10:13:14.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.117+0000 7f9919cbe740 10 client.15657 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:14.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.117+0000 7f9919cbe740 10 client.15657 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:13:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.117+0000 7f9919cbe740 20 client.15657 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.117+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55ceca067090 0x55ceca069480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.117+0000 7f9919cbe740 4 client.15657 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3432dd54", "release": true, "await": true}] 2024-09-10T10:13:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.117+0000 7f9919cbe740 1 -- 172.21.15.50:0/2321000667 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3432dd54", "release": true, "await": true}) -- 0x55cec9f4f0d0 con 0x55ceca067090 2024-09-10T10:13:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.118+0000 7f990fe00640 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55ceca067090 0x55ceca069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.118+0000 7f98fe000640 10 client.15657 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.118+0000 7f990fe00640 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55ceca067090 0x55ceca069480 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cd957cacec209fd server_cookie=bfcf8fc128926460 in_seq=0 out_seq=0 2024-09-10T10:13:14.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.121+0000 7f98fe000640 1 -- 172.21.15.50:0/2321000667 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55cec9f4f0d0 con 0x55ceca067090 2024-09-10T10:13:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.121+0000 7f98fe000640 10 client.15657 handle_command_reply: tid=0 2024-09-10T10:13:14.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.121+0000 7f9919cbe740 1 client.15657 shutdown 2024-09-10T10:13:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.122+0000 7f9919cbe740 1 -- 172.21.15.50:0/2321000667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1c30 msgr2=0x55cec9feff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.122+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1c30 0x55cec9feff40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f98f8005ec0 tx=0x7f98f8005a20 comp rx=0 tx=0).stop 2024-09-10T10:13:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.122+0000 7f9919cbe740 1 -- 172.21.15.50:0/2321000667 shutdown_connections 2024-09-10T10:13:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.122+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55ceca067090 0x55ceca069480 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.122+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cec9fec4f0 0x55cec9ff0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.122+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec9fe1c30 0x55cec9feff40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.122+0000 7f9919cbe740 1 --2- 172.21.15.50:0/2321000667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cec9fe1310 0x55cec9ff4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.122+0000 7f9919cbe740 1 -- 172.21.15.50:0/2321000667 >> 172.21.15.50:0/2321000667 conn(0x55cec9fdd8a0 msgr2=0x55cec9fdcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.122+0000 7f98fe000640 0 client.15657 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.122+0000 7f9919cbe740 1 -- 172.21.15.50:0/2321000667 shutdown_connections 2024-09-10T10:13:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.122+0000 7f9919cbe740 1 -- 172.21.15.50:0/2321000667 wait complete. 2024-09-10T10:13:14.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.123+0000 7f9919cbe740 20 client.15657 trim_cache size 0 max 16384 2024-09-10T10:13:14.126 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:13:14.126 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 25, 2024-09-10T10:13:14.126 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24560, 2024-09-10T10:13:14.126 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 8, 2024-09-10T10:13:14.126 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-09-10T10:13:14.127 INFO:teuthology.orchestra.run.smithi050.stdout: "3432dd54": { 2024-09-10T10:13:14.127 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 8, 2024-09-10T10:13:14.127 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-09-10T10:13:14.127 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:13:14.127 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-09-10T10:13:14.127 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:13:14.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:13:14.127 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-09-10T10:13:14.127 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 150.0, 2024-09-10T10:13:14.127 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-09-10T10:13:14.127 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-09-10T10:13:14.127 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-09-10T10:13:14.127 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:13:14.128 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-09-10T10:13:14.128 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:13:14.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:13:14.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:13:14.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:13:14.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:13:14.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:13:14.128 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:13:14.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.123+0000 7f9917200640 1 -- 172.21.15.50:0/2946681988 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f98f40a2b80 msgr2=0x7f98f40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.123+0000 7f9917200640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f98f40a2b80 0x7f98f40a5040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9908009c70 tx=0x7f9908005f90 comp rx=0 tx=0).stop 2024-09-10T10:13:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.123+0000 7f9917200640 1 -- 172.21.15.50:0/2946681988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910103ff0 msgr2=0x7f991019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.123+0000 7f9917200640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910103ff0 0x7f991019a600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9900009fd0 tx=0x7f990000ef90 comp rx=0 tx=0).stop 2024-09-10T10:13:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.123+0000 7f9917200640 1 -- 172.21.15.50:0/2946681988 shutdown_connections 2024-09-10T10:13:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.123+0000 7f9917200640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f98f40a2b80 0x7f98f40a5040 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.123+0000 7f9917200640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9910109120 0x7f991019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.123+0000 7f9917200640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99101049a0 0x7f991019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.123+0000 7f9917200640 1 --2- 172.21.15.50:0/2946681988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9910103ff0 0x7f991019a600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.123+0000 7f9917200640 1 -- 172.21.15.50:0/2946681988 >> 172.21.15.50:0/2946681988 conn(0x7f99100ffa90 msgr2=0x7f9910100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.124+0000 7f9917200640 1 -- 172.21.15.50:0/2946681988 shutdown_connections 2024-09-10T10:13:14.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:14.124+0000 7f9917200640 1 -- 172.21.15.50:0/2946681988 wait complete. 2024-09-10T10:13:14.137 INFO:tasks.workunit.client.0.smithi050.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-10T10:13:14.263 INFO:tasks.workunit.client.0.smithi050.stdout: Iozone: Performance Test of File I/O 2024-09-10T10:13:14.263 INFO:tasks.workunit.client.0.smithi050.stdout: Version $Revision: 3.494 $ 2024-09-10T10:13:14.263 INFO:tasks.workunit.client.0.smithi050.stdout: Compiled for 64 bit mode. 2024-09-10T10:13:14.263 INFO:tasks.workunit.client.0.smithi050.stdout: Build: linux-AMD64 2024-09-10T10:13:14.263 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:14.263 INFO:tasks.workunit.client.0.smithi050.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-10T10:13:14.263 INFO:tasks.workunit.client.0.smithi050.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-10T10:13:14.263 INFO:tasks.workunit.client.0.smithi050.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: Run began: Tue Sep 10 10:13:14 2024 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: Include close in write timing 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: Include fsync in write timing 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: File size set to 1048576 kB 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: Record Size 16 kB 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-10T10:13:14.264 INFO:tasks.workunit.client.0.smithi050.stdout: Output is in kBytes/sec 2024-09-10T10:13:14.265 INFO:tasks.workunit.client.0.smithi050.stdout: Time Resolution = 0.000001 seconds. 2024-09-10T10:13:14.265 INFO:tasks.workunit.client.0.smithi050.stdout: Processor cache size set to 1024 kBytes. 2024-09-10T10:13:14.265 INFO:tasks.workunit.client.0.smithi050.stdout: Processor cache line size set to 32 bytes. 2024-09-10T10:13:14.265 INFO:tasks.workunit.client.0.smithi050.stdout: File stride size set to 17 * record size. 2024-09-10T10:13:14.265 INFO:tasks.workunit.client.0.smithi050.stdout: Throughput test with 1 process 2024-09-10T10:13:14.265 INFO:tasks.workunit.client.0.smithi050.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-09-10T10:13:14.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:14 smithi050 ceph-mon[30354]: pgmap v452: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T10:13:15.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:14 smithi189 ceph-mon[34999]: pgmap v452: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T10:13:15.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:14 smithi084 ceph-mon[34812]: pgmap v452: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-10T10:13:15.105 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:15.136 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3432dd54', total seconds elapsed: 36.2 2024-09-10T10:13:15.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.736+0000 7fe5c2000640 1 -- 172.21.15.50:0/1528400760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc102d20 msgr2=0x7fe5bc103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:15.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.736+0000 7fe5c2000640 1 --2- 172.21.15.50:0/1528400760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc102d20 0x7fe5bc103100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009900 tx=0x7fe5ac02a490 comp rx=0 tx=0).stop 2024-09-10T10:13:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.736+0000 7fe5c2000640 1 -- 172.21.15.50:0/1528400760 shutdown_connections 2024-09-10T10:13:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.736+0000 7fe5c2000640 1 --2- 172.21.15.50:0/1528400760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5bc10c150 0x7fe5bc10e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.736+0000 7fe5c2000640 1 --2- 172.21.15.50:0/1528400760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5bc103640 0x7fe5bc10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.736+0000 7fe5c2000640 1 --2- 172.21.15.50:0/1528400760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc102d20 0x7fe5bc103100 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.736+0000 7fe5c2000640 1 -- 172.21.15.50:0/1528400760 >> 172.21.15.50:0/1528400760 conn(0x7fe5bc0fc780 msgr2=0x7fe5bc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.736+0000 7fe5c2000640 1 -- 172.21.15.50:0/1528400760 shutdown_connections 2024-09-10T10:13:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.736+0000 7fe5c2000640 1 -- 172.21.15.50:0/1528400760 wait complete. 2024-09-10T10:13:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.737+0000 7fe5c2000640 1 Processor -- start 2024-09-10T10:13:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.737+0000 7fe5c2000640 1 -- start start 2024-09-10T10:13:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.738+0000 7fe5c2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc102d20 0x7fe5bc1a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.738+0000 7fe5c2000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5bc103640 0x7fe5bc1a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.738+0000 7fe5c2000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5bc10c150 0x7fe5bc19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.738+0000 7fe5c2000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc10fdb0 con 0x7fe5bc10c150 2024-09-10T10:13:15.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.738+0000 7fe5c2000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc10fc30 con 0x7fe5bc102d20 2024-09-10T10:13:15.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.738+0000 7fe5c2000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc10ff30 con 0x7fe5bc103640 2024-09-10T10:13:15.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.738+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc102d20 0x7fe5bc1a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.738+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc102d20 0x7fe5bc1a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:57450/0 (socket says 172.21.15.50:57450) 2024-09-10T10:13:15.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.738+0000 7fe5bb400640 1 -- 172.21.15.50:0/1938073406 learned_addr learned my addr 172.21.15.50:0/1938073406 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:15.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.738+0000 7fe5baa00640 1 --2- 172.21.15.50:0/1938073406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5bc103640 0x7fe5bc1a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.739+0000 7fe5bb400640 1 -- 172.21.15.50:0/1938073406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5bc103640 msgr2=0x7fe5bc1a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:15.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.739+0000 7fe5bb400640 1 --2- 172.21.15.50:0/1938073406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5bc103640 0x7fe5bc1a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.739+0000 7fe5bb400640 1 -- 172.21.15.50:0/1938073406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5bc10c150 msgr2=0x7fe5bc19e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:15.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.739+0000 7fe5bb400640 1 --2- 172.21.15.50:0/1938073406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5bc10c150 0x7fe5bc19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.739+0000 7fe5bb400640 1 -- 172.21.15.50:0/1938073406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5bc19f040 con 0x7fe5bc102d20 2024-09-10T10:13:15.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.739+0000 7fe5bb400640 1 --2- 172.21.15.50:0/1938073406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc102d20 0x7fe5bc1a46b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac004770 tx=0x7fe5ac003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:15.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.739+0000 7fe5b3e00640 1 -- 172.21.15.50:0/1938073406 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac03f070 con 0x7fe5bc102d20 2024-09-10T10:13:15.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.739+0000 7fe5c2000640 1 -- 172.21.15.50:0/1938073406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5bc19f2d0 con 0x7fe5bc102d20 2024-09-10T10:13:15.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.739+0000 7fe5b3e00640 1 -- 172.21.15.50:0/1938073406 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5ac031ca0 con 0x7fe5bc102d20 2024-09-10T10:13:15.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.740+0000 7fe5c2000640 1 -- 172.21.15.50:0/1938073406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5bc1ab580 con 0x7fe5bc102d20 2024-09-10T10:13:15.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.740+0000 7fe5b3e00640 1 -- 172.21.15.50:0/1938073406 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac035030 con 0x7fe5bc102d20 2024-09-10T10:13:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.743+0000 7fe5c4c41740 1 Processor -- start 2024-09-10T10:13:15.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.743+0000 7fe5c4c41740 1 -- start start 2024-09-10T10:13:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.743+0000 7fe5c4c41740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 0x561e76bd8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.743+0000 7fe5c4c41740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76be3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.743+0000 7fe5c4c41740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76be3ca0 0x561e76be6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.743+0000 7fe5c4c41740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561e76b3f290 con 0x561e76bd8ac0 2024-09-10T10:13:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.743+0000 7fe5c4c41740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561e76ae6b40 con 0x561e76be3ca0 2024-09-10T10:13:15.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.743+0000 7fe5c4c41740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561e76b3b250 con 0x561e76bd93e0 2024-09-10T10:13:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.744+0000 7fe5bbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 0x561e76bd8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.744+0000 7fe5bbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 0x561e76bd8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51048/0 (socket says 172.21.15.50:51048) 2024-09-10T10:13:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.744+0000 7fe5bbe00640 1 -- 172.21.15.50:0/3185383756 learned_addr learned my addr 172.21.15.50:0/3185383756 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.744+0000 7fe5baa00640 1 --2- 172.21.15.50:0/3185383756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76be3ca0 0x561e76be6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.745+0000 7fe5bbe00640 1 -- 172.21.15.50:0/3185383756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 msgr2=0x561e76be3760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:13:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.745+0000 7fe5bbe00640 1 --2- 172.21.15.50:0/3185383756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76be3760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.745+0000 7fe5bbe00640 1 -- 172.21.15.50:0/3185383756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76be3ca0 msgr2=0x561e76be6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:15.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.745+0000 7fe5bbe00640 1 --2- 172.21.15.50:0/3185383756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76be3ca0 0x561e76be6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.745+0000 7fe5bbe00640 1 -- 172.21.15.50:0/3185383756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e768b06a0 con 0x561e76bd8ac0 2024-09-10T10:13:15.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.745+0000 7fe5b3e00640 1 -- 172.21.15.50:0/1938073406 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe5ac042070 con 0x7fe5bc102d20 2024-09-10T10:13:15.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.745+0000 7fe5bbe00640 1 --2- 172.21.15.50:0/3185383756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 0x561e76bd8ea0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4007bb0 tx=0x7fe5b400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70871c252a76cd5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:15.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.746+0000 7fe5a7e00640 1 -- 172.21.15.50:0/3185383756 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4014070 con 0x561e76bd8ac0 2024-09-10T10:13:15.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.746+0000 7fe5a7e00640 1 -- 172.21.15.50:0/3185383756 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5b400fb30 con 0x561e76bd8ac0 2024-09-10T10:13:15.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.746+0000 7fe5a7e00640 1 -- 172.21.15.50:0/3185383756 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400ead0 con 0x561e76bd8ac0 2024-09-10T10:13:15.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.747+0000 7fe5c4c41740 1 -- 172.21.15.50:0/3185383756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 msgr2=0x561e76bd8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:15.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.747+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/3185383756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 0x561e76bd8ea0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4007bb0 tx=0x7fe5b400c6a0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.747+0000 7fe5c4c41740 1 -- 172.21.15.50:0/3185383756 shutdown_connections 2024-09-10T10:13:15.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.747+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/3185383756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76be3ca0 0x561e76be6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.747+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/3185383756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76be3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.747+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/3185383756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 0x561e76bd8ea0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.747+0000 7fe5c4c41740 1 -- 172.21.15.50:0/3185383756 >> 172.21.15.50:0/3185383756 conn(0x561e76bd5050 msgr2=0x561e76bd5430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:15.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.748+0000 7fe5c4c41740 1 -- 172.21.15.50:0/3185383756 shutdown_connections 2024-09-10T10:13:15.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.748+0000 7fe5c4c41740 1 -- 172.21.15.50:0/3185383756 wait complete. 2024-09-10T10:13:15.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.748+0000 7fe5c4c41740 1 -- start start 2024-09-10T10:13:15.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.748+0000 7fe5b3e00640 1 --2- 172.21.15.50:0/1938073406 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe5a00a2a90 0x7fe5a00a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.749+0000 7fe5c4c41740 1 Processor -- start 2024-09-10T10:13:15.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.749+0000 7fe5b3e00640 1 -- 172.21.15.50:0/1938073406 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe5ac0efc60 con 0x7fe5bc102d20 2024-09-10T10:13:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.750+0000 7fe5bbe00640 1 --2- 172.21.15.50:0/1938073406 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe5a00a2a90 0x7fe5a00a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.750+0000 7fe5c4c41740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 0x561e76be0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.750+0000 7fe5c4c41740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76be0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.750+0000 7fe5c4c41740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76be3ca0 0x561e76be14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.750+0000 7fe5c4c41740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561e76be6910 con 0x561e76be3ca0 2024-09-10T10:13:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.750+0000 7fe5c4c41740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561e76af9fa0 con 0x561e76bd8ac0 2024-09-10T10:13:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.750+0000 7fe5c4c41740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561e76be6a90 con 0x561e76bd93e0 2024-09-10T10:13:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.750+0000 7fe5c4c41740 10 client.0 _ll_register_callbacks cb 0x561e7684dba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.751+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 0x561e76be0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.751+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 0x561e76be0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:57478/0 (socket says 172.21.15.50:57478) 2024-09-10T10:13:15.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.751+0000 7fe5bb400640 1 -- 172.21.15.50:0/2100169972 learned_addr learned my addr 172.21.15.50:0/2100169972 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:15.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.751+0000 7fe5baa00640 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76be0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.751+0000 7fe5bbe00640 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76be3ca0 0x561e76be14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.751+0000 7fe5baa00640 1 -- 172.21.15.50:0/2100169972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 msgr2=0x561e76be0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:15.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.752+0000 7fe5baa00640 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 0x561e76be0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.752+0000 7fe5baa00640 1 -- 172.21.15.50:0/2100169972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76be3ca0 msgr2=0x561e76be14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.752+0000 7fe5baa00640 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76be3ca0 0x561e76be14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.752+0000 7fe5baa00640 1 -- 172.21.15.50:0/2100169972 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e76befd80 con 0x561e76bd93e0 2024-09-10T10:13:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.752+0000 7fe5bb400640 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 0x561e76be0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.752+0000 7fe5bbe00640 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76be3ca0 0x561e76be14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:13:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.752+0000 7fe5baa00640 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76be0fb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x561e76bd63d0 tx=0x7fe5a800dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97d3a0eaae872c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.752+0000 7fe5a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:13:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.752+0000 7fe5a4c00640 1 -- 172.21.15.50:0/2100169972 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a800de60 con 0x561e76bd93e0 2024-09-10T10:13:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.753+0000 7fe5a4c00640 1 -- 172.21.15.50:0/2100169972 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe5a800cc70 con 0x561e76bd93e0 2024-09-10T10:13:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.753+0000 7fe5bbe00640 1 --2- 172.21.15.50:0/1938073406 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe5a00a2a90 0x7fe5a00a4f50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e570 tx=0x7fe5b400e670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.753+0000 7fe5c4c41740 1 -- 172.21.15.50:0/2100169972 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5b400fb30 con 0x561e76bd93e0 2024-09-10T10:13:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.753+0000 7fe5a4c00640 1 -- 172.21.15.50:0/2100169972 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe5a8021450 con 0x561e76bd93e0 2024-09-10T10:13:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.753+0000 7fe5c4c41740 10 client.25684 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.753+0000 7fe5c4c41740 1 -- 172.21.15.50:0/2100169972 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e76bf2a60 con 0x561e76bd93e0 2024-09-10T10:13:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.754+0000 7fe5a4c00640 1 -- 172.21.15.50:0/2100169972 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5b400fb30 con 0x561e76bd93e0 2024-09-10T10:13:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.754+0000 7fe5a4c00640 1 -- 172.21.15.50:0/2100169972 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe5a8016380 con 0x561e76bd93e0 2024-09-10T10:13:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.754+0000 7fe5c4c41740 10 client.25684 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.754+0000 7fe5c4c41740 10 client.25684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.754+0000 7fe5c4c41740 20 client.25684 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:15.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.754+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561e76bf3f70 0x561e76bf6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.754+0000 7fe5c4c41740 4 client.25684 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:15.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.754+0000 7fe5c4c41740 1 -- 172.21.15.50:0/2100169972 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e76b4c800 con 0x561e76bf3f70 2024-09-10T10:13:15.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.754+0000 7fe5bb400640 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561e76bf3f70 0x561e76bf6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.755+0000 7fe5bb400640 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561e76bf3f70 0x561e76bf6390 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7553170a6ed0c920 server_cookie=e82b759859c08638 in_seq=0 out_seq=0 2024-09-10T10:13:15.757 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.755+0000 7fe5a4c00640 10 client.25684 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:15.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.756+0000 7fe5a4c00640 1 -- 172.21.15.50:0/2100169972 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e76b4c800 con 0x561e76bf3f70 2024-09-10T10:13:15.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.756+0000 7fe5a4c00640 10 client.25684 handle_command_reply: tid=0 2024-09-10T10:13:15.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.756+0000 7fe5c4c41740 1 client.25684 shutdown 2024-09-10T10:13:15.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.756+0000 7fe5c4c41740 1 -- 172.21.15.50:0/2100169972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 msgr2=0x561e76be0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:15.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.756+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76be0fb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x561e76bd63d0 tx=0x7fe5a800dc10 comp rx=0 tx=0).stop 2024-09-10T10:13:15.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.756+0000 7fe5c4c41740 1 -- 172.21.15.50:0/2100169972 shutdown_connections 2024-09-10T10:13:15.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.756+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561e76bf3f70 0x561e76bf6390 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.756+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76be3ca0 0x561e76be14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.756+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76be0fb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.758 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.756+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/2100169972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 0x561e76be0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.756+0000 7fe5c4c41740 1 -- 172.21.15.50:0/2100169972 >> 172.21.15.50:0/2100169972 conn(0x561e76bd5050 msgr2=0x561e76bdad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:15.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.756+0000 7fe5a4c00640 0 client.25684 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:15.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.757+0000 7fe5c4c41740 1 -- 172.21.15.50:0/2100169972 shutdown_connections 2024-09-10T10:13:15.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.757+0000 7fe5c4c41740 1 -- 172.21.15.50:0/2100169972 wait complete. 2024-09-10T10:13:15.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.757+0000 7fe5c4c41740 20 client.25684 trim_cache size 0 max 16384 2024-09-10T10:13:15.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.788+0000 7fe5c4c41740 1 Processor -- start 2024-09-10T10:13:15.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.789+0000 7fe5c4c41740 1 -- start start 2024-09-10T10:13:15.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.789+0000 7fe5c4c41740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 0x561e76bd4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.789+0000 7fe5c4c41740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76be1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.789+0000 7fe5c4c41740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76be3ca0 0x561e76bfbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.789+0000 7fe5c4c41740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1b7ca0 con 0x561e76bd8ac0 2024-09-10T10:13:15.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.789+0000 7fe5c4c41740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1b5570 con 0x561e76be3ca0 2024-09-10T10:13:15.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.789+0000 7fe5c4c41740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1b33c0 con 0x561e76bd93e0 2024-09-10T10:13:15.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.790+0000 7fe5bbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76be3ca0 0x561e76bfbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.790+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 0x561e76bd4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.790+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 0x561e76bd4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51058/0 (socket says 172.21.15.50:51058) 2024-09-10T10:13:15.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.790+0000 7fe5bb400640 1 -- 172.21.15.50:0/4041197789 learned_addr learned my addr 172.21.15.50:0/4041197789 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:15.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.790+0000 7fe5baa00640 1 --2- 172.21.15.50:0/4041197789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76be1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.791+0000 7fe5bb400640 1 -- 172.21.15.50:0/4041197789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 msgr2=0x561e76be1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:15.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.791+0000 7fe5bb400640 1 --2- 172.21.15.50:0/4041197789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76be1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.791+0000 7fe5bb400640 1 -- 172.21.15.50:0/4041197789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76be3ca0 msgr2=0x561e76bfbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:15.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.791+0000 7fe5bb400640 1 --2- 172.21.15.50:0/4041197789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76be3ca0 0x561e76bfbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.791+0000 7fe5bb400640 1 -- 172.21.15.50:0/4041197789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e76be6400 con 0x561e76bd8ac0 2024-09-10T10:13:15.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.792+0000 7fe5bb400640 1 --2- 172.21.15.50:0/4041197789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 0x561e76bd4470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac0c4810 tx=0x7fe5ac046040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a89899d4d2f25f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:15.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.792+0000 7fe5a7400640 1 -- 172.21.15.50:0/4041197789 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac0d5070 con 0x561e76bd8ac0 2024-09-10T10:13:15.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.792+0000 7fe5a7400640 1 -- 172.21.15.50:0/4041197789 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5ac0c0480 con 0x561e76bd8ac0 2024-09-10T10:13:15.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.792+0000 7fe5a7400640 1 -- 172.21.15.50:0/4041197789 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac0b8740 con 0x561e76bd8ac0 2024-09-10T10:13:15.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.794+0000 7fe5c4c41740 1 -- 172.21.15.50:0/4041197789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 msgr2=0x561e76bd4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:15.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.794+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/4041197789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 0x561e76bd4470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac0c4810 tx=0x7fe5ac046040 comp rx=0 tx=0).stop 2024-09-10T10:13:15.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.794+0000 7fe5c4c41740 1 -- 172.21.15.50:0/4041197789 shutdown_connections 2024-09-10T10:13:15.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.794+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/4041197789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76be3ca0 0x561e76bfbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.794+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/4041197789 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76be1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.794+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/4041197789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76bd8ac0 0x561e76bd4470 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.794+0000 7fe5c4c41740 1 -- 172.21.15.50:0/4041197789 >> 172.21.15.50:0/4041197789 conn(0x561e76bd5050 msgr2=0x561e76bdbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:15.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.794+0000 7fe5c4c41740 1 -- 172.21.15.50:0/4041197789 shutdown_connections 2024-09-10T10:13:15.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.794+0000 7fe5c4c41740 1 -- 172.21.15.50:0/4041197789 wait complete. 2024-09-10T10:13:15.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.795+0000 7fe5c4c41740 1 -- start start 2024-09-10T10:13:15.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.795+0000 7fe5c4c41740 1 Processor -- start 2024-09-10T10:13:15.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.796+0000 7fe5c4c41740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 0x561e76c573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.796+0000 7fe5c4c41740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76c578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.797+0000 7fe5c4c41740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76be3ca0 0x561e76beacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.797+0000 7fe5c4c41740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1b3a30 con 0x561e76be3ca0 2024-09-10T10:13:15.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.797+0000 7fe5c4c41740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1b4ea0 con 0x561e76bd8ac0 2024-09-10T10:13:15.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.797+0000 7fe5c4c41740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1b4100 con 0x561e76bd93e0 2024-09-10T10:13:15.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.797+0000 7fe5c4c41740 10 client.0 _ll_register_callbacks cb 0x7fe5a800b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:15.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.798+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 0x561e76c573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.798+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 0x561e76c573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:57500/0 (socket says 172.21.15.50:57500) 2024-09-10T10:13:15.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.798+0000 7fe5bb400640 1 -- 172.21.15.50:0/738599174 learned_addr learned my addr 172.21.15.50:0/738599174 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:15.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.798+0000 7fe5baa00640 1 --2- 172.21.15.50:0/738599174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76c578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.798+0000 7fe5bb400640 1 -- 172.21.15.50:0/738599174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 msgr2=0x561e76c578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:15.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.798+0000 7fe5bb400640 1 --2- 172.21.15.50:0/738599174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76c578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.798+0000 7fe5bb400640 1 -- 172.21.15.50:0/738599174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76be3ca0 msgr2=0x561e76beacd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:13:15.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.798+0000 7fe5bb400640 1 --2- 172.21.15.50:0/738599174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76be3ca0 0x561e76beacd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.798+0000 7fe5bb400640 1 -- 172.21.15.50:0/738599174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e76beb210 con 0x561e76bd8ac0 2024-09-10T10:13:15.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.801+0000 7fe5a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:15.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.801+0000 7fe5bb400640 1 --2- 172.21.15.50:0/738599174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 0x561e76c573a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac0b8aa0 tx=0x7fe5ac0092d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af3a6afa0ba39b32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:15.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.801+0000 7fe5a4c00640 1 -- 172.21.15.50:0/738599174 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac0c0150 con 0x561e76bd8ac0 2024-09-10T10:13:15.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.801+0000 7fe5a4c00640 1 -- 172.21.15.50:0/738599174 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe5ac0b8740 con 0x561e76bd8ac0 2024-09-10T10:13:15.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.801+0000 7fe5c4c41740 1 -- 172.21.15.50:0/738599174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5ac0c0480 con 0x561e76bd8ac0 2024-09-10T10:13:15.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.801+0000 7fe5a4c00640 1 -- 172.21.15.50:0/738599174 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe5ac03b5f0 con 0x561e76bd8ac0 2024-09-10T10:13:15.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.801+0000 7fe5c4c41740 10 client.25724 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:15.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.802+0000 7fe5c4c41740 1 -- 172.21.15.50:0/738599174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e76bec510 con 0x561e76bd8ac0 2024-09-10T10:13:15.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.802+0000 7fe5a4c00640 1 -- 172.21.15.50:0/738599174 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5ac0c0480 con 0x561e76bd8ac0 2024-09-10T10:13:15.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.803+0000 7fe5a4c00640 1 -- 172.21.15.50:0/738599174 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe5ac0bc330 con 0x561e76bd8ac0 2024-09-10T10:13:15.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.803+0000 7fe5c4c41740 10 client.25724 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:15.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.803+0000 7fe5c4c41740 10 client.25724 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:15.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.803+0000 7fe5c4c41740 20 client.25724 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:15.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.803+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/738599174 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561e76c6fc70 0x561e76c72090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:15.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.803+0000 7fe5c4c41740 4 client.25724 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T10:13:15.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.803+0000 7fe5c4c41740 1 -- 172.21.15.50:0/738599174 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561e76be3130 con 0x561e76c6fc70 2024-09-10T10:13:15.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.804+0000 7fe5baa00640 1 --2- 172.21.15.50:0/738599174 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561e76c6fc70 0x561e76c72090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:15.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.804+0000 7fe5baa00640 1 --2- 172.21.15.50:0/738599174 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561e76c6fc70 0x561e76c72090 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91363ff0bc692f29 server_cookie=d2e0c458797573e1 in_seq=0 out_seq=0 2024-09-10T10:13:15.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.804+0000 7fe5a4c00640 10 client.25724 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:15.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.805+0000 7fe5a4c00640 1 -- 172.21.15.50:0/738599174 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561e76be3130 con 0x561e76c6fc70 2024-09-10T10:13:15.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.805+0000 7fe5a4c00640 10 client.25724 handle_command_reply: tid=0 2024-09-10T10:13:15.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.805+0000 7fe5c4c41740 1 client.25724 shutdown 2024-09-10T10:13:15.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.806+0000 7fe5c4c41740 1 -- 172.21.15.50:0/738599174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 msgr2=0x561e76c573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:15.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.806+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/738599174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 0x561e76c573a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac0b8aa0 tx=0x7fe5ac0092d0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.806+0000 7fe5c4c41740 1 -- 172.21.15.50:0/738599174 shutdown_connections 2024-09-10T10:13:15.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.806+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/738599174 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561e76c6fc70 0x561e76c72090 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.806+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/738599174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e76be3ca0 0x561e76beacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.806+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/738599174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561e76bd93e0 0x561e76c578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.806+0000 7fe5c4c41740 1 --2- 172.21.15.50:0/738599174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e76bd8ac0 0x561e76c573a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.806+0000 7fe5c4c41740 1 -- 172.21.15.50:0/738599174 >> 172.21.15.50:0/738599174 conn(0x561e76bd5050 msgr2=0x561e76bdefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:15.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.806+0000 7fe5a4c00640 0 client.25724 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:15.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.807+0000 7fe5c4c41740 1 -- 172.21.15.50:0/738599174 shutdown_connections 2024-09-10T10:13:15.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.807+0000 7fe5c4c41740 1 -- 172.21.15.50:0/738599174 wait complete. 2024-09-10T10:13:15.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.807+0000 7fe5c4c41740 20 client.25724 trim_cache size 0 max 16384 2024-09-10T10:13:15.809 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:13:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-10T10:13:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "ca710d49-1d47-4b3a-96c7-9b564853b39c", 2024-09-10T10:13:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-10T10:13:15.810 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:13:15.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.808+0000 7fe5c2000640 1 -- 172.21.15.50:0/1938073406 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe5a00a2a90 msgr2=0x7fe5a00a4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:15.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.808+0000 7fe5c2000640 1 --2- 172.21.15.50:0/1938073406 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe5a00a2a90 0x7fe5a00a4f50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e570 tx=0x7fe5b400e670 comp rx=0 tx=0).stop 2024-09-10T10:13:15.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.808+0000 7fe5c2000640 1 -- 172.21.15.50:0/1938073406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc102d20 msgr2=0x7fe5bc1a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:15.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.808+0000 7fe5c2000640 1 --2- 172.21.15.50:0/1938073406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc102d20 0x7fe5bc1a46b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac004770 tx=0x7fe5ac003c10 comp rx=0 tx=0).stop 2024-09-10T10:13:15.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.808+0000 7fe5c2000640 1 -- 172.21.15.50:0/1938073406 shutdown_connections 2024-09-10T10:13:15.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.808+0000 7fe5c2000640 1 --2- 172.21.15.50:0/1938073406 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe5a00a2a90 0x7fe5a00a4f50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.808+0000 7fe5c2000640 1 --2- 172.21.15.50:0/1938073406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5bc10c150 0x7fe5bc19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.808+0000 7fe5c2000640 1 --2- 172.21.15.50:0/1938073406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5bc103640 0x7fe5bc1a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.808+0000 7fe5c2000640 1 --2- 172.21.15.50:0/1938073406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5bc102d20 0x7fe5bc1a46b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:15.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.808+0000 7fe5c2000640 1 -- 172.21.15.50:0/1938073406 >> 172.21.15.50:0/1938073406 conn(0x7fe5bc0fc780 msgr2=0x7fe5bc0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:15.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.809+0000 7fe5c2000640 1 -- 172.21.15.50:0/1938073406 shutdown_connections 2024-09-10T10:13:15.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:15.809+0000 7fe5c2000640 1 -- 172.21.15.50:0/1938073406 wait complete. 2024-09-10T10:13:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:16 smithi050 ceph-mon[30354]: pgmap v453: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T10:13:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:16 smithi050 ceph-mon[30354]: scrub queued for path: / 2024-09-10T10:13:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:16 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:16 smithi050 ceph-mon[30354]: scrub summary: active paths [/] 2024-09-10T10:13:16.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:16 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:17.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:16 smithi189 ceph-mon[34999]: pgmap v453: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T10:13:17.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:16 smithi189 ceph-mon[34999]: scrub queued for path: / 2024-09-10T10:13:17.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:16 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:17.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:16 smithi189 ceph-mon[34999]: scrub summary: active paths [/] 2024-09-10T10:13:17.089 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:16 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:17.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:16 smithi084 ceph-mon[34812]: pgmap v453: 129 pgs: 129 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-10T10:13:17.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:16 smithi084 ceph-mon[34812]: scrub queued for path: / 2024-09-10T10:13:17.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:16 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:17.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:16 smithi084 ceph-mon[34812]: scrub summary: active paths [/] 2024-09-10T10:13:17.100 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:16 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:17.319 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:13:17.958 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.636+0000 7f27cd400640 1 -- 172.21.15.50:0/3377730378 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c00319b0 con 0x7f27d0074510 2024-09-10T10:13:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.637+0000 7f27d4a00640 1 -- 172.21.15.50:0/3377730378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d0074510 msgr2=0x7f27d00748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:18.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.637+0000 7f27d4a00640 1 --2- 172.21.15.50:0/3377730378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d0074510 0x7f27d00748f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009900 tx=0x7f27c002a480 comp rx=0 tx=0).stop 2024-09-10T10:13:18.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.637+0000 7f27d4a00640 1 -- 172.21.15.50:0/3377730378 shutdown_connections 2024-09-10T10:13:18.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.637+0000 7f27d4a00640 1 --2- 172.21.15.50:0/3377730378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d010e280 0x7f27d0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.637+0000 7f27d4a00640 1 --2- 172.21.15.50:0/3377730378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27d0074e30 0x7f27d010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.637+0000 7f27d4a00640 1 --2- 172.21.15.50:0/3377730378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d0074510 0x7f27d00748f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.637+0000 7f27d4a00640 1 -- 172.21.15.50:0/3377730378 >> 172.21.15.50:0/3377730378 conn(0x7f27d00fd740 msgr2=0x7f27d00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.638+0000 7f27d4a00640 1 -- 172.21.15.50:0/3377730378 shutdown_connections 2024-09-10T10:13:18.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.638+0000 7f27d4a00640 1 -- 172.21.15.50:0/3377730378 wait complete. 2024-09-10T10:13:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.639+0000 7f27d4a00640 1 Processor -- start 2024-09-10T10:13:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.639+0000 7f27d4a00640 1 -- start start 2024-09-10T10:13:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.639+0000 7f27d4a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27d0074510 0x7f27d019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.639+0000 7f27d4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d0074e30 0x7f27d019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.639+0000 7f27d4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d010e280 0x7f27d019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.639+0000 7f27d4a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27d0113fc0 con 0x7f27d0074e30 2024-09-10T10:13:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.639+0000 7f27d4a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f27d0113e40 con 0x7f27d010e280 2024-09-10T10:13:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.639+0000 7f27d4a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f27d0114140 con 0x7f27d0074510 2024-09-10T10:13:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.639+0000 7f27ce800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27d0074510 0x7f27d019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.640+0000 7f27ce800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27d0074510 0x7f27d019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:54104/0 (socket says 172.21.15.50:54104) 2024-09-10T10:13:18.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.640+0000 7f27cde00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d0074e30 0x7f27d019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.640+0000 7f27ce800640 1 -- 172.21.15.50:0/469683717 learned_addr learned my addr 172.21.15.50:0/469683717 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:18.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.640+0000 7f27ce800640 1 -- 172.21.15.50:0/469683717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d010e280 msgr2=0x7f27d019ee10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:13:18.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.640+0000 7f27ce800640 1 --2- 172.21.15.50:0/469683717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d010e280 0x7f27d019ee10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.640+0000 7f27ce800640 1 -- 172.21.15.50:0/469683717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d0074e30 msgr2=0x7f27d019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:18.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.640+0000 7f27ce800640 1 --2- 172.21.15.50:0/469683717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d0074e30 0x7f27d019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.640+0000 7f27ce800640 1 -- 172.21.15.50:0/469683717 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d019f4f0 con 0x7f27d0074510 2024-09-10T10:13:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.640+0000 7f27ce800640 1 --2- 172.21.15.50:0/469683717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27d0074510 0x7f27d019a540 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f27c0006010 tx=0x7f27c0004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.640+0000 7f27c7400640 1 -- 172.21.15.50:0/469683717 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c003f030 con 0x7f27d0074510 2024-09-10T10:13:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.641+0000 7f27d4a00640 1 -- 172.21.15.50:0/469683717 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d019f780 con 0x7f27d0074510 2024-09-10T10:13:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.641+0000 7f27c7400640 1 -- 172.21.15.50:0/469683717 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c0004440 con 0x7f27d0074510 2024-09-10T10:13:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.641+0000 7f27c7400640 1 -- 172.21.15.50:0/469683717 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0035070 con 0x7f27d0074510 2024-09-10T10:13:18.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.641+0000 7f27d4a00640 1 -- 172.21.15.50:0/469683717 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d01a70c0 con 0x7f27d0074510 2024-09-10T10:13:18.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.644+0000 7f27c7400640 1 -- 172.21.15.50:0/469683717 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f27c0042030 con 0x7f27d0074510 2024-09-10T10:13:18.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.644+0000 7f27d7ecc740 1 Processor -- start 2024-09-10T10:13:18.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.644+0000 7f27d7ecc740 1 -- start start 2024-09-10T10:13:18.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.645+0000 7f27d7ecc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafa7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.645+0000 7f27d7ecc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafa7670 0x5590eafb19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.645+0000 7f27d7ecc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 0x5590eafb4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.645+0000 7f27d7ecc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5590eaf0d3e0 con 0x5590eafa6d50 2024-09-10T10:13:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.645+0000 7f27d7ecc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5590eaeb4d80 con 0x5590eafa7670 2024-09-10T10:13:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.645+0000 7f27d7ecc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5590eaf093a0 con 0x5590eafb1f30 2024-09-10T10:13:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.645+0000 7f27ce800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafa7670 0x5590eafb19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.645+0000 7f27cde00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 0x5590eafb4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.645+0000 7f27cf200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafa7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.645+0000 7f27ce800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafa7670 0x5590eafb19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:47896/0 (socket says 172.21.15.50:47896) 2024-09-10T10:13:18.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.645+0000 7f27ce800640 1 -- 172.21.15.50:0/2365913896 learned_addr learned my addr 172.21.15.50:0/2365913896 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.646+0000 7f27cde00640 1 -- 172.21.15.50:0/2365913896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafa7670 msgr2=0x5590eafb19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.646+0000 7f27cde00640 1 --2- 172.21.15.50:0/2365913896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafa7670 0x5590eafb19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.646+0000 7f27cde00640 1 -- 172.21.15.50:0/2365913896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 msgr2=0x5590eafa7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.646+0000 7f27cde00640 1 --2- 172.21.15.50:0/2365913896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafa7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.646+0000 7f27cde00640 1 -- 172.21.15.50:0/2365913896 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590eaed3ae0 con 0x5590eafb1f30 2024-09-10T10:13:18.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.646+0000 7f27ce800640 1 --2- 172.21.15.50:0/2365913896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafa7670 0x5590eafb19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:13:18.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.646+0000 7f27c7400640 1 --2- 172.21.15.50:0/469683717 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f27b40a2c00 0x7f27b40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.646+0000 7f27cde00640 1 --2- 172.21.15.50:0/2365913896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 0x5590eafb4320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009bf0 tx=0x7f27bc011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3921c8b8cdb5e64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:18.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.646+0000 7f27c7400640 1 -- 172.21.15.50:0/469683717 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f27c00ef4a0 con 0x7f27d0074510 2024-09-10T10:13:18.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.646+0000 7f27bb400640 1 -- 172.21.15.50:0/2365913896 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc004310 con 0x5590eafb1f30 2024-09-10T10:13:18.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.646+0000 7f27bb400640 1 -- 172.21.15.50:0/2365913896 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27bc0044b0 con 0x5590eafb1f30 2024-09-10T10:13:18.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.646+0000 7f27bb400640 1 -- 172.21.15.50:0/2365913896 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc003850 con 0x5590eafb1f30 2024-09-10T10:13:18.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.646+0000 7f27cf200640 1 --2- 172.21.15.50:0/469683717 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f27b40a2c00 0x7f27b40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.647+0000 7f27d7ecc740 1 -- 172.21.15.50:0/2365913896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 msgr2=0x5590eafb4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:18.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.647+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/2365913896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 0x5590eafb4320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009bf0 tx=0x7f27bc011440 comp rx=0 tx=0).stop 2024-09-10T10:13:18.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.647+0000 7f27cf200640 1 --2- 172.21.15.50:0/469683717 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f27b40a2c00 0x7f27b40a50c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f27d00754f0 tx=0x7f27c8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:18.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.647+0000 7f27d7ecc740 1 -- 172.21.15.50:0/2365913896 shutdown_connections 2024-09-10T10:13:18.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.647+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/2365913896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 0x5590eafb4320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.647+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/2365913896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafa7670 0x5590eafb19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.647+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/2365913896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafa7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.647+0000 7f27d7ecc740 1 -- 172.21.15.50:0/2365913896 >> 172.21.15.50:0/2365913896 conn(0x5590eafa32e0 msgr2=0x5590eafa36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:18.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.647+0000 7f27d7ecc740 1 -- 172.21.15.50:0/2365913896 shutdown_connections 2024-09-10T10:13:18.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.647+0000 7f27d7ecc740 1 -- 172.21.15.50:0/2365913896 wait complete. 2024-09-10T10:13:18.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.648+0000 7f27d7ecc740 1 -- start start 2024-09-10T10:13:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.648+0000 7f27d7ecc740 1 Processor -- start 2024-09-10T10:13:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27d7ecc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafaee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27d7ecc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafa7670 0x5590eafaf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27d7ecc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb1f30 0x5590eafaf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27d7ecc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5590eafb4ba0 con 0x5590eafa6d50 2024-09-10T10:13:18.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27d7ecc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5590eaec80f0 con 0x5590eafb1f30 2024-09-10T10:13:18.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27d7ecc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5590eafb4d20 con 0x5590eafa7670 2024-09-10T10:13:18.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27d7ecc740 10 client.0 _ll_register_callbacks cb 0x5590eaeb99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:18.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27cde00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafa7670 0x5590eafaf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27cde00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafa7670 0x5590eafaf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:54124/0 (socket says 172.21.15.50:54124) 2024-09-10T10:13:18.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27cf200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb1f30 0x5590eafaf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27cde00640 1 -- 172.21.15.50:0/202533100 learned_addr learned my addr 172.21.15.50:0/202533100 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:18.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27ce800640 1 --2- 172.21.15.50:0/202533100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafaee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27cde00640 1 -- 172.21.15.50:0/202533100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb1f30 msgr2=0x5590eafaf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:18.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27cde00640 1 --2- 172.21.15.50:0/202533100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb1f30 0x5590eafaf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27cde00640 1 -- 172.21.15.50:0/202533100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 msgr2=0x5590eafaee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:18.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27cde00640 1 --2- 172.21.15.50:0/202533100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafaee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27cde00640 1 -- 172.21.15.50:0/202533100 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590eac7e3c0 con 0x5590eafa7670 2024-09-10T10:13:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.649+0000 7f27cf200640 1 --2- 172.21.15.50:0/202533100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb1f30 0x5590eafaf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.650+0000 7f27cde00640 1 --2- 172.21.15.50:0/202533100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafa7670 0x5590eafaf360 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27bc004c80 tx=0x7f27bc0048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c2bd138f0bbfa35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.650+0000 7f27afe00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:13:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.650+0000 7f27afe00640 1 -- 172.21.15.50:0/202533100 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0037f0 con 0x5590eafa7670 2024-09-10T10:13:18.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.650+0000 7f27d7ecc740 1 -- 172.21.15.50:0/202533100 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27bc0044b0 con 0x5590eafa7670 2024-09-10T10:13:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.650+0000 7f27afe00640 1 -- 172.21.15.50:0/202533100 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f27bc003990 con 0x5590eafa7670 2024-09-10T10:13:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.650+0000 7f27afe00640 1 -- 172.21.15.50:0/202533100 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f27bc032050 con 0x5590eafa7670 2024-09-10T10:13:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.650+0000 7f27d7ecc740 10 client.25702 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.650+0000 7f27d7ecc740 1 -- 172.21.15.50:0/202533100 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5590eafc0850 con 0x5590eafa7670 2024-09-10T10:13:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.651+0000 7f27afe00640 1 -- 172.21.15.50:0/202533100 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27bc0044b0 con 0x5590eafa7670 2024-09-10T10:13:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.651+0000 7f27afe00640 1 -- 172.21.15.50:0/202533100 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f27bc018070 con 0x5590eafa7670 2024-09-10T10:13:18.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.651+0000 7f27d7ecc740 10 client.25702 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.651+0000 7f27d7ecc740 10 client.25702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.651+0000 7f27d7ecc740 20 client.25702 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.651+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/202533100 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5590eafc1cb0 0x5590eafc40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.651+0000 7f27d7ecc740 4 client.25702 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:18.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.651+0000 7f27d7ecc740 1 -- 172.21.15.50:0/202533100 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590eaf1a950 con 0x5590eafc1cb0 2024-09-10T10:13:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.651+0000 7f27ce800640 1 --2- 172.21.15.50:0/202533100 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5590eafc1cb0 0x5590eafc40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.652+0000 7f27ce800640 1 --2- 172.21.15.50:0/202533100 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5590eafc1cb0 0x5590eafc40a0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d690d5ec236e0e0 server_cookie=12a2f2a44544a5d2 in_seq=0 out_seq=0 2024-09-10T10:13:18.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.652+0000 7f27afe00640 10 client.25702 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.653+0000 7f27afe00640 1 -- 172.21.15.50:0/202533100 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590eaf1a950 con 0x5590eafc1cb0 2024-09-10T10:13:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.653+0000 7f27afe00640 10 client.25702 handle_command_reply: tid=0 2024-09-10T10:13:18.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.653+0000 7f27d7ecc740 1 client.25702 shutdown 2024-09-10T10:13:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.654+0000 7f27d7ecc740 1 -- 172.21.15.50:0/202533100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafa7670 msgr2=0x5590eafaf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.654+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/202533100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafa7670 0x5590eafaf360 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27bc004c80 tx=0x7f27bc0048f0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.654+0000 7f27d7ecc740 1 -- 172.21.15.50:0/202533100 shutdown_connections 2024-09-10T10:13:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.654+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/202533100 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5590eafc1cb0 0x5590eafc40a0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.654+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/202533100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb1f30 0x5590eafaf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.654+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/202533100 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafa7670 0x5590eafaf360 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.654+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/202533100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafaee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.654+0000 7f27d7ecc740 1 -- 172.21.15.50:0/202533100 >> 172.21.15.50:0/202533100 conn(0x5590eafa32e0 msgr2=0x5590eafa9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.654+0000 7f27afe00640 0 client.25702 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.654+0000 7f27d7ecc740 1 -- 172.21.15.50:0/202533100 shutdown_connections 2024-09-10T10:13:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.655+0000 7f27d7ecc740 1 -- 172.21.15.50:0/202533100 wait complete. 2024-09-10T10:13:18.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.655+0000 7f27d7ecc740 20 client.25702 trim_cache size 0 max 16384 2024-09-10T10:13:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.677+0000 7f27d7ecc740 1 Processor -- start 2024-09-10T10:13:18.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.677+0000 7f27d7ecc740 1 -- start start 2024-09-10T10:13:18.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.677+0000 7f27d7ecc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafc9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.677+0000 7f27d7ecc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 0x5590eafc9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.677+0000 7f27d7ecc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb0d90 0x5590eafaede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.677+0000 7f27d7ecc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27d01b3690 con 0x5590eafa6d50 2024-09-10T10:13:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.677+0000 7f27d7ecc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f27d01b0f60 con 0x5590eafb0d90 2024-09-10T10:13:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.677+0000 7f27d7ecc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f27d01aedb0 con 0x5590eafb1f30 2024-09-10T10:13:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.678+0000 7f27ce800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafc9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.678+0000 7f27ce800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafc9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33054/0 (socket says 172.21.15.50:33054) 2024-09-10T10:13:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.678+0000 7f27ce800640 1 -- 172.21.15.50:0/1127543952 learned_addr learned my addr 172.21.15.50:0/1127543952 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.678+0000 7f27cde00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 0x5590eafc9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.678+0000 7f27cf200640 1 --2- 172.21.15.50:0/1127543952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb0d90 0x5590eafaede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.678+0000 7f27ce800640 1 -- 172.21.15.50:0/1127543952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 msgr2=0x5590eafc9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.678+0000 7f27ce800640 1 --2- 172.21.15.50:0/1127543952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 0x5590eafc9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.678+0000 7f27ce800640 1 -- 172.21.15.50:0/1127543952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb0d90 msgr2=0x5590eafaede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.678+0000 7f27ce800640 1 --2- 172.21.15.50:0/1127543952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb0d90 0x5590eafaede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.678+0000 7f27ce800640 1 -- 172.21.15.50:0/1127543952 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590eafa74a0 con 0x5590eafa6d50 2024-09-10T10:13:18.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.678+0000 7f27ce800640 1 --2- 172.21.15.50:0/1127543952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafc9880 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f27c00b7d70 tx=0x7f27c002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7031094785ee007e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:18.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.679+0000 7f27baa00640 1 -- 172.21.15.50:0/1127543952 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0049040 con 0x5590eafa6d50 2024-09-10T10:13:18.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.679+0000 7f27baa00640 1 -- 172.21.15.50:0/1127543952 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c00bc010 con 0x5590eafa6d50 2024-09-10T10:13:18.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.679+0000 7f27baa00640 1 -- 172.21.15.50:0/1127543952 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c00eccc0 con 0x5590eafa6d50 2024-09-10T10:13:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.679+0000 7f27d7ecc740 1 -- 172.21.15.50:0/1127543952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 msgr2=0x5590eafc9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.679+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/1127543952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafc9880 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f27c00b7d70 tx=0x7f27c002a480 comp rx=0 tx=0).stop 2024-09-10T10:13:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.680+0000 7f27d7ecc740 1 -- 172.21.15.50:0/1127543952 shutdown_connections 2024-09-10T10:13:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.680+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/1127543952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb0d90 0x5590eafaede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.680+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/1127543952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 0x5590eafc9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.680+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/1127543952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafc9880 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.680+0000 7f27d7ecc740 1 -- 172.21.15.50:0/1127543952 >> 172.21.15.50:0/1127543952 conn(0x5590eafa32e0 msgr2=0x5590eafb0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.680+0000 7f27d7ecc740 1 -- 172.21.15.50:0/1127543952 shutdown_connections 2024-09-10T10:13:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.680+0000 7f27d7ecc740 1 -- 172.21.15.50:0/1127543952 wait complete. 2024-09-10T10:13:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.680+0000 7f27d7ecc740 1 -- start start 2024-09-10T10:13:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.680+0000 7f27d7ecc740 1 Processor -- start 2024-09-10T10:13:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27d7ecc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27d7ecc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb0d90 0x5590eafb56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27d7ecc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 0x5590eafb5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27d7ecc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27d01af420 con 0x5590eafa6d50 2024-09-10T10:13:18.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27d7ecc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f27d01b0890 con 0x5590eafb0d90 2024-09-10T10:13:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27d7ecc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f27d01afaf0 con 0x5590eafb1f30 2024-09-10T10:13:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27d7ecc740 10 client.0 _ll_register_callbacks cb 0x7f27bc009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27cde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb0d90 0x5590eafb56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27cf200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 0x5590eafb5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27cde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb0d90 0x5590eafb56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:47924/0 (socket says 172.21.15.50:47924) 2024-09-10T10:13:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27cde00640 1 -- 172.21.15.50:0/4099757193 learned_addr learned my addr 172.21.15.50:0/4099757193 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:18.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27ce800640 1 --2- 172.21.15.50:0/4099757193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27cde00640 1 -- 172.21.15.50:0/4099757193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 msgr2=0x5590eafb5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27cde00640 1 --2- 172.21.15.50:0/4099757193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 0x5590eafb5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27cde00640 1 -- 172.21.15.50:0/4099757193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 msgr2=0x5590eafba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27cde00640 1 --2- 172.21.15.50:0/4099757193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafba3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.681+0000 7f27cde00640 1 -- 172.21.15.50:0/4099757193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590eafb6150 con 0x5590eafb0d90 2024-09-10T10:13:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.682+0000 7f27afe00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.682+0000 7f27cde00640 1 --2- 172.21.15.50:0/4099757193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb0d90 0x5590eafb56d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5590eafae6b0 tx=0x7f27bc024e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ba0bf513e5f66a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.683+0000 7f27afe00640 1 -- 172.21.15.50:0/4099757193 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc005250 con 0x5590eafb0d90 2024-09-10T10:13:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.683+0000 7f27d7ecc740 1 -- 172.21.15.50:0/4099757193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27c00bc010 con 0x5590eafb0d90 2024-09-10T10:13:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.683+0000 7f27afe00640 1 -- 172.21.15.50:0/4099757193 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f27bc004960 con 0x5590eafb0d90 2024-09-10T10:13:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.684+0000 7f27afe00640 1 -- 172.21.15.50:0/4099757193 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f27bc004cb0 con 0x5590eafb0d90 2024-09-10T10:13:18.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.684+0000 7f27d7ecc740 10 client.25739 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.684+0000 7f27d7ecc740 1 -- 172.21.15.50:0/4099757193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5590eb02c550 con 0x5590eafb0d90 2024-09-10T10:13:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.685+0000 7f27afe00640 1 -- 172.21.15.50:0/4099757193 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c00bc010 con 0x5590eafb0d90 2024-09-10T10:13:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.685+0000 7f27afe00640 1 -- 172.21.15.50:0/4099757193 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f27bc018040 con 0x5590eafb0d90 2024-09-10T10:13:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.685+0000 7f27d7ecc740 10 client.25739 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.685+0000 7f27d7ecc740 10 client.25739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.686+0000 7f27d7ecc740 20 client.25739 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.686+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/4099757193 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5590eb02cc40 0x5590eb02f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.686+0000 7f27d7ecc740 4 client.25739 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:13:18.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.686+0000 7f27d7ecc740 1 -- 172.21.15.50:0/4099757193 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5590eaf14e60 con 0x5590eb02cc40 2024-09-10T10:13:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.686+0000 7f27ce800640 1 --2- 172.21.15.50:0/4099757193 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5590eb02cc40 0x5590eb02f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.686+0000 7f27ce800640 1 --2- 172.21.15.50:0/4099757193 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5590eb02cc40 0x5590eb02f060 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c47a5c47689a5b8c server_cookie=a92e7df531e7828c in_seq=0 out_seq=0 2024-09-10T10:13:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.686+0000 7f27afe00640 10 client.25739 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.687+0000 7f27afe00640 1 -- 172.21.15.50:0/4099757193 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5590eaf14e60 con 0x5590eb02cc40 2024-09-10T10:13:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.687+0000 7f27afe00640 10 client.25739 handle_command_reply: tid=0 2024-09-10T10:13:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.687+0000 7f27d7ecc740 1 client.25739 shutdown 2024-09-10T10:13:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.687+0000 7f27d7ecc740 1 -- 172.21.15.50:0/4099757193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb0d90 msgr2=0x5590eafb56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.687+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/4099757193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb0d90 0x5590eafb56d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5590eafae6b0 tx=0x7f27bc024e20 comp rx=0 tx=0).stop 2024-09-10T10:13:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.687+0000 7f27d7ecc740 1 -- 172.21.15.50:0/4099757193 shutdown_connections 2024-09-10T10:13:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.687+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/4099757193 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5590eb02cc40 0x5590eb02f060 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.687+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/4099757193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5590eafb1f30 0x5590eafb5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.687+0000 7f27afe00640 0 client.25739 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.687+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/4099757193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590eafb0d90 0x5590eafb56d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.687+0000 7f27d7ecc740 1 --2- 172.21.15.50:0/4099757193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590eafa6d50 0x5590eafba3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.687+0000 7f27d7ecc740 1 -- 172.21.15.50:0/4099757193 >> 172.21.15.50:0/4099757193 conn(0x5590eafa32e0 msgr2=0x5590eafa1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.687+0000 7f27d7ecc740 1 -- 172.21.15.50:0/4099757193 shutdown_connections 2024-09-10T10:13:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.688+0000 7f27d7ecc740 1 -- 172.21.15.50:0/4099757193 wait complete. 2024-09-10T10:13:18.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.688+0000 7f27d7ecc740 20 client.25739 trim_cache size 0 max 16384 2024-09-10T10:13:18.691 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:13:18.691 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-10T10:13:18.691 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-10T10:13:18.692 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:13:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.690+0000 7f27d4a00640 1 -- 172.21.15.50:0/469683717 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f27b40a2c00 msgr2=0x7f27b40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.690+0000 7f27d4a00640 1 --2- 172.21.15.50:0/469683717 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f27b40a2c00 0x7f27b40a50c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f27d00754f0 tx=0x7f27c8009500 comp rx=0 tx=0).stop 2024-09-10T10:13:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.690+0000 7f27d4a00640 1 -- 172.21.15.50:0/469683717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27d0074510 msgr2=0x7f27d019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:18.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.690+0000 7f27d4a00640 1 --2- 172.21.15.50:0/469683717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27d0074510 0x7f27d019a540 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f27c0006010 tx=0x7f27c0004040 comp rx=0 tx=0).stop 2024-09-10T10:13:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.690+0000 7f27d4a00640 1 -- 172.21.15.50:0/469683717 shutdown_connections 2024-09-10T10:13:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.690+0000 7f27d4a00640 1 --2- 172.21.15.50:0/469683717 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f27b40a2c00 0x7f27b40a50c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.690+0000 7f27d4a00640 1 --2- 172.21.15.50:0/469683717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27d010e280 0x7f27d019ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.690+0000 7f27d4a00640 1 --2- 172.21.15.50:0/469683717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27d0074e30 0x7f27d019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.690+0000 7f27d4a00640 1 --2- 172.21.15.50:0/469683717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f27d0074510 0x7f27d019a540 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.690+0000 7f27d4a00640 1 -- 172.21.15.50:0/469683717 >> 172.21.15.50:0/469683717 conn(0x7f27d00fd740 msgr2=0x7f27d00fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.690+0000 7f27d4a00640 1 -- 172.21.15.50:0/469683717 shutdown_connections 2024-09-10T10:13:18.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:18.690+0000 7f27d4a00640 1 -- 172.21.15.50:0/469683717 wait complete. 2024-09-10T10:13:18.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:18 smithi050 ceph-mon[30354]: pgmap v454: 129 pgs: 129 active+clean; 700 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.6 KiB/s wr, 8 op/s 2024-09-10T10:13:18.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:18 smithi050 ceph-mon[30354]: scrub summary: idle 2024-09-10T10:13:19.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:18 smithi189 ceph-mon[34999]: pgmap v454: 129 pgs: 129 active+clean; 700 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.6 KiB/s wr, 8 op/s 2024-09-10T10:13:19.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:18 smithi189 ceph-mon[34999]: scrub summary: idle 2024-09-10T10:13:19.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:18 smithi084 ceph-mon[34812]: pgmap v454: 129 pgs: 129 active+clean; 700 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.6 KiB/s wr, 8 op/s 2024-09-10T10:13:19.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:18 smithi084 ceph-mon[34812]: scrub summary: idle 2024-09-10T10:13:19.230 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:19.230 INFO:tasks.workunit.client.0.smithi050.stdout: Children see throughput for 1 initial writers = 211253.81 kB/sec 2024-09-10T10:13:19.231 INFO:tasks.workunit.client.0.smithi050.stdout: Parent sees throughput for 1 initial writers = 211228.74 kB/sec 2024-09-10T10:13:19.231 INFO:tasks.workunit.client.0.smithi050.stdout: Min throughput per process = 211253.81 kB/sec 2024-09-10T10:13:19.231 INFO:tasks.workunit.client.0.smithi050.stdout: Max throughput per process = 211253.81 kB/sec 2024-09-10T10:13:19.231 INFO:tasks.workunit.client.0.smithi050.stdout: Avg throughput per process = 211253.81 kB/sec 2024-09-10T10:13:19.231 INFO:tasks.workunit.client.0.smithi050.stdout: Min xfer = 1048576.00 kB 2024-09-10T10:13:20.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:20 smithi050 ceph-mon[30354]: pgmap v455: 129 pgs: 129 active+clean; 341 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 28 MiB/s wr, 14 op/s 2024-09-10T10:13:21.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:20 smithi189 ceph-mon[34999]: pgmap v455: 129 pgs: 129 active+clean; 341 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 28 MiB/s wr, 14 op/s 2024-09-10T10:13:21.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:20 smithi084 ceph-mon[34812]: pgmap v455: 129 pgs: 129 active+clean; 341 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 28 MiB/s wr, 14 op/s 2024-09-10T10:13:21.344 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T10:13:21.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:13:21.735 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.267+0000 7fce2ea00640 1 -- 172.21.15.50:0/3034837414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce2810e260 msgr2=0x7fce28110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.267+0000 7fce2ea00640 1 --2- 172.21.15.50:0/3034837414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce2810e260 0x7fce28110650 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fce20009ca0 tx=0x7fce2002a950 comp rx=0 tx=0).stop 2024-09-10T10:13:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.267+0000 7fce2ea00640 1 -- 172.21.15.50:0/3034837414 shutdown_connections 2024-09-10T10:13:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.267+0000 7fce2ea00640 1 --2- 172.21.15.50:0/3034837414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce2810e260 0x7fce28110650 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.267+0000 7fce2ea00640 1 --2- 172.21.15.50:0/3034837414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce28074ee0 0x7fce2810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.267+0000 7fce2ea00640 1 --2- 172.21.15.50:0/3034837414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce280745c0 0x7fce280749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:22.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.267+0000 7fce2ea00640 1 -- 172.21.15.50:0/3034837414 >> 172.21.15.50:0/3034837414 conn(0x7fce280fd740 msgr2=0x7fce280ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.267+0000 7fce2ea00640 1 -- 172.21.15.50:0/3034837414 shutdown_connections 2024-09-10T10:13:22.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.267+0000 7fce2ea00640 1 -- 172.21.15.50:0/3034837414 wait complete. 2024-09-10T10:13:22.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.269+0000 7fce2ea00640 1 Processor -- start 2024-09-10T10:13:22.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.269+0000 7fce2ea00640 1 -- start start 2024-09-10T10:13:22.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.269+0000 7fce2ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce280745c0 0x7fce2819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:22.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.269+0000 7fce2ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce28074ee0 0x7fce2819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:22.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.269+0000 7fce2ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2810e260 0x7fce2819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:22.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.269+0000 7fce2ea00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce28113fe0 con 0x7fce28074ee0 2024-09-10T10:13:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.269+0000 7fce2ea00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fce28113e60 con 0x7fce280745c0 2024-09-10T10:13:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.269+0000 7fce2ea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fce28114160 con 0x7fce2810e260 2024-09-10T10:13:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.269+0000 7fce2cc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce28074ee0 0x7fce2819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.270+0000 7fce2cc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce28074ee0 0x7fce2819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33080/0 (socket says 172.21.15.50:33080) 2024-09-10T10:13:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.270+0000 7fce2cc00640 1 -- 172.21.15.50:0/4074856170 learned_addr learned my addr 172.21.15.50:0/4074856170 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.270+0000 7fce2e000640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2810e260 0x7fce2819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.270+0000 7fce2d600640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce280745c0 0x7fce2819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.270+0000 7fce2e000640 1 -- 172.21.15.50:0/4074856170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce280745c0 msgr2=0x7fce2819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.270+0000 7fce2e000640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce280745c0 0x7fce2819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.270+0000 7fce2e000640 1 -- 172.21.15.50:0/4074856170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce28074ee0 msgr2=0x7fce2819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.270+0000 7fce2e000640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce28074ee0 0x7fce2819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:22.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.270+0000 7fce2e000640 1 -- 172.21.15.50:0/4074856170 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2819f440 con 0x7fce2810e260 2024-09-10T10:13:22.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.270+0000 7fce2cc00640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce28074ee0 0x7fce2819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:22.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.270+0000 7fce2e000640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2810e260 0x7fce2819ed60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fce2002af40 tx=0x7fce20003b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:22.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.271+0000 7fce26000640 1 -- 172.21.15.50:0/4074856170 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce20034040 con 0x7fce2810e260 2024-09-10T10:13:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.271+0000 7fce2ea00640 1 -- 172.21.15.50:0/4074856170 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2819f6d0 con 0x7fce2810e260 2024-09-10T10:13:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.271+0000 7fce26000640 1 -- 172.21.15.50:0/4074856170 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce2002f940 con 0x7fce2810e260 2024-09-10T10:13:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.271+0000 7fce26000640 1 -- 172.21.15.50:0/4074856170 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce200045a0 con 0x7fce2810e260 2024-09-10T10:13:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.271+0000 7fce2ea00640 1 -- 172.21.15.50:0/4074856170 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce281a7010 con 0x7fce2810e260 2024-09-10T10:13:22.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.272+0000 7fce2ea00640 1 -- 172.21.15.50:0/4074856170 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce280749a0 con 0x7fce2810e260 2024-09-10T10:13:22.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.274+0000 7fce26000640 1 -- 172.21.15.50:0/4074856170 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fce20037020 con 0x7fce2810e260 2024-09-10T10:13:22.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.275+0000 7fce26000640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fce100a2b80 0x7fce100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:22.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.275+0000 7fce26000640 1 -- 172.21.15.50:0/4074856170 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fce200f0250 con 0x7fce2810e260 2024-09-10T10:13:22.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.276+0000 7fce2d600640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fce100a2b80 0x7fce100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:22.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.276+0000 7fce2d600640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fce100a2b80 0x7fce100a5040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0095f0 tx=0x7fce1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:22.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.277+0000 7fce26000640 1 -- 172.21.15.50:0/4074856170 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce200811b0 con 0x7fce2810e260 2024-09-10T10:13:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.498+0000 7fce2ea00640 1 -- 172.21.15.50:0/4074856170 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce281093e0 con 0x7fce2810e260 2024-09-10T10:13:22.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.499+0000 7fce26000640 1 -- 172.21.15.50:0/4074856170 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7fce200bcdc0 con 0x7fce2810e260 2024-09-10T10:13:22.501 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:13:22.501 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:13:22.501 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:13:22.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.501+0000 7fce2ea00640 1 -- 172.21.15.50:0/4074856170 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fce100a2b80 msgr2=0x7fce100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:22.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.501+0000 7fce2ea00640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fce100a2b80 0x7fce100a5040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0095f0 tx=0x7fce1c005f90 comp rx=0 tx=0).stop 2024-09-10T10:13:22.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.501+0000 7fce2ea00640 1 -- 172.21.15.50:0/4074856170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2810e260 msgr2=0x7fce2819ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:22.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.501+0000 7fce2ea00640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2810e260 0x7fce2819ed60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fce2002af40 tx=0x7fce20003b80 comp rx=0 tx=0).stop 2024-09-10T10:13:22.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.502+0000 7fce2ea00640 1 -- 172.21.15.50:0/4074856170 shutdown_connections 2024-09-10T10:13:22.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.502+0000 7fce2ea00640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fce100a2b80 0x7fce100a5040 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:22.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.502+0000 7fce2ea00640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fce2810e260 0x7fce2819ed60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.502+0000 7fce2ea00640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce28074ee0 0x7fce2819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.502+0000 7fce2ea00640 1 --2- 172.21.15.50:0/4074856170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce280745c0 0x7fce2819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.502+0000 7fce2ea00640 1 -- 172.21.15.50:0/4074856170 >> 172.21.15.50:0/4074856170 conn(0x7fce280fd740 msgr2=0x7fce280fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.502+0000 7fce2ea00640 1 -- 172.21.15.50:0/4074856170 shutdown_connections 2024-09-10T10:13:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:22.502+0000 7fce2ea00640 1 -- 172.21.15.50:0/4074856170 wait complete. 2024-09-10T10:13:22.891 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:22 smithi050 ceph-mon[30354]: pgmap v456: 129 pgs: 129 active+clean; 785 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 65 MiB/s wr, 23 op/s 2024-09-10T10:13:22.891 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:22 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4074856170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:23.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:22 smithi189 ceph-mon[34999]: pgmap v456: 129 pgs: 129 active+clean; 785 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 65 MiB/s wr, 23 op/s 2024-09-10T10:13:23.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:22 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4074856170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:23.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:22 smithi084 ceph-mon[34812]: pgmap v456: 129 pgs: 129 active+clean; 785 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 65 MiB/s wr, 23 op/s 2024-09-10T10:13:23.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:22 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4074856170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:23.365 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T10:13:24.034 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:24.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.769+0000 7f3b36600640 1 -- 172.21.15.50:0/797411497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b30103ff0 msgr2=0x7f3b301043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:24.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.769+0000 7f3b36600640 1 --2- 172.21.15.50:0/797411497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b30103ff0 0x7f3b301043d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009900 tx=0x7f3b1802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.769+0000 7f3b36600640 1 -- 172.21.15.50:0/797411497 shutdown_connections 2024-09-10T10:13:24.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.769+0000 7f3b36600640 1 --2- 172.21.15.50:0/797411497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30109120 0x7f3b30110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.769+0000 7f3b36600640 1 --2- 172.21.15.50:0/797411497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b301049a0 0x7f3b301089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.769+0000 7f3b36600640 1 --2- 172.21.15.50:0/797411497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b30103ff0 0x7f3b301043d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.769+0000 7f3b36600640 1 -- 172.21.15.50:0/797411497 >> 172.21.15.50:0/797411497 conn(0x7f3b300ffa90 msgr2=0x7f3b30101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:24.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.772+0000 7f3b36600640 1 -- 172.21.15.50:0/797411497 shutdown_connections 2024-09-10T10:13:24.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.773+0000 7f3b36600640 1 -- 172.21.15.50:0/797411497 wait complete. 2024-09-10T10:13:24.776 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:24 smithi050 ceph-mon[30354]: pgmap v457: 129 pgs: 129 active+clean; 965 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 80 MiB/s wr, 29 op/s 2024-09-10T10:13:24.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.774+0000 7f3b36600640 1 Processor -- start 2024-09-10T10:13:24.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.774+0000 7f3b36600640 1 -- start start 2024-09-10T10:13:24.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.775+0000 7f3b36600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30103ff0 0x7f3b3019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.775+0000 7f3b36600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b301049a0 0x7f3b3019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.775+0000 7f3b36600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b30109120 0x7f3b3019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.775+0000 7f3b36600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3b30114170 con 0x7f3b301049a0 2024-09-10T10:13:24.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.775+0000 7f3b36600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3b30113ff0 con 0x7f3b30103ff0 2024-09-10T10:13:24.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.775+0000 7f3b36600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301142f0 con 0x7f3b30109120 2024-09-10T10:13:24.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.775+0000 7f3b2f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30103ff0 0x7f3b3019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.775+0000 7f3b2f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30103ff0 0x7f3b3019a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:47968/0 (socket says 172.21.15.50:47968) 2024-09-10T10:13:24.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.775+0000 7f3b2f400640 1 -- 172.21.15.50:0/718724476 learned_addr learned my addr 172.21.15.50:0/718724476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:24.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.775+0000 7f3b2fe00640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b30109120 0x7f3b3019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.776+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b301049a0 0x7f3b3019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.776+0000 7f3b2fe00640 1 -- 172.21.15.50:0/718724476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30103ff0 msgr2=0x7f3b3019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:24.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.776+0000 7f3b2fe00640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30103ff0 0x7f3b3019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.776+0000 7f3b2fe00640 1 -- 172.21.15.50:0/718724476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b301049a0 msgr2=0x7f3b3019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:24.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.776+0000 7f3b2fe00640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b301049a0 0x7f3b3019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.776+0000 7f3b2fe00640 1 -- 172.21.15.50:0/718724476 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3019f5e0 con 0x7f3b30109120 2024-09-10T10:13:24.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.777+0000 7f3b2fe00640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b30109120 0x7f3b3019ef00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800ec50 tx=0x7f3b2800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:24.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.777+0000 7f3b27e00640 1 -- 172.21.15.50:0/718724476 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28003b70 con 0x7f3b30109120 2024-09-10T10:13:24.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.777+0000 7f3b27e00640 1 -- 172.21.15.50:0/718724476 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b28003d10 con 0x7f3b30109120 2024-09-10T10:13:24.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.777+0000 7f3b27e00640 1 -- 172.21.15.50:0/718724476 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28010930 con 0x7f3b30109120 2024-09-10T10:13:24.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.777+0000 7f3b36600640 1 -- 172.21.15.50:0/718724476 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3019f8d0 con 0x7f3b30109120 2024-09-10T10:13:24.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.777+0000 7f3b36600640 1 -- 172.21.15.50:0/718724476 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b301a71b0 con 0x7f3b30109120 2024-09-10T10:13:24.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.785+0000 7f3b27e00640 1 -- 172.21.15.50:0/718724476 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3b28003ec0 con 0x7f3b30109120 2024-09-10T10:13:24.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.786+0000 7f3b391d2740 1 Processor -- start 2024-09-10T10:13:24.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.786+0000 7f3b391d2740 1 -- start start 2024-09-10T10:13:24.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.787+0000 7f3b391d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a411f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.787+0000 7f3b391d2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a4124b0 0x561f8a425120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.787+0000 7f3b391d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 0x561f8a427a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.787+0000 7f3b391d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561f8a3783e0 con 0x561f8a411b90 2024-09-10T10:13:24.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.787+0000 7f3b391d2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561f8a31fd80 con 0x561f8a4124b0 2024-09-10T10:13:24.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.787+0000 7f3b391d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561f8a3743a0 con 0x561f8a425660 2024-09-10T10:13:24.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.787+0000 7f3b27e00640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b140a2c00 0x7f3b140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.788+0000 7f3b2ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 0x561f8a427a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.788+0000 7f3b2ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 0x561f8a427a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:54172/0 (socket says 172.21.15.50:54172) 2024-09-10T10:13:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.788+0000 7f3b2ea00640 1 -- 172.21.15.50:0/1992980957 learned_addr learned my addr 172.21.15.50:0/1992980957 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.788+0000 7f3b27e00640 1 -- 172.21.15.50:0/718724476 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f3b280cf990 con 0x7f3b30109120 2024-09-10T10:13:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.788+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/1992980957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a411f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.788+0000 7f3b2fe00640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b140a2c00 0x7f3b140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.789+0000 7f3b2ea00640 1 -- 172.21.15.50:0/1992980957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a4124b0 msgr2=0x561f8a425120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.789+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/1992980957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a4124b0 0x561f8a425120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.789+0000 7f3b2ea00640 1 -- 172.21.15.50:0/1992980957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 msgr2=0x561f8a411f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.789+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/1992980957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a411f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.789+0000 7f3b2ea00640 1 -- 172.21.15.50:0/1992980957 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8a33eae0 con 0x561f8a425660 2024-09-10T10:13:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.790+0000 7f3b2fe00640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b140a2c00 0x7f3b140a50c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3b2809bdf0 tx=0x7f3b28005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:24.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.790+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/1992980957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 0x561f8a427a50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3b200149c0 tx=0x7f3b2000c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f644a8f4d2520491 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:24.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.790+0000 7f3b24c00640 1 -- 172.21.15.50:0/1992980957 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b200142d0 con 0x561f8a425660 2024-09-10T10:13:24.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.791+0000 7f3b24c00640 1 -- 172.21.15.50:0/1992980957 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b2000f760 con 0x561f8a425660 2024-09-10T10:13:24.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.791+0000 7f3b24c00640 1 -- 172.21.15.50:0/1992980957 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20003850 con 0x561f8a425660 2024-09-10T10:13:24.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.793+0000 7f3b391d2740 1 -- 172.21.15.50:0/1992980957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 msgr2=0x561f8a427a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:24.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.793+0000 7f3b391d2740 1 --2- 172.21.15.50:0/1992980957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 0x561f8a427a50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3b200149c0 tx=0x7f3b2000c4d0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.793+0000 7f3b391d2740 1 -- 172.21.15.50:0/1992980957 shutdown_connections 2024-09-10T10:13:24.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.793+0000 7f3b391d2740 1 --2- 172.21.15.50:0/1992980957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 0x561f8a427a50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.793+0000 7f3b391d2740 1 --2- 172.21.15.50:0/1992980957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a4124b0 0x561f8a425120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.793+0000 7f3b391d2740 1 --2- 172.21.15.50:0/1992980957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a411f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.793+0000 7f3b391d2740 1 -- 172.21.15.50:0/1992980957 >> 172.21.15.50:0/1992980957 conn(0x561f8a40e200 msgr2=0x561f8a40e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:24.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.794+0000 7f3b391d2740 1 -- 172.21.15.50:0/1992980957 shutdown_connections 2024-09-10T10:13:24.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.795+0000 7f3b391d2740 1 -- 172.21.15.50:0/1992980957 wait complete. 2024-09-10T10:13:24.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.795+0000 7f3b391d2740 1 -- start start 2024-09-10T10:13:24.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.795+0000 7f3b391d2740 1 Processor -- start 2024-09-10T10:13:24.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.796+0000 7f3b391d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a4225d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.796+0000 7f3b391d2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a4124b0 0x561f8a422b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.796+0000 7f3b391d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 0x561f8a423050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.796+0000 7f3b391d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561f8a428170 con 0x561f8a411b90 2024-09-10T10:13:24.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.796+0000 7f3b391d2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561f8a3330f0 con 0x561f8a4124b0 2024-09-10T10:13:24.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.796+0000 7f3b391d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561f8a4282f0 con 0x561f8a425660 2024-09-10T10:13:24.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.796+0000 7f3b391d2740 10 client.0 _ll_register_callbacks cb 0x561f8a31abd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:24.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.796+0000 7f3b2ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a4225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.797+0000 7f3b2ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 0x561f8a423050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.797+0000 7f3b2ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 0x561f8a423050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:54180/0 (socket says 172.21.15.50:54180) 2024-09-10T10:13:24.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.797+0000 7f3b2ea00640 1 -- 172.21.15.50:0/3458343633 learned_addr learned my addr 172.21.15.50:0/3458343633 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:24.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.797+0000 7f3b2f400640 1 --2- 172.21.15.50:0/3458343633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a4124b0 0x561f8a422b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.797+0000 7f3b2ea00640 1 -- 172.21.15.50:0/3458343633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a4124b0 msgr2=0x561f8a422b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:24.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.797+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/3458343633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a4124b0 0x561f8a422b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.797+0000 7f3b2ea00640 1 -- 172.21.15.50:0/3458343633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 msgr2=0x561f8a4225d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:24.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.797+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/3458343633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a4225d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.797+0000 7f3b2ea00640 1 -- 172.21.15.50:0/3458343633 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f8a0e93c0 con 0x561f8a425660 2024-09-10T10:13:24.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.797+0000 7f3b2f400640 1 --2- 172.21.15.50:0/3458343633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a4124b0 0x561f8a422b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:24.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.798+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/3458343633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 0x561f8a423050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000c4a0 tx=0x7f3b2000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a12737f9a704fcf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:24.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.798+0000 7f3b1d600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:13:24.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.798+0000 7f3b1d600640 1 -- 172.21.15.50:0/3458343633 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20004030 con 0x561f8a425660 2024-09-10T10:13:24.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.798+0000 7f3b1d600640 1 -- 172.21.15.50:0/3458343633 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f3b200041d0 con 0x561f8a425660 2024-09-10T10:13:24.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.798+0000 7f3b391d2740 1 -- 172.21.15.50:0/3458343633 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b2000f760 con 0x561f8a425660 2024-09-10T10:13:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.798+0000 7f3b1d600640 1 -- 172.21.15.50:0/3458343633 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3b20031050 con 0x561f8a425660 2024-09-10T10:13:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.798+0000 7f3b391d2740 10 client.25726 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.798+0000 7f3b391d2740 1 -- 172.21.15.50:0/3458343633 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561f8a434270 con 0x561f8a425660 2024-09-10T10:13:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.799+0000 7f3b1d600640 1 -- 172.21.15.50:0/3458343633 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b2000f760 con 0x561f8a425660 2024-09-10T10:13:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.799+0000 7f3b1d600640 1 -- 172.21.15.50:0/3458343633 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3b20012450 con 0x561f8a425660 2024-09-10T10:13:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.799+0000 7f3b391d2740 10 client.25726 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.799+0000 7f3b391d2740 10 client.25726 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:13:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.799+0000 7f3b391d2740 20 client.25726 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.799+0000 7f3b391d2740 1 --2- 172.21.15.50:0/3458343633 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x561f8a4356d0 0x561f8a437ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.799+0000 7f3b391d2740 4 client.25726 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.799+0000 7f3b391d2740 1 -- 172.21.15.50:0/3458343633 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f8a385950 con 0x561f8a4356d0 2024-09-10T10:13:24.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.800+0000 7f3b2f400640 1 --2- 172.21.15.50:0/3458343633 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x561f8a4356d0 0x561f8a437ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.800+0000 7f3b2f400640 1 --2- 172.21.15.50:0/3458343633 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x561f8a4356d0 0x561f8a437ac0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=467fdf8a505b8acd server_cookie=d0cf3791e5592ce1 in_seq=0 out_seq=0 2024-09-10T10:13:24.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.800+0000 7f3b1d600640 10 client.25726 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:24.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.801+0000 7f3b1d600640 1 -- 172.21.15.50:0/3458343633 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f8a385950 con 0x561f8a4356d0 2024-09-10T10:13:24.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.801+0000 7f3b1d600640 10 client.25726 handle_command_reply: tid=0 2024-09-10T10:13:24.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.801+0000 7f3b391d2740 1 client.25726 shutdown 2024-09-10T10:13:24.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.801+0000 7f3b391d2740 1 -- 172.21.15.50:0/3458343633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 msgr2=0x561f8a423050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:24.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.801+0000 7f3b391d2740 1 --2- 172.21.15.50:0/3458343633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 0x561f8a423050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000c4a0 tx=0x7f3b2000cbf0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.801+0000 7f3b391d2740 1 -- 172.21.15.50:0/3458343633 shutdown_connections 2024-09-10T10:13:24.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.801+0000 7f3b391d2740 1 --2- 172.21.15.50:0/3458343633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a425660 0x561f8a423050 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.801+0000 7f3b391d2740 1 --2- 172.21.15.50:0/3458343633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a4124b0 0x561f8a422b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.801+0000 7f3b391d2740 1 --2- 172.21.15.50:0/3458343633 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x561f8a4356d0 0x561f8a437ac0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.801+0000 7f3b1d600640 0 client.25726 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:24.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.802+0000 7f3b391d2740 1 --2- 172.21.15.50:0/3458343633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a4225d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.802+0000 7f3b391d2740 1 -- 172.21.15.50:0/3458343633 >> 172.21.15.50:0/3458343633 conn(0x561f8a40e200 msgr2=0x561f8a413e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:24.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.802+0000 7f3b391d2740 1 -- 172.21.15.50:0/3458343633 shutdown_connections 2024-09-10T10:13:24.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.802+0000 7f3b391d2740 1 -- 172.21.15.50:0/3458343633 wait complete. 2024-09-10T10:13:24.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.802+0000 7f3b391d2740 20 client.25726 trim_cache size 0 max 16384 2024-09-10T10:13:24.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.818+0000 7f3b391d2740 1 Processor -- start 2024-09-10T10:13:24.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.819+0000 7f3b391d2740 1 -- start start 2024-09-10T10:13:24.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.819+0000 7f3b391d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a422ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.819+0000 7f3b391d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a4124b0 0x561f8a43d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.819+0000 7f3b391d2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a425660 0x561f8a43d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.819+0000 7f3b391d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301af450 con 0x561f8a411b90 2024-09-10T10:13:24.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.819+0000 7f3b391d2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301acd20 con 0x561f8a425660 2024-09-10T10:13:24.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.819+0000 7f3b391d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301aab70 con 0x561f8a4124b0 2024-09-10T10:13:24.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.820+0000 7f3b2ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a422ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.820+0000 7f3b2ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a422ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33108/0 (socket says 172.21.15.50:33108) 2024-09-10T10:13:24.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.820+0000 7f3b2ea00640 1 -- 172.21.15.50:0/3736679348 learned_addr learned my addr 172.21.15.50:0/3736679348 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:24.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.820+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/3736679348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a425660 0x561f8a43d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.821+0000 7f3b2f400640 1 --2- 172.21.15.50:0/3736679348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a4124b0 0x561f8a43d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.821+0000 7f3b2ea00640 1 -- 172.21.15.50:0/3736679348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a4124b0 msgr2=0x561f8a43d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.821+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/3736679348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a4124b0 0x561f8a43d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.821+0000 7f3b2ea00640 1 -- 172.21.15.50:0/3736679348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a425660 msgr2=0x561f8a43d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.821+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/3736679348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a425660 0x561f8a43d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.821+0000 7f3b2ea00640 1 -- 172.21.15.50:0/3736679348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8a409770 con 0x561f8a411b90 2024-09-10T10:13:24.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.822+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/3736679348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a422ea0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3b200059f0 tx=0x7f3b20005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45365dd4d3bc2a84 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:24.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.822+0000 7f3b1fe00640 1 -- 172.21.15.50:0/3736679348 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20025040 con 0x561f8a411b90 2024-09-10T10:13:24.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.822+0000 7f3b1fe00640 1 -- 172.21.15.50:0/3736679348 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b2000cd70 con 0x561f8a411b90 2024-09-10T10:13:24.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.822+0000 7f3b1fe00640 1 -- 172.21.15.50:0/3736679348 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20012450 con 0x561f8a411b90 2024-09-10T10:13:24.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.823+0000 7f3b391d2740 1 -- 172.21.15.50:0/3736679348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 msgr2=0x561f8a422ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:24.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.823+0000 7f3b391d2740 1 --2- 172.21.15.50:0/3736679348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a422ea0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3b200059f0 tx=0x7f3b20005b90 comp rx=0 tx=0).stop 2024-09-10T10:13:24.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.824+0000 7f3b391d2740 1 -- 172.21.15.50:0/3736679348 shutdown_connections 2024-09-10T10:13:24.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.824+0000 7f3b391d2740 1 --2- 172.21.15.50:0/3736679348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a425660 0x561f8a43d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.824+0000 7f3b391d2740 1 --2- 172.21.15.50:0/3736679348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a4124b0 0x561f8a43d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.824+0000 7f3b391d2740 1 --2- 172.21.15.50:0/3736679348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a411b90 0x561f8a422ea0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.824+0000 7f3b391d2740 1 -- 172.21.15.50:0/3736679348 >> 172.21.15.50:0/3736679348 conn(0x561f8a40e200 msgr2=0x561f8a424650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:24.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.824+0000 7f3b391d2740 1 -- 172.21.15.50:0/3736679348 shutdown_connections 2024-09-10T10:13:24.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.824+0000 7f3b391d2740 1 -- 172.21.15.50:0/3736679348 wait complete. 2024-09-10T10:13:24.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.824+0000 7f3b391d2740 1 -- start start 2024-09-10T10:13:24.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.825+0000 7f3b391d2740 1 Processor -- start 2024-09-10T10:13:24.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.825+0000 7f3b391d2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a411b90 0x561f8a49b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.825+0000 7f3b391d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a4124b0 0x561f8a49b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.825+0000 7f3b391d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a425660 0x561f8a42d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.825+0000 7f3b391d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301ab1e0 con 0x561f8a425660 2024-09-10T10:13:24.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.825+0000 7f3b391d2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301ac650 con 0x561f8a411b90 2024-09-10T10:13:24.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.825+0000 7f3b391d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b301ab8b0 con 0x561f8a4124b0 2024-09-10T10:13:24.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.825+0000 7f3b391d2740 10 client.0 _ll_register_callbacks cb 0x7f3b2000cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.826+0000 7f3b2f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a4124b0 0x561f8a49b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.826+0000 7f3b2ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a411b90 0x561f8a49b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.826+0000 7f3b2f400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a4124b0 0x561f8a49b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:54200/0 (socket says 172.21.15.50:54200) 2024-09-10T10:13:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.826+0000 7f3b2f400640 1 -- 172.21.15.50:0/1374870818 learned_addr learned my addr 172.21.15.50:0/1374870818 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.826+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/1374870818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a425660 0x561f8a42d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.826+0000 7f3b2f400640 1 -- 172.21.15.50:0/1374870818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a411b90 msgr2=0x561f8a49b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.826+0000 7f3b2f400640 1 --2- 172.21.15.50:0/1374870818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a411b90 0x561f8a49b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.826+0000 7f3b2f400640 1 -- 172.21.15.50:0/1374870818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a425660 msgr2=0x561f8a42d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.826+0000 7f3b2f400640 1 --2- 172.21.15.50:0/1374870818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a425660 0x561f8a42d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.826+0000 7f3b2f400640 1 -- 172.21.15.50:0/1374870818 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f8a42ddd0 con 0x561f8a4124b0 2024-09-10T10:13:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.826+0000 7f3b2f400640 1 --2- 172.21.15.50:0/1374870818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a4124b0 0x561f8a49b9e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3b18000c00 tx=0x7f3b18009590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f89a521cd4bece5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.826+0000 7f3b1d600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:13:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.827+0000 7f3b1d600640 1 -- 172.21.15.50:0/1374870818 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b18035050 con 0x561f8a4124b0 2024-09-10T10:13:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.827+0000 7f3b391d2740 1 -- 172.21.15.50:0/1374870818 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561f8a37fe60 con 0x561f8a4124b0 2024-09-10T10:13:24.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.827+0000 7f3b1d600640 1 -- 172.21.15.50:0/1374870818 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f3b18005590 con 0x561f8a4124b0 2024-09-10T10:13:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.827+0000 7f3b1d600640 1 -- 172.21.15.50:0/1374870818 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3b18051050 con 0x561f8a4124b0 2024-09-10T10:13:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.827+0000 7f3b391d2740 10 client.25729 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.827+0000 7f3b391d2740 1 -- 172.21.15.50:0/1374870818 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561f8a4995b0 con 0x561f8a4124b0 2024-09-10T10:13:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.827+0000 7f3b1d600640 1 -- 172.21.15.50:0/1374870818 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561f8a37fe60 con 0x561f8a4124b0 2024-09-10T10:13:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.827+0000 7f3b1d600640 1 -- 172.21.15.50:0/1374870818 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3b1804c030 con 0x561f8a4124b0 2024-09-10T10:13:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.827+0000 7f3b391d2740 10 client.25729 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.827+0000 7f3b391d2740 10 client.25729 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:13:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.827+0000 7f3b391d2740 20 client.25729 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.827+0000 7f3b391d2740 1 --2- 172.21.15.50:0/1374870818 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x561f8a4356d0 0x561f8a4b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.828+0000 7f3b391d2740 4 client.25729 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:13:24.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.828+0000 7f3b391d2740 1 -- 172.21.15.50:0/1374870818 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f8a2fc010 con 0x561f8a4356d0 2024-09-10T10:13:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.828+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/1374870818 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x561f8a4356d0 0x561f8a4b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.828+0000 7f3b1d600640 10 client.25729 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.829+0000 7f3b2ea00640 1 --2- 172.21.15.50:0/1374870818 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x561f8a4356d0 0x561f8a4b3670 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=569091f1807a23b3 server_cookie=33b79ee9e96665fd in_seq=0 out_seq=0 2024-09-10T10:13:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.830+0000 7f3b1d600640 1 -- 172.21.15.50:0/1374870818 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f8a2fc010 con 0x561f8a4356d0 2024-09-10T10:13:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.830+0000 7f3b1d600640 10 client.25729 handle_command_reply: tid=0 2024-09-10T10:13:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.830+0000 7f3b391d2740 1 client.25729 shutdown 2024-09-10T10:13:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.830+0000 7f3b391d2740 1 -- 172.21.15.50:0/1374870818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a4124b0 msgr2=0x561f8a49b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.830+0000 7f3b391d2740 1 --2- 172.21.15.50:0/1374870818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a4124b0 0x561f8a49b9e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3b18000c00 tx=0x7f3b18009590 comp rx=0 tx=0).stop 2024-09-10T10:13:24.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.830+0000 7f3b391d2740 1 -- 172.21.15.50:0/1374870818 shutdown_connections 2024-09-10T10:13:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.830+0000 7f3b391d2740 1 --2- 172.21.15.50:0/1374870818 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x561f8a4356d0 0x561f8a4b3670 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.830+0000 7f3b391d2740 1 --2- 172.21.15.50:0/1374870818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561f8a425660 0x561f8a42d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.830+0000 7f3b1d600640 0 client.25729 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.830+0000 7f3b391d2740 1 --2- 172.21.15.50:0/1374870818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f8a4124b0 0x561f8a49b9e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.830+0000 7f3b391d2740 1 --2- 172.21.15.50:0/1374870818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561f8a411b90 0x561f8a49b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.831+0000 7f3b391d2740 1 -- 172.21.15.50:0/1374870818 >> 172.21.15.50:0/1374870818 conn(0x561f8a40e200 msgr2=0x561f8a40cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.831+0000 7f3b391d2740 1 -- 172.21.15.50:0/1374870818 shutdown_connections 2024-09-10T10:13:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.831+0000 7f3b391d2740 1 -- 172.21.15.50:0/1374870818 wait complete. 2024-09-10T10:13:24.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.831+0000 7f3b391d2740 20 client.25729 trim_cache size 0 max 16384 2024-09-10T10:13:24.834 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:13:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.832+0000 7f3b36600640 1 -- 172.21.15.50:0/718724476 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b140a2c00 msgr2=0x7f3b140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.832+0000 7f3b36600640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b140a2c00 0x7f3b140a50c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3b2809bdf0 tx=0x7f3b28005f70 comp rx=0 tx=0).stop 2024-09-10T10:13:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.832+0000 7f3b36600640 1 -- 172.21.15.50:0/718724476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b30109120 msgr2=0x7f3b3019ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.832+0000 7f3b36600640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b30109120 0x7f3b3019ef00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800ec50 tx=0x7f3b2800c6a0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.833+0000 7f3b36600640 1 -- 172.21.15.50:0/718724476 shutdown_connections 2024-09-10T10:13:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.833+0000 7f3b36600640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3b140a2c00 0x7f3b140a50c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.833+0000 7f3b36600640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b30109120 0x7f3b3019ef00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.833+0000 7f3b36600640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b301049a0 0x7f3b3019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.833+0000 7f3b36600640 1 --2- 172.21.15.50:0/718724476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30103ff0 0x7f3b3019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.833+0000 7f3b36600640 1 -- 172.21.15.50:0/718724476 >> 172.21.15.50:0/718724476 conn(0x7f3b300ffa90 msgr2=0x7f3b30100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:24.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.834+0000 7f3b36600640 1 -- 172.21.15.50:0/718724476 shutdown_connections 2024-09-10T10:13:24.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:24.834+0000 7f3b36600640 1 -- 172.21.15.50:0/718724476 wait complete. 2024-09-10T10:13:25.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:24 smithi189 ceph-mon[34999]: pgmap v457: 129 pgs: 129 active+clean; 965 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 80 MiB/s wr, 29 op/s 2024-09-10T10:13:25.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:24 smithi084 ceph-mon[34812]: pgmap v457: 129 pgs: 129 active+clean; 965 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 80 MiB/s wr, 29 op/s 2024-09-10T10:13:25.745 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T10:13:26.281 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:26.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:26 smithi050 ceph-mon[30354]: pgmap v458: 129 pgs: 129 active+clean; 1.0 GiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 87 MiB/s wr, 29 op/s 2024-09-10T10:13:27.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.041+0000 7f38b3e00640 1 -- 172.21.15.50:0/1191466884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b41019d0 msgr2=0x7f38b4101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.041+0000 7f38b3e00640 1 --2- 172.21.15.50:0/1191466884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b41019d0 0x7f38b4101e30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009930 tx=0x7f38a002a420 comp rx=0 tx=0).stop 2024-09-10T10:13:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.041+0000 7f38b3e00640 1 -- 172.21.15.50:0/1191466884 shutdown_connections 2024-09-10T10:13:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.041+0000 7f38b3e00640 1 --2- 172.21.15.50:0/1191466884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38b4102370 0x7f38b410e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.041+0000 7f38b3e00640 1 --2- 172.21.15.50:0/1191466884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b41019d0 0x7f38b4101e30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.041+0000 7f38b3e00640 1 --2- 172.21.15.50:0/1191466884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38b41079d0 0x7f38b4107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.041+0000 7f38b3e00640 1 -- 172.21.15.50:0/1191466884 >> 172.21.15.50:0/1191466884 conn(0x7f38b40fd710 msgr2=0x7f38b40ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.041+0000 7f38b3e00640 1 -- 172.21.15.50:0/1191466884 shutdown_connections 2024-09-10T10:13:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.041+0000 7f38b3e00640 1 -- 172.21.15.50:0/1191466884 wait complete. 2024-09-10T10:13:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.043+0000 7f38b3e00640 1 Processor -- start 2024-09-10T10:13:27.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.043+0000 7f38b3e00640 1 -- start start 2024-09-10T10:13:27.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.044+0000 7f38b3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b41019d0 0x7f38b419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.044+0000 7f38b3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38b4102370 0x7f38b419f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.044+0000 7f38b3e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38b41079d0 0x7f38b410da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.044+0000 7f38b3e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f38b4111e20 con 0x7f38b41019d0 2024-09-10T10:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.044+0000 7f38b3e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f38b4111ca0 con 0x7f38b4102370 2024-09-10T10:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.044+0000 7f38b3e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f38b4111fa0 con 0x7f38b41079d0 2024-09-10T10:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.044+0000 7f38b2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38b4102370 0x7f38b419f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.044+0000 7f38b2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38b4102370 0x7f38b419f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:56238/0 (socket says 172.21.15.50:56238) 2024-09-10T10:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.044+0000 7f38b2000640 1 -- 172.21.15.50:0/2177391570 learned_addr learned my addr 172.21.15.50:0/2177391570 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:27.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.044+0000 7f38b2a00640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b41019d0 0x7f38b419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.045+0000 7f38b3400640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38b41079d0 0x7f38b410da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.045+0000 7f38b2a00640 1 -- 172.21.15.50:0/2177391570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38b41079d0 msgr2=0x7f38b410da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.045+0000 7f38b2a00640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38b41079d0 0x7f38b410da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.045+0000 7f38b2a00640 1 -- 172.21.15.50:0/2177391570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38b4102370 msgr2=0x7f38b419f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.045+0000 7f38b2a00640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38b4102370 0x7f38b419f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.045+0000 7f38b2a00640 1 -- 172.21.15.50:0/2177391570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b410e2f0 con 0x7f38b41019d0 2024-09-10T10:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.046+0000 7f38b2a00640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b41019d0 0x7f38b419ee80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f38a400d6d0 tx=0x7f38a400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.046+0000 7f38ab400640 1 -- 172.21.15.50:0/2177391570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4017070 con 0x7f38b41019d0 2024-09-10T10:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.046+0000 7f38ab400640 1 -- 172.21.15.50:0/2177391570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38a4009820 con 0x7f38b41019d0 2024-09-10T10:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.046+0000 7f38ab400640 1 -- 172.21.15.50:0/2177391570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4004ce0 con 0x7f38b41019d0 2024-09-10T10:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.046+0000 7f38b3e00640 1 -- 172.21.15.50:0/2177391570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b410e5e0 con 0x7f38b41019d0 2024-09-10T10:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.046+0000 7f38b3e00640 1 -- 172.21.15.50:0/2177391570 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b419ab90 con 0x7f38b41019d0 2024-09-10T10:13:27.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.050+0000 7f38ab400640 1 -- 172.21.15.50:0/2177391570 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f38a4010460 con 0x7f38b41019d0 2024-09-10T10:13:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.052+0000 7f38ab400640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f38980c4cd0 0x7f38980c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.053+0000 7f38ab400640 1 -- 172.21.15.50:0/2177391570 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f38a4005280 con 0x7f38b41019d0 2024-09-10T10:13:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.053+0000 7f38bc259740 1 Processor -- start 2024-09-10T10:13:27.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.053+0000 7f38b2000640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f38980c4cd0 0x7f38980c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.053+0000 7f38bc259740 1 -- start start 2024-09-10T10:13:27.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.054+0000 7f38bc259740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36576e40 0x563e36577220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.054+0000 7f38bc259740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36577760 0x563e36581ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.054+0000 7f38bc259740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36582020 0x563e36584410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.054+0000 7f38bc259740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563e364dd3e0 con 0x563e36577760 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.054+0000 7f38bc259740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563e36484d80 con 0x563e36582020 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.054+0000 7f38bc259740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563e364d93a0 con 0x563e36576e40 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.054+0000 7f38b2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36576e40 0x563e36577220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.054+0000 7f38b2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36576e40 0x563e36577220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:53046/0 (socket says 172.21.15.50:53046) 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.054+0000 7f38b2a00640 1 -- 172.21.15.50:0/625825114 learned_addr learned my addr 172.21.15.50:0/625825114 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.054+0000 7f38b3400640 1 --2- 172.21.15.50:0/625825114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36582020 0x563e36584410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.054+0000 7f38b2000640 1 --2- 172.21.15.50:0/625825114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36577760 0x563e36581ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.055+0000 7f38b3400640 1 -- 172.21.15.50:0/625825114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36576e40 msgr2=0x563e36577220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.055+0000 7f38b3400640 1 --2- 172.21.15.50:0/625825114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36576e40 0x563e36577220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.055+0000 7f38b3400640 1 -- 172.21.15.50:0/625825114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36577760 msgr2=0x563e36581ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:27.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.055+0000 7f38b3400640 1 --2- 172.21.15.50:0/625825114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36577760 0x563e36581ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.055+0000 7f38b3400640 1 -- 172.21.15.50:0/625825114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e364a3ae0 con 0x563e36582020 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.055+0000 7f38b3400640 1 --2- 172.21.15.50:0/625825114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36582020 0x563e36584410 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009ed0 tx=0x7f38ac0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7033bda0e92a3ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.055+0000 7f389f400640 1 -- 172.21.15.50:0/625825114 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac003b70 con 0x563e36582020 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.056+0000 7f389f400640 1 -- 172.21.15.50:0/625825114 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38ac015070 con 0x563e36582020 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.056+0000 7f389f400640 1 -- 172.21.15.50:0/625825114 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac011900 con 0x563e36582020 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.057+0000 7f38bc259740 1 -- 172.21.15.50:0/625825114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36582020 msgr2=0x563e36584410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.057+0000 7f38bc259740 1 --2- 172.21.15.50:0/625825114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36582020 0x563e36584410 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009ed0 tx=0x7f38ac0107a0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.057+0000 7f38bc259740 1 -- 172.21.15.50:0/625825114 shutdown_connections 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.057+0000 7f38bc259740 1 --2- 172.21.15.50:0/625825114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36582020 0x563e36584410 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.057+0000 7f38bc259740 1 --2- 172.21.15.50:0/625825114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36577760 0x563e36581ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.057+0000 7f38bc259740 1 --2- 172.21.15.50:0/625825114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36576e40 0x563e36577220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.057+0000 7f38bc259740 1 -- 172.21.15.50:0/625825114 >> 172.21.15.50:0/625825114 conn(0x563e365733d0 msgr2=0x563e365737b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.057+0000 7f38bc259740 1 -- 172.21.15.50:0/625825114 shutdown_connections 2024-09-10T10:13:27.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.057+0000 7f38bc259740 1 -- 172.21.15.50:0/625825114 wait complete. 2024-09-10T10:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.058+0000 7f38bc259740 1 -- start start 2024-09-10T10:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.058+0000 7f38bc259740 1 Processor -- start 2024-09-10T10:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.059+0000 7f38bc259740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36576e40 0x563e3657ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.059+0000 7f38bc259740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36577760 0x563e3657f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.059+0000 7f38bc259740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36582020 0x563e3657f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.059+0000 7f38bc259740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563e36584bf0 con 0x563e36577760 2024-09-10T10:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.059+0000 7f38bc259740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563e364980f0 con 0x563e36582020 2024-09-10T10:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.059+0000 7f38bc259740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563e36584d70 con 0x563e36576e40 2024-09-10T10:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.059+0000 7f38bc259740 10 client.0 _ll_register_callbacks cb 0x563e3647fbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.060+0000 7f38b2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36576e40 0x563e3657ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.060+0000 7f38b2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36576e40 0x563e3657ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:53054/0 (socket says 172.21.15.50:53054) 2024-09-10T10:13:27.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.060+0000 7f38b2a00640 1 -- 172.21.15.50:0/2841633878 learned_addr learned my addr 172.21.15.50:0/2841633878 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:27.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.060+0000 7f38b3400640 1 --2- 172.21.15.50:0/2841633878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36582020 0x563e3657f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.060+0000 7f38b2000640 1 --2- 172.21.15.50:0/2841633878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36577760 0x563e3657f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.060+0000 7f38b2000640 1 -- 172.21.15.50:0/2841633878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36576e40 msgr2=0x563e3657ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:27.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.060+0000 7f38b2000640 1 --2- 172.21.15.50:0/2841633878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36576e40 0x563e3657ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.060+0000 7f38b2000640 1 -- 172.21.15.50:0/2841633878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36582020 msgr2=0x563e3657f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:27.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.060+0000 7f38b2000640 1 --2- 172.21.15.50:0/2841633878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36582020 0x563e3657f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.060+0000 7f38b2000640 1 -- 172.21.15.50:0/2841633878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e3624e3c0 con 0x563e36577760 2024-09-10T10:13:27.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.061+0000 7f38b2000640 1 --2- 172.21.15.50:0/2841633878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36577760 0x563e3657f460 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f38b410eca0 tx=0x7f38a0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85d0fc2a9fac5cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:27.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.061+0000 7f3893e00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:13:27.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.062+0000 7f3893e00640 1 -- 172.21.15.50:0/2841633878 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0035050 con 0x563e36577760 2024-09-10T10:13:27.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.062+0000 7f3893e00640 1 -- 172.21.15.50:0/2841633878 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f38a00038b0 con 0x563e36577760 2024-09-10T10:13:27.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.062+0000 7f38bc259740 1 -- 172.21.15.50:0/2841633878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38ac015070 con 0x563e36577760 2024-09-10T10:13:27.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.062+0000 7f38b2000640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f38980c4cd0 0x7f38980c7190 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f38a004a000 tx=0x7f38a003e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:27.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.062+0000 7f3893e00640 1 -- 172.21.15.50:0/2841633878 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f38a0003ab0 con 0x563e36577760 2024-09-10T10:13:27.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.062+0000 7f38bc259740 10 client.15717 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:27.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.063+0000 7f38bc259740 1 -- 172.21.15.50:0/2841633878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563e36590d30 con 0x563e36577760 2024-09-10T10:13:27.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.063+0000 7f3893e00640 1 -- 172.21.15.50:0/2841633878 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38ac015070 con 0x563e36577760 2024-09-10T10:13:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.063+0000 7f3893e00640 1 -- 172.21.15.50:0/2841633878 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f38a003d480 con 0x563e36577760 2024-09-10T10:13:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.064+0000 7f38bc259740 10 client.15717 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.064+0000 7f38bc259740 10 client.15717 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:13:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.064+0000 7f38bc259740 20 client.15717 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.064+0000 7f38bc259740 1 --2- 172.21.15.50:0/2841633878 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x563e36592290 0x563e36594710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.064+0000 7f38bc259740 4 client.15717 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:27.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.064+0000 7f38bc259740 1 -- 172.21.15.50:0/2841633878 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e364ea950 con 0x563e36592290 2024-09-10T10:13:27.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.064+0000 7f38b2a00640 1 --2- 172.21.15.50:0/2841633878 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x563e36592290 0x563e36594710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.065+0000 7f38b2a00640 1 --2- 172.21.15.50:0/2841633878 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x563e36592290 0x563e36594710 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e8415ddd15f0f941 server_cookie=316334a68a9f2196 in_seq=0 out_seq=0 2024-09-10T10:13:27.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.065+0000 7f3893e00640 10 client.15717 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:27.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.066+0000 7f3893e00640 1 -- 172.21.15.50:0/2841633878 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e364ea950 con 0x563e36592290 2024-09-10T10:13:27.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.066+0000 7f3893e00640 10 client.15717 handle_command_reply: tid=0 2024-09-10T10:13:27.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.066+0000 7f38bc259740 1 client.15717 shutdown 2024-09-10T10:13:27.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.067+0000 7f38bc259740 1 -- 172.21.15.50:0/2841633878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36577760 msgr2=0x563e3657f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:27.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.067+0000 7f38bc259740 1 --2- 172.21.15.50:0/2841633878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36577760 0x563e3657f460 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f38b410eca0 tx=0x7f38a0004470 comp rx=0 tx=0).stop 2024-09-10T10:13:27.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.067+0000 7f38bc259740 1 -- 172.21.15.50:0/2841633878 shutdown_connections 2024-09-10T10:13:27.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.067+0000 7f38bc259740 1 --2- 172.21.15.50:0/2841633878 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x563e36592290 0x563e36594710 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.067+0000 7f38bc259740 1 --2- 172.21.15.50:0/2841633878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36582020 0x563e3657f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.067+0000 7f38bc259740 1 --2- 172.21.15.50:0/2841633878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36577760 0x563e3657f460 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.067+0000 7f38bc259740 1 --2- 172.21.15.50:0/2841633878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36576e40 0x563e3657ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.067+0000 7f38bc259740 1 -- 172.21.15.50:0/2841633878 >> 172.21.15.50:0/2841633878 conn(0x563e365733d0 msgr2=0x563e36579100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:27.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.068+0000 7f3893e00640 0 client.15717 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:27.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.068+0000 7f38bc259740 1 -- 172.21.15.50:0/2841633878 shutdown_connections 2024-09-10T10:13:27.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.068+0000 7f38bc259740 1 -- 172.21.15.50:0/2841633878 wait complete. 2024-09-10T10:13:27.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.068+0000 7f38bc259740 20 client.15717 trim_cache size 0 max 16384 2024-09-10T10:13:27.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:26 smithi189 ceph-mon[34999]: pgmap v458: 129 pgs: 129 active+clean; 1.0 GiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 87 MiB/s wr, 29 op/s 2024-09-10T10:13:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.089+0000 7f38bc259740 1 Processor -- start 2024-09-10T10:13:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.090+0000 7f38bc259740 1 -- start start 2024-09-10T10:13:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.090+0000 7f38bc259740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36576e40 0x563e36580e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.090+0000 7f38bc259740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36577760 0x563e3659a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.090+0000 7f38bc259740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36582020 0x563e3659a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.090+0000 7f38bc259740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3894012460 con 0x563e36582020 2024-09-10T10:13:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.090+0000 7f38bc259740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f389400fd30 con 0x563e36576e40 2024-09-10T10:13:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.090+0000 7f38bc259740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f389400db80 con 0x563e36577760 2024-09-10T10:13:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.091+0000 7f38b2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36576e40 0x563e36580e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.091+0000 7f38b2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36576e40 0x563e36580e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:56272/0 (socket says 172.21.15.50:56272) 2024-09-10T10:13:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.091+0000 7f38b2a00640 1 -- 172.21.15.50:0/1459635565 learned_addr learned my addr 172.21.15.50:0/1459635565 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.091+0000 7f38b2000640 1 --2- 172.21.15.50:0/1459635565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36577760 0x563e3659a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.092+0000 7f38b2a00640 1 -- 172.21.15.50:0/1459635565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36577760 msgr2=0x563e3659a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.092+0000 7f38b2a00640 1 --2- 172.21.15.50:0/1459635565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36577760 0x563e3659a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.092+0000 7f38b2a00640 1 -- 172.21.15.50:0/1459635565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36582020 msgr2=0x563e3659a560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:13:27.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.092+0000 7f38b3400640 1 --2- 172.21.15.50:0/1459635565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36582020 0x563e3659a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.093+0000 7f38b2a00640 1 --2- 172.21.15.50:0/1459635565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36582020 0x563e3659a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.093+0000 7f38b2a00640 1 -- 172.21.15.50:0/1459635565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e36579df0 con 0x563e36576e40 2024-09-10T10:13:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.093+0000 7f38b3400640 1 --2- 172.21.15.50:0/1459635565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36582020 0x563e3659a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:13:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.094+0000 7f38b2a00640 1 --2- 172.21.15.50:0/1459635565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36576e40 0x563e36580e90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f38a4098b80 tx=0x7f38a401d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed701f5c82792bed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.094+0000 7f389ea00640 1 -- 172.21.15.50:0/1459635565 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4020040 con 0x563e36576e40 2024-09-10T10:13:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.094+0000 7f389ea00640 1 -- 172.21.15.50:0/1459635565 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38a4015040 con 0x563e36576e40 2024-09-10T10:13:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.094+0000 7f389ea00640 1 -- 172.21.15.50:0/1459635565 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a40bc0b0 con 0x563e36576e40 2024-09-10T10:13:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.095+0000 7f38bc259740 1 -- 172.21.15.50:0/1459635565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36576e40 msgr2=0x563e36580e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.095+0000 7f38bc259740 1 --2- 172.21.15.50:0/1459635565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36576e40 0x563e36580e90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f38a4098b80 tx=0x7f38a401d040 comp rx=0 tx=0).stop 2024-09-10T10:13:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.096+0000 7f38bc259740 1 -- 172.21.15.50:0/1459635565 shutdown_connections 2024-09-10T10:13:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.096+0000 7f38bc259740 1 --2- 172.21.15.50:0/1459635565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36582020 0x563e3659a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.096+0000 7f38bc259740 1 --2- 172.21.15.50:0/1459635565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e36577760 0x563e3659a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.096+0000 7f38bc259740 1 --2- 172.21.15.50:0/1459635565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e36576e40 0x563e36580e90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.096+0000 7f38bc259740 1 -- 172.21.15.50:0/1459635565 >> 172.21.15.50:0/1459635565 conn(0x563e365733d0 msgr2=0x563e36580780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:27.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:26 smithi084 ceph-mon[34812]: pgmap v458: 129 pgs: 129 active+clean; 1.0 GiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 87 MiB/s wr, 29 op/s 2024-09-10T10:13:27.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.101+0000 7f38bc259740 1 -- 172.21.15.50:0/1459635565 shutdown_connections 2024-09-10T10:13:27.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.104+0000 7f38bc259740 1 -- 172.21.15.50:0/1459635565 wait complete. 2024-09-10T10:13:27.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.105+0000 7f38bc259740 1 -- start start 2024-09-10T10:13:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.105+0000 7f38bc259740 1 Processor -- start 2024-09-10T10:13:27.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.106+0000 7f38bc259740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36582020 0x563e3658a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.106+0000 7f38bc259740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e3658a590 0x563e36587020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.106+0000 7f38bc259740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e3658aa10 0x563e36587560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.107+0000 7f38b3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e3658aa10 0x563e36587560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.107+0000 7f38bc259740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f389400e1f0 con 0x563e36582020 2024-09-10T10:13:27.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.107+0000 7f38b3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e3658aa10 0x563e36587560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:56282/0 (socket says 172.21.15.50:56282) 2024-09-10T10:13:27.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.107+0000 7f38b3400640 1 -- 172.21.15.50:0/241244887 learned_addr learned my addr 172.21.15.50:0/241244887 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:27.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.107+0000 7f38b2000640 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e3658a590 0x563e36587020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.108+0000 7f38bc259740 1 -- 172.21.15.50:0/241244887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f389400f660 con 0x563e3658aa10 2024-09-10T10:13:27.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.108+0000 7f38bc259740 1 -- 172.21.15.50:0/241244887 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f389400e8c0 con 0x563e3658a590 2024-09-10T10:13:27.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.108+0000 7f38bc259740 10 client.0 _ll_register_callbacks cb 0x7f38ac0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:27.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.108+0000 7f38b2a00640 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36582020 0x563e3658a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.109+0000 7f38b2a00640 1 -- 172.21.15.50:0/241244887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e3658a590 msgr2=0x563e36587020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.109+0000 7f38b2a00640 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e3658a590 0x563e36587020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.109+0000 7f38b2a00640 1 -- 172.21.15.50:0/241244887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e3658aa10 msgr2=0x563e36587560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.109+0000 7f38b2a00640 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e3658aa10 0x563e36587560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.109+0000 7f38b2a00640 1 -- 172.21.15.50:0/241244887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e36587aa0 con 0x563e36582020 2024-09-10T10:13:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.111+0000 7f38b2a00640 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36582020 0x563e3658a050 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x563e36581e70 tx=0x7f38a40a4fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229b36846dc3f4f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:27.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.111+0000 7f3893e00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:13:27.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.112+0000 7f3893e00640 1 -- 172.21.15.50:0/241244887 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4020050 con 0x563e36582020 2024-09-10T10:13:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.112+0000 7f38b3400640 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e3658aa10 0x563e36587560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:13:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.112+0000 7f38b2000640 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e3658a590 0x563e36587020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:13:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.113+0000 7f3893e00640 1 -- 172.21.15.50:0/241244887 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f38a40988b0 con 0x563e36582020 2024-09-10T10:13:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.113+0000 7f38bc259740 1 -- 172.21.15.50:0/241244887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38a4015040 con 0x563e36582020 2024-09-10T10:13:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.113+0000 7f3893e00640 1 -- 172.21.15.50:0/241244887 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f38a40b5170 con 0x563e36582020 2024-09-10T10:13:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.114+0000 7f38bc259740 10 client.15720 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:27.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.114+0000 7f38bc259740 1 -- 172.21.15.50:0/241244887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563e365fdc40 con 0x563e36582020 2024-09-10T10:13:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.114+0000 7f3893e00640 1 -- 172.21.15.50:0/241244887 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38a4015040 con 0x563e36582020 2024-09-10T10:13:27.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.115+0000 7f3893e00640 1 -- 172.21.15.50:0/241244887 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f38a409b070 con 0x563e36582020 2024-09-10T10:13:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.115+0000 7f38bc259740 10 client.15720 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.115+0000 7f38bc259740 10 client.15720 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:13:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.115+0000 7f38bc259740 20 client.15720 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.115+0000 7f38bc259740 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x563e365fe170 0x563e36600590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.115+0000 7f38bc259740 4 client.15720 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:13:27.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.115+0000 7f38bc259740 1 -- 172.21.15.50:0/241244887 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563e364e4e60 con 0x563e365fe170 2024-09-10T10:13:27.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.117+0000 7f38b2000640 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x563e365fe170 0x563e36600590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.121+0000 7f38b2000640 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x563e365fe170 0x563e36600590 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=58f105950b883de6 server_cookie=2b63dc4f249acba4 in_seq=0 out_seq=0 2024-09-10T10:13:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.121+0000 7f3893e00640 10 client.15720 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.121+0000 7f3893e00640 1 -- 172.21.15.50:0/241244887 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563e364e4e60 con 0x563e365fe170 2024-09-10T10:13:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.121+0000 7f3893e00640 10 client.15720 handle_command_reply: tid=0 2024-09-10T10:13:27.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.122+0000 7f38bc259740 1 client.15720 shutdown 2024-09-10T10:13:27.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.125+0000 7f38bc259740 1 -- 172.21.15.50:0/241244887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36582020 msgr2=0x563e3658a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:27.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.125+0000 7f38bc259740 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36582020 0x563e3658a050 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x563e36581e70 tx=0x7f38a40a4fa0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.126+0000 7f38bc259740 1 -- 172.21.15.50:0/241244887 shutdown_connections 2024-09-10T10:13:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.126+0000 7f38bc259740 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x563e365fe170 0x563e36600590 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.126+0000 7f38bc259740 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e3658aa10 0x563e36587560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.126+0000 7f3893e00640 0 client.15720 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.126+0000 7f38bc259740 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e3658a590 0x563e36587020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.126+0000 7f38bc259740 1 --2- 172.21.15.50:0/241244887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e36582020 0x563e3658a050 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.126+0000 7f38bc259740 1 -- 172.21.15.50:0/241244887 >> 172.21.15.50:0/241244887 conn(0x563e365733d0 msgr2=0x563e36580fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.127+0000 7f38bc259740 1 -- 172.21.15.50:0/241244887 shutdown_connections 2024-09-10T10:13:27.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.127+0000 7f38bc259740 1 -- 172.21.15.50:0/241244887 wait complete. 2024-09-10T10:13:27.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.128+0000 7f38bc259740 20 client.15720 trim_cache size 0 max 16384 2024-09-10T10:13:27.131 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:13:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.130+0000 7f38b3e00640 1 -- 172.21.15.50:0/2177391570 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f38980c4cd0 msgr2=0x7f38980c7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.130+0000 7f38b3e00640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f38980c4cd0 0x7f38980c7190 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f38a004a000 tx=0x7f38a003e000 comp rx=0 tx=0).stop 2024-09-10T10:13:27.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.130+0000 7f38b3e00640 1 -- 172.21.15.50:0/2177391570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b41019d0 msgr2=0x7f38b419ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:27.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.130+0000 7f38b3e00640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b41019d0 0x7f38b419ee80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f38a400d6d0 tx=0x7f38a400db90 comp rx=0 tx=0).stop 2024-09-10T10:13:27.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.132+0000 7f38b3e00640 1 -- 172.21.15.50:0/2177391570 shutdown_connections 2024-09-10T10:13:27.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.132+0000 7f38b3e00640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f38980c4cd0 0x7f38980c7190 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.132+0000 7f38b3e00640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f38b41079d0 0x7f38b410da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.132+0000 7f38b3e00640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38b4102370 0x7f38b419f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.132+0000 7f38b3e00640 1 --2- 172.21.15.50:0/2177391570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38b41019d0 0x7f38b419ee80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:27.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.132+0000 7f38b3e00640 1 -- 172.21.15.50:0/2177391570 >> 172.21.15.50:0/2177391570 conn(0x7f38b40fd710 msgr2=0x7f38b4074510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:27.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.133+0000 7f38b3e00640 1 -- 172.21.15.50:0/2177391570 shutdown_connections 2024-09-10T10:13:27.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:27.133+0000 7f38b3e00640 1 -- 172.21.15.50:0/2177391570 wait complete. 2024-09-10T10:13:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: Children see throughput for 1 rewriters = 244342.95 kB/sec 2024-09-10T10:13:27.283 INFO:tasks.workunit.client.0.smithi050.stdout: Parent sees throughput for 1 rewriters = 244307.08 kB/sec 2024-09-10T10:13:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: Min throughput per process = 244342.95 kB/sec 2024-09-10T10:13:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: Max throughput per process = 244342.95 kB/sec 2024-09-10T10:13:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: Avg throughput per process = 244342.95 kB/sec 2024-09-10T10:13:27.284 INFO:tasks.workunit.client.0.smithi050.stdout: Min xfer = 1048576.00 kB 2024-09-10T10:13:28.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:28 smithi050 ceph-mon[30354]: pgmap v459: 129 pgs: 129 active+clean; 1.0 GiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 98 MiB/s wr, 33 op/s 2024-09-10T10:13:29.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:28 smithi189 ceph-mon[34999]: pgmap v459: 129 pgs: 129 active+clean; 1.0 GiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 98 MiB/s wr, 33 op/s 2024-09-10T10:13:29.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:28 smithi084 ceph-mon[34812]: pgmap v459: 129 pgs: 129 active+clean; 1.0 GiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 98 MiB/s wr, 33 op/s 2024-09-10T10:13:29.147 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T10:13:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.061+0000 7f2f1fe00640 1 -- 172.21.15.50:0/2968526332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20108f60 msgr2=0x7f2f20110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.061+0000 7f2f1fe00640 1 --2- 172.21.15.50:0/2968526332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20108f60 0x7f2f20110ae0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009ca0 tx=0x7f2f1802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.061+0000 7f2f1fe00640 1 -- 172.21.15.50:0/2968526332 shutdown_connections 2024-09-10T10:13:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.061+0000 7f2f1fe00640 1 --2- 172.21.15.50:0/2968526332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20108f60 0x7f2f20110ae0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.061+0000 7f2f1fe00640 1 --2- 172.21.15.50:0/2968526332 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f201047e0 0x7f2f20108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.061+0000 7f2f1fe00640 1 --2- 172.21.15.50:0/2968526332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f20103e30 0x7f2f20104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.061+0000 7f2f1fe00640 1 -- 172.21.15.50:0/2968526332 >> 172.21.15.50:0/2968526332 conn(0x7f2f200ff8d0 msgr2=0x7f2f20101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.061+0000 7f2f1fe00640 1 -- 172.21.15.50:0/2968526332 shutdown_connections 2024-09-10T10:13:30.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.061+0000 7f2f1fe00640 1 -- 172.21.15.50:0/2968526332 wait complete. 2024-09-10T10:13:30.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.062+0000 7f2f1fe00640 1 Processor -- start 2024-09-10T10:13:30.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.062+0000 7f2f1fe00640 1 -- start start 2024-09-10T10:13:30.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f1fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20103e30 0x7f2f2019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f1fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f201047e0 0x7f2f2019a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f1fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f20108f60 0x7f2f2019eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f1fe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2f20114010 con 0x7f2f20103e30 2024-09-10T10:13:30.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f1fe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2f20113e90 con 0x7f2f20108f60 2024-09-10T10:13:30.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f1fe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2f20114190 con 0x7f2f201047e0 2024-09-10T10:13:30.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f1ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20103e30 0x7f2f2019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f1ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20103e30 0x7f2f2019a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60618/0 (socket says 172.21.15.50:60618) 2024-09-10T10:13:30.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f1ea00640 1 -- 172.21.15.50:0/2629551342 learned_addr learned my addr 172.21.15.50:0/2629551342 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:30.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f1f400640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f20108f60 0x7f2f2019eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f17e00640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f201047e0 0x7f2f2019a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f1ea00640 1 -- 172.21.15.50:0/2629551342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f201047e0 msgr2=0x7f2f2019a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:30.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f1ea00640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f201047e0 0x7f2f2019a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.063+0000 7f2f1ea00640 1 -- 172.21.15.50:0/2629551342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f20108f60 msgr2=0x7f2f2019eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:30.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.064+0000 7f2f1ea00640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f20108f60 0x7f2f2019eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.064+0000 7f2f1ea00640 1 -- 172.21.15.50:0/2629551342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2019f380 con 0x7f2f20103e30 2024-09-10T10:13:30.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.064+0000 7f2f1ea00640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20103e30 0x7f2f2019a3d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000e9f0 tx=0x7f2f1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:30.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.064+0000 7f2f17400640 1 -- 172.21.15.50:0/2629551342 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000cd80 con 0x7f2f20103e30 2024-09-10T10:13:30.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.064+0000 7f2f17400640 1 -- 172.21.15.50:0/2629551342 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f10010910 con 0x7f2f20103e30 2024-09-10T10:13:30.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.064+0000 7f2f1fe00640 1 -- 172.21.15.50:0/2629551342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2019f670 con 0x7f2f20103e30 2024-09-10T10:13:30.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.064+0000 7f2f17400640 1 -- 172.21.15.50:0/2629551342 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f10018990 con 0x7f2f20103e30 2024-09-10T10:13:30.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.064+0000 7f2f1fe00640 1 -- 172.21.15.50:0/2629551342 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f201a6f50 con 0x7f2f20103e30 2024-09-10T10:13:30.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.068+0000 7f2f285d3740 1 Processor -- start 2024-09-10T10:13:30.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.068+0000 7f2f17400640 1 -- 172.21.15.50:0/2629551342 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2f10010ac0 con 0x7f2f20103e30 2024-09-10T10:13:30.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.068+0000 7f2f285d3740 1 -- start start 2024-09-10T10:13:30.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.068+0000 7f2f285d3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 0x55902c297220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.068+0000 7f2f285d3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c297760 0x55902c2a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.068+0000 7f2f285d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 0x55902c2a4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.068+0000 7f2f285d3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55902c1fd3e0 con 0x55902c296e40 2024-09-10T10:13:30.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.068+0000 7f2f285d3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55902c1a4d80 con 0x55902c297760 2024-09-10T10:13:30.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.068+0000 7f2f285d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55902c1f93a0 con 0x55902c2a2020 2024-09-10T10:13:30.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.068+0000 7f2f1f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 0x55902c297220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.069+0000 7f2f1f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 0x55902c297220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60628/0 (socket says 172.21.15.50:60628) 2024-09-10T10:13:30.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.069+0000 7f2f1ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c297760 0x55902c2a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.069+0000 7f2f1f400640 1 -- 172.21.15.50:0/3845902176 learned_addr learned my addr 172.21.15.50:0/3845902176 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:30.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.069+0000 7f2f1f400640 1 -- 172.21.15.50:0/3845902176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 msgr2=0x55902c2a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:30.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.069+0000 7f2f1f400640 1 --2- 172.21.15.50:0/3845902176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 0x55902c2a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.069+0000 7f2f1f400640 1 -- 172.21.15.50:0/3845902176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c297760 msgr2=0x55902c2a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:30.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.069+0000 7f2f1f400640 1 --2- 172.21.15.50:0/3845902176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c297760 0x55902c2a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.069+0000 7f2f1f400640 1 -- 172.21.15.50:0/3845902176 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55902c1c3ae0 con 0x55902c296e40 2024-09-10T10:13:30.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.069+0000 7f2f1ea00640 1 --2- 172.21.15.50:0/3845902176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c297760 0x55902c2a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:30.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.069+0000 7f2f1f400640 1 --2- 172.21.15.50:0/3845902176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 0x55902c297220 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009ca0 tx=0x7f2f180093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45782b9a930df804 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:30.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.070+0000 7f2f17400640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2f040a2c00 0x7f2f040a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.070+0000 7f2f0fe00640 1 -- 172.21.15.50:0/3845902176 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18031db0 con 0x55902c296e40 2024-09-10T10:13:30.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.070+0000 7f2f17400640 1 -- 172.21.15.50:0/2629551342 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f2f100cf6a0 con 0x7f2f20103e30 2024-09-10T10:13:30.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.070+0000 7f2f0fe00640 1 -- 172.21.15.50:0/3845902176 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f18036030 con 0x55902c296e40 2024-09-10T10:13:30.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.070+0000 7f2f0fe00640 1 -- 172.21.15.50:0/3845902176 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f180042a0 con 0x55902c296e40 2024-09-10T10:13:30.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.070+0000 7f2f1ea00640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2f040a2c00 0x7f2f040a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.071+0000 7f2f285d3740 1 -- 172.21.15.50:0/3845902176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 msgr2=0x55902c297220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.071+0000 7f2f1ea00640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2f040a2c00 0x7f2f040a50c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000c6a0 tx=0x7f2f100d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.071+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3845902176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 0x55902c297220 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009ca0 tx=0x7f2f180093e0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.071+0000 7f2f285d3740 1 -- 172.21.15.50:0/3845902176 shutdown_connections 2024-09-10T10:13:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.071+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3845902176 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 0x55902c2a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.071+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3845902176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c297760 0x55902c2a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.071+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3845902176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 0x55902c297220 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.071+0000 7f2f285d3740 1 -- 172.21.15.50:0/3845902176 >> 172.21.15.50:0/3845902176 conn(0x55902c2933d0 msgr2=0x55902c2937b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.071+0000 7f2f285d3740 1 -- 172.21.15.50:0/3845902176 shutdown_connections 2024-09-10T10:13:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.071+0000 7f2f285d3740 1 -- 172.21.15.50:0/3845902176 wait complete. 2024-09-10T10:13:30.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.071+0000 7f2f285d3740 1 -- start start 2024-09-10T10:13:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.072+0000 7f2f285d3740 1 Processor -- start 2024-09-10T10:13:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.072+0000 7f2f285d3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c296e40 0x55902c29ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.072+0000 7f2f285d3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c297760 0x55902c29f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.072+0000 7f2f285d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 0x55902c29f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.072+0000 7f2f285d3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55902c2a4a70 con 0x55902c297760 2024-09-10T10:13:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.072+0000 7f2f285d3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55902c1b80f0 con 0x55902c296e40 2024-09-10T10:13:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.072+0000 7f2f285d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55902c2a4bf0 con 0x55902c2a2020 2024-09-10T10:13:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.072+0000 7f2f285d3740 10 client.0 _ll_register_callbacks cb 0x55902c19fbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.072+0000 7f2f17e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c297760 0x55902c29f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.073+0000 7f2f17e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c297760 0x55902c29f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60634/0 (socket says 172.21.15.50:60634) 2024-09-10T10:13:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.073+0000 7f2f1f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c296e40 0x55902c29ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.073+0000 7f2f17e00640 1 -- 172.21.15.50:0/3206149177 learned_addr learned my addr 172.21.15.50:0/3206149177 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:30.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.073+0000 7f2f1f400640 1 --2- 172.21.15.50:0/3206149177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 0x55902c29f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.073+0000 7f2f1f400640 1 -- 172.21.15.50:0/3206149177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 msgr2=0x55902c29f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:30.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.073+0000 7f2f1f400640 1 --2- 172.21.15.50:0/3206149177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 0x55902c29f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.073+0000 7f2f1f400640 1 -- 172.21.15.50:0/3206149177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c297760 msgr2=0x55902c29f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:30.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.073+0000 7f2f1f400640 1 --2- 172.21.15.50:0/3206149177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c297760 0x55902c29f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.073+0000 7f2f1f400640 1 -- 172.21.15.50:0/3206149177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55902bf6e3c0 con 0x55902c296e40 2024-09-10T10:13:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.073+0000 7f2f17e00640 1 --2- 172.21.15.50:0/3206149177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c297760 0x55902c29f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.073+0000 7f2f1f400640 1 --2- 172.21.15.50:0/3206149177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c296e40 0x55902c29ef60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f1802ade0 tx=0x7f2f18031910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f5d62123a2ee735 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.073+0000 7f2f0cc00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.074+0000 7f2f0cc00640 1 -- 172.21.15.50:0/3206149177 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18059060 con 0x55902c296e40 2024-09-10T10:13:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.074+0000 7f2f285d3740 1 -- 172.21.15.50:0/3206149177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f18036030 con 0x55902c296e40 2024-09-10T10:13:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.074+0000 7f2f0cc00640 1 -- 172.21.15.50:0/3206149177 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f2f18004680 con 0x55902c296e40 2024-09-10T10:13:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.074+0000 7f2f0cc00640 1 -- 172.21.15.50:0/3206149177 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2f18004b40 con 0x55902c296e40 2024-09-10T10:13:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.074+0000 7f2f285d3740 10 client.25787 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.074+0000 7f2f285d3740 1 -- 172.21.15.50:0/3206149177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55902c2a4a70 con 0x55902c296e40 2024-09-10T10:13:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.075+0000 7f2f0cc00640 1 -- 172.21.15.50:0/3206149177 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f18036030 con 0x55902c296e40 2024-09-10T10:13:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.075+0000 7f2f0cc00640 1 -- 172.21.15.50:0/3206149177 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f2f18043070 con 0x55902c296e40 2024-09-10T10:13:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.075+0000 7f2f285d3740 10 client.25787 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:30.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.075+0000 7f2f285d3740 10 client.25787 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:30.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.075+0000 7f2f285d3740 20 client.25787 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:30.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.075+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3206149177 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55902c2b1c80 0x55902c2b4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.075+0000 7f2f285d3740 4 client.25787 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:30.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.075+0000 7f2f285d3740 1 -- 172.21.15.50:0/3206149177 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55902c20a950 con 0x55902c2b1c80 2024-09-10T10:13:30.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.075+0000 7f2f17e00640 1 --2- 172.21.15.50:0/3206149177 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55902c2b1c80 0x55902c2b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.076+0000 7f2f17e00640 1 --2- 172.21.15.50:0/3206149177 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55902c2b1c80 0x55902c2b4070 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3391f0de1671f25e server_cookie=11e0b779a8d8899c in_seq=0 out_seq=0 2024-09-10T10:13:30.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.076+0000 7f2f0cc00640 10 client.25787 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.076+0000 7f2f0cc00640 1 -- 172.21.15.50:0/3206149177 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55902c20a950 con 0x55902c2b1c80 2024-09-10T10:13:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.076+0000 7f2f0cc00640 10 client.25787 handle_command_reply: tid=0 2024-09-10T10:13:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.077+0000 7f2f285d3740 1 client.25787 shutdown 2024-09-10T10:13:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.077+0000 7f2f285d3740 1 -- 172.21.15.50:0/3206149177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c296e40 msgr2=0x55902c29ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.077+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3206149177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c296e40 0x55902c29ef60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f1802ade0 tx=0x7f2f18031910 comp rx=0 tx=0).stop 2024-09-10T10:13:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.077+0000 7f2f285d3740 1 -- 172.21.15.50:0/3206149177 shutdown_connections 2024-09-10T10:13:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.077+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3206149177 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55902c2b1c80 0x55902c2b4070 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.077+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3206149177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 0x55902c29f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.077+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3206149177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c297760 0x55902c29f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.077+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3206149177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c296e40 0x55902c29ef60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.077+0000 7f2f0cc00640 0 client.25787 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.077+0000 7f2f285d3740 1 -- 172.21.15.50:0/3206149177 >> 172.21.15.50:0/3206149177 conn(0x55902c2933d0 msgr2=0x55902c299100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.077+0000 7f2f285d3740 1 -- 172.21.15.50:0/3206149177 shutdown_connections 2024-09-10T10:13:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.077+0000 7f2f285d3740 1 -- 172.21.15.50:0/3206149177 wait complete. 2024-09-10T10:13:30.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.077+0000 7f2f285d3740 20 client.25787 trim_cache size 0 max 16384 2024-09-10T10:13:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.091+0000 7f2f285d3740 1 Processor -- start 2024-09-10T10:13:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.091+0000 7f2f285d3740 1 -- start start 2024-09-10T10:13:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.091+0000 7f2f285d3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c296e40 0x55902c29d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.091+0000 7f2f285d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c297760 0x55902c29f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.091+0000 7f2f285d3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c2a2020 0x55902c2b9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.091+0000 7f2f285d3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2f201b34e0 con 0x55902c2a2020 2024-09-10T10:13:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.091+0000 7f2f285d3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2f201b0db0 con 0x55902c296e40 2024-09-10T10:13:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.091+0000 7f2f285d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2f201aec00 con 0x55902c297760 2024-09-10T10:13:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.092+0000 7f2f1f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c296e40 0x55902c29d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.092+0000 7f2f17e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c297760 0x55902c29f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.092+0000 7f2f17e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c297760 0x55902c29f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:53136/0 (socket says 172.21.15.50:53136) 2024-09-10T10:13:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.092+0000 7f2f17e00640 1 -- 172.21.15.50:0/3501517201 learned_addr learned my addr 172.21.15.50:0/3501517201 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:30.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.092+0000 7f2f1f400640 1 --2- 172.21.15.50:0/3501517201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c2a2020 0x55902c2b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.092+0000 7f2f17e00640 1 -- 172.21.15.50:0/3501517201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c296e40 msgr2=0x55902c29d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.092+0000 7f2f17e00640 1 --2- 172.21.15.50:0/3501517201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c296e40 0x55902c29d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.092+0000 7f2f17e00640 1 -- 172.21.15.50:0/3501517201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c2a2020 msgr2=0x55902c2b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.092+0000 7f2f17e00640 1 --2- 172.21.15.50:0/3501517201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c2a2020 0x55902c2b9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.092+0000 7f2f17e00640 1 -- 172.21.15.50:0/3501517201 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55902c297590 con 0x55902c297760 2024-09-10T10:13:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.092+0000 7f2f1f400640 1 --2- 172.21.15.50:0/3501517201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c296e40 0x55902c29d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:13:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.092+0000 7f2f17e00640 1 --2- 172.21.15.50:0/3501517201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c297760 0x55902c29f830 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55902c2a05a0 tx=0x7f2f080139f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0c22931333761c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.093+0000 7f2f0f400640 1 -- 172.21.15.50:0/3501517201 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08005220 con 0x55902c297760 2024-09-10T10:13:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.093+0000 7f2f0f400640 1 -- 172.21.15.50:0/3501517201 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f08004c80 con 0x55902c297760 2024-09-10T10:13:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.093+0000 7f2f0f400640 1 -- 172.21.15.50:0/3501517201 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0801f9a0 con 0x55902c297760 2024-09-10T10:13:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.093+0000 7f2f285d3740 1 -- 172.21.15.50:0/3501517201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c297760 msgr2=0x55902c29f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.093+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3501517201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c297760 0x55902c29f830 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55902c2a05a0 tx=0x7f2f080139f0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.093+0000 7f2f285d3740 1 -- 172.21.15.50:0/3501517201 shutdown_connections 2024-09-10T10:13:30.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.093+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3501517201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c2a2020 0x55902c2b9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.093+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3501517201 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c297760 0x55902c29f830 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.093+0000 7f2f285d3740 1 --2- 172.21.15.50:0/3501517201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c296e40 0x55902c29d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.093+0000 7f2f285d3740 1 -- 172.21.15.50:0/3501517201 >> 172.21.15.50:0/3501517201 conn(0x55902c2933d0 msgr2=0x55902c2990b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:30.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.093+0000 7f2f285d3740 1 -- 172.21.15.50:0/3501517201 shutdown_connections 2024-09-10T10:13:30.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.094+0000 7f2f285d3740 1 -- 172.21.15.50:0/3501517201 wait complete. 2024-09-10T10:13:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.094+0000 7f2f285d3740 1 -- start start 2024-09-10T10:13:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.094+0000 7f2f285d3740 1 Processor -- start 2024-09-10T10:13:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f285d3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 0x55902c2a5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f285d3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c297760 0x55902c2a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f285d3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 0x55902c314880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f285d3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2f201af270 con 0x55902c296e40 2024-09-10T10:13:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f285d3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2f201b06e0 con 0x55902c297760 2024-09-10T10:13:30.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f285d3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2f201af940 con 0x55902c2a2020 2024-09-10T10:13:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f285d3740 10 client.0 _ll_register_callbacks cb 0x7f2f100d5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f1f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 0x55902c2a5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f1f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 0x55902c2a5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60650/0 (socket says 172.21.15.50:60650) 2024-09-10T10:13:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f17e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c297760 0x55902c2a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f1f400640 1 -- 172.21.15.50:0/1215991054 learned_addr learned my addr 172.21.15.50:0/1215991054 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f1f400640 1 --2- 172.21.15.50:0/1215991054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 0x55902c314880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f17e00640 1 -- 172.21.15.50:0/1215991054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 msgr2=0x55902c314880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f17e00640 1 --2- 172.21.15.50:0/1215991054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 0x55902c314880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f17e00640 1 -- 172.21.15.50:0/1215991054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 msgr2=0x55902c2a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f17e00640 1 --2- 172.21.15.50:0/1215991054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 0x55902c2a5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f17e00640 1 -- 172.21.15.50:0/1215991054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55902c314e40 con 0x55902c297760 2024-09-10T10:13:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.095+0000 7f2f1f400640 1 --2- 172.21.15.50:0/1215991054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 0x55902c2a5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:30.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.096+0000 7f2f17e00640 1 --2- 172.21.15.50:0/1215991054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c297760 0x55902c2a5ac0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55902c29a4f0 tx=0x7f2f08004f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c31dc8e8a46e6556 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.096+0000 7f2f0cc00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.096+0000 7f2f0cc00640 1 -- 172.21.15.50:0/1215991054 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0801f920 con 0x55902c297760 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.096+0000 7f2f0cc00640 1 -- 172.21.15.50:0/1215991054 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f2f0801fac0 con 0x55902c297760 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.096+0000 7f2f285d3740 1 -- 172.21.15.50:0/1215991054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f08004c80 con 0x55902c297760 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.096+0000 7f2f0cc00640 1 -- 172.21.15.50:0/1215991054 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2f0803a050 con 0x55902c297760 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.096+0000 7f2f285d3740 10 client.25793 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.096+0000 7f2f285d3740 1 -- 172.21.15.50:0/1215991054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55902c31c1f0 con 0x55902c297760 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.097+0000 7f2f0cc00640 1 -- 172.21.15.50:0/1215991054 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f08004c80 con 0x55902c297760 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.097+0000 7f2f0cc00640 1 -- 172.21.15.50:0/1215991054 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f2f0802f020 con 0x55902c297760 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.097+0000 7f2f285d3740 10 client.25793 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.097+0000 7f2f285d3740 10 client.25793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.097+0000 7f2f285d3740 20 client.25793 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.097+0000 7f2f285d3740 1 --2- 172.21.15.50:0/1215991054 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55902c31c940 0x55902c31ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.097+0000 7f2f285d3740 4 client.25793 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:13:30.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.097+0000 7f2f285d3740 1 -- 172.21.15.50:0/1215991054 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55902c204e60 con 0x55902c31c940 2024-09-10T10:13:30.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.097+0000 7f2f1f400640 1 --2- 172.21.15.50:0/1215991054 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55902c31c940 0x55902c31ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f1f400640 1 --2- 172.21.15.50:0/1215991054 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55902c31c940 0x55902c31ed60 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f157ddb0b9db3036 server_cookie=1879af6f57f31f7d in_seq=0 out_seq=0 2024-09-10T10:13:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f0cc00640 10 client.25793 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f0cc00640 1 -- 172.21.15.50:0/1215991054 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55902c204e60 con 0x55902c31c940 2024-09-10T10:13:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f0cc00640 10 client.25793 handle_command_reply: tid=0 2024-09-10T10:13:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f285d3740 1 client.25793 shutdown 2024-09-10T10:13:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f285d3740 1 -- 172.21.15.50:0/1215991054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c297760 msgr2=0x55902c2a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f285d3740 1 --2- 172.21.15.50:0/1215991054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c297760 0x55902c2a5ac0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55902c29a4f0 tx=0x7f2f08004f40 comp rx=0 tx=0).stop 2024-09-10T10:13:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f285d3740 1 -- 172.21.15.50:0/1215991054 shutdown_connections 2024-09-10T10:13:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f285d3740 1 --2- 172.21.15.50:0/1215991054 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55902c31c940 0x55902c31ed60 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f285d3740 1 --2- 172.21.15.50:0/1215991054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55902c2a2020 0x55902c314880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f285d3740 1 --2- 172.21.15.50:0/1215991054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55902c297760 0x55902c2a5ac0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f285d3740 1 --2- 172.21.15.50:0/1215991054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55902c296e40 0x55902c2a5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f285d3740 1 -- 172.21.15.50:0/1215991054 >> 172.21.15.50:0/1215991054 conn(0x55902c2933d0 msgr2=0x55902c291c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:30.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.098+0000 7f2f0cc00640 0 client.25793 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:30.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.099+0000 7f2f285d3740 1 -- 172.21.15.50:0/1215991054 shutdown_connections 2024-09-10T10:13:30.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.099+0000 7f2f285d3740 1 -- 172.21.15.50:0/1215991054 wait complete. 2024-09-10T10:13:30.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.099+0000 7f2f285d3740 20 client.25793 trim_cache size 0 max 16384 2024-09-10T10:13:30.103 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:13:30.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.099+0000 7f2f1fe00640 1 -- 172.21.15.50:0/2629551342 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2f040a2c00 msgr2=0x7f2f040a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:30.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.099+0000 7f2f1fe00640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2f040a2c00 0x7f2f040a50c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000c6a0 tx=0x7f2f100d5530 comp rx=0 tx=0).stop 2024-09-10T10:13:30.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.099+0000 7f2f1fe00640 1 -- 172.21.15.50:0/2629551342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20103e30 msgr2=0x7f2f2019a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:30.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.099+0000 7f2f1fe00640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20103e30 0x7f2f2019a3d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000e9f0 tx=0x7f2f1000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.099+0000 7f2f1fe00640 1 -- 172.21.15.50:0/2629551342 shutdown_connections 2024-09-10T10:13:30.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.099+0000 7f2f1fe00640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2f040a2c00 0x7f2f040a50c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.099+0000 7f2f1fe00640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f20108f60 0x7f2f2019eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.099+0000 7f2f1fe00640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f201047e0 0x7f2f2019a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.099+0000 7f2f1fe00640 1 --2- 172.21.15.50:0/2629551342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2f20103e30 0x7f2f2019a3d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:30.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.099+0000 7f2f1fe00640 1 -- 172.21.15.50:0/2629551342 >> 172.21.15.50:0/2629551342 conn(0x7f2f200ff8d0 msgr2=0x7f2f20100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:30.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.100+0000 7f2f1fe00640 1 -- 172.21.15.50:0/2629551342 shutdown_connections 2024-09-10T10:13:30.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:30.100+0000 7f2f1fe00640 1 -- 172.21.15.50:0/2629551342 wait complete. 2024-09-10T10:13:30.731 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:30.731 INFO:tasks.workunit.client.0.smithi050.stdout: Children see throughput for 1 readers = 3637377.25 kB/sec 2024-09-10T10:13:30.731 INFO:tasks.workunit.client.0.smithi050.stdout: Parent sees throughput for 1 readers = 3630099.64 kB/sec 2024-09-10T10:13:30.731 INFO:tasks.workunit.client.0.smithi050.stdout: Min throughput per process = 3637377.25 kB/sec 2024-09-10T10:13:30.731 INFO:tasks.workunit.client.0.smithi050.stdout: Max throughput per process = 3637377.25 kB/sec 2024-09-10T10:13:30.731 INFO:tasks.workunit.client.0.smithi050.stdout: Avg throughput per process = 3637377.25 kB/sec 2024-09-10T10:13:30.732 INFO:tasks.workunit.client.0.smithi050.stdout: Min xfer = 1048576.00 kB 2024-09-10T10:13:30.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:30 smithi050 ceph-mon[30354]: pgmap v460: 129 pgs: 129 active+clean; 1.0 GiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 145 MiB/s wr, 43 op/s 2024-09-10T10:13:31.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:30 smithi189 ceph-mon[34999]: pgmap v460: 129 pgs: 129 active+clean; 1.0 GiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 145 MiB/s wr, 43 op/s 2024-09-10T10:13:31.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:30 smithi084 ceph-mon[34812]: pgmap v460: 129 pgs: 129 active+clean; 1.0 GiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 145 MiB/s wr, 43 op/s 2024-09-10T10:13:32.231 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T10:13:32.231 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T10:13:32.628 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:32.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:32 smithi050 ceph-mon[30354]: pgmap v461: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 142 MiB/s wr, 41 op/s 2024-09-10T10:13:33.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:32 smithi189 ceph-mon[34999]: pgmap v461: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 142 MiB/s wr, 41 op/s 2024-09-10T10:13:33.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:32 smithi084 ceph-mon[34812]: pgmap v461: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 142 MiB/s wr, 41 op/s 2024-09-10T10:13:33.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.187+0000 7f2ff7200640 1 -- 172.21.15.50:0/4108854996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff010e420 msgr2=0x7f2ff0110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.187+0000 7f2ff7200640 1 --2- 172.21.15.50:0/4108854996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff010e420 0x7f2ff0110810 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8009ca0 tx=0x7f2fe802a950 comp rx=0 tx=0).stop 2024-09-10T10:13:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.188+0000 7f2ff7200640 1 -- 172.21.15.50:0/4108854996 shutdown_connections 2024-09-10T10:13:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.188+0000 7f2ff7200640 1 --2- 172.21.15.50:0/4108854996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff010e420 0x7f2ff0110810 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.188+0000 7f2ff7200640 1 --2- 172.21.15.50:0/4108854996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ff0074ee0 0x7f2ff010dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.188+0000 7f2ff7200640 1 --2- 172.21.15.50:0/4108854996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ff00745c0 0x7f2ff00749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.188+0000 7f2ff7200640 1 -- 172.21.15.50:0/4108854996 >> 172.21.15.50:0/4108854996 conn(0x7f2ff00fd8e0 msgr2=0x7f2ff00ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.188+0000 7f2ff7200640 1 -- 172.21.15.50:0/4108854996 shutdown_connections 2024-09-10T10:13:33.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.188+0000 7f2ff7200640 1 -- 172.21.15.50:0/4108854996 wait complete. 2024-09-10T10:13:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.189+0000 7f2ff7200640 1 Processor -- start 2024-09-10T10:13:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.189+0000 7f2ff7200640 1 -- start start 2024-09-10T10:13:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.190+0000 7f2ff7200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ff00745c0 0x7f2ff019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.190+0000 7f2ff7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ff0074ee0 0x7f2ff019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.190+0000 7f2ff7200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff010e420 0x7f2ff019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.190+0000 7f2ff7200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01141a0 con 0x7f2ff010e420 2024-09-10T10:13:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.190+0000 7f2ff7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff0114020 con 0x7f2ff0074ee0 2024-09-10T10:13:33.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.190+0000 7f2ff7200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff0114320 con 0x7f2ff00745c0 2024-09-10T10:13:33.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.190+0000 7f2fefe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ff00745c0 0x7f2ff019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.190+0000 7f2fef400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ff0074ee0 0x7f2ff019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.190+0000 7f2fefe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ff00745c0 0x7f2ff019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:53148/0 (socket says 172.21.15.50:53148) 2024-09-10T10:13:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.190+0000 7f2fefe00640 1 -- 172.21.15.50:0/3042423741 learned_addr learned my addr 172.21.15.50:0/3042423741 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.190+0000 7f2ff5200640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff010e420 0x7f2ff019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.191+0000 7f2fefe00640 1 -- 172.21.15.50:0/3042423741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ff0074ee0 msgr2=0x7f2ff019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.191+0000 7f2fefe00640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ff0074ee0 0x7f2ff019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.191+0000 7f2fefe00640 1 -- 172.21.15.50:0/3042423741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff010e420 msgr2=0x7f2ff019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.191+0000 7f2fefe00640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff010e420 0x7f2ff019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.191+0000 7f2fefe00640 1 -- 172.21.15.50:0/3042423741 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff019f650 con 0x7f2ff00745c0 2024-09-10T10:13:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.191+0000 7f2fef400640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ff0074ee0 0x7f2ff019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.191+0000 7f2fefe00640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ff00745c0 0x7f2ff019a6a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000e9f0 tx=0x7f2fe000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:33.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.191+0000 7f2fecc00640 1 -- 172.21.15.50:0/3042423741 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000cd80 con 0x7f2ff00745c0 2024-09-10T10:13:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.191+0000 7f2fecc00640 1 -- 172.21.15.50:0/3042423741 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fe0010910 con 0x7f2ff00745c0 2024-09-10T10:13:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.191+0000 7f2fecc00640 1 -- 172.21.15.50:0/3042423741 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0018990 con 0x7f2ff00745c0 2024-09-10T10:13:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.191+0000 7f2ff7200640 1 -- 172.21.15.50:0/3042423741 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff019f940 con 0x7f2ff00745c0 2024-09-10T10:13:33.194 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.192+0000 7f2ff7200640 1 -- 172.21.15.50:0/3042423741 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff01a7220 con 0x7f2ff00745c0 2024-09-10T10:13:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.195+0000 7f2ff9c80740 1 Processor -- start 2024-09-10T10:13:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.196+0000 7f2ff9c80740 1 -- start start 2024-09-10T10:13:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.196+0000 7f2ff9c80740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e7cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.196+0000 7f2ff9c80740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e87760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.197 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.196+0000 7f2ff9c80740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e8a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.196+0000 7f2ff9c80740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b7f6de3290 con 0x55b7f6e7d3e0 2024-09-10T10:13:33.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.196+0000 7f2ff9c80740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b7f6d8ab40 con 0x55b7f6e87ca0 2024-09-10T10:13:33.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.196+0000 7f2ff9c80740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7f6ddf250 con 0x55b7f6e7cac0 2024-09-10T10:13:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.196+0000 7f2ff5200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e7cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.197+0000 7f2ff5200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e7cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:53154/0 (socket says 172.21.15.50:53154) 2024-09-10T10:13:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.197+0000 7f2ff5200640 1 -- 172.21.15.50:0/1260449692 learned_addr learned my addr 172.21.15.50:0/1260449692 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.197+0000 7f2fef400640 1 --2- 172.21.15.50:0/1260449692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e8a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.197+0000 7f2ff5200640 1 -- 172.21.15.50:0/1260449692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e87ca0 msgr2=0x55b7f6e8a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.197+0000 7f2ff5200640 1 --2- 172.21.15.50:0/1260449692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e8a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.197+0000 7f2ff5200640 1 -- 172.21.15.50:0/1260449692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e7d3e0 msgr2=0x55b7f6e87760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:13:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.197+0000 7f2ff5200640 1 --2- 172.21.15.50:0/1260449692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e87760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.197+0000 7f2ff5200640 1 -- 172.21.15.50:0/1260449692 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f6b546a0 con 0x55b7f6e7cac0 2024-09-10T10:13:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.197+0000 7f2fecc00640 1 -- 172.21.15.50:0/3042423741 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2fe0010ac0 con 0x7f2ff00745c0 2024-09-10T10:13:33.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.197+0000 7f2ff5200640 1 --2- 172.21.15.50:0/1260449692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e7cea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8009ca0 tx=0x7f2fe8005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2fa2a08bfd58661 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.198+0000 7f2fe5600640 1 -- 172.21.15.50:0/1260449692 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8048070 con 0x55b7f6e7cac0 2024-09-10T10:13:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.198+0000 7f2fe5600640 1 -- 172.21.15.50:0/1260449692 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fe8003e50 con 0x55b7f6e7cac0 2024-09-10T10:13:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.198+0000 7f2fe5600640 1 -- 172.21.15.50:0/1260449692 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8034040 con 0x55b7f6e7cac0 2024-09-10T10:13:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.199+0000 7f2ff9c80740 1 -- 172.21.15.50:0/1260449692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7cac0 msgr2=0x55b7f6e7cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.199+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/1260449692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e7cea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8009ca0 tx=0x7f2fe8005f80 comp rx=0 tx=0).stop 2024-09-10T10:13:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.199+0000 7f2fecc00640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2fd40a2c00 0x7f2fd40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.199+0000 7f2ff9c80740 1 -- 172.21.15.50:0/1260449692 shutdown_connections 2024-09-10T10:13:33.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.199+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/1260449692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e8a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.199+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/1260449692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e87760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.199+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/1260449692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e7cea0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.199+0000 7f2fecc00640 1 -- 172.21.15.50:0/3042423741 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f2fe00cf860 con 0x7f2ff00745c0 2024-09-10T10:13:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.199+0000 7f2ff9c80740 1 -- 172.21.15.50:0/1260449692 >> 172.21.15.50:0/1260449692 conn(0x55b7f6e79050 msgr2=0x55b7f6e79430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.199+0000 7f2ff9c80740 1 -- 172.21.15.50:0/1260449692 shutdown_connections 2024-09-10T10:13:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.199+0000 7f2fefe00640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2fd40a2c00 0x7f2fd40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.199+0000 7f2ff9c80740 1 -- 172.21.15.50:0/1260449692 wait complete. 2024-09-10T10:13:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.200+0000 7f2ff9c80740 1 -- start start 2024-09-10T10:13:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.200+0000 7f2fefe00640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2fd40a2c00 0x7f2fd40a50c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00a4410 tx=0x7f2fe0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:33.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.200+0000 7f2ff9c80740 1 Processor -- start 2024-09-10T10:13:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.200+0000 7f2ff9c80740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e876b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.200+0000 7f2ff9c80740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e84960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff9c80740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e84f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff9c80740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b7f6e8a910 con 0x55b7f6e87ca0 2024-09-10T10:13:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff9c80740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b7f6d9dfa0 con 0x55b7f6e7cac0 2024-09-10T10:13:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff9c80740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b7f6e8aa90 con 0x55b7f6e7d3e0 2024-09-10T10:13:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff9c80740 10 client.0 _ll_register_callbacks cb 0x55b7f6af1ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff5200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e876b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2fef400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e84960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff5200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e876b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:56380/0 (socket says 172.21.15.50:56380) 2024-09-10T10:13:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff5200640 1 -- 172.21.15.50:0/264311761 learned_addr learned my addr 172.21.15.50:0/264311761 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff5200640 1 --2- 172.21.15.50:0/264311761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e84f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff5200640 1 -- 172.21.15.50:0/264311761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7d3e0 msgr2=0x55b7f6e84960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff5200640 1 --2- 172.21.15.50:0/264311761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e84960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff5200640 1 -- 172.21.15.50:0/264311761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 msgr2=0x55b7f6e84f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff5200640 1 --2- 172.21.15.50:0/264311761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e84f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2ff5200640 1 -- 172.21.15.50:0/264311761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7f6e857a0 con 0x55b7f6e7cac0 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.201+0000 7f2fef400640 1 --2- 172.21.15.50:0/264311761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e84960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.202+0000 7f2ff5200640 1 --2- 172.21.15.50:0/264311761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e876b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fe802fd70 tx=0x7f2fe802fc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac420c2917533cbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.202+0000 7f2fda000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.202+0000 7f2fda000640 1 -- 172.21.15.50:0/264311761 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8048070 con 0x55b7f6e7cac0 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.202+0000 7f2ff9c80740 1 -- 172.21.15.50:0/264311761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fe8003e50 con 0x55b7f6e7cac0 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.202+0000 7f2fda000640 1 -- 172.21.15.50:0/264311761 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f2fe8004040 con 0x55b7f6e7cac0 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.202+0000 7f2fda000640 1 -- 172.21.15.50:0/264311761 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2fe805b050 con 0x55b7f6e7cac0 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.202+0000 7f2ff9c80740 10 client.25805 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.202+0000 7f2ff9c80740 1 -- 172.21.15.50:0/264311761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b7f6e968f0 con 0x55b7f6e7cac0 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.203+0000 7f2fda000640 1 -- 172.21.15.50:0/264311761 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fe8003e50 con 0x55b7f6e7cac0 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.203+0000 7f2fda000640 1 -- 172.21.15.50:0/264311761 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f2fe8052a90 con 0x55b7f6e7cac0 2024-09-10T10:13:33.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.203+0000 7f2ff9c80740 10 client.25805 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.203+0000 7f2ff9c80740 10 client.25805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.203+0000 7f2ff9c80740 20 client.25805 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.203+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/264311761 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55b7f6e97c40 0x55b7f6e9a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.203+0000 7f2ff9c80740 4 client.25805 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:33.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.203+0000 7f2ff9c80740 1 -- 172.21.15.50:0/264311761 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7f6df0800 con 0x55b7f6e97c40 2024-09-10T10:13:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.204+0000 7f2fef400640 1 --2- 172.21.15.50:0/264311761 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55b7f6e97c40 0x55b7f6e9a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.204+0000 7f2fef400640 1 --2- 172.21.15.50:0/264311761 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55b7f6e97c40 0x55b7f6e9a030 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f802a9e30dbcf48 server_cookie=3c93588868e63264 in_seq=0 out_seq=0 2024-09-10T10:13:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.204+0000 7f2fda000640 10 client.25805 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.205+0000 7f2fda000640 1 -- 172.21.15.50:0/264311761 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7f6df0800 con 0x55b7f6e97c40 2024-09-10T10:13:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.205+0000 7f2fda000640 10 client.25805 handle_command_reply: tid=0 2024-09-10T10:13:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.205+0000 7f2ff9c80740 1 client.25805 shutdown 2024-09-10T10:13:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.205+0000 7f2ff9c80740 1 -- 172.21.15.50:0/264311761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7cac0 msgr2=0x55b7f6e876b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.205+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/264311761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e876b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fe802fd70 tx=0x7f2fe802fc70 comp rx=0 tx=0).stop 2024-09-10T10:13:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.205+0000 7f2ff9c80740 1 -- 172.21.15.50:0/264311761 shutdown_connections 2024-09-10T10:13:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.205+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/264311761 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55b7f6e97c40 0x55b7f6e9a030 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.205+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/264311761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e84f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.205+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/264311761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e84960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.205+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/264311761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e876b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.205+0000 7f2ff9c80740 1 -- 172.21.15.50:0/264311761 >> 172.21.15.50:0/264311761 conn(0x55b7f6e79050 msgr2=0x55b7f6e7ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.205+0000 7f2fda000640 0 client.25805 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.206+0000 7f2ff9c80740 1 -- 172.21.15.50:0/264311761 shutdown_connections 2024-09-10T10:13:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.206+0000 7f2ff9c80740 1 -- 172.21.15.50:0/264311761 wait complete. 2024-09-10T10:13:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.206+0000 7f2ff9c80740 20 client.25805 trim_cache size 0 max 16384 2024-09-10T10:13:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.224+0000 7f2ff9c80740 1 Processor -- start 2024-09-10T10:13:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.224+0000 7f2ff9c80740 1 -- start start 2024-09-10T10:13:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.225+0000 7f2ff9c80740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e7fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.225+0000 7f2ff9c80740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e9d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.225+0000 7f2ff9c80740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e9d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.225+0000 7f2ff9c80740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01b3800 con 0x55b7f6e87ca0 2024-09-10T10:13:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.225+0000 7f2ff9c80740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01b10d0 con 0x55b7f6e7d3e0 2024-09-10T10:13:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.225+0000 7f2ff9c80740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01aef20 con 0x55b7f6e7cac0 2024-09-10T10:13:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.225+0000 7f2ff5200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e7fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.225+0000 7f2fef400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e9d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.225+0000 7f2fef400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e9d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:56396/0 (socket says 172.21.15.50:56396) 2024-09-10T10:13:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.225+0000 7f2ff5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e9d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.225+0000 7f2fef400640 1 -- 172.21.15.50:0/3285421744 learned_addr learned my addr 172.21.15.50:0/3285421744 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.226+0000 7f2ff5200640 1 -- 172.21.15.50:0/3285421744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7cac0 msgr2=0x55b7f6e7fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.226+0000 7f2ff5200640 1 --2- 172.21.15.50:0/3285421744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e7fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.226+0000 7f2ff5200640 1 -- 172.21.15.50:0/3285421744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7d3e0 msgr2=0x55b7f6e9d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.226+0000 7f2ff5200640 1 --2- 172.21.15.50:0/3285421744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e9d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.226+0000 7f2ff5200640 1 -- 172.21.15.50:0/3285421744 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f6e852e0 con 0x55b7f6e87ca0 2024-09-10T10:13:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.226+0000 7f2fef400640 1 --2- 172.21.15.50:0/3285421744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e9d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.226+0000 7f2ff5200640 1 --2- 172.21.15.50:0/3285421744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e9d590 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8052e30 tx=0x7f2fe802fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3676c5a3857886ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.226+0000 7f2fe4c00640 1 -- 172.21.15.50:0/3285421744 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8048040 con 0x55b7f6e87ca0 2024-09-10T10:13:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.226+0000 7f2fe4c00640 1 -- 172.21.15.50:0/3285421744 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fe8049040 con 0x55b7f6e87ca0 2024-09-10T10:13:33.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.226+0000 7f2fe4c00640 1 -- 172.21.15.50:0/3285421744 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8004b40 con 0x55b7f6e87ca0 2024-09-10T10:13:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.227+0000 7f2ff9c80740 1 -- 172.21.15.50:0/3285421744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 msgr2=0x55b7f6e9d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.227+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/3285421744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e9d590 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8052e30 tx=0x7f2fe802fce0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.227+0000 7f2ff9c80740 1 -- 172.21.15.50:0/3285421744 shutdown_connections 2024-09-10T10:13:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.227+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/3285421744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e9d590 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.227+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/3285421744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e9d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.227+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/3285421744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e7fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.227+0000 7f2ff9c80740 1 -- 172.21.15.50:0/3285421744 >> 172.21.15.50:0/3285421744 conn(0x55b7f6e79050 msgr2=0x55b7f6e7f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.228+0000 7f2ff9c80740 1 -- 172.21.15.50:0/3285421744 shutdown_connections 2024-09-10T10:13:33.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.228+0000 7f2ff9c80740 1 -- 172.21.15.50:0/3285421744 wait complete. 2024-09-10T10:13:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.228+0000 7f2ff9c80740 1 -- start start 2024-09-10T10:13:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.228+0000 7f2ff9c80740 1 Processor -- start 2024-09-10T10:13:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.229+0000 7f2ff9c80740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e9b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.229+0000 7f2ff9c80740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e9b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.229+0000 7f2ff9c80740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e9baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.229+0000 7f2ff9c80740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01af590 con 0x55b7f6e87ca0 2024-09-10T10:13:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.229+0000 7f2ff9c80740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01b0a00 con 0x55b7f6e7cac0 2024-09-10T10:13:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.229+0000 7f2ff9c80740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01afc60 con 0x55b7f6e7d3e0 2024-09-10T10:13:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.229+0000 7f2ff9c80740 10 client.0 _ll_register_callbacks cb 0x7f2fe8046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.229+0000 7f2fef400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e9b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.229+0000 7f2ff5200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e9b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.229+0000 7f2fef400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e9b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:53180/0 (socket says 172.21.15.50:53180) 2024-09-10T10:13:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.229+0000 7f2fef400640 1 -- 172.21.15.50:0/332585112 learned_addr learned my addr 172.21.15.50:0/332585112 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.229+0000 7f2ff5200640 1 --2- 172.21.15.50:0/332585112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e9baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.229+0000 7f2fef400640 1 -- 172.21.15.50:0/332585112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7cac0 msgr2=0x55b7f6e9b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.230+0000 7f2fef400640 1 --2- 172.21.15.50:0/332585112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e9b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.230+0000 7f2fef400640 1 -- 172.21.15.50:0/332585112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 msgr2=0x55b7f6e9baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.230+0000 7f2fef400640 1 --2- 172.21.15.50:0/332585112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e9baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.230+0000 7f2fef400640 1 -- 172.21.15.50:0/332585112 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7f6f09fe0 con 0x55b7f6e7d3e0 2024-09-10T10:13:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.230+0000 7f2fef400640 1 --2- 172.21.15.50:0/332585112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e9b5b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55b7f6e84210 tx=0x7f2fdc01f7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bab14e2cb2446cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.230+0000 7f2fda000640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:13:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.230+0000 7f2fda000640 1 -- 172.21.15.50:0/332585112 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc005220 con 0x55b7f6e7d3e0 2024-09-10T10:13:33.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.230+0000 7f2fda000640 1 -- 172.21.15.50:0/332585112 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f2fdc0053c0 con 0x55b7f6e7d3e0 2024-09-10T10:13:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.230+0000 7f2ff9c80740 1 -- 172.21.15.50:0/332585112 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fe8049040 con 0x55b7f6e7d3e0 2024-09-10T10:13:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.231+0000 7f2fda000640 1 -- 172.21.15.50:0/332585112 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2fdc032050 con 0x55b7f6e7d3e0 2024-09-10T10:13:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.231+0000 7f2ff9c80740 10 client.25774 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.231+0000 7f2ff9c80740 1 -- 172.21.15.50:0/332585112 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b7f6f0b360 con 0x55b7f6e7d3e0 2024-09-10T10:13:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.231+0000 7f2fda000640 1 -- 172.21.15.50:0/332585112 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fe8049040 con 0x55b7f6e7d3e0 2024-09-10T10:13:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.231+0000 7f2fda000640 1 -- 172.21.15.50:0/332585112 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f2fdc010690 con 0x55b7f6e7d3e0 2024-09-10T10:13:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.231+0000 7f2ff9c80740 10 client.25774 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.231+0000 7f2ff9c80740 10 client.25774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.231+0000 7f2ff9c80740 20 client.25774 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.232+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/332585112 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55b7f6f0ba90 0x55b7f6f0deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.232+0000 7f2ff9c80740 4 client.25774 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T10:13:33.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.232+0000 7f2ff9c80740 1 -- 172.21.15.50:0/332585112 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b7f6dead10 con 0x55b7f6f0ba90 2024-09-10T10:13:33.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.232+0000 7f2ff5200640 1 --2- 172.21.15.50:0/332585112 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55b7f6f0ba90 0x55b7f6f0deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:33.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.232+0000 7f2ff5200640 1 --2- 172.21.15.50:0/332585112 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55b7f6f0ba90 0x55b7f6f0deb0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29651aabb3e025d5 server_cookie=20725d6966dc5fee in_seq=0 out_seq=0 2024-09-10T10:13:33.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.232+0000 7f2fda000640 10 client.25774 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:33.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.233+0000 7f2fda000640 1 -- 172.21.15.50:0/332585112 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b7f6dead10 con 0x55b7f6f0ba90 2024-09-10T10:13:33.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.233+0000 7f2fda000640 10 client.25774 handle_command_reply: tid=0 2024-09-10T10:13:33.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.233+0000 7f2ff9c80740 1 client.25774 shutdown 2024-09-10T10:13:33.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.234+0000 7f2ff9c80740 1 -- 172.21.15.50:0/332585112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7d3e0 msgr2=0x55b7f6e9b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:33.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.234+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/332585112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e9b5b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55b7f6e84210 tx=0x7f2fdc01f7c0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.234+0000 7f2ff9c80740 1 -- 172.21.15.50:0/332585112 shutdown_connections 2024-09-10T10:13:33.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.234+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/332585112 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55b7f6f0ba90 0x55b7f6f0deb0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.234+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/332585112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7f6e87ca0 0x55b7f6e9baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.234+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/332585112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b7f6e7d3e0 0x55b7f6e9b5b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.234+0000 7f2fda000640 0 client.25774 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:33.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.234+0000 7f2ff9c80740 1 --2- 172.21.15.50:0/332585112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b7f6e7cac0 0x55b7f6e9b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.234+0000 7f2ff9c80740 1 -- 172.21.15.50:0/332585112 >> 172.21.15.50:0/332585112 conn(0x55b7f6e79050 msgr2=0x55b7f6e781c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:33.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.234+0000 7f2ff9c80740 1 -- 172.21.15.50:0/332585112 shutdown_connections 2024-09-10T10:13:33.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.234+0000 7f2ff9c80740 1 -- 172.21.15.50:0/332585112 wait complete. 2024-09-10T10:13:33.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.234+0000 7f2ff9c80740 20 client.25774 trim_cache size 0 max 16384 2024-09-10T10:13:33.238 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:13:33.238 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-10T10:13:33.238 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "3d765e55-b8e4-485a-83f4-ed2d42264351", 2024-09-10T10:13:33.239 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-10T10:13:33.239 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:13:33.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.235+0000 7f2ff7200640 1 -- 172.21.15.50:0/3042423741 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2fd40a2c00 msgr2=0x7f2fd40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:33.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.235+0000 7f2ff7200640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2fd40a2c00 0x7f2fd40a50c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00a4410 tx=0x7f2fe0000bc0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.235+0000 7f2ff7200640 1 -- 172.21.15.50:0/3042423741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ff00745c0 msgr2=0x7f2ff019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.235+0000 7f2ff7200640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ff00745c0 0x7f2ff019a6a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000e9f0 tx=0x7f2fe000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.235+0000 7f2ff7200640 1 -- 172.21.15.50:0/3042423741 shutdown_connections 2024-09-10T10:13:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.235+0000 7f2ff7200640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f2fd40a2c00 0x7f2fd40a50c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.235+0000 7f2ff7200640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ff010e420 0x7f2ff019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.235+0000 7f2ff7200640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ff0074ee0 0x7f2ff019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.235+0000 7f2ff7200640 1 --2- 172.21.15.50:0/3042423741 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ff00745c0 0x7f2ff019a6a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.235+0000 7f2ff7200640 1 -- 172.21.15.50:0/3042423741 >> 172.21.15.50:0/3042423741 conn(0x7f2ff00fd8e0 msgr2=0x7f2ff00fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.236+0000 7f2ff7200640 1 -- 172.21.15.50:0/3042423741 shutdown_connections 2024-09-10T10:13:33.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:33.236+0000 7f2ff7200640 1 -- 172.21.15.50:0/3042423741 wait complete. 2024-09-10T10:13:33.371 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:33.371 INFO:tasks.workunit.client.0.smithi050.stdout: Children see throughput for 1 re-readers = 2638604.50 kB/sec 2024-09-10T10:13:33.371 INFO:tasks.workunit.client.0.smithi050.stdout: Parent sees throughput for 1 re-readers = 2634850.12 kB/sec 2024-09-10T10:13:33.371 INFO:tasks.workunit.client.0.smithi050.stdout: Min throughput per process = 2638604.50 kB/sec 2024-09-10T10:13:33.371 INFO:tasks.workunit.client.0.smithi050.stdout: Max throughput per process = 2638604.50 kB/sec 2024-09-10T10:13:33.372 INFO:tasks.workunit.client.0.smithi050.stdout: Avg throughput per process = 2638604.50 kB/sec 2024-09-10T10:13:33.372 INFO:tasks.workunit.client.0.smithi050.stdout: Min xfer = 1048576.00 kB 2024-09-10T10:13:34.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:33 smithi189 ceph-mon[34999]: scrub queued for path: / 2024-09-10T10:13:34.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:33 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:34.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:33 smithi189 ceph-mon[34999]: scrub summary: active paths [/] 2024-09-10T10:13:34.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:33 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:34.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:33 smithi189 ceph-mon[34999]: scrub summary: idle 2024-09-10T10:13:34.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:33 smithi084 ceph-mon[34812]: scrub queued for path: / 2024-09-10T10:13:34.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:33 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:34.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:33 smithi084 ceph-mon[34812]: scrub summary: active paths [/] 2024-09-10T10:13:34.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:33 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:34.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:33 smithi084 ceph-mon[34812]: scrub summary: idle 2024-09-10T10:13:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:33 smithi050 ceph-mon[30354]: scrub queued for path: / 2024-09-10T10:13:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:33 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:33 smithi050 ceph-mon[30354]: scrub summary: active paths [/] 2024-09-10T10:13:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:33 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:33 smithi050 ceph-mon[30354]: scrub summary: idle 2024-09-10T10:13:34.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:13:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:35.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:34 smithi050 ceph-mon[30354]: pgmap v462: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 105 MiB/s wr, 34 op/s 2024-09-10T10:13:35.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:34 smithi189 ceph-mon[34999]: pgmap v462: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 105 MiB/s wr, 34 op/s 2024-09-10T10:13:35.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:34 smithi084 ceph-mon[34812]: pgmap v462: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 105 MiB/s wr, 34 op/s 2024-09-10T10:13:35.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.285+0000 7fa53ae00640 1 -- 172.21.15.50:0/1583062927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa534103ff0 msgr2=0x7fa5341043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:35.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.285+0000 7fa53ae00640 1 --2- 172.21.15.50:0/1583062927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa534103ff0 0x7fa5341043d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa524009900 tx=0x7fa52402a410 comp rx=0 tx=0).stop 2024-09-10T10:13:35.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.285+0000 7fa53ae00640 1 -- 172.21.15.50:0/1583062927 shutdown_connections 2024-09-10T10:13:35.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.285+0000 7fa53ae00640 1 --2- 172.21.15.50:0/1583062927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa534109120 0x7fa534110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.285+0000 7fa53ae00640 1 --2- 172.21.15.50:0/1583062927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa5341049a0 0x7fa5341089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.285+0000 7fa53ae00640 1 --2- 172.21.15.50:0/1583062927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa534103ff0 0x7fa5341043d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.285+0000 7fa53ae00640 1 -- 172.21.15.50:0/1583062927 >> 172.21.15.50:0/1583062927 conn(0x7fa5340ffa90 msgr2=0x7fa534101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:35.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.285+0000 7fa53ae00640 1 -- 172.21.15.50:0/1583062927 shutdown_connections 2024-09-10T10:13:35.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.285+0000 7fa53ae00640 1 -- 172.21.15.50:0/1583062927 wait complete. 2024-09-10T10:13:35.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.287+0000 7fa53ae00640 1 Processor -- start 2024-09-10T10:13:35.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.287+0000 7fa53ae00640 1 -- start start 2024-09-10T10:13:35.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.287+0000 7fa53ae00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534103ff0 0x7fa53419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.287+0000 7fa53ae00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5341049a0 0x7fa53419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.287+0000 7fa53ae00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa534109120 0x7fa53419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.287+0000 7fa53ae00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa534114190 con 0x7fa5341049a0 2024-09-10T10:13:35.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.287+0000 7fa53ae00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa534114010 con 0x7fa534109120 2024-09-10T10:13:35.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.287+0000 7fa53ae00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa534114310 con 0x7fa534103ff0 2024-09-10T10:13:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.288+0000 7fa52be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5341049a0 0x7fa53419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.288+0000 7fa52be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5341049a0 0x7fa53419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60704/0 (socket says 172.21.15.50:60704) 2024-09-10T10:13:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.288+0000 7fa52be00640 1 -- 172.21.15.50:0/1501496562 learned_addr learned my addr 172.21.15.50:0/1501496562 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.288+0000 7fa533e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534103ff0 0x7fa53419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.288+0000 7fa538e00640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa534109120 0x7fa53419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.288+0000 7fa52be00640 1 -- 172.21.15.50:0/1501496562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534103ff0 msgr2=0x7fa53419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.288+0000 7fa52be00640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534103ff0 0x7fa53419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.288+0000 7fa52be00640 1 -- 172.21.15.50:0/1501496562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa534109120 msgr2=0x7fa53419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.288+0000 7fa52be00640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa534109120 0x7fa53419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.288+0000 7fa52be00640 1 -- 172.21.15.50:0/1501496562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53419f640 con 0x7fa5341049a0 2024-09-10T10:13:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.288+0000 7fa533e00640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534103ff0 0x7fa53419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.288+0000 7fa52be00640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5341049a0 0x7fa53419abd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00e9f0 tx=0x7fa51c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.289+0000 7fa531600640 1 -- 172.21.15.50:0/1501496562 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c00cd80 con 0x7fa5341049a0 2024-09-10T10:13:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.289+0000 7fa531600640 1 -- 172.21.15.50:0/1501496562 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa51c005500 con 0x7fa5341049a0 2024-09-10T10:13:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.289+0000 7fa531600640 1 -- 172.21.15.50:0/1501496562 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c010690 con 0x7fa5341049a0 2024-09-10T10:13:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.289+0000 7fa53ae00640 1 -- 172.21.15.50:0/1501496562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa53419f930 con 0x7fa5341049a0 2024-09-10T10:13:35.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.289+0000 7fa53ae00640 1 -- 172.21.15.50:0/1501496562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5341a7210 con 0x7fa5341049a0 2024-09-10T10:13:35.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.293+0000 7fa53d9f6740 1 Processor -- start 2024-09-10T10:13:35.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.293+0000 7fa53d9f6740 1 -- start start 2024-09-10T10:13:35.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.294+0000 7fa531600640 1 -- 172.21.15.50:0/1501496562 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa51c0046c0 con 0x7fa5341049a0 2024-09-10T10:13:35.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.294+0000 7fa53d9f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 0x559490b4ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.294+0000 7fa53d9f6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b5a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.294+0000 7fa53d9f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b5ad70 0x559490b5d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.294+0000 7fa53d9f6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559490ab63e0 con 0x559490b504b0 2024-09-10T10:13:35.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.294+0000 7fa53d9f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559490a5dd80 con 0x559490b4fb90 2024-09-10T10:13:35.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.294+0000 7fa53d9f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559490ab23a0 con 0x559490b5ad70 2024-09-10T10:13:35.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.294+0000 7fa533e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b5a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.294+0000 7fa533e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b5a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60720/0 (socket says 172.21.15.50:60720) 2024-09-10T10:13:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.294+0000 7fa533e00640 1 -- 172.21.15.50:0/141436459 learned_addr learned my addr 172.21.15.50:0/141436459 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.294+0000 7fa538e00640 1 --2- 172.21.15.50:0/141436459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 0x559490b4ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.295+0000 7fa52be00640 1 --2- 172.21.15.50:0/141436459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b5ad70 0x559490b5d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.295+0000 7fa533e00640 1 -- 172.21.15.50:0/141436459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b5ad70 msgr2=0x559490b5d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.295+0000 7fa533e00640 1 --2- 172.21.15.50:0/141436459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b5ad70 0x559490b5d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.295+0000 7fa533e00640 1 -- 172.21.15.50:0/141436459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 msgr2=0x559490b4ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.295+0000 7fa533e00640 1 --2- 172.21.15.50:0/141436459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 0x559490b4ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.295+0000 7fa533e00640 1 -- 172.21.15.50:0/141436459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559490a7cae0 con 0x559490b504b0 2024-09-10T10:13:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.295+0000 7fa538e00640 1 --2- 172.21.15.50:0/141436459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 0x559490b4ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.295+0000 7fa533e00640 1 --2- 172.21.15.50:0/141436459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b5a830 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa524009900 tx=0x7fa524005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192271e1643bab1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:35.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.295+0000 7fa531600640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa5180a2b80 0x7fa5180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.295+0000 7fa529600640 1 -- 172.21.15.50:0/141436459 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524035040 con 0x559490b504b0 2024-09-10T10:13:35.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.296+0000 7fa529600640 1 -- 172.21.15.50:0/141436459 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa524004760 con 0x559490b504b0 2024-09-10T10:13:35.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.296+0000 7fa529600640 1 -- 172.21.15.50:0/141436459 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524003970 con 0x559490b504b0 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.296+0000 7fa531600640 1 -- 172.21.15.50:0/1501496562 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa51c0cf880 con 0x7fa5341049a0 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.296+0000 7fa538e00640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa5180a2b80 0x7fa5180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.296+0000 7fa53d9f6740 1 -- 172.21.15.50:0/141436459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 msgr2=0x559490b5a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.296+0000 7fa538e00640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa5180a2b80 0x7fa5180a5040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009fd0 tx=0x7fa52c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.296+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/141436459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b5a830 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa524009900 tx=0x7fa524005de0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.297+0000 7fa53d9f6740 1 -- 172.21.15.50:0/141436459 shutdown_connections 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.297+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/141436459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b5ad70 0x559490b5d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.297+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/141436459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b5a830 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.297+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/141436459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 0x559490b4ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.297+0000 7fa53d9f6740 1 -- 172.21.15.50:0/141436459 >> 172.21.15.50:0/141436459 conn(0x559490b4c120 msgr2=0x559490b4c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.297+0000 7fa53d9f6740 1 -- 172.21.15.50:0/141436459 shutdown_connections 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.297+0000 7fa53d9f6740 1 -- 172.21.15.50:0/141436459 wait complete. 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.297+0000 7fa53d9f6740 1 -- start start 2024-09-10T10:13:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.297+0000 7fa53d9f6740 1 Processor -- start 2024-09-10T10:13:35.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.298+0000 7fa53d9f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 0x559490b57cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.298+0000 7fa53d9f6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b581f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.298+0000 7fa53d9f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b5ad70 0x559490b58730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.298+0000 7fa53d9f6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559490b5d9e0 con 0x559490b504b0 2024-09-10T10:13:35.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.298+0000 7fa53d9f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559490a710f0 con 0x559490b4fb90 2024-09-10T10:13:35.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.298+0000 7fa53d9f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559490b5db60 con 0x559490b5ad70 2024-09-10T10:13:35.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.298+0000 7fa53d9f6740 10 client.0 _ll_register_callbacks cb 0x559490a629e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:35.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.298+0000 7fa52be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.298+0000 7fa52be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60736/0 (socket says 172.21.15.50:60736) 2024-09-10T10:13:35.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.298+0000 7fa52be00640 1 -- 172.21.15.50:0/3043444508 learned_addr learned my addr 172.21.15.50:0/3043444508 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:35.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.298+0000 7fa533e00640 1 --2- 172.21.15.50:0/3043444508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 0x559490b57cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.298+0000 7fa538e00640 1 --2- 172.21.15.50:0/3043444508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b5ad70 0x559490b58730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.299+0000 7fa52be00640 1 -- 172.21.15.50:0/3043444508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b5ad70 msgr2=0x559490b58730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:35.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.299+0000 7fa52be00640 1 --2- 172.21.15.50:0/3043444508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b5ad70 0x559490b58730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.299+0000 7fa52be00640 1 -- 172.21.15.50:0/3043444508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 msgr2=0x559490b57cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.299+0000 7fa52be00640 1 --2- 172.21.15.50:0/3043444508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 0x559490b57cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.299+0000 7fa52be00640 1 -- 172.21.15.50:0/3043444508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594908273c0 con 0x559490b504b0 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.299+0000 7fa52be00640 1 --2- 172.21.15.50:0/3043444508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b581f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0986c0 tx=0x7fa51c09b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfc726fe58b21fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.299+0000 7fa522000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.299+0000 7fa522000640 1 -- 172.21.15.50:0/3043444508 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0a00a0 con 0x559490b504b0 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.299+0000 7fa522000640 1 -- 172.21.15.50:0/3043444508 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa51c09b140 con 0x559490b504b0 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.299+0000 7fa53d9f6740 1 -- 172.21.15.50:0/3043444508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa524004760 con 0x559490b504b0 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.299+0000 7fa522000640 1 -- 172.21.15.50:0/3043444508 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa51c0a4960 con 0x559490b504b0 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.299+0000 7fa53d9f6740 10 client.15765 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.300+0000 7fa53d9f6740 1 -- 172.21.15.50:0/3043444508 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559490b69710 con 0x559490b504b0 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.300+0000 7fa522000640 1 -- 172.21.15.50:0/3043444508 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa524004760 con 0x559490b504b0 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.300+0000 7fa522000640 1 -- 172.21.15.50:0/3043444508 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fa51c0ba410 con 0x559490b504b0 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.300+0000 7fa53d9f6740 10 client.15765 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:35.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.300+0000 7fa53d9f6740 10 client.15765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:35.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.300+0000 7fa53d9f6740 20 client.15765 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:35.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.300+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/3043444508 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559490b6ab20 0x559490b6cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.300+0000 7fa53d9f6740 4 client.15765 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:35.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.300+0000 7fa53d9f6740 1 -- 172.21.15.50:0/3043444508 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559490ac3950 con 0x559490b6ab20 2024-09-10T10:13:35.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.301+0000 7fa533e00640 1 --2- 172.21.15.50:0/3043444508 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559490b6ab20 0x559490b6cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.301+0000 7fa533e00640 1 --2- 172.21.15.50:0/3043444508 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559490b6ab20 0x559490b6cf30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20b04e0baae716a7 server_cookie=f6febc343ff5142b in_seq=0 out_seq=0 2024-09-10T10:13:35.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.301+0000 7fa522000640 10 client.15765 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:35.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.302+0000 7fa522000640 1 -- 172.21.15.50:0/3043444508 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559490ac3950 con 0x559490b6ab20 2024-09-10T10:13:35.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.302+0000 7fa522000640 10 client.15765 handle_command_reply: tid=0 2024-09-10T10:13:35.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.302+0000 7fa53d9f6740 1 client.15765 shutdown 2024-09-10T10:13:35.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.302+0000 7fa53d9f6740 1 -- 172.21.15.50:0/3043444508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 msgr2=0x559490b581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:35.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.302+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/3043444508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b581f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0986c0 tx=0x7fa51c09b650 comp rx=0 tx=0).stop 2024-09-10T10:13:35.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.302+0000 7fa53d9f6740 1 -- 172.21.15.50:0/3043444508 shutdown_connections 2024-09-10T10:13:35.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.302+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/3043444508 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559490b6ab20 0x559490b6cf30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.302+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/3043444508 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b5ad70 0x559490b58730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.302+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/3043444508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b581f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.302+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/3043444508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 0x559490b57cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.302+0000 7fa53d9f6740 1 -- 172.21.15.50:0/3043444508 >> 172.21.15.50:0/3043444508 conn(0x559490b4c120 msgr2=0x559490b51e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:35.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.302+0000 7fa522000640 0 client.15765 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:35.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.302+0000 7fa53d9f6740 1 -- 172.21.15.50:0/3043444508 shutdown_connections 2024-09-10T10:13:35.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.303+0000 7fa53d9f6740 1 -- 172.21.15.50:0/3043444508 wait complete. 2024-09-10T10:13:35.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.303+0000 7fa53d9f6740 20 client.15765 trim_cache size 0 max 16384 2024-09-10T10:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.321+0000 7fa53d9f6740 1 Processor -- start 2024-09-10T10:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.321+0000 7fa53d9f6740 1 -- start start 2024-09-10T10:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.321+0000 7fa53d9f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 0x559490b4c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.321+0000 7fa53d9f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b504b0 0x559490b59c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.321+0000 7fa53d9f6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b5ad70 0x559490b72800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.321+0000 7fa53d9f6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa5341b3780 con 0x559490b5ad70 2024-09-10T10:13:35.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.321+0000 7fa53d9f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa5341b1050 con 0x559490b4fb90 2024-09-10T10:13:35.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.321+0000 7fa53d9f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa5341aeea0 con 0x559490b504b0 2024-09-10T10:13:35.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.321+0000 7fa538e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b5ad70 0x559490b72800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.321+0000 7fa52be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b504b0 0x559490b59c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.321+0000 7fa538e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b5ad70 0x559490b72800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60746/0 (socket says 172.21.15.50:60746) 2024-09-10T10:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.321+0000 7fa533e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 0x559490b4c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.321+0000 7fa538e00640 1 -- 172.21.15.50:0/1633820873 learned_addr learned my addr 172.21.15.50:0/1633820873 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.322+0000 7fa52be00640 1 -- 172.21.15.50:0/1633820873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 msgr2=0x559490b4c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.322+0000 7fa52be00640 1 --2- 172.21.15.50:0/1633820873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 0x559490b4c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.322+0000 7fa52be00640 1 -- 172.21.15.50:0/1633820873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b5ad70 msgr2=0x559490b72800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.322+0000 7fa52be00640 1 --2- 172.21.15.50:0/1633820873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b5ad70 0x559490b72800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.322+0000 7fa52be00640 1 -- 172.21.15.50:0/1633820873 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559490b56c60 con 0x559490b504b0 2024-09-10T10:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.322+0000 7fa52be00640 1 --2- 172.21.15.50:0/1633820873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b504b0 0x559490b59c20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0097d0 tx=0x7fa51c09a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b10a170d56de844 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.322+0000 7fa528c00640 1 -- 172.21.15.50:0/1633820873 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0a00a0 con 0x559490b504b0 2024-09-10T10:13:35.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.322+0000 7fa528c00640 1 -- 172.21.15.50:0/1633820873 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa51c09ade0 con 0x559490b504b0 2024-09-10T10:13:35.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.322+0000 7fa528c00640 1 -- 172.21.15.50:0/1633820873 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0a4bb0 con 0x559490b504b0 2024-09-10T10:13:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.323+0000 7fa53d9f6740 1 -- 172.21.15.50:0/1633820873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b504b0 msgr2=0x559490b59c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.323+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/1633820873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b504b0 0x559490b59c20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0097d0 tx=0x7fa51c09a200 comp rx=0 tx=0).stop 2024-09-10T10:13:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.323+0000 7fa53d9f6740 1 -- 172.21.15.50:0/1633820873 shutdown_connections 2024-09-10T10:13:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.323+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/1633820873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b5ad70 0x559490b72800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.323+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/1633820873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b504b0 0x559490b59c20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.323+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/1633820873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b4fb90 0x559490b4c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.323+0000 7fa53d9f6740 1 -- 172.21.15.50:0/1633820873 >> 172.21.15.50:0/1633820873 conn(0x559490b4c120 msgr2=0x559490b59510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.323+0000 7fa53d9f6740 1 -- 172.21.15.50:0/1633820873 shutdown_connections 2024-09-10T10:13:35.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.323+0000 7fa53d9f6740 1 -- 172.21.15.50:0/1633820873 wait complete. 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.324+0000 7fa53d9f6740 1 -- start start 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.324+0000 7fa53d9f6740 1 Processor -- start 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.324+0000 7fa53d9f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b4fb90 0x559490b63470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.324+0000 7fa53d9f6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b5e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.324+0000 7fa53d9f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b5ad70 0x559490b5ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.324+0000 7fa53d9f6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa5341af510 con 0x559490b504b0 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.324+0000 7fa53d9f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa5341b0980 con 0x559490b5ad70 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.324+0000 7fa53d9f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa5341afbe0 con 0x559490b4fb90 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.324+0000 7fa53d9f6740 10 client.0 _ll_register_callbacks cb 0x7fa51c09bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.325+0000 7fa52be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b5e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.325+0000 7fa533e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b4fb90 0x559490b63470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.325+0000 7fa533e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b4fb90 0x559490b63470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:53216/0 (socket says 172.21.15.50:53216) 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.325+0000 7fa533e00640 1 -- 172.21.15.50:0/1231927516 learned_addr learned my addr 172.21.15.50:0/1231927516 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:35.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.325+0000 7fa538e00640 1 --2- 172.21.15.50:0/1231927516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b5ad70 0x559490b5ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.325+0000 7fa533e00640 1 -- 172.21.15.50:0/1231927516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b5ad70 msgr2=0x559490b5ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.325+0000 7fa533e00640 1 --2- 172.21.15.50:0/1231927516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b5ad70 0x559490b5ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.325+0000 7fa533e00640 1 -- 172.21.15.50:0/1231927516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 msgr2=0x559490b5e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.325+0000 7fa533e00640 1 --2- 172.21.15.50:0/1231927516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b5e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.325+0000 7fa533e00640 1 -- 172.21.15.50:0/1231927516 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559490b5f4c0 con 0x559490b4fb90 2024-09-10T10:13:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.325+0000 7fa52be00640 1 --2- 172.21.15.50:0/1231927516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b5e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.325+0000 7fa533e00640 1 --2- 172.21.15.50:0/1231927516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b4fb90 0x559490b63470 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa524009900 tx=0x7fa52402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d2206909532daec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.325+0000 7fa522000640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:13:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.326+0000 7fa522000640 1 -- 172.21.15.50:0/1231927516 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524035040 con 0x559490b4fb90 2024-09-10T10:13:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.326+0000 7fa53d9f6740 1 -- 172.21.15.50:0/1231927516 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa51c09ade0 con 0x559490b4fb90 2024-09-10T10:13:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.326+0000 7fa522000640 1 -- 172.21.15.50:0/1231927516 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa524004fd0 con 0x559490b4fb90 2024-09-10T10:13:35.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.326+0000 7fa522000640 1 -- 172.21.15.50:0/1231927516 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa524061050 con 0x559490b4fb90 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.326+0000 7fa53d9f6740 10 client.25792 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.326+0000 7fa53d9f6740 1 -- 172.21.15.50:0/1231927516 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559490bd5730 con 0x559490b4fb90 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.326+0000 7fa522000640 1 -- 172.21.15.50:0/1231927516 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa51c09ade0 con 0x559490b4fb90 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.327+0000 7fa522000640 1 -- 172.21.15.50:0/1231927516 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fa524003c90 con 0x559490b4fb90 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.327+0000 7fa53d9f6740 10 client.25792 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.327+0000 7fa53d9f6740 10 client.25792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.327+0000 7fa53d9f6740 20 client.25792 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.327+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/1231927516 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559490bd5a70 0x559490bd7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.327+0000 7fa53d9f6740 4 client.25792 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.327+0000 7fa53d9f6740 1 -- 172.21.15.50:0/1231927516 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559490abde60 con 0x559490bd5a70 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.327+0000 7fa52be00640 1 --2- 172.21.15.50:0/1231927516 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559490bd5a70 0x559490bd7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa52be00640 1 --2- 172.21.15.50:0/1231927516 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559490bd5a70 0x559490bd7e60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=772a492495a89487 server_cookie=4c7c000e8fe0c4be in_seq=0 out_seq=0 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa522000640 10 client.25792 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:35.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa522000640 1 -- 172.21.15.50:0/1231927516 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559490abde60 con 0x559490bd5a70 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa522000640 10 client.25792 handle_command_reply: tid=0 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa53d9f6740 1 client.25792 shutdown 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa53d9f6740 1 -- 172.21.15.50:0/1231927516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b4fb90 msgr2=0x559490b63470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/1231927516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b4fb90 0x559490b63470 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa524009900 tx=0x7fa52402a410 comp rx=0 tx=0).stop 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa53d9f6740 1 -- 172.21.15.50:0/1231927516 shutdown_connections 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/1231927516 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559490bd5a70 0x559490bd7e60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/1231927516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559490b5ad70 0x559490b5ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/1231927516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559490b504b0 0x559490b5e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa53d9f6740 1 --2- 172.21.15.50:0/1231927516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559490b4fb90 0x559490b63470 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa53d9f6740 1 -- 172.21.15.50:0/1231927516 >> 172.21.15.50:0/1231927516 conn(0x559490b4c120 msgr2=0x559490b59d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa522000640 0 client.25792 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa53d9f6740 1 -- 172.21.15.50:0/1231927516 shutdown_connections 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa53d9f6740 1 -- 172.21.15.50:0/1231927516 wait complete. 2024-09-10T10:13:35.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.328+0000 7fa53d9f6740 20 client.25792 trim_cache size 0 max 16384 2024-09-10T10:13:35.333 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:13:35.333 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-10T10:13:35.333 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-10T10:13:35.333 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:13:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.329+0000 7fa53ae00640 1 -- 172.21.15.50:0/1501496562 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa5180a2b80 msgr2=0x7fa5180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.329+0000 7fa53ae00640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa5180a2b80 0x7fa5180a5040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009fd0 tx=0x7fa52c009500 comp rx=0 tx=0).stop 2024-09-10T10:13:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.329+0000 7fa53ae00640 1 -- 172.21.15.50:0/1501496562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5341049a0 msgr2=0x7fa53419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.329+0000 7fa53ae00640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5341049a0 0x7fa53419abd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00e9f0 tx=0x7fa51c00edf0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.329+0000 7fa53ae00640 1 -- 172.21.15.50:0/1501496562 shutdown_connections 2024-09-10T10:13:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.329+0000 7fa53ae00640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa5180a2b80 0x7fa5180a5040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.329+0000 7fa53ae00640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa534109120 0x7fa53419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.329+0000 7fa53ae00640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa5341049a0 0x7fa53419abd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.329+0000 7fa53ae00640 1 --2- 172.21.15.50:0/1501496562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa534103ff0 0x7fa53419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:35.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.329+0000 7fa53ae00640 1 -- 172.21.15.50:0/1501496562 >> 172.21.15.50:0/1501496562 conn(0x7fa5340ffa90 msgr2=0x7fa534100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:35.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.329+0000 7fa53ae00640 1 -- 172.21.15.50:0/1501496562 shutdown_connections 2024-09-10T10:13:35.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:35.329+0000 7fa53ae00640 1 -- 172.21.15.50:0/1501496562 wait complete. 2024-09-10T10:13:36.156 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T10:13:36.157 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:13:36.536 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:36.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:36 smithi050 ceph-mon[30354]: pgmap v463: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 90 MiB/s wr, 28 op/s 2024-09-10T10:13:37.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:36 smithi189 ceph-mon[34999]: pgmap v463: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 90 MiB/s wr, 28 op/s 2024-09-10T10:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.096+0000 7f231d600640 1 -- 172.21.15.50:0/2963632655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2318109120 msgr2=0x7f2318110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.096+0000 7f231d600640 1 --2- 172.21.15.50:0/2963632655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2318109120 0x7f2318110ca0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2310009900 tx=0x7f231002a410 comp rx=0 tx=0).stop 2024-09-10T10:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.096+0000 7f231d600640 1 -- 172.21.15.50:0/2963632655 shutdown_connections 2024-09-10T10:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.096+0000 7f231d600640 1 --2- 172.21.15.50:0/2963632655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2318109120 0x7f2318110ca0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.096+0000 7f231d600640 1 --2- 172.21.15.50:0/2963632655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23181049a0 0x7f23181089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.096+0000 7f231d600640 1 --2- 172.21.15.50:0/2963632655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2318103ff0 0x7f23181043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.096+0000 7f231d600640 1 -- 172.21.15.50:0/2963632655 >> 172.21.15.50:0/2963632655 conn(0x7f23180ffa90 msgr2=0x7f2318101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.096+0000 7f231d600640 1 -- 172.21.15.50:0/2963632655 shutdown_connections 2024-09-10T10:13:37.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.096+0000 7f231d600640 1 -- 172.21.15.50:0/2963632655 wait complete. 2024-09-10T10:13:37.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.097+0000 7f231d600640 1 Processor -- start 2024-09-10T10:13:37.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.097+0000 7f231d600640 1 -- start start 2024-09-10T10:13:37.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f231d600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2318103ff0 0x7f231819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:37.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f231d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23181049a0 0x7f231819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:37.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f231d600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2318109120 0x7f231819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:37.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f231d600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2318114150 con 0x7f2318103ff0 2024-09-10T10:13:37.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f231d600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2318113fd0 con 0x7f23181049a0 2024-09-10T10:13:37.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f231d600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f23181142d0 con 0x7f2318109120 2024-09-10T10:13:37.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f2316a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2318103ff0 0x7f231819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f2316a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2318103ff0 0x7f231819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51438/0 (socket says 172.21.15.50:51438) 2024-09-10T10:13:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f2316a00640 1 -- 172.21.15.50:0/1369635241 learned_addr learned my addr 172.21.15.50:0/1369635241 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f2317400640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2318109120 0x7f231819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f230e000640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23181049a0 0x7f231819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f2316a00640 1 -- 172.21.15.50:0/1369635241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2318109120 msgr2=0x7f231819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f2316a00640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2318109120 0x7f231819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f2316a00640 1 -- 172.21.15.50:0/1369635241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23181049a0 msgr2=0x7f231819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.098+0000 7f2316a00640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23181049a0 0x7f231819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.099+0000 7f2316a00640 1 -- 172.21.15.50:0/1369635241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231819f5e0 con 0x7f2318103ff0 2024-09-10T10:13:37.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.099+0000 7f2316a00640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2318103ff0 0x7f231819a630 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f230800eb90 tx=0x7f230800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:37.102 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:36 smithi084 ceph-mon[34812]: pgmap v463: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 90 MiB/s wr, 28 op/s 2024-09-10T10:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.099+0000 7f230fe00640 1 -- 172.21.15.50:0/1369635241 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308004d20 con 0x7f2318103ff0 2024-09-10T10:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.099+0000 7f230fe00640 1 -- 172.21.15.50:0/1369635241 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f230800ee90 con 0x7f2318103ff0 2024-09-10T10:13:37.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.099+0000 7f230fe00640 1 -- 172.21.15.50:0/1369635241 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308010830 con 0x7f2318103ff0 2024-09-10T10:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.099+0000 7f231d600640 1 -- 172.21.15.50:0/1369635241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231819f8d0 con 0x7f2318103ff0 2024-09-10T10:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.099+0000 7f231d600640 1 -- 172.21.15.50:0/1369635241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23181a71b0 con 0x7f2318103ff0 2024-09-10T10:13:37.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.100+0000 7f231d600640 1 -- 172.21.15.50:0/1369635241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23181043d0 con 0x7f2318103ff0 2024-09-10T10:13:37.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.104+0000 7f230fe00640 1 -- 172.21.15.50:0/1369635241 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2308005000 con 0x7f2318103ff0 2024-09-10T10:13:37.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.105+0000 7f230fe00640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f22fc0a2b80 0x7f22fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:37.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.105+0000 7f230fe00640 1 -- 172.21.15.50:0/1369635241 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f23080cfc60 con 0x7f2318103ff0 2024-09-10T10:13:37.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.106+0000 7f230e000640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f22fc0a2b80 0x7f22fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:37.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.106+0000 7f230e000640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f22fc0a2b80 0x7f22fc0a5040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f23000095f0 tx=0x7f2300005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:37.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.108+0000 7f230fe00640 1 -- 172.21.15.50:0/1369635241 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23080541b0 con 0x7f2318103ff0 2024-09-10T10:13:37.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.331+0000 7f231d600640 1 -- 172.21.15.50:0/1369635241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f231819b990 con 0x7f2318103ff0 2024-09-10T10:13:37.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.332+0000 7f230fe00640 1 -- 172.21.15.50:0/1369635241 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f230809c7d0 con 0x7f2318103ff0 2024-09-10T10:13:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:13:37.334 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:13:37.334 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:13:37.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.335+0000 7f231d600640 1 -- 172.21.15.50:0/1369635241 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f22fc0a2b80 msgr2=0x7f22fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:37.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.335+0000 7f231d600640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f22fc0a2b80 0x7f22fc0a5040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f23000095f0 tx=0x7f2300005f90 comp rx=0 tx=0).stop 2024-09-10T10:13:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.335+0000 7f231d600640 1 -- 172.21.15.50:0/1369635241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2318103ff0 msgr2=0x7f231819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.335+0000 7f231d600640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2318103ff0 0x7f231819a630 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f230800eb90 tx=0x7f230800c6a0 comp rx=0 tx=0).stop 2024-09-10T10:13:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.335+0000 7f231d600640 1 -- 172.21.15.50:0/1369635241 shutdown_connections 2024-09-10T10:13:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.335+0000 7f231d600640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f22fc0a2b80 0x7f22fc0a5040 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.335+0000 7f231d600640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2318109120 0x7f231819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.335+0000 7f231d600640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23181049a0 0x7f231819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.335+0000 7f231d600640 1 --2- 172.21.15.50:0/1369635241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2318103ff0 0x7f231819a630 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.335+0000 7f231d600640 1 -- 172.21.15.50:0/1369635241 >> 172.21.15.50:0/1369635241 conn(0x7f23180ffa90 msgr2=0x7f23181005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:37.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.335+0000 7f231d600640 1 -- 172.21.15.50:0/1369635241 shutdown_connections 2024-09-10T10:13:37.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:37.335+0000 7f231d600640 1 -- 172.21.15.50:0/1369635241 wait complete. 2024-09-10T10:13:37.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:37 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1369635241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:38.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:37 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1369635241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:38.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:37 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1369635241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:38.423 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T10:13:38.811 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:38.989 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:38 smithi050 ceph-mon[30354]: pgmap v464: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 83 MiB/s wr, 28 op/s 2024-09-10T10:13:39.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:38 smithi189 ceph-mon[34999]: pgmap v464: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 83 MiB/s wr, 28 op/s 2024-09-10T10:13:39.098 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:38 smithi084 ceph-mon[34812]: pgmap v464: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 83 MiB/s wr, 28 op/s 2024-09-10T10:13:39.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.402+0000 7f102cc00640 1 -- 172.21.15.50:0/214474815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1028076720 msgr2=0x7f1028076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:39.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.402+0000 7f102cc00640 1 --2- 172.21.15.50:0/214474815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1028076720 0x7f1028076b00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1018009900 tx=0x7f101802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.402+0000 7f102cc00640 1 -- 172.21.15.50:0/214474815 shutdown_connections 2024-09-10T10:13:39.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.402+0000 7f102cc00640 1 --2- 172.21.15.50:0/214474815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1028112a50 0x7f1028114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.402+0000 7f102cc00640 1 --2- 172.21.15.50:0/214474815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1028077040 0x7f1028112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.404 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.402+0000 7f102cc00640 1 --2- 172.21.15.50:0/214474815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1028076720 0x7f1028076b00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.402+0000 7f102cc00640 1 -- 172.21.15.50:0/214474815 >> 172.21.15.50:0/214474815 conn(0x7f10280ffa50 msgr2=0x7f1028101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:39.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.402+0000 7f102cc00640 1 -- 172.21.15.50:0/214474815 shutdown_connections 2024-09-10T10:13:39.405 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.402+0000 7f102cc00640 1 -- 172.21.15.50:0/214474815 wait complete. 2024-09-10T10:13:39.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.403+0000 7f102cc00640 1 Processor -- start 2024-09-10T10:13:39.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.404+0000 7f102cc00640 1 -- start start 2024-09-10T10:13:39.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.404+0000 7f102cc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1028076720 0x7f10281a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.404+0000 7f102cc00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1028077040 0x7f10281a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.404+0000 7f102cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1028112a50 0x7f102819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.404+0000 7f102cc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f10281185e0 con 0x7f1028076720 2024-09-10T10:13:39.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.404+0000 7f102cc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1028118460 con 0x7f1028112a50 2024-09-10T10:13:39.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.404+0000 7f102cc00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1028118760 con 0x7f1028077040 2024-09-10T10:13:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.404+0000 7f1025e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1028076720 0x7f10281a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.404+0000 7f1025e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1028076720 0x7f10281a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51460/0 (socket says 172.21.15.50:51460) 2024-09-10T10:13:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.404+0000 7f1026800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1028112a50 0x7f102819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.404+0000 7f1025e00640 1 -- 172.21.15.50:0/337505442 learned_addr learned my addr 172.21.15.50:0/337505442 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.404+0000 7f101fe00640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1028077040 0x7f10281a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.405+0000 7f1025e00640 1 -- 172.21.15.50:0/337505442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1028077040 msgr2=0x7f10281a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.405+0000 7f1025e00640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1028077040 0x7f10281a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.405+0000 7f1025e00640 1 -- 172.21.15.50:0/337505442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1028112a50 msgr2=0x7f102819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.405+0000 7f1025e00640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1028112a50 0x7f102819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.405+0000 7f1025e00640 1 -- 172.21.15.50:0/337505442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102819f000 con 0x7f1028076720 2024-09-10T10:13:39.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.405+0000 7f1026800640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1028112a50 0x7f102819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:39.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.405+0000 7f1025e00640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1028076720 0x7f10281a4710 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1018006010 tx=0x7f10180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:39.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.405+0000 7f101ea00640 1 -- 172.21.15.50:0/337505442 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101803f030 con 0x7f1028076720 2024-09-10T10:13:39.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.406+0000 7f101ea00640 1 -- 172.21.15.50:0/337505442 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1018003ce0 con 0x7f1028076720 2024-09-10T10:13:39.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.406+0000 7f102cc00640 1 -- 172.21.15.50:0/337505442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f102819f290 con 0x7f1028076720 2024-09-10T10:13:39.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.406+0000 7f101ea00640 1 -- 172.21.15.50:0/337505442 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018035070 con 0x7f1028076720 2024-09-10T10:13:39.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.406+0000 7f102cc00640 1 -- 172.21.15.50:0/337505442 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10281ab5e0 con 0x7f1028076720 2024-09-10T10:13:39.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.409+0000 7f101ea00640 1 -- 172.21.15.50:0/337505442 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1018042030 con 0x7f1028076720 2024-09-10T10:13:39.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.409+0000 7f102f858740 1 Processor -- start 2024-09-10T10:13:39.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.409+0000 7f102f858740 1 -- start start 2024-09-10T10:13:39.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.409+0000 7f102f858740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 0x55675fb68050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.409+0000 7f102f858740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb68590 0x55675fb72910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.409+0000 7f102f858740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb72e50 0x55675fb75240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.409+0000 7f102f858740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55675face3e0 con 0x55675fb68590 2024-09-10T10:13:39.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.409+0000 7f102f858740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55675fa75d80 con 0x55675fb72e50 2024-09-10T10:13:39.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.409+0000 7f102f858740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55675faca3a0 con 0x55675fb67c70 2024-09-10T10:13:39.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.410+0000 7f1026800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 0x55675fb68050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.410+0000 7f1025e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb68590 0x55675fb72910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.410+0000 7f1026800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 0x55675fb68050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:36874/0 (socket says 172.21.15.50:36874) 2024-09-10T10:13:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.410+0000 7f1026800640 1 -- 172.21.15.50:0/814310418 learned_addr learned my addr 172.21.15.50:0/814310418 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.410+0000 7f101fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb72e50 0x55675fb75240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.410+0000 7f101ea00640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f100c0a2c00 0x7f100c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.410+0000 7f1025e00640 1 -- 172.21.15.50:0/814310418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 msgr2=0x55675fb68050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.410+0000 7f1025e00640 1 --2- 172.21.15.50:0/814310418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 0x55675fb68050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.410+0000 7f1025e00640 1 -- 172.21.15.50:0/814310418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb72e50 msgr2=0x55675fb75240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.410+0000 7f1025e00640 1 --2- 172.21.15.50:0/814310418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb72e50 0x55675fb75240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.410+0000 7f101ea00640 1 -- 172.21.15.50:0/337505442 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f10180ef8e0 con 0x7f1028076720 2024-09-10T10:13:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.411+0000 7f1026800640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f100c0a2c00 0x7f100c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.411+0000 7f1025e00640 1 -- 172.21.15.50:0/814310418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675fa94ae0 con 0x55675fb68590 2024-09-10T10:13:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.411+0000 7f1025e00640 1 --2- 172.21.15.50:0/814310418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb68590 0x55675fb72910 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f10180ecf90 tx=0x7f101802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d814b3111046eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:39.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.411+0000 7f1017000640 1 -- 172.21.15.50:0/814310418 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018049020 con 0x55675fb68590 2024-09-10T10:13:39.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.411+0000 7f1017000640 1 -- 172.21.15.50:0/814310418 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10180f2e50 con 0x55675fb68590 2024-09-10T10:13:39.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.411+0000 7f1017000640 1 -- 172.21.15.50:0/814310418 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10180044e0 con 0x55675fb68590 2024-09-10T10:13:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.412+0000 7f102f858740 1 -- 172.21.15.50:0/814310418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb68590 msgr2=0x55675fb72910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.412+0000 7f102f858740 1 --2- 172.21.15.50:0/814310418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb68590 0x55675fb72910 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f10180ecf90 tx=0x7f101802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.412+0000 7f1026800640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f100c0a2c00 0x7f100c0a50c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1020005c40 tx=0x7f1020004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.412+0000 7f102f858740 1 -- 172.21.15.50:0/814310418 shutdown_connections 2024-09-10T10:13:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.412+0000 7f102f858740 1 --2- 172.21.15.50:0/814310418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb72e50 0x55675fb75240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.412+0000 7f102f858740 1 --2- 172.21.15.50:0/814310418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb68590 0x55675fb72910 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.412+0000 7f102f858740 1 --2- 172.21.15.50:0/814310418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 0x55675fb68050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.412+0000 7f102f858740 1 -- 172.21.15.50:0/814310418 >> 172.21.15.50:0/814310418 conn(0x55675fb64200 msgr2=0x55675fb645e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.412+0000 7f102f858740 1 -- 172.21.15.50:0/814310418 shutdown_connections 2024-09-10T10:13:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.412+0000 7f102f858740 1 -- 172.21.15.50:0/814310418 wait complete. 2024-09-10T10:13:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.413+0000 7f102f858740 1 -- start start 2024-09-10T10:13:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.413+0000 7f102f858740 1 Processor -- start 2024-09-10T10:13:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.413+0000 7f102f858740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb67c70 0x55675fb6fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.413+0000 7f102f858740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb68590 0x55675fb701d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.413+0000 7f102f858740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb72e50 0x55675fb70710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.413+0000 7f102f858740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55675fb757e0 con 0x55675fb67c70 2024-09-10T10:13:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.413+0000 7f102f858740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55675fa890f0 con 0x55675fb72e50 2024-09-10T10:13:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.413+0000 7f102f858740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55675fb75960 con 0x55675fb68590 2024-09-10T10:13:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.414+0000 7f102f858740 10 client.0 _ll_register_callbacks cb 0x55675fa70bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:39.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.414+0000 7f1025e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb67c70 0x55675fb6fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.414+0000 7f1025e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb67c70 0x55675fb6fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51480/0 (socket says 172.21.15.50:51480) 2024-09-10T10:13:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.414+0000 7f1025e00640 1 -- 172.21.15.50:0/719551841 learned_addr learned my addr 172.21.15.50:0/719551841 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.414+0000 7f101fe00640 1 --2- 172.21.15.50:0/719551841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb68590 0x55675fb701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.414+0000 7f1026800640 1 --2- 172.21.15.50:0/719551841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb72e50 0x55675fb70710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.414+0000 7f1025e00640 1 -- 172.21.15.50:0/719551841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb68590 msgr2=0x55675fb701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.414+0000 7f1025e00640 1 --2- 172.21.15.50:0/719551841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb68590 0x55675fb701d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.414+0000 7f1025e00640 1 -- 172.21.15.50:0/719551841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb72e50 msgr2=0x55675fb70710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.414+0000 7f1025e00640 1 --2- 172.21.15.50:0/719551841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb72e50 0x55675fb70710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.414+0000 7f1025e00640 1 -- 172.21.15.50:0/719551841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55675f83f3c0 con 0x55675fb67c70 2024-09-10T10:13:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.415+0000 7f1025e00640 1 --2- 172.21.15.50:0/719551841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb67c70 0x55675fb6fc90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1018005ab0 tx=0x7f1018009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e02f9a03299aa55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.415+0000 7f100b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:13:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.415+0000 7f100b400640 1 -- 172.21.15.50:0/719551841 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018049070 con 0x55675fb67c70 2024-09-10T10:13:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.415+0000 7f100b400640 1 -- 172.21.15.50:0/719551841 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f10180ed070 con 0x55675fb67c70 2024-09-10T10:13:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.415+0000 7f102f858740 1 -- 172.21.15.50:0/719551841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10180f2e50 con 0x55675fb67c70 2024-09-10T10:13:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.415+0000 7f100b400640 1 -- 172.21.15.50:0/719551841 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f10180bba00 con 0x55675fb67c70 2024-09-10T10:13:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.415+0000 7f102f858740 10 client.15789 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.415+0000 7f102f858740 1 -- 172.21.15.50:0/719551841 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55675fb757e0 con 0x55675fb67c70 2024-09-10T10:13:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.415+0000 7f100b400640 1 -- 172.21.15.50:0/719551841 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10180f2e50 con 0x55675fb67c70 2024-09-10T10:13:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.416+0000 7f100b400640 1 -- 172.21.15.50:0/719551841 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f10180b8530 con 0x55675fb67c70 2024-09-10T10:13:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.416+0000 7f102f858740 10 client.15789 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.416+0000 7f102f858740 10 client.15789 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:13:39.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.416+0000 7f102f858740 20 client.15789 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.416+0000 7f102f858740 1 --2- 172.21.15.50:0/719551841 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55675fb829c0 0x55675fb84de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.416+0000 7f102f858740 4 client.15789 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.416+0000 7f102f858740 1 -- 172.21.15.50:0/719551841 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55675fadb950 con 0x55675fb829c0 2024-09-10T10:13:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.416+0000 7f101fe00640 1 --2- 172.21.15.50:0/719551841 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55675fb829c0 0x55675fb84de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.417+0000 7f101fe00640 1 --2- 172.21.15.50:0/719551841 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55675fb829c0 0x55675fb84de0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=25e6cdda100eb931 server_cookie=567c86bc38f2c74d in_seq=0 out_seq=0 2024-09-10T10:13:39.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.417+0000 7f100b400640 10 client.15789 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.417+0000 7f100b400640 1 -- 172.21.15.50:0/719551841 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55675fadb950 con 0x55675fb829c0 2024-09-10T10:13:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.417+0000 7f100b400640 10 client.15789 handle_command_reply: tid=0 2024-09-10T10:13:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.418+0000 7f102f858740 1 client.15789 shutdown 2024-09-10T10:13:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.418+0000 7f102f858740 1 -- 172.21.15.50:0/719551841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb67c70 msgr2=0x55675fb6fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.418+0000 7f102f858740 1 --2- 172.21.15.50:0/719551841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb67c70 0x55675fb6fc90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1018005ab0 tx=0x7f1018009660 comp rx=0 tx=0).stop 2024-09-10T10:13:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.418+0000 7f102f858740 1 -- 172.21.15.50:0/719551841 shutdown_connections 2024-09-10T10:13:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.418+0000 7f102f858740 1 --2- 172.21.15.50:0/719551841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb72e50 0x55675fb70710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.418+0000 7f102f858740 1 --2- 172.21.15.50:0/719551841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb68590 0x55675fb701d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.418+0000 7f102f858740 1 --2- 172.21.15.50:0/719551841 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55675fb829c0 0x55675fb84de0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.418+0000 7f102f858740 1 --2- 172.21.15.50:0/719551841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb67c70 0x55675fb6fc90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.418+0000 7f102f858740 1 -- 172.21.15.50:0/719551841 >> 172.21.15.50:0/719551841 conn(0x55675fb64200 msgr2=0x55675fb69f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.418+0000 7f100b400640 0 client.15789 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.418+0000 7f102f858740 1 -- 172.21.15.50:0/719551841 shutdown_connections 2024-09-10T10:13:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.418+0000 7f102f858740 1 -- 172.21.15.50:0/719551841 wait complete. 2024-09-10T10:13:39.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.418+0000 7f102f858740 20 client.15789 trim_cache size 0 max 16384 2024-09-10T10:13:39.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.432+0000 7f102f858740 1 Processor -- start 2024-09-10T10:13:39.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.432+0000 7f102f858740 1 -- start start 2024-09-10T10:13:39.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.432+0000 7f102f858740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 0x55675fb6e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.432+0000 7f102f858740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 0x55675fb70560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f102f858740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb72e50 0x55675fb8a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f102f858740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f10281b7b60 con 0x55675fb72e50 2024-09-10T10:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f102f858740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f10281b5430 con 0x55675fb68590 2024-09-10T10:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f102f858740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10281b3280 con 0x55675fb67c70 2024-09-10T10:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f101fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 0x55675fb70560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f1026800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb72e50 0x55675fb8a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f101fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 0x55675fb70560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:53096/0 (socket says 172.21.15.50:53096) 2024-09-10T10:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f101fe00640 1 -- 172.21.15.50:0/3982264520 learned_addr learned my addr 172.21.15.50:0/3982264520 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f1025e00640 1 --2- 172.21.15.50:0/3982264520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 0x55675fb6e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f101fe00640 1 -- 172.21.15.50:0/3982264520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 msgr2=0x55675fb6e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f101fe00640 1 --2- 172.21.15.50:0/3982264520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 0x55675fb6e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f101fe00640 1 -- 172.21.15.50:0/3982264520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb72e50 msgr2=0x55675fb8a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f101fe00640 1 --2- 172.21.15.50:0/3982264520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb72e50 0x55675fb8a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.433+0000 7f101fe00640 1 -- 172.21.15.50:0/3982264520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675fb683c0 con 0x55675fb68590 2024-09-10T10:13:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.434+0000 7f101fe00640 1 --2- 172.21.15.50:0/3982264520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 0x55675fb70560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1028079220 tx=0x7f101000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b70bd5b477c9eca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.434+0000 7f1016600640 1 -- 172.21.15.50:0/3982264520 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1010005020 con 0x55675fb68590 2024-09-10T10:13:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.434+0000 7f1016600640 1 -- 172.21.15.50:0/3982264520 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10100047a0 con 0x55675fb68590 2024-09-10T10:13:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.434+0000 7f1016600640 1 -- 172.21.15.50:0/3982264520 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10100116a0 con 0x55675fb68590 2024-09-10T10:13:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.435+0000 7f102f858740 1 -- 172.21.15.50:0/3982264520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 msgr2=0x55675fb70560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.435+0000 7f102f858740 1 --2- 172.21.15.50:0/3982264520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 0x55675fb70560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1028079220 tx=0x7f101000b390 comp rx=0 tx=0).stop 2024-09-10T10:13:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.435+0000 7f102f858740 1 -- 172.21.15.50:0/3982264520 shutdown_connections 2024-09-10T10:13:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.435+0000 7f102f858740 1 --2- 172.21.15.50:0/3982264520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb72e50 0x55675fb8a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.435+0000 7f102f858740 1 --2- 172.21.15.50:0/3982264520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 0x55675fb70560 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.435+0000 7f102f858740 1 --2- 172.21.15.50:0/3982264520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 0x55675fb6e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.435+0000 7f102f858740 1 -- 172.21.15.50:0/3982264520 >> 172.21.15.50:0/3982264520 conn(0x55675fb64200 msgr2=0x55675fb71d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.435+0000 7f102f858740 1 -- 172.21.15.50:0/3982264520 shutdown_connections 2024-09-10T10:13:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.435+0000 7f102f858740 1 -- 172.21.15.50:0/3982264520 wait complete. 2024-09-10T10:13:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.435+0000 7f102f858740 1 -- start start 2024-09-10T10:13:39.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.436+0000 7f102f858740 1 Processor -- start 2024-09-10T10:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.436+0000 7f102f858740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 0x55675fb7aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.436+0000 7f102f858740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 0x55675fb7b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.436+0000 7f102f858740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb72e50 0x55675fb75a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.436+0000 7f102f858740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f10281b38f0 con 0x55675fb72e50 2024-09-10T10:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.436+0000 7f102f858740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f10281b4d60 con 0x55675fb68590 2024-09-10T10:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.436+0000 7f102f858740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10281b3fc0 con 0x55675fb67c70 2024-09-10T10:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.436+0000 7f102f858740 10 client.0 _ll_register_callbacks cb 0x7f1010004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:39.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.436+0000 7f101fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 0x55675fb7b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.436+0000 7f1026800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb72e50 0x55675fb75a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.436+0000 7f101fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 0x55675fb7b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:53112/0 (socket says 172.21.15.50:53112) 2024-09-10T10:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.436+0000 7f101fe00640 1 -- 172.21.15.50:0/1407904809 learned_addr learned my addr 172.21.15.50:0/1407904809 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.436+0000 7f1025e00640 1 --2- 172.21.15.50:0/1407904809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 0x55675fb7aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.437+0000 7f101fe00640 1 -- 172.21.15.50:0/1407904809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 msgr2=0x55675fb7aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.437+0000 7f101fe00640 1 --2- 172.21.15.50:0/1407904809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 0x55675fb7aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.437+0000 7f101fe00640 1 -- 172.21.15.50:0/1407904809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb72e50 msgr2=0x55675fb75a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.437+0000 7f101fe00640 1 --2- 172.21.15.50:0/1407904809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb72e50 0x55675fb75a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.437+0000 7f101fe00640 1 -- 172.21.15.50:0/1407904809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55675fb7b5f0 con 0x55675fb68590 2024-09-10T10:13:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.437+0000 7f1026800640 1 --2- 172.21.15.50:0/1407904809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb72e50 0x55675fb75a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.437+0000 7f101fe00640 1 --2- 172.21.15.50:0/1407904809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 0x55675fb7b000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f101000b760 tx=0x7f101000ba80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d8f869d1d5ff26a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.437+0000 7f100b400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.437+0000 7f100b400640 1 -- 172.21.15.50:0/1407904809 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1010004950 con 0x55675fb68590 2024-09-10T10:13:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.437+0000 7f102f858740 1 -- 172.21.15.50:0/1407904809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10100047a0 con 0x55675fb68590 2024-09-10T10:13:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.437+0000 7f100b400640 1 -- 172.21.15.50:0/1407904809 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f1010004af0 con 0x55675fb68590 2024-09-10T10:13:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.438+0000 7f100b400640 1 -- 172.21.15.50:0/1407904809 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1010038050 con 0x55675fb68590 2024-09-10T10:13:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.438+0000 7f102f858740 10 client.25853 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.438+0000 7f102f858740 1 -- 172.21.15.50:0/1407904809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55675fbedb00 con 0x55675fb68590 2024-09-10T10:13:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.438+0000 7f100b400640 1 -- 172.21.15.50:0/1407904809 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10100047a0 con 0x55675fb68590 2024-09-10T10:13:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.438+0000 7f100b400640 1 -- 172.21.15.50:0/1407904809 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f1010011900 con 0x55675fb68590 2024-09-10T10:13:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.438+0000 7f102f858740 10 client.25853 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:39.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.438+0000 7f102f858740 10 client.25853 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:13:39.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.438+0000 7f102f858740 20 client.25853 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:39.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.438+0000 7f102f858740 1 --2- 172.21.15.50:0/1407904809 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55675fbee110 0x55675fbf0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:39.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.438+0000 7f102f858740 4 client.25853 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:13:39.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.438+0000 7f102f858740 1 -- 172.21.15.50:0/1407904809 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55675fad5e60 con 0x55675fbee110 2024-09-10T10:13:39.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.439+0000 7f1025e00640 1 --2- 172.21.15.50:0/1407904809 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55675fbee110 0x55675fbf0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:39.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.439+0000 7f1025e00640 1 --2- 172.21.15.50:0/1407904809 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55675fbee110 0x55675fbf0530 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e6543f6ab0d192ae server_cookie=8218d977d2795408 in_seq=0 out_seq=0 2024-09-10T10:13:39.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.439+0000 7f100b400640 10 client.25853 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:39.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.439+0000 7f100b400640 1 -- 172.21.15.50:0/1407904809 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55675fad5e60 con 0x55675fbee110 2024-09-10T10:13:39.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.439+0000 7f100b400640 10 client.25853 handle_command_reply: tid=0 2024-09-10T10:13:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.439+0000 7f102f858740 1 client.25853 shutdown 2024-09-10T10:13:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.439+0000 7f102f858740 1 -- 172.21.15.50:0/1407904809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 msgr2=0x55675fb7b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.439+0000 7f102f858740 1 --2- 172.21.15.50:0/1407904809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 0x55675fb7b000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f101000b760 tx=0x7f101000ba80 comp rx=0 tx=0).stop 2024-09-10T10:13:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f102f858740 1 -- 172.21.15.50:0/1407904809 shutdown_connections 2024-09-10T10:13:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f102f858740 1 --2- 172.21.15.50:0/1407904809 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55675fbee110 0x55675fbf0530 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f102f858740 1 --2- 172.21.15.50:0/1407904809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55675fb72e50 0x55675fb75a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f100b400640 0 client.25853 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f102f858740 1 --2- 172.21.15.50:0/1407904809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55675fb68590 0x55675fb7b000 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f102f858740 1 --2- 172.21.15.50:0/1407904809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55675fb67c70 0x55675fb7aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f102f858740 1 -- 172.21.15.50:0/1407904809 >> 172.21.15.50:0/1407904809 conn(0x55675fb64200 msgr2=0x55675fb62b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f102f858740 1 -- 172.21.15.50:0/1407904809 shutdown_connections 2024-09-10T10:13:39.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f102f858740 1 -- 172.21.15.50:0/1407904809 wait complete. 2024-09-10T10:13:39.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f102f858740 20 client.25853 trim_cache size 0 max 16384 2024-09-10T10:13:39.448 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f102cc00640 1 -- 172.21.15.50:0/337505442 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f100c0a2c00 msgr2=0x7f100c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f102cc00640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f100c0a2c00 0x7f100c0a50c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1020005c40 tx=0x7f1020004a40 comp rx=0 tx=0).stop 2024-09-10T10:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f102cc00640 1 -- 172.21.15.50:0/337505442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1028076720 msgr2=0x7f10281a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.440+0000 7f102cc00640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1028076720 0x7f10281a4710 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1018006010 tx=0x7f10180042f0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.441+0000 7f102cc00640 1 -- 172.21.15.50:0/337505442 shutdown_connections 2024-09-10T10:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.441+0000 7f102cc00640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f100c0a2c00 0x7f100c0a50c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.441+0000 7f102cc00640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1028112a50 0x7f102819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.441+0000 7f102cc00640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1028077040 0x7f10281a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.441+0000 7f102cc00640 1 --2- 172.21.15.50:0/337505442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1028076720 0x7f10281a4710 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:39.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.441+0000 7f102cc00640 1 -- 172.21.15.50:0/337505442 >> 172.21.15.50:0/337505442 conn(0x7f10280ffa50 msgr2=0x7f1028101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:39.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.441+0000 7f102cc00640 1 -- 172.21.15.50:0/337505442 shutdown_connections 2024-09-10T10:13:39.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:39.441+0000 7f102cc00640 1 -- 172.21.15.50:0/337505442 wait complete. 2024-09-10T10:13:40.592 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:40.593 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:40.593 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:40.593 INFO:tasks.workunit.client.0.smithi050.stdout:iozone test complete. 2024-09-10T10:13:40.594 INFO:tasks.workunit.client.0.smithi050.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-10T10:13:40.675 INFO:tasks.workunit.client.0.smithi050.stdout: Iozone: Performance Test of File I/O 2024-09-10T10:13:40.675 INFO:tasks.workunit.client.0.smithi050.stdout: Version $Revision: 3.494 $ 2024-09-10T10:13:40.675 INFO:tasks.workunit.client.0.smithi050.stdout: Compiled for 64 bit mode. 2024-09-10T10:13:40.675 INFO:tasks.workunit.client.0.smithi050.stdout: Build: linux-AMD64 2024-09-10T10:13:40.675 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-10T10:13:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-10T10:13:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-10T10:13:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-10T10:13:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-10T10:13:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-10T10:13:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-10T10:13:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-10T10:13:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-10T10:13:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: Run began: Tue Sep 10 10:13:40 2024 2024-09-10T10:13:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:40.676 INFO:tasks.workunit.client.0.smithi050.stdout: Include close in write timing 2024-09-10T10:13:40.677 INFO:tasks.workunit.client.0.smithi050.stdout: Include fsync in write timing 2024-09-10T10:13:40.677 INFO:tasks.workunit.client.0.smithi050.stdout: File size set to 1048576 kB 2024-09-10T10:13:40.677 INFO:tasks.workunit.client.0.smithi050.stdout: Record Size 1024 kB 2024-09-10T10:13:40.677 INFO:tasks.workunit.client.0.smithi050.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-10T10:13:40.677 INFO:tasks.workunit.client.0.smithi050.stdout: Output is in kBytes/sec 2024-09-10T10:13:40.677 INFO:tasks.workunit.client.0.smithi050.stdout: Time Resolution = 0.000001 seconds. 2024-09-10T10:13:40.677 INFO:tasks.workunit.client.0.smithi050.stdout: Processor cache size set to 1024 kBytes. 2024-09-10T10:13:40.677 INFO:tasks.workunit.client.0.smithi050.stdout: Processor cache line size set to 32 bytes. 2024-09-10T10:13:40.677 INFO:tasks.workunit.client.0.smithi050.stdout: File stride size set to 17 * record size. 2024-09-10T10:13:40.677 INFO:tasks.workunit.client.0.smithi050.stdout: Throughput test with 1 process 2024-09-10T10:13:40.677 INFO:tasks.workunit.client.0.smithi050.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-09-10T10:13:40.858 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T10:13:41.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:40 smithi189 ceph-mon[34999]: pgmap v465: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 72 MiB/s wr, 24 op/s 2024-09-10T10:13:41.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:40 smithi084 ceph-mon[34812]: pgmap v465: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 72 MiB/s wr, 24 op/s 2024-09-10T10:13:41.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:40 smithi050 ceph-mon[30354]: pgmap v465: 129 pgs: 129 active+clean; 1.0 GiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 72 MiB/s wr, 24 op/s 2024-09-10T10:13:41.264 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.834+0000 7fe122000640 1 -- 172.21.15.50:0/1006740817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe11c101150 msgr2=0x7fe11c10de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.834+0000 7fe122000640 1 --2- 172.21.15.50:0/1006740817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe11c101150 0x7fe11c10de10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe108009900 tx=0x7fe10802a410 comp rx=0 tx=0).stop 2024-09-10T10:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.834+0000 7fe122000640 1 -- 172.21.15.50:0/1006740817 shutdown_connections 2024-09-10T10:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.834+0000 7fe122000640 1 --2- 172.21.15.50:0/1006740817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe11c10e350 0x7fe11c110740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.834+0000 7fe122000640 1 --2- 172.21.15.50:0/1006740817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe11c101150 0x7fe11c10de10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.834+0000 7fe122000640 1 --2- 172.21.15.50:0/1006740817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11c1007a0 0x7fe11c100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.834+0000 7fe122000640 1 -- 172.21.15.50:0/1006740817 >> 172.21.15.50:0/1006740817 conn(0x7fe11c0fc610 msgr2=0x7fe11c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.834+0000 7fe122000640 1 -- 172.21.15.50:0/1006740817 shutdown_connections 2024-09-10T10:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.834+0000 7fe122000640 1 -- 172.21.15.50:0/1006740817 wait complete. 2024-09-10T10:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.835+0000 7fe122000640 1 Processor -- start 2024-09-10T10:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.836+0000 7fe122000640 1 -- start start 2024-09-10T10:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.836+0000 7fe122000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11c1007a0 0x7fe11c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.836+0000 7fe122000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe11c101150 0x7fe11c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.836+0000 7fe122000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe11c10e350 0x7fe11c19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.836+0000 7fe122000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c114020 con 0x7fe11c10e350 2024-09-10T10:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.836+0000 7fe122000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c113ea0 con 0x7fe11c101150 2024-09-10T10:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.836+0000 7fe122000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1141a0 con 0x7fe11c1007a0 2024-09-10T10:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.837+0000 7fe120c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11c1007a0 0x7fe11c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.837+0000 7fe120c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11c1007a0 0x7fe11c19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:36892/0 (socket says 172.21.15.50:36892) 2024-09-10T10:13:41.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.837+0000 7fe120c00640 1 -- 172.21.15.50:0/3378650630 learned_addr learned my addr 172.21.15.50:0/3378650630 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.837+0000 7fe121600640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe11c10e350 0x7fe11c19edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.837+0000 7fe11be00640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe11c101150 0x7fe11c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.837+0000 7fe120c00640 1 -- 172.21.15.50:0/3378650630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe11c101150 msgr2=0x7fe11c19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.837+0000 7fe120c00640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe11c101150 0x7fe11c19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.837+0000 7fe120c00640 1 -- 172.21.15.50:0/3378650630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe11c10e350 msgr2=0x7fe11c19edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.837+0000 7fe120c00640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe11c10e350 0x7fe11c19edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.837+0000 7fe120c00640 1 -- 172.21.15.50:0/3378650630 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11c19f4d0 con 0x7fe11c1007a0 2024-09-10T10:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.838+0000 7fe120c00640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11c1007a0 0x7fe11c19a520 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe11000d950 tx=0x7fe11000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.838+0000 7fe119600640 1 -- 172.21.15.50:0/3378650630 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110017030 con 0x7fe11c1007a0 2024-09-10T10:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.838+0000 7fe122000640 1 -- 172.21.15.50:0/3378650630 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe11c19f7c0 con 0x7fe11c1007a0 2024-09-10T10:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.838+0000 7fe119600640 1 -- 172.21.15.50:0/3378650630 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe110004020 con 0x7fe11c1007a0 2024-09-10T10:13:41.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.838+0000 7fe119600640 1 -- 172.21.15.50:0/3378650630 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1100047a0 con 0x7fe11c1007a0 2024-09-10T10:13:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.839+0000 7fe122000640 1 -- 172.21.15.50:0/3378650630 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe11c1a70a0 con 0x7fe11c1007a0 2024-09-10T10:13:41.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.843+0000 7fe125fcb740 1 Processor -- start 2024-09-10T10:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.843+0000 7fe125fcb740 1 -- start start 2024-09-10T10:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.844+0000 7fe125fcb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.844+0000 7fe125fcb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 0x5625fa0d7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.844+0000 7fe125fcb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0da410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.844+0000 7fe125fcb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5625fa0333e0 con 0x5625fa0cce40 2024-09-10T10:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.844+0000 7fe125fcb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5625f9fdad80 con 0x5625fa0cd760 2024-09-10T10:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.844+0000 7fe125fcb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5625fa02f3a0 con 0x5625fa0d8020 2024-09-10T10:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.844+0000 7fe121600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.844+0000 7fe121600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51510/0 (socket says 172.21.15.50:51510) 2024-09-10T10:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.844+0000 7fe121600640 1 -- 172.21.15.50:0/2714529504 learned_addr learned my addr 172.21.15.50:0/2714529504 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.844+0000 7fe11be00640 1 --2- 172.21.15.50:0/2714529504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0da410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.845+0000 7fe121600640 1 -- 172.21.15.50:0/2714529504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 msgr2=0x5625fa0da410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.845+0000 7fe121600640 1 --2- 172.21.15.50:0/2714529504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0da410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.845+0000 7fe121600640 1 -- 172.21.15.50:0/2714529504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 msgr2=0x5625fa0d7ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:13:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.845+0000 7fe121600640 1 --2- 172.21.15.50:0/2714529504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 0x5625fa0d7ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.845+0000 7fe121600640 1 -- 172.21.15.50:0/2714529504 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625f9ff9ae0 con 0x5625fa0cce40 2024-09-10T10:13:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.845+0000 7fe121600640 1 --2- 172.21.15.50:0/2714529504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0cd220 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe114009f10 tx=0x7fe114010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39f27c53d5e02f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.846+0000 7fe119600640 1 -- 172.21.15.50:0/3378650630 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe1100041d0 con 0x7fe11c1007a0 2024-09-10T10:13:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.846+0000 7fe10dc00640 1 -- 172.21.15.50:0/2714529504 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe114016070 con 0x5625fa0cce40 2024-09-10T10:13:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.846+0000 7fe10dc00640 1 -- 172.21.15.50:0/2714529504 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe114012930 con 0x5625fa0cce40 2024-09-10T10:13:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.846+0000 7fe10dc00640 1 -- 172.21.15.50:0/2714529504 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe114011a50 con 0x5625fa0cce40 2024-09-10T10:13:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.847+0000 7fe125fcb740 1 -- 172.21.15.50:0/2714529504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 msgr2=0x5625fa0cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.847+0000 7fe125fcb740 1 --2- 172.21.15.50:0/2714529504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0cd220 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe114009f10 tx=0x7fe114010740 comp rx=0 tx=0).stop 2024-09-10T10:13:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.847+0000 7fe125fcb740 1 -- 172.21.15.50:0/2714529504 shutdown_connections 2024-09-10T10:13:41.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.847+0000 7fe125fcb740 1 --2- 172.21.15.50:0/2714529504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0da410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.847+0000 7fe125fcb740 1 --2- 172.21.15.50:0/2714529504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 0x5625fa0d7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.847+0000 7fe125fcb740 1 --2- 172.21.15.50:0/2714529504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0cd220 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.847+0000 7fe125fcb740 1 -- 172.21.15.50:0/2714529504 >> 172.21.15.50:0/2714529504 conn(0x5625fa0c93d0 msgr2=0x5625fa0c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.847+0000 7fe125fcb740 1 -- 172.21.15.50:0/2714529504 shutdown_connections 2024-09-10T10:13:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.847+0000 7fe119600640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1040a2b10 0x7fe1040a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.847+0000 7fe125fcb740 1 -- 172.21.15.50:0/2714529504 wait complete. 2024-09-10T10:13:41.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.847+0000 7fe119600640 1 -- 172.21.15.50:0/3378650630 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe1100ceda0 con 0x7fe11c1007a0 2024-09-10T10:13:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.848+0000 7fe11be00640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1040a2b10 0x7fe1040a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.848+0000 7fe125fcb740 1 -- start start 2024-09-10T10:13:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.848+0000 7fe125fcb740 1 Processor -- start 2024-09-10T10:13:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.849+0000 7fe125fcb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0d5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.849+0000 7fe125fcb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 0x5625fa0d5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.849+0000 7fe125fcb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0d5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.849+0000 7fe11be00640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1040a2b10 0x7fe1040a4fd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe108000c00 tx=0x7fe108005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.849+0000 7fe125fcb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5625fa0dabf0 con 0x5625fa0cce40 2024-09-10T10:13:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.849+0000 7fe125fcb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5625f9fee0f0 con 0x5625fa0cd760 2024-09-10T10:13:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.849+0000 7fe125fcb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5625fa0dad70 con 0x5625fa0d8020 2024-09-10T10:13:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.849+0000 7fe125fcb740 10 client.0 _ll_register_callbacks cb 0x5625f9fd5bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.849+0000 7fe120c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0d5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.849+0000 7fe120c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0d5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51526/0 (socket says 172.21.15.50:51526) 2024-09-10T10:13:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.849+0000 7fe120c00640 1 -- 172.21.15.50:0/2027679424 learned_addr learned my addr 172.21.15.50:0/2027679424 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.849+0000 7fe121600640 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0d5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.850+0000 7fe11be00640 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 0x5625fa0d5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.850+0000 7fe120c00640 1 -- 172.21.15.50:0/2027679424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 msgr2=0x5625fa0d5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.850+0000 7fe120c00640 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0d5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.850+0000 7fe120c00640 1 -- 172.21.15.50:0/2027679424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 msgr2=0x5625fa0d5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.850+0000 7fe120c00640 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 0x5625fa0d5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.850+0000 7fe120c00640 1 -- 172.21.15.50:0/2027679424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625f9da43c0 con 0x5625fa0cce40 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.850+0000 7fe121600640 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0d5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.850+0000 7fe11be00640 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 0x5625fa0d5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.850+0000 7fe120c00640 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0d5040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe110097be0 tx=0x7fe11009ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d78440d8f9735ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.850+0000 7fe102000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.850+0000 7fe102000640 1 -- 172.21.15.50:0/2027679424 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11009f5c0 con 0x5625fa0cce40 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.850+0000 7fe102000640 1 -- 172.21.15.50:0/2027679424 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe11009f120 con 0x5625fa0cce40 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.850+0000 7fe125fcb740 1 -- 172.21.15.50:0/2027679424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe114012930 con 0x5625fa0cce40 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.851+0000 7fe102000640 1 -- 172.21.15.50:0/2027679424 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe1100b4200 con 0x5625fa0cce40 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.851+0000 7fe125fcb740 10 client.15807 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.851+0000 7fe125fcb740 1 -- 172.21.15.50:0/2027679424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5625fa0e6d50 con 0x5625fa0cce40 2024-09-10T10:13:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.851+0000 7fe102000640 1 -- 172.21.15.50:0/2027679424 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe114012930 con 0x5625fa0cce40 2024-09-10T10:13:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.851+0000 7fe102000640 1 -- 172.21.15.50:0/2027679424 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe11009a660 con 0x5625fa0cce40 2024-09-10T10:13:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.851+0000 7fe125fcb740 10 client.15807 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.851+0000 7fe125fcb740 10 client.15807 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:13:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.851+0000 7fe125fcb740 20 client.15807 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.851+0000 7fe125fcb740 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5625fa0e8160 0x5625fa0ea550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.851+0000 7fe125fcb740 4 client.15807 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.851+0000 7fe125fcb740 1 -- 172.21.15.50:0/2027679424 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625fa040950 con 0x5625fa0e8160 2024-09-10T10:13:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.852+0000 7fe11be00640 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5625fa0e8160 0x5625fa0ea550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.852+0000 7fe11be00640 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5625fa0e8160 0x5625fa0ea550 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5ac0adc2d49ff10 server_cookie=fda4a86113c666ff in_seq=0 out_seq=0 2024-09-10T10:13:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.852+0000 7fe102000640 10 client.15807 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.853+0000 7fe102000640 1 -- 172.21.15.50:0/2027679424 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625fa040950 con 0x5625fa0e8160 2024-09-10T10:13:41.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.853+0000 7fe102000640 10 client.15807 handle_command_reply: tid=0 2024-09-10T10:13:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.853+0000 7fe125fcb740 1 client.15807 shutdown 2024-09-10T10:13:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.854+0000 7fe125fcb740 1 -- 172.21.15.50:0/2027679424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 msgr2=0x5625fa0d5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.854+0000 7fe125fcb740 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0d5040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe110097be0 tx=0x7fe11009ab70 comp rx=0 tx=0).stop 2024-09-10T10:13:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.854+0000 7fe125fcb740 1 -- 172.21.15.50:0/2027679424 shutdown_connections 2024-09-10T10:13:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.854+0000 7fe125fcb740 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5625fa0e8160 0x5625fa0ea550 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.854+0000 7fe125fcb740 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0d5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.854+0000 7fe125fcb740 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 0x5625fa0d5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.854+0000 7fe125fcb740 1 --2- 172.21.15.50:0/2027679424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0d5040 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.854+0000 7fe102000640 0 client.15807 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.854+0000 7fe125fcb740 1 -- 172.21.15.50:0/2027679424 >> 172.21.15.50:0/2027679424 conn(0x5625fa0c93d0 msgr2=0x5625fa0cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.854+0000 7fe125fcb740 1 -- 172.21.15.50:0/2027679424 shutdown_connections 2024-09-10T10:13:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.854+0000 7fe125fcb740 1 -- 172.21.15.50:0/2027679424 wait complete. 2024-09-10T10:13:41.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.854+0000 7fe125fcb740 20 client.15807 trim_cache size 0 max 16384 2024-09-10T10:13:41.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.868+0000 7fe125fcb740 1 Processor -- start 2024-09-10T10:13:41.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.868+0000 7fe125fcb740 1 -- start start 2024-09-10T10:13:41.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.868+0000 7fe125fcb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.868+0000 7fe125fcb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 0x5625fa0efdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.868+0000 7fe125fcb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0f0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.868+0000 7fe125fcb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1b36c0 con 0x5625fa0cce40 2024-09-10T10:13:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.868+0000 7fe125fcb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1b0f90 con 0x5625fa0cd760 2024-09-10T10:13:41.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.868+0000 7fe125fcb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1aede0 con 0x5625fa0d8020 2024-09-10T10:13:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.869+0000 7fe120c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.869+0000 7fe120c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51542/0 (socket says 172.21.15.50:51542) 2024-09-10T10:13:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.869+0000 7fe120c00640 1 -- 172.21.15.50:0/312844476 learned_addr learned my addr 172.21.15.50:0/312844476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:41.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.869+0000 7fe121600640 1 --2- 172.21.15.50:0/312844476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.869+0000 7fe120c00640 1 -- 172.21.15.50:0/312844476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 msgr2=0x5625fa0f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.869+0000 7fe120c00640 1 --2- 172.21.15.50:0/312844476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.869+0000 7fe120c00640 1 -- 172.21.15.50:0/312844476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 msgr2=0x5625fa0efdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.869+0000 7fe11be00640 1 --2- 172.21.15.50:0/312844476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 0x5625fa0efdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.869+0000 7fe120c00640 1 --2- 172.21.15.50:0/312844476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 0x5625fa0efdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.869+0000 7fe120c00640 1 -- 172.21.15.50:0/312844476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625fa0ca480 con 0x5625fa0cce40 2024-09-10T10:13:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.870+0000 7fe120c00640 1 --2- 172.21.15.50:0/312844476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0cf8f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe1100b1040 tx=0x7fe110099720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b467346cf8272a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.870+0000 7fe10d200640 1 -- 172.21.15.50:0/312844476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1100b4200 con 0x5625fa0cce40 2024-09-10T10:13:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.870+0000 7fe10d200640 1 -- 172.21.15.50:0/312844476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1100b9e50 con 0x5625fa0cce40 2024-09-10T10:13:41.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.870+0000 7fe10d200640 1 -- 172.21.15.50:0/312844476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110097880 con 0x5625fa0cce40 2024-09-10T10:13:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.871+0000 7fe125fcb740 1 -- 172.21.15.50:0/312844476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 msgr2=0x5625fa0cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.871+0000 7fe125fcb740 1 --2- 172.21.15.50:0/312844476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0cf8f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe1100b1040 tx=0x7fe110099720 comp rx=0 tx=0).stop 2024-09-10T10:13:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.871+0000 7fe125fcb740 1 -- 172.21.15.50:0/312844476 shutdown_connections 2024-09-10T10:13:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.871+0000 7fe125fcb740 1 --2- 172.21.15.50:0/312844476 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.871+0000 7fe125fcb740 1 --2- 172.21.15.50:0/312844476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cd760 0x5625fa0efdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.871+0000 7fe125fcb740 1 --2- 172.21.15.50:0/312844476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cce40 0x5625fa0cf8f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.871+0000 7fe125fcb740 1 -- 172.21.15.50:0/312844476 >> 172.21.15.50:0/312844476 conn(0x5625fa0c93d0 msgr2=0x5625fa0d70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.872+0000 7fe125fcb740 1 -- 172.21.15.50:0/312844476 shutdown_connections 2024-09-10T10:13:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.872+0000 7fe125fcb740 1 -- 172.21.15.50:0/312844476 wait complete. 2024-09-10T10:13:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.872+0000 7fe125fcb740 1 -- start start 2024-09-10T10:13:41.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.873+0000 7fe125fcb740 1 Processor -- start 2024-09-10T10:13:41.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.873+0000 7fe125fcb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cce40 0x5625fa0e08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.873+0000 7fe125fcb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cd760 0x5625fa0d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.873+0000 7fe125fcb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.873+0000 7fe125fcb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1af450 con 0x5625fa0cd760 2024-09-10T10:13:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.873+0000 7fe125fcb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1b08c0 con 0x5625fa0cce40 2024-09-10T10:13:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.873+0000 7fe125fcb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1afb20 con 0x5625fa0d8020 2024-09-10T10:13:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.873+0000 7fe125fcb740 10 client.0 _ll_register_callbacks cb 0x7fe11009b090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.874+0000 7fe120c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cce40 0x5625fa0e08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.874+0000 7fe120c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cce40 0x5625fa0e08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:53164/0 (socket says 172.21.15.50:53164) 2024-09-10T10:13:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.874+0000 7fe120c00640 1 -- 172.21.15.50:0/1135724904 learned_addr learned my addr 172.21.15.50:0/1135724904 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.874+0000 7fe121600640 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.874+0000 7fe11be00640 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cd760 0x5625fa0d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.874+0000 7fe120c00640 1 -- 172.21.15.50:0/1135724904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 msgr2=0x5625fa0d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:41.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.874+0000 7fe120c00640 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.874+0000 7fe120c00640 1 -- 172.21.15.50:0/1135724904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cd760 msgr2=0x5625fa0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.874+0000 7fe120c00640 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cd760 0x5625fa0d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.874+0000 7fe120c00640 1 -- 172.21.15.50:0/1135724904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625fa0cfe30 con 0x5625fa0cce40 2024-09-10T10:13:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.875+0000 7fe121600640 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.875+0000 7fe120c00640 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cce40 0x5625fa0e08a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe1100a3950 tx=0x7fe1100975e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c369c4a59c514b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.875+0000 7fe102000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.875+0000 7fe102000640 1 -- 172.21.15.50:0/1135724904 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1100b4200 con 0x5625fa0cce40 2024-09-10T10:13:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.875+0000 7fe102000640 1 -- 172.21.15.50:0/1135724904 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe11009f120 con 0x5625fa0cce40 2024-09-10T10:13:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.875+0000 7fe125fcb740 1 -- 172.21.15.50:0/1135724904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1100b9e50 con 0x5625fa0cce40 2024-09-10T10:13:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.876+0000 7fe102000640 1 -- 172.21.15.50:0/1135724904 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe1100a3e80 con 0x5625fa0cce40 2024-09-10T10:13:41.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.876+0000 7fe125fcb740 10 client.25862 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.876+0000 7fe125fcb740 1 -- 172.21.15.50:0/1135724904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5625fa152d70 con 0x5625fa0cce40 2024-09-10T10:13:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.876+0000 7fe102000640 1 -- 172.21.15.50:0/1135724904 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1100b9e50 con 0x5625fa0cce40 2024-09-10T10:13:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.877+0000 7fe102000640 1 -- 172.21.15.50:0/1135724904 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe110009a30 con 0x5625fa0cce40 2024-09-10T10:13:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.877+0000 7fe125fcb740 10 client.25862 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.877+0000 7fe125fcb740 10 client.25862 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:13:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.877+0000 7fe125fcb740 20 client.25862 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.877+0000 7fe125fcb740 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5625fa153150 0x5625fa155540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:41.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.877+0000 7fe125fcb740 4 client.25862 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:13:41.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.877+0000 7fe125fcb740 1 -- 172.21.15.50:0/1135724904 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5625fa03ae60 con 0x5625fa153150 2024-09-10T10:13:41.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.877+0000 7fe11be00640 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5625fa153150 0x5625fa155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:41.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.878+0000 7fe102000640 10 client.25862 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:41.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.879+0000 7fe11be00640 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5625fa153150 0x5625fa155540 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=10113165f13fcb9e server_cookie=e3006982d4200234 in_seq=0 out_seq=0 2024-09-10T10:13:41.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.879+0000 7fe102000640 1 -- 172.21.15.50:0/1135724904 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5625fa03ae60 con 0x5625fa153150 2024-09-10T10:13:41.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.879+0000 7fe102000640 10 client.25862 handle_command_reply: tid=0 2024-09-10T10:13:41.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.879+0000 7fe125fcb740 1 client.25862 shutdown 2024-09-10T10:13:41.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.879+0000 7fe125fcb740 1 -- 172.21.15.50:0/1135724904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cce40 msgr2=0x5625fa0e08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:41.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.879+0000 7fe125fcb740 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cce40 0x5625fa0e08a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe1100a3950 tx=0x7fe1100975e0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.879+0000 7fe125fcb740 1 -- 172.21.15.50:0/1135724904 shutdown_connections 2024-09-10T10:13:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.879+0000 7fe125fcb740 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x5625fa153150 0x5625fa155540 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.879+0000 7fe125fcb740 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625fa0d8020 0x5625fa0d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.879+0000 7fe125fcb740 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5625fa0cd760 0x5625fa0d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.879+0000 7fe125fcb740 1 --2- 172.21.15.50:0/1135724904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5625fa0cce40 0x5625fa0e08a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.879+0000 7fe125fcb740 1 -- 172.21.15.50:0/1135724904 >> 172.21.15.50:0/1135724904 conn(0x5625fa0c93d0 msgr2=0x5625fa0e2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.879+0000 7fe102000640 0 client.25862 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.880+0000 7fe125fcb740 1 -- 172.21.15.50:0/1135724904 shutdown_connections 2024-09-10T10:13:41.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.880+0000 7fe125fcb740 1 -- 172.21.15.50:0/1135724904 wait complete. 2024-09-10T10:13:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.880+0000 7fe125fcb740 20 client.25862 trim_cache size 0 max 16384 2024-09-10T10:13:41.883 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:13:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.882+0000 7fe122000640 1 -- 172.21.15.50:0/3378650630 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1040a2b10 msgr2=0x7fe1040a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.882+0000 7fe122000640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1040a2b10 0x7fe1040a4fd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe108000c00 tx=0x7fe108005b50 comp rx=0 tx=0).stop 2024-09-10T10:13:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.882+0000 7fe122000640 1 -- 172.21.15.50:0/3378650630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11c1007a0 msgr2=0x7fe11c19a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:41.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.882+0000 7fe122000640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11c1007a0 0x7fe11c19a520 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe11000d950 tx=0x7fe11000de10 comp rx=0 tx=0).stop 2024-09-10T10:13:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.883+0000 7fe122000640 1 -- 172.21.15.50:0/3378650630 shutdown_connections 2024-09-10T10:13:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.883+0000 7fe122000640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1040a2b10 0x7fe1040a4fd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.883+0000 7fe122000640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe11c10e350 0x7fe11c19edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.883+0000 7fe122000640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe11c101150 0x7fe11c19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.883+0000 7fe122000640 1 --2- 172.21.15.50:0/3378650630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe11c1007a0 0x7fe11c19a520 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.883+0000 7fe122000640 1 -- 172.21.15.50:0/3378650630 >> 172.21.15.50:0/3378650630 conn(0x7fe11c0fc610 msgr2=0x7fe11c0fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:41.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.884+0000 7fe122000640 1 -- 172.21.15.50:0/3378650630 shutdown_connections 2024-09-10T10:13:41.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:41.884+0000 7fe122000640 1 -- 172.21.15.50:0/3378650630 wait complete. 2024-09-10T10:13:42.731 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T10:13:42.967 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:42 smithi050 ceph-mon[30354]: pgmap v466: 129 pgs: 129 active+clean; 705 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-10T10:13:43.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:42 smithi189 ceph-mon[34999]: pgmap v466: 129 pgs: 129 active+clean; 705 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-10T10:13:43.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:42 smithi084 ceph-mon[34812]: pgmap v466: 129 pgs: 129 active+clean; 705 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 26 MiB/s wr, 18 op/s 2024-09-10T10:13:43.519 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:43.961 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:43 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:13:44.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:43 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:13:44.098 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:43 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:13:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.219+0000 7fb8ca600640 1 -- 172.21.15.50:0/2381522316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8c41027a0 msgr2=0x7fb8c41067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.219+0000 7fb8ca600640 1 --2- 172.21.15.50:0/2381522316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8c41027a0 0x7fb8c41067f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009900 tx=0x7fb8b002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.220+0000 7fb8ca600640 1 -- 172.21.15.50:0/2381522316 shutdown_connections 2024-09-10T10:13:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.220+0000 7fb8ca600640 1 --2- 172.21.15.50:0/2381522316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c4106f20 0x7fb8c410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.220+0000 7fb8ca600640 1 --2- 172.21.15.50:0/2381522316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8c41027a0 0x7fb8c41067f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.220+0000 7fb8ca600640 1 --2- 172.21.15.50:0/2381522316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8c4101df0 0x7fb8c41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.220+0000 7fb8ca600640 1 -- 172.21.15.50:0/2381522316 >> 172.21.15.50:0/2381522316 conn(0x7fb8c40fd8b0 msgr2=0x7fb8c40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.220+0000 7fb8ca600640 1 -- 172.21.15.50:0/2381522316 shutdown_connections 2024-09-10T10:13:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.220+0000 7fb8ca600640 1 -- 172.21.15.50:0/2381522316 wait complete. 2024-09-10T10:13:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.221+0000 7fb8ca600640 1 Processor -- start 2024-09-10T10:13:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.221+0000 7fb8ca600640 1 -- start start 2024-09-10T10:13:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.222+0000 7fb8ca600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8c4101df0 0x7fb8c41a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.222+0000 7fb8ca600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8c41027a0 0x7fb8c41a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.222+0000 7fb8ca600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c4106f20 0x7fb8c410dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.222+0000 7fb8ca600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c4111f90 con 0x7fb8c4101df0 2024-09-10T10:13:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.222+0000 7fb8ca600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c4111e10 con 0x7fb8c4106f20 2024-09-10T10:13:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.222+0000 7fb8ca600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c4112110 con 0x7fb8c41027a0 2024-09-10T10:13:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.222+0000 7fb8c3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8c4101df0 0x7fb8c41a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.222+0000 7fb8c3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8c4101df0 0x7fb8c41a47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51570/0 (socket says 172.21.15.50:51570) 2024-09-10T10:13:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.222+0000 7fb8c2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8c41027a0 0x7fb8c41a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.222+0000 7fb8c3400640 1 -- 172.21.15.50:0/729690277 learned_addr learned my addr 172.21.15.50:0/729690277 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.222+0000 7fb8c3e00640 1 --2- 172.21.15.50:0/729690277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c4106f20 0x7fb8c410dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.223+0000 7fb8c3e00640 1 -- 172.21.15.50:0/729690277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8c41027a0 msgr2=0x7fb8c41a4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.223+0000 7fb8c3e00640 1 --2- 172.21.15.50:0/729690277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8c41027a0 0x7fb8c41a4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.223+0000 7fb8c3e00640 1 -- 172.21.15.50:0/729690277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8c4101df0 msgr2=0x7fb8c41a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.223+0000 7fb8c3e00640 1 --2- 172.21.15.50:0/729690277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8c4101df0 0x7fb8c41a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.223+0000 7fb8c3e00640 1 -- 172.21.15.50:0/729690277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c410e4f0 con 0x7fb8c4106f20 2024-09-10T10:13:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.223+0000 7fb8c3e00640 1 --2- 172.21.15.50:0/729690277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c4106f20 0x7fb8c410dcc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009fd0 tx=0x7fb8bc00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.224+0000 7fb8bbe00640 1 -- 172.21.15.50:0/729690277 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc00ce20 con 0x7fb8c4106f20 2024-09-10T10:13:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.224+0000 7fb8bbe00640 1 -- 172.21.15.50:0/729690277 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8bc005020 con 0x7fb8c4106f20 2024-09-10T10:13:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.224+0000 7fb8bbe00640 1 -- 172.21.15.50:0/729690277 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc010720 con 0x7fb8c4106f20 2024-09-10T10:13:44.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.224+0000 7fb8ca600640 1 -- 172.21.15.50:0/729690277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c410e7e0 con 0x7fb8c4106f20 2024-09-10T10:13:44.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.224+0000 7fb8ca600640 1 -- 172.21.15.50:0/729690277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c41ab520 con 0x7fb8c4106f20 2024-09-10T10:13:44.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.228+0000 7fb8cd013740 1 Processor -- start 2024-09-10T10:13:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.229+0000 7fb8bbe00640 1 -- 172.21.15.50:0/729690277 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb8bc005540 con 0x7fb8c4106f20 2024-09-10T10:13:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.230+0000 7fb8cd013740 1 -- start start 2024-09-10T10:13:44.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.231+0000 7fb8cd013740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07cc70 0x5631cf07d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.231+0000 7fb8cd013740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07d590 0x5631cf087910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.231+0000 7fb8cd013740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf087e50 0x5631cf08a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.231+0000 7fb8cd013740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5631cefe33e0 con 0x5631cf087e50 2024-09-10T10:13:44.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.231+0000 7fb8cd013740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5631cef8ad80 con 0x5631cf07cc70 2024-09-10T10:13:44.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.231+0000 7fb8c2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07cc70 0x5631cf07d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.231+0000 7fb8cd013740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5631cefdf3a0 con 0x5631cf07d590 2024-09-10T10:13:44.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.231+0000 7fb8bbe00640 1 --2- 172.21.15.50:0/729690277 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb8a80a2b80 0x7fb8a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.231+0000 7fb8c2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07cc70 0x5631cf07d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:53182/0 (socket says 172.21.15.50:53182) 2024-09-10T10:13:44.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.232+0000 7fb8c2a00640 1 -- 172.21.15.50:0/3902582288 learned_addr learned my addr 172.21.15.50:0/3902582288 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:44.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.232+0000 7fb8c3400640 1 --2- 172.21.15.50:0/3902582288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07d590 0x5631cf087910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.232+0000 7fb8c2a00640 1 --2- 172.21.15.50:0/3902582288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf087e50 0x5631cf08a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.232+0000 7fb8bbe00640 1 -- 172.21.15.50:0/729690277 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb8bc0cf8e0 con 0x7fb8c4106f20 2024-09-10T10:13:44.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.232+0000 7fb8c3400640 1 -- 172.21.15.50:0/3902582288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07cc70 msgr2=0x5631cf07d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:44.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.232+0000 7fb8c3400640 1 --2- 172.21.15.50:0/3902582288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07cc70 0x5631cf07d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.232+0000 7fb8c3400640 1 -- 172.21.15.50:0/3902582288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf087e50 msgr2=0x5631cf08a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:44.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.232+0000 7fb8c3400640 1 --2- 172.21.15.50:0/3902582288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf087e50 0x5631cf08a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.232+0000 7fb8c3400640 1 -- 172.21.15.50:0/3902582288 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631cefa9ae0 con 0x5631cf07d590 2024-09-10T10:13:44.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.233+0000 7fb8c3e00640 1 --2- 172.21.15.50:0/729690277 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb8a80a2b80 0x7fb8a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.233+0000 7fb8c3400640 1 --2- 172.21.15.50:0/3902582288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07d590 0x5631cf087910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009c80 tx=0x7fb8b4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5e95b107f108c0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:44.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.234+0000 7fb8c3e00640 1 --2- 172.21.15.50:0/729690277 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb8a80a2b80 0x7fb8a80a5040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc098780 tx=0x7fb8bc005940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:44.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.234+0000 7fb8b8c00640 1 -- 172.21.15.50:0/3902582288 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4004250 con 0x5631cf07d590 2024-09-10T10:13:44.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.234+0000 7fb8b8c00640 1 -- 172.21.15.50:0/3902582288 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8b4009e30 con 0x5631cf07d590 2024-09-10T10:13:44.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.234+0000 7fb8b8c00640 1 -- 172.21.15.50:0/3902582288 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4004e20 con 0x5631cf07d590 2024-09-10T10:13:44.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.235+0000 7fb8cd013740 1 -- 172.21.15.50:0/3902582288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07d590 msgr2=0x5631cf087910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:44.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.235+0000 7fb8cd013740 1 --2- 172.21.15.50:0/3902582288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07d590 0x5631cf087910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009c80 tx=0x7fb8b4011810 comp rx=0 tx=0).stop 2024-09-10T10:13:44.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.235+0000 7fb8cd013740 1 -- 172.21.15.50:0/3902582288 shutdown_connections 2024-09-10T10:13:44.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.235+0000 7fb8cd013740 1 --2- 172.21.15.50:0/3902582288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf087e50 0x5631cf08a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.235+0000 7fb8cd013740 1 --2- 172.21.15.50:0/3902582288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07d590 0x5631cf087910 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.235+0000 7fb8cd013740 1 --2- 172.21.15.50:0/3902582288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07cc70 0x5631cf07d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.235+0000 7fb8cd013740 1 -- 172.21.15.50:0/3902582288 >> 172.21.15.50:0/3902582288 conn(0x5631cf079200 msgr2=0x5631cf0795e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:44.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.236+0000 7fb8cd013740 1 -- 172.21.15.50:0/3902582288 shutdown_connections 2024-09-10T10:13:44.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.236+0000 7fb8cd013740 1 -- 172.21.15.50:0/3902582288 wait complete. 2024-09-10T10:13:44.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.236+0000 7fb8cd013740 1 -- start start 2024-09-10T10:13:44.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.237+0000 7fb8cd013740 1 Processor -- start 2024-09-10T10:13:44.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.238+0000 7fb8cd013740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07cc70 0x5631cf084c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.238+0000 7fb8cd013740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07d590 0x5631cf0851a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.238+0000 7fb8cd013740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf087e50 0x5631cf0856e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.238+0000 7fb8cd013740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5631cf08aa20 con 0x5631cf087e50 2024-09-10T10:13:44.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.238+0000 7fb8cd013740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5631cef9e0f0 con 0x5631cf07d590 2024-09-10T10:13:44.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.238+0000 7fb8cd013740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5631cf08aba0 con 0x5631cf07cc70 2024-09-10T10:13:44.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.238+0000 7fb8cd013740 10 client.0 _ll_register_callbacks cb 0x5631cef85bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:44.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.238+0000 7fb8c3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07d590 0x5631cf0851a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.238+0000 7fb8c3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07d590 0x5631cf0851a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:53188/0 (socket says 172.21.15.50:53188) 2024-09-10T10:13:44.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.238+0000 7fb8c3400640 1 -- 172.21.15.50:0/772909433 learned_addr learned my addr 172.21.15.50:0/772909433 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:44.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.239+0000 7fb8c2a00640 1 --2- 172.21.15.50:0/772909433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf087e50 0x5631cf0856e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.240+0000 7fb8c3400640 1 -- 172.21.15.50:0/772909433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07cc70 msgr2=0x5631cf084c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:13:44.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.240+0000 7fb8c3400640 1 --2- 172.21.15.50:0/772909433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07cc70 0x5631cf084c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.240+0000 7fb8c3400640 1 -- 172.21.15.50:0/772909433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf087e50 msgr2=0x5631cf0856e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:44.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.240+0000 7fb8c3400640 1 --2- 172.21.15.50:0/772909433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf087e50 0x5631cf0856e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.240+0000 7fb8c3400640 1 -- 172.21.15.50:0/772909433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631ced543c0 con 0x5631cf07d590 2024-09-10T10:13:44.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.240+0000 7fb8c2a00640 1 --2- 172.21.15.50:0/772909433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf087e50 0x5631cf0856e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:44.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.241+0000 7fb8c3400640 1 --2- 172.21.15.50:0/772909433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07d590 0x5631cf0851a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4004960 tx=0x7fb8b4005d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de2e66c7f8058234 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:44.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.241+0000 7fb8ad600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:44.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.242+0000 7fb8ad600640 1 -- 172.21.15.50:0/772909433 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4029070 con 0x5631cf07d590 2024-09-10T10:13:44.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.242+0000 7fb8cd013740 1 -- 172.21.15.50:0/772909433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8b4009e30 con 0x5631cf07d590 2024-09-10T10:13:44.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.242+0000 7fb8ad600640 1 -- 172.21.15.50:0/772909433 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb8b4003a00 con 0x5631cf07d590 2024-09-10T10:13:44.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.242+0000 7fb8ad600640 1 -- 172.21.15.50:0/772909433 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8b4035050 con 0x5631cf07d590 2024-09-10T10:13:44.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.242+0000 7fb8cd013740 10 client.25874 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:44.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.242+0000 7fb8cd013740 1 -- 172.21.15.50:0/772909433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5631cf096980 con 0x5631cf07d590 2024-09-10T10:13:44.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.243+0000 7fb8ad600640 1 -- 172.21.15.50:0/772909433 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8b4009e30 con 0x5631cf07d590 2024-09-10T10:13:44.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.243+0000 7fb8ad600640 1 -- 172.21.15.50:0/772909433 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb8b4023430 con 0x5631cf07d590 2024-09-10T10:13:44.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.243+0000 7fb8cd013740 10 client.25874 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:44.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.243+0000 7fb8cd013740 10 client.25874 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:44.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.243+0000 7fb8cd013740 20 client.25874 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:44.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.243+0000 7fb8cd013740 1 --2- 172.21.15.50:0/772909433 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5631cf098140 0x5631cf09a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.244+0000 7fb8cd013740 4 client.25874 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:44.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.244+0000 7fb8cd013740 1 -- 172.21.15.50:0/772909433 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631ceff0950 con 0x5631cf098140 2024-09-10T10:13:44.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.244+0000 7fb8c2a00640 1 --2- 172.21.15.50:0/772909433 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5631cf098140 0x5631cf09a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.245+0000 7fb8ad600640 10 client.25874 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:44.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.245+0000 7fb8c2a00640 1 --2- 172.21.15.50:0/772909433 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5631cf098140 0x5631cf09a600 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=522c0674c80917b5 server_cookie=8ebe908cc7100c2 in_seq=0 out_seq=0 2024-09-10T10:13:44.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.246+0000 7fb8ad600640 1 -- 172.21.15.50:0/772909433 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631ceff0950 con 0x5631cf098140 2024-09-10T10:13:44.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.246+0000 7fb8ad600640 10 client.25874 handle_command_reply: tid=0 2024-09-10T10:13:44.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.246+0000 7fb8cd013740 1 client.25874 shutdown 2024-09-10T10:13:44.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.246+0000 7fb8cd013740 1 -- 172.21.15.50:0/772909433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07d590 msgr2=0x5631cf0851a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:44.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.246+0000 7fb8cd013740 1 --2- 172.21.15.50:0/772909433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07d590 0x5631cf0851a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4004960 tx=0x7fb8b4005d30 comp rx=0 tx=0).stop 2024-09-10T10:13:44.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.247+0000 7fb8cd013740 1 -- 172.21.15.50:0/772909433 shutdown_connections 2024-09-10T10:13:44.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.247+0000 7fb8cd013740 1 --2- 172.21.15.50:0/772909433 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5631cf098140 0x5631cf09a600 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.247+0000 7fb8cd013740 1 --2- 172.21.15.50:0/772909433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf087e50 0x5631cf0856e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.247+0000 7fb8cd013740 1 --2- 172.21.15.50:0/772909433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07d590 0x5631cf0851a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.247+0000 7fb8cd013740 1 --2- 172.21.15.50:0/772909433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07cc70 0x5631cf084c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.247+0000 7fb8cd013740 1 -- 172.21.15.50:0/772909433 >> 172.21.15.50:0/772909433 conn(0x5631cf079200 msgr2=0x5631cf078380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:44.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.247+0000 7fb8ad600640 0 client.25874 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:44.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.247+0000 7fb8cd013740 1 -- 172.21.15.50:0/772909433 shutdown_connections 2024-09-10T10:13:44.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.247+0000 7fb8cd013740 1 -- 172.21.15.50:0/772909433 wait complete. 2024-09-10T10:13:44.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.247+0000 7fb8cd013740 20 client.25874 trim_cache size 0 max 16384 2024-09-10T10:13:44.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.265+0000 7fb8cd013740 1 Processor -- start 2024-09-10T10:13:44.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.265+0000 7fb8cd013740 1 -- start start 2024-09-10T10:13:44.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8cd013740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07cc70 0x5631cf09ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8cd013740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf087e50 0x5631cf0a0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8cd013740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf079c50 0x5631cf0864c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8cd013740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c41af460 con 0x5631cf079c50 2024-09-10T10:13:44.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8cd013740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c41acd30 con 0x5631cf07cc70 2024-09-10T10:13:44.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8cd013740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c41021d0 con 0x5631cf087e50 2024-09-10T10:13:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8c3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf087e50 0x5631cf0a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8c2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07cc70 0x5631cf09ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8c3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf087e50 0x5631cf0a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:36972/0 (socket says 172.21.15.50:36972) 2024-09-10T10:13:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8c3400640 1 -- 172.21.15.50:0/3898682721 learned_addr learned my addr 172.21.15.50:0/3898682721 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:44.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8c2a00640 1 --2- 172.21.15.50:0/3898682721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf079c50 0x5631cf0864c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8c3400640 1 -- 172.21.15.50:0/3898682721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07cc70 msgr2=0x5631cf09ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8c3400640 1 --2- 172.21.15.50:0/3898682721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07cc70 0x5631cf09ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8c3400640 1 -- 172.21.15.50:0/3898682721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf079c50 msgr2=0x5631cf0864c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8c3400640 1 --2- 172.21.15.50:0/3898682721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf079c50 0x5631cf0864c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.266+0000 7fb8c3400640 1 -- 172.21.15.50:0/3898682721 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631cf079030 con 0x5631cf087e50 2024-09-10T10:13:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.267+0000 7fb8c3400640 1 --2- 172.21.15.50:0/3898682721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf087e50 0x5631cf0a0450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4012fd0 tx=0x7fb8b4009530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d3eee912846d0ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.267+0000 7fb8afe00640 1 -- 172.21.15.50:0/3898682721 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4029070 con 0x5631cf087e50 2024-09-10T10:13:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.267+0000 7fb8afe00640 1 -- 172.21.15.50:0/3898682721 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8b40043f0 con 0x5631cf087e50 2024-09-10T10:13:44.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.267+0000 7fb8afe00640 1 -- 172.21.15.50:0/3898682721 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b402e440 con 0x5631cf087e50 2024-09-10T10:13:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.268+0000 7fb8cd013740 1 -- 172.21.15.50:0/3898682721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf087e50 msgr2=0x5631cf0a0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.268+0000 7fb8cd013740 1 --2- 172.21.15.50:0/3898682721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf087e50 0x5631cf0a0450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4012fd0 tx=0x7fb8b4009530 comp rx=0 tx=0).stop 2024-09-10T10:13:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.268+0000 7fb8cd013740 1 -- 172.21.15.50:0/3898682721 shutdown_connections 2024-09-10T10:13:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.268+0000 7fb8cd013740 1 --2- 172.21.15.50:0/3898682721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf079c50 0x5631cf0864c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.268+0000 7fb8cd013740 1 --2- 172.21.15.50:0/3898682721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf087e50 0x5631cf0a0450 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.268+0000 7fb8cd013740 1 --2- 172.21.15.50:0/3898682721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf07cc70 0x5631cf09ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.268+0000 7fb8cd013740 1 -- 172.21.15.50:0/3898682721 >> 172.21.15.50:0/3898682721 conn(0x5631cf079200 msgr2=0x5631cf083d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:44.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.268+0000 7fb8cd013740 1 -- 172.21.15.50:0/3898682721 shutdown_connections 2024-09-10T10:13:44.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.268+0000 7fb8cd013740 1 -- 172.21.15.50:0/3898682721 wait complete. 2024-09-10T10:13:44.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.269+0000 7fb8cd013740 1 -- start start 2024-09-10T10:13:44.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.269+0000 7fb8cd013740 1 Processor -- start 2024-09-10T10:13:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.269+0000 7fb8cd013740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf079c50 0x5631cf08b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.269+0000 7fb8cd013740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07cc70 0x5631cf08b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8cd013740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf087e50 0x5631cf100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8cd013740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c4073eb0 con 0x5631cf079c50 2024-09-10T10:13:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8cd013740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c41ac660 con 0x5631cf087e50 2024-09-10T10:13:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8cd013740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c41ab8c0 con 0x5631cf07cc70 2024-09-10T10:13:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8cd013740 10 client.0 _ll_register_callbacks cb 0x7fb8bc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8c2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf079c50 0x5631cf08b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8c3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07cc70 0x5631cf08b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8c2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf079c50 0x5631cf08b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51604/0 (socket says 172.21.15.50:51604) 2024-09-10T10:13:44.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8c3400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07cc70 0x5631cf08b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:36984/0 (socket says 172.21.15.50:36984) 2024-09-10T10:13:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8c2a00640 1 -- 172.21.15.50:0/2728588154 learned_addr learned my addr 172.21.15.50:0/2728588154 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8c2a00640 1 --2- 172.21.15.50:0/2728588154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf087e50 0x5631cf100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8c3400640 1 -- 172.21.15.50:0/2728588154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf087e50 msgr2=0x5631cf100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8c3400640 1 --2- 172.21.15.50:0/2728588154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf087e50 0x5631cf100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8c3400640 1 -- 172.21.15.50:0/2728588154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf079c50 msgr2=0x5631cf08b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8c3400640 1 --2- 172.21.15.50:0/2728588154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf079c50 0x5631cf08b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8c3400640 1 -- 172.21.15.50:0/2728588154 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631cf074770 con 0x5631cf07cc70 2024-09-10T10:13:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.270+0000 7fb8c2a00640 1 --2- 172.21.15.50:0/2728588154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf079c50 0x5631cf08b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.271+0000 7fb8c3400640 1 --2- 172.21.15.50:0/2728588154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07cc70 0x5631cf08b610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4011850 tx=0x7fb8b40234c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcb0bce2fbc1915b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:44.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.271+0000 7fb8ad600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:13:44.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.271+0000 7fb8ad600640 1 -- 172.21.15.50:0/2728588154 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4029040 con 0x5631cf07cc70 2024-09-10T10:13:44.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.271+0000 7fb8cd013740 1 -- 172.21.15.50:0/2728588154 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8b40043f0 con 0x5631cf07cc70 2024-09-10T10:13:44.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.271+0000 7fb8ad600640 1 -- 172.21.15.50:0/2728588154 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb8b4003800 con 0x5631cf07cc70 2024-09-10T10:13:44.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.271+0000 7fb8ad600640 1 -- 172.21.15.50:0/2728588154 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8b4023c70 con 0x5631cf07cc70 2024-09-10T10:13:44.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.271+0000 7fb8cd013740 10 client.25849 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.271+0000 7fb8cd013740 1 -- 172.21.15.50:0/2728588154 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5631cf1023d0 con 0x5631cf07cc70 2024-09-10T10:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.271+0000 7fb8ad600640 1 -- 172.21.15.50:0/2728588154 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8b40043f0 con 0x5631cf07cc70 2024-09-10T10:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.272+0000 7fb8ad600640 1 -- 172.21.15.50:0/2728588154 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb8b4040020 con 0x5631cf07cc70 2024-09-10T10:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.272+0000 7fb8cd013740 10 client.25849 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.272+0000 7fb8cd013740 10 client.25849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.272+0000 7fb8cd013740 20 client.25849 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.272+0000 7fb8cd013740 1 --2- 172.21.15.50:0/2728588154 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5631cf102b10 0x5631cf104f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.272+0000 7fb8cd013740 4 client.25849 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.272+0000 7fb8cd013740 1 -- 172.21.15.50:0/2728588154 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631cefeae60 con 0x5631cf102b10 2024-09-10T10:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.272+0000 7fb8c2a00640 1 --2- 172.21.15.50:0/2728588154 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5631cf102b10 0x5631cf104f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.272+0000 7fb8c2a00640 1 --2- 172.21.15.50:0/2728588154 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5631cf102b10 0x5631cf104f30 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c0b1c506ab517d7 server_cookie=6edb9074e6655ac7 in_seq=0 out_seq=0 2024-09-10T10:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.272+0000 7fb8ad600640 10 client.25849 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:44.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8ad600640 1 -- 172.21.15.50:0/2728588154 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631cefeae60 con 0x5631cf102b10 2024-09-10T10:13:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8ad600640 10 client.25849 handle_command_reply: tid=0 2024-09-10T10:13:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8cd013740 1 client.25849 shutdown 2024-09-10T10:13:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8cd013740 1 -- 172.21.15.50:0/2728588154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07cc70 msgr2=0x5631cf08b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8cd013740 1 --2- 172.21.15.50:0/2728588154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07cc70 0x5631cf08b610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4011850 tx=0x7fb8b40234c0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8cd013740 1 -- 172.21.15.50:0/2728588154 shutdown_connections 2024-09-10T10:13:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8cd013740 1 --2- 172.21.15.50:0/2728588154 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5631cf102b10 0x5631cf104f30 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8cd013740 1 --2- 172.21.15.50:0/2728588154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631cf087e50 0x5631cf100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8cd013740 1 --2- 172.21.15.50:0/2728588154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5631cf07cc70 0x5631cf08b610 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8cd013740 1 --2- 172.21.15.50:0/2728588154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631cf079c50 0x5631cf08b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8cd013740 1 -- 172.21.15.50:0/2728588154 >> 172.21.15.50:0/2728588154 conn(0x5631cf079200 msgr2=0x5631cf084c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8ad600640 0 client.25849 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8cd013740 1 -- 172.21.15.50:0/2728588154 shutdown_connections 2024-09-10T10:13:44.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8cd013740 1 -- 172.21.15.50:0/2728588154 wait complete. 2024-09-10T10:13:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.273+0000 7fb8cd013740 20 client.25849 trim_cache size 0 max 16384 2024-09-10T10:13:44.278 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:13:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.274+0000 7fb8ca600640 1 -- 172.21.15.50:0/729690277 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb8a80a2b80 msgr2=0x7fb8a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.274+0000 7fb8ca600640 1 --2- 172.21.15.50:0/729690277 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb8a80a2b80 0x7fb8a80a5040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc098780 tx=0x7fb8bc005940 comp rx=0 tx=0).stop 2024-09-10T10:13:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.274+0000 7fb8ca600640 1 -- 172.21.15.50:0/729690277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c4106f20 msgr2=0x7fb8c410dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.274+0000 7fb8ca600640 1 --2- 172.21.15.50:0/729690277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c4106f20 0x7fb8c410dcc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009fd0 tx=0x7fb8bc00ef10 comp rx=0 tx=0).stop 2024-09-10T10:13:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.274+0000 7fb8ca600640 1 -- 172.21.15.50:0/729690277 shutdown_connections 2024-09-10T10:13:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.274+0000 7fb8ca600640 1 --2- 172.21.15.50:0/729690277 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb8a80a2b80 0x7fb8a80a5040 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.274+0000 7fb8ca600640 1 --2- 172.21.15.50:0/729690277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c4106f20 0x7fb8c410dcc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.274+0000 7fb8ca600640 1 --2- 172.21.15.50:0/729690277 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8c41027a0 0x7fb8c41a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.274+0000 7fb8ca600640 1 --2- 172.21.15.50:0/729690277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8c4101df0 0x7fb8c41a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.274+0000 7fb8ca600640 1 -- 172.21.15.50:0/729690277 >> 172.21.15.50:0/729690277 conn(0x7fb8c40fd8b0 msgr2=0x7fb8c40ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.275+0000 7fb8ca600640 1 -- 172.21.15.50:0/729690277 shutdown_connections 2024-09-10T10:13:44.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:44.275+0000 7fb8ca600640 1 -- 172.21.15.50:0/729690277 wait complete. 2024-09-10T10:13:44.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:44 smithi050 ceph-mon[30354]: pgmap v467: 129 pgs: 129 active+clean; 413 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 23 op/s 2024-09-10T10:13:44.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:13:44.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:13:44.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:44 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:13:45.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:44 smithi189 ceph-mon[34999]: pgmap v467: 129 pgs: 129 active+clean; 413 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 23 op/s 2024-09-10T10:13:45.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:13:45.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:13:45.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:44 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:13:45.098 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:44 smithi084 ceph-mon[34812]: pgmap v467: 129 pgs: 129 active+clean; 413 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 23 op/s 2024-09-10T10:13:45.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:13:45.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:13:45.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:44 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:13:45.385 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:45.385 INFO:tasks.workunit.client.0.smithi050.stdout: Children see throughput for 1 initial writers = 224415.34 kB/sec 2024-09-10T10:13:45.385 INFO:tasks.workunit.client.0.smithi050.stdout: Parent sees throughput for 1 initial writers = 224388.94 kB/sec 2024-09-10T10:13:45.385 INFO:tasks.workunit.client.0.smithi050.stdout: Min throughput per process = 224415.34 kB/sec 2024-09-10T10:13:45.386 INFO:tasks.workunit.client.0.smithi050.stdout: Max throughput per process = 224415.34 kB/sec 2024-09-10T10:13:45.386 INFO:tasks.workunit.client.0.smithi050.stdout: Avg throughput per process = 224415.34 kB/sec 2024-09-10T10:13:45.386 INFO:tasks.workunit.client.0.smithi050.stdout: Min xfer = 1048576.00 kB 2024-09-10T10:13:46.145 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T10:13:46.145 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T10:13:46.534 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:46.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:46 smithi050 ceph-mon[30354]: pgmap v468: 129 pgs: 129 active+clean; 181 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 15 MiB/s wr, 32 op/s 2024-09-10T10:13:47.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:46 smithi189 ceph-mon[34999]: pgmap v468: 129 pgs: 129 active+clean; 181 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 15 MiB/s wr, 32 op/s 2024-09-10T10:13:47.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:46 smithi084 ceph-mon[34812]: pgmap v468: 129 pgs: 129 active+clean; 181 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 15 MiB/s wr, 32 op/s 2024-09-10T10:13:47.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.114+0000 7f7760c00640 1 -- 172.21.15.50:0/1112227485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775c103e30 msgr2=0x7f775c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:47.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.114+0000 7f7760c00640 1 --2- 172.21.15.50:0/1112227485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775c103e30 0x7f775c104210 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f774c009900 tx=0x7f774c02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.114+0000 7f7760c00640 1 -- 172.21.15.50:0/1112227485 shutdown_connections 2024-09-10T10:13:47.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.114+0000 7f7760c00640 1 --2- 172.21.15.50:0/1112227485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c108f60 0x7f775c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.114+0000 7f7760c00640 1 --2- 172.21.15.50:0/1112227485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f775c1047e0 0x7f775c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.114+0000 7f7760c00640 1 --2- 172.21.15.50:0/1112227485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775c103e30 0x7f775c104210 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.114+0000 7f7760c00640 1 -- 172.21.15.50:0/1112227485 >> 172.21.15.50:0/1112227485 conn(0x7f775c0ff8d0 msgr2=0x7f775c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:47.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.114+0000 7f7760c00640 1 -- 172.21.15.50:0/1112227485 shutdown_connections 2024-09-10T10:13:47.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.114+0000 7f7760c00640 1 -- 172.21.15.50:0/1112227485 wait complete. 2024-09-10T10:13:47.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.115+0000 7f7760c00640 1 Processor -- start 2024-09-10T10:13:47.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.115+0000 7f7760c00640 1 -- start start 2024-09-10T10:13:47.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.115+0000 7f7760c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775c103e30 0x7f775c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.115+0000 7f7760c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f775c1047e0 0x7f775c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.115+0000 7f7760c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c108f60 0x7f775c19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.115+0000 7f7760c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f775c114010 con 0x7f775c103e30 2024-09-10T10:13:47.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.115+0000 7f7760c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f775c113e90 con 0x7f775c108f60 2024-09-10T10:13:47.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.115+0000 7f7760c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f775c114190 con 0x7f775c1047e0 2024-09-10T10:13:47.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.116+0000 7f775b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775c103e30 0x7f775c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.116+0000 7f775be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c108f60 0x7f775c19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.116+0000 7f775be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c108f60 0x7f775c19edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50012/0 (socket says 172.21.15.50:50012) 2024-09-10T10:13:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.116+0000 7f775be00640 1 -- 172.21.15.50:0/863269464 learned_addr learned my addr 172.21.15.50:0/863269464 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.116+0000 7f7753e00640 1 --2- 172.21.15.50:0/863269464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f775c1047e0 0x7f775c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.116+0000 7f775be00640 1 -- 172.21.15.50:0/863269464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f775c1047e0 msgr2=0x7f775c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.116+0000 7f775be00640 1 --2- 172.21.15.50:0/863269464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f775c1047e0 0x7f775c19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.116+0000 7f775be00640 1 -- 172.21.15.50:0/863269464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775c103e30 msgr2=0x7f775c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.116+0000 7f775be00640 1 --2- 172.21.15.50:0/863269464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775c103e30 0x7f775c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.116+0000 7f775be00640 1 -- 172.21.15.50:0/863269464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c19f490 con 0x7f775c108f60 2024-09-10T10:13:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.117+0000 7f775be00640 1 --2- 172.21.15.50:0/863269464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c108f60 0x7f775c19edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7754009fd0 tx=0x7f775400b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.117+0000 7f7758c00640 1 -- 172.21.15.50:0/863269464 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754017070 con 0x7f775c108f60 2024-09-10T10:13:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.117+0000 7f7758c00640 1 -- 172.21.15.50:0/863269464 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7754003e50 con 0x7f775c108f60 2024-09-10T10:13:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.117+0000 7f7760c00640 1 -- 172.21.15.50:0/863269464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c19f780 con 0x7f775c108f60 2024-09-10T10:13:47.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.117+0000 7f7758c00640 1 -- 172.21.15.50:0/863269464 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77540106c0 con 0x7f775c108f60 2024-09-10T10:13:47.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.117+0000 7f7760c00640 1 -- 172.21.15.50:0/863269464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c1a7060 con 0x7f775c108f60 2024-09-10T10:13:47.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.120+0000 7f7764e14740 1 Processor -- start 2024-09-10T10:13:47.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.120+0000 7f7758c00640 1 -- 172.21.15.50:0/863269464 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7754003970 con 0x7f775c108f60 2024-09-10T10:13:47.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.120+0000 7f7764e14740 1 -- start start 2024-09-10T10:13:47.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f7764e14740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50bcb0 0x55e30e50c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f7764e14740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50c5d0 0x55e30e516950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f7764e14740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e516e90 0x55e30e519280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f7764e14740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e30e472290 con 0x55e30e50c5d0 2024-09-10T10:13:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f7764e14740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e30e419b40 con 0x55e30e516e90 2024-09-10T10:13:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f7764e14740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e30e46e250 con 0x55e30e50bcb0 2024-09-10T10:13:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f775b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50c5d0 0x55e30e516950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f7753e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50bcb0 0x55e30e50c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f775b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50c5d0 0x55e30e516950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48110/0 (socket says 172.21.15.50:48110) 2024-09-10T10:13:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f775b400640 1 -- 172.21.15.50:0/2275280893 learned_addr learned my addr 172.21.15.50:0/2275280893 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f7753e00640 1 --2- 172.21.15.50:0/2275280893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e516e90 0x55e30e519280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f775b400640 1 -- 172.21.15.50:0/2275280893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50bcb0 msgr2=0x55e30e50c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f775b400640 1 --2- 172.21.15.50:0/2275280893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50bcb0 0x55e30e50c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f775b400640 1 -- 172.21.15.50:0/2275280893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e516e90 msgr2=0x55e30e519280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:47.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f775b400640 1 --2- 172.21.15.50:0/2275280893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e516e90 0x55e30e519280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.121+0000 7f775b400640 1 -- 172.21.15.50:0/2275280893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e30e1e36a0 con 0x55e30e50c5d0 2024-09-10T10:13:47.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.122+0000 7f775b400640 1 --2- 172.21.15.50:0/2275280893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50c5d0 0x55e30e516950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f774c009900 tx=0x7f774c0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455bc3420174921 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:47.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.122+0000 7f7758c00640 1 --2- 172.21.15.50:0/863269464 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f77400a2b80 0x7f77400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.122+0000 7f7758c00640 1 -- 172.21.15.50:0/863269464 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f77540cf0f0 con 0x7f775c108f60 2024-09-10T10:13:47.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.122+0000 7f7753e00640 1 --2- 172.21.15.50:0/863269464 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f77400a2b80 0x7f77400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.122+0000 7f774be00640 1 -- 172.21.15.50:0/2275280893 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c035040 con 0x55e30e50c5d0 2024-09-10T10:13:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.122+0000 7f774be00640 1 -- 172.21.15.50:0/2275280893 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f774c005520 con 0x55e30e50c5d0 2024-09-10T10:13:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.122+0000 7f774be00640 1 -- 172.21.15.50:0/2275280893 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c003850 con 0x55e30e50c5d0 2024-09-10T10:13:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.123+0000 7f7764e14740 1 -- 172.21.15.50:0/2275280893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50c5d0 msgr2=0x55e30e516950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.123+0000 7f7753e00640 1 --2- 172.21.15.50:0/863269464 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f77400a2b80 0x7f77400a5040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f774400bfd0 tx=0x7f774400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.123+0000 7f7764e14740 1 --2- 172.21.15.50:0/2275280893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50c5d0 0x55e30e516950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f774c009900 tx=0x7f774c0040f0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.123+0000 7f7764e14740 1 -- 172.21.15.50:0/2275280893 shutdown_connections 2024-09-10T10:13:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.123+0000 7f7764e14740 1 --2- 172.21.15.50:0/2275280893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e516e90 0x55e30e519280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.123+0000 7f7764e14740 1 --2- 172.21.15.50:0/2275280893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50c5d0 0x55e30e516950 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.123+0000 7f7764e14740 1 --2- 172.21.15.50:0/2275280893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50bcb0 0x55e30e50c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.123+0000 7f7764e14740 1 -- 172.21.15.50:0/2275280893 >> 172.21.15.50:0/2275280893 conn(0x55e30e508240 msgr2=0x55e30e508620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.123+0000 7f7764e14740 1 -- 172.21.15.50:0/2275280893 shutdown_connections 2024-09-10T10:13:47.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.123+0000 7f7764e14740 1 -- 172.21.15.50:0/2275280893 wait complete. 2024-09-10T10:13:47.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.124+0000 7f7764e14740 1 -- start start 2024-09-10T10:13:47.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.124+0000 7f7764e14740 1 Processor -- start 2024-09-10T10:13:47.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f7764e14740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50bcb0 0x55e30e516730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f7764e14740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e50c5d0 0x55e30e5139e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f7764e14740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e516e90 0x55e30e513f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f7764e14740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e30e519b00 con 0x55e30e516e90 2024-09-10T10:13:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f7764e14740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e30e42cfa0 con 0x55e30e50c5d0 2024-09-10T10:13:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f7764e14740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e30e519c80 con 0x55e30e50bcb0 2024-09-10T10:13:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f7764e14740 10 client.0 _ll_register_callbacks cb 0x55e30e180ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f7753e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e50c5d0 0x55e30e5139e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f775b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50bcb0 0x55e30e516730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f7753e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e50c5d0 0x55e30e5139e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50026/0 (socket says 172.21.15.50:50026) 2024-09-10T10:13:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f775be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e516e90 0x55e30e513f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f7753e00640 1 -- 172.21.15.50:0/4091789769 learned_addr learned my addr 172.21.15.50:0/4091789769 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f775b400640 1 -- 172.21.15.50:0/4091789769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e50c5d0 msgr2=0x55e30e5139e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f775b400640 1 --2- 172.21.15.50:0/4091789769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e50c5d0 0x55e30e5139e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f775b400640 1 -- 172.21.15.50:0/4091789769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e516e90 msgr2=0x55e30e513f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f775b400640 1 --2- 172.21.15.50:0/4091789769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e516e90 0x55e30e513f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.125+0000 7f775b400640 1 -- 172.21.15.50:0/4091789769 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e30e514720 con 0x55e30e50bcb0 2024-09-10T10:13:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.126+0000 7f775b400640 1 --2- 172.21.15.50:0/4091789769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50bcb0 0x55e30e516730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f774c02a910 tx=0x7f774c004bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=919670bf1130b517 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.126+0000 7f7748c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:13:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.126+0000 7f7748c00640 1 -- 172.21.15.50:0/4091789769 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c035050 con 0x55e30e50bcb0 2024-09-10T10:13:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.126+0000 7f7764e14740 1 -- 172.21.15.50:0/4091789769 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f774c005520 con 0x55e30e50bcb0 2024-09-10T10:13:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.126+0000 7f7748c00640 1 -- 172.21.15.50:0/4091789769 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f774c0048d0 con 0x55e30e50bcb0 2024-09-10T10:13:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.126+0000 7f7748c00640 1 -- 172.21.15.50:0/4091789769 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f774c004df0 con 0x55e30e50bcb0 2024-09-10T10:13:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.126+0000 7f7764e14740 10 client.25861 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.126+0000 7f7764e14740 1 -- 172.21.15.50:0/4091789769 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e30e519b00 con 0x55e30e50bcb0 2024-09-10T10:13:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.127+0000 7f7748c00640 1 -- 172.21.15.50:0/4091789769 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f774c005520 con 0x55e30e50bcb0 2024-09-10T10:13:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.127+0000 7f7748c00640 1 -- 172.21.15.50:0/4091789769 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f774c031cb0 con 0x55e30e50bcb0 2024-09-10T10:13:47.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.127+0000 7f7764e14740 10 client.25861 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.127+0000 7f7764e14740 10 client.25861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.127+0000 7f7764e14740 20 client.25861 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.127+0000 7f7764e14740 1 --2- 172.21.15.50:0/4091789769 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e30e526b00 0x55e30e528ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.127+0000 7f7764e14740 4 client.25861 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.127+0000 7f7764e14740 1 -- 172.21.15.50:0/4091789769 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e30e47f800 con 0x55e30e526b00 2024-09-10T10:13:47.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.127+0000 7f7753e00640 1 --2- 172.21.15.50:0/4091789769 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e30e526b00 0x55e30e528ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.128+0000 7f7753e00640 1 --2- 172.21.15.50:0/4091789769 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e30e526b00 0x55e30e528ef0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c38339932a683687 server_cookie=a65dff3c30ca332f in_seq=0 out_seq=0 2024-09-10T10:13:47.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.128+0000 7f7748c00640 10 client.25861 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:47.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7748c00640 1 -- 172.21.15.50:0/4091789769 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e30e47f800 con 0x55e30e526b00 2024-09-10T10:13:47.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7748c00640 10 client.25861 handle_command_reply: tid=0 2024-09-10T10:13:47.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7764e14740 1 client.25861 shutdown 2024-09-10T10:13:47.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7764e14740 1 -- 172.21.15.50:0/4091789769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50bcb0 msgr2=0x55e30e516730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7764e14740 1 --2- 172.21.15.50:0/4091789769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50bcb0 0x55e30e516730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f774c02a910 tx=0x7f774c004bd0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7764e14740 1 -- 172.21.15.50:0/4091789769 shutdown_connections 2024-09-10T10:13:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7764e14740 1 --2- 172.21.15.50:0/4091789769 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e30e526b00 0x55e30e528ef0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7764e14740 1 --2- 172.21.15.50:0/4091789769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e516e90 0x55e30e513f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7764e14740 1 --2- 172.21.15.50:0/4091789769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e50c5d0 0x55e30e5139e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7748c00640 0 client.25861 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7764e14740 1 --2- 172.21.15.50:0/4091789769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50bcb0 0x55e30e516730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7764e14740 1 -- 172.21.15.50:0/4091789769 >> 172.21.15.50:0/4091789769 conn(0x55e30e508240 msgr2=0x55e30e50df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7764e14740 1 -- 172.21.15.50:0/4091789769 shutdown_connections 2024-09-10T10:13:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7764e14740 1 -- 172.21.15.50:0/4091789769 wait complete. 2024-09-10T10:13:47.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.129+0000 7f7764e14740 20 client.25861 trim_cache size 0 max 16384 2024-09-10T10:13:47.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.147+0000 7f7764e14740 1 Processor -- start 2024-09-10T10:13:47.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.148+0000 7f7764e14740 1 -- start start 2024-09-10T10:13:47.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.148+0000 7f7764e14740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50bcb0 0x55e30e512890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.148+0000 7f7764e14740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50c5d0 0x55e30e52e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.148+0000 7f7764e14740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e516e90 0x55e30e52ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.148+0000 7f7764e14740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1b3600 con 0x55e30e50bcb0 2024-09-10T10:13:47.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.148+0000 7f7764e14740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1b0ed0 con 0x55e30e516e90 2024-09-10T10:13:47.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.148+0000 7f7764e14740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1aed20 con 0x55e30e50c5d0 2024-09-10T10:13:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.148+0000 7f775b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50bcb0 0x55e30e512890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.148+0000 7f775b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50bcb0 0x55e30e512890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48140/0 (socket says 172.21.15.50:48140) 2024-09-10T10:13:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.148+0000 7f775b400640 1 -- 172.21.15.50:0/3682382562 learned_addr learned my addr 172.21.15.50:0/3682382562 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.148+0000 7f7753e00640 1 --2- 172.21.15.50:0/3682382562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50c5d0 0x55e30e52e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.149+0000 7f775be00640 1 --2- 172.21.15.50:0/3682382562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e516e90 0x55e30e52ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.149+0000 7f775b400640 1 -- 172.21.15.50:0/3682382562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50c5d0 msgr2=0x55e30e52e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.149+0000 7f775b400640 1 --2- 172.21.15.50:0/3682382562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50c5d0 0x55e30e52e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.149+0000 7f775b400640 1 -- 172.21.15.50:0/3682382562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e516e90 msgr2=0x55e30e52ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.149+0000 7f775b400640 1 --2- 172.21.15.50:0/3682382562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e516e90 0x55e30e52ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.149+0000 7f775b400640 1 -- 172.21.15.50:0/3682382562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e30e50cb40 con 0x55e30e50bcb0 2024-09-10T10:13:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.149+0000 7f7753e00640 1 --2- 172.21.15.50:0/3682382562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50c5d0 0x55e30e52e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:13:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.149+0000 7f775be00640 1 --2- 172.21.15.50:0/3682382562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e516e90 0x55e30e52ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:13:47.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.149+0000 7f775b400640 1 --2- 172.21.15.50:0/3682382562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50bcb0 0x55e30e512890 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f774c004ae0 tx=0x7f774c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fd6d82964c1770 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.149+0000 7f774b400640 1 -- 172.21.15.50:0/3682382562 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c035040 con 0x55e30e50bcb0 2024-09-10T10:13:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.149+0000 7f774b400640 1 -- 172.21.15.50:0/3682382562 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f774c0037b0 con 0x55e30e50bcb0 2024-09-10T10:13:47.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.149+0000 7f774b400640 1 -- 172.21.15.50:0/3682382562 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c0055a0 con 0x55e30e50bcb0 2024-09-10T10:13:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.150+0000 7f7764e14740 1 -- 172.21.15.50:0/3682382562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50bcb0 msgr2=0x55e30e512890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.150+0000 7f7764e14740 1 --2- 172.21.15.50:0/3682382562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50bcb0 0x55e30e512890 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f774c004ae0 tx=0x7f774c005fd0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.150+0000 7f7764e14740 1 -- 172.21.15.50:0/3682382562 shutdown_connections 2024-09-10T10:13:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.150+0000 7f7764e14740 1 --2- 172.21.15.50:0/3682382562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e516e90 0x55e30e52ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.150+0000 7f7764e14740 1 --2- 172.21.15.50:0/3682382562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50c5d0 0x55e30e52e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.150+0000 7f7764e14740 1 --2- 172.21.15.50:0/3682382562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e50bcb0 0x55e30e512890 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.150+0000 7f7764e14740 1 -- 172.21.15.50:0/3682382562 >> 172.21.15.50:0/3682382562 conn(0x55e30e508240 msgr2=0x55e30e512180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.150+0000 7f7764e14740 1 -- 172.21.15.50:0/3682382562 shutdown_connections 2024-09-10T10:13:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.150+0000 7f7764e14740 1 -- 172.21.15.50:0/3682382562 wait complete. 2024-09-10T10:13:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.150+0000 7f7764e14740 1 -- start start 2024-09-10T10:13:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.151+0000 7f7764e14740 1 Processor -- start 2024-09-10T10:13:47.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.151+0000 7f7764e14740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e50bcb0 0x55e30e51cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.151+0000 7f7764e14740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50c5d0 0x55e30e51d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.151+0000 7f7764e14740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e516e90 0x55e30e51d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.151+0000 7f7764e14740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1af390 con 0x55e30e516e90 2024-09-10T10:13:47.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.151+0000 7f7764e14740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1b0800 con 0x55e30e50bcb0 2024-09-10T10:13:47.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.151+0000 7f7764e14740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1afa60 con 0x55e30e50c5d0 2024-09-10T10:13:47.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.151+0000 7f7764e14740 10 client.0 _ll_register_callbacks cb 0x7f774400be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:47.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.151+0000 7f775be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e516e90 0x55e30e51d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f775b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e50bcb0 0x55e30e51cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f775be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e516e90 0x55e30e51d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48152/0 (socket says 172.21.15.50:48152) 2024-09-10T10:13:47.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f775be00640 1 -- 172.21.15.50:0/3638205110 learned_addr learned my addr 172.21.15.50:0/3638205110 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:47.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f7753e00640 1 --2- 172.21.15.50:0/3638205110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50c5d0 0x55e30e51d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f775be00640 1 -- 172.21.15.50:0/3638205110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50c5d0 msgr2=0x55e30e51d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f775be00640 1 --2- 172.21.15.50:0/3638205110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50c5d0 0x55e30e51d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f775be00640 1 -- 172.21.15.50:0/3638205110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e50bcb0 msgr2=0x55e30e51cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f775be00640 1 --2- 172.21.15.50:0/3638205110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e50bcb0 0x55e30e51cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f775be00640 1 -- 172.21.15.50:0/3638205110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e30e5906c0 con 0x55e30e516e90 2024-09-10T10:13:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f775b400640 1 --2- 172.21.15.50:0/3638205110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e50bcb0 0x55e30e51cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f775be00640 1 --2- 172.21.15.50:0/3638205110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e516e90 0x55e30e51d6f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f775400b760 tx=0x7f775409b210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1ec5f5163236f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f7748c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:13:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f7748c00640 1 -- 172.21.15.50:0/3638205110 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77540b3070 con 0x55e30e516e90 2024-09-10T10:13:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f7748c00640 1 -- 172.21.15.50:0/3638205110 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f7754097c80 con 0x55e30e516e90 2024-09-10T10:13:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.152+0000 7f7764e14740 1 -- 172.21.15.50:0/3638205110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f774c0037b0 con 0x55e30e516e90 2024-09-10T10:13:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.153+0000 7f7748c00640 1 -- 172.21.15.50:0/3638205110 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7754020040 con 0x55e30e516e90 2024-09-10T10:13:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.153+0000 7f7764e14740 10 client.15846 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:47.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.153+0000 7f7764e14740 1 -- 172.21.15.50:0/3638205110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e30e591a20 con 0x55e30e516e90 2024-09-10T10:13:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.153+0000 7f7748c00640 1 -- 172.21.15.50:0/3638205110 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f774c0037b0 con 0x55e30e516e90 2024-09-10T10:13:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.153+0000 7f7748c00640 1 -- 172.21.15.50:0/3638205110 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7754084ba0 con 0x55e30e516e90 2024-09-10T10:13:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.153+0000 7f7764e14740 10 client.15846 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.153+0000 7f7764e14740 10 client.15846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.153+0000 7f7764e14740 20 client.15846 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.153+0000 7f7764e14740 1 --2- 172.21.15.50:0/3638205110 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e30e592190 0x55e30e594580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.153+0000 7f7764e14740 4 client.15846 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T10:13:47.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.153+0000 7f7764e14740 1 -- 172.21.15.50:0/3638205110 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e30e479d10 con 0x55e30e592190 2024-09-10T10:13:47.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.154+0000 7f775b400640 1 --2- 172.21.15.50:0/3638205110 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e30e592190 0x55e30e594580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:47.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.154+0000 7f775b400640 1 --2- 172.21.15.50:0/3638205110 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e30e592190 0x55e30e594580 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e835e70eb4d4f604 server_cookie=a1a197b7695b32e1 in_seq=0 out_seq=0 2024-09-10T10:13:47.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.154+0000 7f7748c00640 10 client.15846 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:47.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.155+0000 7f7748c00640 1 -- 172.21.15.50:0/3638205110 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e30e479d10 con 0x55e30e592190 2024-09-10T10:13:47.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.155+0000 7f7748c00640 10 client.15846 handle_command_reply: tid=0 2024-09-10T10:13:47.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.155+0000 7f7764e14740 1 client.15846 shutdown 2024-09-10T10:13:47.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.155+0000 7f7764e14740 1 -- 172.21.15.50:0/3638205110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e516e90 msgr2=0x55e30e51d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.155+0000 7f7764e14740 1 --2- 172.21.15.50:0/3638205110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e516e90 0x55e30e51d6f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f775400b760 tx=0x7f775409b210 comp rx=0 tx=0).stop 2024-09-10T10:13:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.155+0000 7f7764e14740 1 -- 172.21.15.50:0/3638205110 shutdown_connections 2024-09-10T10:13:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.155+0000 7f7764e14740 1 --2- 172.21.15.50:0/3638205110 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e30e592190 0x55e30e594580 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.155+0000 7f7764e14740 1 --2- 172.21.15.50:0/3638205110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e30e516e90 0x55e30e51d6f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.155+0000 7f7764e14740 1 --2- 172.21.15.50:0/3638205110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e30e50c5d0 0x55e30e51d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.156+0000 7f7748c00640 0 client.15846 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.155+0000 7f7764e14740 1 --2- 172.21.15.50:0/3638205110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e30e50bcb0 0x55e30e51cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.156+0000 7f7764e14740 1 -- 172.21.15.50:0/3638205110 >> 172.21.15.50:0/3638205110 conn(0x55e30e508240 msgr2=0x55e30e515a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.156+0000 7f7764e14740 1 -- 172.21.15.50:0/3638205110 shutdown_connections 2024-09-10T10:13:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.156+0000 7f7764e14740 1 -- 172.21.15.50:0/3638205110 wait complete. 2024-09-10T10:13:47.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.156+0000 7f7764e14740 20 client.15846 trim_cache size 0 max 16384 2024-09-10T10:13:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:13:47.161 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-10T10:13:47.161 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "f33014ce-6f99-43cd-9e29-18e70bdbd248", 2024-09-10T10:13:47.161 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-10T10:13:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:13:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.156+0000 7f7760c00640 1 -- 172.21.15.50:0/863269464 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f77400a2b80 msgr2=0x7f77400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.156+0000 7f7760c00640 1 --2- 172.21.15.50:0/863269464 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f77400a2b80 0x7f77400a5040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f774400bfd0 tx=0x7f774400b390 comp rx=0 tx=0).stop 2024-09-10T10:13:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.156+0000 7f7760c00640 1 -- 172.21.15.50:0/863269464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c108f60 msgr2=0x7f775c19edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.156+0000 7f7760c00640 1 --2- 172.21.15.50:0/863269464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c108f60 0x7f775c19edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7754009fd0 tx=0x7f775400b260 comp rx=0 tx=0).stop 2024-09-10T10:13:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.157+0000 7f7760c00640 1 -- 172.21.15.50:0/863269464 shutdown_connections 2024-09-10T10:13:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.157+0000 7f7760c00640 1 --2- 172.21.15.50:0/863269464 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f77400a2b80 0x7f77400a5040 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.157+0000 7f7760c00640 1 --2- 172.21.15.50:0/863269464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f775c108f60 0x7f775c19edb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.157+0000 7f7760c00640 1 --2- 172.21.15.50:0/863269464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f775c1047e0 0x7f775c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.157+0000 7f7760c00640 1 --2- 172.21.15.50:0/863269464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f775c103e30 0x7f775c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:47.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.157+0000 7f7760c00640 1 -- 172.21.15.50:0/863269464 >> 172.21.15.50:0/863269464 conn(0x7f775c0ff8d0 msgr2=0x7f775c100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:47.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.157+0000 7f7760c00640 1 -- 172.21.15.50:0/863269464 shutdown_connections 2024-09-10T10:13:47.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:47.157+0000 7f7760c00640 1 -- 172.21.15.50:0/863269464 wait complete. 2024-09-10T10:13:47.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:47 smithi050 ceph-mon[30354]: scrub queued for path: / 2024-09-10T10:13:47.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:47 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:47.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:47 smithi050 ceph-mon[30354]: scrub summary: active paths [/] 2024-09-10T10:13:47.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:47 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:48.065 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:13:48.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:47 smithi189 ceph-mon[34999]: scrub queued for path: / 2024-09-10T10:13:48.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:47 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:48.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:47 smithi189 ceph-mon[34999]: scrub summary: active paths [/] 2024-09-10T10:13:48.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:47 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:48.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:47 smithi084 ceph-mon[34812]: scrub queued for path: / 2024-09-10T10:13:48.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:47 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:48.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:47 smithi084 ceph-mon[34812]: scrub summary: active paths [/] 2024-09-10T10:13:48.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:47 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:13:48.689 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:49.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:48 smithi189 ceph-mon[34999]: pgmap v469: 129 pgs: 129 active+clean; 453 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 38 MiB/s wr, 40 op/s 2024-09-10T10:13:49.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:48 smithi189 ceph-mon[34999]: scrub summary: idle 2024-09-10T10:13:49.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:48 smithi084 ceph-mon[34812]: pgmap v469: 129 pgs: 129 active+clean; 453 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 38 MiB/s wr, 40 op/s 2024-09-10T10:13:49.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:48 smithi084 ceph-mon[34812]: scrub summary: idle 2024-09-10T10:13:49.137 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:48 smithi050 ceph-mon[30354]: pgmap v469: 129 pgs: 129 active+clean; 453 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 38 MiB/s wr, 40 op/s 2024-09-10T10:13:49.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:48 smithi050 ceph-mon[30354]: scrub summary: idle 2024-09-10T10:13:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.593+0000 7f7fa4a00640 1 -- 172.21.15.50:0/3675020279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa0077040 msgr2=0x7f7fa0112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.593+0000 7f7fa4a00640 1 --2- 172.21.15.50:0/3675020279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa0077040 0x7f7fa0112330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009900 tx=0x7f7f8c02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.594+0000 7f7fa4a00640 1 -- 172.21.15.50:0/3675020279 shutdown_connections 2024-09-10T10:13:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.594+0000 7f7fa4a00640 1 --2- 172.21.15.50:0/3675020279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fa0112870 0x7f7fa0114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.594+0000 7f7fa4a00640 1 --2- 172.21.15.50:0/3675020279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa0077040 0x7f7fa0112330 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.594+0000 7f7fa4a00640 1 --2- 172.21.15.50:0/3675020279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fa0076720 0x7f7fa0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.594+0000 7f7fa4a00640 1 -- 172.21.15.50:0/3675020279 >> 172.21.15.50:0/3675020279 conn(0x7f7fa00ff910 msgr2=0x7f7fa0101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.596+0000 7f7fa4a00640 1 -- 172.21.15.50:0/3675020279 shutdown_connections 2024-09-10T10:13:49.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.596+0000 7f7fa4a00640 1 -- 172.21.15.50:0/3675020279 wait complete. 2024-09-10T10:13:49.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.597+0000 7f7fa4a00640 1 Processor -- start 2024-09-10T10:13:49.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.597+0000 7f7fa4a00640 1 -- start start 2024-09-10T10:13:49.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.598+0000 7f7fa4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fa0076720 0x7f7fa01a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.598+0000 7f7fa4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa0077040 0x7f7fa01a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.598+0000 7f7fa4a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fa0112870 0x7f7fa019e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.598+0000 7f7fa4a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa0118430 con 0x7f7fa0077040 2024-09-10T10:13:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.598+0000 7f7fa4a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa01182b0 con 0x7f7fa0076720 2024-09-10T10:13:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.598+0000 7f7fa4a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa01185b0 con 0x7f7fa0112870 2024-09-10T10:13:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.599+0000 7f7f9fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fa0112870 0x7f7fa019e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.599+0000 7f7f9ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa0077040 0x7f7fa01a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.599+0000 7f7f9fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fa0112870 0x7f7fa019e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:36968/0 (socket says 172.21.15.50:36968) 2024-09-10T10:13:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.599+0000 7f7f9fe00640 1 -- 172.21.15.50:0/4170914308 learned_addr learned my addr 172.21.15.50:0/4170914308 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.600+0000 7f7f9ea00640 1 -- 172.21.15.50:0/4170914308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fa0112870 msgr2=0x7f7fa019e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.600+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/4170914308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fa0112870 0x7f7fa019e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.600+0000 7f7f9ea00640 1 -- 172.21.15.50:0/4170914308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fa0076720 msgr2=0x7f7fa01a4690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T10:13:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.600+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/4170914308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fa0076720 0x7f7fa01a4690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.600+0000 7f7f9ea00640 1 -- 172.21.15.50:0/4170914308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa019efd0 con 0x7f7fa0077040 2024-09-10T10:13:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.600+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/4170914308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa0077040 0x7f7fa01a4bd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c02a9e0 tx=0x7f7f8c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:49.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.602+0000 7f7f97e00640 1 -- 172.21.15.50:0/4170914308 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c03f070 con 0x7f7fa0077040 2024-09-10T10:13:49.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.602+0000 7f7f97e00640 1 -- 172.21.15.50:0/4170914308 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8c03b460 con 0x7f7fa0077040 2024-09-10T10:13:49.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.602+0000 7f7f97e00640 1 -- 172.21.15.50:0/4170914308 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c035030 con 0x7f7fa0077040 2024-09-10T10:13:49.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.602+0000 7f7fa4a00640 1 -- 172.21.15.50:0/4170914308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa019f260 con 0x7f7fa0077040 2024-09-10T10:13:49.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.603+0000 7f7fa4a00640 1 -- 172.21.15.50:0/4170914308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa01ab440 con 0x7f7fa0077040 2024-09-10T10:13:49.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.610+0000 7f7fa8c7b740 1 Processor -- start 2024-09-10T10:13:49.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.611+0000 7f7fa8c7b740 1 -- start start 2024-09-10T10:13:49.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.611+0000 7f7fa8c7b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563734624d50 0x563734625130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.611+0000 7f7fa8c7b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734625670 0x56373462f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.611+0000 7f7fa8c7b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56373462ff30 0x563734632320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.611+0000 7f7fa8c7b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56373458b3e0 con 0x563734625670 2024-09-10T10:13:49.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.612+0000 7f7fa8c7b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563734532d80 con 0x563734624d50 2024-09-10T10:13:49.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.612+0000 7f7fa8c7b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5637345873a0 con 0x56373462ff30 2024-09-10T10:13:49.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.613+0000 7f7f9fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563734624d50 0x563734625130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.613+0000 7f7f9fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563734624d50 0x563734625130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50070/0 (socket says 172.21.15.50:50070) 2024-09-10T10:13:49.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.613+0000 7f7f9fe00640 1 -- 172.21.15.50:0/1295500573 learned_addr learned my addr 172.21.15.50:0/1295500573 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:49.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.614+0000 7f7f9f400640 1 --2- 172.21.15.50:0/1295500573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734625670 0x56373462f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.615+0000 7f7f97e00640 1 -- 172.21.15.50:0/4170914308 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7f8c042070 con 0x7f7fa0077040 2024-09-10T10:13:49.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.616+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/1295500573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56373462ff30 0x563734632320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.617+0000 7f7f9ea00640 1 -- 172.21.15.50:0/1295500573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563734624d50 msgr2=0x563734625130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.617+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/1295500573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563734624d50 0x563734625130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.617+0000 7f7f9ea00640 1 -- 172.21.15.50:0/1295500573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734625670 msgr2=0x56373462f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.617+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/1295500573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734625670 0x56373462f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.617+0000 7f7f9ea00640 1 -- 172.21.15.50:0/1295500573 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563734551ae0 con 0x56373462ff30 2024-09-10T10:13:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.618+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/1295500573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56373462ff30 0x563734632320 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0ed370 tx=0x7f7f8c0f3e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c0dc0bb85bd5a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.618+0000 7f7f8be00640 1 -- 172.21.15.50:0/1295500573 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0f8e10 con 0x56373462ff30 2024-09-10T10:13:49.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.618+0000 7f7f8be00640 1 -- 172.21.15.50:0/1295500573 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8c0fa8f0 con 0x56373462ff30 2024-09-10T10:13:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.618+0000 7f7f8be00640 1 -- 172.21.15.50:0/1295500573 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c102b20 con 0x56373462ff30 2024-09-10T10:13:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.619+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/1295500573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56373462ff30 msgr2=0x563734632320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:49.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.619+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/1295500573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56373462ff30 0x563734632320 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0ed370 tx=0x7f7f8c0f3e90 comp rx=0 tx=0).stop 2024-09-10T10:13:49.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.622+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/1295500573 shutdown_connections 2024-09-10T10:13:49.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.622+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/1295500573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56373462ff30 0x563734632320 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.622+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/1295500573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734625670 0x56373462f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.622+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/1295500573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563734624d50 0x563734625130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.622+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/1295500573 >> 172.21.15.50:0/1295500573 conn(0x5637346212e0 msgr2=0x5637346216c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:49.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.623+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/1295500573 shutdown_connections 2024-09-10T10:13:49.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.623+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/1295500573 wait complete. 2024-09-10T10:13:49.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.623+0000 7f7f97e00640 1 --2- 172.21.15.50:0/4170914308 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7f840a2b50 0x7f7f840a5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.624+0000 7f7f97e00640 1 -- 172.21.15.50:0/4170914308 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f7f8c0efc30 con 0x7f7fa0077040 2024-09-10T10:13:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.624+0000 7f7fa8c7b740 1 -- start start 2024-09-10T10:13:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.624+0000 7f7fa8c7b740 1 Processor -- start 2024-09-10T10:13:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.625+0000 7f7fa8c7b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563734624d50 0x56373462cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.625+0000 7f7fa8c7b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734625670 0x56373462d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.625+0000 7f7fa8c7b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56373462ff30 0x56373462d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.625+0000 7f7fa8c7b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5637346438d0 con 0x563734625670 2024-09-10T10:13:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.625+0000 7f7fa8c7b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5637345460f0 con 0x56373462ff30 2024-09-10T10:13:49.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.625+0000 7f7fa8c7b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563734643a50 con 0x563734624d50 2024-09-10T10:13:49.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.626+0000 7f7f9f400640 1 --2- 172.21.15.50:0/4170914308 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7f840a2b50 0x7f7f840a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.626+0000 7f7f9fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56373462ff30 0x56373462d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.626+0000 7f7f9fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56373462ff30 0x56373462d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50084/0 (socket says 172.21.15.50:50084) 2024-09-10T10:13:49.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.626+0000 7f7f9fe00640 1 -- 172.21.15.50:0/664564465 learned_addr learned my addr 172.21.15.50:0/664564465 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:49.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.625+0000 7f7fa8c7b740 10 client.0 _ll_register_callbacks cb 0x5637345379e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:49.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.626+0000 7f7f9f400640 1 --2- 172.21.15.50:0/664564465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563734624d50 0x56373462cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.627+0000 7f7f9fe00640 1 -- 172.21.15.50:0/664564465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563734624d50 msgr2=0x56373462cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:49.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.627+0000 7f7f9fe00640 1 --2- 172.21.15.50:0/664564465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563734624d50 0x56373462cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.627+0000 7f7f9fe00640 1 -- 172.21.15.50:0/664564465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734625670 msgr2=0x56373462d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.627+0000 7f7f9fe00640 1 --2- 172.21.15.50:0/664564465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734625670 0x56373462d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.627+0000 7f7f9fe00640 1 -- 172.21.15.50:0/664564465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637342fc3c0 con 0x56373462ff30 2024-09-10T10:13:49.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.627+0000 7f7f9fe00640 1 --2- 172.21.15.50:0/664564465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56373462ff30 0x56373462d980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7f98012810 tx=0x7f7f98012cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d399b1c4d06baf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:49.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.627+0000 7f7f88c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.627+0000 7f7f88c00640 1 -- 172.21.15.50:0/664564465 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98010dc0 con 0x56373462ff30 2024-09-10T10:13:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.628+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/664564465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f8c0fa8f0 con 0x56373462ff30 2024-09-10T10:13:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.628+0000 7f7f88c00640 1 -- 172.21.15.50:0/664564465 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f7f9801a3e0 con 0x56373462ff30 2024-09-10T10:13:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.629+0000 7f7f88c00640 1 -- 172.21.15.50:0/664564465 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7f9801a5e0 con 0x56373462ff30 2024-09-10T10:13:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.629+0000 7f7f9f400640 1 --2- 172.21.15.50:0/4170914308 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7f840a2b50 0x7f7f840a5010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f900058c0 tx=0x7f7f9000c340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:49.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.629+0000 7f7fa8c7b740 10 client.25904 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:49.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.629+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/664564465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56373464f700 con 0x56373462ff30 2024-09-10T10:13:49.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.629+0000 7f7f88c00640 1 -- 172.21.15.50:0/664564465 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8c0fa8f0 con 0x56373462ff30 2024-09-10T10:13:49.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.631+0000 7f7f88c00640 1 -- 172.21.15.50:0/664564465 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7f98019070 con 0x56373462ff30 2024-09-10T10:13:49.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.631+0000 7f7fa8c7b740 10 client.25904 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:49.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.631+0000 7f7fa8c7b740 10 client.25904 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:49.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.631+0000 7f7fa8c7b740 20 client.25904 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:49.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.631+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/664564465 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563734650b60 0x563734652ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.632+0000 7f7fa8c7b740 4 client.25904 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:49.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.632+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/664564465 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563734598950 con 0x563734650b60 2024-09-10T10:13:49.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.632+0000 7f7f9f400640 1 --2- 172.21.15.50:0/664564465 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563734650b60 0x563734652ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.633+0000 7f7f9f400640 1 --2- 172.21.15.50:0/664564465 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563734650b60 0x563734652ff0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3db3cd3357fb6dfa server_cookie=a4b96294fb0b743a in_seq=0 out_seq=0 2024-09-10T10:13:49.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.633+0000 7f7f88c00640 10 client.25904 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:49.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.633+0000 7f7f88c00640 1 -- 172.21.15.50:0/664564465 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563734598950 con 0x563734650b60 2024-09-10T10:13:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.633+0000 7f7f88c00640 10 client.25904 handle_command_reply: tid=0 2024-09-10T10:13:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.633+0000 7f7fa8c7b740 1 client.25904 shutdown 2024-09-10T10:13:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.634+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/664564465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56373462ff30 msgr2=0x56373462d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.634+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/664564465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56373462ff30 0x56373462d980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7f98012810 tx=0x7f7f98012cd0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.634+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/664564465 shutdown_connections 2024-09-10T10:13:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.634+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/664564465 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563734650b60 0x563734652ff0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.634+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/664564465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56373462ff30 0x56373462d980 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.634+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/664564465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734625670 0x56373462d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.634+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/664564465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563734624d50 0x56373462cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.634+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/664564465 >> 172.21.15.50:0/664564465 conn(0x5637346212e0 msgr2=0x563734627010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.634+0000 7f7f88c00640 0 client.25904 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.634+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/664564465 shutdown_connections 2024-09-10T10:13:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.635+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/664564465 wait complete. 2024-09-10T10:13:49.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.635+0000 7f7fa8c7b740 20 client.25904 trim_cache size 0 max 16384 2024-09-10T10:13:49.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.686+0000 7f7fa8c7b740 1 Processor -- start 2024-09-10T10:13:49.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.686+0000 7f7fa8c7b740 1 -- start start 2024-09-10T10:13:49.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.686+0000 7f7fa8c7b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734624d50 0x56373462d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.686+0000 7f7fa8c7b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563734625670 0x5637346588c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.686+0000 7f7fa8c7b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56373462ff30 0x563734658e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.686+0000 7f7fa8c7b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa01af340 con 0x563734624d50 2024-09-10T10:13:49.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.686+0000 7f7fa8c7b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa01acc10 con 0x56373462ff30 2024-09-10T10:13:49.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.686+0000 7f7fa8c7b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa019fc90 con 0x563734625670 2024-09-10T10:13:49.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.687+0000 7f7f9ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563734625670 0x5637346588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.687+0000 7f7f9ea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563734625670 0x5637346588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:36986/0 (socket says 172.21.15.50:36986) 2024-09-10T10:13:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.687+0000 7f7f9ea00640 1 -- 172.21.15.50:0/348027539 learned_addr learned my addr 172.21.15.50:0/348027539 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.687+0000 7f7f9f400640 1 --2- 172.21.15.50:0/348027539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734624d50 0x56373462d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.687+0000 7f7f9fe00640 1 --2- 172.21.15.50:0/348027539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56373462ff30 0x563734658e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.687+0000 7f7f9ea00640 1 -- 172.21.15.50:0/348027539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56373462ff30 msgr2=0x563734658e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:49.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.687+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/348027539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56373462ff30 0x563734658e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.687+0000 7f7f9ea00640 1 -- 172.21.15.50:0/348027539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734624d50 msgr2=0x56373462d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.688+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/348027539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734624d50 0x56373462d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.688+0000 7f7f9ea00640 1 -- 172.21.15.50:0/348027539 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56373462f800 con 0x563734625670 2024-09-10T10:13:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.688+0000 7f7f9fe00640 1 --2- 172.21.15.50:0/348027539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56373462ff30 0x563734658e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:13:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.688+0000 7f7f9f400640 1 --2- 172.21.15.50:0/348027539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734624d50 0x56373462d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.688+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/348027539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563734625670 0x5637346588c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009850 tx=0x7f7f8c0f3fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc5c349c21971fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.688+0000 7f7f8b400640 1 -- 172.21.15.50:0/348027539 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0b83a0 con 0x563734625670 2024-09-10T10:13:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.688+0000 7f7f8b400640 1 -- 172.21.15.50:0/348027539 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8c0bc800 con 0x563734625670 2024-09-10T10:13:49.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.688+0000 7f7f8b400640 1 -- 172.21.15.50:0/348027539 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0bba60 con 0x563734625670 2024-09-10T10:13:49.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.689+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/348027539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563734625670 msgr2=0x5637346588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.689+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/348027539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563734625670 0x5637346588c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009850 tx=0x7f7f8c0f3fc0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.689+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/348027539 shutdown_connections 2024-09-10T10:13:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.689+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/348027539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56373462ff30 0x563734658e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.689+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/348027539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563734625670 0x5637346588c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.689+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/348027539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734624d50 0x56373462d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.689+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/348027539 >> 172.21.15.50:0/348027539 conn(0x5637346212e0 msgr2=0x5637346203a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.690+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/348027539 shutdown_connections 2024-09-10T10:13:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.690+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/348027539 wait complete. 2024-09-10T10:13:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.690+0000 7f7fa8c7b740 1 -- start start 2024-09-10T10:13:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.691+0000 7f7fa8c7b740 1 Processor -- start 2024-09-10T10:13:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.691+0000 7f7fa8c7b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734624d50 0x563734649350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.691+0000 7f7fa8c7b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563734625670 0x5637346446d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.691+0000 7f7fa8c7b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56373462ff30 0x563734644c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.691+0000 7f7fa8c7b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa0073f00 con 0x563734624d50 2024-09-10T10:13:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.691+0000 7f7fa8c7b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa01ac540 con 0x563734625670 2024-09-10T10:13:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.691+0000 7f7fa8c7b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa01ab7a0 con 0x56373462ff30 2024-09-10T10:13:49.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.691+0000 7f7fa8c7b740 10 client.0 _ll_register_callbacks cb 0x7f7f9800abf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:49.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.692+0000 7f7f9fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56373462ff30 0x563734644c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.692+0000 7f7f9fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56373462ff30 0x563734644c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:36992/0 (socket says 172.21.15.50:36992) 2024-09-10T10:13:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.692+0000 7f7f9fe00640 1 -- 172.21.15.50:0/440679888 learned_addr learned my addr 172.21.15.50:0/440679888 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.692+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/440679888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563734625670 0x5637346446d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.692+0000 7f7f9f400640 1 --2- 172.21.15.50:0/440679888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734624d50 0x563734649350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.692+0000 7f7f9ea00640 1 -- 172.21.15.50:0/440679888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56373462ff30 msgr2=0x563734644c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.692+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/440679888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56373462ff30 0x563734644c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.692+0000 7f7f9ea00640 1 -- 172.21.15.50:0/440679888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734624d50 msgr2=0x563734649350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.692+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/440679888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734624d50 0x563734649350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.692+0000 7f7f9ea00640 1 -- 172.21.15.50:0/440679888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563734645440 con 0x563734625670 2024-09-10T10:13:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.692+0000 7f7f9ea00640 1 --2- 172.21.15.50:0/440679888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563734625670 0x5637346446d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x56373464f610 tx=0x7f7f8c0c04b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd916ebcd7b81cfc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.692+0000 7f7f88c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.693+0000 7f7f88c00640 1 -- 172.21.15.50:0/440679888 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0bbc40 con 0x563734625670 2024-09-10T10:13:49.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.693+0000 7f7f88c00640 1 -- 172.21.15.50:0/440679888 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f7f8c0f3950 con 0x563734625670 2024-09-10T10:13:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.693+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/440679888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f8c0bc800 con 0x563734625670 2024-09-10T10:13:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.693+0000 7f7f88c00640 1 -- 172.21.15.50:0/440679888 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7f8c0bbed0 con 0x563734625670 2024-09-10T10:13:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.693+0000 7f7fa8c7b740 10 client.25910 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.693+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/440679888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5637346bb7e0 con 0x563734625670 2024-09-10T10:13:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.694+0000 7f7f88c00640 1 -- 172.21.15.50:0/440679888 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8c0bc800 con 0x563734625670 2024-09-10T10:13:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.694+0000 7f7f88c00640 1 -- 172.21.15.50:0/440679888 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7f8c03b610 con 0x563734625670 2024-09-10T10:13:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.694+0000 7f7fa8c7b740 10 client.25910 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.694+0000 7f7fa8c7b740 10 client.25910 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.694+0000 7f7fa8c7b740 20 client.25910 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.694+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/440679888 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5637346bbbb0 0x5637346bdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.694+0000 7f7fa8c7b740 4 client.25910 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:13:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.694+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/440679888 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563734592e60 con 0x5637346bbbb0 2024-09-10T10:13:49.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.694+0000 7f7f9f400640 1 --2- 172.21.15.50:0/440679888 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5637346bbbb0 0x5637346bdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:49.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.695+0000 7f7f9f400640 1 --2- 172.21.15.50:0/440679888 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5637346bbbb0 0x5637346bdfa0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=277628f3df1d1ca9 server_cookie=8739c91ba89f8ab3 in_seq=0 out_seq=0 2024-09-10T10:13:49.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.695+0000 7f7f88c00640 10 client.25910 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:49.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.695+0000 7f7f88c00640 1 -- 172.21.15.50:0/440679888 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563734592e60 con 0x5637346bbbb0 2024-09-10T10:13:49.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.695+0000 7f7f88c00640 10 client.25910 handle_command_reply: tid=0 2024-09-10T10:13:49.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.695+0000 7f7fa8c7b740 1 client.25910 shutdown 2024-09-10T10:13:49.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.696+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/440679888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563734625670 msgr2=0x5637346446d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:49.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.696+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/440679888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563734625670 0x5637346446d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x56373464f610 tx=0x7f7f8c0c04b0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.696+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/440679888 shutdown_connections 2024-09-10T10:13:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.696+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/440679888 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5637346bbbb0 0x5637346bdfa0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.696+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/440679888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56373462ff30 0x563734644c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.696+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/440679888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563734625670 0x5637346446d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.696+0000 7f7fa8c7b740 1 --2- 172.21.15.50:0/440679888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563734624d50 0x563734649350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.696+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/440679888 >> 172.21.15.50:0/440679888 conn(0x5637346212e0 msgr2=0x56373462e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.696+0000 7f7f88c00640 0 client.25910 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.696+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/440679888 shutdown_connections 2024-09-10T10:13:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.696+0000 7f7fa8c7b740 1 -- 172.21.15.50:0/440679888 wait complete. 2024-09-10T10:13:49.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.696+0000 7f7fa8c7b740 20 client.25910 trim_cache size 0 max 16384 2024-09-10T10:13:49.700 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:13:49.700 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-10T10:13:49.701 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-10T10:13:49.701 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:13:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.697+0000 7f7fa4a00640 1 -- 172.21.15.50:0/4170914308 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7f840a2b50 msgr2=0x7f7f840a5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.697+0000 7f7fa4a00640 1 --2- 172.21.15.50:0/4170914308 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7f840a2b50 0x7f7f840a5010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f900058c0 tx=0x7f7f9000c340 comp rx=0 tx=0).stop 2024-09-10T10:13:49.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.697+0000 7f7fa4a00640 1 -- 172.21.15.50:0/4170914308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa0077040 msgr2=0x7f7fa01a4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.697+0000 7f7fa4a00640 1 --2- 172.21.15.50:0/4170914308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa0077040 0x7f7fa01a4bd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c02a9e0 tx=0x7f7f8c003cd0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.697+0000 7f7fa4a00640 1 -- 172.21.15.50:0/4170914308 shutdown_connections 2024-09-10T10:13:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.697+0000 7f7fa4a00640 1 --2- 172.21.15.50:0/4170914308 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7f840a2b50 0x7f7f840a5010 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.697+0000 7f7fa4a00640 1 --2- 172.21.15.50:0/4170914308 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7fa0112870 0x7f7fa019e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.697+0000 7f7fa4a00640 1 --2- 172.21.15.50:0/4170914308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fa0077040 0x7f7fa01a4bd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.697+0000 7f7fa4a00640 1 --2- 172.21.15.50:0/4170914308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fa0076720 0x7f7fa01a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.697+0000 7f7fa4a00640 1 -- 172.21.15.50:0/4170914308 >> 172.21.15.50:0/4170914308 conn(0x7f7fa00ff910 msgr2=0x7f7fa0101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.698+0000 7f7fa4a00640 1 -- 172.21.15.50:0/4170914308 shutdown_connections 2024-09-10T10:13:49.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:49.698+0000 7f7fa4a00640 1 -- 172.21.15.50:0/4170914308 wait complete. 2024-09-10T10:13:50.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:49 smithi189 ceph-mon[34999]: pgmap v470: 129 pgs: 129 active+clean; 937 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 79 MiB/s wr, 49 op/s 2024-09-10T10:13:50.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:49 smithi084 ceph-mon[34812]: pgmap v470: 129 pgs: 129 active+clean; 937 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 79 MiB/s wr, 49 op/s 2024-09-10T10:13:50.156 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:49 smithi050 ceph-mon[30354]: pgmap v470: 129 pgs: 129 active+clean; 937 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 79 MiB/s wr, 49 op/s 2024-09-10T10:13:50.640 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T10:13:50.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:13:51.294 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:51.897 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:51.897 INFO:tasks.workunit.client.0.smithi050.stdout: Children see throughput for 1 rewriters = 256642.11 kB/sec 2024-09-10T10:13:51.897 INFO:tasks.workunit.client.0.smithi050.stdout: Parent sees throughput for 1 rewriters = 256604.05 kB/sec 2024-09-10T10:13:51.897 INFO:tasks.workunit.client.0.smithi050.stdout: Min throughput per process = 256642.11 kB/sec 2024-09-10T10:13:51.897 INFO:tasks.workunit.client.0.smithi050.stdout: Max throughput per process = 256642.11 kB/sec 2024-09-10T10:13:51.897 INFO:tasks.workunit.client.0.smithi050.stdout: Avg throughput per process = 256642.11 kB/sec 2024-09-10T10:13:51.897 INFO:tasks.workunit.client.0.smithi050.stdout: Min xfer = 1048576.00 kB 2024-09-10T10:13:52.114 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:51 smithi050 ceph-mon[30354]: pgmap v471: 129 pgs: 129 active+clean; 1.0 GiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 MiB/s wr, 55 op/s 2024-09-10T10:13:52.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:51 smithi189 ceph-mon[34999]: pgmap v471: 129 pgs: 129 active+clean; 1.0 GiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 MiB/s wr, 55 op/s 2024-09-10T10:13:52.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:51 smithi084 ceph-mon[34812]: pgmap v471: 129 pgs: 129 active+clean; 1.0 GiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 102 MiB/s wr, 55 op/s 2024-09-10T10:13:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.111+0000 7fc881e00640 1 -- 172.21.15.50:0/1523310568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c074e30 msgr2=0x7fc87c10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.111+0000 7fc881e00640 1 --2- 172.21.15.50:0/1523310568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c074e30 0x7fc87c10dd40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc868009900 tx=0x7fc86802a480 comp rx=0 tx=0).stop 2024-09-10T10:13:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.111+0000 7fc881e00640 1 -- 172.21.15.50:0/1523310568 shutdown_connections 2024-09-10T10:13:52.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.111+0000 7fc881e00640 1 --2- 172.21.15.50:0/1523310568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc87c10e280 0x7fc87c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.111+0000 7fc881e00640 1 --2- 172.21.15.50:0/1523310568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c074e30 0x7fc87c10dd40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.111+0000 7fc881e00640 1 --2- 172.21.15.50:0/1523310568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc87c074510 0x7fc87c0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.111+0000 7fc881e00640 1 -- 172.21.15.50:0/1523310568 >> 172.21.15.50:0/1523310568 conn(0x7fc87c0fd6e0 msgr2=0x7fc87c0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.111+0000 7fc881e00640 1 -- 172.21.15.50:0/1523310568 shutdown_connections 2024-09-10T10:13:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.111+0000 7fc881e00640 1 -- 172.21.15.50:0/1523310568 wait complete. 2024-09-10T10:13:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.112+0000 7fc881e00640 1 Processor -- start 2024-09-10T10:13:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.112+0000 7fc881e00640 1 -- start start 2024-09-10T10:13:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.113+0000 7fc881e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c074510 0x7fc87c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.113+0000 7fc881e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc87c074e30 0x7fc87c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.113+0000 7fc881e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc87c10e280 0x7fc87c19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.113+0000 7fc881e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c113fb0 con 0x7fc87c074510 2024-09-10T10:13:52.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.113+0000 7fc881e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c113e30 con 0x7fc87c074e30 2024-09-10T10:13:52.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.113+0000 7fc881e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c114130 con 0x7fc87c10e280 2024-09-10T10:13:52.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.113+0000 7fc880a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c074510 0x7fc87c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:52.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.113+0000 7fc87be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc87c074e30 0x7fc87c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:52.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.113+0000 7fc880a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c074510 0x7fc87c19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48234/0 (socket says 172.21.15.50:48234) 2024-09-10T10:13:52.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.113+0000 7fc880a00640 1 -- 172.21.15.50:0/2202305539 learned_addr learned my addr 172.21.15.50:0/2202305539 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:52.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.113+0000 7fc881400640 1 --2- 172.21.15.50:0/2202305539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc87c10e280 0x7fc87c19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:52.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.114+0000 7fc880a00640 1 -- 172.21.15.50:0/2202305539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc87c10e280 msgr2=0x7fc87c19ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:52.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.114+0000 7fc880a00640 1 --2- 172.21.15.50:0/2202305539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc87c10e280 0x7fc87c19ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.114+0000 7fc880a00640 1 -- 172.21.15.50:0/2202305539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc87c074e30 msgr2=0x7fc87c19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:52.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.114+0000 7fc880a00640 1 --2- 172.21.15.50:0/2202305539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc87c074e30 0x7fc87c19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.114+0000 7fc880a00640 1 -- 172.21.15.50:0/2202305539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87c19f430 con 0x7fc87c074510 2024-09-10T10:13:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.114+0000 7fc880a00640 1 --2- 172.21.15.50:0/2202305539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c074510 0x7fc87c19a480 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc87000e9f0 tx=0x7fc87000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.114+0000 7fc879600640 1 -- 172.21.15.50:0/2202305539 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87000cd80 con 0x7fc87c074510 2024-09-10T10:13:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.114+0000 7fc879600640 1 -- 172.21.15.50:0/2202305539 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc870010910 con 0x7fc87c074510 2024-09-10T10:13:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.114+0000 7fc881e00640 1 -- 172.21.15.50:0/2202305539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87c19f720 con 0x7fc87c074510 2024-09-10T10:13:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.114+0000 7fc879600640 1 -- 172.21.15.50:0/2202305539 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc870018990 con 0x7fc87c074510 2024-09-10T10:13:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.114+0000 7fc881e00640 1 -- 172.21.15.50:0/2202305539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc87c1a7000 con 0x7fc87c074510 2024-09-10T10:13:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.115+0000 7fc881e00640 1 -- 172.21.15.50:0/2202305539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc87c0748f0 con 0x7fc87c074510 2024-09-10T10:13:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.117+0000 7fc879600640 1 -- 172.21.15.50:0/2202305539 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc870010ac0 con 0x7fc87c074510 2024-09-10T10:13:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.118+0000 7fc879600640 1 --2- 172.21.15.50:0/2202305539 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc8640a2c00 0x7fc8640a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.119+0000 7fc879600640 1 -- 172.21.15.50:0/2202305539 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fc8700cf6a0 con 0x7fc87c074510 2024-09-10T10:13:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.119+0000 7fc87be00640 1 --2- 172.21.15.50:0/2202305539 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc8640a2c00 0x7fc8640a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:52.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.120+0000 7fc87be00640 1 --2- 172.21.15.50:0/2202305539 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc8640a2c00 0x7fc8640a50c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc868009230 tx=0x7fc8680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.123+0000 7fc879600640 1 -- 172.21.15.50:0/2202305539 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc87009bbc0 con 0x7fc87c074510 2024-09-10T10:13:52.765 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:13:52.765 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:13:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.347+0000 7fc881e00640 1 -- 172.21.15.50:0/2202305539 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc87c109460 con 0x7fc87c074510 2024-09-10T10:13:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.348+0000 7fc879600640 1 -- 172.21.15.50:0/2202305539 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7fc87009fec0 con 0x7fc87c074510 2024-09-10T10:13:52.765 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:13:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.350+0000 7fc881e00640 1 -- 172.21.15.50:0/2202305539 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc8640a2c00 msgr2=0x7fc8640a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.350+0000 7fc881e00640 1 --2- 172.21.15.50:0/2202305539 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc8640a2c00 0x7fc8640a50c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc868009230 tx=0x7fc8680058d0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.350+0000 7fc881e00640 1 -- 172.21.15.50:0/2202305539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c074510 msgr2=0x7fc87c19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.350+0000 7fc881e00640 1 --2- 172.21.15.50:0/2202305539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c074510 0x7fc87c19a480 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc87000e9f0 tx=0x7fc87000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.350+0000 7fc881e00640 1 -- 172.21.15.50:0/2202305539 shutdown_connections 2024-09-10T10:13:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.350+0000 7fc881e00640 1 --2- 172.21.15.50:0/2202305539 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc8640a2c00 0x7fc8640a50c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.350+0000 7fc881e00640 1 --2- 172.21.15.50:0/2202305539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc87c10e280 0x7fc87c19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.350+0000 7fc881e00640 1 --2- 172.21.15.50:0/2202305539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc87c074e30 0x7fc87c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.350+0000 7fc881e00640 1 --2- 172.21.15.50:0/2202305539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc87c074510 0x7fc87c19a480 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.350+0000 7fc881e00640 1 -- 172.21.15.50:0/2202305539 >> 172.21.15.50:0/2202305539 conn(0x7fc87c0fd6e0 msgr2=0x7fc87c0fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.350+0000 7fc881e00640 1 -- 172.21.15.50:0/2202305539 shutdown_connections 2024-09-10T10:13:52.766 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:52.351+0000 7fc881e00640 1 -- 172.21.15.50:0/2202305539 wait complete. 2024-09-10T10:13:53.144 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:52 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2202305539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:53.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:52 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2202305539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:53.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:52 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2202305539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:13:53.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T10:13:54.018 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:54.176 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:53 smithi050 ceph-mon[30354]: pgmap v472: 129 pgs: 129 active+clean; 1.0 GiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 130 MiB/s wr, 57 op/s 2024-09-10T10:13:54.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:53 smithi189 ceph-mon[34999]: pgmap v472: 129 pgs: 129 active+clean; 1.0 GiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 130 MiB/s wr, 57 op/s 2024-09-10T10:13:54.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:53 smithi084 ceph-mon[34812]: pgmap v472: 129 pgs: 129 active+clean; 1.0 GiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 130 MiB/s wr, 57 op/s 2024-09-10T10:13:54.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.593+0000 7f987c800640 1 -- 172.21.15.50:0/432232815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98741049a0 msgr2=0x7f98741089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.593+0000 7f987c800640 1 --2- 172.21.15.50:0/432232815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98741049a0 0x7f98741089f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9864009900 tx=0x7f986402a410 comp rx=0 tx=0).stop 2024-09-10T10:13:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.593+0000 7f987c800640 1 -- 172.21.15.50:0/432232815 shutdown_connections 2024-09-10T10:13:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.593+0000 7f987c800640 1 --2- 172.21.15.50:0/432232815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9874109120 0x7f9874110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.593+0000 7f987c800640 1 --2- 172.21.15.50:0/432232815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98741049a0 0x7f98741089f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.593+0000 7f987c800640 1 --2- 172.21.15.50:0/432232815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9874103ff0 0x7f98741043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.593+0000 7f987c800640 1 -- 172.21.15.50:0/432232815 >> 172.21.15.50:0/432232815 conn(0x7f98740ffa90 msgr2=0x7f9874101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.593+0000 7f987c800640 1 -- 172.21.15.50:0/432232815 shutdown_connections 2024-09-10T10:13:54.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.593+0000 7f987c800640 1 -- 172.21.15.50:0/432232815 wait complete. 2024-09-10T10:13:54.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.594+0000 7f987c800640 1 Processor -- start 2024-09-10T10:13:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.594+0000 7f987c800640 1 -- start start 2024-09-10T10:13:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.594+0000 7f987c800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9874103ff0 0x7f987419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.594+0000 7f987c800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98741049a0 0x7f987419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.594+0000 7f987c800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9874109120 0x7f987419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.594+0000 7f987c800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9874114140 con 0x7f9874103ff0 2024-09-10T10:13:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.594+0000 7f987c800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9874113fc0 con 0x7f9874109120 2024-09-10T10:13:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.594+0000 7f987c800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f98741142c0 con 0x7f98741049a0 2024-09-10T10:13:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.595+0000 7f9879e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9874103ff0 0x7f987419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.595+0000 7f9879e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9874103ff0 0x7f987419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48252/0 (socket says 172.21.15.50:48252) 2024-09-10T10:13:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.595+0000 7f9879e00640 1 -- 172.21.15.50:0/3475642165 learned_addr learned my addr 172.21.15.50:0/3475642165 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.595+0000 7f987a800640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9874109120 0x7f987419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.595+0000 7f9879400640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98741049a0 0x7f987419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.595+0000 7f9879e00640 1 -- 172.21.15.50:0/3475642165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98741049a0 msgr2=0x7f987419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:54.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.595+0000 7f9879e00640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98741049a0 0x7f987419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.595+0000 7f9879e00640 1 -- 172.21.15.50:0/3475642165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9874109120 msgr2=0x7f987419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:54.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.595+0000 7f9879e00640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9874109120 0x7f987419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.595+0000 7f9879e00640 1 -- 172.21.15.50:0/3475642165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987419f5d0 con 0x7f9874103ff0 2024-09-10T10:13:54.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.595+0000 7f987a800640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9874109120 0x7f987419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:54.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.596+0000 7f9879e00640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9874103ff0 0x7f987419a620 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f986800e9f0 tx=0x7f986800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:54.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.596+0000 7f986ea00640 1 -- 172.21.15.50:0/3475642165 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986800cd80 con 0x7f9874103ff0 2024-09-10T10:13:54.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.596+0000 7f986ea00640 1 -- 172.21.15.50:0/3475642165 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9868005500 con 0x7f9874103ff0 2024-09-10T10:13:54.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.596+0000 7f986ea00640 1 -- 172.21.15.50:0/3475642165 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868010690 con 0x7f9874103ff0 2024-09-10T10:13:54.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.596+0000 7f987c800640 1 -- 172.21.15.50:0/3475642165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987419f8c0 con 0x7f9874103ff0 2024-09-10T10:13:54.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.596+0000 7f987c800640 1 -- 172.21.15.50:0/3475642165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98741a71a0 con 0x7f9874103ff0 2024-09-10T10:13:54.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.600+0000 7f987f3f6740 1 Processor -- start 2024-09-10T10:13:54.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.601+0000 7f987f3f6740 1 -- start start 2024-09-10T10:13:54.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.601+0000 7f986ea00640 1 -- 172.21.15.50:0/3475642165 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f98680046c0 con 0x7f9874103ff0 2024-09-10T10:13:54.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.601+0000 7f987f3f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57e8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.601+0000 7f987f3f6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a57f2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.601+0000 7f987f3f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 0x5559a57f5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.601+0000 7f987f3f6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5559a574e3e0 con 0x5559a57e8590 2024-09-10T10:13:54.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.601+0000 7f987f3f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5559a56f5d80 con 0x5559a57e7c70 2024-09-10T10:13:54.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.601+0000 7f987f3f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5559a574a3a0 con 0x5559a57f2e50 2024-09-10T10:13:54.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.601+0000 7f9879e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a57f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.601+0000 7f987a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57e8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.601+0000 7f987a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57e8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50134/0 (socket says 172.21.15.50:50134) 2024-09-10T10:13:54.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.601+0000 7f9879e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a57f2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48262/0 (socket says 172.21.15.50:48262) 2024-09-10T10:13:54.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.601+0000 7f987a800640 1 -- 172.21.15.50:0/2668038960 learned_addr learned my addr 172.21.15.50:0/2668038960 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:54.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.602+0000 7f9879400640 1 --2- 172.21.15.50:0/2668038960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 0x5559a57f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.602+0000 7f9879e00640 1 -- 172.21.15.50:0/2668038960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 msgr2=0x5559a57f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:54.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.602+0000 7f9879e00640 1 --2- 172.21.15.50:0/2668038960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 0x5559a57f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.602+0000 7f9879e00640 1 -- 172.21.15.50:0/2668038960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 msgr2=0x5559a57e8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.602+0000 7f9879e00640 1 --2- 172.21.15.50:0/2668038960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57e8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.602+0000 7f9879e00640 1 -- 172.21.15.50:0/2668038960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a5714ae0 con 0x5559a57e8590 2024-09-10T10:13:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.602+0000 7f987a800640 1 --2- 172.21.15.50:0/2668038960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57e8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.602+0000 7f9879400640 1 --2- 172.21.15.50:0/2668038960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 0x5559a57f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.602+0000 7f9879e00640 1 --2- 172.21.15.50:0/2668038960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a57f2910 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f98680ccef0 tx=0x7f98680d5b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66664a54f19cacda server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.603+0000 7f9863000640 1 -- 172.21.15.50:0/2668038960 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680de070 con 0x5559a57e8590 2024-09-10T10:13:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.603+0000 7f9863000640 1 -- 172.21.15.50:0/2668038960 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98680da440 con 0x5559a57e8590 2024-09-10T10:13:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.603+0000 7f9863000640 1 -- 172.21.15.50:0/2668038960 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680d12b0 con 0x5559a57e8590 2024-09-10T10:13:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.603+0000 7f986ea00640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f985c0a2b80 0x7f985c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.603+0000 7f986ea00640 1 -- 172.21.15.50:0/3475642165 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f98680cf7b0 con 0x7f9874103ff0 2024-09-10T10:13:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.603+0000 7f987a800640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f985c0a2b80 0x7f985c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.603+0000 7f987f3f6740 1 -- 172.21.15.50:0/2668038960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 msgr2=0x5559a57f2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:54.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.603+0000 7f987f3f6740 1 --2- 172.21.15.50:0/2668038960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a57f2910 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f98680ccef0 tx=0x7f98680d5b40 comp rx=0 tx=0).stop 2024-09-10T10:13:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.604+0000 7f987f3f6740 1 -- 172.21.15.50:0/2668038960 shutdown_connections 2024-09-10T10:13:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.604+0000 7f987f3f6740 1 --2- 172.21.15.50:0/2668038960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 0x5559a57f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.604+0000 7f987f3f6740 1 --2- 172.21.15.50:0/2668038960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a57f2910 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.604+0000 7f987f3f6740 1 --2- 172.21.15.50:0/2668038960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57e8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.604+0000 7f987f3f6740 1 -- 172.21.15.50:0/2668038960 >> 172.21.15.50:0/2668038960 conn(0x5559a57e4200 msgr2=0x5559a57e45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.604+0000 7f987f3f6740 1 -- 172.21.15.50:0/2668038960 shutdown_connections 2024-09-10T10:13:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.604+0000 7f987f3f6740 1 -- 172.21.15.50:0/2668038960 wait complete. 2024-09-10T10:13:54.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.604+0000 7f987a800640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f985c0a2b80 0x7f985c0a5040 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9870009fd0 tx=0x7f9870009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.605+0000 7f987f3f6740 1 -- start start 2024-09-10T10:13:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.605+0000 7f987f3f6740 1 Processor -- start 2024-09-10T10:13:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.605+0000 7f987f3f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57efd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.605+0000 7f987f3f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57e8590 0x5559a57f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.605+0000 7f987f3f6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57f2e50 0x5559a57f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.605+0000 7f987f3f6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5559a57f5a20 con 0x5559a57f2e50 2024-09-10T10:13:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.605+0000 7f987f3f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5559a57090f0 con 0x5559a57e7c70 2024-09-10T10:13:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.605+0000 7f987f3f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5559a57f5ba0 con 0x5559a57e8590 2024-09-10T10:13:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.605+0000 7f987f3f6740 10 client.0 _ll_register_callbacks cb 0x5559a56f0bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.606+0000 7f9879e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.606+0000 7f987a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57f2e50 0x5559a57f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.606+0000 7f9879e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57efd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50140/0 (socket says 172.21.15.50:50140) 2024-09-10T10:13:54.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.606+0000 7f9879e00640 1 -- 172.21.15.50:0/4231845430 learned_addr learned my addr 172.21.15.50:0/4231845430 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:54.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.606+0000 7f9879400640 1 --2- 172.21.15.50:0/4231845430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57e8590 0x5559a57f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.606+0000 7f9879e00640 1 -- 172.21.15.50:0/4231845430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57e8590 msgr2=0x5559a57f02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:54.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.606+0000 7f9879e00640 1 --2- 172.21.15.50:0/4231845430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57e8590 0x5559a57f02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.606+0000 7f9879e00640 1 -- 172.21.15.50:0/4231845430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57f2e50 msgr2=0x5559a57f07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:54.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.606+0000 7f9879e00640 1 --2- 172.21.15.50:0/4231845430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57f2e50 0x5559a57f07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.606+0000 7f9879e00640 1 -- 172.21.15.50:0/4231845430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a54bf3c0 con 0x5559a57e7c70 2024-09-10T10:13:54.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.607+0000 7f9879e00640 1 --2- 172.21.15.50:0/4231845430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57efd60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f986809bc10 tx=0x7f98680d5fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dce44b3cac8169b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.607+0000 7f9857400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.607+0000 7f9857400640 1 -- 172.21.15.50:0/4231845430 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680de070 con 0x5559a57e7c70 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.607+0000 7f9857400640 1 -- 172.21.15.50:0/4231845430 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f986809bee0 con 0x5559a57e7c70 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.607+0000 7f987f3f6740 1 -- 172.21.15.50:0/4231845430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98680da440 con 0x5559a57e7c70 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.607+0000 7f9857400640 1 -- 172.21.15.50:0/4231845430 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f98680b9050 con 0x5559a57e7c70 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.607+0000 7f987f3f6740 10 client.25928 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.607+0000 7f987f3f6740 1 -- 172.21.15.50:0/4231845430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5559a5801a90 con 0x5559a57e7c70 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.607+0000 7f9857400640 1 -- 172.21.15.50:0/4231845430 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98680da440 con 0x5559a57e7c70 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.608+0000 7f9857400640 1 -- 172.21.15.50:0/4231845430 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f98680a4460 con 0x5559a57e7c70 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.608+0000 7f987f3f6740 10 client.25928 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.608+0000 7f987f3f6740 10 client.25928 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.608+0000 7f987f3f6740 20 client.25928 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.608+0000 7f987f3f6740 1 --2- 172.21.15.50:0/4231845430 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5559a5802de0 0x5559a58051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.608+0000 7f987f3f6740 4 client.25928 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.608+0000 7f987f3f6740 1 -- 172.21.15.50:0/4231845430 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559a575b950 con 0x5559a5802de0 2024-09-10T10:13:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.608+0000 7f9879400640 1 --2- 172.21.15.50:0/4231845430 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5559a5802de0 0x5559a58051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.609+0000 7f9879400640 1 --2- 172.21.15.50:0/4231845430 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5559a5802de0 0x5559a58051d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4f6c3d6bd8b95d49 server_cookie=f2694f8d762a3231 in_seq=0 out_seq=0 2024-09-10T10:13:54.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.609+0000 7f9857400640 10 client.25928 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.609+0000 7f9857400640 1 -- 172.21.15.50:0/4231845430 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559a575b950 con 0x5559a5802de0 2024-09-10T10:13:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.609+0000 7f9857400640 10 client.25928 handle_command_reply: tid=0 2024-09-10T10:13:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.610+0000 7f987f3f6740 1 client.25928 shutdown 2024-09-10T10:13:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.610+0000 7f987f3f6740 1 -- 172.21.15.50:0/4231845430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 msgr2=0x5559a57efd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.610+0000 7f987f3f6740 1 --2- 172.21.15.50:0/4231845430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57efd60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f986809bc10 tx=0x7f98680d5fa0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.610+0000 7f987f3f6740 1 -- 172.21.15.50:0/4231845430 shutdown_connections 2024-09-10T10:13:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.610+0000 7f987f3f6740 1 --2- 172.21.15.50:0/4231845430 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5559a5802de0 0x5559a58051d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.610+0000 7f987f3f6740 1 --2- 172.21.15.50:0/4231845430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57f2e50 0x5559a57f07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.610+0000 7f987f3f6740 1 --2- 172.21.15.50:0/4231845430 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57e8590 0x5559a57f02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.610+0000 7f9857400640 0 client.25928 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.610+0000 7f987f3f6740 1 --2- 172.21.15.50:0/4231845430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57efd60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.610+0000 7f987f3f6740 1 -- 172.21.15.50:0/4231845430 >> 172.21.15.50:0/4231845430 conn(0x5559a57e4200 msgr2=0x5559a57e3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:54.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.610+0000 7f987f3f6740 1 -- 172.21.15.50:0/4231845430 shutdown_connections 2024-09-10T10:13:54.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.610+0000 7f987f3f6740 1 -- 172.21.15.50:0/4231845430 wait complete. 2024-09-10T10:13:54.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.610+0000 7f987f3f6740 20 client.25928 trim_cache size 0 max 16384 2024-09-10T10:13:54.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f987f3f6740 1 Processor -- start 2024-09-10T10:13:54.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f987f3f6740 1 -- start start 2024-09-10T10:13:54.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f987f3f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f987f3f6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a58081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f987f3f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 0x5559a5808730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f987f3f6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98741b37a0 con 0x5559a57e8590 2024-09-10T10:13:54.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f987f3f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f98741b1070 con 0x5559a57e7c70 2024-09-10T10:13:54.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f987f3f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f98741aeec0 con 0x5559a57f2e50 2024-09-10T10:13:54.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f9879e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f9879e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50142/0 (socket says 172.21.15.50:50142) 2024-09-10T10:13:54.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f9879e00640 1 -- 172.21.15.50:0/747137408 learned_addr learned my addr 172.21.15.50:0/747137408 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:54.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f9879400640 1 --2- 172.21.15.50:0/747137408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a58081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f987a800640 1 --2- 172.21.15.50:0/747137408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 0x5559a5808730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f9879e00640 1 -- 172.21.15.50:0/747137408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 msgr2=0x5559a5808730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:54.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f9879e00640 1 --2- 172.21.15.50:0/747137408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 0x5559a5808730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f9879e00640 1 -- 172.21.15.50:0/747137408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 msgr2=0x5559a58081f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:54.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f9879e00640 1 --2- 172.21.15.50:0/747137408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a58081f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.625+0000 7f9879e00640 1 -- 172.21.15.50:0/747137408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a57df770 con 0x5559a57e7c70 2024-09-10T10:13:54.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.626+0000 7f9879e00640 1 --2- 172.21.15.50:0/747137408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57f15c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f986809b980 tx=0x7f986809c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=265ac44708adbc2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:54.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.626+0000 7f9862600640 1 -- 172.21.15.50:0/747137408 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680de070 con 0x5559a57e7c70 2024-09-10T10:13:54.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.626+0000 7f9862600640 1 -- 172.21.15.50:0/747137408 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98680d5320 con 0x5559a57e7c70 2024-09-10T10:13:54.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.626+0000 7f9862600640 1 -- 172.21.15.50:0/747137408 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680a48f0 con 0x5559a57e7c70 2024-09-10T10:13:54.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.626+0000 7f987f3f6740 1 -- 172.21.15.50:0/747137408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 msgr2=0x5559a57f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:54.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.626+0000 7f987f3f6740 1 --2- 172.21.15.50:0/747137408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57f15c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f986809b980 tx=0x7f986809c4c0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.626+0000 7f987f3f6740 1 -- 172.21.15.50:0/747137408 shutdown_connections 2024-09-10T10:13:54.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.626+0000 7f987f3f6740 1 --2- 172.21.15.50:0/747137408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 0x5559a5808730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.626+0000 7f987f3f6740 1 --2- 172.21.15.50:0/747137408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a58081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.626+0000 7f987f3f6740 1 --2- 172.21.15.50:0/747137408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a57f15c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.626+0000 7f987f3f6740 1 -- 172.21.15.50:0/747137408 >> 172.21.15.50:0/747137408 conn(0x5559a57e4200 msgr2=0x5559a57fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:54.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.627+0000 7f987f3f6740 1 -- 172.21.15.50:0/747137408 shutdown_connections 2024-09-10T10:13:54.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.627+0000 7f987f3f6740 1 -- 172.21.15.50:0/747137408 wait complete. 2024-09-10T10:13:54.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.627+0000 7f987f3f6740 1 -- start start 2024-09-10T10:13:54.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.627+0000 7f987f3f6740 1 Processor -- start 2024-09-10T10:13:54.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f987f3f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a58089e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f987f3f6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a5805d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f987f3f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 0x5559a5806290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f987f3f6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f98741af530 con 0x5559a57e8590 2024-09-10T10:13:54.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f987f3f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f98741b09a0 con 0x5559a57e7c70 2024-09-10T10:13:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f987f3f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f98741afc00 con 0x5559a57f2e50 2024-09-10T10:13:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f987f3f6740 10 client.0 _ll_register_callbacks cb 0x7f9870009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f9879e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a58089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f9879e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a58089e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50148/0 (socket says 172.21.15.50:50148) 2024-09-10T10:13:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f9879e00640 1 -- 172.21.15.50:0/1354730003 learned_addr learned my addr 172.21.15.50:0/1354730003 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f9879400640 1 --2- 172.21.15.50:0/1354730003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a5805d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f987a800640 1 --2- 172.21.15.50:0/1354730003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 0x5559a5806290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f9879e00640 1 -- 172.21.15.50:0/1354730003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 msgr2=0x5559a5806290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f9879e00640 1 --2- 172.21.15.50:0/1354730003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 0x5559a5806290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f9879e00640 1 -- 172.21.15.50:0/1354730003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 msgr2=0x5559a5805d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f9879e00640 1 --2- 172.21.15.50:0/1354730003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a5805d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.628+0000 7f9879e00640 1 -- 172.21.15.50:0/1354730003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a5806ac0 con 0x5559a57e7c70 2024-09-10T10:13:54.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.629+0000 7f9879e00640 1 --2- 172.21.15.50:0/1354730003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a58089e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9868098650 tx=0x7f986800cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=842490fb68c4aca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:54.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.629+0000 7f9857400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.629+0000 7f9857400640 1 -- 172.21.15.50:0/1354730003 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680de070 con 0x5559a57e7c70 2024-09-10T10:13:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.629+0000 7f9857400640 1 -- 172.21.15.50:0/1354730003 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f98680a4460 con 0x5559a57e7c70 2024-09-10T10:13:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.629+0000 7f987f3f6740 1 -- 172.21.15.50:0/1354730003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98680d5320 con 0x5559a57e7c70 2024-09-10T10:13:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.629+0000 7f9857400640 1 -- 172.21.15.50:0/1354730003 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f986809bc80 con 0x5559a57e7c70 2024-09-10T10:13:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.629+0000 7f987f3f6740 10 client.25934 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.629+0000 7f987f3f6740 1 -- 172.21.15.50:0/1354730003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5559a5806ac0 con 0x5559a57e7c70 2024-09-10T10:13:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.630+0000 7f9857400640 1 -- 172.21.15.50:0/1354730003 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98680d5320 con 0x5559a57e7c70 2024-09-10T10:13:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.630+0000 7f9857400640 1 -- 172.21.15.50:0/1354730003 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f98680ac030 con 0x5559a57e7c70 2024-09-10T10:13:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.630+0000 7f987f3f6740 10 client.25934 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.630+0000 7f987f3f6740 10 client.25934 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:13:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.630+0000 7f987f3f6740 20 client.25934 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:54.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.630+0000 7f987f3f6740 1 --2- 172.21.15.50:0/1354730003 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5559a586d910 0x5559a586fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:54.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.630+0000 7f987f3f6740 4 client.25934 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:13:54.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.630+0000 7f987f3f6740 1 -- 172.21.15.50:0/1354730003 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5559a5755e60 con 0x5559a586d910 2024-09-10T10:13:54.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.630+0000 7f9879400640 1 --2- 172.21.15.50:0/1354730003 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5559a586d910 0x5559a586fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:54.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f9879400640 1 --2- 172.21.15.50:0/1354730003 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5559a586d910 0x5559a586fd00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a0a73e1885212e90 server_cookie=b5fb0d2d9252df82 in_seq=0 out_seq=0 2024-09-10T10:13:54.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f9857400640 10 client.25934 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:54.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f9857400640 1 -- 172.21.15.50:0/1354730003 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5559a5755e60 con 0x5559a586d910 2024-09-10T10:13:54.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f9857400640 10 client.25934 handle_command_reply: tid=0 2024-09-10T10:13:54.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f987f3f6740 1 client.25934 shutdown 2024-09-10T10:13:54.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f987f3f6740 1 -- 172.21.15.50:0/1354730003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 msgr2=0x5559a58089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:54.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f987f3f6740 1 --2- 172.21.15.50:0/1354730003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a58089e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9868098650 tx=0x7f986800cf90 comp rx=0 tx=0).stop 2024-09-10T10:13:54.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f987f3f6740 1 -- 172.21.15.50:0/1354730003 shutdown_connections 2024-09-10T10:13:54.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f987f3f6740 1 --2- 172.21.15.50:0/1354730003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5559a57f2e50 0x5559a5806290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f987f3f6740 1 --2- 172.21.15.50:0/1354730003 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5559a586d910 0x5559a586fd00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f987f3f6740 1 --2- 172.21.15.50:0/1354730003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559a57e8590 0x5559a5805d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f987f3f6740 1 --2- 172.21.15.50:0/1354730003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559a57e7c70 0x5559a58089e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f9857400640 0 client.25934 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:13:54.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f987f3f6740 1 -- 172.21.15.50:0/1354730003 >> 172.21.15.50:0/1354730003 conn(0x5559a57e4200 msgr2=0x5559a57e9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:54.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.631+0000 7f987f3f6740 1 -- 172.21.15.50:0/1354730003 shutdown_connections 2024-09-10T10:13:54.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.632+0000 7f987f3f6740 1 -- 172.21.15.50:0/1354730003 wait complete. 2024-09-10T10:13:54.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.632+0000 7f987f3f6740 20 client.25934 trim_cache size 0 max 16384 2024-09-10T10:13:54.638 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:13:54.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.632+0000 7f987c800640 1 -- 172.21.15.50:0/3475642165 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f985c0a2b80 msgr2=0x7f985c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:54.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.632+0000 7f987c800640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f985c0a2b80 0x7f985c0a5040 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9870009fd0 tx=0x7f9870009500 comp rx=0 tx=0).stop 2024-09-10T10:13:54.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.632+0000 7f987c800640 1 -- 172.21.15.50:0/3475642165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9874103ff0 msgr2=0x7f987419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:54.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.632+0000 7f987c800640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9874103ff0 0x7f987419a620 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f986800e9f0 tx=0x7f986800edf0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.632+0000 7f987c800640 1 -- 172.21.15.50:0/3475642165 shutdown_connections 2024-09-10T10:13:54.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.632+0000 7f987c800640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f985c0a2b80 0x7f985c0a5040 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.632+0000 7f987c800640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9874109120 0x7f987419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.632+0000 7f987c800640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98741049a0 0x7f987419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.632+0000 7f987c800640 1 --2- 172.21.15.50:0/3475642165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9874103ff0 0x7f987419a620 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:54.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.632+0000 7f987c800640 1 -- 172.21.15.50:0/3475642165 >> 172.21.15.50:0/3475642165 conn(0x7f98740ffa90 msgr2=0x7f9874100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:54.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.633+0000 7f987c800640 1 -- 172.21.15.50:0/3475642165 shutdown_connections 2024-09-10T10:13:54.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:54.633+0000 7f987c800640 1 -- 172.21.15.50:0/3475642165 wait complete. 2024-09-10T10:13:54.863 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:54.864 INFO:tasks.workunit.client.0.smithi050.stdout: Children see throughput for 1 readers = 5275431.00 kB/sec 2024-09-10T10:13:54.864 INFO:tasks.workunit.client.0.smithi050.stdout: Parent sees throughput for 1 readers = 5260400.82 kB/sec 2024-09-10T10:13:54.864 INFO:tasks.workunit.client.0.smithi050.stdout: Min throughput per process = 5275431.00 kB/sec 2024-09-10T10:13:54.864 INFO:tasks.workunit.client.0.smithi050.stdout: Max throughput per process = 5275431.00 kB/sec 2024-09-10T10:13:54.864 INFO:tasks.workunit.client.0.smithi050.stdout: Avg throughput per process = 5275431.00 kB/sec 2024-09-10T10:13:54.864 INFO:tasks.workunit.client.0.smithi050.stdout: Min xfer = 1048576.00 kB 2024-09-10T10:13:55.718 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T10:13:55.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:55 smithi050 ceph-mon[30354]: pgmap v473: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 155 MiB/s wr, 52 op/s 2024-09-10T10:13:56.096 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:56.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:55 smithi189 ceph-mon[34999]: pgmap v473: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 155 MiB/s wr, 52 op/s 2024-09-10T10:13:56.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:55 smithi084 ceph-mon[34812]: pgmap v473: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 155 MiB/s wr, 52 op/s 2024-09-10T10:13:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.653+0000 7f0db5800640 1 -- 172.21.15.50:0/1744229633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db0076720 msgr2=0x7f0db0076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.653+0000 7f0db5800640 1 --2- 172.21.15.50:0/1744229633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db0076720 0x7f0db0076b00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0da0009900 tx=0x7f0da002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.653+0000 7f0db5800640 1 -- 172.21.15.50:0/1744229633 shutdown_connections 2024-09-10T10:13:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.653+0000 7f0db5800640 1 --2- 172.21.15.50:0/1744229633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0db0112870 0x7f0db0114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.653+0000 7f0db5800640 1 --2- 172.21.15.50:0/1744229633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0db0077040 0x7f0db0112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.653+0000 7f0db5800640 1 --2- 172.21.15.50:0/1744229633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db0076720 0x7f0db0076b00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.653+0000 7f0db5800640 1 -- 172.21.15.50:0/1744229633 >> 172.21.15.50:0/1744229633 conn(0x7f0db00ff8d0 msgr2=0x7f0db0101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.653+0000 7f0db5800640 1 -- 172.21.15.50:0/1744229633 shutdown_connections 2024-09-10T10:13:56.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.653+0000 7f0db5800640 1 -- 172.21.15.50:0/1744229633 wait complete. 2024-09-10T10:13:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.654+0000 7f0db5800640 1 Processor -- start 2024-09-10T10:13:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.654+0000 7f0db5800640 1 -- start start 2024-09-10T10:13:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.655+0000 7f0db5800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db0076720 0x7f0db01a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.655+0000 7f0db5800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0db0077040 0x7f0db01a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.655+0000 7f0db5800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0db0112870 0x7f0db019e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.655+0000 7f0db5800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0db0118400 con 0x7f0db0076720 2024-09-10T10:13:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.655+0000 7f0db5800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0db0118280 con 0x7f0db0077040 2024-09-10T10:13:56.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.655+0000 7f0db5800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0db0118580 con 0x7f0db0112870 2024-09-10T10:13:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.655+0000 7f0dafe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db0076720 0x7f0db01a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.655+0000 7f0dafe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db0076720 0x7f0db01a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48310/0 (socket says 172.21.15.50:48310) 2024-09-10T10:13:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.655+0000 7f0dafe00640 1 -- 172.21.15.50:0/550789036 learned_addr learned my addr 172.21.15.50:0/550789036 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.655+0000 7f0daf400640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0db0077040 0x7f0db01a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.655+0000 7f0db4e00640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0db0112870 0x7f0db019e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.655+0000 7f0dafe00640 1 -- 172.21.15.50:0/550789036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0db0112870 msgr2=0x7f0db019e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.655+0000 7f0dafe00640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0db0112870 0x7f0db019e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.656+0000 7f0dafe00640 1 -- 172.21.15.50:0/550789036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0db0077040 msgr2=0x7f0db01a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.656+0000 7f0dafe00640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0db0077040 0x7f0db01a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.656+0000 7f0dafe00640 1 -- 172.21.15.50:0/550789036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db019ef80 con 0x7f0db0076720 2024-09-10T10:13:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.656+0000 7f0daf400640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0db0077040 0x7f0db01a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.656+0000 7f0dafe00640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db0076720 0x7f0db01a4640 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0da0006010 tx=0x7f0da00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.656+0000 7f0dacc00640 1 -- 172.21.15.50:0/550789036 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da003f030 con 0x7f0db0076720 2024-09-10T10:13:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.656+0000 7f0dacc00640 1 -- 172.21.15.50:0/550789036 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0da0003ce0 con 0x7f0db0076720 2024-09-10T10:13:56.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.656+0000 7f0dacc00640 1 -- 172.21.15.50:0/550789036 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da0035070 con 0x7f0db0076720 2024-09-10T10:13:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.656+0000 7f0db5800640 1 -- 172.21.15.50:0/550789036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db019f210 con 0x7f0db0076720 2024-09-10T10:13:56.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.656+0000 7f0db5800640 1 -- 172.21.15.50:0/550789036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db01ab3f0 con 0x7f0db0076720 2024-09-10T10:13:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.659+0000 7f0dacc00640 1 -- 172.21.15.50:0/550789036 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0da0042030 con 0x7f0db0076720 2024-09-10T10:13:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.660+0000 7f0db9a31740 1 Processor -- start 2024-09-10T10:13:56.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.660+0000 7f0db9a31740 1 -- start start 2024-09-10T10:13:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.660+0000 7f0db9a31740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a746e40 0x560f3a747220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.660+0000 7f0db9a31740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a751ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.660+0000 7f0db9a31740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a752020 0x560f3a754410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.660+0000 7f0db9a31740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560f3a6ad3e0 con 0x560f3a746e40 2024-09-10T10:13:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.660+0000 7f0db9a31740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560f3a654d80 con 0x560f3a747760 2024-09-10T10:13:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.660+0000 7f0db9a31740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560f3a6a93a0 con 0x560f3a752020 2024-09-10T10:13:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.660+0000 7f0db4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a746e40 0x560f3a747220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.660+0000 7f0db4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a746e40 0x560f3a747220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48314/0 (socket says 172.21.15.50:48314) 2024-09-10T10:13:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.661+0000 7f0db4e00640 1 -- 172.21.15.50:0/4241912950 learned_addr learned my addr 172.21.15.50:0/4241912950 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:56.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.661+0000 7f0dafe00640 1 --2- 172.21.15.50:0/4241912950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a751ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.661+0000 7f0daf400640 1 --2- 172.21.15.50:0/4241912950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a752020 0x560f3a754410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.661+0000 7f0dafe00640 1 -- 172.21.15.50:0/4241912950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a752020 msgr2=0x560f3a754410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:56.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.661+0000 7f0dafe00640 1 --2- 172.21.15.50:0/4241912950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a752020 0x560f3a754410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.661+0000 7f0dafe00640 1 -- 172.21.15.50:0/4241912950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a746e40 msgr2=0x560f3a747220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:56.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.661+0000 7f0dafe00640 1 --2- 172.21.15.50:0/4241912950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a746e40 0x560f3a747220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.661+0000 7f0dafe00640 1 -- 172.21.15.50:0/4241912950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f3a673ae0 con 0x560f3a747760 2024-09-10T10:13:56.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.661+0000 7f0dacc00640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d940a2c00 0x7f0d940a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.661+0000 7f0dacc00640 1 -- 172.21.15.50:0/550789036 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f0da00ef8e0 con 0x7f0db0076720 2024-09-10T10:13:56.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.661+0000 7f0dafe00640 1 --2- 172.21.15.50:0/4241912950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a751ae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0da00ecf90 tx=0x7f0da00f5bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b154a61d137b9e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:56.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.662+0000 7f0db4e00640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d940a2c00 0x7f0d940a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.662+0000 7f0da5600640 1 -- 172.21.15.50:0/4241912950 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da0049030 con 0x560f3a747760 2024-09-10T10:13:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.662+0000 7f0da5600640 1 -- 172.21.15.50:0/4241912950 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0da00f2e50 con 0x560f3a747760 2024-09-10T10:13:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.662+0000 7f0da5600640 1 -- 172.21.15.50:0/4241912950 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da00b8160 con 0x560f3a747760 2024-09-10T10:13:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.662+0000 7f0db4e00640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d940a2c00 0x7f0d940a50c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0da80049d0 tx=0x7f0da8009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.662+0000 7f0db9a31740 1 -- 172.21.15.50:0/4241912950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 msgr2=0x560f3a751ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.663+0000 7f0db9a31740 1 --2- 172.21.15.50:0/4241912950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a751ae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0da00ecf90 tx=0x7f0da00f5bf0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.663+0000 7f0db9a31740 1 -- 172.21.15.50:0/4241912950 shutdown_connections 2024-09-10T10:13:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.663+0000 7f0db9a31740 1 --2- 172.21.15.50:0/4241912950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a752020 0x560f3a754410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.663+0000 7f0db9a31740 1 --2- 172.21.15.50:0/4241912950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a751ae0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.663+0000 7f0db9a31740 1 --2- 172.21.15.50:0/4241912950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a746e40 0x560f3a747220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.663+0000 7f0db9a31740 1 -- 172.21.15.50:0/4241912950 >> 172.21.15.50:0/4241912950 conn(0x560f3a7433d0 msgr2=0x560f3a7437b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.663+0000 7f0db9a31740 1 -- 172.21.15.50:0/4241912950 shutdown_connections 2024-09-10T10:13:56.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.663+0000 7f0db9a31740 1 -- 172.21.15.50:0/4241912950 wait complete. 2024-09-10T10:13:56.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.663+0000 7f0db9a31740 1 -- start start 2024-09-10T10:13:56.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.663+0000 7f0db9a31740 1 Processor -- start 2024-09-10T10:13:56.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.664+0000 7f0db9a31740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a746e40 0x560f3a74ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.664+0000 7f0db9a31740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a747760 0x560f3a74f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.664+0000 7f0db9a31740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a74f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.664+0000 7f0db9a31740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560f3a7549b0 con 0x560f3a752020 2024-09-10T10:13:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.664+0000 7f0db9a31740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560f3a6680f0 con 0x560f3a746e40 2024-09-10T10:13:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.664+0000 7f0db9a31740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560f3a754b30 con 0x560f3a747760 2024-09-10T10:13:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.664+0000 7f0db9a31740 10 client.0 _ll_register_callbacks cb 0x560f3a64fbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.664+0000 7f0db4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a74f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.664+0000 7f0dafe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a746e40 0x560f3a74ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.664+0000 7f0daf400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a747760 0x560f3a74f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.664+0000 7f0dafe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a746e40 0x560f3a74ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50182/0 (socket says 172.21.15.50:50182) 2024-09-10T10:13:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.664+0000 7f0dafe00640 1 -- 172.21.15.50:0/40365428 learned_addr learned my addr 172.21.15.50:0/40365428 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.665+0000 7f0dafe00640 1 -- 172.21.15.50:0/40365428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a747760 msgr2=0x560f3a74f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.665+0000 7f0dafe00640 1 --2- 172.21.15.50:0/40365428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a747760 0x560f3a74f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.665+0000 7f0dafe00640 1 -- 172.21.15.50:0/40365428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 msgr2=0x560f3a74f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.665+0000 7f0dafe00640 1 --2- 172.21.15.50:0/40365428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a74f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.665+0000 7f0dafe00640 1 -- 172.21.15.50:0/40365428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f3a41e3c0 con 0x560f3a746e40 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.665+0000 7f0daf400640 1 --2- 172.21.15.50:0/40365428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a747760 0x560f3a74f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.665+0000 7f0dafe00640 1 --2- 172.21.15.50:0/40365428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a746e40 0x560f3a74ef30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0da00092a0 tx=0x7f0da0031a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95bb2ca18ff3f050 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.665+0000 7f0d9a000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.665+0000 7f0d9a000640 1 -- 172.21.15.50:0/40365428 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da0049030 con 0x560f3a746e40 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.665+0000 7f0d9a000640 1 -- 172.21.15.50:0/40365428 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f0da00f5d80 con 0x560f3a746e40 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.665+0000 7f0db9a31740 1 -- 172.21.15.50:0/40365428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0da00f2e50 con 0x560f3a746e40 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.666+0000 7f0d9a000640 1 -- 172.21.15.50:0/40365428 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0da00044e0 con 0x560f3a746e40 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.666+0000 7f0db9a31740 10 client.25946 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.666+0000 7f0db9a31740 1 -- 172.21.15.50:0/40365428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560f3a7549b0 con 0x560f3a746e40 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.666+0000 7f0d9a000640 1 -- 172.21.15.50:0/40365428 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0da00f2e50 con 0x560f3a746e40 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.666+0000 7f0d9a000640 1 -- 172.21.15.50:0/40365428 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f0da00b8530 con 0x560f3a746e40 2024-09-10T10:13:56.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.666+0000 7f0db9a31740 10 client.25946 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.666+0000 7f0db9a31740 10 client.25946 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:13:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.666+0000 7f0db9a31740 20 client.25946 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.666+0000 7f0db9a31740 1 --2- 172.21.15.50:0/40365428 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x560f3a761b10 0x560f3a763f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.666+0000 7f0db9a31740 4 client.25946 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:56.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.666+0000 7f0db9a31740 1 -- 172.21.15.50:0/40365428 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f3a6ba950 con 0x560f3a761b10 2024-09-10T10:13:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.667+0000 7f0daf400640 1 --2- 172.21.15.50:0/40365428 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x560f3a761b10 0x560f3a763f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.667+0000 7f0daf400640 1 --2- 172.21.15.50:0/40365428 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x560f3a761b10 0x560f3a763f20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fabff7833729a9db server_cookie=8dfee08af8966660 in_seq=0 out_seq=0 2024-09-10T10:13:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.667+0000 7f0d9a000640 10 client.25946 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.668+0000 7f0d9a000640 1 -- 172.21.15.50:0/40365428 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f3a6ba950 con 0x560f3a761b10 2024-09-10T10:13:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.668+0000 7f0d9a000640 10 client.25946 handle_command_reply: tid=0 2024-09-10T10:13:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.668+0000 7f0db9a31740 1 client.25946 shutdown 2024-09-10T10:13:56.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.668+0000 7f0db9a31740 1 -- 172.21.15.50:0/40365428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a746e40 msgr2=0x560f3a74ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.668+0000 7f0db9a31740 1 --2- 172.21.15.50:0/40365428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a746e40 0x560f3a74ef30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0da00092a0 tx=0x7f0da0031a60 comp rx=0 tx=0).stop 2024-09-10T10:13:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.668+0000 7f0db9a31740 1 -- 172.21.15.50:0/40365428 shutdown_connections 2024-09-10T10:13:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.668+0000 7f0db9a31740 1 --2- 172.21.15.50:0/40365428 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x560f3a761b10 0x560f3a763f20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.668+0000 7f0db9a31740 1 --2- 172.21.15.50:0/40365428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a74f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.668+0000 7f0db9a31740 1 --2- 172.21.15.50:0/40365428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a747760 0x560f3a74f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.668+0000 7f0db9a31740 1 --2- 172.21.15.50:0/40365428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a746e40 0x560f3a74ef30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.668+0000 7f0d9a000640 0 client.25946 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.668+0000 7f0db9a31740 1 -- 172.21.15.50:0/40365428 >> 172.21.15.50:0/40365428 conn(0x560f3a7433d0 msgr2=0x560f3a749100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.668+0000 7f0db9a31740 1 -- 172.21.15.50:0/40365428 shutdown_connections 2024-09-10T10:13:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.669+0000 7f0db9a31740 1 -- 172.21.15.50:0/40365428 wait complete. 2024-09-10T10:13:56.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.669+0000 7f0db9a31740 20 client.25946 trim_cache size 0 max 16384 2024-09-10T10:13:56.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.682+0000 7f0db9a31740 1 Processor -- start 2024-09-10T10:13:56.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.682+0000 7f0db9a31740 1 -- start start 2024-09-10T10:13:56.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.683+0000 7f0db9a31740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a746e40 0x560f3a7498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.683+0000 7f0db9a31740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a7697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.683+0000 7f0db9a31740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a769d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.683+0000 7f0db9a31740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0db01b7a30 con 0x560f3a752020 2024-09-10T10:13:56.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.683+0000 7f0db9a31740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0db01b5300 con 0x560f3a747760 2024-09-10T10:13:56.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.683+0000 7f0db9a31740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0db01b3150 con 0x560f3a746e40 2024-09-10T10:13:56.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.683+0000 7f0db4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a769d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.683+0000 7f0dafe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a746e40 0x560f3a7498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.683+0000 7f0db4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a769d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48328/0 (socket says 172.21.15.50:48328) 2024-09-10T10:13:56.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.683+0000 7f0db4e00640 1 -- 172.21.15.50:0/1017639020 learned_addr learned my addr 172.21.15.50:0/1017639020 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:56.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.683+0000 7f0daf400640 1 --2- 172.21.15.50:0/1017639020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a7697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.683+0000 7f0dafe00640 1 -- 172.21.15.50:0/1017639020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 msgr2=0x560f3a7697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:56.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.683+0000 7f0dafe00640 1 --2- 172.21.15.50:0/1017639020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a7697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.684+0000 7f0dafe00640 1 -- 172.21.15.50:0/1017639020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 msgr2=0x560f3a769d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:56.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.684+0000 7f0dafe00640 1 --2- 172.21.15.50:0/1017639020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a769d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.684+0000 7f0dafe00640 1 -- 172.21.15.50:0/1017639020 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f3a743200 con 0x560f3a746e40 2024-09-10T10:13:56.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.684+0000 7f0dafe00640 1 --2- 172.21.15.50:0/1017639020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a746e40 0x560f3a7498a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0da00b8890 tx=0x7f0da003b5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16e6595e7e5189f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:56.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.684+0000 7f0da4c00640 1 -- 172.21.15.50:0/1017639020 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da0049070 con 0x560f3a746e40 2024-09-10T10:13:56.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.684+0000 7f0da4c00640 1 -- 172.21.15.50:0/1017639020 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0da00f2e50 con 0x560f3a746e40 2024-09-10T10:13:56.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.684+0000 7f0da4c00640 1 -- 172.21.15.50:0/1017639020 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da00bb820 con 0x560f3a746e40 2024-09-10T10:13:56.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.685+0000 7f0db9a31740 1 -- 172.21.15.50:0/1017639020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a746e40 msgr2=0x560f3a7498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:56.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.685+0000 7f0db9a31740 1 --2- 172.21.15.50:0/1017639020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a746e40 0x560f3a7498a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0da00b8890 tx=0x7f0da003b5d0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.685+0000 7f0db9a31740 1 -- 172.21.15.50:0/1017639020 shutdown_connections 2024-09-10T10:13:56.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.685+0000 7f0db9a31740 1 --2- 172.21.15.50:0/1017639020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a769d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.685+0000 7f0db9a31740 1 --2- 172.21.15.50:0/1017639020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a7697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.685+0000 7f0db9a31740 1 --2- 172.21.15.50:0/1017639020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a746e40 0x560f3a7498a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.685+0000 7f0db9a31740 1 -- 172.21.15.50:0/1017639020 >> 172.21.15.50:0/1017639020 conn(0x560f3a7433d0 msgr2=0x560f3a750fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:56.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.685+0000 7f0db9a31740 1 -- 172.21.15.50:0/1017639020 shutdown_connections 2024-09-10T10:13:56.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.685+0000 7f0db9a31740 1 -- 172.21.15.50:0/1017639020 wait complete. 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.685+0000 7f0db9a31740 1 -- start start 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.686+0000 7f0db9a31740 1 Processor -- start 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.686+0000 7f0db9a31740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a746e40 0x560f3a7559d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.686+0000 7f0db9a31740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a755f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.686+0000 7f0db9a31740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a756450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.686+0000 7f0db9a31740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0db01b37c0 con 0x560f3a752020 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.686+0000 7f0db9a31740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0db01b4c30 con 0x560f3a747760 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.686+0000 7f0db9a31740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0db01b3e90 con 0x560f3a746e40 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.686+0000 7f0db9a31740 10 client.0 _ll_register_callbacks cb 0x7f0da8009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.686+0000 7f0db4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a756450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.686+0000 7f0db4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a756450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48340/0 (socket says 172.21.15.50:48340) 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.686+0000 7f0daf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a755f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.686+0000 7f0db4e00640 1 -- 172.21.15.50:0/2516042960 learned_addr learned my addr 172.21.15.50:0/2516042960 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.686+0000 7f0dafe00640 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a746e40 0x560f3a7559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.687+0000 7f0daf400640 1 -- 172.21.15.50:0/2516042960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a746e40 msgr2=0x560f3a7559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:56.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.687+0000 7f0daf400640 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a746e40 0x560f3a7559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.687+0000 7f0daf400640 1 -- 172.21.15.50:0/2516042960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 msgr2=0x560f3a756450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:56.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.687+0000 7f0daf400640 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a756450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.687+0000 7f0daf400640 1 -- 172.21.15.50:0/2516042960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f3a7cb7c0 con 0x560f3a747760 2024-09-10T10:13:56.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.687+0000 7f0dafe00640 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a746e40 0x560f3a7559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:56.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.687+0000 7f0db4e00640 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a756450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:56.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.687+0000 7f0daf400640 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a755f10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x560f3a7504e0 tx=0x7f0d9c01f7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6104f2b993d80ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:56.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.687+0000 7f0d9a000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:13:56.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.687+0000 7f0d9a000640 1 -- 172.21.15.50:0/2516042960 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c005220 con 0x560f3a747760 2024-09-10T10:13:56.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.688+0000 7f0db9a31740 1 -- 172.21.15.50:0/2516042960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0da00f2e50 con 0x560f3a747760 2024-09-10T10:13:56.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.688+0000 7f0d9a000640 1 -- 172.21.15.50:0/2516042960 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f0d9c0053c0 con 0x560f3a747760 2024-09-10T10:13:56.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.688+0000 7f0d9a000640 1 -- 172.21.15.50:0/2516042960 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0d9c031050 con 0x560f3a747760 2024-09-10T10:13:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.688+0000 7f0db9a31740 10 client.25952 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.688+0000 7f0db9a31740 1 -- 172.21.15.50:0/2516042960 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560f3a7ccab0 con 0x560f3a747760 2024-09-10T10:13:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.688+0000 7f0d9a000640 1 -- 172.21.15.50:0/2516042960 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0da00f2e50 con 0x560f3a747760 2024-09-10T10:13:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.688+0000 7f0d9a000640 1 -- 172.21.15.50:0/2516042960 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f0d9c029600 con 0x560f3a747760 2024-09-10T10:13:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.688+0000 7f0db9a31740 10 client.25952 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.688+0000 7f0db9a31740 10 client.25952 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:13:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.688+0000 7f0db9a31740 20 client.25952 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.688+0000 7f0db9a31740 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x560f3a7cd230 0x560f3a7cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.688+0000 7f0db9a31740 4 client.25952 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:13:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.688+0000 7f0db9a31740 1 -- 172.21.15.50:0/2516042960 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560f3a6b4e60 con 0x560f3a7cd230 2024-09-10T10:13:56.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.689+0000 7f0dafe00640 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x560f3a7cd230 0x560f3a7cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.689+0000 7f0dafe00640 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x560f3a7cd230 0x560f3a7cf650 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cd4e55ae6e807306 server_cookie=bd148154a61eb0b6 in_seq=0 out_seq=0 2024-09-10T10:13:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.689+0000 7f0d9a000640 10 client.25952 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.689+0000 7f0d9a000640 1 -- 172.21.15.50:0/2516042960 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560f3a6b4e60 con 0x560f3a7cd230 2024-09-10T10:13:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.689+0000 7f0d9a000640 10 client.25952 handle_command_reply: tid=0 2024-09-10T10:13:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.689+0000 7f0db9a31740 1 client.25952 shutdown 2024-09-10T10:13:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.690+0000 7f0db9a31740 1 -- 172.21.15.50:0/2516042960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 msgr2=0x560f3a755f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.690+0000 7f0db9a31740 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a755f10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x560f3a7504e0 tx=0x7f0d9c01f7c0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.690+0000 7f0db9a31740 1 -- 172.21.15.50:0/2516042960 shutdown_connections 2024-09-10T10:13:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.690+0000 7f0db9a31740 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x560f3a7cd230 0x560f3a7cf650 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.690+0000 7f0db9a31740 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f3a752020 0x560f3a756450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.690+0000 7f0db9a31740 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f3a747760 0x560f3a755f10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.690+0000 7f0db9a31740 1 --2- 172.21.15.50:0/2516042960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f3a746e40 0x560f3a7559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.690+0000 7f0d9a000640 0 client.25952 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:13:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.690+0000 7f0db9a31740 1 -- 172.21.15.50:0/2516042960 >> 172.21.15.50:0/2516042960 conn(0x560f3a7433d0 msgr2=0x560f3a741c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.690+0000 7f0db9a31740 1 -- 172.21.15.50:0/2516042960 shutdown_connections 2024-09-10T10:13:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.690+0000 7f0db9a31740 1 -- 172.21.15.50:0/2516042960 wait complete. 2024-09-10T10:13:56.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.690+0000 7f0db9a31740 20 client.25952 trim_cache size 0 max 16384 2024-09-10T10:13:56.695 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:13:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.691+0000 7f0db5800640 1 -- 172.21.15.50:0/550789036 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d940a2c00 msgr2=0x7f0d940a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.691+0000 7f0db5800640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d940a2c00 0x7f0d940a50c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0da80049d0 tx=0x7f0da8009600 comp rx=0 tx=0).stop 2024-09-10T10:13:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.691+0000 7f0db5800640 1 -- 172.21.15.50:0/550789036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db0076720 msgr2=0x7f0db01a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.691+0000 7f0db5800640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db0076720 0x7f0db01a4640 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0da0006010 tx=0x7f0da00042f0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.691+0000 7f0db5800640 1 -- 172.21.15.50:0/550789036 shutdown_connections 2024-09-10T10:13:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.691+0000 7f0db5800640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f0d940a2c00 0x7f0d940a50c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.691+0000 7f0db5800640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0db0112870 0x7f0db019e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.691+0000 7f0db5800640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0db0077040 0x7f0db01a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.691+0000 7f0db5800640 1 --2- 172.21.15.50:0/550789036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0db0076720 0x7f0db01a4640 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:56.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.691+0000 7f0db5800640 1 -- 172.21.15.50:0/550789036 >> 172.21.15.50:0/550789036 conn(0x7f0db00ff8d0 msgr2=0x7f0db0101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:56.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.691+0000 7f0db5800640 1 -- 172.21.15.50:0/550789036 shutdown_connections 2024-09-10T10:13:56.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:56.691+0000 7f0db5800640 1 -- 172.21.15.50:0/550789036 wait complete. 2024-09-10T10:13:57.324 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:13:57.325 INFO:tasks.workunit.client.0.smithi050.stdout: Children see throughput for 1 re-readers = 3564124.25 kB/sec 2024-09-10T10:13:57.325 INFO:tasks.workunit.client.0.smithi050.stdout: Parent sees throughput for 1 re-readers = 3556943.81 kB/sec 2024-09-10T10:13:57.325 INFO:tasks.workunit.client.0.smithi050.stdout: Min throughput per process = 3564124.25 kB/sec 2024-09-10T10:13:57.325 INFO:tasks.workunit.client.0.smithi050.stdout: Max throughput per process = 3564124.25 kB/sec 2024-09-10T10:13:57.325 INFO:tasks.workunit.client.0.smithi050.stdout: Avg throughput per process = 3564124.25 kB/sec 2024-09-10T10:13:57.325 INFO:tasks.workunit.client.0.smithi050.stdout: Min xfer = 1048576.00 kB 2024-09-10T10:13:57.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T10:13:58.208 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:13:58.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:57 smithi050 ceph-mon[30354]: pgmap v474: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 156 MiB/s wr, 46 op/s 2024-09-10T10:13:58.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:57 smithi189 ceph-mon[34999]: pgmap v474: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 156 MiB/s wr, 46 op/s 2024-09-10T10:13:58.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:57 smithi084 ceph-mon[34812]: pgmap v474: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 156 MiB/s wr, 46 op/s 2024-09-10T10:13:58.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.784+0000 7f7f9f000640 1 -- 172.21.15.50:0/2003462603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f981079c0 msgr2=0x7f7f98107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.784+0000 7f7f9f000640 1 --2- 172.21.15.50:0/2003462603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f981079c0 0x7f7f98107da0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009900 tx=0x7f7f8c02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.784+0000 7f7f9f000640 1 -- 172.21.15.50:0/2003462603 shutdown_connections 2024-09-10T10:13:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.784+0000 7f7f9f000640 1 --2- 172.21.15.50:0/2003462603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f98102360 0x7f7f9810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.784+0000 7f7f9f000640 1 --2- 172.21.15.50:0/2003462603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f981019c0 0x7f7f98101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.784+0000 7f7f9f000640 1 --2- 172.21.15.50:0/2003462603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f981079c0 0x7f7f98107da0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.784+0000 7f7f9f000640 1 -- 172.21.15.50:0/2003462603 >> 172.21.15.50:0/2003462603 conn(0x7f7f980fd6e0 msgr2=0x7f7f980ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:58.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.784+0000 7f7f9f000640 1 -- 172.21.15.50:0/2003462603 shutdown_connections 2024-09-10T10:13:58.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.784+0000 7f7f9f000640 1 -- 172.21.15.50:0/2003462603 wait complete. 2024-09-10T10:13:58.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.785+0000 7f7f9f000640 1 Processor -- start 2024-09-10T10:13:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.785+0000 7f7f9f000640 1 -- start start 2024-09-10T10:13:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.785+0000 7f7f9f000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f981019c0 0x7f7f9819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.785+0000 7f7f9f000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f98102360 0x7f7f9819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.785+0000 7f7f9f000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f981079c0 0x7f7f9819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.785+0000 7f7f9f000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f98111d90 con 0x7f7f98102360 2024-09-10T10:13:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.785+0000 7f7f9f000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7f98111c10 con 0x7f7f981079c0 2024-09-10T10:13:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.785+0000 7f7f9f000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f98111f10 con 0x7f7f981019c0 2024-09-10T10:13:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.786+0000 7f7f9d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f98102360 0x7f7f9819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.786+0000 7f7f9e600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f981079c0 0x7f7f9819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.786+0000 7f7f9d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f98102360 0x7f7f9819a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53026/0 (socket says 172.21.15.50:53026) 2024-09-10T10:13:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.786+0000 7f7f9d200640 1 -- 172.21.15.50:0/288416287 learned_addr learned my addr 172.21.15.50:0/288416287 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.786+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f981019c0 0x7f7f9819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.786+0000 7f7f9e600640 1 -- 172.21.15.50:0/288416287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f981019c0 msgr2=0x7f7f9819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.786+0000 7f7f9e600640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f981019c0 0x7f7f9819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.786+0000 7f7f9e600640 1 -- 172.21.15.50:0/288416287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f98102360 msgr2=0x7f7f9819a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.786+0000 7f7f9e600640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f98102360 0x7f7f9819a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.786+0000 7f7f9e600640 1 -- 172.21.15.50:0/288416287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9819f3b0 con 0x7f7f981079c0 2024-09-10T10:13:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.786+0000 7f7f9d200640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f98102360 0x7f7f9819a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.787+0000 7f7f9e600640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f981079c0 0x7f7f9819ecd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009fd0 tx=0x7f7f9000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.787+0000 7f7f96000640 1 -- 172.21.15.50:0/288416287 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9000ce20 con 0x7f7f981079c0 2024-09-10T10:13:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.787+0000 7f7f96000640 1 -- 172.21.15.50:0/288416287 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f90005020 con 0x7f7f981079c0 2024-09-10T10:13:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.787+0000 7f7f96000640 1 -- 172.21.15.50:0/288416287 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90010720 con 0x7f7f981079c0 2024-09-10T10:13:58.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.787+0000 7f7f9f000640 1 -- 172.21.15.50:0/288416287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9819f6a0 con 0x7f7f981079c0 2024-09-10T10:13:58.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.787+0000 7f7f9f000640 1 -- 172.21.15.50:0/288416287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f981a6f80 con 0x7f7f981079c0 2024-09-10T10:13:58.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.790+0000 7f7fa3002740 1 Processor -- start 2024-09-10T10:13:58.791 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.790+0000 7f7f96000640 1 -- 172.21.15.50:0/288416287 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7f90005540 con 0x7f7f981079c0 2024-09-10T10:13:58.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.791+0000 7f7fa3002740 1 -- start start 2024-09-10T10:13:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.791+0000 7f7fa3002740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ece40 0x5602d13ed220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.791+0000 7f7fa3002740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 0x5602d13f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.791+0000 7f7fa3002740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13f8020 0x5602d13fa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.791+0000 7f7fa3002740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5602d13533e0 con 0x5602d13ed760 2024-09-10T10:13:58.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.791+0000 7f7fa3002740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5602d12fad80 con 0x5602d13f8020 2024-09-10T10:13:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.791+0000 7f7fa3002740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5602d134f3a0 con 0x5602d13ece40 2024-09-10T10:13:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.791+0000 7f7f9dc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 0x5602d13f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.791+0000 7f7f9d200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ece40 0x5602d13ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f9dc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 0x5602d13f7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53028/0 (socket says 172.21.15.50:53028) 2024-09-10T10:13:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f9dc00640 1 -- 172.21.15.50:0/4267416848 learned_addr learned my addr 172.21.15.50:0/4267416848 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f9d200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ece40 0x5602d13ed220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:46074/0 (socket says 172.21.15.50:46074) 2024-09-10T10:13:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f9d200640 1 --2- 172.21.15.50:0/4267416848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13f8020 0x5602d13fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f9dc00640 1 -- 172.21.15.50:0/4267416848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ece40 msgr2=0x5602d13ed220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/4267416848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ece40 0x5602d13ed220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f9dc00640 1 -- 172.21.15.50:0/4267416848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13f8020 msgr2=0x5602d13fa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/4267416848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13f8020 0x5602d13fa410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f9dc00640 1 -- 172.21.15.50:0/4267416848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602d1319ae0 con 0x5602d13ed760 2024-09-10T10:13:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f9d200640 1 --2- 172.21.15.50:0/4267416848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ece40 0x5602d13ed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f96000640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7f800a2b80 0x7f7f800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f96000640 1 -- 172.21.15.50:0/288416287 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f7f900cfab0 con 0x7f7f981079c0 2024-09-10T10:13:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/4267416848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 0x5602d13f7ae0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c02a910 tx=0x7f7f8c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8500bc65d2a0b9cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.792+0000 7f7f9d200640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7f800a2b80 0x7f7f800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.793+0000 7f7f8aa00640 1 -- 172.21.15.50:0/4267416848 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c035030 con 0x5602d13ed760 2024-09-10T10:13:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.793+0000 7f7f8aa00640 1 -- 172.21.15.50:0/4267416848 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8c040070 con 0x5602d13ed760 2024-09-10T10:13:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.793+0000 7f7f8aa00640 1 -- 172.21.15.50:0/4267416848 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c031830 con 0x5602d13ed760 2024-09-10T10:13:58.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.793+0000 7f7fa3002740 1 -- 172.21.15.50:0/4267416848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 msgr2=0x5602d13f7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.793+0000 7f7fa3002740 1 --2- 172.21.15.50:0/4267416848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 0x5602d13f7ae0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c02a910 tx=0x7f7f8c005dd0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.793+0000 7f7f9d200640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7f800a2b80 0x7f7f800a5040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x5602d13ea750 tx=0x7f7f84005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.794+0000 7f7fa3002740 1 -- 172.21.15.50:0/4267416848 shutdown_connections 2024-09-10T10:13:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.794+0000 7f7fa3002740 1 --2- 172.21.15.50:0/4267416848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13f8020 0x5602d13fa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.794+0000 7f7fa3002740 1 --2- 172.21.15.50:0/4267416848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 0x5602d13f7ae0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.794+0000 7f7fa3002740 1 --2- 172.21.15.50:0/4267416848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ece40 0x5602d13ed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.794+0000 7f7fa3002740 1 -- 172.21.15.50:0/4267416848 >> 172.21.15.50:0/4267416848 conn(0x5602d13e93d0 msgr2=0x5602d13e97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.794+0000 7f7fa3002740 1 -- 172.21.15.50:0/4267416848 shutdown_connections 2024-09-10T10:13:58.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.794+0000 7f7fa3002740 1 -- 172.21.15.50:0/4267416848 wait complete. 2024-09-10T10:13:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.794+0000 7f7fa3002740 1 -- start start 2024-09-10T10:13:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.794+0000 7f7fa3002740 1 Processor -- start 2024-09-10T10:13:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.795+0000 7f7fa3002740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d13f4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.795+0000 7f7fa3002740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 0x5602d13f5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.795+0000 7f7fa3002740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13f8020 0x5602d13f5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.795+0000 7f7fa3002740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5602d13fabf0 con 0x5602d13ed760 2024-09-10T10:13:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.795+0000 7f7fa3002740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5602d130e0f0 con 0x5602d13ece40 2024-09-10T10:13:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.795+0000 7f7fa3002740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5602d13fad70 con 0x5602d13f8020 2024-09-10T10:13:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.795+0000 7f7fa3002740 10 client.0 _ll_register_callbacks cb 0x5602d12f5bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.795+0000 7f7f9d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 0x5602d13f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.795+0000 7f7f9d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 0x5602d13f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53044/0 (socket says 172.21.15.50:53044) 2024-09-10T10:13:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.795+0000 7f7f9d200640 1 -- 172.21.15.50:0/609601847 learned_addr learned my addr 172.21.15.50:0/609601847 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.795+0000 7f7f9e600640 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13f8020 0x5602d13f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.795+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d13f4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.796+0000 7f7f9d200640 1 -- 172.21.15.50:0/609601847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13f8020 msgr2=0x5602d13f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.796+0000 7f7f9d200640 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13f8020 0x5602d13f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.796+0000 7f7f9d200640 1 -- 172.21.15.50:0/609601847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 msgr2=0x5602d13f4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.796+0000 7f7f9d200640 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d13f4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.796+0000 7f7f9d200640 1 -- 172.21.15.50:0/609601847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602d10c43c0 con 0x5602d13ed760 2024-09-10T10:13:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.796+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d13f4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.796+0000 7f7f9e600640 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13f8020 0x5602d13f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:13:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.796+0000 7f7f9d200640 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 0x5602d13f5400 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7f84011f50 tx=0x7f7f840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffbe766863bafc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.796+0000 7f7f7f400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:13:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.796+0000 7f7f7f400640 1 -- 172.21.15.50:0/609601847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84022b40 con 0x5602d13ed760 2024-09-10T10:13:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.796+0000 7f7fa3002740 1 -- 172.21.15.50:0/609601847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f8c040070 con 0x5602d13ed760 2024-09-10T10:13:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.796+0000 7f7f7f400640 1 -- 172.21.15.50:0/609601847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f7f84022ce0 con 0x5602d13ed760 2024-09-10T10:13:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.797+0000 7f7f7f400640 1 -- 172.21.15.50:0/609601847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7f84005020 con 0x5602d13ed760 2024-09-10T10:13:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.797+0000 7f7fa3002740 10 client.15915 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:58.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.797+0000 7f7fa3002740 1 -- 172.21.15.50:0/609601847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5602d1406cf0 con 0x5602d13ed760 2024-09-10T10:13:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.797+0000 7f7f7f400640 1 -- 172.21.15.50:0/609601847 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8c040070 con 0x5602d13ed760 2024-09-10T10:13:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.797+0000 7f7f7f400640 1 -- 172.21.15.50:0/609601847 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7f84029070 con 0x5602d13ed760 2024-09-10T10:13:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.797+0000 7f7fa3002740 10 client.15915 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.797+0000 7f7fa3002740 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:58.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.797+0000 7f7fa3002740 20 client.15915 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.797+0000 7f7fa3002740 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5602d14081a0 0x5602d140a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.797+0000 7f7fa3002740 4 client.15915 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:13:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.798+0000 7f7fa3002740 1 -- 172.21.15.50:0/609601847 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602d1360950 con 0x5602d14081a0 2024-09-10T10:13:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.798+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5602d14081a0 0x5602d140a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.798+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5602d14081a0 0x5602d140a5c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c99e49c64787951 server_cookie=3e72b155bde70837 in_seq=0 out_seq=0 2024-09-10T10:13:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.798+0000 7f7f7f400640 10 client.15915 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.799+0000 7f7f7f400640 1 -- 172.21.15.50:0/609601847 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5602d1360950 con 0x5602d14081a0 2024-09-10T10:13:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.799+0000 7f7f7f400640 10 client.15915 handle_command_reply: tid=0 2024-09-10T10:13:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.799+0000 7f7fa3002740 1 client.15915 shutdown 2024-09-10T10:13:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.800+0000 7f7fa3002740 1 -- 172.21.15.50:0/609601847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 msgr2=0x5602d13f5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.800+0000 7f7fa3002740 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 0x5602d13f5400 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7f84011f50 tx=0x7f7f840046c0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.800+0000 7f7fa3002740 1 -- 172.21.15.50:0/609601847 shutdown_connections 2024-09-10T10:13:58.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.800+0000 7f7fa3002740 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5602d14081a0 0x5602d140a5c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.800+0000 7f7fa3002740 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13f8020 0x5602d13f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.800+0000 7f7fa3002740 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13ed760 0x5602d13f5400 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.800+0000 7f7fa3002740 1 --2- 172.21.15.50:0/609601847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d13f4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.800+0000 7f7fa3002740 1 -- 172.21.15.50:0/609601847 >> 172.21.15.50:0/609601847 conn(0x5602d13e93d0 msgr2=0x5602d13ef0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.800+0000 7f7f7f400640 0 client.15915 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.800+0000 7f7fa3002740 1 -- 172.21.15.50:0/609601847 shutdown_connections 2024-09-10T10:13:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.800+0000 7f7fa3002740 1 -- 172.21.15.50:0/609601847 wait complete. 2024-09-10T10:13:58.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.800+0000 7f7fa3002740 20 client.15915 trim_cache size 0 max 16384 2024-09-10T10:13:58.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7fa3002740 1 Processor -- start 2024-09-10T10:13:58.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7fa3002740 1 -- start start 2024-09-10T10:13:58.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7fa3002740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d13f4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7fa3002740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ed760 0x5602d13f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7fa3002740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13f8020 0x5602d140fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7fa3002740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f981b3530 con 0x5602d13f8020 2024-09-10T10:13:58.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7fa3002740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7f981b0e00 con 0x5602d13ece40 2024-09-10T10:13:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7fa3002740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f981aec50 con 0x5602d13ed760 2024-09-10T10:13:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7f9e600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13f8020 0x5602d140fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7f9dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d13f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7f9e600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13f8020 0x5602d140fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53048/0 (socket says 172.21.15.50:53048) 2024-09-10T10:13:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7f9e600640 1 -- 172.21.15.50:0/553013610 learned_addr learned my addr 172.21.15.50:0/553013610 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7f9d200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ed760 0x5602d13f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.814+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/553013610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d13f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:52156/0 (socket says 172.21.15.50:52156) 2024-09-10T10:13:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.815+0000 7f7f9dc00640 1 -- 172.21.15.50:0/553013610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ed760 msgr2=0x5602d13f6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.815+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/553013610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ed760 0x5602d13f6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.815+0000 7f7f9dc00640 1 -- 172.21.15.50:0/553013610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13f8020 msgr2=0x5602d140fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:58.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.815+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/553013610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13f8020 0x5602d140fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.815+0000 7f7f9dc00640 1 -- 172.21.15.50:0/553013610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602d13e9200 con 0x5602d13ece40 2024-09-10T10:13:58.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.815+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/553013610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d13f4780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c006010 tx=0x7f7f8c0045b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af58a3658b3eece4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.815+0000 7f7f8a000640 1 -- 172.21.15.50:0/553013610 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c035040 con 0x5602d13ece40 2024-09-10T10:13:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.815+0000 7f7f8a000640 1 -- 172.21.15.50:0/553013610 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8c040030 con 0x5602d13ece40 2024-09-10T10:13:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.815+0000 7f7f8a000640 1 -- 172.21.15.50:0/553013610 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0035f0 con 0x5602d13ece40 2024-09-10T10:13:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.816+0000 7f7fa3002740 1 -- 172.21.15.50:0/553013610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 msgr2=0x5602d13f4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.816+0000 7f7fa3002740 1 --2- 172.21.15.50:0/553013610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d13f4780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c006010 tx=0x7f7f8c0045b0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.816+0000 7f7fa3002740 1 -- 172.21.15.50:0/553013610 shutdown_connections 2024-09-10T10:13:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.816+0000 7f7fa3002740 1 --2- 172.21.15.50:0/553013610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13f8020 0x5602d140fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.816+0000 7f7fa3002740 1 --2- 172.21.15.50:0/553013610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ed760 0x5602d13f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.816+0000 7f7fa3002740 1 --2- 172.21.15.50:0/553013610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d13f4780 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.816+0000 7f7fa3002740 1 -- 172.21.15.50:0/553013610 >> 172.21.15.50:0/553013610 conn(0x5602d13e93d0 msgr2=0x5602d13f6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:58.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.816+0000 7f7fa3002740 1 -- 172.21.15.50:0/553013610 shutdown_connections 2024-09-10T10:13:58.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.816+0000 7f7fa3002740 1 -- 172.21.15.50:0/553013610 wait complete. 2024-09-10T10:13:58.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.817+0000 7f7fa3002740 1 -- start start 2024-09-10T10:13:58.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.817+0000 7f7fa3002740 1 Processor -- start 2024-09-10T10:13:58.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.817+0000 7f7fa3002740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d14005e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.817+0000 7f7fa3002740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ed760 0x5602d13fb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.817+0000 7f7fa3002740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13f8020 0x5602d13fbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.817+0000 7f7fa3002740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f981af2c0 con 0x5602d13f8020 2024-09-10T10:13:58.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.817+0000 7f7fa3002740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7f981b0730 con 0x5602d13ece40 2024-09-10T10:13:58.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.817+0000 7f7fa3002740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f981af990 con 0x5602d13ed760 2024-09-10T10:13:58.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.817+0000 7f7fa3002740 10 client.0 _ll_register_callbacks cb 0x7f7f84011db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:13:58.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.818+0000 7f7f9e600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13f8020 0x5602d13fbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.818+0000 7f7f9dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d14005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.818+0000 7f7f9e600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13f8020 0x5602d13fbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53050/0 (socket says 172.21.15.50:53050) 2024-09-10T10:13:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.818+0000 7f7f9e600640 1 -- 172.21.15.50:0/395699298 learned_addr learned my addr 172.21.15.50:0/395699298 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:13:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.818+0000 7f7f9d200640 1 --2- 172.21.15.50:0/395699298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ed760 0x5602d13fb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.818+0000 7f7f9e600640 1 -- 172.21.15.50:0/395699298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ed760 msgr2=0x5602d13fb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.818+0000 7f7f9e600640 1 --2- 172.21.15.50:0/395699298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ed760 0x5602d13fb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.818+0000 7f7f9e600640 1 -- 172.21.15.50:0/395699298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 msgr2=0x5602d14005e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:13:58.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.818+0000 7f7f9e600640 1 --2- 172.21.15.50:0/395699298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d14005e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.818+0000 7f7f9e600640 1 -- 172.21.15.50:0/395699298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602d13e8c80 con 0x5602d13f8020 2024-09-10T10:13:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.818+0000 7f7f9e600640 1 --2- 172.21.15.50:0/395699298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13f8020 0x5602d13fbe50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7f900bc190 tx=0x7f7f900cd090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0607e86dca770ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:13:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.818+0000 7f7f7f400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:13:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7f7f400640 1 -- 172.21.15.50:0/395699298 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f900a4b90 con 0x5602d13f8020 2024-09-10T10:13:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7f7f400640 1 -- 172.21.15.50:0/395699298 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f7f900bab60 con 0x5602d13f8020 2024-09-10T10:13:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7fa3002740 1 -- 172.21.15.50:0/395699298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f8c040030 con 0x5602d13f8020 2024-09-10T10:13:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7f7f400640 1 -- 172.21.15.50:0/395699298 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7f900bad60 con 0x5602d13f8020 2024-09-10T10:13:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7fa3002740 10 client.15921 fetch_fsmap learned FSMap version 25 2024-09-10T10:13:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7fa3002740 1 -- 172.21.15.50:0/395699298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5602d1472b50 con 0x5602d13f8020 2024-09-10T10:13:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7f7f400640 1 -- 172.21.15.50:0/395699298 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8c040030 con 0x5602d13f8020 2024-09-10T10:13:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7f7f400640 1 -- 172.21.15.50:0/395699298 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7f9009ade0 con 0x5602d13f8020 2024-09-10T10:13:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7fa3002740 10 client.15921 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:13:58.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7fa3002740 10 client.15921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:13:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7fa3002740 20 client.15921 populate_metadata read hostname 'smithi050' 2024-09-10T10:13:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7fa3002740 1 --2- 172.21.15.50:0/395699298 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5602d14732c0 0x5602d14756e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:13:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7fa3002740 4 client.15921 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:13:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.819+0000 7f7fa3002740 1 -- 172.21.15.50:0/395699298 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5602d135ae60 con 0x5602d14732c0 2024-09-10T10:13:58.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.820+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/395699298 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5602d14732c0 0x5602d14756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:13:58.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.820+0000 7f7f9dc00640 1 --2- 172.21.15.50:0/395699298 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5602d14732c0 0x5602d14756e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d4549042a66318b server_cookie=61ef6ed0d4ec6678 in_seq=0 out_seq=0 2024-09-10T10:13:58.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.820+0000 7f7f7f400640 10 client.15921 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:58.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7f7f400640 1 -- 172.21.15.50:0/395699298 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5602d135ae60 con 0x5602d14732c0 2024-09-10T10:13:58.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7f7f400640 10 client.15921 handle_command_reply: tid=0 2024-09-10T10:13:58.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7fa3002740 1 client.15921 shutdown 2024-09-10T10:13:58.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7fa3002740 1 -- 172.21.15.50:0/395699298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13f8020 msgr2=0x5602d13fbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:58.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7fa3002740 1 --2- 172.21.15.50:0/395699298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13f8020 0x5602d13fbe50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7f900bc190 tx=0x7f7f900cd090 comp rx=0 tx=0).stop 2024-09-10T10:13:58.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7fa3002740 1 -- 172.21.15.50:0/395699298 shutdown_connections 2024-09-10T10:13:58.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7fa3002740 1 --2- 172.21.15.50:0/395699298 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5602d14732c0 0x5602d14756e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7fa3002740 1 --2- 172.21.15.50:0/395699298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5602d13f8020 0x5602d13fbe50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7fa3002740 1 --2- 172.21.15.50:0/395699298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d13ed760 0x5602d13fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7f7f400640 0 client.15921 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:13:58.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7fa3002740 1 --2- 172.21.15.50:0/395699298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5602d13ece40 0x5602d14005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7fa3002740 1 -- 172.21.15.50:0/395699298 >> 172.21.15.50:0/395699298 conn(0x5602d13e93d0 msgr2=0x5602d13e8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:58.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7fa3002740 1 -- 172.21.15.50:0/395699298 shutdown_connections 2024-09-10T10:13:58.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7fa3002740 1 -- 172.21.15.50:0/395699298 wait complete. 2024-09-10T10:13:58.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.821+0000 7f7fa3002740 20 client.15921 trim_cache size 0 max 16384 2024-09-10T10:13:58.828 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:13:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.822+0000 7f7f9f000640 1 -- 172.21.15.50:0/288416287 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7f800a2b80 msgr2=0x7f7f800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.822+0000 7f7f9f000640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7f800a2b80 0x7f7f800a5040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x5602d13ea750 tx=0x7f7f84005f90 comp rx=0 tx=0).stop 2024-09-10T10:13:58.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.822+0000 7f7f9f000640 1 -- 172.21.15.50:0/288416287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f981079c0 msgr2=0x7f7f9819ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:13:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.822+0000 7f7f9f000640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f981079c0 0x7f7f9819ecd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009fd0 tx=0x7f7f9000ef10 comp rx=0 tx=0).stop 2024-09-10T10:13:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.822+0000 7f7f9f000640 1 -- 172.21.15.50:0/288416287 shutdown_connections 2024-09-10T10:13:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.822+0000 7f7f9f000640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f7f800a2b80 0x7f7f800a5040 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.822+0000 7f7f9f000640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f981079c0 0x7f7f9819ecd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.822+0000 7f7f9f000640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f98102360 0x7f7f9819a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.822+0000 7f7f9f000640 1 --2- 172.21.15.50:0/288416287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f981019c0 0x7f7f9819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:13:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.822+0000 7f7f9f000640 1 -- 172.21.15.50:0/288416287 >> 172.21.15.50:0/288416287 conn(0x7f7f980fd6e0 msgr2=0x7f7f9810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:13:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.822+0000 7f7f9f000640 1 -- 172.21.15.50:0/288416287 shutdown_connections 2024-09-10T10:13:58.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:13:58.822+0000 7f7f9f000640 1 -- 172.21.15.50:0/288416287 wait complete. 2024-09-10T10:14:00.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:13:59 smithi050 ceph-mon[30354]: pgmap v475: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 133 MiB/s wr, 39 op/s 2024-09-10T10:14:00.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:13:59 smithi189 ceph-mon[34999]: pgmap v475: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 133 MiB/s wr, 39 op/s 2024-09-10T10:14:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:13:59 smithi084 ceph-mon[34812]: pgmap v475: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 133 MiB/s wr, 39 op/s 2024-09-10T10:14:00.671 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T10:14:00.672 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T10:14:01.065 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:14:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.727+0000 7fa20f800640 1 -- 172.21.15.50:0/3907496146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa208112a50 msgr2=0x7fa208114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.727+0000 7fa20f800640 1 --2- 172.21.15.50:0/3907496146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa208112a50 0x7fa208114e40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa200009ca0 tx=0x7fa20002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.728+0000 7fa20f800640 1 -- 172.21.15.50:0/3907496146 shutdown_connections 2024-09-10T10:14:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.728+0000 7fa20f800640 1 --2- 172.21.15.50:0/3907496146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa208112a50 0x7fa208114e40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.728+0000 7fa20f800640 1 --2- 172.21.15.50:0/3907496146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa208077040 0x7fa208112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.728+0000 7fa20f800640 1 --2- 172.21.15.50:0/3907496146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa208076720 0x7fa208076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.728+0000 7fa20f800640 1 -- 172.21.15.50:0/3907496146 >> 172.21.15.50:0/3907496146 conn(0x7fa2080ffa50 msgr2=0x7fa208101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.728+0000 7fa20f800640 1 -- 172.21.15.50:0/3907496146 shutdown_connections 2024-09-10T10:14:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.728+0000 7fa20f800640 1 -- 172.21.15.50:0/3907496146 wait complete. 2024-09-10T10:14:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.728+0000 7fa20f800640 1 Processor -- start 2024-09-10T10:14:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.729+0000 7fa20f800640 1 -- start start 2024-09-10T10:14:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.729+0000 7fa20f800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa208076720 0x7fa20819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.729+0000 7fa20f800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa208077040 0x7fa20819f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.729+0000 7fa20f800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa208112a50 0x7fa2081a3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.729+0000 7fa20f800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081185f0 con 0x7fa208112a50 2024-09-10T10:14:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.729+0000 7fa20f800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa208118470 con 0x7fa208077040 2024-09-10T10:14:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.729+0000 7fa20f800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa208118770 con 0x7fa208076720 2024-09-10T10:14:01.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.729+0000 7fa20d800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa208112a50 0x7fa2081a3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.729+0000 7fa20d800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa208112a50 0x7fa2081a3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53074/0 (socket says 172.21.15.50:53074) 2024-09-10T10:14:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.729+0000 7fa20d800640 1 -- 172.21.15.50:0/1805064514 learned_addr learned my addr 172.21.15.50:0/1805064514 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.729+0000 7fa20ce00640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa208076720 0x7fa20819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.729+0000 7fa207e00640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa208077040 0x7fa20819f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.730+0000 7fa20d800640 1 -- 172.21.15.50:0/1805064514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa208076720 msgr2=0x7fa20819eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.730+0000 7fa20d800640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa208076720 0x7fa20819eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.730+0000 7fa20d800640 1 -- 172.21.15.50:0/1805064514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa208077040 msgr2=0x7fa20819f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.730+0000 7fa20d800640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa208077040 0x7fa20819f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.730+0000 7fa20d800640 1 -- 172.21.15.50:0/1805064514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2081a3bc0 con 0x7fa208112a50 2024-09-10T10:14:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.730+0000 7fa20d800640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa208112a50 0x7fa2081a3490 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa200005e30 tx=0x7fa200003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.730+0000 7fa205600640 1 -- 172.21.15.50:0/1805064514 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200031650 con 0x7fa208112a50 2024-09-10T10:14:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.730+0000 7fa20f800640 1 -- 172.21.15.50:0/1805064514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2081a3e50 con 0x7fa208112a50 2024-09-10T10:14:01.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.730+0000 7fa205600640 1 -- 172.21.15.50:0/1805064514 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2000317f0 con 0x7fa208112a50 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.730+0000 7fa205600640 1 -- 172.21.15.50:0/1805064514 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20002f970 con 0x7fa208112a50 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.731+0000 7fa20f800640 1 -- 172.21.15.50:0/1805064514 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2081ab740 con 0x7fa208112a50 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.733+0000 7fa205600640 1 -- 172.21.15.50:0/1805064514 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa20002fb50 con 0x7fa208112a50 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.733+0000 7fa212411740 1 Processor -- start 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.734+0000 7fa212411740 1 -- start start 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.734+0000 7fa212411740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 0x55dda849aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.734+0000 7fa212411740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849b3e0 0x55dda84a5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.734+0000 7fa212411740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda84a5ca0 0x55dda84a8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.734+0000 7fa212411740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dda8401290 con 0x55dda849aac0 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.734+0000 7fa212411740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dda83a8b40 con 0x55dda84a5ca0 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.734+0000 7fa212411740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dda83fd250 con 0x55dda849b3e0 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.734+0000 7fa207e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 0x55dda849aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.734+0000 7fa207e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 0x55dda849aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53076/0 (socket says 172.21.15.50:53076) 2024-09-10T10:14:01.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.734+0000 7fa207e00640 1 -- 172.21.15.50:0/2820673192 learned_addr learned my addr 172.21.15.50:0/2820673192 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.734+0000 7fa20ce00640 1 --2- 172.21.15.50:0/2820673192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849b3e0 0x55dda84a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.734+0000 7fa207e00640 1 --2- 172.21.15.50:0/2820673192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda84a5ca0 0x55dda84a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.735+0000 7fa207e00640 1 -- 172.21.15.50:0/2820673192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849b3e0 msgr2=0x55dda84a5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.735+0000 7fa207e00640 1 --2- 172.21.15.50:0/2820673192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849b3e0 0x55dda84a5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.735+0000 7fa207e00640 1 -- 172.21.15.50:0/2820673192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda84a5ca0 msgr2=0x55dda84a8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.735+0000 7fa207e00640 1 --2- 172.21.15.50:0/2820673192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda84a5ca0 0x55dda84a8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.735+0000 7fa207e00640 1 -- 172.21.15.50:0/2820673192 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dda81726a0 con 0x55dda849aac0 2024-09-10T10:14:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.735+0000 7fa20ce00640 1 --2- 172.21.15.50:0/2820673192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849b3e0 0x55dda84a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:14:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.735+0000 7fa205600640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa1f00a2b80 0x7fa1f00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.735+0000 7fa207e00640 1 --2- 172.21.15.50:0/2820673192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 0x55dda849aea0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40136f0 tx=0x7fa1f4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea24a9b0717220d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.735+0000 7fa205600640 1 -- 172.21.15.50:0/1805064514 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa2000f0650 con 0x7fa208112a50 2024-09-10T10:14:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.735+0000 7fa20ce00640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa1f00a2b80 0x7fa1f00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.735+0000 7fa1fa000640 1 -- 172.21.15.50:0/2820673192 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4013c70 con 0x55dda849aac0 2024-09-10T10:14:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.736+0000 7fa1fa000640 1 -- 172.21.15.50:0/2820673192 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1f4013e10 con 0x55dda849aac0 2024-09-10T10:14:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.736+0000 7fa1fa000640 1 -- 172.21.15.50:0/2820673192 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4004a00 con 0x55dda849aac0 2024-09-10T10:14:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.736+0000 7fa212411740 1 -- 172.21.15.50:0/2820673192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 msgr2=0x55dda849aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.736+0000 7fa20ce00640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa1f00a2b80 0x7fa1f00a5040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55dda8497eb0 tx=0x7fa1fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.736+0000 7fa212411740 1 --2- 172.21.15.50:0/2820673192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 0x55dda849aea0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40136f0 tx=0x7fa1f4005f90 comp rx=0 tx=0).stop 2024-09-10T10:14:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.736+0000 7fa212411740 1 -- 172.21.15.50:0/2820673192 shutdown_connections 2024-09-10T10:14:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.736+0000 7fa212411740 1 --2- 172.21.15.50:0/2820673192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda84a5ca0 0x55dda84a8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.736+0000 7fa212411740 1 --2- 172.21.15.50:0/2820673192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849b3e0 0x55dda84a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.736+0000 7fa212411740 1 --2- 172.21.15.50:0/2820673192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 0x55dda849aea0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.736+0000 7fa212411740 1 -- 172.21.15.50:0/2820673192 >> 172.21.15.50:0/2820673192 conn(0x55dda8497050 msgr2=0x55dda8497430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.736+0000 7fa212411740 1 -- 172.21.15.50:0/2820673192 shutdown_connections 2024-09-10T10:14:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.737+0000 7fa212411740 1 -- 172.21.15.50:0/2820673192 wait complete. 2024-09-10T10:14:01.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.737+0000 7fa212411740 1 -- start start 2024-09-10T10:14:01.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.737+0000 7fa212411740 1 Processor -- start 2024-09-10T10:14:01.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa212411740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849aac0 0x55dda84a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa212411740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849b3e0 0x55dda84a2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa212411740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda84a5ca0 0x55dda84a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa212411740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dda84a8910 con 0x55dda84a5ca0 2024-09-10T10:14:01.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa212411740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dda83bbfa0 con 0x55dda849aac0 2024-09-10T10:14:01.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa212411740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dda84a8a90 con 0x55dda849b3e0 2024-09-10T10:14:01.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa212411740 10 client.0 _ll_register_callbacks cb 0x55dda810fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:01.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa207e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849b3e0 0x55dda84a2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa20d800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda84a5ca0 0x55dda84a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa207e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849b3e0 0x55dda84a2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:46140/0 (socket says 172.21.15.50:46140) 2024-09-10T10:14:01.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa207e00640 1 -- 172.21.15.50:0/2202526955 learned_addr learned my addr 172.21.15.50:0/2202526955 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:01.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa20ce00640 1 --2- 172.21.15.50:0/2202526955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849aac0 0x55dda84a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa207e00640 1 -- 172.21.15.50:0/2202526955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849aac0 msgr2=0x55dda84a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa207e00640 1 --2- 172.21.15.50:0/2202526955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849aac0 0x55dda84a55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa207e00640 1 -- 172.21.15.50:0/2202526955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda84a5ca0 msgr2=0x55dda84a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa207e00640 1 --2- 172.21.15.50:0/2202526955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda84a5ca0 0x55dda84a2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.738+0000 7fa207e00640 1 -- 172.21.15.50:0/2202526955 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dda84a35a0 con 0x55dda849b3e0 2024-09-10T10:14:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.739+0000 7fa207e00640 1 --2- 172.21.15.50:0/2202526955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849b3e0 0x55dda84a2860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4005530 tx=0x7fa1f4005450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fab221349e7f8b9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.739+0000 7fa1eea00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:14:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.739+0000 7fa1eea00640 1 -- 172.21.15.50:0/2202526955 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4013c70 con 0x55dda849b3e0 2024-09-10T10:14:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.739+0000 7fa1eea00640 1 -- 172.21.15.50:0/2202526955 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa1f4004020 con 0x55dda849b3e0 2024-09-10T10:14:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.739+0000 7fa212411740 1 -- 172.21.15.50:0/2202526955 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1f4013e10 con 0x55dda849b3e0 2024-09-10T10:14:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.739+0000 7fa1eea00640 1 -- 172.21.15.50:0/2202526955 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa1f4031050 con 0x55dda849b3e0 2024-09-10T10:14:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.739+0000 7fa212411740 10 client.25954 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:01.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.739+0000 7fa212411740 1 -- 172.21.15.50:0/2202526955 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dda84b4820 con 0x55dda849b3e0 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.740+0000 7fa1eea00640 1 -- 172.21.15.50:0/2202526955 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1f4013e10 con 0x55dda849b3e0 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.740+0000 7fa1eea00640 1 -- 172.21.15.50:0/2202526955 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fa1f4027030 con 0x55dda849b3e0 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.740+0000 7fa212411740 10 client.25954 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.740+0000 7fa212411740 10 client.25954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.740+0000 7fa212411740 20 client.25954 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.740+0000 7fa212411740 1 --2- 172.21.15.50:0/2202526955 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55dda84b5b70 0x55dda84b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.740+0000 7fa212411740 4 client.25954 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.740+0000 7fa212411740 1 -- 172.21.15.50:0/2202526955 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dda840e800 con 0x55dda84b5b70 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.741+0000 7fa20ce00640 1 --2- 172.21.15.50:0/2202526955 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55dda84b5b70 0x55dda84b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.741+0000 7fa20ce00640 1 --2- 172.21.15.50:0/2202526955 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55dda84b5b70 0x55dda84b7f60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce2513650fa7ae23 server_cookie=453fd087ac28eb4c in_seq=0 out_seq=0 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.741+0000 7fa1eea00640 10 client.25954 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa1eea00640 1 -- 172.21.15.50:0/2202526955 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dda840e800 con 0x55dda84b5b70 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa1eea00640 10 client.25954 handle_command_reply: tid=0 2024-09-10T10:14:01.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa212411740 1 client.25954 shutdown 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa212411740 1 -- 172.21.15.50:0/2202526955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849b3e0 msgr2=0x55dda84a2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa212411740 1 --2- 172.21.15.50:0/2202526955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849b3e0 0x55dda84a2860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4005530 tx=0x7fa1f4005450 comp rx=0 tx=0).stop 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa212411740 1 -- 172.21.15.50:0/2202526955 shutdown_connections 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa212411740 1 --2- 172.21.15.50:0/2202526955 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55dda84b5b70 0x55dda84b7f60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa212411740 1 --2- 172.21.15.50:0/2202526955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda84a5ca0 0x55dda84a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa212411740 1 --2- 172.21.15.50:0/2202526955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849b3e0 0x55dda84a2860 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa212411740 1 --2- 172.21.15.50:0/2202526955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849aac0 0x55dda84a55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa212411740 1 -- 172.21.15.50:0/2202526955 >> 172.21.15.50:0/2202526955 conn(0x55dda8497050 msgr2=0x55dda849cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa1eea00640 0 client.25954 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa212411740 1 -- 172.21.15.50:0/2202526955 shutdown_connections 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.742+0000 7fa212411740 1 -- 172.21.15.50:0/2202526955 wait complete. 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.743+0000 7fa212411740 20 client.25954 trim_cache size 0 max 16384 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.761+0000 7fa212411740 1 Processor -- start 2024-09-10T10:14:01.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.761+0000 7fa212411740 1 -- start start 2024-09-10T10:14:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.761+0000 7fa212411740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 0x55dda84960b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.761+0000 7fa212411740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849b3e0 0x55dda84add10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.761+0000 7fa212411740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda84a5ca0 0x55dda84ae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.761+0000 7fa212411740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081b7bb0 con 0x55dda849aac0 2024-09-10T10:14:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.761+0000 7fa212411740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081b5480 con 0x55dda849b3e0 2024-09-10T10:14:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.761+0000 7fa212411740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081b32d0 con 0x55dda84a5ca0 2024-09-10T10:14:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.761+0000 7fa20ce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 0x55dda84960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.762+0000 7fa20ce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 0x55dda84960b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53100/0 (socket says 172.21.15.50:53100) 2024-09-10T10:14:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.762+0000 7fa20ce00640 1 -- 172.21.15.50:0/321432339 learned_addr learned my addr 172.21.15.50:0/321432339 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.762+0000 7fa207e00640 1 --2- 172.21.15.50:0/321432339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849b3e0 0x55dda84add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.762+0000 7fa20d800640 1 --2- 172.21.15.50:0/321432339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda84a5ca0 0x55dda84ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.762+0000 7fa207e00640 1 -- 172.21.15.50:0/321432339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda84a5ca0 msgr2=0x55dda84ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.762+0000 7fa207e00640 1 --2- 172.21.15.50:0/321432339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda84a5ca0 0x55dda84ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.762+0000 7fa207e00640 1 -- 172.21.15.50:0/321432339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 msgr2=0x55dda84960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.762+0000 7fa207e00640 1 --2- 172.21.15.50:0/321432339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 0x55dda84960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.762+0000 7fa207e00640 1 -- 172.21.15.50:0/321432339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dda849b210 con 0x55dda849b3e0 2024-09-10T10:14:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.762+0000 7fa20ce00640 1 --2- 172.21.15.50:0/321432339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 0x55dda84960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:14:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.762+0000 7fa207e00640 1 --2- 172.21.15.50:0/321432339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849b3e0 0x55dda84add10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4003640 tx=0x7fa1f4005670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fb92ace8c6fc609 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.762+0000 7fa1f9600640 1 -- 172.21.15.50:0/321432339 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4011da0 con 0x55dda849b3e0 2024-09-10T10:14:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.763+0000 7fa1f9600640 1 -- 172.21.15.50:0/321432339 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1f4017040 con 0x55dda849b3e0 2024-09-10T10:14:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.763+0000 7fa1f9600640 1 -- 172.21.15.50:0/321432339 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4003e60 con 0x55dda849b3e0 2024-09-10T10:14:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.763+0000 7fa212411740 1 -- 172.21.15.50:0/321432339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849b3e0 msgr2=0x55dda84add10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.763+0000 7fa212411740 1 --2- 172.21.15.50:0/321432339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849b3e0 0x55dda84add10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4003640 tx=0x7fa1f4005670 comp rx=0 tx=0).stop 2024-09-10T10:14:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.763+0000 7fa212411740 1 -- 172.21.15.50:0/321432339 shutdown_connections 2024-09-10T10:14:01.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.763+0000 7fa212411740 1 --2- 172.21.15.50:0/321432339 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda84a5ca0 0x55dda84ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.763+0000 7fa212411740 1 --2- 172.21.15.50:0/321432339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849b3e0 0x55dda84add10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.763+0000 7fa212411740 1 --2- 172.21.15.50:0/321432339 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda849aac0 0x55dda84960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.763+0000 7fa212411740 1 -- 172.21.15.50:0/321432339 >> 172.21.15.50:0/321432339 conn(0x55dda8497050 msgr2=0x55dda84959a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.763+0000 7fa212411740 1 -- 172.21.15.50:0/321432339 shutdown_connections 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.763+0000 7fa212411740 1 -- 172.21.15.50:0/321432339 wait complete. 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.764+0000 7fa212411740 1 -- start start 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.764+0000 7fa212411740 1 Processor -- start 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.764+0000 7fa212411740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849aac0 0x55dda84ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.764+0000 7fa212411740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849b3e0 0x55dda84ac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.764+0000 7fa212411740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda84a5ca0 0x55dda851f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.764+0000 7fa212411740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081b3940 con 0x55dda84a5ca0 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.764+0000 7fa212411740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081b4db0 con 0x55dda849b3e0 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.764+0000 7fa212411740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081b4010 con 0x55dda849aac0 2024-09-10T10:14:01.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.765+0000 7fa212411740 10 client.0 _ll_register_callbacks cb 0x7fa1f4009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.765+0000 7fa20d800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda84a5ca0 0x55dda851f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.765+0000 7fa20d800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda84a5ca0 0x55dda851f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53104/0 (socket says 172.21.15.50:53104) 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.765+0000 7fa20d800640 1 -- 172.21.15.50:0/3259761909 learned_addr learned my addr 172.21.15.50:0/3259761909 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.765+0000 7fa20ce00640 1 --2- 172.21.15.50:0/3259761909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849aac0 0x55dda84ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.765+0000 7fa207e00640 1 --2- 172.21.15.50:0/3259761909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849b3e0 0x55dda84ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.765+0000 7fa20d800640 1 -- 172.21.15.50:0/3259761909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849aac0 msgr2=0x55dda84ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.765+0000 7fa20d800640 1 --2- 172.21.15.50:0/3259761909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849aac0 0x55dda84ac1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.765+0000 7fa20d800640 1 -- 172.21.15.50:0/3259761909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849b3e0 msgr2=0x55dda84ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.765+0000 7fa20d800640 1 --2- 172.21.15.50:0/3259761909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849b3e0 0x55dda84ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.765+0000 7fa20d800640 1 -- 172.21.15.50:0/3259761909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dda851fbc0 con 0x55dda84a5ca0 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.765+0000 7fa20d800640 1 --2- 172.21.15.50:0/3259761909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda84a5ca0 0x55dda851f680 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2000b8f20 tx=0x7fa200031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908a3ba9047f19a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.765+0000 7fa1eea00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa1eea00640 1 -- 172.21.15.50:0/3259761909 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2000c0e70 con 0x55dda84a5ca0 2024-09-10T10:14:01.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa1eea00640 1 -- 172.21.15.50:0/3259761909 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa2000ede70 con 0x55dda84a5ca0 2024-09-10T10:14:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa212411740 1 -- 172.21.15.50:0/3259761909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1f4017040 con 0x55dda84a5ca0 2024-09-10T10:14:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa1eea00640 1 -- 172.21.15.50:0/3259761909 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa2000c5730 con 0x55dda84a5ca0 2024-09-10T10:14:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa212411740 10 client.15939 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa212411740 1 -- 172.21.15.50:0/3259761909 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dda8520f60 con 0x55dda84a5ca0 2024-09-10T10:14:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa1eea00640 1 -- 172.21.15.50:0/3259761909 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1f4017040 con 0x55dda84a5ca0 2024-09-10T10:14:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa1eea00640 1 -- 172.21.15.50:0/3259761909 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fa2000db2b0 con 0x55dda84a5ca0 2024-09-10T10:14:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa212411740 10 client.15939 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa212411740 10 client.15939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:14:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa212411740 20 client.15939 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa212411740 1 --2- 172.21.15.50:0/3259761909 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55dda8521680 0x55dda8523a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa212411740 4 client.15939 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T10:14:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.766+0000 7fa212411740 1 -- 172.21.15.50:0/3259761909 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dda8408d10 con 0x55dda8521680 2024-09-10T10:14:01.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.767+0000 7fa20ce00640 1 --2- 172.21.15.50:0/3259761909 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55dda8521680 0x55dda8523a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.767+0000 7fa20ce00640 1 --2- 172.21.15.50:0/3259761909 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55dda8521680 0x55dda8523a70 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2db50c7ddbbac89b server_cookie=a9d1e1aefd2a84f8 in_seq=0 out_seq=0 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.767+0000 7fa1eea00640 10 client.15939 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.768+0000 7fa1eea00640 1 -- 172.21.15.50:0/3259761909 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dda8408d10 con 0x55dda8521680 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.768+0000 7fa1eea00640 10 client.15939 handle_command_reply: tid=0 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.768+0000 7fa212411740 1 client.15939 shutdown 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.769+0000 7fa212411740 1 -- 172.21.15.50:0/3259761909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda84a5ca0 msgr2=0x55dda851f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.769+0000 7fa212411740 1 --2- 172.21.15.50:0/3259761909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda84a5ca0 0x55dda851f680 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2000b8f20 tx=0x7fa200031a60 comp rx=0 tx=0).stop 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.769+0000 7fa212411740 1 -- 172.21.15.50:0/3259761909 shutdown_connections 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.769+0000 7fa212411740 1 --2- 172.21.15.50:0/3259761909 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55dda8521680 0x55dda8523a70 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.769+0000 7fa212411740 1 --2- 172.21.15.50:0/3259761909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dda84a5ca0 0x55dda851f680 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.769+0000 7fa212411740 1 --2- 172.21.15.50:0/3259761909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dda849b3e0 0x55dda84ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.769+0000 7fa212411740 1 --2- 172.21.15.50:0/3259761909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dda849aac0 0x55dda84ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.769+0000 7fa212411740 1 -- 172.21.15.50:0/3259761909 >> 172.21.15.50:0/3259761909 conn(0x55dda8497050 msgr2=0x55dda84961c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:01.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.769+0000 7fa1eea00640 0 client.15939 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:01.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.769+0000 7fa212411740 1 -- 172.21.15.50:0/3259761909 shutdown_connections 2024-09-10T10:14:01.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.769+0000 7fa212411740 1 -- 172.21.15.50:0/3259761909 wait complete. 2024-09-10T10:14:01.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.769+0000 7fa212411740 20 client.15939 trim_cache size 0 max 16384 2024-09-10T10:14:01.974 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:14:01.974 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-10T10:14:01.974 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "955379ce-4f20-4b6f-862e-d53a894c3940", 2024-09-10T10:14:01.974 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-10T10:14:01.974 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:14:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.770+0000 7fa20f800640 1 -- 172.21.15.50:0/1805064514 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa1f00a2b80 msgr2=0x7fa1f00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.770+0000 7fa20f800640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa1f00a2b80 0x7fa1f00a5040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55dda8497eb0 tx=0x7fa1fc005f90 comp rx=0 tx=0).stop 2024-09-10T10:14:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.770+0000 7fa20f800640 1 -- 172.21.15.50:0/1805064514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa208112a50 msgr2=0x7fa2081a3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.770+0000 7fa20f800640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa208112a50 0x7fa2081a3490 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa200005e30 tx=0x7fa200003f10 comp rx=0 tx=0).stop 2024-09-10T10:14:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.770+0000 7fa20f800640 1 -- 172.21.15.50:0/1805064514 shutdown_connections 2024-09-10T10:14:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.770+0000 7fa20f800640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa1f00a2b80 0x7fa1f00a5040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.770+0000 7fa20f800640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa208112a50 0x7fa2081a3490 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.770+0000 7fa20f800640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa208077040 0x7fa20819f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.770+0000 7fa20f800640 1 --2- 172.21.15.50:0/1805064514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa208076720 0x7fa20819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.770+0000 7fa20f800640 1 -- 172.21.15.50:0/1805064514 >> 172.21.15.50:0/1805064514 conn(0x7fa2080ffa50 msgr2=0x7fa208101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.770+0000 7fa20f800640 1 -- 172.21.15.50:0/1805064514 shutdown_connections 2024-09-10T10:14:01.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:01.770+0000 7fa20f800640 1 -- 172.21.15.50:0/1805064514 wait complete. 2024-09-10T10:14:02.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:01 smithi050 ceph-mon[30354]: pgmap v476: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 MiB/s wr, 28 op/s 2024-09-10T10:14:02.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:01 smithi189 ceph-mon[34999]: pgmap v476: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 MiB/s wr, 28 op/s 2024-09-10T10:14:02.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:01 smithi084 ceph-mon[34812]: pgmap v476: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 91 MiB/s wr, 28 op/s 2024-09-10T10:14:02.855 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:14:03.214 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:02 smithi050 ceph-mon[30354]: scrub queued for path: / 2024-09-10T10:14:03.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:02 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:14:03.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:02 smithi050 ceph-mon[30354]: scrub summary: active paths [/] 2024-09-10T10:14:03.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:02 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:14:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:14:03.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:02 smithi189 ceph-mon[34999]: scrub queued for path: / 2024-09-10T10:14:03.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:02 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:14:03.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:02 smithi189 ceph-mon[34999]: scrub summary: active paths [/] 2024-09-10T10:14:03.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:02 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:14:03.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:02 smithi084 ceph-mon[34812]: scrub queued for path: / 2024-09-10T10:14:03.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:02 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:14:03.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:02 smithi084 ceph-mon[34812]: scrub summary: active paths [/] 2024-09-10T10:14:03.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:02 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:14:03.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.822+0000 7fcae0200640 1 -- 172.21.15.50:0/693303429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8074590 msgr2=0x7fcad8074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:03.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.822+0000 7fcae0200640 1 --2- 172.21.15.50:0/693303429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8074590 0x7fcad8074970 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009900 tx=0x7fcacc02a480 comp rx=0 tx=0).stop 2024-09-10T10:14:03.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.822+0000 7fcae0200640 1 -- 172.21.15.50:0/693303429 shutdown_connections 2024-09-10T10:14:03.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.822+0000 7fcae0200640 1 --2- 172.21.15.50:0/693303429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcad8112b90 0x7fcad8114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.822+0000 7fcae0200640 1 --2- 172.21.15.50:0/693303429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcad8074eb0 0x7fcad8112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.823+0000 7fcae0200640 1 --2- 172.21.15.50:0/693303429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8074590 0x7fcad8074970 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.823+0000 7fcae0200640 1 -- 172.21.15.50:0/693303429 >> 172.21.15.50:0/693303429 conn(0x7fcad80fd8c0 msgr2=0x7fcad80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:03.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.823+0000 7fcae0200640 1 -- 172.21.15.50:0/693303429 shutdown_connections 2024-09-10T10:14:03.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.823+0000 7fcae0200640 1 -- 172.21.15.50:0/693303429 wait complete. 2024-09-10T10:14:03.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.823+0000 7fcae0200640 1 Processor -- start 2024-09-10T10:14:03.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.824+0000 7fcae0200640 1 -- start start 2024-09-10T10:14:03.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.824+0000 7fcae0200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcad8074590 0x7fcad819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.824+0000 7fcae0200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcad8074eb0 0x7fcad819f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.824+0000 7fcae0200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8112b90 0x7fcad81a3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.824+0000 7fcae0200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81185c0 con 0x7fcad8112b90 2024-09-10T10:14:03.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.824+0000 7fcae0200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcad8118440 con 0x7fcad8074eb0 2024-09-10T10:14:03.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.824+0000 7fcae0200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcad8118740 con 0x7fcad8074590 2024-09-10T10:14:03.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.824+0000 7fcadd800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcad8074590 0x7fcad819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.824+0000 7fcade200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8112b90 0x7fcad81a3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.824+0000 7fcadce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcad8074eb0 0x7fcad819f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.824+0000 7fcadd800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcad8074590 0x7fcad819eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:46184/0 (socket says 172.21.15.50:46184) 2024-09-10T10:14:03.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.824+0000 7fcadd800640 1 -- 172.21.15.50:0/1200935336 learned_addr learned my addr 172.21.15.50:0/1200935336 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.825+0000 7fcadd800640 1 -- 172.21.15.50:0/1200935336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcad8074eb0 msgr2=0x7fcad819f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.825+0000 7fcadd800640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcad8074eb0 0x7fcad819f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.825+0000 7fcadd800640 1 -- 172.21.15.50:0/1200935336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8112b90 msgr2=0x7fcad81a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.825+0000 7fcadd800640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8112b90 0x7fcad81a3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.825+0000 7fcadd800640 1 -- 172.21.15.50:0/1200935336 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad81a3b80 con 0x7fcad8074590 2024-09-10T10:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.825+0000 7fcadce00640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcad8074eb0 0x7fcad819f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.825+0000 7fcade200640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8112b90 0x7fcad81a3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.825+0000 7fcadd800640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcad8074590 0x7fcad819eb50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcacc004770 tx=0x7fcacc003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.825+0000 7fcad6000640 1 -- 172.21.15.50:0/1200935336 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc03f070 con 0x7fcad8074590 2024-09-10T10:14:03.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.826+0000 7fcae0200640 1 -- 172.21.15.50:0/1200935336 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad81a3e10 con 0x7fcad8074590 2024-09-10T10:14:03.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.826+0000 7fcad6000640 1 -- 172.21.15.50:0/1200935336 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcacc031ca0 con 0x7fcad8074590 2024-09-10T10:14:03.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.826+0000 7fcad6000640 1 -- 172.21.15.50:0/1200935336 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc035030 con 0x7fcad8074590 2024-09-10T10:14:03.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.826+0000 7fcae0200640 1 -- 172.21.15.50:0/1200935336 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad81ab700 con 0x7fcad8074590 2024-09-10T10:14:03.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.829+0000 7fcae2c8d740 1 Processor -- start 2024-09-10T10:14:03.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.829+0000 7fcad6000640 1 -- 172.21.15.50:0/1200935336 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcacc042070 con 0x7fcad8074590 2024-09-10T10:14:03.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.829+0000 7fcae2c8d740 1 -- start start 2024-09-10T10:14:03.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.829+0000 7fcae2c8d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47edb90 0x559cd47edf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.829+0000 7fcae2c8d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47ee4b0 0x559cd47f8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.829+0000 7fcae2c8d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47f8d70 0x559cd47fb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.829+0000 7fcae2c8d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559cd47543e0 con 0x559cd47edb90 2024-09-10T10:14:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.829+0000 7fcae2c8d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559cd46fbd80 con 0x559cd47ee4b0 2024-09-10T10:14:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.829+0000 7fcae2c8d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559cd47503a0 con 0x559cd47f8d70 2024-09-10T10:14:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.830+0000 7fcade200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47edb90 0x559cd47edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.830+0000 7fcade200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47edb90 0x559cd47edf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53126/0 (socket says 172.21.15.50:53126) 2024-09-10T10:14:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.830+0000 7fcade200640 1 -- 172.21.15.50:0/297689089 learned_addr learned my addr 172.21.15.50:0/297689089 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.830+0000 7fcadd800640 1 --2- 172.21.15.50:0/297689089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47ee4b0 0x559cd47f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.830+0000 7fcadce00640 1 --2- 172.21.15.50:0/297689089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47f8d70 0x559cd47fb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.830+0000 7fcade200640 1 -- 172.21.15.50:0/297689089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47f8d70 msgr2=0x559cd47fb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:03.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.830+0000 7fcade200640 1 --2- 172.21.15.50:0/297689089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47f8d70 0x559cd47fb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.830+0000 7fcade200640 1 -- 172.21.15.50:0/297689089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47ee4b0 msgr2=0x559cd47f8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:03.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.830+0000 7fcade200640 1 --2- 172.21.15.50:0/297689089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47ee4b0 0x559cd47f8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.830+0000 7fcade200640 1 -- 172.21.15.50:0/297689089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cd471aae0 con 0x559cd47edb90 2024-09-10T10:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.831+0000 7fcade200640 1 --2- 172.21.15.50:0/297689089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47edb90 0x559cd47edf70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcad00106c0 tx=0x7fcad0010b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24065c3f2b0b8f76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.831+0000 7fcad6000640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcac00a2b80 0x7fcac00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.831+0000 7fcacaa00640 1 -- 172.21.15.50:0/297689089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad000e8d0 con 0x559cd47edb90 2024-09-10T10:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.831+0000 7fcad6000640 1 -- 172.21.15.50:0/1200935336 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fcacc0efad0 con 0x7fcad8074590 2024-09-10T10:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.831+0000 7fcadd800640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcac00a2b80 0x7fcac00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.831+0000 7fcacaa00640 1 -- 172.21.15.50:0/297689089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcad0012450 con 0x559cd47edb90 2024-09-10T10:14:03.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.831+0000 7fcacaa00640 1 -- 172.21.15.50:0/297689089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad001c670 con 0x559cd47edb90 2024-09-10T10:14:03.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.832+0000 7fcae2c8d740 1 -- 172.21.15.50:0/297689089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47edb90 msgr2=0x559cd47edf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.832+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/297689089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47edb90 0x559cd47edf70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcad00106c0 tx=0x7fcad0010b80 comp rx=0 tx=0).stop 2024-09-10T10:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.832+0000 7fcadd800640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcac00a2b80 0x7fcac00a5040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0b8450 tx=0x7fcacc0f4040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.832+0000 7fcae2c8d740 1 -- 172.21.15.50:0/297689089 shutdown_connections 2024-09-10T10:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.832+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/297689089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47f8d70 0x559cd47fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.832+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/297689089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47ee4b0 0x559cd47f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.832+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/297689089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47edb90 0x559cd47edf70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.832+0000 7fcae2c8d740 1 -- 172.21.15.50:0/297689089 >> 172.21.15.50:0/297689089 conn(0x559cd47ea120 msgr2=0x559cd47ea500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.832+0000 7fcae2c8d740 1 -- 172.21.15.50:0/297689089 shutdown_connections 2024-09-10T10:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.832+0000 7fcae2c8d740 1 -- 172.21.15.50:0/297689089 wait complete. 2024-09-10T10:14:03.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.833+0000 7fcae2c8d740 1 -- start start 2024-09-10T10:14:03.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.833+0000 7fcae2c8d740 1 Processor -- start 2024-09-10T10:14:03.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.834+0000 7fcae2c8d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47edb90 0x559cd47f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.834+0000 7fcae2c8d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47ee4b0 0x559cd47f6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.834+0000 7fcae2c8d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47f8d70 0x559cd47f6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.834+0000 7fcae2c8d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559cd47fb9e0 con 0x559cd47f8d70 2024-09-10T10:14:03.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.834+0000 7fcae2c8d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559cd470f0f0 con 0x559cd47edb90 2024-09-10T10:14:03.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.834+0000 7fcae2c8d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559cd47fbb60 con 0x559cd47ee4b0 2024-09-10T10:14:03.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.834+0000 7fcae2c8d740 10 client.0 _ll_register_callbacks cb 0x559cd47009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:03.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.834+0000 7fcade200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47edb90 0x559cd47f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.834+0000 7fcade200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47edb90 0x559cd47f5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:52242/0 (socket says 172.21.15.50:52242) 2024-09-10T10:14:03.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.834+0000 7fcadce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47ee4b0 0x559cd47f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.834+0000 7fcade200640 1 -- 172.21.15.50:0/2193672022 learned_addr learned my addr 172.21.15.50:0/2193672022 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:03.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.834+0000 7fcade200640 1 --2- 172.21.15.50:0/2193672022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47f8d70 0x559cd47f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.835+0000 7fcadce00640 1 -- 172.21.15.50:0/2193672022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47edb90 msgr2=0x559cd47f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:03.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.835+0000 7fcadce00640 1 --2- 172.21.15.50:0/2193672022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47edb90 0x559cd47f5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.835+0000 7fcadce00640 1 -- 172.21.15.50:0/2193672022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47f8d70 msgr2=0x559cd47f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:03.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.835+0000 7fcadce00640 1 --2- 172.21.15.50:0/2193672022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47f8d70 0x559cd47f6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.835+0000 7fcadce00640 1 -- 172.21.15.50:0/2193672022 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cd44c53c0 con 0x559cd47ee4b0 2024-09-10T10:14:03.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.835+0000 7fcade200640 1 --2- 172.21.15.50:0/2193672022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47edb90 0x559cd47f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:14:03.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.835+0000 7fcadce00640 1 --2- 172.21.15.50:0/2193672022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47ee4b0 0x559cd47f6230 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcad80fecf0 tx=0x7fcac400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dc92edcaf241a18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:03.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.835+0000 7fcabf400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:14:03.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.835+0000 7fcabf400640 1 -- 172.21.15.50:0/2193672022 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4012110 con 0x559cd47ee4b0 2024-09-10T10:14:03.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.835+0000 7fcabf400640 1 -- 172.21.15.50:0/2193672022 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fcac4004050 con 0x559cd47ee4b0 2024-09-10T10:14:03.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.835+0000 7fcae2c8d740 1 -- 172.21.15.50:0/2193672022 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcad0012450 con 0x559cd47ee4b0 2024-09-10T10:14:03.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.836+0000 7fcabf400640 1 -- 172.21.15.50:0/2193672022 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcac4025050 con 0x559cd47ee4b0 2024-09-10T10:14:03.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.836+0000 7fcae2c8d740 10 client.25972 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.836+0000 7fcae2c8d740 1 -- 172.21.15.50:0/2193672022 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559cd4807770 con 0x559cd47ee4b0 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.836+0000 7fcabf400640 1 -- 172.21.15.50:0/2193672022 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcad0012450 con 0x559cd47ee4b0 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.836+0000 7fcabf400640 1 -- 172.21.15.50:0/2193672022 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fcac4010430 con 0x559cd47ee4b0 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.836+0000 7fcae2c8d740 10 client.25972 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.836+0000 7fcae2c8d740 10 client.25972 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.836+0000 7fcae2c8d740 20 client.25972 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.837+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/2193672022 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559cd4808c30 0x559cd480b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.837+0000 7fcae2c8d740 4 client.25972 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.837+0000 7fcae2c8d740 1 -- 172.21.15.50:0/2193672022 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559cd4761950 con 0x559cd4808c30 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.837+0000 7fcade200640 1 --2- 172.21.15.50:0/2193672022 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559cd4808c30 0x559cd480b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.837+0000 7fcade200640 1 --2- 172.21.15.50:0/2193672022 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559cd4808c30 0x559cd480b050 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0848b9759c2a924 server_cookie=add2ad5f8da0bb98 in_seq=0 out_seq=0 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.837+0000 7fcabf400640 10 client.25972 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.838+0000 7fcabf400640 1 -- 172.21.15.50:0/2193672022 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559cd4761950 con 0x559cd4808c30 2024-09-10T10:14:03.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.838+0000 7fcabf400640 10 client.25972 handle_command_reply: tid=0 2024-09-10T10:14:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.838+0000 7fcae2c8d740 1 client.25972 shutdown 2024-09-10T10:14:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.839+0000 7fcae2c8d740 1 -- 172.21.15.50:0/2193672022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47ee4b0 msgr2=0x559cd47f6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.839+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/2193672022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47ee4b0 0x559cd47f6230 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcad80fecf0 tx=0x7fcac400f790 comp rx=0 tx=0).stop 2024-09-10T10:14:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.839+0000 7fcae2c8d740 1 -- 172.21.15.50:0/2193672022 shutdown_connections 2024-09-10T10:14:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.839+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/2193672022 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559cd4808c30 0x559cd480b050 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.839+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/2193672022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47f8d70 0x559cd47f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.839+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/2193672022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47ee4b0 0x559cd47f6230 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.839+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/2193672022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47edb90 0x559cd47f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.839+0000 7fcabf400640 0 client.25972 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.839+0000 7fcae2c8d740 1 -- 172.21.15.50:0/2193672022 >> 172.21.15.50:0/2193672022 conn(0x559cd47ea120 msgr2=0x559cd47efe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.839+0000 7fcae2c8d740 1 -- 172.21.15.50:0/2193672022 shutdown_connections 2024-09-10T10:14:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.839+0000 7fcae2c8d740 1 -- 172.21.15.50:0/2193672022 wait complete. 2024-09-10T10:14:03.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.839+0000 7fcae2c8d740 20 client.25972 trim_cache size 0 max 16384 2024-09-10T10:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.857+0000 7fcae2c8d740 1 Processor -- start 2024-09-10T10:14:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.857+0000 7fcae2c8d740 1 -- start start 2024-09-10T10:14:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcae2c8d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47edb90 0x559cd4810920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcae2c8d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47ee4b0 0x559cd4810e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcae2c8d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47f8d70 0x559cd47e89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcae2c8d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81b7c50 con 0x559cd47ee4b0 2024-09-10T10:14:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcae2c8d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81b5520 con 0x559cd47f8d70 2024-09-10T10:14:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcae2c8d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81b3370 con 0x559cd47edb90 2024-09-10T10:14:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcade200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47edb90 0x559cd4810920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcadce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47ee4b0 0x559cd4810e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcade200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47edb90 0x559cd4810920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:46208/0 (socket says 172.21.15.50:46208) 2024-09-10T10:14:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcade200640 1 -- 172.21.15.50:0/3092179072 learned_addr learned my addr 172.21.15.50:0/3092179072 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcade200640 1 --2- 172.21.15.50:0/3092179072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47f8d70 0x559cd47e89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcadce00640 1 -- 172.21.15.50:0/3092179072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47edb90 msgr2=0x559cd4810920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcadce00640 1 --2- 172.21.15.50:0/3092179072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47edb90 0x559cd4810920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcadce00640 1 -- 172.21.15.50:0/3092179072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47f8d70 msgr2=0x559cd47e89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcadce00640 1 --2- 172.21.15.50:0/3092179072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47f8d70 0x559cd47e89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcadce00640 1 -- 172.21.15.50:0/3092179072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cd47eadb0 con 0x559cd47ee4b0 2024-09-10T10:14:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.858+0000 7fcade200640 1 --2- 172.21.15.50:0/3092179072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47f8d70 0x559cd47e89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:14:03.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.859+0000 7fcadce00640 1 --2- 172.21.15.50:0/3092179072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47ee4b0 0x559cd4810e60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcac4010850 tx=0x7fcac4012320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a244f63b31f211b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:03.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.859+0000 7fcaca000640 1 -- 172.21.15.50:0/3092179072 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4010430 con 0x559cd47ee4b0 2024-09-10T10:14:03.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.859+0000 7fcaca000640 1 -- 172.21.15.50:0/3092179072 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac40105d0 con 0x559cd47ee4b0 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.859+0000 7fcaca000640 1 -- 172.21.15.50:0/3092179072 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4003950 con 0x559cd47ee4b0 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.859+0000 7fcae2c8d740 1 -- 172.21.15.50:0/3092179072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47ee4b0 msgr2=0x559cd4810e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.859+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/3092179072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47ee4b0 0x559cd4810e60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcac4010850 tx=0x7fcac4012320 comp rx=0 tx=0).stop 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.860+0000 7fcae2c8d740 1 -- 172.21.15.50:0/3092179072 shutdown_connections 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.860+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/3092179072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47f8d70 0x559cd47e89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.860+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/3092179072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47ee4b0 0x559cd4810e60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.860+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/3092179072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47edb90 0x559cd4810920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.860+0000 7fcae2c8d740 1 -- 172.21.15.50:0/3092179072 >> 172.21.15.50:0/3092179072 conn(0x559cd47ea120 msgr2=0x559cd47f4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.860+0000 7fcae2c8d740 1 -- 172.21.15.50:0/3092179072 shutdown_connections 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.860+0000 7fcae2c8d740 1 -- 172.21.15.50:0/3092179072 wait complete. 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.860+0000 7fcae2c8d740 1 -- start start 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.860+0000 7fcae2c8d740 1 Processor -- start 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcae2c8d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47edb90 0x559cd48013c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcae2c8d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47ee4b0 0x559cd47fc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcae2c8d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47f8d70 0x559cd47fcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcae2c8d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81b39e0 con 0x559cd47edb90 2024-09-10T10:14:03.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcae2c8d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81b4e50 con 0x559cd47f8d70 2024-09-10T10:14:03.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcae2c8d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcad81b40b0 con 0x559cd47ee4b0 2024-09-10T10:14:03.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcae2c8d740 10 client.0 _ll_register_callbacks cb 0x7fcac4012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:03.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcadce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47ee4b0 0x559cd47fc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcade200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47edb90 0x559cd48013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcadce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47ee4b0 0x559cd47fc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:46224/0 (socket says 172.21.15.50:46224) 2024-09-10T10:14:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcadce00640 1 -- 172.21.15.50:0/3637969581 learned_addr learned my addr 172.21.15.50:0/3637969581 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcade200640 1 --2- 172.21.15.50:0/3637969581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47f8d70 0x559cd47fcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcadce00640 1 -- 172.21.15.50:0/3637969581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47f8d70 msgr2=0x559cd47fcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcadce00640 1 --2- 172.21.15.50:0/3637969581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47f8d70 0x559cd47fcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcadce00640 1 -- 172.21.15.50:0/3637969581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47edb90 msgr2=0x559cd48013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcadce00640 1 --2- 172.21.15.50:0/3637969581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47edb90 0x559cd48013c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.861+0000 7fcadce00640 1 -- 172.21.15.50:0/3637969581 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cd47fd320 con 0x559cd47ee4b0 2024-09-10T10:14:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.862+0000 7fcade200640 1 --2- 172.21.15.50:0/3637969581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47f8d70 0x559cd47fcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:14:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.862+0000 7fcadce00640 1 --2- 172.21.15.50:0/3637969581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47ee4b0 0x559cd47fc6f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcac4000c00 tx=0x7fcac4010c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc93cda644f8c651 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.862+0000 7fcabf400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:14:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.862+0000 7fcabf400640 1 -- 172.21.15.50:0/3637969581 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4010430 con 0x559cd47ee4b0 2024-09-10T10:14:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.862+0000 7fcae2c8d740 1 -- 172.21.15.50:0/3637969581 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcac40105d0 con 0x559cd47ee4b0 2024-09-10T10:14:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.862+0000 7fcabf400640 1 -- 172.21.15.50:0/3637969581 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fcac4005320 con 0x559cd47ee4b0 2024-09-10T10:14:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.863+0000 7fcabf400640 1 -- 172.21.15.50:0/3637969581 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcac4005520 con 0x559cd47ee4b0 2024-09-10T10:14:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.863+0000 7fcae2c8d740 10 client.25978 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.863+0000 7fcae2c8d740 1 -- 172.21.15.50:0/3637969581 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559cd48737c0 con 0x559cd47ee4b0 2024-09-10T10:14:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.863+0000 7fcabf400640 1 -- 172.21.15.50:0/3637969581 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac40105d0 con 0x559cd47ee4b0 2024-09-10T10:14:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.863+0000 7fcabf400640 1 -- 172.21.15.50:0/3637969581 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fcac4032420 con 0x559cd47ee4b0 2024-09-10T10:14:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.863+0000 7fcae2c8d740 10 client.25978 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.863+0000 7fcae2c8d740 10 client.25978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:14:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.863+0000 7fcae2c8d740 20 client.25978 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.863+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/3637969581 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559cd4873e70 0x559cd4876290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.863+0000 7fcae2c8d740 4 client.25978 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:14:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.863+0000 7fcae2c8d740 1 -- 172.21.15.50:0/3637969581 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559cd475be60 con 0x559cd4873e70 2024-09-10T10:14:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcade200640 1 --2- 172.21.15.50:0/3637969581 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559cd4873e70 0x559cd4876290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcade200640 1 --2- 172.21.15.50:0/3637969581 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559cd4873e70 0x559cd4876290 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fbb5f522df23e8e server_cookie=a98bc34b8758d16d in_seq=0 out_seq=0 2024-09-10T10:14:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcabf400640 10 client.25978 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcabf400640 1 -- 172.21.15.50:0/3637969581 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559cd475be60 con 0x559cd4873e70 2024-09-10T10:14:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcabf400640 10 client.25978 handle_command_reply: tid=0 2024-09-10T10:14:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcae2c8d740 1 client.25978 shutdown 2024-09-10T10:14:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcae2c8d740 1 -- 172.21.15.50:0/3637969581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47ee4b0 msgr2=0x559cd47fc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/3637969581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47ee4b0 0x559cd47fc6f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcac4000c00 tx=0x7fcac4010c20 comp rx=0 tx=0).stop 2024-09-10T10:14:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcae2c8d740 1 -- 172.21.15.50:0/3637969581 shutdown_connections 2024-09-10T10:14:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/3637969581 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559cd4873e70 0x559cd4876290 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/3637969581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559cd47f8d70 0x559cd47fcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/3637969581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559cd47ee4b0 0x559cd47fc6f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcae2c8d740 1 --2- 172.21.15.50:0/3637969581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cd47edb90 0x559cd48013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcae2c8d740 1 -- 172.21.15.50:0/3637969581 >> 172.21.15.50:0/3637969581 conn(0x559cd47ea120 msgr2=0x559cd47e89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:03.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.864+0000 7fcabf400640 0 client.25978 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:03.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.865+0000 7fcae2c8d740 1 -- 172.21.15.50:0/3637969581 shutdown_connections 2024-09-10T10:14:03.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.865+0000 7fcae2c8d740 1 -- 172.21.15.50:0/3637969581 wait complete. 2024-09-10T10:14:03.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.865+0000 7fcae2c8d740 20 client.25978 trim_cache size 0 max 16384 2024-09-10T10:14:03.870 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:14:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-10T10:14:03.870 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-10T10:14:03.870 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:14:03.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.865+0000 7fcae0200640 1 -- 172.21.15.50:0/1200935336 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcac00a2b80 msgr2=0x7fcac00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:03.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.865+0000 7fcae0200640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcac00a2b80 0x7fcac00a5040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0b8450 tx=0x7fcacc0f4040 comp rx=0 tx=0).stop 2024-09-10T10:14:03.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.865+0000 7fcae0200640 1 -- 172.21.15.50:0/1200935336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcad8074590 msgr2=0x7fcad819eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:03.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.865+0000 7fcae0200640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcad8074590 0x7fcad819eb50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcacc004770 tx=0x7fcacc003c10 comp rx=0 tx=0).stop 2024-09-10T10:14:03.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.866+0000 7fcae0200640 1 -- 172.21.15.50:0/1200935336 shutdown_connections 2024-09-10T10:14:03.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.866+0000 7fcae0200640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcac00a2b80 0x7fcac00a5040 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.866+0000 7fcae0200640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcad8112b90 0x7fcad81a3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.866+0000 7fcae0200640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcad8074eb0 0x7fcad819f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.866+0000 7fcae0200640 1 --2- 172.21.15.50:0/1200935336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcad8074590 0x7fcad819eb50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:03.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.866+0000 7fcae0200640 1 -- 172.21.15.50:0/1200935336 >> 172.21.15.50:0/1200935336 conn(0x7fcad80fd8c0 msgr2=0x7fcad80ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:03.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.866+0000 7fcae0200640 1 -- 172.21.15.50:0/1200935336 shutdown_connections 2024-09-10T10:14:03.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:03.866+0000 7fcae0200640 1 -- 172.21.15.50:0/1200935336 wait complete. 2024-09-10T10:14:03.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:03 smithi050 ceph-mon[30354]: pgmap v477: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 69 MiB/s wr, 25 op/s 2024-09-10T10:14:03.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:03 smithi050 ceph-mon[30354]: scrub summary: idle 2024-09-10T10:14:04.087 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:14:04.087 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:14:04.087 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:14:04.087 INFO:tasks.workunit.client.0.smithi050.stdout:iozone test complete. 2024-09-10T10:14:04.089 INFO:tasks.workunit.client.0.smithi050.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-10T10:14:04.168 INFO:tasks.workunit.client.0.smithi050.stdout: Iozone: Performance Test of File I/O 2024-09-10T10:14:04.168 INFO:tasks.workunit.client.0.smithi050.stdout: Version $Revision: 3.494 $ 2024-09-10T10:14:04.168 INFO:tasks.workunit.client.0.smithi050.stdout: Compiled for 64 bit mode. 2024-09-10T10:14:04.169 INFO:tasks.workunit.client.0.smithi050.stdout: Build: linux-AMD64 2024-09-10T10:14:04.169 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:14:04.169 INFO:tasks.workunit.client.0.smithi050.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-10T10:14:04.169 INFO:tasks.workunit.client.0.smithi050.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-10T10:14:04.169 INFO:tasks.workunit.client.0.smithi050.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-10T10:14:04.169 INFO:tasks.workunit.client.0.smithi050.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-10T10:14:04.169 INFO:tasks.workunit.client.0.smithi050.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-10T10:14:04.169 INFO:tasks.workunit.client.0.smithi050.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-10T10:14:04.169 INFO:tasks.workunit.client.0.smithi050.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-10T10:14:04.169 INFO:tasks.workunit.client.0.smithi050.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-10T10:14:04.169 INFO:tasks.workunit.client.0.smithi050.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-10T10:14:04.169 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:14:04.169 INFO:tasks.workunit.client.0.smithi050.stdout: Run began: Tue Sep 10 10:14:04 2024 2024-09-10T10:14:04.170 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:14:04.170 INFO:tasks.workunit.client.0.smithi050.stdout: Include close in write timing 2024-09-10T10:14:04.170 INFO:tasks.workunit.client.0.smithi050.stdout: Include fsync in write timing 2024-09-10T10:14:04.170 INFO:tasks.workunit.client.0.smithi050.stdout: File size set to 10485760 kB 2024-09-10T10:14:04.170 INFO:tasks.workunit.client.0.smithi050.stdout: Record Size 1024 kB 2024-09-10T10:14:04.170 INFO:tasks.workunit.client.0.smithi050.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-10T10:14:04.170 INFO:tasks.workunit.client.0.smithi050.stdout: Output is in kBytes/sec 2024-09-10T10:14:04.170 INFO:tasks.workunit.client.0.smithi050.stdout: Time Resolution = 0.000001 seconds. 2024-09-10T10:14:04.170 INFO:tasks.workunit.client.0.smithi050.stdout: Processor cache size set to 1024 kBytes. 2024-09-10T10:14:04.170 INFO:tasks.workunit.client.0.smithi050.stdout: Processor cache line size set to 32 bytes. 2024-09-10T10:14:04.170 INFO:tasks.workunit.client.0.smithi050.stdout: File stride size set to 17 * record size. 2024-09-10T10:14:04.170 INFO:tasks.workunit.client.0.smithi050.stdout: Throughput test with 1 process 2024-09-10T10:14:04.171 INFO:tasks.workunit.client.0.smithi050.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-09-10T10:14:04.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:03 smithi189 ceph-mon[34999]: pgmap v477: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 69 MiB/s wr, 25 op/s 2024-09-10T10:14:04.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:03 smithi189 ceph-mon[34999]: scrub summary: idle 2024-09-10T10:14:04.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:03 smithi084 ceph-mon[34812]: pgmap v477: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 69 MiB/s wr, 25 op/s 2024-09-10T10:14:04.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:03 smithi084 ceph-mon[34812]: scrub summary: idle 2024-09-10T10:14:04.864 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T10:14:04.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:14:05.256 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:14:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.827+0000 7efebc400640 1 -- 172.21.15.50:0/872835235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb4076720 msgr2=0x7efeb4076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.827+0000 7efebc400640 1 --2- 172.21.15.50:0/872835235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb4076720 0x7efeb4076b00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efea8009900 tx=0x7efea802a410 comp rx=0 tx=0).stop 2024-09-10T10:14:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.827+0000 7efebc400640 1 -- 172.21.15.50:0/872835235 shutdown_connections 2024-09-10T10:14:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.827+0000 7efebc400640 1 --2- 172.21.15.50:0/872835235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efeb4112a50 0x7efeb4114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.827+0000 7efebc400640 1 --2- 172.21.15.50:0/872835235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb4077040 0x7efeb4112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.827+0000 7efebc400640 1 --2- 172.21.15.50:0/872835235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb4076720 0x7efeb4076b00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.827+0000 7efebc400640 1 -- 172.21.15.50:0/872835235 >> 172.21.15.50:0/872835235 conn(0x7efeb40ffa50 msgr2=0x7efeb4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.827+0000 7efebc400640 1 -- 172.21.15.50:0/872835235 shutdown_connections 2024-09-10T10:14:05.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.827+0000 7efebc400640 1 -- 172.21.15.50:0/872835235 wait complete. 2024-09-10T10:14:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.828+0000 7efebc400640 1 Processor -- start 2024-09-10T10:14:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.828+0000 7efebc400640 1 -- start start 2024-09-10T10:14:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.829+0000 7efebc400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efeb4076720 0x7efeb41a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.829+0000 7efebc400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb4077040 0x7efeb41a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:05.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.829+0000 7efebc400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb4112a50 0x7efeb419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:05.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.829+0000 7efebc400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efeb4118610 con 0x7efeb4112a50 2024-09-10T10:14:05.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.829+0000 7efebc400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efeb4118490 con 0x7efeb4077040 2024-09-10T10:14:05.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.829+0000 7efebc400640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efeb4118790 con 0x7efeb4076720 2024-09-10T10:14:05.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.829+0000 7efeba400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb4112a50 0x7efeb419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:05.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.829+0000 7efeb9a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efeb4076720 0x7efeb41a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:05.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.829+0000 7efeba400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb4112a50 0x7efeb419e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53162/0 (socket says 172.21.15.50:53162) 2024-09-10T10:14:05.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.829+0000 7efeba400640 1 -- 172.21.15.50:0/927112954 learned_addr learned my addr 172.21.15.50:0/927112954 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:05.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.829+0000 7efeb9000640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb4077040 0x7efeb41a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.829+0000 7efeb9a00640 1 -- 172.21.15.50:0/927112954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb4077040 msgr2=0x7efeb41a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.829+0000 7efeb9a00640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb4077040 0x7efeb41a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.830+0000 7efeb9a00640 1 -- 172.21.15.50:0/927112954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb4112a50 msgr2=0x7efeb419e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.830+0000 7efeb9a00640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb4112a50 0x7efeb419e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.830+0000 7efeb9a00640 1 -- 172.21.15.50:0/927112954 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb419f050 con 0x7efeb4076720 2024-09-10T10:14:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.830+0000 7efeba400640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb4112a50 0x7efeb419e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:14:05.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.830+0000 7efeb9a00640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efeb4076720 0x7efeb41a4760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efea802a930 tx=0x7efea8003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.830+0000 7efeb2000640 1 -- 172.21.15.50:0/927112954 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea803f070 con 0x7efeb4076720 2024-09-10T10:14:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.830+0000 7efebc400640 1 -- 172.21.15.50:0/927112954 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb419f2e0 con 0x7efeb4076720 2024-09-10T10:14:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.831+0000 7efebc400640 1 -- 172.21.15.50:0/927112954 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb41ab630 con 0x7efeb4076720 2024-09-10T10:14:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.831+0000 7efeb2000640 1 -- 172.21.15.50:0/927112954 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efea8031c90 con 0x7efeb4076720 2024-09-10T10:14:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.831+0000 7efeb2000640 1 -- 172.21.15.50:0/927112954 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8049060 con 0x7efeb4076720 2024-09-10T10:14:05.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.832+0000 7efebc400640 1 -- 172.21.15.50:0/927112954 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb4076b00 con 0x7efeb4076720 2024-09-10T10:14:05.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.834+0000 7efeb2000640 1 -- 172.21.15.50:0/927112954 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efea8042070 con 0x7efeb4076720 2024-09-10T10:14:05.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.836+0000 7efeb2000640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7efe9c0a2c00 0x7efe9c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.836+0000 7efeb2000640 1 -- 172.21.15.50:0/927112954 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7efea80ef800 con 0x7efeb4076720 2024-09-10T10:14:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.836+0000 7efeb9000640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7efe9c0a2c00 0x7efe9c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.837+0000 7efeb9000640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7efe9c0a2c00 0x7efe9c0a50c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efea00095f0 tx=0x7efea0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:05.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:05.837+0000 7efeb2000640 1 -- 172.21.15.50:0/927112954 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efea80bbd20 con 0x7efeb4076720 2024-09-10T10:14:05.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:05 smithi050 ceph-mon[30354]: pgmap v478: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 41 MiB/s wr, 15 op/s 2024-09-10T10:14:06.064 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.062+0000 7efebc400640 1 -- 172.21.15.50:0/927112954 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efeb419fe50 con 0x7efeb4076720 2024-09-10T10:14:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.064+0000 7efeb2000640 1 -- 172.21.15.50:0/927112954 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7efeb419fe50 con 0x7efeb4076720 2024-09-10T10:14:06.065 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:14:06.065 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:14:06.066 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:14:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.066+0000 7efebc400640 1 -- 172.21.15.50:0/927112954 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7efe9c0a2c00 msgr2=0x7efe9c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.066+0000 7efebc400640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7efe9c0a2c00 0x7efe9c0a50c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efea00095f0 tx=0x7efea0005f90 comp rx=0 tx=0).stop 2024-09-10T10:14:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.066+0000 7efebc400640 1 -- 172.21.15.50:0/927112954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efeb4076720 msgr2=0x7efeb41a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.066+0000 7efebc400640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efeb4076720 0x7efeb41a4760 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efea802a930 tx=0x7efea8003b20 comp rx=0 tx=0).stop 2024-09-10T10:14:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.066+0000 7efebc400640 1 -- 172.21.15.50:0/927112954 shutdown_connections 2024-09-10T10:14:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.066+0000 7efebc400640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7efe9c0a2c00 0x7efe9c0a50c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:06.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.066+0000 7efebc400640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb4112a50 0x7efeb419e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:06.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.066+0000 7efebc400640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efeb4077040 0x7efeb41a4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:06.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.066+0000 7efebc400640 1 --2- 172.21.15.50:0/927112954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efeb4076720 0x7efeb41a4760 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:06.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.066+0000 7efebc400640 1 -- 172.21.15.50:0/927112954 >> 172.21.15.50:0/927112954 conn(0x7efeb40ffa50 msgr2=0x7efeb4101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:06.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.067+0000 7efebc400640 1 -- 172.21.15.50:0/927112954 shutdown_connections 2024-09-10T10:14:06.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:06.067+0000 7efebc400640 1 -- 172.21.15.50:0/927112954 wait complete. 2024-09-10T10:14:06.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:05 smithi189 ceph-mon[34999]: pgmap v478: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 41 MiB/s wr, 15 op/s 2024-09-10T10:14:06.348 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:05 smithi084 ceph-mon[34812]: pgmap v478: 129 pgs: 129 active+clean; 1.0 GiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 41 MiB/s wr, 15 op/s 2024-09-10T10:14:06.806 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T10:14:07.211 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:14:07.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:06 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/927112954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:14:07.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:06 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/927112954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:14:07.348 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:06 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/927112954' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:14:07.966 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:07 smithi050 ceph-mon[30354]: pgmap v479: 129 pgs: 129 active+clean; 721 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 12 MiB/s wr, 18 op/s 2024-09-10T10:14:08.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.183+0000 7f1670800640 1 -- 172.21.15.50:0/1659699630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1668109120 msgr2=0x7f1668110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:08.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.183+0000 7f1670800640 1 --2- 172.21.15.50:0/1659699630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1668109120 0x7f1668110ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1664009be0 tx=0x7f166402a6e0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.184+0000 7f1670800640 1 -- 172.21.15.50:0/1659699630 shutdown_connections 2024-09-10T10:14:08.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.184+0000 7f1670800640 1 --2- 172.21.15.50:0/1659699630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1668109120 0x7f1668110ca0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.184+0000 7f1670800640 1 --2- 172.21.15.50:0/1659699630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681049a0 0x7f16681089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.184+0000 7f1670800640 1 --2- 172.21.15.50:0/1659699630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1668103ff0 0x7f16681043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.184+0000 7f1670800640 1 -- 172.21.15.50:0/1659699630 >> 172.21.15.50:0/1659699630 conn(0x7f16680ffa90 msgr2=0x7f1668101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:08.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.184+0000 7f1670800640 1 -- 172.21.15.50:0/1659699630 shutdown_connections 2024-09-10T10:14:08.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.184+0000 7f1670800640 1 -- 172.21.15.50:0/1659699630 wait complete. 2024-09-10T10:14:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.187+0000 7f1670800640 1 Processor -- start 2024-09-10T10:14:08.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.187+0000 7f1670800640 1 -- start start 2024-09-10T10:14:08.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.188+0000 7f1670800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1668103ff0 0x7f1668110b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.188+0000 7f1670800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681049a0 0x7f166810dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.188+0000 7f1670800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1668109120 0x7f166810e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.188+0000 7f1670800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1668114150 con 0x7f16681049a0 2024-09-10T10:14:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.188+0000 7f1670800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1668113fd0 con 0x7f1668109120 2024-09-10T10:14:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.188+0000 7f1670800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f16681142d0 con 0x7f1668103ff0 2024-09-10T10:14:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.188+0000 7f166d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681049a0 0x7f166810dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.188+0000 7f166e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1668109120 0x7f166810e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.188+0000 7f166d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681049a0 0x7f166810dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40280/0 (socket says 172.21.15.50:40280) 2024-09-10T10:14:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.188+0000 7f166d400640 1 -- 172.21.15.50:0/347713669 learned_addr learned my addr 172.21.15.50:0/347713669 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.188+0000 7f166e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1668109120 0x7f166810e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:55366/0 (socket says 172.21.15.50:55366) 2024-09-10T10:14:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.189+0000 7f166de00640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1668103ff0 0x7f1668110b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.189+0000 7f166e800640 1 -- 172.21.15.50:0/347713669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1668103ff0 msgr2=0x7f1668110b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.189+0000 7f166e800640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1668103ff0 0x7f1668110b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.189+0000 7f166e800640 1 -- 172.21.15.50:0/347713669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681049a0 msgr2=0x7f166810dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.189+0000 7f166e800640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681049a0 0x7f166810dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.189+0000 7f166e800640 1 -- 172.21.15.50:0/347713669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166810ea30 con 0x7f1668109120 2024-09-10T10:14:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.189+0000 7f166de00640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1668103ff0 0x7f1668110b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:14:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.189+0000 7f166d400640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681049a0 0x7f166810dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:14:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.190+0000 7f166e800640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1668109120 0x7f166810e170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1664034040 tx=0x7f1664031a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.190+0000 7f1662a00640 1 -- 172.21.15.50:0/347713669 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664041020 con 0x7f1668109120 2024-09-10T10:14:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.190+0000 7f1662a00640 1 -- 172.21.15.50:0/347713669 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1664030c80 con 0x7f1668109120 2024-09-10T10:14:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.190+0000 7f1662a00640 1 -- 172.21.15.50:0/347713669 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664036040 con 0x7f1668109120 2024-09-10T10:14:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.191+0000 7f1670800640 1 -- 172.21.15.50:0/347713669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16681aaf50 con 0x7f1668109120 2024-09-10T10:14:08.193 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.191+0000 7f1670800640 1 -- 172.21.15.50:0/347713669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16681ab350 con 0x7f1668109120 2024-09-10T10:14:08.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.197+0000 7f1662a00640 1 -- 172.21.15.50:0/347713669 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1664044020 con 0x7f1668109120 2024-09-10T10:14:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.198+0000 7f16733fe740 1 Processor -- start 2024-09-10T10:14:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.199+0000 7f16733fe740 1 -- start start 2024-09-10T10:14:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.199+0000 7f1662a00640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f16500a2cd0 0x7f16500a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.199+0000 7f1662a00640 1 -- 172.21.15.50:0/347713669 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f16640efd90 con 0x7f1668109120 2024-09-10T10:14:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.200+0000 7f166d400640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f16500a2cd0 0x7f16500a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.200+0000 7f16733fe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de55050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.200+0000 7f16733fe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de55590 0x56243de5f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.200+0000 7f16733fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de62240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.201+0000 7f16733fe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56243ddbb3e0 con 0x56243de54c70 2024-09-10T10:14:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.201+0000 7f16733fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56243dd62d80 con 0x56243de5fe50 2024-09-10T10:14:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.201+0000 7f16733fe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56243ddb73a0 con 0x56243de55590 2024-09-10T10:14:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.201+0000 7f166de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de55050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.201+0000 7f166de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de55050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40292/0 (socket says 172.21.15.50:40292) 2024-09-10T10:14:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.201+0000 7f166de00640 1 -- 172.21.15.50:0/4058107733 learned_addr learned my addr 172.21.15.50:0/4058107733 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.201+0000 7f166e800640 1 --2- 172.21.15.50:0/4058107733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de62240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.201+0000 7f166d400640 1 --2- 172.21.15.50:0/4058107733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de55590 0x56243de5f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.202+0000 7f166e800640 1 -- 172.21.15.50:0/4058107733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de55590 msgr2=0x56243de5f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:08.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.202+0000 7f166e800640 1 --2- 172.21.15.50:0/4058107733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de55590 0x56243de5f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.202+0000 7f166e800640 1 -- 172.21.15.50:0/4058107733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 msgr2=0x56243de55050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:08.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.202+0000 7f166e800640 1 --2- 172.21.15.50:0/4058107733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de55050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.202+0000 7f166e800640 1 -- 172.21.15.50:0/4058107733 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56243dd81ae0 con 0x56243de5fe50 2024-09-10T10:14:08.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.202+0000 7f166d400640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f16500a2cd0 0x7f16500a5190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f166810f3d0 tx=0x7f165c014a30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:08.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.203+0000 7f166e800640 1 --2- 172.21.15.50:0/4058107733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de62240 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f16640ed4a0 tx=0x7f166402a6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fccbf36df0897d3d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:08.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.203+0000 7f1657000640 1 -- 172.21.15.50:0/4058107733 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16640c05b0 con 0x56243de5fe50 2024-09-10T10:14:08.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.203+0000 7f1657000640 1 -- 172.21.15.50:0/4058107733 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16640c4e70 con 0x56243de5fe50 2024-09-10T10:14:08.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.203+0000 7f1657000640 1 -- 172.21.15.50:0/4058107733 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16640dc0f0 con 0x56243de5fe50 2024-09-10T10:14:08.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.204+0000 7f16733fe740 1 -- 172.21.15.50:0/4058107733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 msgr2=0x56243de62240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:08.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.204+0000 7f16733fe740 1 --2- 172.21.15.50:0/4058107733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de62240 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f16640ed4a0 tx=0x7f166402a6e0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.205+0000 7f16733fe740 1 -- 172.21.15.50:0/4058107733 shutdown_connections 2024-09-10T10:14:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.205+0000 7f16733fe740 1 --2- 172.21.15.50:0/4058107733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de62240 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.205+0000 7f16733fe740 1 --2- 172.21.15.50:0/4058107733 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de55590 0x56243de5f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.205+0000 7f16733fe740 1 --2- 172.21.15.50:0/4058107733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de55050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.205+0000 7f16733fe740 1 -- 172.21.15.50:0/4058107733 >> 172.21.15.50:0/4058107733 conn(0x56243de51200 msgr2=0x56243de515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:08.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.205+0000 7f16733fe740 1 -- 172.21.15.50:0/4058107733 shutdown_connections 2024-09-10T10:14:08.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.205+0000 7f16733fe740 1 -- 172.21.15.50:0/4058107733 wait complete. 2024-09-10T10:14:08.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.206+0000 7f16733fe740 1 -- start start 2024-09-10T10:14:08.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.207+0000 7f16733fe740 1 Processor -- start 2024-09-10T10:14:08.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.209+0000 7f16733fe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de5cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.209+0000 7f16733fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de55590 0x56243de5d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.209+0000 7f16733fe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de5fe50 0x56243de5d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.209+0000 7f16733fe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56243dd62d80 con 0x56243de54c70 2024-09-10T10:14:08.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.209+0000 7f16733fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56243dd760f0 con 0x56243de55590 2024-09-10T10:14:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.209+0000 7f16733fe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56243de627e0 con 0x56243de5fe50 2024-09-10T10:14:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.209+0000 7f16733fe740 10 client.0 _ll_register_callbacks cb 0x56243dd5dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.209+0000 7f166e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de5fe50 0x56243de5d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.209+0000 7f166e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de5fe50 0x56243de5d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:51018/0 (socket says 172.21.15.50:51018) 2024-09-10T10:14:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.209+0000 7f166e800640 1 -- 172.21.15.50:0/1683546288 learned_addr learned my addr 172.21.15.50:0/1683546288 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.210+0000 7f166e800640 1 -- 172.21.15.50:0/1683546288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de55590 msgr2=0x56243de5d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.210+0000 7f166e800640 1 --2- 172.21.15.50:0/1683546288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de55590 0x56243de5d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.210+0000 7f166de00640 1 --2- 172.21.15.50:0/1683546288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de5cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.210+0000 7f166e800640 1 -- 172.21.15.50:0/1683546288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 msgr2=0x56243de5cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.210+0000 7f166e800640 1 --2- 172.21.15.50:0/1683546288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de5cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.210+0000 7f166e800640 1 -- 172.21.15.50:0/1683546288 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56243db2c3c0 con 0x56243de5fe50 2024-09-10T10:14:08.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.210+0000 7f166de00640 1 --2- 172.21.15.50:0/1683546288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de5cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:14:08.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.211+0000 7f166e800640 1 --2- 172.21.15.50:0/1683546288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de5fe50 0x56243de5d790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f16640c4940 tx=0x7f16640c05b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcd97c41e1778693 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:08.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.211+0000 7f164b400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:14:08.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.211+0000 7f164b400640 1 -- 172.21.15.50:0/1683546288 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16640c8070 con 0x56243de5fe50 2024-09-10T10:14:08.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.211+0000 7f164b400640 1 -- 172.21.15.50:0/1683546288 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f16640b8870 con 0x56243de5fe50 2024-09-10T10:14:08.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.212+0000 7f16733fe740 1 -- 172.21.15.50:0/1683546288 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16640c4e70 con 0x56243de5fe50 2024-09-10T10:14:08.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.212+0000 7f164b400640 1 -- 172.21.15.50:0/1683546288 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f16640d9030 con 0x56243de5fe50 2024-09-10T10:14:08.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.213+0000 7f16733fe740 10 client.25996 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:08.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.213+0000 7f16733fe740 1 -- 172.21.15.50:0/1683546288 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56243de6e5e0 con 0x56243de5fe50 2024-09-10T10:14:08.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.213+0000 7f164b400640 1 -- 172.21.15.50:0/1683546288 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16640c4e70 con 0x56243de5fe50 2024-09-10T10:14:08.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.213+0000 7f164b400640 1 -- 172.21.15.50:0/1683546288 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f16640cb020 con 0x56243de5fe50 2024-09-10T10:14:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.213+0000 7f16733fe740 10 client.25996 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.213+0000 7f16733fe740 10 client.25996 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:14:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.213+0000 7f16733fe740 20 client.25996 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.214+0000 7f16733fe740 1 --2- 172.21.15.50:0/1683546288 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56243de6fa40 0x56243de71e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.214+0000 7f16733fe740 4 client.25996 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:14:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.214+0000 7f16733fe740 1 -- 172.21.15.50:0/1683546288 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56243ddc8950 con 0x56243de6fa40 2024-09-10T10:14:08.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.214+0000 7f166de00640 1 --2- 172.21.15.50:0/1683546288 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56243de6fa40 0x56243de71e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.215+0000 7f164b400640 10 client.25996 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:14:08.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.215+0000 7f166de00640 1 --2- 172.21.15.50:0/1683546288 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56243de6fa40 0x56243de71e90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d269e1c60126fd8e server_cookie=f68f5d7f224cd2c1 in_seq=0 out_seq=0 2024-09-10T10:14:08.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.216+0000 7f164b400640 1 -- 172.21.15.50:0/1683546288 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56243ddc8950 con 0x56243de6fa40 2024-09-10T10:14:08.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.216+0000 7f164b400640 10 client.25996 handle_command_reply: tid=0 2024-09-10T10:14:08.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.216+0000 7f16733fe740 1 client.25996 shutdown 2024-09-10T10:14:08.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.217+0000 7f16733fe740 1 -- 172.21.15.50:0/1683546288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de5fe50 msgr2=0x56243de5d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.217+0000 7f16733fe740 1 --2- 172.21.15.50:0/1683546288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de5fe50 0x56243de5d790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f16640c4940 tx=0x7f16640c05b0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.217+0000 7f16733fe740 1 -- 172.21.15.50:0/1683546288 shutdown_connections 2024-09-10T10:14:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.217+0000 7f16733fe740 1 --2- 172.21.15.50:0/1683546288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de5fe50 0x56243de5d790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.217+0000 7f16733fe740 1 --2- 172.21.15.50:0/1683546288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de55590 0x56243de5d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.217+0000 7f16733fe740 1 --2- 172.21.15.50:0/1683546288 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56243de6fa40 0x56243de71e90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.217+0000 7f16733fe740 1 --2- 172.21.15.50:0/1683546288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de5cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.217+0000 7f16733fe740 1 -- 172.21.15.50:0/1683546288 >> 172.21.15.50:0/1683546288 conn(0x56243de51200 msgr2=0x56243de56f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.217+0000 7f164b400640 0 client.25996 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:14:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.221+0000 7f16733fe740 1 -- 172.21.15.50:0/1683546288 shutdown_connections 2024-09-10T10:14:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.222+0000 7f16733fe740 1 -- 172.21.15.50:0/1683546288 wait complete. 2024-09-10T10:14:08.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.222+0000 7f16733fe740 20 client.25996 trim_cache size 0 max 16384 2024-09-10T10:14:08.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.255+0000 7f16733fe740 1 Processor -- start 2024-09-10T10:14:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.255+0000 7f16733fe740 1 -- start start 2024-09-10T10:14:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.255+0000 7f16733fe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de54c70 0x56243de5ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.255+0000 7f16733fe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de55590 0x56243de77760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.256+0000 7f166de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de54c70 0x56243de5ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.256+0000 7f166de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de54c70 0x56243de5ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:51028/0 (socket says 172.21.15.50:51028) 2024-09-10T10:14:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.256+0000 7f16733fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de77ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.256+0000 7f166d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de55590 0x56243de77760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.256+0000 7f166d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de55590 0x56243de77760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40312/0 (socket says 172.21.15.50:40312) 2024-09-10T10:14:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.256+0000 7f166de00640 1 -- 172.21.15.50:0/1805733691 learned_addr learned my addr 172.21.15.50:0/1805733691 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.257+0000 7f16733fe740 1 -- 172.21.15.50:0/1805733691 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f16681b7ae0 con 0x56243de55590 2024-09-10T10:14:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.257+0000 7f16733fe740 1 -- 172.21.15.50:0/1805733691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f16681b53b0 con 0x56243de5fe50 2024-09-10T10:14:08.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.257+0000 7f16733fe740 1 -- 172.21.15.50:0/1805733691 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f16681b3200 con 0x56243de54c70 2024-09-10T10:14:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.257+0000 7f166e800640 1 --2- 172.21.15.50:0/1805733691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de77ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.257+0000 7f166de00640 1 -- 172.21.15.50:0/1805733691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 msgr2=0x56243de77ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.258+0000 7f166de00640 1 --2- 172.21.15.50:0/1805733691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de77ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.258+0000 7f166de00640 1 -- 172.21.15.50:0/1805733691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de55590 msgr2=0x56243de77760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:08.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.258+0000 7f166de00640 1 --2- 172.21.15.50:0/1805733691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de55590 0x56243de77760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.258+0000 7f166de00640 1 -- 172.21.15.50:0/1805733691 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56243de51030 con 0x56243de54c70 2024-09-10T10:14:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.258+0000 7f166e800640 1 --2- 172.21.15.50:0/1805733691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de77ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:14:08.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.258+0000 7f166de00640 1 --2- 172.21.15.50:0/1805733691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de54c70 0x56243de5ec80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x56243de726d0 tx=0x7f16580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9d3b2930b95a34b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.258+0000 7f1656600640 1 -- 172.21.15.50:0/1805733691 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658012310 con 0x56243de54c70 2024-09-10T10:14:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.258+0000 7f1656600640 1 -- 172.21.15.50:0/1805733691 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1658012e30 con 0x56243de54c70 2024-09-10T10:14:08.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.258+0000 7f1656600640 1 -- 172.21.15.50:0/1805733691 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16580047a0 con 0x56243de54c70 2024-09-10T10:14:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.260+0000 7f16733fe740 1 -- 172.21.15.50:0/1805733691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de54c70 msgr2=0x56243de5ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.260+0000 7f16733fe740 1 --2- 172.21.15.50:0/1805733691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de54c70 0x56243de5ec80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x56243de726d0 tx=0x7f16580046c0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.260+0000 7f16733fe740 1 -- 172.21.15.50:0/1805733691 shutdown_connections 2024-09-10T10:14:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.260+0000 7f16733fe740 1 --2- 172.21.15.50:0/1805733691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de77ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.260+0000 7f16733fe740 1 --2- 172.21.15.50:0/1805733691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de55590 0x56243de77760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.260+0000 7f16733fe740 1 --2- 172.21.15.50:0/1805733691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de54c70 0x56243de5ec80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.260+0000 7f16733fe740 1 -- 172.21.15.50:0/1805733691 >> 172.21.15.50:0/1805733691 conn(0x56243de51200 msgr2=0x56243de5e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.261+0000 7f16733fe740 1 -- 172.21.15.50:0/1805733691 shutdown_connections 2024-09-10T10:14:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.261+0000 7f16733fe740 1 -- 172.21.15.50:0/1805733691 wait complete. 2024-09-10T10:14:08.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.262+0000 7f16733fe740 1 -- start start 2024-09-10T10:14:08.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.263+0000 7f16733fe740 1 Processor -- start 2024-09-10T10:14:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.264+0000 7f16733fe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de59d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.265+0000 7f16733fe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de55590 0x56243de5a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.265+0000 7f16733fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de5a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.265+0000 7f166de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de59d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.266+0000 7f166de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de59d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40314/0 (socket says 172.21.15.50:40314) 2024-09-10T10:14:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.266+0000 7f166d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de55590 0x56243de5a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.266+0000 7f166d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de55590 0x56243de5a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:51030/0 (socket says 172.21.15.50:51030) 2024-09-10T10:14:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.266+0000 7f16733fe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f16681b3870 con 0x56243de54c70 2024-09-10T10:14:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.266+0000 7f16733fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f16681b4ce0 con 0x56243de5fe50 2024-09-10T10:14:08.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.266+0000 7f16733fe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f16681b3f40 con 0x56243de55590 2024-09-10T10:14:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.266+0000 7f166d400640 1 -- 172.21.15.50:0/112531889 learned_addr learned my addr 172.21.15.50:0/112531889 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.266+0000 7f166e800640 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de5a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.266+0000 7f16733fe740 10 client.0 _ll_register_callbacks cb 0x7f16640bbdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.266+0000 7f166d400640 1 -- 172.21.15.50:0/112531889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 msgr2=0x56243de5a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.266+0000 7f166d400640 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de5a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.266+0000 7f166d400640 1 -- 172.21.15.50:0/112531889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 msgr2=0x56243de59d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.266+0000 7f166d400640 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de59d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.267+0000 7f166d400640 1 -- 172.21.15.50:0/112531889 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56243de4c770 con 0x56243de55590 2024-09-10T10:14:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.267+0000 7f166de00640 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de59d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:14:08.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.267+0000 7f166e800640 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de5a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:14:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.268+0000 7f166d400640 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de55590 0x56243de5a2d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f165c009ef0 tx=0x7f165c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1873366c062759f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.268+0000 7f164b400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:14:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.269+0000 7f164b400640 1 -- 172.21.15.50:0/112531889 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c011b20 con 0x56243de55590 2024-09-10T10:14:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.269+0000 7f164b400640 1 -- 172.21.15.50:0/112531889 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f165c011cc0 con 0x56243de55590 2024-09-10T10:14:08.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.269+0000 7f16733fe740 1 -- 172.21.15.50:0/112531889 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1658012e30 con 0x56243de55590 2024-09-10T10:14:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.270+0000 7f164b400640 1 -- 172.21.15.50:0/112531889 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f165c005020 con 0x56243de55590 2024-09-10T10:14:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.270+0000 7f16733fe740 10 client.26002 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:08.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.270+0000 7f16733fe740 1 -- 172.21.15.50:0/112531889 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56243deda8a0 con 0x56243de55590 2024-09-10T10:14:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.272+0000 7f164b400640 1 -- 172.21.15.50:0/112531889 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1658012e30 con 0x56243de55590 2024-09-10T10:14:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.272+0000 7f164b400640 1 -- 172.21.15.50:0/112531889 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f165c027030 con 0x56243de55590 2024-09-10T10:14:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.273+0000 7f16733fe740 10 client.26002 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.273+0000 7f16733fe740 10 client.26002 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:14:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.273+0000 7f16733fe740 20 client.26002 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.273+0000 7f16733fe740 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56243dedafb0 0x56243dedd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.273+0000 7f16733fe740 4 client.26002 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:14:08.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.273+0000 7f16733fe740 1 -- 172.21.15.50:0/112531889 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56243ddc2e60 con 0x56243dedafb0 2024-09-10T10:14:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.273+0000 7f166de00640 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56243dedafb0 0x56243dedd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.274+0000 7f166de00640 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56243dedafb0 0x56243dedd3d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=475f6f69f79ac273 server_cookie=d6601f58a7d7071d in_seq=0 out_seq=0 2024-09-10T10:14:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.274+0000 7f164b400640 10 client.26002 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:14:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.274+0000 7f164b400640 1 -- 172.21.15.50:0/112531889 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56243ddc2e60 con 0x56243dedafb0 2024-09-10T10:14:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.274+0000 7f164b400640 10 client.26002 handle_command_reply: tid=0 2024-09-10T10:14:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.274+0000 7f16733fe740 1 client.26002 shutdown 2024-09-10T10:14:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.275+0000 7f16733fe740 1 -- 172.21.15.50:0/112531889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de55590 msgr2=0x56243de5a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.275+0000 7f16733fe740 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de55590 0x56243de5a2d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f165c009ef0 tx=0x7f165c004730 comp rx=0 tx=0).stop 2024-09-10T10:14:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.275+0000 7f16733fe740 1 -- 172.21.15.50:0/112531889 shutdown_connections 2024-09-10T10:14:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.275+0000 7f16733fe740 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56243de5fe50 0x56243de5a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.275+0000 7f16733fe740 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56243de55590 0x56243de5a2d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.275+0000 7f16733fe740 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x56243dedafb0 0x56243dedd3d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.275+0000 7f16733fe740 1 --2- 172.21.15.50:0/112531889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56243de54c70 0x56243de59d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.275+0000 7f16733fe740 1 -- 172.21.15.50:0/112531889 >> 172.21.15.50:0/112531889 conn(0x56243de51200 msgr2=0x56243de5ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.275+0000 7f164b400640 0 client.26002 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:14:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.275+0000 7f16733fe740 1 -- 172.21.15.50:0/112531889 shutdown_connections 2024-09-10T10:14:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.276+0000 7f16733fe740 1 -- 172.21.15.50:0/112531889 wait complete. 2024-09-10T10:14:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.276+0000 7f16733fe740 20 client.26002 trim_cache size 0 max 16384 2024-09-10T10:14:08.278 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.277+0000 7f1670800640 1 -- 172.21.15.50:0/347713669 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f16500a2cd0 msgr2=0x7f16500a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.277+0000 7f1670800640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f16500a2cd0 0x7f16500a5190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f166810f3d0 tx=0x7f165c014a30 comp rx=0 tx=0).stop 2024-09-10T10:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.277+0000 7f1670800640 1 -- 172.21.15.50:0/347713669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1668109120 msgr2=0x7f166810e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.277+0000 7f1670800640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1668109120 0x7f166810e170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1664034040 tx=0x7f1664031a50 comp rx=0 tx=0).stop 2024-09-10T10:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.277+0000 7f1670800640 1 -- 172.21.15.50:0/347713669 shutdown_connections 2024-09-10T10:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.277+0000 7f1670800640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f16500a2cd0 0x7f16500a5190 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.277+0000 7f1670800640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1668109120 0x7f166810e170 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.277+0000 7f1670800640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16681049a0 0x7f166810dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.277+0000 7f1670800640 1 --2- 172.21.15.50:0/347713669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1668103ff0 0x7f1668110b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.277+0000 7f1670800640 1 -- 172.21.15.50:0/347713669 >> 172.21.15.50:0/347713669 conn(0x7f16680ffa90 msgr2=0x7f1668100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.278+0000 7f1670800640 1 -- 172.21.15.50:0/347713669 shutdown_connections 2024-09-10T10:14:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:08.278+0000 7f1670800640 1 -- 172.21.15.50:0/347713669 wait complete. 2024-09-10T10:14:08.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:07 smithi189 ceph-mon[34999]: pgmap v479: 129 pgs: 129 active+clean; 721 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 12 MiB/s wr, 18 op/s 2024-09-10T10:14:08.348 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:07 smithi084 ceph-mon[34812]: pgmap v479: 129 pgs: 129 active+clean; 721 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 12 MiB/s wr, 18 op/s 2024-09-10T10:14:09.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T10:14:10.218 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:09 smithi050 ceph-mon[30354]: pgmap v480: 129 pgs: 129 active+clean; 205 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 7.3 MiB/s wr, 29 op/s 2024-09-10T10:14:10.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:09 smithi189 ceph-mon[34999]: pgmap v480: 129 pgs: 129 active+clean; 205 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 7.3 MiB/s wr, 29 op/s 2024-09-10T10:14:10.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:09 smithi084 ceph-mon[34812]: pgmap v480: 129 pgs: 129 active+clean; 205 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 7.3 MiB/s wr, 29 op/s 2024-09-10T10:14:10.647 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:14:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.661+0000 7fe14f200640 1 -- 172.21.15.50:0/3704114150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe150076720 msgr2=0x7fe150076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.661+0000 7fe14f200640 1 --2- 172.21.15.50:0/3704114150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe150076720 0x7fe150076b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe140009900 tx=0x7fe14002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.662+0000 7fe14f200640 1 -- 172.21.15.50:0/3704114150 shutdown_connections 2024-09-10T10:14:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.662+0000 7fe14f200640 1 --2- 172.21.15.50:0/3704114150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe150112870 0x7fe150114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.662+0000 7fe14f200640 1 --2- 172.21.15.50:0/3704114150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe150077040 0x7fe150112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.662+0000 7fe14f200640 1 --2- 172.21.15.50:0/3704114150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe150076720 0x7fe150076b00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.662+0000 7fe14f200640 1 -- 172.21.15.50:0/3704114150 >> 172.21.15.50:0/3704114150 conn(0x7fe1500ff8d0 msgr2=0x7fe150101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.662+0000 7fe14f200640 1 -- 172.21.15.50:0/3704114150 shutdown_connections 2024-09-10T10:14:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.663+0000 7fe14f200640 1 -- 172.21.15.50:0/3704114150 wait complete. 2024-09-10T10:14:11.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.666+0000 7fe14f200640 1 Processor -- start 2024-09-10T10:14:11.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.667+0000 7fe14f200640 1 -- start start 2024-09-10T10:14:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.668+0000 7fe14f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe150076720 0x7fe1501a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.668+0000 7fe14f200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe150077040 0x7fe1501a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.668+0000 7fe14f200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe150112870 0x7fe15019e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.668+0000 7fe14f200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe150118400 con 0x7fe150077040 2024-09-10T10:14:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.668+0000 7fe14f200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe150118280 con 0x7fe150076720 2024-09-10T10:14:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.668+0000 7fe14f200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe150118580 con 0x7fe150112870 2024-09-10T10:14:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.669+0000 7fe14d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe150077040 0x7fe1501a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.669+0000 7fe14d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe150077040 0x7fe1501a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40328/0 (socket says 172.21.15.50:40328) 2024-09-10T10:14:11.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.669+0000 7fe14d400640 1 -- 172.21.15.50:0/495101491 learned_addr learned my addr 172.21.15.50:0/495101491 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.670+0000 7fe14e800640 1 --2- 172.21.15.50:0/495101491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe150112870 0x7fe15019e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.670+0000 7fe14d400640 1 -- 172.21.15.50:0/495101491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe150112870 msgr2=0x7fe15019e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.670+0000 7fe14d400640 1 --2- 172.21.15.50:0/495101491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe150112870 0x7fe15019e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.670+0000 7fe14d400640 1 -- 172.21.15.50:0/495101491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe150076720 msgr2=0x7fe1501a4660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:14:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.670+0000 7fe14d400640 1 --2- 172.21.15.50:0/495101491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe150076720 0x7fe1501a4660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.670+0000 7fe14d400640 1 -- 172.21.15.50:0/495101491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15019efa0 con 0x7fe150077040 2024-09-10T10:14:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.671+0000 7fe14d400640 1 --2- 172.21.15.50:0/495101491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe150077040 0x7fe1501a4ba0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00e9f0 tx=0x7fe13c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:11.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.672+0000 7fe146a00640 1 -- 172.21.15.50:0/495101491 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00cd80 con 0x7fe150077040 2024-09-10T10:14:11.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.672+0000 7fe146a00640 1 -- 172.21.15.50:0/495101491 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe13c005500 con 0x7fe150077040 2024-09-10T10:14:11.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.672+0000 7fe146a00640 1 -- 172.21.15.50:0/495101491 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c010690 con 0x7fe150077040 2024-09-10T10:14:11.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.672+0000 7fe14f200640 1 -- 172.21.15.50:0/495101491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15019f290 con 0x7fe150077040 2024-09-10T10:14:11.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.673+0000 7fe14f200640 1 -- 172.21.15.50:0/495101491 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1501ab410 con 0x7fe150077040 2024-09-10T10:14:11.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.676+0000 7fe146a00640 1 -- 172.21.15.50:0/495101491 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe13c0046c0 con 0x7fe150077040 2024-09-10T10:14:11.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.679+0000 7fe146a00640 1 --2- 172.21.15.50:0/495101491 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1340a2cd0 0x7fe1340a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.679+0000 7fe146a00640 1 -- 172.21.15.50:0/495101491 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe13c0cf880 con 0x7fe150077040 2024-09-10T10:14:11.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.682+0000 7fe157c24740 1 Processor -- start 2024-09-10T10:14:11.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.682+0000 7fe157c24740 1 -- start start 2024-09-10T10:14:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.683+0000 7fe157c24740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9747e40 0x564ad9748220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.683+0000 7fe157c24740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9748760 0x564ad9752ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.683+0000 7fe157c24740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9753020 0x564ad9755410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.683+0000 7fe157c24740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564ad96ae3e0 con 0x564ad9747e40 2024-09-10T10:14:11.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.683+0000 7fe157c24740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564ad9655d80 con 0x564ad9753020 2024-09-10T10:14:11.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.683+0000 7fe157c24740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564ad96aa3a0 con 0x564ad9748760 2024-09-10T10:14:11.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.684+0000 7fe14d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9748760 0x564ad9752ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.684+0000 7fe14d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9748760 0x564ad9752ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:51048/0 (socket says 172.21.15.50:51048) 2024-09-10T10:14:11.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.684+0000 7fe14d400640 1 -- 172.21.15.50:0/4260420305 learned_addr learned my addr 172.21.15.50:0/4260420305 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:11.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.684+0000 7fe14e800640 1 --2- 172.21.15.50:0/4260420305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9753020 0x564ad9755410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.684+0000 7fe14d400640 1 -- 172.21.15.50:0/4260420305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9753020 msgr2=0x564ad9755410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.685+0000 7fe14d400640 1 --2- 172.21.15.50:0/4260420305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9753020 0x564ad9755410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.685+0000 7fe14d400640 1 -- 172.21.15.50:0/4260420305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9747e40 msgr2=0x564ad9748220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:14:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.685+0000 7fe14d400640 1 --2- 172.21.15.50:0/4260420305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9747e40 0x564ad9748220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.685+0000 7fe14d400640 1 -- 172.21.15.50:0/4260420305 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad9674ae0 con 0x564ad9748760 2024-09-10T10:14:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.685+0000 7fe14d400640 1 --2- 172.21.15.50:0/4260420305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9748760 0x564ad9752ae0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe13c09b9f0 tx=0x7fe13c09b830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bff30af8dae2f30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:11.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.686+0000 7fe13b400640 1 -- 172.21.15.50:0/4260420305 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c0b9070 con 0x564ad9748760 2024-09-10T10:14:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.686+0000 7fe13b400640 1 -- 172.21.15.50:0/4260420305 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe13c09bcf0 con 0x564ad9748760 2024-09-10T10:14:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.686+0000 7fe13b400640 1 -- 172.21.15.50:0/4260420305 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c0b9070 con 0x564ad9748760 2024-09-10T10:14:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.687+0000 7fe14de00640 1 --2- 172.21.15.50:0/495101491 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1340a2cd0 0x7fe1340a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.688+0000 7fe157c24740 1 -- 172.21.15.50:0/4260420305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9748760 msgr2=0x564ad9752ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:11.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.689+0000 7fe157c24740 1 --2- 172.21.15.50:0/4260420305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9748760 0x564ad9752ae0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe13c09b9f0 tx=0x7fe13c09b830 comp rx=0 tx=0).stop 2024-09-10T10:14:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.689+0000 7fe14de00640 1 --2- 172.21.15.50:0/495101491 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1340a2cd0 0x7fe1340a5190 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe140009850 tx=0x7fe140005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.690+0000 7fe157c24740 1 -- 172.21.15.50:0/4260420305 shutdown_connections 2024-09-10T10:14:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.690+0000 7fe157c24740 1 --2- 172.21.15.50:0/4260420305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9753020 0x564ad9755410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.690+0000 7fe157c24740 1 --2- 172.21.15.50:0/4260420305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9748760 0x564ad9752ae0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.690+0000 7fe157c24740 1 --2- 172.21.15.50:0/4260420305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9747e40 0x564ad9748220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.690+0000 7fe157c24740 1 -- 172.21.15.50:0/4260420305 >> 172.21.15.50:0/4260420305 conn(0x564ad97443d0 msgr2=0x564ad97447b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.691+0000 7fe157c24740 1 -- 172.21.15.50:0/4260420305 shutdown_connections 2024-09-10T10:14:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.691+0000 7fe157c24740 1 -- 172.21.15.50:0/4260420305 wait complete. 2024-09-10T10:14:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.692+0000 7fe157c24740 1 -- start start 2024-09-10T10:14:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.693+0000 7fe157c24740 1 Processor -- start 2024-09-10T10:14:11.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.694+0000 7fe157c24740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 0x564ad974ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.694+0000 7fe157c24740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad97504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.694+0000 7fe157c24740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad9750a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.694+0000 7fe157c24740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564ad9755bf0 con 0x564ad9748760 2024-09-10T10:14:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.694+0000 7fe157c24740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564ad96690f0 con 0x564ad9747e40 2024-09-10T10:14:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.694+0000 7fe157c24740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564ad9755d70 con 0x564ad9753020 2024-09-10T10:14:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.695+0000 7fe14d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad97504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.695+0000 7fe14e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad9750a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.695+0000 7fe14e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad9750a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:51054/0 (socket says 172.21.15.50:51054) 2024-09-10T10:14:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.695+0000 7fe14d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad97504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40344/0 (socket says 172.21.15.50:40344) 2024-09-10T10:14:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.695+0000 7fe14e800640 1 -- 172.21.15.50:0/479673641 learned_addr learned my addr 172.21.15.50:0/479673641 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.696+0000 7fe14e800640 1 -- 172.21.15.50:0/479673641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 msgr2=0x564ad974ffa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:14:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.696+0000 7fe14e800640 1 --2- 172.21.15.50:0/479673641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 0x564ad974ffa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.696+0000 7fe14e800640 1 -- 172.21.15.50:0/479673641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 msgr2=0x564ad97504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.696+0000 7fe14e800640 1 --2- 172.21.15.50:0/479673641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad97504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.696+0000 7fe14e800640 1 -- 172.21.15.50:0/479673641 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad941f3c0 con 0x564ad9753020 2024-09-10T10:14:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.696+0000 7fe14d400640 1 --2- 172.21.15.50:0/479673641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad97504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:14:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.697+0000 7fe14e800640 1 --2- 172.21.15.50:0/479673641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad9750a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe1480216b0 tx=0x7fe148021b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=218a7f87914bd95f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.695+0000 7fe157c24740 10 client.0 _ll_register_callbacks cb 0x564ad9650bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.697+0000 7fe157c24740 1 -- 172.21.15.50:0/479673641 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe13c09bcf0 con 0x564ad9753020 2024-09-10T10:14:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.697+0000 7fe12fe00640 10 client.26011 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:14:11.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.697+0000 7fe12fe00640 1 -- 172.21.15.50:0/479673641 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14801fae0 con 0x564ad9753020 2024-09-10T10:14:11.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.697+0000 7fe12fe00640 1 -- 172.21.15.50:0/479673641 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe14801fc80 con 0x564ad9753020 2024-09-10T10:14:11.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.697+0000 7fe12fe00640 1 -- 172.21.15.50:0/479673641 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe14801fe80 con 0x564ad9753020 2024-09-10T10:14:11.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.698+0000 7fe157c24740 10 client.26011 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:11.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.698+0000 7fe157c24740 1 -- 172.21.15.50:0/479673641 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=25}) -- 0x564ad9761bb0 con 0x564ad9753020 2024-09-10T10:14:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.709+0000 7fe12fe00640 1 -- 172.21.15.50:0/479673641 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe148037420 con 0x564ad9753020 2024-09-10T10:14:11.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.709+0000 7fe157c24740 10 client.26011 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.709+0000 7fe157c24740 10 client.26011 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:14:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.709+0000 7fe157c24740 20 client.26011 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.709+0000 7fe157c24740 1 --2- 172.21.15.50:0/479673641 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x564ad9763020 0x564ad9765470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.709+0000 7fe157c24740 4 client.26011 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:14:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.709+0000 7fe157c24740 1 -- 172.21.15.50:0/479673641 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ad96bb950 con 0x564ad9763020 2024-09-10T10:14:11.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.710+0000 7fe14de00640 1 --2- 172.21.15.50:0/479673641 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x564ad9763020 0x564ad9765470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.711+0000 7fe12fe00640 10 client.26011 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:14:11.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.711+0000 7fe14de00640 1 --2- 172.21.15.50:0/479673641 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x564ad9763020 0x564ad9765470 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8e203e1c951ce711 server_cookie=f2c724129509b003 in_seq=0 out_seq=0 2024-09-10T10:14:11.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.712+0000 7fe12fe00640 1 -- 172.21.15.50:0/479673641 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ad96bb950 con 0x564ad9763020 2024-09-10T10:14:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.712+0000 7fe12fe00640 10 client.26011 handle_command_reply: tid=0 2024-09-10T10:14:11.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.712+0000 7fe157c24740 1 client.26011 shutdown 2024-09-10T10:14:11.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.714+0000 7fe157c24740 1 -- 172.21.15.50:0/479673641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 msgr2=0x564ad9750a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:11.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.714+0000 7fe157c24740 1 --2- 172.21.15.50:0/479673641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad9750a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe1480216b0 tx=0x7fe148021b70 comp rx=0 tx=0).stop 2024-09-10T10:14:11.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.715+0000 7fe157c24740 1 -- 172.21.15.50:0/479673641 shutdown_connections 2024-09-10T10:14:11.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.715+0000 7fe157c24740 1 --2- 172.21.15.50:0/479673641 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x564ad9763020 0x564ad9765470 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.715+0000 7fe157c24740 1 --2- 172.21.15.50:0/479673641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad9750a20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.715+0000 7fe157c24740 1 --2- 172.21.15.50:0/479673641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad97504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.715+0000 7fe12fe00640 0 client.26011 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:14:11.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.715+0000 7fe157c24740 1 --2- 172.21.15.50:0/479673641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 0x564ad974ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.715+0000 7fe157c24740 1 -- 172.21.15.50:0/479673641 >> 172.21.15.50:0/479673641 conn(0x564ad97443d0 msgr2=0x564ad974a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:11.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.716+0000 7fe157c24740 1 -- 172.21.15.50:0/479673641 shutdown_connections 2024-09-10T10:14:11.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.716+0000 7fe157c24740 1 -- 172.21.15.50:0/479673641 wait complete. 2024-09-10T10:14:11.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.716+0000 7fe157c24740 20 client.26011 trim_cache size 0 max 16384 2024-09-10T10:14:11.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.738+0000 7fe157c24740 1 Processor -- start 2024-09-10T10:14:11.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.738+0000 7fe157c24740 1 -- start start 2024-09-10T10:14:11.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.738+0000 7fe157c24740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 0x564ad974a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.739+0000 7fe157c24740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad9751800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.739+0000 7fe157c24740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad976ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.739+0000 7fe157c24740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe1501af250 con 0x564ad9748760 2024-09-10T10:14:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.739+0000 7fe157c24740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1501acb20 con 0x564ad9747e40 2024-09-10T10:14:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.739+0000 7fe157c24740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe150076b00 con 0x564ad9753020 2024-09-10T10:14:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.739+0000 7fe14d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad9751800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.739+0000 7fe14d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad9751800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40356/0 (socket says 172.21.15.50:40356) 2024-09-10T10:14:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.739+0000 7fe14d400640 1 -- 172.21.15.50:0/1122356064 learned_addr learned my addr 172.21.15.50:0/1122356064 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.739+0000 7fe14e800640 1 --2- 172.21.15.50:0/1122356064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad976ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.740+0000 7fe14de00640 1 --2- 172.21.15.50:0/1122356064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 0x564ad974a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.740+0000 7fe14e800640 1 -- 172.21.15.50:0/1122356064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 msgr2=0x564ad974a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.740+0000 7fe14e800640 1 --2- 172.21.15.50:0/1122356064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 0x564ad974a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.740+0000 7fe14e800640 1 -- 172.21.15.50:0/1122356064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 msgr2=0x564ad9751800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.740+0000 7fe14e800640 1 --2- 172.21.15.50:0/1122356064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad9751800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.740+0000 7fe14e800640 1 -- 172.21.15.50:0/1122356064 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad97526b0 con 0x564ad9753020 2024-09-10T10:14:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.740+0000 7fe14d400640 1 --2- 172.21.15.50:0/1122356064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad9751800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:14:11.742 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.740+0000 7fe14e800640 1 --2- 172.21.15.50:0/1122356064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad976ad40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe148000f80 tx=0x7fe148024000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1758f75b464bac8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.741+0000 7fe13aa00640 1 -- 172.21.15.50:0/1122356064 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148009e60 con 0x564ad9753020 2024-09-10T10:14:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.741+0000 7fe13aa00640 1 -- 172.21.15.50:0/1122356064 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe13c09bcf0 con 0x564ad9753020 2024-09-10T10:14:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.741+0000 7fe13aa00640 1 -- 172.21.15.50:0/1122356064 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148005020 con 0x564ad9753020 2024-09-10T10:14:11.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.742+0000 7fe157c24740 1 -- 172.21.15.50:0/1122356064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 msgr2=0x564ad976ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.742+0000 7fe157c24740 1 --2- 172.21.15.50:0/1122356064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad976ad40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe148000f80 tx=0x7fe148024000 comp rx=0 tx=0).stop 2024-09-10T10:14:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.742+0000 7fe157c24740 1 -- 172.21.15.50:0/1122356064 shutdown_connections 2024-09-10T10:14:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.742+0000 7fe157c24740 1 --2- 172.21.15.50:0/1122356064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad976ad40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.742+0000 7fe157c24740 1 --2- 172.21.15.50:0/1122356064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad9751800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.742+0000 7fe157c24740 1 --2- 172.21.15.50:0/1122356064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 0x564ad974a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.742+0000 7fe157c24740 1 -- 172.21.15.50:0/1122356064 >> 172.21.15.50:0/1122356064 conn(0x564ad97443d0 msgr2=0x564ad974ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.742+0000 7fe157c24740 1 -- 172.21.15.50:0/1122356064 shutdown_connections 2024-09-10T10:14:11.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.742+0000 7fe157c24740 1 -- 172.21.15.50:0/1122356064 wait complete. 2024-09-10T10:14:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.743+0000 7fe157c24740 1 -- start start 2024-09-10T10:14:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.743+0000 7fe157c24740 1 Processor -- start 2024-09-10T10:14:11.745 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.743+0000 7fe157c24740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 0x564ad975b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.743+0000 7fe157c24740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad97568f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.743+0000 7fe157c24740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad9756e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.743+0000 7fe157c24740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe15010ce60 con 0x564ad9748760 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.743+0000 7fe157c24740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1501ac450 con 0x564ad9747e40 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.743+0000 7fe157c24740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe1501ab6b0 con 0x564ad9753020 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.743+0000 7fe157c24740 10 client.0 _ll_register_callbacks cb 0x7fe148009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.744+0000 7fe14e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad9756e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.744+0000 7fe14e800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad9756e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:51072/0 (socket says 172.21.15.50:51072) 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.744+0000 7fe14e800640 1 -- 172.21.15.50:0/1766600374 learned_addr learned my addr 172.21.15.50:0/1766600374 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.744+0000 7fe14de00640 1 --2- 172.21.15.50:0/1766600374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 0x564ad975b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.744+0000 7fe14e800640 1 -- 172.21.15.50:0/1766600374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 msgr2=0x564ad975b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.744+0000 7fe14e800640 1 --2- 172.21.15.50:0/1766600374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 0x564ad975b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.744+0000 7fe14e800640 1 -- 172.21.15.50:0/1766600374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 msgr2=0x564ad97568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:11.746 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.744+0000 7fe14e800640 1 --2- 172.21.15.50:0/1766600374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad97568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.744+0000 7fe14e800640 1 -- 172.21.15.50:0/1766600374 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad9757520 con 0x564ad9753020 2024-09-10T10:14:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.744+0000 7fe14e800640 1 --2- 172.21.15.50:0/1766600374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad9756e30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe1480216b0 tx=0x7fe148037920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=216a4e0e8eaca144 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.744+0000 7fe12fe00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:14:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.745+0000 7fe12fe00640 1 -- 172.21.15.50:0/1766600374 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14801fc20 con 0x564ad9753020 2024-09-10T10:14:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.745+0000 7fe12fe00640 1 -- 172.21.15.50:0/1766600374 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe148004a20 con 0x564ad9753020 2024-09-10T10:14:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.745+0000 7fe157c24740 1 -- 172.21.15.50:0/1766600374 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe13c09bcf0 con 0x564ad9753020 2024-09-10T10:14:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.745+0000 7fe12fe00640 1 -- 172.21.15.50:0/1766600374 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe148004c20 con 0x564ad9753020 2024-09-10T10:14:11.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.745+0000 7fe157c24740 10 client.26017 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.746+0000 7fe157c24740 1 -- 172.21.15.50:0/1766600374 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ad97cdbb0 con 0x564ad9753020 2024-09-10T10:14:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.746+0000 7fe12fe00640 1 -- 172.21.15.50:0/1766600374 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe13c09bcf0 con 0x564ad9753020 2024-09-10T10:14:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.746+0000 7fe12fe00640 1 -- 172.21.15.50:0/1766600374 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe148040070 con 0x564ad9753020 2024-09-10T10:14:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.746+0000 7fe157c24740 10 client.26017 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.746+0000 7fe157c24740 10 client.26017 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:14:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.746+0000 7fe157c24740 20 client.26017 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.746+0000 7fe157c24740 1 --2- 172.21.15.50:0/1766600374 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x564ad97ce210 0x564ad97d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.746+0000 7fe157c24740 4 client.26017 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:14:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.746+0000 7fe157c24740 1 -- 172.21.15.50:0/1766600374 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564ad96b5e60 con 0x564ad97ce210 2024-09-10T10:14:11.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.747+0000 7fe14de00640 1 --2- 172.21.15.50:0/1766600374 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x564ad97ce210 0x564ad97d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.748+0000 7fe12fe00640 10 client.26017 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:14:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.749+0000 7fe14de00640 1 --2- 172.21.15.50:0/1766600374 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x564ad97ce210 0x564ad97d0600 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d1f673004e19e781 server_cookie=6ddd93a5a49c1747 in_seq=0 out_seq=0 2024-09-10T10:14:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.749+0000 7fe12fe00640 1 -- 172.21.15.50:0/1766600374 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ad96b5e60 con 0x564ad97ce210 2024-09-10T10:14:11.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.749+0000 7fe12fe00640 10 client.26017 handle_command_reply: tid=0 2024-09-10T10:14:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.749+0000 7fe157c24740 1 client.26017 shutdown 2024-09-10T10:14:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.750+0000 7fe157c24740 1 -- 172.21.15.50:0/1766600374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 msgr2=0x564ad9756e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.750+0000 7fe157c24740 1 --2- 172.21.15.50:0/1766600374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad9756e30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe1480216b0 tx=0x7fe148037920 comp rx=0 tx=0).stop 2024-09-10T10:14:11.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.750+0000 7fe157c24740 1 -- 172.21.15.50:0/1766600374 shutdown_connections 2024-09-10T10:14:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.750+0000 7fe157c24740 1 --2- 172.21.15.50:0/1766600374 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x564ad97ce210 0x564ad97d0600 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.750+0000 7fe12fe00640 0 client.26017 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:14:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.750+0000 7fe157c24740 1 --2- 172.21.15.50:0/1766600374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ad9753020 0x564ad9756e30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.750+0000 7fe157c24740 1 --2- 172.21.15.50:0/1766600374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad9748760 0x564ad97568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.750+0000 7fe157c24740 1 --2- 172.21.15.50:0/1766600374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ad9747e40 0x564ad975b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.750+0000 7fe157c24740 1 -- 172.21.15.50:0/1766600374 >> 172.21.15.50:0/1766600374 conn(0x564ad97443d0 msgr2=0x564ad974e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.751+0000 7fe157c24740 1 -- 172.21.15.50:0/1766600374 shutdown_connections 2024-09-10T10:14:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.751+0000 7fe157c24740 1 -- 172.21.15.50:0/1766600374 wait complete. 2024-09-10T10:14:11.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.751+0000 7fe157c24740 20 client.26017 trim_cache size 0 max 16384 2024-09-10T10:14:11.753 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:14:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.752+0000 7fe14f200640 1 -- 172.21.15.50:0/495101491 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1340a2cd0 msgr2=0x7fe1340a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.752+0000 7fe14f200640 1 --2- 172.21.15.50:0/495101491 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1340a2cd0 0x7fe1340a5190 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe140009850 tx=0x7fe140005fd0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.752+0000 7fe14f200640 1 -- 172.21.15.50:0/495101491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe150077040 msgr2=0x7fe1501a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.752+0000 7fe14f200640 1 --2- 172.21.15.50:0/495101491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe150077040 0x7fe1501a4ba0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00e9f0 tx=0x7fe13c00edf0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.752+0000 7fe14f200640 1 -- 172.21.15.50:0/495101491 shutdown_connections 2024-09-10T10:14:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.752+0000 7fe14f200640 1 --2- 172.21.15.50:0/495101491 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe1340a2cd0 0x7fe1340a5190 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.752+0000 7fe14f200640 1 --2- 172.21.15.50:0/495101491 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe150112870 0x7fe15019e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.752+0000 7fe14f200640 1 --2- 172.21.15.50:0/495101491 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe150077040 0x7fe1501a4ba0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.753+0000 7fe14f200640 1 --2- 172.21.15.50:0/495101491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe150076720 0x7fe1501a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.753+0000 7fe14f200640 1 -- 172.21.15.50:0/495101491 >> 172.21.15.50:0/495101491 conn(0x7fe1500ff8d0 msgr2=0x7fe150101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.753+0000 7fe14f200640 1 -- 172.21.15.50:0/495101491 shutdown_connections 2024-09-10T10:14:11.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:11.753+0000 7fe14f200640 1 -- 172.21.15.50:0/495101491 wait complete. 2024-09-10T10:14:12.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:11 smithi050 ceph-mon[30354]: pgmap v481: 129 pgs: 129 active+clean; 341 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 28 MiB/s wr, 36 op/s 2024-09-10T10:14:12.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:11 smithi189 ceph-mon[34999]: pgmap v481: 129 pgs: 129 active+clean; 341 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 28 MiB/s wr, 36 op/s 2024-09-10T10:14:12.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:11 smithi084 ceph-mon[34812]: pgmap v481: 129 pgs: 129 active+clean; 341 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 28 MiB/s wr, 36 op/s 2024-09-10T10:14:13.331 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T10:14:13.945 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:14:14.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:13 smithi189 ceph-mon[34999]: pgmap v482: 129 pgs: 129 active+clean; 741 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 62 MiB/s wr, 48 op/s 2024-09-10T10:14:14.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:13 smithi084 ceph-mon[34812]: pgmap v482: 129 pgs: 129 active+clean; 741 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 62 MiB/s wr, 48 op/s 2024-09-10T10:14:14.375 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:13 smithi050 ceph-mon[30354]: pgmap v482: 129 pgs: 129 active+clean; 741 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 62 MiB/s wr, 48 op/s 2024-09-10T10:14:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.089+0000 7f1f39e00640 1 -- 172.21.15.50:0/3089435795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f340ffe80 msgr2=0x7f1f34100260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.090+0000 7f1f39e00640 1 --2- 172.21.15.50:0/3089435795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f340ffe80 0x7f1f34100260 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009930 tx=0x7f1f2402a4d0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.090+0000 7f1f39e00640 1 -- 172.21.15.50:0/3089435795 shutdown_connections 2024-09-10T10:14:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.090+0000 7f1f39e00640 1 --2- 172.21.15.50:0/3089435795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f3410a350 0x7f1f34110d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.090+0000 7f1f39e00640 1 --2- 172.21.15.50:0/3089435795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f341007a0 0x7f1f34109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.090+0000 7f1f39e00640 1 --2- 172.21.15.50:0/3089435795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f340ffe80 0x7f1f34100260 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.090+0000 7f1f39e00640 1 -- 172.21.15.50:0/3089435795 >> 172.21.15.50:0/3089435795 conn(0x7f1f340fba90 msgr2=0x7f1f340fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:15.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.094+0000 7f1f39e00640 1 -- 172.21.15.50:0/3089435795 shutdown_connections 2024-09-10T10:14:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.094+0000 7f1f39e00640 1 -- 172.21.15.50:0/3089435795 wait complete. 2024-09-10T10:14:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.098+0000 7f1f39e00640 1 Processor -- start 2024-09-10T10:14:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.098+0000 7f1f39e00640 1 -- start start 2024-09-10T10:14:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.099+0000 7f1f39e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f340ffe80 0x7f1f34110be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.099+0000 7f1f39e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f341007a0 0x7f1f3410dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.100+0000 7f1f39e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f3410a350 0x7f1f3410e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.100+0000 7f1f32a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f340ffe80 0x7f1f34110be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.100+0000 7f1f32a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f340ffe80 0x7f1f34110be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40374/0 (socket says 172.21.15.50:40374) 2024-09-10T10:14:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.101+0000 7f1f33400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f3410a350 0x7f1f3410e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.101+0000 7f1f33400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f3410a350 0x7f1f3410e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:51084/0 (socket says 172.21.15.50:51084) 2024-09-10T10:14:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.101+0000 7f1f32000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f341007a0 0x7f1f3410dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.101+0000 7f1f32000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f341007a0 0x7f1f3410dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:55438/0 (socket says 172.21.15.50:55438) 2024-09-10T10:14:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.101+0000 7f1f39e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f34114210 con 0x7f1f340ffe80 2024-09-10T10:14:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.101+0000 7f1f39e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f34114090 con 0x7f1f341007a0 2024-09-10T10:14:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.101+0000 7f1f39e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f34114390 con 0x7f1f3410a350 2024-09-10T10:14:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.101+0000 7f1f32a00640 1 -- 172.21.15.50:0/3706106669 learned_addr learned my addr 172.21.15.50:0/3706106669 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.102+0000 7f1f33400640 1 -- 172.21.15.50:0/3706106669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f341007a0 msgr2=0x7f1f3410dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.102+0000 7f1f33400640 1 --2- 172.21.15.50:0/3706106669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f341007a0 0x7f1f3410dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.102+0000 7f1f33400640 1 -- 172.21.15.50:0/3706106669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f340ffe80 msgr2=0x7f1f34110be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.103+0000 7f1f33400640 1 --2- 172.21.15.50:0/3706106669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f340ffe80 0x7f1f34110be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.103+0000 7f1f33400640 1 -- 172.21.15.50:0/3706106669 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3410eab0 con 0x7f1f3410a350 2024-09-10T10:14:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.103+0000 7f1f32a00640 1 --2- 172.21.15.50:0/3706106669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f340ffe80 0x7f1f34110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:14:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.104+0000 7f1f33400640 1 --2- 172.21.15.50:0/3706106669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f3410a350 0x7f1f3410e1f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00e940 tx=0x7f1f2c00ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.104+0000 7f1f38a00640 1 -- 172.21.15.50:0/3706106669 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c004d20 con 0x7f1f3410a350 2024-09-10T10:14:15.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.104+0000 7f1f38a00640 1 -- 172.21.15.50:0/3706106669 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f2c005020 con 0x7f1f3410a350 2024-09-10T10:14:15.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.104+0000 7f1f38a00640 1 -- 172.21.15.50:0/3706106669 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0116b0 con 0x7f1f3410a350 2024-09-10T10:14:15.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.104+0000 7f1f39e00640 1 -- 172.21.15.50:0/3706106669 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f341ab070 con 0x7f1f3410a350 2024-09-10T10:14:15.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.105+0000 7f1f39e00640 1 -- 172.21.15.50:0/3706106669 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f341ab5e0 con 0x7f1f3410a350 2024-09-10T10:14:15.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.112+0000 7f1f38a00640 1 -- 172.21.15.50:0/3706106669 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1f2c0054d0 con 0x7f1f3410a350 2024-09-10T10:14:15.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.116+0000 7f1f38a00640 1 --2- 172.21.15.50:0/3706106669 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1f180a2c40 0x7f1f180a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.116+0000 7f1f38a00640 1 -- 172.21.15.50:0/3706106669 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f1f2c0cf410 con 0x7f1f3410a350 2024-09-10T10:14:15.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.117+0000 7f1f3c9c5740 1 Processor -- start 2024-09-10T10:14:15.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.117+0000 7f1f3c9c5740 1 -- start start 2024-09-10T10:14:15.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.118+0000 7f1f3c9c5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b3e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.118+0000 7f1f3c9c5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b48910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.118+0000 7f1f3c9c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b48e50 0x555904b4b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.118+0000 7f1f3c9c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555904aa43e0 con 0x555904b48e50 2024-09-10T10:14:15.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.118+0000 7f1f3c9c5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555904a4bd80 con 0x555904b3dc70 2024-09-10T10:14:15.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.118+0000 7f1f3c9c5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555904aa03a0 con 0x555904b3e590 2024-09-10T10:14:15.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.119+0000 7f1f32a00640 1 --2- 172.21.15.50:0/3706106669 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1f180a2c40 0x7f1f180a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.120+0000 7f1f32000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b48910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.120+0000 7f1f32a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b3e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.120+0000 7f1f32a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b3e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:55446/0 (socket says 172.21.15.50:55446) 2024-09-10T10:14:15.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.120+0000 7f1f32a00640 1 -- 172.21.15.50:0/705246157 learned_addr learned my addr 172.21.15.50:0/705246157 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:15.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.121+0000 7f1f33400640 1 --2- 172.21.15.50:0/705246157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b48e50 0x555904b4b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.121+0000 7f1f33400640 1 -- 172.21.15.50:0/705246157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 msgr2=0x555904b48910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:15.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.121+0000 7f1f33400640 1 --2- 172.21.15.50:0/705246157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b48910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.121+0000 7f1f33400640 1 -- 172.21.15.50:0/705246157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 msgr2=0x555904b3e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:15.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.121+0000 7f1f33400640 1 --2- 172.21.15.50:0/705246157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b3e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.121+0000 7f1f33400640 1 -- 172.21.15.50:0/705246157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555904a6aae0 con 0x555904b48e50 2024-09-10T10:14:15.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.123+0000 7f1f32a00640 1 --2- 172.21.15.50:0/3706106669 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1f180a2c40 0x7f1f180a5100 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1f24005d80 tx=0x7f1f240040d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.123+0000 7f1f33400640 1 --2- 172.21.15.50:0/705246157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b48e50 0x555904b4b240 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c000f80 tx=0x7f1f2c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229980640d12efb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.124+0000 7f1f1fe00640 1 -- 172.21.15.50:0/705246157 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0b4070 con 0x555904b48e50 2024-09-10T10:14:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.124+0000 7f1f1fe00640 1 -- 172.21.15.50:0/705246157 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f2c0a44f0 con 0x555904b48e50 2024-09-10T10:14:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.124+0000 7f1f1fe00640 1 -- 172.21.15.50:0/705246157 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c01f040 con 0x555904b48e50 2024-09-10T10:14:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.125+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/705246157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b48e50 msgr2=0x555904b4b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.125+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/705246157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b48e50 0x555904b4b240 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c000f80 tx=0x7f1f2c00ef90 comp rx=0 tx=0).stop 2024-09-10T10:14:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.126+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/705246157 shutdown_connections 2024-09-10T10:14:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.126+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/705246157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b48e50 0x555904b4b240 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.126+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/705246157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b48910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.126+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/705246157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b3e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.126+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/705246157 >> 172.21.15.50:0/705246157 conn(0x555904b3a200 msgr2=0x555904b3a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.126+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/705246157 shutdown_connections 2024-09-10T10:14:15.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.126+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/705246157 wait complete. 2024-09-10T10:14:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.127+0000 7f1f3c9c5740 1 -- start start 2024-09-10T10:14:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.127+0000 7f1f3c9c5740 1 Processor -- start 2024-09-10T10:14:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.128+0000 7f1f3c9c5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b45d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.128+0000 7f1f3c9c5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b46250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.128+0000 7f1f3c9c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b48e50 0x555904b46790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.128+0000 7f1f3c9c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555904b4ba20 con 0x555904b48e50 2024-09-10T10:14:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.128+0000 7f1f3c9c5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555904a5f0f0 con 0x555904b3dc70 2024-09-10T10:14:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.128+0000 7f1f3c9c5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555904b4bba0 con 0x555904b3e590 2024-09-10T10:14:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.129+0000 7f1f3c9c5740 10 client.0 _ll_register_callbacks cb 0x555904a46bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.129+0000 7f1f32000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b46250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.129+0000 7f1f32000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b46250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:51100/0 (socket says 172.21.15.50:51100) 2024-09-10T10:14:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.129+0000 7f1f32000640 1 -- 172.21.15.50:0/232614311 learned_addr learned my addr 172.21.15.50:0/232614311 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:15.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.129+0000 7f1f32a00640 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b45d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.130+0000 7f1f32000640 1 -- 172.21.15.50:0/232614311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 msgr2=0x555904b45d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.130+0000 7f1f32000640 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b45d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.130+0000 7f1f33400640 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b48e50 0x555904b46790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.130+0000 7f1f32000640 1 -- 172.21.15.50:0/232614311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b48e50 msgr2=0x555904b46790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.130+0000 7f1f32000640 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b48e50 0x555904b46790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.130+0000 7f1f32000640 1 -- 172.21.15.50:0/232614311 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559048153c0 con 0x555904b3e590 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.130+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/232614311 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f2c0a44f0 con 0x555904b3e590 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.130+0000 7f1f33400640 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b48e50 0x555904b46790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.131+0000 7f1f32000640 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b46250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009ed0 tx=0x7f1f20011630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dac7c90af9a42f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.131+0000 7f1f1cc00640 10 client.26029 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.133+0000 7f1f1cc00640 1 -- 172.21.15.50:0/232614311 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20023050 con 0x555904b3e590 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.133+0000 7f1f1cc00640 1 -- 172.21.15.50:0/232614311 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f1f20015870 con 0x555904b3e590 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.134+0000 7f1f1cc00640 1 -- 172.21.15.50:0/232614311 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1f20019070 con 0x555904b3e590 2024-09-10T10:14:15.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.134+0000 7f1f3c9c5740 10 client.26029 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.134+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/232614311 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=25}) -- 0x555904b57a00 con 0x555904b3e590 2024-09-10T10:14:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.135+0000 7f1f1cc00640 1 -- 172.21.15.50:0/232614311 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f1f20015ad0 con 0x555904b3e590 2024-09-10T10:14:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.135+0000 7f1f3c9c5740 10 client.26029 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.135+0000 7f1f3c9c5740 10 client.26029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:14:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.136+0000 7f1f3c9c5740 20 client.26029 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.136+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555904b58db0 0x555904b5b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.136+0000 7f1f3c9c5740 4 client.26029 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:14:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.136+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/232614311 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555904ab1950 con 0x555904b58db0 2024-09-10T10:14:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.137+0000 7f1f32a00640 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555904b58db0 0x555904b5b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.137+0000 7f1f32a00640 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555904b58db0 0x555904b5b1a0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccc1c4dc57c31fc2 server_cookie=4ca295a1d9927c09 in_seq=0 out_seq=0 2024-09-10T10:14:15.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.137+0000 7f1f1cc00640 10 client.26029 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:15.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.138+0000 7f1f1cc00640 1 -- 172.21.15.50:0/232614311 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555904ab1950 con 0x555904b58db0 2024-09-10T10:14:15.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.138+0000 7f1f1cc00640 10 client.26029 handle_command_reply: tid=0 2024-09-10T10:14:15.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.139+0000 7f1f3c9c5740 1 client.26029 shutdown 2024-09-10T10:14:15.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.139+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/232614311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 msgr2=0x555904b46250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:15.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.139+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b46250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009ed0 tx=0x7f1f20011630 comp rx=0 tx=0).stop 2024-09-10T10:14:15.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.140+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/232614311 shutdown_connections 2024-09-10T10:14:15.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.140+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555904b58db0 0x555904b5b1a0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.140+0000 7f1f1cc00640 0 client.26029 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:15.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.140+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b48e50 0x555904b46790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.140+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b46250 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.140+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/232614311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b45d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.140+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/232614311 >> 172.21.15.50:0/232614311 conn(0x555904b3a200 msgr2=0x555904b39380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:15.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.140+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/232614311 shutdown_connections 2024-09-10T10:14:15.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.141+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/232614311 wait complete. 2024-09-10T10:14:15.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.142+0000 7f1f3c9c5740 20 client.26029 trim_cache size 0 max 16384 2024-09-10T10:14:15.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.160+0000 7f1f3c9c5740 1 Processor -- start 2024-09-10T10:14:15.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.160+0000 7f1f3c9c5740 1 -- start start 2024-09-10T10:14:15.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.160+0000 7f1f3c9c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b3dc70 0x555904b47c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.160+0000 7f1f3c9c5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b60a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.160+0000 7f1f3c9c5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b48e50 0x555904b60fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.160+0000 7f1f3c9c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341b7d70 con 0x555904b3dc70 2024-09-10T10:14:15.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.160+0000 7f1f3c9c5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341b5640 con 0x555904b48e50 2024-09-10T10:14:15.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.160+0000 7f1f3c9c5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341b3490 con 0x555904b3e590 2024-09-10T10:14:15.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.160+0000 7f1f32a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b3dc70 0x555904b47c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.161+0000 7f1f33400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b48e50 0x555904b60fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.161+0000 7f1f32000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b60a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.161+0000 7f1f32a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b3dc70 0x555904b47c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40390/0 (socket says 172.21.15.50:40390) 2024-09-10T10:14:15.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.161+0000 7f1f32a00640 1 -- 172.21.15.50:0/408384782 learned_addr learned my addr 172.21.15.50:0/408384782 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:15.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.161+0000 7f1f33400640 1 -- 172.21.15.50:0/408384782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 msgr2=0x555904b60a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:15.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.161+0000 7f1f33400640 1 --2- 172.21.15.50:0/408384782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b60a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.161+0000 7f1f33400640 1 -- 172.21.15.50:0/408384782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b3dc70 msgr2=0x555904b47c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:15.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.161+0000 7f1f33400640 1 --2- 172.21.15.50:0/408384782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b3dc70 0x555904b47c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.161+0000 7f1f33400640 1 -- 172.21.15.50:0/408384782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555904b35770 con 0x555904b48e50 2024-09-10T10:14:15.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.161+0000 7f1f33400640 1 --2- 172.21.15.50:0/408384782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b48e50 0x555904b60fb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c005c40 tx=0x7f1f2c09b290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1533bf531bdd1e64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:15.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.162+0000 7f1f1f400640 1 -- 172.21.15.50:0/408384782 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c01f070 con 0x555904b48e50 2024-09-10T10:14:15.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.162+0000 7f1f1f400640 1 -- 172.21.15.50:0/408384782 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f2c0cf150 con 0x555904b48e50 2024-09-10T10:14:15.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.162+0000 7f1f1f400640 1 -- 172.21.15.50:0/408384782 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0b4050 con 0x555904b48e50 2024-09-10T10:14:15.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.163+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/408384782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b48e50 msgr2=0x555904b60fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:15.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.163+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/408384782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b48e50 0x555904b60fb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c005c40 tx=0x7f1f2c09b290 comp rx=0 tx=0).stop 2024-09-10T10:14:15.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.163+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/408384782 shutdown_connections 2024-09-10T10:14:15.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.163+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/408384782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b48e50 0x555904b60fb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.163+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/408384782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b3e590 0x555904b60a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.163+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/408384782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b3dc70 0x555904b47c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.163+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/408384782 >> 172.21.15.50:0/408384782 conn(0x555904b3a200 msgr2=0x555904b47570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:15.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.163+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/408384782 shutdown_connections 2024-09-10T10:14:15.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.163+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/408384782 wait complete. 2024-09-10T10:14:15.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.164+0000 7f1f3c9c5740 1 -- start start 2024-09-10T10:14:15.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.164+0000 7f1f3c9c5740 1 Processor -- start 2024-09-10T10:14:15.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.164+0000 7f1f3c9c5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b51540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.164+0000 7f1f3c9c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b3e590 0x555904b42ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.164+0000 7f1f3c9c5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b48e50 0x555904b43010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.164+0000 7f1f3c9c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341b3b00 con 0x555904b3e590 2024-09-10T10:14:15.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.164+0000 7f1f3c9c5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341b4f70 con 0x555904b3dc70 2024-09-10T10:14:15.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.164+0000 7f1f3c9c5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341b41d0 con 0x555904b48e50 2024-09-10T10:14:15.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.164+0000 7f1f3c9c5740 10 client.0 _ll_register_callbacks cb 0x7f1f20009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:15.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.165+0000 7f1f32a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b51540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.165+0000 7f1f32a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b51540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:55474/0 (socket says 172.21.15.50:55474) 2024-09-10T10:14:15.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.165+0000 7f1f32a00640 1 -- 172.21.15.50:0/2818370083 learned_addr learned my addr 172.21.15.50:0/2818370083 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:15.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.165+0000 7f1f33400640 1 --2- 172.21.15.50:0/2818370083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b48e50 0x555904b43010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.165+0000 7f1f32000640 1 --2- 172.21.15.50:0/2818370083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b3e590 0x555904b42ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.165+0000 7f1f33400640 1 -- 172.21.15.50:0/2818370083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 msgr2=0x555904b51540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:15.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.165+0000 7f1f33400640 1 --2- 172.21.15.50:0/2818370083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b51540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.165+0000 7f1f33400640 1 -- 172.21.15.50:0/2818370083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b3e590 msgr2=0x555904b42ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:15.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.165+0000 7f1f33400640 1 --2- 172.21.15.50:0/2818370083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b3e590 0x555904b42ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.165+0000 7f1f33400640 1 -- 172.21.15.50:0/2818370083 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555904b43840 con 0x555904b48e50 2024-09-10T10:14:15.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.165+0000 7f1f33400640 1 --2- 172.21.15.50:0/2818370083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b48e50 0x555904b43010 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0a3fc0 tx=0x7f1f2c099a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83f408bc05050d3d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:15.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.165+0000 7f1f1cc00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:14:15.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.166+0000 7f1f1cc00640 1 -- 172.21.15.50:0/2818370083 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0b8070 con 0x555904b48e50 2024-09-10T10:14:15.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.166+0000 7f1f1cc00640 1 -- 172.21.15.50:0/2818370083 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f1f2c09acd0 con 0x555904b48e50 2024-09-10T10:14:15.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.166+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/2818370083 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f2c0cf150 con 0x555904b48e50 2024-09-10T10:14:15.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.166+0000 7f1f1cc00640 1 -- 172.21.15.50:0/2818370083 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1f2c01f040 con 0x555904b48e50 2024-09-10T10:14:15.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.166+0000 7f1f3c9c5740 10 client.26035 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:15.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.166+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/2818370083 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555904bc3aa0 con 0x555904b48e50 2024-09-10T10:14:15.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.166+0000 7f1f1cc00640 1 -- 172.21.15.50:0/2818370083 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f2c0cf150 con 0x555904b48e50 2024-09-10T10:14:15.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.166+0000 7f1f1cc00640 1 -- 172.21.15.50:0/2818370083 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f1f2c00f040 con 0x555904b48e50 2024-09-10T10:14:15.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.167+0000 7f1f3c9c5740 10 client.26035 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:15.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.167+0000 7f1f3c9c5740 10 client.26035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:14:15.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.167+0000 7f1f3c9c5740 20 client.26035 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:15.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.167+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/2818370083 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555904bc3cd0 0x555904bc60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:15.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.167+0000 7f1f3c9c5740 4 client.26035 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:14:15.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.167+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/2818370083 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555904aabe60 con 0x555904bc3cd0 2024-09-10T10:14:15.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.167+0000 7f1f32a00640 1 --2- 172.21.15.50:0/2818370083 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555904bc3cd0 0x555904bc60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:15.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f32a00640 1 --2- 172.21.15.50:0/2818370083 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555904bc3cd0 0x555904bc60c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97ffa13e3f69ff06 server_cookie=a47ef0288198db21 in_seq=0 out_seq=0 2024-09-10T10:14:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f1cc00640 10 client.26035 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f1cc00640 1 -- 172.21.15.50:0/2818370083 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555904aabe60 con 0x555904bc3cd0 2024-09-10T10:14:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f1cc00640 10 client.26035 handle_command_reply: tid=0 2024-09-10T10:14:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f3c9c5740 1 client.26035 shutdown 2024-09-10T10:14:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/2818370083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b48e50 msgr2=0x555904b43010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/2818370083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b48e50 0x555904b43010 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0a3fc0 tx=0x7f1f2c099a60 comp rx=0 tx=0).stop 2024-09-10T10:14:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/2818370083 shutdown_connections 2024-09-10T10:14:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/2818370083 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555904bc3cd0 0x555904bc60c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f1cc00640 0 client.26035 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/2818370083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555904b48e50 0x555904b43010 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/2818370083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555904b3e590 0x555904b42ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f3c9c5740 1 --2- 172.21.15.50:0/2818370083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555904b3dc70 0x555904b51540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.168+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/2818370083 >> 172.21.15.50:0/2818370083 conn(0x555904b3a200 msgr2=0x555904b39380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:15.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.169+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/2818370083 shutdown_connections 2024-09-10T10:14:15.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.169+0000 7f1f3c9c5740 1 -- 172.21.15.50:0/2818370083 wait complete. 2024-09-10T10:14:15.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.169+0000 7f1f3c9c5740 20 client.26035 trim_cache size 0 max 16384 2024-09-10T10:14:15.173 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:14:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.170+0000 7f1f39e00640 1 -- 172.21.15.50:0/3706106669 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1f180a2c40 msgr2=0x7f1f180a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.170+0000 7f1f39e00640 1 --2- 172.21.15.50:0/3706106669 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1f180a2c40 0x7f1f180a5100 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1f24005d80 tx=0x7f1f240040d0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.170+0000 7f1f39e00640 1 -- 172.21.15.50:0/3706106669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f3410a350 msgr2=0x7f1f3410e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.170+0000 7f1f39e00640 1 --2- 172.21.15.50:0/3706106669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f3410a350 0x7f1f3410e1f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00e940 tx=0x7f1f2c00ed40 comp rx=0 tx=0).stop 2024-09-10T10:14:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.170+0000 7f1f39e00640 1 -- 172.21.15.50:0/3706106669 shutdown_connections 2024-09-10T10:14:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.170+0000 7f1f39e00640 1 --2- 172.21.15.50:0/3706106669 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1f180a2c40 0x7f1f180a5100 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.170+0000 7f1f39e00640 1 --2- 172.21.15.50:0/3706106669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f3410a350 0x7f1f3410e1f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.170+0000 7f1f39e00640 1 --2- 172.21.15.50:0/3706106669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f341007a0 0x7f1f3410dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.170+0000 7f1f39e00640 1 --2- 172.21.15.50:0/3706106669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f340ffe80 0x7f1f34110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.170+0000 7f1f39e00640 1 -- 172.21.15.50:0/3706106669 >> 172.21.15.50:0/3706106669 conn(0x7f1f340fba90 msgr2=0x7f1f34108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.170+0000 7f1f39e00640 1 -- 172.21.15.50:0/3706106669 shutdown_connections 2024-09-10T10:14:15.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:15.170+0000 7f1f39e00640 1 -- 172.21.15.50:0/3706106669 wait complete. 2024-09-10T10:14:16.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:15 smithi050 ceph-mon[30354]: pgmap v483: 129 pgs: 129 active+clean; 1.2 GiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 104 MiB/s wr, 56 op/s 2024-09-10T10:14:16.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:15 smithi189 ceph-mon[34999]: pgmap v483: 129 pgs: 129 active+clean; 1.2 GiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 104 MiB/s wr, 56 op/s 2024-09-10T10:14:16.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:15 smithi084 ceph-mon[34812]: pgmap v483: 129 pgs: 129 active+clean; 1.2 GiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 104 MiB/s wr, 56 op/s 2024-09-10T10:14:17.382 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T10:14:17.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T10:14:18.171 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:14:18.331 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:17 smithi050 ceph-mon[30354]: pgmap v484: 129 pgs: 129 active+clean; 1.7 GiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 144 MiB/s wr, 69 op/s 2024-09-10T10:14:18.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:17 smithi189 ceph-mon[34999]: pgmap v484: 129 pgs: 129 active+clean; 1.7 GiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 144 MiB/s wr, 69 op/s 2024-09-10T10:14:18.348 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:17 smithi084 ceph-mon[34812]: pgmap v484: 129 pgs: 129 active+clean; 1.7 GiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 144 MiB/s wr, 69 op/s 2024-09-10T10:14:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.283+0000 7f0813e00640 1 -- 172.21.15.50:0/2852914200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0814102370 msgr2=0x7f081410e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.283+0000 7f0813e00640 1 --2- 172.21.15.50:0/2852914200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0814102370 0x7f081410e8a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f080c009cd0 tx=0x7f080c02a8f0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.283+0000 7f0813e00640 1 -- 172.21.15.50:0/2852914200 shutdown_connections 2024-09-10T10:14:19.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.283+0000 7f0813e00640 1 --2- 172.21.15.50:0/2852914200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0814102370 0x7f081410e8a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.283+0000 7f0813e00640 1 --2- 172.21.15.50:0/2852914200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08141019d0 0x7f0814101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.283+0000 7f0813e00640 1 --2- 172.21.15.50:0/2852914200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08141079d0 0x7f0814107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.283+0000 7f0813e00640 1 -- 172.21.15.50:0/2852914200 >> 172.21.15.50:0/2852914200 conn(0x7f08140fd710 msgr2=0x7f08140ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.283+0000 7f0813e00640 1 -- 172.21.15.50:0/2852914200 shutdown_connections 2024-09-10T10:14:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.283+0000 7f0813e00640 1 -- 172.21.15.50:0/2852914200 wait complete. 2024-09-10T10:14:19.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.285+0000 7f0813e00640 1 Processor -- start 2024-09-10T10:14:19.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.285+0000 7f0813e00640 1 -- start start 2024-09-10T10:14:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.286+0000 7f0813e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08141019d0 0x7f081410da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.286+0000 7f0813e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0814102370 0x7f081410dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.286+0000 7f0813e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08141079d0 0x7f081419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.287+0000 7f0813e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0814111e20 con 0x7f08141019d0 2024-09-10T10:14:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.287+0000 7f0813e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0814111ca0 con 0x7f0814102370 2024-09-10T10:14:19.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.287+0000 7f0813e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0814111fa0 con 0x7f08141079d0 2024-09-10T10:14:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.287+0000 7f0813400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08141079d0 0x7f081419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.287+0000 7f0813400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08141079d0 0x7f081419a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:46522/0 (socket says 172.21.15.50:46522) 2024-09-10T10:14:19.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.287+0000 7f0813400640 1 -- 172.21.15.50:0/2568605858 learned_addr learned my addr 172.21.15.50:0/2568605858 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.288+0000 7f0812000640 1 --2- 172.21.15.50:0/2568605858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0814102370 0x7f081410dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.288+0000 7f0813400640 1 -- 172.21.15.50:0/2568605858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0814102370 msgr2=0x7f081410dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.288+0000 7f0813400640 1 --2- 172.21.15.50:0/2568605858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0814102370 0x7f081410dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.288+0000 7f0813400640 1 -- 172.21.15.50:0/2568605858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08141019d0 msgr2=0x7f081410da70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:14:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.289+0000 7f0813400640 1 --2- 172.21.15.50:0/2568605858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08141019d0 0x7f081410da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.289+0000 7f0813400640 1 -- 172.21.15.50:0/2568605858 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081419afc0 con 0x7f08141079d0 2024-09-10T10:14:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.289+0000 7f0813400640 1 --2- 172.21.15.50:0/2568605858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08141079d0 0x7f081419a8e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f080c0098d0 tx=0x7f080c030b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.289+0000 7f080b400640 1 -- 172.21.15.50:0/2568605858 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c004240 con 0x7f08141079d0 2024-09-10T10:14:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.290+0000 7f080b400640 1 -- 172.21.15.50:0/2568605858 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f080c040070 con 0x7f08141079d0 2024-09-10T10:14:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.290+0000 7f080b400640 1 -- 172.21.15.50:0/2568605858 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c045dd0 con 0x7f08141079d0 2024-09-10T10:14:19.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.290+0000 7f0813e00640 1 -- 172.21.15.50:0/2568605858 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081419b250 con 0x7f08141079d0 2024-09-10T10:14:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.290+0000 7f0813e00640 1 -- 172.21.15.50:0/2568605858 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0814197810 con 0x7f08141079d0 2024-09-10T10:14:19.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.295+0000 7f081c07a740 1 Processor -- start 2024-09-10T10:14:19.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.296+0000 7f081c07a740 1 -- start start 2024-09-10T10:14:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.296+0000 7f080b400640 1 -- 172.21.15.50:0/2568605858 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f080c045500 con 0x7f08141079d0 2024-09-10T10:14:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.296+0000 7f081c07a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a1ecb0 0x562ce4a1f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.296+0000 7f081c07a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1f5d0 0x562ce4a29950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.296+0000 7f081c07a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a29e90 0x562ce4a2c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.296+0000 7f081c07a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562ce4985290 con 0x562ce4a29e90 2024-09-10T10:14:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.297+0000 7f081c07a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562ce492cb40 con 0x562ce4a1ecb0 2024-09-10T10:14:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.297+0000 7f081c07a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562ce4981250 con 0x562ce4a1f5d0 2024-09-10T10:14:19.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.298+0000 7f0812000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a29e90 0x562ce4a2c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.298+0000 7f0812a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1f5d0 0x562ce4a29950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.298+0000 7f0812a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1f5d0 0x562ce4a29950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:46534/0 (socket says 172.21.15.50:46534) 2024-09-10T10:14:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.298+0000 7f0812a00640 1 -- 172.21.15.50:0/1852901922 learned_addr learned my addr 172.21.15.50:0/1852901922 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:19.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.298+0000 7f0812000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a1ecb0 0x562ce4a1f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.298+0000 7f080b400640 1 --2- 172.21.15.50:0/2568605858 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f07f80a2c80 0x7f07f80a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.299+0000 7f080b400640 1 -- 172.21.15.50:0/2568605858 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f080c0f09f0 con 0x7f08141079d0 2024-09-10T10:14:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.299+0000 7f0812000640 1 -- 172.21.15.50:0/1852901922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1f5d0 msgr2=0x562ce4a29950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.299+0000 7f0812000640 1 --2- 172.21.15.50:0/1852901922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1f5d0 0x562ce4a29950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.299+0000 7f0812000640 1 -- 172.21.15.50:0/1852901922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a1ecb0 msgr2=0x562ce4a1f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.299+0000 7f0812000640 1 --2- 172.21.15.50:0/1852901922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a1ecb0 0x562ce4a1f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.299+0000 7f0812000640 1 -- 172.21.15.50:0/1852901922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce46f66a0 con 0x562ce4a29e90 2024-09-10T10:14:19.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.300+0000 7f0813400640 1 --2- 172.21.15.50:0/2568605858 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f07f80a2c80 0x7f07f80a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.301+0000 7f0812000640 1 --2- 172.21.15.50:0/1852901922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a29e90 0x562ce4a2c280 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0800005fd0 tx=0x7f0800005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228072cc33e039a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:19.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.302+0000 7f07ff400640 1 -- 172.21.15.50:0/1852901922 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08000117f0 con 0x562ce4a29e90 2024-09-10T10:14:19.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.302+0000 7f07ff400640 1 -- 172.21.15.50:0/1852901922 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f080000f3f0 con 0x562ce4a29e90 2024-09-10T10:14:19.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.302+0000 7f07ff400640 1 -- 172.21.15.50:0/1852901922 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08000117f0 con 0x562ce4a29e90 2024-09-10T10:14:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.307+0000 7f081c07a740 1 -- 172.21.15.50:0/1852901922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a29e90 msgr2=0x562ce4a2c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:19.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.307+0000 7f081c07a740 1 --2- 172.21.15.50:0/1852901922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a29e90 0x562ce4a2c280 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0800005fd0 tx=0x7f0800005da0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.309+0000 7f0813400640 1 --2- 172.21.15.50:0/2568605858 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f07f80a2c80 0x7f07f80a5140 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f080c009430 tx=0x7f080c0458a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:19.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.310+0000 7f081c07a740 1 -- 172.21.15.50:0/1852901922 shutdown_connections 2024-09-10T10:14:19.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.310+0000 7f081c07a740 1 --2- 172.21.15.50:0/1852901922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a29e90 0x562ce4a2c280 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.310+0000 7f081c07a740 1 --2- 172.21.15.50:0/1852901922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1f5d0 0x562ce4a29950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.310+0000 7f081c07a740 1 --2- 172.21.15.50:0/1852901922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a1ecb0 0x562ce4a1f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.310+0000 7f081c07a740 1 -- 172.21.15.50:0/1852901922 >> 172.21.15.50:0/1852901922 conn(0x562ce4a1b240 msgr2=0x562ce4a1b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.314+0000 7f081c07a740 1 -- 172.21.15.50:0/1852901922 shutdown_connections 2024-09-10T10:14:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.314+0000 7f081c07a740 1 -- 172.21.15.50:0/1852901922 wait complete. 2024-09-10T10:14:19.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.316+0000 7f081c07a740 1 -- start start 2024-09-10T10:14:19.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.318+0000 7f081c07a740 1 Processor -- start 2024-09-10T10:14:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.320+0000 7f081c07a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a1ecb0 0x562ce4a29710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.321+0000 7f081c07a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1f5d0 0x562ce4a269c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.322+0000 7f081c07a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a29e90 0x562ce4a26f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.322+0000 7f081c07a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562ce4a3db10 con 0x562ce4a1ecb0 2024-09-10T10:14:19.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.323+0000 7f081c07a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562ce493ffa0 con 0x562ce4a29e90 2024-09-10T10:14:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.323+0000 7f081c07a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562ce4a3dc90 con 0x562ce4a1f5d0 2024-09-10T10:14:19.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.323+0000 7f081c07a740 10 client.0 _ll_register_callbacks cb 0x562ce4693ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.323+0000 7f0812000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a1ecb0 0x562ce4a29710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.324+0000 7f0812000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a1ecb0 0x562ce4a29710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33246/0 (socket says 172.21.15.50:33246) 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.324+0000 7f0812000640 1 -- 172.21.15.50:0/2700236665 learned_addr learned my addr 172.21.15.50:0/2700236665 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.323+0000 7f0812a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1f5d0 0x562ce4a269c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.325+0000 7f0812000640 1 -- 172.21.15.50:0/2700236665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1f5d0 msgr2=0x562ce4a269c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.325+0000 7f0812000640 1 --2- 172.21.15.50:0/2700236665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1f5d0 0x562ce4a269c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.325+0000 7f0812000640 1 -- 172.21.15.50:0/2700236665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a29e90 msgr2=0x562ce4a26f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.325+0000 7f0812000640 1 --2- 172.21.15.50:0/2700236665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a29e90 0x562ce4a26f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.325+0000 7f0812000640 1 -- 172.21.15.50:0/2700236665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ce4a276e0 con 0x562ce4a1ecb0 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.326+0000 7f0812a00640 1 --2- 172.21.15.50:0/2700236665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1f5d0 0x562ce4a269c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.326+0000 7f0812000640 1 --2- 172.21.15.50:0/2700236665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a1ecb0 0x562ce4a29710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f080000d9a0 tx=0x7f080000f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a78343f697d5eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.327+0000 7f07f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.327+0000 7f07f3e00640 1 -- 172.21.15.50:0/2700236665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08000117f0 con 0x562ce4a1ecb0 2024-09-10T10:14:19.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.327+0000 7f07f3e00640 1 -- 172.21.15.50:0/2700236665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f08000115f0 con 0x562ce4a1ecb0 2024-09-10T10:14:19.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.327+0000 7f081c07a740 1 -- 172.21.15.50:0/2700236665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f080000f3f0 con 0x562ce4a1ecb0 2024-09-10T10:14:19.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.328+0000 7f07f3e00640 1 -- 172.21.15.50:0/2700236665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f08000117f0 con 0x562ce4a1ecb0 2024-09-10T10:14:19.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.330+0000 7f081c07a740 10 client.16011 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:19.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.330+0000 7f081c07a740 1 -- 172.21.15.50:0/2700236665 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ce4a49970 con 0x562ce4a1ecb0 2024-09-10T10:14:19.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.331+0000 7f07f3e00640 1 -- 172.21.15.50:0/2700236665 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f080000f3f0 con 0x562ce4a1ecb0 2024-09-10T10:14:19.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.331+0000 7f07f3e00640 1 -- 172.21.15.50:0/2700236665 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f08000046c0 con 0x562ce4a1ecb0 2024-09-10T10:14:19.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.332+0000 7f081c07a740 10 client.16011 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:19.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.332+0000 7f081c07a740 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:14:19.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.333+0000 7f081c07a740 20 client.16011 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.333+0000 7f081c07a740 1 --2- 172.21.15.50:0/2700236665 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562ce4a4ad20 0x562ce4a4d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.333+0000 7f081c07a740 4 client.16011 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:14:19.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.333+0000 7f081c07a740 1 -- 172.21.15.50:0/2700236665 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ce4992800 con 0x562ce4a4ad20 2024-09-10T10:14:19.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.334+0000 7f0812a00640 1 --2- 172.21.15.50:0/2700236665 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562ce4a4ad20 0x562ce4a4d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.336+0000 7f0812a00640 1 --2- 172.21.15.50:0/2700236665 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562ce4a4ad20 0x562ce4a4d110 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f8704b1f4703c82 server_cookie=15123b76ebb36caa in_seq=0 out_seq=0 2024-09-10T10:14:19.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.336+0000 7f07f3e00640 10 client.16011 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:19.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.337+0000 7f07f3e00640 1 -- 172.21.15.50:0/2700236665 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ce4992800 con 0x562ce4a4ad20 2024-09-10T10:14:19.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.337+0000 7f07f3e00640 10 client.16011 handle_command_reply: tid=0 2024-09-10T10:14:19.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.337+0000 7f081c07a740 1 client.16011 shutdown 2024-09-10T10:14:19.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.337+0000 7f081c07a740 1 -- 172.21.15.50:0/2700236665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a1ecb0 msgr2=0x562ce4a29710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:19.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.337+0000 7f081c07a740 1 --2- 172.21.15.50:0/2700236665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a1ecb0 0x562ce4a29710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f080000d9a0 tx=0x7f080000f5a0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.338+0000 7f081c07a740 1 -- 172.21.15.50:0/2700236665 shutdown_connections 2024-09-10T10:14:19.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.338+0000 7f081c07a740 1 --2- 172.21.15.50:0/2700236665 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562ce4a4ad20 0x562ce4a4d110 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.338+0000 7f081c07a740 1 --2- 172.21.15.50:0/2700236665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a29e90 0x562ce4a26f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.338+0000 7f081c07a740 1 --2- 172.21.15.50:0/2700236665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1f5d0 0x562ce4a269c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.338+0000 7f07f3e00640 0 client.16011 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:19.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.338+0000 7f081c07a740 1 --2- 172.21.15.50:0/2700236665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a1ecb0 0x562ce4a29710 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.338+0000 7f081c07a740 1 -- 172.21.15.50:0/2700236665 >> 172.21.15.50:0/2700236665 conn(0x562ce4a1b240 msgr2=0x562ce4a20f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:19.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.338+0000 7f081c07a740 1 -- 172.21.15.50:0/2700236665 shutdown_connections 2024-09-10T10:14:19.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.339+0000 7f081c07a740 1 -- 172.21.15.50:0/2700236665 wait complete. 2024-09-10T10:14:19.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.339+0000 7f081c07a740 20 client.16011 trim_cache size 0 max 16384 2024-09-10T10:14:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.405+0000 7f081c07a740 1 Processor -- start 2024-09-10T10:14:19.406 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.405+0000 7f081c07a740 1 -- start start 2024-09-10T10:14:19.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.406+0000 7f081c07a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1ecb0 0x562ce4a29230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.407 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.406+0000 7f081c07a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a1f5d0 0x562ce4a20e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.406+0000 7f081c07a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a29e90 0x562ce4a526b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.406+0000 7f081c07a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f08141b7a40 con 0x562ce4a1f5d0 2024-09-10T10:14:19.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.406+0000 7f081c07a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f08141b5310 con 0x562ce4a29e90 2024-09-10T10:14:19.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.406+0000 7f081c07a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0814072a50 con 0x562ce4a1ecb0 2024-09-10T10:14:19.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.406+0000 7f0812000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1ecb0 0x562ce4a29230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.408 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.406+0000 7f0812000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1ecb0 0x562ce4a29230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:46546/0 (socket says 172.21.15.50:46546) 2024-09-10T10:14:19.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.406+0000 7f0812000640 1 -- 172.21.15.50:0/1608371539 learned_addr learned my addr 172.21.15.50:0/1608371539 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:19.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.407+0000 7f0812a00640 1 --2- 172.21.15.50:0/1608371539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a1f5d0 0x562ce4a20e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.407+0000 7f0812000640 1 -- 172.21.15.50:0/1608371539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a29e90 msgr2=0x562ce4a526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:19.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.407+0000 7f0812000640 1 --2- 172.21.15.50:0/1608371539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a29e90 0x562ce4a526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.407+0000 7f0812000640 1 -- 172.21.15.50:0/1608371539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a1f5d0 msgr2=0x562ce4a20e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:19.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.407+0000 7f0812000640 1 --2- 172.21.15.50:0/1608371539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a1f5d0 0x562ce4a20e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.409 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.407+0000 7f0812000640 1 -- 172.21.15.50:0/1608371539 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce4a1f400 con 0x562ce4a1ecb0 2024-09-10T10:14:19.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.408+0000 7f0812000640 1 --2- 172.21.15.50:0/1608371539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1ecb0 0x562ce4a29230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f080002b040 tx=0x7f080000d890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6c5e1ee57d3c73c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:19.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.409+0000 7f07fea00640 1 -- 172.21.15.50:0/1608371539 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800037070 con 0x562ce4a1ecb0 2024-09-10T10:14:19.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.409+0000 7f07fea00640 1 -- 172.21.15.50:0/1608371539 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f080000f3f0 con 0x562ce4a1ecb0 2024-09-10T10:14:19.410 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.409+0000 7f07fea00640 1 -- 172.21.15.50:0/1608371539 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080000f9f0 con 0x562ce4a1ecb0 2024-09-10T10:14:19.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.410+0000 7f081c07a740 1 -- 172.21.15.50:0/1608371539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1ecb0 msgr2=0x562ce4a29230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:19.411 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.410+0000 7f081c07a740 1 --2- 172.21.15.50:0/1608371539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1ecb0 0x562ce4a29230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f080002b040 tx=0x7f080000d890 comp rx=0 tx=0).stop 2024-09-10T10:14:19.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.410+0000 7f081c07a740 1 -- 172.21.15.50:0/1608371539 shutdown_connections 2024-09-10T10:14:19.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.410+0000 7f081c07a740 1 --2- 172.21.15.50:0/1608371539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a29e90 0x562ce4a526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.410+0000 7f081c07a740 1 --2- 172.21.15.50:0/1608371539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a1f5d0 0x562ce4a20e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.410+0000 7f081c07a740 1 --2- 172.21.15.50:0/1608371539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a1ecb0 0x562ce4a29230 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f080002b040 tx=0x7f080000d890 comp rx=0 tx=0).stop 2024-09-10T10:14:19.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.410+0000 7f081c07a740 1 -- 172.21.15.50:0/1608371539 >> 172.21.15.50:0/1608371539 conn(0x562ce4a1b240 msgr2=0x562ce4a20700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:19.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.410+0000 7f081c07a740 1 -- 172.21.15.50:0/1608371539 shutdown_connections 2024-09-10T10:14:19.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.410+0000 7f081c07a740 1 -- 172.21.15.50:0/1608371539 wait complete. 2024-09-10T10:14:19.412 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.411+0000 7f081c07a740 1 -- start start 2024-09-10T10:14:19.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.411+0000 7f081c07a740 1 Processor -- start 2024-09-10T10:14:19.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.412+0000 7f081c07a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a1f5d0 0x562ce4a43470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.412+0000 7f081c07a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a29e90 0x562ce4a23570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.412+0000 7f081c07a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a23ab0 0x562ce4a23f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.412+0000 7f081c07a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0814073120 con 0x562ce4a23ab0 2024-09-10T10:14:19.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.412+0000 7f081c07a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f08141b4c40 con 0x562ce4a1f5d0 2024-09-10T10:14:19.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.412+0000 7f081c07a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08140737f0 con 0x562ce4a29e90 2024-09-10T10:14:19.414 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.412+0000 7f081c07a740 10 client.0 _ll_register_callbacks cb 0x7f0800013490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.413+0000 7f0812a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a29e90 0x562ce4a23570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.413+0000 7f0812a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a29e90 0x562ce4a23570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:46550/0 (socket says 172.21.15.50:46550) 2024-09-10T10:14:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.413+0000 7f0812a00640 1 -- 172.21.15.50:0/1513867268 learned_addr learned my addr 172.21.15.50:0/1513867268 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.413+0000 7f0812a00640 1 -- 172.21.15.50:0/1513867268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a1f5d0 msgr2=0x562ce4a43470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:14:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.413+0000 7f0812a00640 1 --2- 172.21.15.50:0/1513867268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a1f5d0 0x562ce4a43470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.413+0000 7f0812a00640 1 -- 172.21.15.50:0/1513867268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a23ab0 msgr2=0x562ce4a23f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:14:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.413+0000 7f0812000640 1 --2- 172.21.15.50:0/1513867268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a23ab0 0x562ce4a23f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.415 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.413+0000 7f0812a00640 1 --2- 172.21.15.50:0/1513867268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a23ab0 0x562ce4a23f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.414+0000 7f0812a00640 1 -- 172.21.15.50:0/1513867268 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ce4ab4680 con 0x562ce4a29e90 2024-09-10T10:14:19.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.414+0000 7f0812000640 1 --2- 172.21.15.50:0/1513867268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a23ab0 0x562ce4a23f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:14:19.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.414+0000 7f0812a00640 1 --2- 172.21.15.50:0/1513867268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a29e90 0x562ce4a23570 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x562ce4a26250 tx=0x7f08040118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91a4bf546789ecdd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:19.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.414+0000 7f07f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:14:19.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.414+0000 7f07f3e00640 1 -- 172.21.15.50:0/1513867268 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08040107e0 con 0x562ce4a29e90 2024-09-10T10:14:19.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.414+0000 7f07f3e00640 1 -- 172.21.15.50:0/1513867268 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f0804010980 con 0x562ce4a29e90 2024-09-10T10:14:19.416 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.414+0000 7f081c07a740 1 -- 172.21.15.50:0/1513867268 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f080000f3f0 con 0x562ce4a29e90 2024-09-10T10:14:19.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.415+0000 7f07f3e00640 1 -- 172.21.15.50:0/1513867268 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0804029050 con 0x562ce4a29e90 2024-09-10T10:14:19.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.415+0000 7f081c07a740 10 client.26047 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:19.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.415+0000 7f081c07a740 1 -- 172.21.15.50:0/1513867268 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562ce4ab59a0 con 0x562ce4a29e90 2024-09-10T10:14:19.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.416+0000 7f07f3e00640 1 -- 172.21.15.50:0/1513867268 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f080000f3f0 con 0x562ce4a29e90 2024-09-10T10:14:19.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.416+0000 7f07f3e00640 1 -- 172.21.15.50:0/1513867268 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f08040203a0 con 0x562ce4a29e90 2024-09-10T10:14:19.417 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.416+0000 7f081c07a740 10 client.26047 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:19.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.416+0000 7f081c07a740 10 client.26047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:14:19.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.416+0000 7f081c07a740 20 client.26047 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:19.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.416+0000 7f081c07a740 1 --2- 172.21.15.50:0/1513867268 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562ce4ab61a0 0x562ce4ab8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:19.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.416+0000 7f081c07a740 4 client.26047 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T10:14:19.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.416+0000 7f081c07a740 1 -- 172.21.15.50:0/1513867268 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562ce498cd10 con 0x562ce4ab61a0 2024-09-10T10:14:19.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.418+0000 7f0812000640 1 --2- 172.21.15.50:0/1513867268 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562ce4ab61a0 0x562ce4ab8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:19.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.418+0000 7f0812000640 1 --2- 172.21.15.50:0/1513867268 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562ce4ab61a0 0x562ce4ab8600 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6509d9d7bf53eead server_cookie=fec11b62f4d96b11 in_seq=0 out_seq=0 2024-09-10T10:14:19.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.418+0000 7f07f3e00640 10 client.26047 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:19.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.419+0000 7f07f3e00640 1 -- 172.21.15.50:0/1513867268 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562ce498cd10 con 0x562ce4ab61a0 2024-09-10T10:14:19.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.419+0000 7f07f3e00640 10 client.26047 handle_command_reply: tid=0 2024-09-10T10:14:19.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.419+0000 7f081c07a740 1 client.26047 shutdown 2024-09-10T10:14:19.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.420+0000 7f081c07a740 1 -- 172.21.15.50:0/1513867268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a29e90 msgr2=0x562ce4a23570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:19.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.420+0000 7f081c07a740 1 --2- 172.21.15.50:0/1513867268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a29e90 0x562ce4a23570 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x562ce4a26250 tx=0x7f08040118d0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.420+0000 7f081c07a740 1 -- 172.21.15.50:0/1513867268 shutdown_connections 2024-09-10T10:14:19.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.421+0000 7f081c07a740 1 --2- 172.21.15.50:0/1513867268 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562ce4ab61a0 0x562ce4ab8600 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.421+0000 7f081c07a740 1 --2- 172.21.15.50:0/1513867268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562ce4a23ab0 0x562ce4a23f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.421+0000 7f081c07a740 1 --2- 172.21.15.50:0/1513867268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562ce4a29e90 0x562ce4a23570 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.421+0000 7f081c07a740 1 --2- 172.21.15.50:0/1513867268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562ce4a1f5d0 0x562ce4a43470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.421+0000 7f07f3e00640 0 client.26047 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:19.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.421+0000 7f081c07a740 1 -- 172.21.15.50:0/1513867268 >> 172.21.15.50:0/1513867268 conn(0x562ce4a1b240 msgr2=0x562ce4a20f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:19.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.421+0000 7f081c07a740 1 -- 172.21.15.50:0/1513867268 shutdown_connections 2024-09-10T10:14:19.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.421+0000 7f081c07a740 1 -- 172.21.15.50:0/1513867268 wait complete. 2024-09-10T10:14:19.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.421+0000 7f081c07a740 20 client.26047 trim_cache size 0 max 16384 2024-09-10T10:14:19.423 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:14:19.423 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-10T10:14:19.423 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "76fc81ec-5a45-46f6-b49d-7e4b22b119bb", 2024-09-10T10:14:19.424 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-10T10:14:19.424 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:14:19.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.422+0000 7f0813e00640 1 -- 172.21.15.50:0/2568605858 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f07f80a2c80 msgr2=0x7f07f80a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:19.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.422+0000 7f0813e00640 1 --2- 172.21.15.50:0/2568605858 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f07f80a2c80 0x7f07f80a5140 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f080c009430 tx=0x7f080c0458a0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.422+0000 7f0813e00640 1 -- 172.21.15.50:0/2568605858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08141079d0 msgr2=0x7f081419a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:19.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.422+0000 7f0813e00640 1 --2- 172.21.15.50:0/2568605858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08141079d0 0x7f081419a8e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f080c0098d0 tx=0x7f080c030b60 comp rx=0 tx=0).stop 2024-09-10T10:14:19.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.422+0000 7f0813e00640 1 -- 172.21.15.50:0/2568605858 shutdown_connections 2024-09-10T10:14:19.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.422+0000 7f0813e00640 1 --2- 172.21.15.50:0/2568605858 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f07f80a2c80 0x7f07f80a5140 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.422+0000 7f0813e00640 1 --2- 172.21.15.50:0/2568605858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08141079d0 0x7f081419a8e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.422+0000 7f0813e00640 1 --2- 172.21.15.50:0/2568605858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0814102370 0x7f081410dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.422+0000 7f0813e00640 1 --2- 172.21.15.50:0/2568605858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08141019d0 0x7f081410da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:19.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.422+0000 7f0813e00640 1 -- 172.21.15.50:0/2568605858 >> 172.21.15.50:0/2568605858 conn(0x7f08140fd710 msgr2=0x7f08140feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:19.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.423+0000 7f0813e00640 1 -- 172.21.15.50:0/2568605858 shutdown_connections 2024-09-10T10:14:19.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:19.423+0000 7f0813e00640 1 -- 172.21.15.50:0/2568605858 wait complete. 2024-09-10T10:14:20.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:20 smithi189 ceph-mon[34999]: pgmap v485: 129 pgs: 129 active+clean; 2.4 GiB data, 738 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 203 MiB/s wr, 75 op/s 2024-09-10T10:14:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:20 smithi189 ceph-mon[34999]: scrub queued for path: / 2024-09-10T10:14:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:20 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:14:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:20 smithi189 ceph-mon[34999]: scrub summary: active paths [/] 2024-09-10T10:14:20.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:20 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:14:20.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:20 smithi084 ceph-mon[34812]: pgmap v485: 129 pgs: 129 active+clean; 2.4 GiB data, 738 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 203 MiB/s wr, 75 op/s 2024-09-10T10:14:20.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:20 smithi084 ceph-mon[34812]: scrub queued for path: / 2024-09-10T10:14:20.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:20 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:14:20.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:20 smithi084 ceph-mon[34812]: scrub summary: active paths [/] 2024-09-10T10:14:20.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:20 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:14:20.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:20 smithi050 ceph-mon[30354]: pgmap v485: 129 pgs: 129 active+clean; 2.4 GiB data, 738 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 203 MiB/s wr, 75 op/s 2024-09-10T10:14:20.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:20 smithi050 ceph-mon[30354]: scrub queued for path: / 2024-09-10T10:14:20.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:20 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:14:20.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:20 smithi050 ceph-mon[30354]: scrub summary: active paths [/] 2024-09-10T10:14:20.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:20 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:14:20.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:14:21.609 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:14:22.199 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:22 smithi050 ceph-mon[30354]: pgmap v486: 129 pgs: 129 active+clean; 3.0 GiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 246 MiB/s wr, 72 op/s 2024-09-10T10:14:22.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:22 smithi189 ceph-mon[34999]: pgmap v486: 129 pgs: 129 active+clean; 3.0 GiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 246 MiB/s wr, 72 op/s 2024-09-10T10:14:22.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:22 smithi084 ceph-mon[34812]: pgmap v486: 129 pgs: 129 active+clean; 3.0 GiB data, 803 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 246 MiB/s wr, 72 op/s 2024-09-10T10:14:22.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.632+0000 7f6c00a00640 1 -- 172.21.15.50:0/1061067729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bfc103e30 msgr2=0x7f6bfc104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:22.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.632+0000 7f6c00a00640 1 --2- 172.21.15.50:0/1061067729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bfc103e30 0x7f6bfc104210 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009900 tx=0x7f6bec02a410 comp rx=0 tx=0).stop 2024-09-10T10:14:22.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.632+0000 7f6c00a00640 1 -- 172.21.15.50:0/1061067729 shutdown_connections 2024-09-10T10:14:22.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.633+0000 7f6c00a00640 1 --2- 172.21.15.50:0/1061067729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bfc108f60 0x7f6bfc110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.633+0000 7f6c00a00640 1 --2- 172.21.15.50:0/1061067729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bfc1047e0 0x7f6bfc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.633+0000 7f6c00a00640 1 --2- 172.21.15.50:0/1061067729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bfc103e30 0x7f6bfc104210 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.633+0000 7f6c00a00640 1 -- 172.21.15.50:0/1061067729 >> 172.21.15.50:0/1061067729 conn(0x7f6bfc0ff910 msgr2=0x7f6bfc101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:22.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.633+0000 7f6c00a00640 1 -- 172.21.15.50:0/1061067729 shutdown_connections 2024-09-10T10:14:22.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.633+0000 7f6c00a00640 1 -- 172.21.15.50:0/1061067729 wait complete. 2024-09-10T10:14:22.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.634+0000 7f6c00a00640 1 Processor -- start 2024-09-10T10:14:22.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.635+0000 7f6c00a00640 1 -- start start 2024-09-10T10:14:22.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.635+0000 7f6c00a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bfc103e30 0x7f6bfc19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.635+0000 7f6c00a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bfc1047e0 0x7f6bfc19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.635+0000 7f6c00a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bfc108f60 0x7f6bfc19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.635+0000 7f6c00a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc114010 con 0x7f6bfc103e30 2024-09-10T10:14:22.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.635+0000 7f6c00a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc113e90 con 0x7f6bfc108f60 2024-09-10T10:14:22.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.635+0000 7f6c00a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc114190 con 0x7f6bfc1047e0 2024-09-10T10:14:22.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.636+0000 7f6bfb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bfc103e30 0x7f6bfc19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.636+0000 7f6bf2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bfc1047e0 0x7f6bfc19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.636+0000 7f6bfbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bfc108f60 0x7f6bfc19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.636+0000 7f6bf2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bfc1047e0 0x7f6bfc19a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:46558/0 (socket says 172.21.15.50:46558) 2024-09-10T10:14:22.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.636+0000 7f6bf2a00640 1 -- 172.21.15.50:0/1949308220 learned_addr learned my addr 172.21.15.50:0/1949308220 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:22.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.636+0000 7f6bf2a00640 1 -- 172.21.15.50:0/1949308220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bfc108f60 msgr2=0x7f6bfc19ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:22.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.636+0000 7f6bf2a00640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bfc108f60 0x7f6bfc19ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.636+0000 7f6bf2a00640 1 -- 172.21.15.50:0/1949308220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bfc103e30 msgr2=0x7f6bfc19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:22.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.636+0000 7f6bf2a00640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bfc103e30 0x7f6bfc19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.636+0000 7f6bf2a00640 1 -- 172.21.15.50:0/1949308220 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bfc19f420 con 0x7f6bfc1047e0 2024-09-10T10:14:22.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.637+0000 7f6bfbe00640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bfc108f60 0x7f6bfc19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:14:22.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.637+0000 7f6bfb400640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bfc103e30 0x7f6bfc19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:14:22.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.637+0000 7f6bf2a00640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bfc1047e0 0x7f6bfc19a9b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6be400e9f0 tx=0x7f6be400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:22.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.640+0000 7f6bf8c00640 1 -- 172.21.15.50:0/1949308220 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be400cd80 con 0x7f6bfc1047e0 2024-09-10T10:14:22.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.640+0000 7f6bf8c00640 1 -- 172.21.15.50:0/1949308220 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6be4010910 con 0x7f6bfc1047e0 2024-09-10T10:14:22.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.640+0000 7f6c00a00640 1 -- 172.21.15.50:0/1949308220 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bfc19f710 con 0x7f6bfc1047e0 2024-09-10T10:14:22.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.640+0000 7f6c00a00640 1 -- 172.21.15.50:0/1949308220 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bfc1a6ff0 con 0x7f6bfc1047e0 2024-09-10T10:14:22.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.640+0000 7f6bf8c00640 1 -- 172.21.15.50:0/1949308220 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4018990 con 0x7f6bfc1047e0 2024-09-10T10:14:22.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.645+0000 7f6c04ab9740 1 Processor -- start 2024-09-10T10:14:22.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.646+0000 7f6bf8c00640 1 -- 172.21.15.50:0/1949308220 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6be4018b30 con 0x7f6bfc1047e0 2024-09-10T10:14:22.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.646+0000 7f6c04ab9740 1 -- start start 2024-09-10T10:14:22.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.647+0000 7f6c04ab9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563177506c70 0x563177507050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.647+0000 7f6c04ab9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177507590 0x56317751a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.647+0000 7f6c04ab9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56317751a740 0x56317751cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.647+0000 7f6c04ab9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56317746d3e0 con 0x56317751a740 2024-09-10T10:14:22.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.647+0000 7f6c04ab9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563177414d80 con 0x563177506c70 2024-09-10T10:14:22.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.647+0000 7f6c04ab9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5631774693a0 con 0x563177507590 2024-09-10T10:14:22.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.647+0000 7f6bfbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563177506c70 0x563177507050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.647+0000 7f6bfbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563177506c70 0x563177507050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:52104/0 (socket says 172.21.15.50:52104) 2024-09-10T10:14:22.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.647+0000 7f6bfbe00640 1 -- 172.21.15.50:0/903086984 learned_addr learned my addr 172.21.15.50:0/903086984 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:22.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.647+0000 7f6bfb400640 1 --2- 172.21.15.50:0/903086984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177507590 0x56317751a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.647+0000 7f6bf2a00640 1 --2- 172.21.15.50:0/903086984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56317751a740 0x56317751cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.647+0000 7f6bfb400640 1 -- 172.21.15.50:0/903086984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563177506c70 msgr2=0x563177507050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:22.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.648+0000 7f6bfb400640 1 --2- 172.21.15.50:0/903086984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563177506c70 0x563177507050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.648+0000 7f6bfb400640 1 -- 172.21.15.50:0/903086984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56317751a740 msgr2=0x56317751cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:22.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.648+0000 7f6bfb400640 1 --2- 172.21.15.50:0/903086984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56317751a740 0x56317751cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.648+0000 7f6bfb400640 1 -- 172.21.15.50:0/903086984 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563177433ae0 con 0x563177507590 2024-09-10T10:14:22.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.648+0000 7f6bf2a00640 1 --2- 172.21.15.50:0/903086984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56317751a740 0x56317751cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.648+0000 7f6bfb400640 1 --2- 172.21.15.50:0/903086984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177507590 0x56317751a200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6bec02aa00 tx=0x7f6bec0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=425d0a6dcb3c56d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.648+0000 7f6bebe00640 1 -- 172.21.15.50:0/903086984 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec035030 con 0x563177507590 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.648+0000 7f6bebe00640 1 -- 172.21.15.50:0/903086984 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bec005520 con 0x563177507590 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.648+0000 7f6bebe00640 1 -- 172.21.15.50:0/903086984 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0035f0 con 0x563177507590 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.649+0000 7f6bf8c00640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6be00a2c00 0x7f6be00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.649+0000 7f6bf8c00640 1 -- 172.21.15.50:0/1949308220 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f6be40cf4e0 con 0x7f6bfc1047e0 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.649+0000 7f6bfbe00640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6be00a2c00 0x7f6be00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.650+0000 7f6c04ab9740 1 -- 172.21.15.50:0/903086984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177507590 msgr2=0x56317751a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.650+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/903086984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177507590 0x56317751a200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6bec02aa00 tx=0x7f6bec0040c0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.650+0000 7f6c04ab9740 1 -- 172.21.15.50:0/903086984 shutdown_connections 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.650+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/903086984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56317751a740 0x56317751cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.650+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/903086984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177507590 0x56317751a200 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.650+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/903086984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563177506c70 0x563177507050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.650+0000 7f6c04ab9740 1 -- 172.21.15.50:0/903086984 >> 172.21.15.50:0/903086984 conn(0x5631775032e0 msgr2=0x5631775036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:22.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.650+0000 7f6bfbe00640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6be00a2c00 0x7f6be00a50c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4012940 tx=0x7f6bf4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:22.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.650+0000 7f6c04ab9740 1 -- 172.21.15.50:0/903086984 shutdown_connections 2024-09-10T10:14:22.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.650+0000 7f6c04ab9740 1 -- 172.21.15.50:0/903086984 wait complete. 2024-09-10T10:14:22.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.651+0000 7f6c04ab9740 1 -- start start 2024-09-10T10:14:22.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.651+0000 7f6c04ab9740 1 Processor -- start 2024-09-10T10:14:22.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.652+0000 7f6c04ab9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563177506c70 0x5631775176e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.652+0000 7f6c04ab9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177507590 0x563177517c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.652+0000 7f6c04ab9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56317751a740 0x563177518160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.652+0000 7f6c04ab9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56317751d2f0 con 0x563177506c70 2024-09-10T10:14:22.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.652+0000 7f6c04ab9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5631774280f0 con 0x56317751a740 2024-09-10T10:14:22.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.652+0000 7f6c04ab9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56317751d470 con 0x563177507590 2024-09-10T10:14:22.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.652+0000 7f6c04ab9740 10 client.0 _ll_register_callbacks cb 0x5631774199e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:22.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.652+0000 7f6bfb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563177506c70 0x5631775176e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.652+0000 7f6bfb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563177506c70 0x5631775176e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33290/0 (socket says 172.21.15.50:33290) 2024-09-10T10:14:22.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.652+0000 7f6bfb400640 1 -- 172.21.15.50:0/485811404 learned_addr learned my addr 172.21.15.50:0/485811404 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:22.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.652+0000 7f6bf2a00640 1 --2- 172.21.15.50:0/485811404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177507590 0x563177517c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.653+0000 7f6bfb400640 1 -- 172.21.15.50:0/485811404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177507590 msgr2=0x563177517c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:22.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.653+0000 7f6bfb400640 1 --2- 172.21.15.50:0/485811404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177507590 0x563177517c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.653+0000 7f6bfb400640 1 -- 172.21.15.50:0/485811404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56317751a740 msgr2=0x563177518160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:22.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.654+0000 7f6bfbe00640 1 --2- 172.21.15.50:0/485811404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56317751a740 0x563177518160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.654+0000 7f6bfb400640 1 --2- 172.21.15.50:0/485811404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56317751a740 0x563177518160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.654+0000 7f6bfb400640 1 -- 172.21.15.50:0/485811404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631771de3c0 con 0x563177506c70 2024-09-10T10:14:22.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.655+0000 7f6bfb400640 1 --2- 172.21.15.50:0/485811404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563177506c70 0x5631775176e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6bec006010 tx=0x7f6bec02aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57908c0a47a749a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:22.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.655+0000 7f6be8c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:14:22.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.655+0000 7f6be8c00640 1 -- 172.21.15.50:0/485811404 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec035030 con 0x563177506c70 2024-09-10T10:14:22.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.655+0000 7f6be8c00640 1 -- 172.21.15.50:0/485811404 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f6bec005010 con 0x563177506c70 2024-09-10T10:14:22.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.655+0000 7f6c04ab9740 1 -- 172.21.15.50:0/485811404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bec005520 con 0x563177506c70 2024-09-10T10:14:22.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.656+0000 7f6be8c00640 1 -- 172.21.15.50:0/485811404 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6bec005210 con 0x563177506c70 2024-09-10T10:14:22.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.656+0000 7f6c04ab9740 10 client.16026 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:22.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.656+0000 7f6c04ab9740 1 -- 172.21.15.50:0/485811404 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5631775290e0 con 0x563177506c70 2024-09-10T10:14:22.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.656+0000 7f6be8c00640 1 -- 172.21.15.50:0/485811404 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bec005520 con 0x563177506c70 2024-09-10T10:14:22.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.657+0000 7f6be8c00640 1 -- 172.21.15.50:0/485811404 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f6bec0039c0 con 0x563177506c70 2024-09-10T10:14:22.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.657+0000 7f6c04ab9740 10 client.16026 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:22.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.657+0000 7f6c04ab9740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:14:22.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.657+0000 7f6c04ab9740 20 client.16026 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:22.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.658+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/485811404 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56317752a430 0x56317752c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.658+0000 7f6c04ab9740 4 client.16026 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:14:22.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.658+0000 7f6c04ab9740 1 -- 172.21.15.50:0/485811404 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56317747a950 con 0x56317752a430 2024-09-10T10:14:22.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.659+0000 7f6bf2a00640 1 --2- 172.21.15.50:0/485811404 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56317752a430 0x56317752c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.660+0000 7f6bf2a00640 1 --2- 172.21.15.50:0/485811404 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56317752a430 0x56317752c820 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7c2dcc2954ec587 server_cookie=f84c563556321ccb in_seq=0 out_seq=0 2024-09-10T10:14:22.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.660+0000 7f6be8c00640 10 client.16026 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:22.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.661+0000 7f6be8c00640 1 -- 172.21.15.50:0/485811404 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56317747a950 con 0x56317752a430 2024-09-10T10:14:22.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.661+0000 7f6be8c00640 10 client.16026 handle_command_reply: tid=0 2024-09-10T10:14:22.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.662+0000 7f6c04ab9740 1 client.16026 shutdown 2024-09-10T10:14:22.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.662+0000 7f6c04ab9740 1 -- 172.21.15.50:0/485811404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563177506c70 msgr2=0x5631775176e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:22.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.662+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/485811404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563177506c70 0x5631775176e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6bec006010 tx=0x7f6bec02aa90 comp rx=0 tx=0).stop 2024-09-10T10:14:22.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.663+0000 7f6c04ab9740 1 -- 172.21.15.50:0/485811404 shutdown_connections 2024-09-10T10:14:22.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.663+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/485811404 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x56317752a430 0x56317752c820 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.663+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/485811404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56317751a740 0x563177518160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.663+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/485811404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177507590 0x563177517c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.663+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/485811404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563177506c70 0x5631775176e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.663+0000 7f6c04ab9740 1 -- 172.21.15.50:0/485811404 >> 172.21.15.50:0/485811404 conn(0x5631775032e0 msgr2=0x563177508f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:22.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.663+0000 7f6be8c00640 0 client.16026 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:22.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.664+0000 7f6c04ab9740 1 -- 172.21.15.50:0/485811404 shutdown_connections 2024-09-10T10:14:22.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.664+0000 7f6c04ab9740 1 -- 172.21.15.50:0/485811404 wait complete. 2024-09-10T10:14:22.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.664+0000 7f6c04ab9740 20 client.16026 trim_cache size 0 max 16384 2024-09-10T10:14:22.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.703+0000 7f6c04ab9740 1 Processor -- start 2024-09-10T10:14:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.703+0000 7f6c04ab9740 1 -- start start 2024-09-10T10:14:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.703+0000 7f6c04ab9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177506c70 0x5631775036c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.703+0000 7f6c04ab9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563177507590 0x563177502270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.703+0000 7f6c04ab9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56317751a740 0x5631775027b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.703+0000 7f6c04ab9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd8012400 con 0x56317751a740 2024-09-10T10:14:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.703+0000 7f6c04ab9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd800fcd0 con 0x563177507590 2024-09-10T10:14:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.703+0000 7f6c04ab9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd800db20 con 0x563177506c70 2024-09-10T10:14:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.704+0000 7f6bfbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56317751a740 0x5631775027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.704+0000 7f6bfbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56317751a740 0x5631775027b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33300/0 (socket says 172.21.15.50:33300) 2024-09-10T10:14:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.704+0000 7f6bfbe00640 1 -- 172.21.15.50:0/3580746123 learned_addr learned my addr 172.21.15.50:0/3580746123 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.704+0000 7f6bf2a00640 1 --2- 172.21.15.50:0/3580746123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563177507590 0x563177502270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.704+0000 7f6bfb400640 1 --2- 172.21.15.50:0/3580746123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177506c70 0x5631775036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.705+0000 7f6bfb400640 1 -- 172.21.15.50:0/3580746123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563177507590 msgr2=0x563177502270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:22.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.705+0000 7f6bfb400640 1 --2- 172.21.15.50:0/3580746123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563177507590 0x563177502270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.705+0000 7f6bfb400640 1 -- 172.21.15.50:0/3580746123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56317751a740 msgr2=0x5631775027b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:22.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.705+0000 7f6bfb400640 1 --2- 172.21.15.50:0/3580746123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56317751a740 0x5631775027b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.705+0000 7f6bfb400640 1 -- 172.21.15.50:0/3580746123 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563177516690 con 0x563177506c70 2024-09-10T10:14:22.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.705+0000 7f6bfb400640 1 --2- 172.21.15.50:0/3580746123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177506c70 0x5631775036c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6bec031550 tx=0x7f6bec048000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1565f1c2da2f02f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.706+0000 7f6beb400640 1 -- 172.21.15.50:0/3580746123 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec035030 con 0x563177506c70 2024-09-10T10:14:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.706+0000 7f6beb400640 1 -- 172.21.15.50:0/3580746123 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bec003ad0 con 0x563177506c70 2024-09-10T10:14:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.706+0000 7f6beb400640 1 -- 172.21.15.50:0/3580746123 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec031920 con 0x563177506c70 2024-09-10T10:14:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.707+0000 7f6c04ab9740 1 -- 172.21.15.50:0/3580746123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177506c70 msgr2=0x5631775036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:22.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.707+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/3580746123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177506c70 0x5631775036c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6bec031550 tx=0x7f6bec048000 comp rx=0 tx=0).stop 2024-09-10T10:14:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.708+0000 7f6c04ab9740 1 -- 172.21.15.50:0/3580746123 shutdown_connections 2024-09-10T10:14:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.708+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/3580746123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56317751a740 0x5631775027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.708+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/3580746123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563177507590 0x563177502270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.708+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/3580746123 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177506c70 0x5631775036c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.708+0000 7f6c04ab9740 1 -- 172.21.15.50:0/3580746123 >> 172.21.15.50:0/3580746123 conn(0x5631775032e0 msgr2=0x563177501b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:22.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.708+0000 7f6c04ab9740 1 -- 172.21.15.50:0/3580746123 shutdown_connections 2024-09-10T10:14:22.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.708+0000 7f6c04ab9740 1 -- 172.21.15.50:0/3580746123 wait complete. 2024-09-10T10:14:22.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.709+0000 7f6c04ab9740 1 -- start start 2024-09-10T10:14:22.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.710+0000 7f6c04ab9740 1 Processor -- start 2024-09-10T10:14:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.711+0000 7f6c04ab9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177506c70 0x56317752cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.711+0000 7f6c04ab9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563177507590 0x56317752d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.711+0000 7f6c04ab9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56317751a740 0x56317752f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.711+0000 7f6c04ab9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd800e190 con 0x563177507590 2024-09-10T10:14:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.711+0000 7f6c04ab9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd800f600 con 0x56317751a740 2024-09-10T10:14:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.711+0000 7f6c04ab9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd800e860 con 0x563177506c70 2024-09-10T10:14:22.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.711+0000 7f6c04ab9740 10 client.0 _ll_register_callbacks cb 0x7f6bec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.712+0000 7f6bfb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177506c70 0x56317752cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.712+0000 7f6bfb400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177506c70 0x56317752cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:46586/0 (socket says 172.21.15.50:46586) 2024-09-10T10:14:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.712+0000 7f6bfb400640 1 -- 172.21.15.50:0/1361399943 learned_addr learned my addr 172.21.15.50:0/1361399943 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.712+0000 7f6bfbe00640 1 --2- 172.21.15.50:0/1361399943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56317751a740 0x56317752f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.712+0000 7f6bfb400640 1 -- 172.21.15.50:0/1361399943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56317751a740 msgr2=0x56317752f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.712+0000 7f6bfb400640 1 --2- 172.21.15.50:0/1361399943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56317751a740 0x56317752f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.712+0000 7f6bfb400640 1 -- 172.21.15.50:0/1361399943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563177507590 msgr2=0x56317752d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.712+0000 7f6bfb400640 1 --2- 172.21.15.50:0/1361399943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563177507590 0x56317752d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.712+0000 7f6bfb400640 1 -- 172.21.15.50:0/1361399943 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56317752f880 con 0x563177506c70 2024-09-10T10:14:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.712+0000 7f6bfb400640 1 --2- 172.21.15.50:0/1361399943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177506c70 0x56317752cc70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0092a0 tx=0x7f6bec02aa90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d00e07efd2218147 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.712+0000 7f6be8c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:14:22.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.712+0000 7f6be8c00640 1 -- 172.21.15.50:0/1361399943 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec035030 con 0x563177506c70 2024-09-10T10:14:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.713+0000 7f6be8c00640 1 -- 172.21.15.50:0/1361399943 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f6bec0035f0 con 0x563177506c70 2024-09-10T10:14:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.713+0000 7f6c04ab9740 1 -- 172.21.15.50:0/1361399943 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bec003ad0 con 0x563177506c70 2024-09-10T10:14:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.713+0000 7f6be8c00640 1 -- 172.21.15.50:0/1361399943 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6bec06e050 con 0x563177506c70 2024-09-10T10:14:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.714+0000 7f6c04ab9740 10 client.26065 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:22.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.714+0000 7f6c04ab9740 1 -- 172.21.15.50:0/1361399943 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5631775948e0 con 0x563177506c70 2024-09-10T10:14:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.714+0000 7f6be8c00640 1 -- 172.21.15.50:0/1361399943 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bec003ad0 con 0x563177506c70 2024-09-10T10:14:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.715+0000 7f6be8c00640 1 -- 172.21.15.50:0/1361399943 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f6bec060440 con 0x563177506c70 2024-09-10T10:14:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.715+0000 7f6c04ab9740 10 client.26065 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.715+0000 7f6c04ab9740 10 client.26065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:14:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.715+0000 7f6c04ab9740 20 client.26065 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.715+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/1361399943 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563177594fb0 0x5631775973d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.715+0000 7f6c04ab9740 4 client.26065 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:14:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.715+0000 7f6c04ab9740 1 -- 172.21.15.50:0/1361399943 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563177474e60 con 0x563177594fb0 2024-09-10T10:14:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.716+0000 7f6bf2a00640 1 --2- 172.21.15.50:0/1361399943 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563177594fb0 0x5631775973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:22.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.717+0000 7f6bf2a00640 1 --2- 172.21.15.50:0/1361399943 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563177594fb0 0x5631775973d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e298d101b33afde server_cookie=c26f491926964428 in_seq=0 out_seq=0 2024-09-10T10:14:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.717+0000 7f6be8c00640 10 client.26065 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.717+0000 7f6be8c00640 1 -- 172.21.15.50:0/1361399943 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563177474e60 con 0x563177594fb0 2024-09-10T10:14:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.717+0000 7f6be8c00640 10 client.26065 handle_command_reply: tid=0 2024-09-10T10:14:22.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.717+0000 7f6c04ab9740 1 client.26065 shutdown 2024-09-10T10:14:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.718+0000 7f6c04ab9740 1 -- 172.21.15.50:0/1361399943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177506c70 msgr2=0x56317752cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.718+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/1361399943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177506c70 0x56317752cc70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0092a0 tx=0x7f6bec02aa90 comp rx=0 tx=0).stop 2024-09-10T10:14:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.718+0000 7f6c04ab9740 1 -- 172.21.15.50:0/1361399943 shutdown_connections 2024-09-10T10:14:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.718+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/1361399943 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563177594fb0 0x5631775973d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.718+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/1361399943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56317751a740 0x56317752f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.718+0000 7f6be8c00640 0 client.26065 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.718+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/1361399943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563177507590 0x56317752d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.718+0000 7f6c04ab9740 1 --2- 172.21.15.50:0/1361399943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563177506c70 0x56317752cc70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.718+0000 7f6c04ab9740 1 -- 172.21.15.50:0/1361399943 >> 172.21.15.50:0/1361399943 conn(0x5631775032e0 msgr2=0x563177525f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.718+0000 7f6c04ab9740 1 -- 172.21.15.50:0/1361399943 shutdown_connections 2024-09-10T10:14:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.718+0000 7f6c04ab9740 1 -- 172.21.15.50:0/1361399943 wait complete. 2024-09-10T10:14:22.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.718+0000 7f6c04ab9740 20 client.26065 trim_cache size 0 max 16384 2024-09-10T10:14:22.721 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:14:22.721 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T10:14:22.721 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-10T10:14:22.721 INFO:teuthology.orchestra.run.smithi050.stdout: "76fc81ec-5a45-46f6-b49d-7e4b22b119bb": { 2024-09-10T10:14:22.721 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-10T10:14:22.721 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "76fc81ec-5a45-46f6-b49d-7e4b22b119bb", 2024-09-10T10:14:22.721 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2024-09-10T10:14:22.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:14:22.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:14:22.721 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:14:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.719+0000 7f6c00a00640 1 -- 172.21.15.50:0/1949308220 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6be00a2c00 msgr2=0x7f6be00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.719+0000 7f6c00a00640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6be00a2c00 0x7f6be00a50c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4012940 tx=0x7f6bf4009500 comp rx=0 tx=0).stop 2024-09-10T10:14:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.719+0000 7f6c00a00640 1 -- 172.21.15.50:0/1949308220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bfc1047e0 msgr2=0x7f6bfc19a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.719+0000 7f6c00a00640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bfc1047e0 0x7f6bfc19a9b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6be400e9f0 tx=0x7f6be400eeb0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.719+0000 7f6c00a00640 1 -- 172.21.15.50:0/1949308220 shutdown_connections 2024-09-10T10:14:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.719+0000 7f6c00a00640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6be00a2c00 0x7f6be00a50c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.719+0000 7f6c00a00640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bfc108f60 0x7f6bfc19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.719+0000 7f6c00a00640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bfc1047e0 0x7f6bfc19a9b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.719+0000 7f6c00a00640 1 --2- 172.21.15.50:0/1949308220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bfc103e30 0x7f6bfc19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:22.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.719+0000 7f6c00a00640 1 -- 172.21.15.50:0/1949308220 >> 172.21.15.50:0/1949308220 conn(0x7f6bfc0ff910 msgr2=0x7f6bfc100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:22.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.723+0000 7f6c00a00640 1 -- 172.21.15.50:0/1949308220 shutdown_connections 2024-09-10T10:14:22.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:22.723+0000 7f6c00a00640 1 -- 172.21.15.50:0/1949308220 wait complete. 2024-09-10T10:14:24.261 INFO:tasks.cephfs.filesystem:scrub status for tag:76fc81ec-5a45-46f6-b49d-7e4b22b119bb - {'path': '/', 'tag': '76fc81ec-5a45-46f6-b49d-7e4b22b119bb', 'options': 'recursive,force'} 2024-09-10T10:14:24.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:24 smithi189 ceph-mon[34999]: pgmap v487: 129 pgs: 129 active+clean; 3.4 GiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 77 op/s 2024-09-10T10:14:24.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:24 smithi189 ceph-mon[34999]: scrub summary: idle 2024-09-10T10:14:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:24 smithi084 ceph-mon[34812]: pgmap v487: 129 pgs: 129 active+clean; 3.4 GiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 77 op/s 2024-09-10T10:14:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:24 smithi084 ceph-mon[34812]: scrub summary: idle 2024-09-10T10:14:24.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:24 smithi050 ceph-mon[30354]: pgmap v487: 129 pgs: 129 active+clean; 3.4 GiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 266 MiB/s wr, 77 op/s 2024-09-10T10:14:24.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:24 smithi050 ceph-mon[30354]: scrub summary: idle 2024-09-10T10:14:26.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:26 smithi189 ceph-mon[34999]: pgmap v488: 129 pgs: 129 active+clean; 4.0 GiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 277 MiB/s wr, 77 op/s 2024-09-10T10:14:26.348 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:26 smithi084 ceph-mon[34812]: pgmap v488: 129 pgs: 129 active+clean; 4.0 GiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 277 MiB/s wr, 77 op/s 2024-09-10T10:14:26.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:26 smithi050 ceph-mon[30354]: pgmap v488: 129 pgs: 129 active+clean; 4.0 GiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 277 MiB/s wr, 77 op/s 2024-09-10T10:14:28.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:28 smithi189 ceph-mon[34999]: pgmap v489: 129 pgs: 129 active+clean; 4.4 GiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 269 MiB/s wr, 78 op/s 2024-09-10T10:14:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:28 smithi084 ceph-mon[34812]: pgmap v489: 129 pgs: 129 active+clean; 4.4 GiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 269 MiB/s wr, 78 op/s 2024-09-10T10:14:28.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:28 smithi050 ceph-mon[30354]: pgmap v489: 129 pgs: 129 active+clean; 4.4 GiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 269 MiB/s wr, 78 op/s 2024-09-10T10:14:30.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:30 smithi189 ceph-mon[34999]: pgmap v490: 129 pgs: 129 active+clean; 5.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 289 MiB/s wr, 81 op/s 2024-09-10T10:14:30.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:30 smithi084 ceph-mon[34812]: pgmap v490: 129 pgs: 129 active+clean; 5.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 289 MiB/s wr, 81 op/s 2024-09-10T10:14:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:30 smithi050 ceph-mon[30354]: pgmap v490: 129 pgs: 129 active+clean; 5.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 289 MiB/s wr, 81 op/s 2024-09-10T10:14:32.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:32 smithi189 ceph-mon[34999]: pgmap v491: 129 pgs: 129 active+clean; 5.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 290 MiB/s wr, 80 op/s 2024-09-10T10:14:32.348 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:32 smithi084 ceph-mon[34812]: pgmap v491: 129 pgs: 129 active+clean; 5.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 290 MiB/s wr, 80 op/s 2024-09-10T10:14:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:32 smithi050 ceph-mon[30354]: pgmap v491: 129 pgs: 129 active+clean; 5.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 290 MiB/s wr, 80 op/s 2024-09-10T10:14:34.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:34 smithi189 ceph-mon[34999]: pgmap v492: 129 pgs: 129 active+clean; 6.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 283 MiB/s wr, 81 op/s 2024-09-10T10:14:34.348 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:34 smithi084 ceph-mon[34812]: pgmap v492: 129 pgs: 129 active+clean; 6.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 283 MiB/s wr, 81 op/s 2024-09-10T10:14:34.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:34 smithi050 ceph-mon[30354]: pgmap v492: 129 pgs: 129 active+clean; 6.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 283 MiB/s wr, 81 op/s 2024-09-10T10:14:36.295 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:36 smithi050 ceph-mon[30354]: pgmap v493: 129 pgs: 129 active+clean; 6.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 297 MiB/s wr, 81 op/s 2024-09-10T10:14:36.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:36 smithi189 ceph-mon[34999]: pgmap v493: 129 pgs: 129 active+clean; 6.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 297 MiB/s wr, 81 op/s 2024-09-10T10:14:36.348 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:36 smithi084 ceph-mon[34812]: pgmap v493: 129 pgs: 129 active+clean; 6.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 297 MiB/s wr, 81 op/s 2024-09-10T10:14:38.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:38 smithi189 ceph-mon[34999]: pgmap v494: 129 pgs: 129 active+clean; 7.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 292 MiB/s wr, 81 op/s 2024-09-10T10:14:38.348 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:38 smithi084 ceph-mon[34812]: pgmap v494: 129 pgs: 129 active+clean; 7.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 292 MiB/s wr, 81 op/s 2024-09-10T10:14:38.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:38 smithi050 ceph-mon[30354]: pgmap v494: 129 pgs: 129 active+clean; 7.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 292 MiB/s wr, 81 op/s 2024-09-10T10:14:40.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:40 smithi189 ceph-mon[34999]: pgmap v495: 129 pgs: 129 active+clean; 8.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 325 MiB/s wr, 87 op/s 2024-09-10T10:14:40.348 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:40 smithi084 ceph-mon[34812]: pgmap v495: 129 pgs: 129 active+clean; 8.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 325 MiB/s wr, 87 op/s 2024-09-10T10:14:40.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:40 smithi050 ceph-mon[30354]: pgmap v495: 129 pgs: 129 active+clean; 8.2 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 325 MiB/s wr, 87 op/s 2024-09-10T10:14:42.334 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:14:42.334 INFO:tasks.workunit.client.0.smithi050.stdout: Children see throughput for 1 initial writers = 275013.28 kB/sec 2024-09-10T10:14:42.334 INFO:tasks.workunit.client.0.smithi050.stdout: Parent sees throughput for 1 initial writers = 275007.65 kB/sec 2024-09-10T10:14:42.334 INFO:tasks.workunit.client.0.smithi050.stdout: Min throughput per process = 275013.28 kB/sec 2024-09-10T10:14:42.334 INFO:tasks.workunit.client.0.smithi050.stdout: Max throughput per process = 275013.28 kB/sec 2024-09-10T10:14:42.334 INFO:tasks.workunit.client.0.smithi050.stdout: Avg throughput per process = 275013.28 kB/sec 2024-09-10T10:14:42.334 INFO:tasks.workunit.client.0.smithi050.stdout: Min xfer = 10485760.00 kB 2024-09-10T10:14:42.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:42 smithi189 ceph-mon[34999]: pgmap v496: 129 pgs: 129 active+clean; 8.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 319 MiB/s wr, 85 op/s 2024-09-10T10:14:42.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:42 smithi084 ceph-mon[34812]: pgmap v496: 129 pgs: 129 active+clean; 8.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 319 MiB/s wr, 85 op/s 2024-09-10T10:14:42.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:42 smithi050 ceph-mon[30354]: pgmap v496: 129 pgs: 129 active+clean; 8.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 319 MiB/s wr, 85 op/s 2024-09-10T10:14:44.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:44 smithi189 ceph-mon[34999]: pgmap v497: 129 pgs: 129 active+clean; 9.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 299 MiB/s wr, 82 op/s 2024-09-10T10:14:44.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:44 smithi084 ceph-mon[34812]: pgmap v497: 129 pgs: 129 active+clean; 9.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 299 MiB/s wr, 82 op/s 2024-09-10T10:14:44.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:44 smithi050 ceph-mon[30354]: pgmap v497: 129 pgs: 129 active+clean; 9.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 299 MiB/s wr, 82 op/s 2024-09-10T10:14:45.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:45 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:14:45.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:45 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:14:45.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:45 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:14:46.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:46 smithi189 ceph-mon[34999]: pgmap v498: 129 pgs: 129 active+clean; 9.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 298 MiB/s wr, 79 op/s 2024-09-10T10:14:46.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:14:46.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:14:46.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:14:46.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:46 smithi084 ceph-mon[34812]: pgmap v498: 129 pgs: 129 active+clean; 9.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 298 MiB/s wr, 79 op/s 2024-09-10T10:14:46.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:14:46.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:14:46.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:14:46.467 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:46 smithi050 ceph-mon[30354]: pgmap v498: 129 pgs: 129 active+clean; 9.8 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 298 MiB/s wr, 79 op/s 2024-09-10T10:14:46.467 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:14:46.467 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:14:46.468 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:14:48.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:48 smithi189 ceph-mon[34999]: pgmap v499: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 262 MiB/s wr, 72 op/s 2024-09-10T10:14:48.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:48 smithi084 ceph-mon[34812]: pgmap v499: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 262 MiB/s wr, 72 op/s 2024-09-10T10:14:48.470 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:48 smithi050 ceph-mon[30354]: pgmap v499: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 262 MiB/s wr, 72 op/s 2024-09-10T10:14:50.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:50 smithi189 ceph-mon[34999]: pgmap v500: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 246 MiB/s wr, 67 op/s 2024-09-10T10:14:50.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:50 smithi084 ceph-mon[34812]: pgmap v500: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 246 MiB/s wr, 67 op/s 2024-09-10T10:14:50.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:50 smithi050 ceph-mon[30354]: pgmap v500: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 246 MiB/s wr, 67 op/s 2024-09-10T10:14:52.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:52 smithi084 ceph-mon[34812]: pgmap v501: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 215 MiB/s wr, 59 op/s 2024-09-10T10:14:52.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:52 smithi050 ceph-mon[30354]: pgmap v501: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 215 MiB/s wr, 59 op/s 2024-09-10T10:14:52.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:52 smithi189 ceph-mon[34999]: pgmap v501: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 215 MiB/s wr, 59 op/s 2024-09-10T10:14:54.262 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:14:54.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:54 smithi084 ceph-mon[34812]: pgmap v502: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 199 MiB/s wr, 58 op/s 2024-09-10T10:14:54.352 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:54 smithi050 ceph-mon[30354]: pgmap v502: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 199 MiB/s wr, 58 op/s 2024-09-10T10:14:54.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:54 smithi189 ceph-mon[34999]: pgmap v502: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 199 MiB/s wr, 58 op/s 2024-09-10T10:14:54.888 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:14:55.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.876+0000 7fee9a800640 1 -- 172.21.15.50:0/2950418909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee941008d0 msgr2=0x7fee94100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:55.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.876+0000 7fee9a800640 1 --2- 172.21.15.50:0/2950418909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee941008d0 0x7fee94100d30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fee80009900 tx=0x7fee8002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.876+0000 7fee9a800640 1 -- 172.21.15.50:0/2950418909 shutdown_connections 2024-09-10T10:14:55.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.876+0000 7fee9a800640 1 --2- 172.21.15.50:0/2950418909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee94101270 0x7fee9410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.876+0000 7fee9a800640 1 --2- 172.21.15.50:0/2950418909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee941008d0 0x7fee94100d30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.876+0000 7fee9a800640 1 --2- 172.21.15.50:0/2950418909 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee941068d0 0x7fee94106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.876+0000 7fee9a800640 1 -- 172.21.15.50:0/2950418909 >> 172.21.15.50:0/2950418909 conn(0x7fee940fc610 msgr2=0x7fee940fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:55.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.877+0000 7fee9a800640 1 -- 172.21.15.50:0/2950418909 shutdown_connections 2024-09-10T10:14:55.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.877+0000 7fee9a800640 1 -- 172.21.15.50:0/2950418909 wait complete. 2024-09-10T10:14:55.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.878+0000 7fee9a800640 1 Processor -- start 2024-09-10T10:14:55.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.878+0000 7fee9a800640 1 -- start start 2024-09-10T10:14:55.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.879+0000 7fee9a800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee941008d0 0x7fee9419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.879+0000 7fee9a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee94101270 0x7fee9419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.879+0000 7fee9a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee941068d0 0x7fee9419ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.879+0000 7fee9a800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fee94110d20 con 0x7fee94101270 2024-09-10T10:14:55.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.879+0000 7fee9a800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fee94110ba0 con 0x7fee941068d0 2024-09-10T10:14:55.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.879+0000 7fee9a800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fee94110ea0 con 0x7fee941008d0 2024-09-10T10:14:55.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.879+0000 7fee99e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee941068d0 0x7fee9419ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.880+0000 7fee99e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee941068d0 0x7fee9419ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37764/0 (socket says 172.21.15.50:37764) 2024-09-10T10:14:55.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.880+0000 7fee99e00640 1 -- 172.21.15.50:0/2315948279 learned_addr learned my addr 172.21.15.50:0/2315948279 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:55.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.880+0000 7fee99400640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee941008d0 0x7fee9419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.880+0000 7fee98a00640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee94101270 0x7fee9419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.880+0000 7fee99e00640 1 -- 172.21.15.50:0/2315948279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee941008d0 msgr2=0x7fee9419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:55.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.880+0000 7fee99e00640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee941008d0 0x7fee9419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.880+0000 7fee99e00640 1 -- 172.21.15.50:0/2315948279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee94101270 msgr2=0x7fee9419a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:55.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.880+0000 7fee99e00640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee94101270 0x7fee9419a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.881+0000 7fee99e00640 1 -- 172.21.15.50:0/2315948279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee9419f3a0 con 0x7fee941068d0 2024-09-10T10:14:55.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.881+0000 7fee99e00640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee941068d0 0x7fee9419ecc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00eb10 tx=0x7fee8c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:55.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.881+0000 7fee92000640 1 -- 172.21.15.50:0/2315948279 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c004b20 con 0x7fee941068d0 2024-09-10T10:14:55.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.882+0000 7fee92000640 1 -- 172.21.15.50:0/2315948279 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee8c004cc0 con 0x7fee941068d0 2024-09-10T10:14:55.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.882+0000 7fee92000640 1 -- 172.21.15.50:0/2315948279 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c010760 con 0x7fee941068d0 2024-09-10T10:14:55.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.882+0000 7fee9a800640 1 -- 172.21.15.50:0/2315948279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee9419f690 con 0x7fee941068d0 2024-09-10T10:14:55.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.882+0000 7fee9a800640 1 -- 172.21.15.50:0/2315948279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee94107750 con 0x7fee941068d0 2024-09-10T10:14:55.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.887+0000 7fee92000640 1 -- 172.21.15.50:0/2315948279 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fee8c010900 con 0x7fee941068d0 2024-09-10T10:14:55.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.888+0000 7fee9e9f1740 1 Processor -- start 2024-09-10T10:14:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.888+0000 7fee9e9f1740 1 -- start start 2024-09-10T10:14:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.889+0000 7fee9e9f1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9b4d50 0x559d9e9b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.889+0000 7fee9e9f1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b5670 0x559d9e9bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.889+0000 7fee9e9f1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9bff30 0x559d9e9c2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.889+0000 7fee9e9f1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559d9e91b3e0 con 0x559d9e9b4d50 2024-09-10T10:14:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.889+0000 7fee9e9f1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559d9e8c2d80 con 0x559d9e9bff30 2024-09-10T10:14:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.889+0000 7fee9e9f1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559d9e9173a0 con 0x559d9e9b5670 2024-09-10T10:14:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.889+0000 7fee99400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b5670 0x559d9e9bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.889+0000 7fee99400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b5670 0x559d9e9bf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:36598/0 (socket says 172.21.15.50:36598) 2024-09-10T10:14:55.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.889+0000 7fee99400640 1 -- 172.21.15.50:0/710840573 learned_addr learned my addr 172.21.15.50:0/710840573 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.890+0000 7fee99400640 1 -- 172.21.15.50:0/710840573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9bff30 msgr2=0x559d9e9c2320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.890+0000 7fee99400640 1 --2- 172.21.15.50:0/710840573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9bff30 0x559d9e9c2320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.890+0000 7fee99400640 1 -- 172.21.15.50:0/710840573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9b4d50 msgr2=0x559d9e9b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.890+0000 7fee99400640 1 --2- 172.21.15.50:0/710840573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9b4d50 0x559d9e9b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.890+0000 7fee99400640 1 -- 172.21.15.50:0/710840573 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d9e8e1ae0 con 0x559d9e9b5670 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.890+0000 7fee92000640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fee7c0a2c80 0x7fee7c0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.890+0000 7fee92000640 1 -- 172.21.15.50:0/2315948279 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fee8c0d0be0 con 0x7fee941068d0 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.890+0000 7fee99400640 1 --2- 172.21.15.50:0/710840573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b5670 0x559d9e9bf9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fee8800cbe0 tx=0x7fee8800e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd1d96704e8bdd32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.891+0000 7fee86600640 1 -- 172.21.15.50:0/710840573 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88005220 con 0x559d9e9b5670 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.891+0000 7fee86600640 1 -- 172.21.15.50:0/710840573 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee88004c80 con 0x559d9e9b5670 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.891+0000 7fee86600640 1 -- 172.21.15.50:0/710840573 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88010850 con 0x559d9e9b5670 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.891+0000 7fee98a00640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fee7c0a2c80 0x7fee7c0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.892+0000 7fee9e9f1740 1 -- 172.21.15.50:0/710840573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b5670 msgr2=0x559d9e9bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:55.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.892+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/710840573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b5670 0x559d9e9bf9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fee8800cbe0 tx=0x7fee8800e720 comp rx=0 tx=0).stop 2024-09-10T10:14:55.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.894+0000 7fee98a00640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fee7c0a2c80 0x7fee7c0a5140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fee80000c00 tx=0x7fee80031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:55.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.894+0000 7fee9e9f1740 1 -- 172.21.15.50:0/710840573 shutdown_connections 2024-09-10T10:14:55.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.894+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/710840573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9bff30 0x559d9e9c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.894+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/710840573 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b5670 0x559d9e9bf9f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.894+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/710840573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9b4d50 0x559d9e9b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.894+0000 7fee9e9f1740 1 -- 172.21.15.50:0/710840573 >> 172.21.15.50:0/710840573 conn(0x559d9e9b12e0 msgr2=0x559d9e9b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:55.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.895+0000 7fee9e9f1740 1 -- 172.21.15.50:0/710840573 shutdown_connections 2024-09-10T10:14:55.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.895+0000 7fee9e9f1740 1 -- 172.21.15.50:0/710840573 wait complete. 2024-09-10T10:14:55.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.896+0000 7fee9e9f1740 1 -- start start 2024-09-10T10:14:55.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.896+0000 7fee9e9f1740 1 Processor -- start 2024-09-10T10:14:55.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.897+0000 7fee9e9f1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b4d50 0x559d9e9bcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.897+0000 7fee9e9f1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b5670 0x559d9e9bd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.897+0000 7fee9e9f1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 0x559d9e9bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.897+0000 7fee9e9f1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559d9e9c2b40 con 0x559d9e9bff30 2024-09-10T10:14:55.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.897+0000 7fee9e9f1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559d9e8d60f0 con 0x559d9e9b5670 2024-09-10T10:14:55.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.897+0000 7fee9e9f1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559d9e9c2cc0 con 0x559d9e9b4d50 2024-09-10T10:14:55.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.898+0000 7fee9e9f1740 10 client.0 _ll_register_callbacks cb 0x559d9e8c79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:55.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.898+0000 7fee98a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b5670 0x559d9e9bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.898+0000 7fee98a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b5670 0x559d9e9bd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37776/0 (socket says 172.21.15.50:37776) 2024-09-10T10:14:55.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.898+0000 7fee98a00640 1 -- 172.21.15.50:0/2937967760 learned_addr learned my addr 172.21.15.50:0/2937967760 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:55.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.900+0000 7fee99400640 1 --2- 172.21.15.50:0/2937967760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b4d50 0x559d9e9bcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.900+0000 7fee98a00640 1 -- 172.21.15.50:0/2937967760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b4d50 msgr2=0x559d9e9bcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:55.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.900+0000 7fee98a00640 1 --2- 172.21.15.50:0/2937967760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b4d50 0x559d9e9bcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.900+0000 7fee98a00640 1 -- 172.21.15.50:0/2937967760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 msgr2=0x559d9e9bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:55.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.900+0000 7fee98a00640 1 --2- 172.21.15.50:0/2937967760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 0x559d9e9bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.900+0000 7fee98a00640 1 -- 172.21.15.50:0/2937967760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d9e68c3c0 con 0x559d9e9b5670 2024-09-10T10:14:55.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.902+0000 7fee98a00640 1 --2- 172.21.15.50:0/2937967760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b5670 0x559d9e9bd310 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fee80005ab0 tx=0x7fee8002a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27b41466207ec382 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.902+0000 7fee7aa00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:14:55.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.903+0000 7fee7aa00640 1 -- 172.21.15.50:0/2937967760 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8004c020 con 0x559d9e9b5670 2024-09-10T10:14:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.903+0000 7fee7aa00640 1 -- 172.21.15.50:0/2937967760 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fee80004b90 con 0x559d9e9b5670 2024-09-10T10:14:55.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.903+0000 7fee9e9f1740 1 -- 172.21.15.50:0/2937967760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee88004c80 con 0x559d9e9b5670 2024-09-10T10:14:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.904+0000 7fee7aa00640 1 -- 172.21.15.50:0/2937967760 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee80035050 con 0x559d9e9b5670 2024-09-10T10:14:55.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.905+0000 7fee9e9f1740 10 client.26081 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:55.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.905+0000 7fee9e9f1740 1 -- 172.21.15.50:0/2937967760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559d9e9ce830 con 0x559d9e9b5670 2024-09-10T10:14:55.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.906+0000 7fee7aa00640 1 -- 172.21.15.50:0/2937967760 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee88004c80 con 0x559d9e9b5670 2024-09-10T10:14:55.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.907+0000 7fee7aa00640 1 -- 172.21.15.50:0/2937967760 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fee80032730 con 0x559d9e9b5670 2024-09-10T10:14:55.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.907+0000 7fee9e9f1740 10 client.26081 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:55.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.907+0000 7fee9e9f1740 10 client.26081 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:14:55.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.907+0000 7fee9e9f1740 20 client.26081 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:55.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.907+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/2937967760 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559d9e9cfc40 0x559d9e9d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.907+0000 7fee9e9f1740 4 client.26081 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:14:55.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.907+0000 7fee9e9f1740 1 -- 172.21.15.50:0/2937967760 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d9e928950 con 0x559d9e9cfc40 2024-09-10T10:14:55.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.910+0000 7fee99400640 1 --2- 172.21.15.50:0/2937967760 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559d9e9cfc40 0x559d9e9d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.912+0000 7fee7aa00640 10 client.26081 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:55.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.912+0000 7fee99400640 1 --2- 172.21.15.50:0/2937967760 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559d9e9cfc40 0x559d9e9d20e0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb57df409ea79926 server_cookie=acd19aea36df4419 in_seq=0 out_seq=0 2024-09-10T10:14:55.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.913+0000 7fee7aa00640 1 -- 172.21.15.50:0/2937967760 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d9e928950 con 0x559d9e9cfc40 2024-09-10T10:14:55.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.913+0000 7fee7aa00640 10 client.26081 handle_command_reply: tid=0 2024-09-10T10:14:55.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.914+0000 7fee9e9f1740 1 client.26081 shutdown 2024-09-10T10:14:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.922+0000 7fee9e9f1740 1 -- 172.21.15.50:0/2937967760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b5670 msgr2=0x559d9e9bd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:55.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.922+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/2937967760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b5670 0x559d9e9bd310 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fee80005ab0 tx=0x7fee8002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.923+0000 7fee9e9f1740 1 -- 172.21.15.50:0/2937967760 shutdown_connections 2024-09-10T10:14:55.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.924+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/2937967760 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559d9e9cfc40 0x559d9e9d20e0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.924+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/2937967760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 0x559d9e9bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.924+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/2937967760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b5670 0x559d9e9bd310 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.924+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/2937967760 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b4d50 0x559d9e9bcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.924+0000 7fee9e9f1740 1 -- 172.21.15.50:0/2937967760 >> 172.21.15.50:0/2937967760 conn(0x559d9e9b12e0 msgr2=0x559d9e9b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:55.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.925+0000 7fee7aa00640 0 client.26081 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:55.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.925+0000 7fee9e9f1740 1 -- 172.21.15.50:0/2937967760 shutdown_connections 2024-09-10T10:14:55.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.926+0000 7fee9e9f1740 1 -- 172.21.15.50:0/2937967760 wait complete. 2024-09-10T10:14:55.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.926+0000 7fee9e9f1740 20 client.26081 trim_cache size 0 max 16384 2024-09-10T10:14:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.958+0000 7fee9e9f1740 1 Processor -- start 2024-09-10T10:14:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.959+0000 7fee9e9f1740 1 -- start start 2024-09-10T10:14:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.959+0000 7fee9e9f1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b4d50 0x559d9e9d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.959+0000 7fee9e9f1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b5670 0x559d9e9d8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.959+0000 7fee9e9f1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 0x559d9e9d8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.960+0000 7fee99400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b4d50 0x559d9e9d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.960+0000 7fee99400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b4d50 0x559d9e9d3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:36622/0 (socket says 172.21.15.50:36622) 2024-09-10T10:14:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.960+0000 7fee98a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b5670 0x559d9e9d8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.960+0000 7fee98a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b5670 0x559d9e9d8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37782/0 (socket says 172.21.15.50:37782) 2024-09-10T10:14:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.960+0000 7fee9e9f1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fee94073fe0 con 0x559d9e9bff30 2024-09-10T10:14:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.960+0000 7fee9e9f1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fee940718b0 con 0x559d9e9b5670 2024-09-10T10:14:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.960+0000 7fee9e9f1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fee9406f760 con 0x559d9e9b4d50 2024-09-10T10:14:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.960+0000 7fee99e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 0x559d9e9d8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.960+0000 7fee99e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 0x559d9e9d8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60432/0 (socket says 172.21.15.50:60432) 2024-09-10T10:14:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.960+0000 7fee99e00640 1 -- 172.21.15.50:0/3493105693 learned_addr learned my addr 172.21.15.50:0/3493105693 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.961+0000 7fee99400640 1 -- 172.21.15.50:0/3493105693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b5670 msgr2=0x559d9e9d8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.961+0000 7fee99400640 1 --2- 172.21.15.50:0/3493105693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b5670 0x559d9e9d8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.961+0000 7fee99400640 1 -- 172.21.15.50:0/3493105693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 msgr2=0x559d9e9d8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.961+0000 7fee99400640 1 --2- 172.21.15.50:0/3493105693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 0x559d9e9d8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.961+0000 7fee99400640 1 -- 172.21.15.50:0/3493105693 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d9e9b7ba0 con 0x559d9e9b4d50 2024-09-10T10:14:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.962+0000 7fee99400640 1 --2- 172.21.15.50:0/3493105693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b4d50 0x559d9e9d3090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fee8800ec20 tx=0x7fee8800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e16a710d20a20e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:55.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.962+0000 7fee85c00640 1 -- 172.21.15.50:0/3493105693 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8802d070 con 0x559d9e9b4d50 2024-09-10T10:14:55.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.963+0000 7fee85c00640 1 -- 172.21.15.50:0/3493105693 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee880056d0 con 0x559d9e9b4d50 2024-09-10T10:14:55.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.963+0000 7fee85c00640 1 -- 172.21.15.50:0/3493105693 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8802d070 con 0x559d9e9b4d50 2024-09-10T10:14:55.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.964+0000 7fee9e9f1740 1 -- 172.21.15.50:0/3493105693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b4d50 msgr2=0x559d9e9d3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:55.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.964+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/3493105693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b4d50 0x559d9e9d3090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fee8800ec20 tx=0x7fee8800c8a0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.965+0000 7fee9e9f1740 1 -- 172.21.15.50:0/3493105693 shutdown_connections 2024-09-10T10:14:55.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.965+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/3493105693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 0x559d9e9d8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.965+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/3493105693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b5670 0x559d9e9d8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.965+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/3493105693 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b4d50 0x559d9e9d3090 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.965+0000 7fee9e9f1740 1 -- 172.21.15.50:0/3493105693 >> 172.21.15.50:0/3493105693 conn(0x559d9e9b12e0 msgr2=0x559d9e9d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:55.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.966+0000 7fee9e9f1740 1 -- 172.21.15.50:0/3493105693 shutdown_connections 2024-09-10T10:14:55.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.966+0000 7fee9e9f1740 1 -- 172.21.15.50:0/3493105693 wait complete. 2024-09-10T10:14:55.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.967+0000 7fee9e9f1740 1 -- start start 2024-09-10T10:14:55.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.968+0000 7fee9e9f1740 1 Processor -- start 2024-09-10T10:14:55.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.968+0000 7fee9e9f1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b4d50 0x559d9e9ba870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.968+0000 7fee9e9f1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b5670 0x559d9e9c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.968+0000 7fee9e9f1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 0x559d9e9c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.968+0000 7fee9e9f1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fee9406fdb0 con 0x559d9e9bff30 2024-09-10T10:14:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.968+0000 7fee9e9f1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fee940711e0 con 0x559d9e9b4d50 2024-09-10T10:14:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.968+0000 7fee9e9f1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fee94070440 con 0x559d9e9b5670 2024-09-10T10:14:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.968+0000 7fee9e9f1740 10 client.0 _ll_register_callbacks cb 0x7fee80009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:14:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.969+0000 7fee98a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b5670 0x559d9e9c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.969+0000 7fee98a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b5670 0x559d9e9c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:36634/0 (socket says 172.21.15.50:36634) 2024-09-10T10:14:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.969+0000 7fee98a00640 1 -- 172.21.15.50:0/3272883396 learned_addr learned my addr 172.21.15.50:0/3272883396 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.969+0000 7fee99400640 1 --2- 172.21.15.50:0/3272883396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b4d50 0x559d9e9ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.970+0000 7fee99400640 1 -- 172.21.15.50:0/3272883396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b5670 msgr2=0x559d9e9c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:14:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.970+0000 7fee99400640 1 --2- 172.21.15.50:0/3272883396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b5670 0x559d9e9c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.970+0000 7fee99400640 1 -- 172.21.15.50:0/3272883396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 msgr2=0x559d9e9c84a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:14:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.970+0000 7fee99400640 1 --2- 172.21.15.50:0/3272883396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 0x559d9e9c84a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.970+0000 7fee99400640 1 -- 172.21.15.50:0/3272883396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d9e9c8b40 con 0x559d9e9b4d50 2024-09-10T10:14:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.971+0000 7fee99400640 1 --2- 172.21.15.50:0/3272883396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b4d50 0x559d9e9ba870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee88000c00 tx=0x7fee8800c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d3c7274620c1969 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:55.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.971+0000 7fee7aa00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:14:55.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.972+0000 7fee7aa00640 1 -- 172.21.15.50:0/3272883396 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8802d070 con 0x559d9e9b4d50 2024-09-10T10:14:55.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.972+0000 7fee9e9f1740 1 -- 172.21.15.50:0/3272883396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee880056d0 con 0x559d9e9b4d50 2024-09-10T10:14:55.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.972+0000 7fee7aa00640 1 -- 172.21.15.50:0/3272883396 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fee88004f10 con 0x559d9e9b4d50 2024-09-10T10:14:55.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.973+0000 7fee7aa00640 1 -- 172.21.15.50:0/3272883396 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee8800c6f0 con 0x559d9e9b4d50 2024-09-10T10:14:55.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.973+0000 7fee9e9f1740 10 client.26087 fetch_fsmap learned FSMap version 25 2024-09-10T10:14:55.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.973+0000 7fee9e9f1740 1 -- 172.21.15.50:0/3272883396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559d9ea3a930 con 0x559d9e9b4d50 2024-09-10T10:14:55.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.973+0000 7fee7aa00640 1 -- 172.21.15.50:0/3272883396 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee880056d0 con 0x559d9e9b4d50 2024-09-10T10:14:55.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.974+0000 7fee7aa00640 1 -- 172.21.15.50:0/3272883396 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fee880104a0 con 0x559d9e9b4d50 2024-09-10T10:14:55.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.974+0000 7fee9e9f1740 10 client.26087 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:14:55.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.974+0000 7fee9e9f1740 10 client.26087 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:14:55.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.974+0000 7fee9e9f1740 20 client.26087 populate_metadata read hostname 'smithi050' 2024-09-10T10:14:55.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.974+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/3272883396 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559d9ea3ae00 0x559d9ea3d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:55.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.974+0000 7fee9e9f1740 4 client.26087 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:14:55.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.974+0000 7fee9e9f1740 1 -- 172.21.15.50:0/3272883396 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559d9e922e60 con 0x559d9ea3ae00 2024-09-10T10:14:55.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.976+0000 7fee98a00640 1 --2- 172.21.15.50:0/3272883396 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559d9ea3ae00 0x559d9ea3d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:55.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.977+0000 7fee98a00640 1 --2- 172.21.15.50:0/3272883396 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559d9ea3ae00 0x559d9ea3d1f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19940a01a5ea4678 server_cookie=d47b6cf514724843 in_seq=0 out_seq=0 2024-09-10T10:14:55.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.977+0000 7fee7aa00640 10 client.26087 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:55.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.977+0000 7fee7aa00640 1 -- 172.21.15.50:0/3272883396 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559d9e922e60 con 0x559d9ea3ae00 2024-09-10T10:14:55.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.977+0000 7fee7aa00640 10 client.26087 handle_command_reply: tid=0 2024-09-10T10:14:55.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.977+0000 7fee9e9f1740 1 client.26087 shutdown 2024-09-10T10:14:55.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.980+0000 7fee9e9f1740 1 -- 172.21.15.50:0/3272883396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b4d50 msgr2=0x559d9e9ba870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:55.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.980+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/3272883396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b4d50 0x559d9e9ba870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee88000c00 tx=0x7fee8800c3b0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.980+0000 7fee9e9f1740 1 -- 172.21.15.50:0/3272883396 shutdown_connections 2024-09-10T10:14:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.980+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/3272883396 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559d9ea3ae00 0x559d9ea3d1f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.980+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/3272883396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d9e9bff30 0x559d9e9c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.980+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/3272883396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559d9e9b5670 0x559d9e9c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.980+0000 7fee9e9f1740 1 --2- 172.21.15.50:0/3272883396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559d9e9b4d50 0x559d9e9ba870 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.980+0000 7fee9e9f1740 1 -- 172.21.15.50:0/3272883396 >> 172.21.15.50:0/3272883396 conn(0x559d9e9b12e0 msgr2=0x559d9e9d2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.980+0000 7fee7aa00640 0 client.26087 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:14:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.981+0000 7fee9e9f1740 1 -- 172.21.15.50:0/3272883396 shutdown_connections 2024-09-10T10:14:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.981+0000 7fee9e9f1740 1 -- 172.21.15.50:0/3272883396 wait complete. 2024-09-10T10:14:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.981+0000 7fee9e9f1740 20 client.26087 trim_cache size 0 max 16384 2024-09-10T10:14:55.984 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:14:55.984 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-10T10:14:55.984 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-10T10:14:55.984 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:14:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.982+0000 7fee9a800640 1 -- 172.21.15.50:0/2315948279 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fee7c0a2c80 msgr2=0x7fee7c0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.982+0000 7fee9a800640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fee7c0a2c80 0x7fee7c0a5140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fee80000c00 tx=0x7fee80031400 comp rx=0 tx=0).stop 2024-09-10T10:14:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.982+0000 7fee9a800640 1 -- 172.21.15.50:0/2315948279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee941068d0 msgr2=0x7fee9419ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.982+0000 7fee9a800640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee941068d0 0x7fee9419ecc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00eb10 tx=0x7fee8c00c2d0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.982+0000 7fee9a800640 1 -- 172.21.15.50:0/2315948279 shutdown_connections 2024-09-10T10:14:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.982+0000 7fee9a800640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fee7c0a2c80 0x7fee7c0a5140 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.982+0000 7fee9a800640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee941068d0 0x7fee9419ecc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.982+0000 7fee9a800640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee94101270 0x7fee9419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.982+0000 7fee9a800640 1 --2- 172.21.15.50:0/2315948279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee941008d0 0x7fee9419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.982+0000 7fee9a800640 1 -- 172.21.15.50:0/2315948279 >> 172.21.15.50:0/2315948279 conn(0x7fee940fc610 msgr2=0x7fee94069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.983+0000 7fee9a800640 1 -- 172.21.15.50:0/2315948279 shutdown_connections 2024-09-10T10:14:55.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:55.983+0000 7fee9a800640 1 -- 172.21.15.50:0/2315948279 wait complete. 2024-09-10T10:14:56.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:56 smithi050 ceph-mon[30354]: pgmap v503: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 201 MiB/s wr, 56 op/s 2024-09-10T10:14:56.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:56 smithi189 ceph-mon[34999]: pgmap v503: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 201 MiB/s wr, 56 op/s 2024-09-10T10:14:56.598 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:56 smithi084 ceph-mon[34812]: pgmap v503: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 201 MiB/s wr, 56 op/s 2024-09-10T10:14:57.532 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T10:14:57.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:14:58.310 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:14:58.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:14:58 smithi050 ceph-mon[30354]: pgmap v504: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 201 MiB/s wr, 59 op/s 2024-09-10T10:14:58.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:14:58 smithi189 ceph-mon[34999]: pgmap v504: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 201 MiB/s wr, 59 op/s 2024-09-10T10:14:58.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:14:58 smithi084 ceph-mon[34812]: pgmap v504: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 201 MiB/s wr, 59 op/s 2024-09-10T10:14:59.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.598+0000 7f21f1e00640 1 -- 172.21.15.50:0/545526701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21ec112870 msgr2=0x7f21ec114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.598+0000 7f21f1e00640 1 --2- 172.21.15.50:0/545526701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21ec112870 0x7f21ec114c60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f21e4009ca0 tx=0x7f21e402a8e0 comp rx=0 tx=0).stop 2024-09-10T10:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.600+0000 7f21f1e00640 1 -- 172.21.15.50:0/545526701 shutdown_connections 2024-09-10T10:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.600+0000 7f21f1e00640 1 --2- 172.21.15.50:0/545526701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21ec112870 0x7f21ec114c60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.600+0000 7f21f1e00640 1 --2- 172.21.15.50:0/545526701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ec077040 0x7f21ec112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.600+0000 7f21f1e00640 1 --2- 172.21.15.50:0/545526701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21ec076720 0x7f21ec076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.600+0000 7f21f1e00640 1 -- 172.21.15.50:0/545526701 >> 172.21.15.50:0/545526701 conn(0x7f21ec0ff8f0 msgr2=0x7f21ec101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.600+0000 7f21f1e00640 1 -- 172.21.15.50:0/545526701 shutdown_connections 2024-09-10T10:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.600+0000 7f21f1e00640 1 -- 172.21.15.50:0/545526701 wait complete. 2024-09-10T10:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.601+0000 7f21f1e00640 1 Processor -- start 2024-09-10T10:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.601+0000 7f21f1e00640 1 -- start start 2024-09-10T10:14:59.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.602+0000 7f21f1e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21ec076720 0x7f21ec1a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:59.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.602+0000 7f21f1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21ec077040 0x7f21ec1a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:59.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.602+0000 7f21f1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ec112870 0x7f21ec19e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:59.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.602+0000 7f21f1e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f21ec1183b0 con 0x7f21ec112870 2024-09-10T10:14:59.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.602+0000 7f21f1e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f21ec118230 con 0x7f21ec077040 2024-09-10T10:14:59.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.602+0000 7f21f1e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f21ec118530 con 0x7f21ec076720 2024-09-10T10:14:59.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.602+0000 7f21eaa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21ec076720 0x7f21ec1a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:59.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.602+0000 7f21eaa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21ec076720 0x7f21ec1a4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:44970/0 (socket says 172.21.15.50:44970) 2024-09-10T10:14:59.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.602+0000 7f21eaa00640 1 -- 172.21.15.50:0/3925691898 learned_addr learned my addr 172.21.15.50:0/3925691898 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:14:59.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.603+0000 7f21ebe00640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ec112870 0x7f21ec19e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:59.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.603+0000 7f21eaa00640 1 -- 172.21.15.50:0/3925691898 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21ec077040 msgr2=0x7f21ec1a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.603+0000 7f21eaa00640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21ec077040 0x7f21ec1a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.603+0000 7f21eaa00640 1 -- 172.21.15.50:0/3925691898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ec112870 msgr2=0x7f21ec19e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:14:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.603+0000 7f21eaa00640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ec112870 0x7f21ec19e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:14:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.603+0000 7f21eaa00640 1 -- 172.21.15.50:0/3925691898 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ec19ef70 con 0x7f21ec076720 2024-09-10T10:14:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.603+0000 7f21ebe00640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ec112870 0x7f21ec19e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:14:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.604+0000 7f21eaa00640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21ec076720 0x7f21ec1a4630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f21d800d950 tx=0x7f21d800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:14:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.604+0000 7f21f0a00640 1 -- 172.21.15.50:0/3925691898 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d8017030 con 0x7f21ec076720 2024-09-10T10:14:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.604+0000 7f21f0a00640 1 -- 172.21.15.50:0/3925691898 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21d8004020 con 0x7f21ec076720 2024-09-10T10:14:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.604+0000 7f21f0a00640 1 -- 172.21.15.50:0/3925691898 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d80047a0 con 0x7f21ec076720 2024-09-10T10:14:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.605+0000 7f21f1e00640 1 -- 172.21.15.50:0/3925691898 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21ec19f260 con 0x7f21ec076720 2024-09-10T10:14:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.605+0000 7f21f1e00640 1 -- 172.21.15.50:0/3925691898 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ec1ab3e0 con 0x7f21ec076720 2024-09-10T10:14:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.607+0000 7f21f1e00640 1 -- 172.21.15.50:0/3925691898 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21ec077e60 con 0x7f21ec076720 2024-09-10T10:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.614+0000 7f21f0a00640 1 -- 172.21.15.50:0/3925691898 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f21d80041d0 con 0x7f21ec076720 2024-09-10T10:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.616+0000 7f21f0a00640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f21d00a2c00 0x7f21d00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.617+0000 7f21f0a00640 1 -- 172.21.15.50:0/3925691898 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f21d80cecf0 con 0x7f21ec076720 2024-09-10T10:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.617+0000 7f21f0a00640 1 -- 172.21.15.50:0/3925691898 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f21d8041070 con 0x7f21ec076720 2024-09-10T10:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.617+0000 7f21ea000640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f21d00a2c00 0x7f21d00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:14:59.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:14:59.620+0000 7f21ea000640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f21d00a2c00 0x7f21d00a50c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f21ec19ff50 tx=0x7f21dc009590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:00.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.177+0000 7f21f1e00640 1 -- 172.21.15.50:0/3925691898 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21ec076b00 con 0x7f21ec076720 2024-09-10T10:15:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.178+0000 7f21f0a00640 1 -- 172.21.15.50:0/3925691898 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f21d809b8e0 con 0x7f21ec076720 2024-09-10T10:15:00.180 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:15:00.180 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:15:00.181 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:15:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.184+0000 7f21f1e00640 1 -- 172.21.15.50:0/3925691898 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f21d00a2c00 msgr2=0x7f21d00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.184+0000 7f21f1e00640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f21d00a2c00 0x7f21d00a50c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f21ec19ff50 tx=0x7f21dc009590 comp rx=0 tx=0).stop 2024-09-10T10:15:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.184+0000 7f21f1e00640 1 -- 172.21.15.50:0/3925691898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21ec076720 msgr2=0x7f21ec1a4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.184+0000 7f21f1e00640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21ec076720 0x7f21ec1a4630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f21d800d950 tx=0x7f21d800de10 comp rx=0 tx=0).stop 2024-09-10T10:15:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.185+0000 7f21f1e00640 1 -- 172.21.15.50:0/3925691898 shutdown_connections 2024-09-10T10:15:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.185+0000 7f21f1e00640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f21d00a2c00 0x7f21d00a50c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.185+0000 7f21f1e00640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21ec112870 0x7f21ec19e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.185+0000 7f21f1e00640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21ec077040 0x7f21ec1a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.185+0000 7f21f1e00640 1 --2- 172.21.15.50:0/3925691898 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f21ec076720 0x7f21ec1a4630 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.185+0000 7f21f1e00640 1 -- 172.21.15.50:0/3925691898 >> 172.21.15.50:0/3925691898 conn(0x7f21ec0ff8f0 msgr2=0x7f21ec101ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.185+0000 7f21f1e00640 1 -- 172.21.15.50:0/3925691898 shutdown_connections 2024-09-10T10:15:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:00.185+0000 7f21f1e00640 1 -- 172.21.15.50:0/3925691898 wait complete. 2024-09-10T10:15:00.468 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:00 smithi050 ceph-mon[30354]: pgmap v505: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 249 MiB/s wr, 70 op/s 2024-09-10T10:15:00.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:00 smithi189 ceph-mon[34999]: pgmap v505: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 249 MiB/s wr, 70 op/s 2024-09-10T10:15:00.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:00 smithi084 ceph-mon[34812]: pgmap v505: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 249 MiB/s wr, 70 op/s 2024-09-10T10:15:01.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:01 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3925691898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:01.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:01 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3925691898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:01.598 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:01 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3925691898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:01.982 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T10:15:02.216 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:02 smithi050 ceph-mon[30354]: pgmap v506: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 277 MiB/s wr, 77 op/s 2024-09-10T10:15:02.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:02 smithi189 ceph-mon[34999]: pgmap v506: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 277 MiB/s wr, 77 op/s 2024-09-10T10:15:02.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:02 smithi084 ceph-mon[34812]: pgmap v506: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 277 MiB/s wr, 77 op/s 2024-09-10T10:15:02.663 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.046+0000 7f50c7200640 1 -- 172.21.15.50:0/2343804260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c8110190 msgr2=0x7f50c806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.046+0000 7f50c7200640 1 --2- 172.21.15.50:0/2343804260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c8110190 0x7f50c806e4f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009900 tx=0x7f50b802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.046+0000 7f50c7200640 1 -- 172.21.15.50:0/2343804260 shutdown_connections 2024-09-10T10:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.046+0000 7f50c7200640 1 --2- 172.21.15.50:0/2343804260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50c811b140 0x7f50c811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.046+0000 7f50c7200640 1 --2- 172.21.15.50:0/2343804260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c806ea30 0x7f50c806ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.046+0000 7f50c7200640 1 --2- 172.21.15.50:0/2343804260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c8110190 0x7f50c806e4f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.046+0000 7f50c7200640 1 -- 172.21.15.50:0/2343804260 >> 172.21.15.50:0/2343804260 conn(0x7f50c8073180 msgr2=0x7f50c8073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.046+0000 7f50c7200640 1 -- 172.21.15.50:0/2343804260 shutdown_connections 2024-09-10T10:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.047+0000 7f50c7200640 1 -- 172.21.15.50:0/2343804260 wait complete. 2024-09-10T10:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.048+0000 7f50c7200640 1 Processor -- start 2024-09-10T10:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.048+0000 7f50c7200640 1 -- start start 2024-09-10T10:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.049+0000 7f50c7200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50c806ea30 0x7f50c81a70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.049+0000 7f50c7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c8110190 0x7f50c81a7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.049+0000 7f50c7200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c811b140 0x7f50c81ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.049+0000 7f50c7200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8120be0 con 0x7f50c806ea30 2024-09-10T10:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.049+0000 7f50c7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8120a60 con 0x7f50c8110190 2024-09-10T10:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.049+0000 7f50c5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c8110190 0x7f50c81a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.049+0000 7f50c7200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8120d60 con 0x7f50c811b140 2024-09-10T10:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.049+0000 7f50c5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c8110190 0x7f50c81a7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50978/0 (socket says 172.21.15.50:50978) 2024-09-10T10:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.049+0000 7f50c5400640 1 -- 172.21.15.50:0/989811559 learned_addr learned my addr 172.21.15.50:0/989811559 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.049+0000 7f50c5e00640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50c806ea30 0x7f50c81a70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.050+0000 7f50c6800640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c811b140 0x7f50c81ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.050+0000 7f50c5400640 1 -- 172.21.15.50:0/989811559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c811b140 msgr2=0x7f50c81ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.050+0000 7f50c5400640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c811b140 0x7f50c81ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.050+0000 7f50c5400640 1 -- 172.21.15.50:0/989811559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50c806ea30 msgr2=0x7f50c81a70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.050+0000 7f50c5400640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50c806ea30 0x7f50c81a70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.050+0000 7f50c5400640 1 -- 172.21.15.50:0/989811559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c81ac090 con 0x7f50c8110190 2024-09-10T10:15:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.050+0000 7f50c5400640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c8110190 0x7f50c81a7620 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f50b400d950 tx=0x7f50b400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.050+0000 7f50bea00640 1 -- 172.21.15.50:0/989811559 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4017030 con 0x7f50c8110190 2024-09-10T10:15:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.051+0000 7f50bea00640 1 -- 172.21.15.50:0/989811559 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50b4004020 con 0x7f50c8110190 2024-09-10T10:15:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.051+0000 7f50c7200640 1 -- 172.21.15.50:0/989811559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c81ac380 con 0x7f50c8110190 2024-09-10T10:15:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.051+0000 7f50bea00640 1 -- 172.21.15.50:0/989811559 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b40047a0 con 0x7f50c8110190 2024-09-10T10:15:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.051+0000 7f50c7200640 1 -- 172.21.15.50:0/989811559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c81b3c60 con 0x7f50c8110190 2024-09-10T10:15:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.056+0000 7f50bea00640 1 -- 172.21.15.50:0/989811559 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f50b40041d0 con 0x7f50c8110190 2024-09-10T10:15:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.056+0000 7f50cf5df740 1 Processor -- start 2024-09-10T10:15:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.056+0000 7f50cf5df740 1 -- start start 2024-09-10T10:15:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.057+0000 7f50cf5df740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1ae40 0x55b318b1b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.057+0000 7f50cf5df740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1b760 0x55b318b25ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.057+0000 7f50cf5df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b28410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.057+0000 7f50cf5df740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b318a813e0 con 0x55b318b1ae40 2024-09-10T10:15:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.058+0000 7f50c5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1b760 0x55b318b25ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.058+0000 7f50c5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1b760 0x55b318b25ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:50982/0 (socket says 172.21.15.50:50982) 2024-09-10T10:15:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.058+0000 7f50c5e00640 1 -- 172.21.15.50:0/1010157139 learned_addr learned my addr 172.21.15.50:0/1010157139 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.058+0000 7f50c6800640 1 --2- 172.21.15.50:0/1010157139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1ae40 0x55b318b1b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.058+0000 7f50c5400640 1 --2- 172.21.15.50:0/1010157139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b28410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.059+0000 7f50cf5df740 1 -- 172.21.15.50:0/1010157139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b318a28d80 con 0x55b318b1b760 2024-09-10T10:15:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.059+0000 7f50cf5df740 1 -- 172.21.15.50:0/1010157139 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b318a7d3a0 con 0x55b318b26020 2024-09-10T10:15:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.060+0000 7f50c5e00640 1 -- 172.21.15.50:0/1010157139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 msgr2=0x55b318b28410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.060+0000 7f50c5e00640 1 --2- 172.21.15.50:0/1010157139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b28410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.060+0000 7f50c5e00640 1 -- 172.21.15.50:0/1010157139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1ae40 msgr2=0x55b318b1b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.060+0000 7f50c5e00640 1 --2- 172.21.15.50:0/1010157139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1ae40 0x55b318b1b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.060+0000 7f50c5e00640 1 -- 172.21.15.50:0/1010157139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b318a47ae0 con 0x55b318b1b760 2024-09-10T10:15:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.060+0000 7f50c5e00640 1 --2- 172.21.15.50:0/1010157139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1b760 0x55b318b25ae0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009900 tx=0x7f50b80040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=178343f977baac64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.061+0000 7f50bea00640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f50ac0a2c80 0x7f50ac0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.062+0000 7f50bea00640 1 -- 172.21.15.50:0/989811559 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f50b40cee70 con 0x7f50c8110190 2024-09-10T10:15:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.064+0000 7f50b3000640 1 -- 172.21.15.50:0/1010157139 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8035030 con 0x55b318b1b760 2024-09-10T10:15:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.064+0000 7f50c6800640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f50ac0a2c80 0x7f50ac0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.065+0000 7f50b3000640 1 -- 172.21.15.50:0/1010157139 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50b80044b0 con 0x55b318b1b760 2024-09-10T10:15:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.066+0000 7f50cf5df740 1 -- 172.21.15.50:0/1010157139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1b760 msgr2=0x55b318b25ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.066+0000 7f50cf5df740 1 --2- 172.21.15.50:0/1010157139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1b760 0x55b318b25ae0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009900 tx=0x7f50b80040c0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.066+0000 7f50cf5df740 1 -- 172.21.15.50:0/1010157139 shutdown_connections 2024-09-10T10:15:04.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.066+0000 7f50cf5df740 1 --2- 172.21.15.50:0/1010157139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b28410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.066+0000 7f50cf5df740 1 --2- 172.21.15.50:0/1010157139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1b760 0x55b318b25ae0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.066+0000 7f50cf5df740 1 --2- 172.21.15.50:0/1010157139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1ae40 0x55b318b1b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.066+0000 7f50cf5df740 1 -- 172.21.15.50:0/1010157139 >> 172.21.15.50:0/1010157139 conn(0x55b318b173d0 msgr2=0x55b318b177b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.067+0000 7f50cf5df740 1 -- 172.21.15.50:0/1010157139 shutdown_connections 2024-09-10T10:15:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.067+0000 7f50cf5df740 1 -- 172.21.15.50:0/1010157139 wait complete. 2024-09-10T10:15:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.068+0000 7f50cf5df740 1 -- start start 2024-09-10T10:15:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.068+0000 7f50cf5df740 1 Processor -- start 2024-09-10T10:15:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.070+0000 7f50c6800640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f50ac0a2c80 0x7f50ac0a5140 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f50c806b4a0 tx=0x7f50c00096d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.071+0000 7f50cf5df740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1ae40 0x55b318b22e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.071+0000 7f50cf5df740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1b760 0x55b318b23350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.072+0000 7f50cf5df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b23890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.072+0000 7f50cf5df740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b318b28c90 con 0x55b318b1ae40 2024-09-10T10:15:04.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.072+0000 7f50cf5df740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b318a3c0f0 con 0x55b318b1b760 2024-09-10T10:15:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.072+0000 7f50cf5df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b318b28e10 con 0x55b318b26020 2024-09-10T10:15:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.072+0000 7f50cf5df740 10 client.0 _ll_register_callbacks cb 0x55b318a23bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.072+0000 7f50c6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b23890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.072+0000 7f50c6800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b23890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:45016/0 (socket says 172.21.15.50:45016) 2024-09-10T10:15:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.072+0000 7f50c6800640 1 -- 172.21.15.50:0/3610478500 learned_addr learned my addr 172.21.15.50:0/3610478500 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.073+0000 7f50c5e00640 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1ae40 0x55b318b22e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.073+0000 7f50c5400640 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1b760 0x55b318b23350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.073+0000 7f50c5400640 1 -- 172.21.15.50:0/3610478500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 msgr2=0x55b318b23890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.075+0000 7f50c5400640 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b23890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.075+0000 7f50c5400640 1 -- 172.21.15.50:0/3610478500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1ae40 msgr2=0x55b318b22e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.075+0000 7f50c5400640 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1ae40 0x55b318b22e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.075+0000 7f50c5400640 1 -- 172.21.15.50:0/3610478500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3187f23c0 con 0x55b318b1b760 2024-09-10T10:15:04.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.075+0000 7f50c5e00640 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1ae40 0x55b318b22e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.075+0000 7f50c5400640 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1b760 0x55b318b23350 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55b318b18750 tx=0x7f50b409b170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2eb124cf250b4407 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.075+0000 7f50a7400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:15:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.076+0000 7f50a7400640 1 -- 172.21.15.50:0/3610478500 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b409b2e0 con 0x55b318b1b760 2024-09-10T10:15:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.076+0000 7f50a7400640 1 -- 172.21.15.50:0/3610478500 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f50b40bb0c0 con 0x55b318b1b760 2024-09-10T10:15:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.077+0000 7f50cf5df740 1 -- 172.21.15.50:0/3610478500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50b80044b0 con 0x55b318b1b760 2024-09-10T10:15:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.079+0000 7f50a7400640 1 -- 172.21.15.50:0/3610478500 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f50b409f690 con 0x55b318b1b760 2024-09-10T10:15:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.079+0000 7f50cf5df740 10 client.26102 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.079+0000 7f50cf5df740 1 -- 172.21.15.50:0/3610478500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b318b34d00 con 0x55b318b1b760 2024-09-10T10:15:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.079+0000 7f50a7400640 1 -- 172.21.15.50:0/3610478500 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50b80044b0 con 0x55b318b1b760 2024-09-10T10:15:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.079+0000 7f50a7400640 1 -- 172.21.15.50:0/3610478500 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f50b409a730 con 0x55b318b1b760 2024-09-10T10:15:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.084+0000 7f50cf5df740 10 client.26102 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.084+0000 7f50cf5df740 10 client.26102 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:15:04.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.084+0000 7f50cf5df740 20 client.26102 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:04.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.084+0000 7f50cf5df740 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55b318b361c0 0x55b318b38630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.084+0000 7f50cf5df740 4 client.26102 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:15:04.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.084+0000 7f50cf5df740 1 -- 172.21.15.50:0/3610478500 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b318a8e950 con 0x55b318b361c0 2024-09-10T10:15:04.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.085+0000 7f50c5e00640 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55b318b361c0 0x55b318b38630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.087+0000 7f50c5e00640 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55b318b361c0 0x55b318b38630 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=496ac74e5cdc1a19 server_cookie=1abb751e271ed364 in_seq=0 out_seq=0 2024-09-10T10:15:04.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.087+0000 7f50a7400640 10 client.26102 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:15:04.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.088+0000 7f50a7400640 1 -- 172.21.15.50:0/3610478500 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b318a8e950 con 0x55b318b361c0 2024-09-10T10:15:04.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.089+0000 7f50a7400640 10 client.26102 handle_command_reply: tid=0 2024-09-10T10:15:04.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.089+0000 7f50cf5df740 1 client.26102 shutdown 2024-09-10T10:15:04.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.091+0000 7f50cf5df740 1 -- 172.21.15.50:0/3610478500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1b760 msgr2=0x55b318b23350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:04.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.091+0000 7f50cf5df740 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1b760 0x55b318b23350 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55b318b18750 tx=0x7f50b409b170 comp rx=0 tx=0).stop 2024-09-10T10:15:04.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.092+0000 7f50cf5df740 1 -- 172.21.15.50:0/3610478500 shutdown_connections 2024-09-10T10:15:04.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.092+0000 7f50cf5df740 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b23890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.093+0000 7f50cf5df740 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1b760 0x55b318b23350 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.093+0000 7f50cf5df740 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55b318b361c0 0x55b318b38630 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.093+0000 7f50cf5df740 1 --2- 172.21.15.50:0/3610478500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1ae40 0x55b318b22e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.093+0000 7f50cf5df740 1 -- 172.21.15.50:0/3610478500 >> 172.21.15.50:0/3610478500 conn(0x55b318b173d0 msgr2=0x55b318b1d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:04.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.094+0000 7f50a7400640 0 client.26102 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:15:04.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.094+0000 7f50cf5df740 1 -- 172.21.15.50:0/3610478500 shutdown_connections 2024-09-10T10:15:04.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.095+0000 7f50cf5df740 1 -- 172.21.15.50:0/3610478500 wait complete. 2024-09-10T10:15:04.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.095+0000 7f50cf5df740 20 client.26102 trim_cache size 0 max 16384 2024-09-10T10:15:04.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.121+0000 7f50cf5df740 1 Processor -- start 2024-09-10T10:15:04.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.121+0000 7f50cf5df740 1 -- start start 2024-09-10T10:15:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.121+0000 7f50cf5df740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1ae40 0x55b318b1d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.121+0000 7f50cf5df740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1b760 0x55b318b3df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.121+0000 7f50cf5df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b3e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.121+0000 7f50cf5df740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f50c81b7ab0 con 0x55b318b1b760 2024-09-10T10:15:04.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.121+0000 7f50cf5df740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f50c81b5380 con 0x55b318b1ae40 2024-09-10T10:15:04.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.121+0000 7f50cf5df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50c806ee70 con 0x55b318b26020 2024-09-10T10:15:04.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.123+0000 7f50c5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1ae40 0x55b318b1d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.123+0000 7f50c5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1ae40 0x55b318b1d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:51002/0 (socket says 172.21.15.50:51002) 2024-09-10T10:15:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.123+0000 7f50c5e00640 1 -- 172.21.15.50:0/533260966 learned_addr learned my addr 172.21.15.50:0/533260966 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.123+0000 7f50c5e00640 1 -- 172.21.15.50:0/533260966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 msgr2=0x55b318b3e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.123+0000 7f50c6800640 1 --2- 172.21.15.50:0/533260966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b3e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.123+0000 7f50c5e00640 1 --2- 172.21.15.50:0/533260966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b3e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.123+0000 7f50c5e00640 1 -- 172.21.15.50:0/533260966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1b760 msgr2=0x55b318b3df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.123+0000 7f50c5e00640 1 --2- 172.21.15.50:0/533260966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1b760 0x55b318b3df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.123+0000 7f50c5e00640 1 -- 172.21.15.50:0/533260966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b318b17200 con 0x55b318b1ae40 2024-09-10T10:15:04.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.123+0000 7f50c6800640 1 --2- 172.21.15.50:0/533260966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b3e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.123+0000 7f50c5e00640 1 --2- 172.21.15.50:0/533260966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1ae40 0x55b318b1d8a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f50b8031550 tx=0x7f50b8004b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=994b5c8760247e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.125+0000 7f50b2600640 1 -- 172.21.15.50:0/533260966 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8004980 con 0x55b318b1ae40 2024-09-10T10:15:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.125+0000 7f50b2600640 1 -- 172.21.15.50:0/533260966 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50b8003ad0 con 0x55b318b1ae40 2024-09-10T10:15:04.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.125+0000 7f50b2600640 1 -- 172.21.15.50:0/533260966 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8031ce0 con 0x55b318b1ae40 2024-09-10T10:15:04.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.125+0000 7f50cf5df740 1 -- 172.21.15.50:0/533260966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1ae40 msgr2=0x55b318b1d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:04.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.125+0000 7f50cf5df740 1 --2- 172.21.15.50:0/533260966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1ae40 0x55b318b1d8a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f50b8031550 tx=0x7f50b8004b70 comp rx=0 tx=0).stop 2024-09-10T10:15:04.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.126+0000 7f50cf5df740 1 -- 172.21.15.50:0/533260966 shutdown_connections 2024-09-10T10:15:04.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.126+0000 7f50cf5df740 1 --2- 172.21.15.50:0/533260966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b26020 0x55b318b3e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.126+0000 7f50cf5df740 1 --2- 172.21.15.50:0/533260966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1b760 0x55b318b3df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.126+0000 7f50cf5df740 1 --2- 172.21.15.50:0/533260966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b1ae40 0x55b318b1d8a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.126+0000 7f50cf5df740 1 -- 172.21.15.50:0/533260966 >> 172.21.15.50:0/533260966 conn(0x55b318b173d0 msgr2=0x55b318b21f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:04.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.126+0000 7f50cf5df740 1 -- 172.21.15.50:0/533260966 shutdown_connections 2024-09-10T10:15:04.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.126+0000 7f50cf5df740 1 -- 172.21.15.50:0/533260966 wait complete. 2024-09-10T10:15:04.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.127+0000 7f50cf5df740 1 -- start start 2024-09-10T10:15:04.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.127+0000 7f50cf5df740 1 Processor -- start 2024-09-10T10:15:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.127+0000 7f50cf5df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b1ae40 0x55b318b2e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.127+0000 7f50cf5df740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1b760 0x55b318b1fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.127+0000 7f50cf5df740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b26020 0x55b318b20220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.127+0000 7f50cf5df740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8118ae0 con 0x55b318b1b760 2024-09-10T10:15:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.127+0000 7f50cf5df740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f50c81b4cb0 con 0x55b318b26020 2024-09-10T10:15:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.127+0000 7f50cf5df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f50c81b3f40 con 0x55b318b1ae40 2024-09-10T10:15:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.127+0000 7f50cf5df740 10 client.0 _ll_register_callbacks cb 0x7f50b4097580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.128+0000 7f50c6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b26020 0x55b318b20220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.128+0000 7f50c5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b1ae40 0x55b318b2e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.128+0000 7f50c5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b1ae40 0x55b318b2e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:45026/0 (socket says 172.21.15.50:45026) 2024-09-10T10:15:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.128+0000 7f50c6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b26020 0x55b318b20220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:51010/0 (socket says 172.21.15.50:51010) 2024-09-10T10:15:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.128+0000 7f50c5e00640 1 -- 172.21.15.50:0/2031936228 learned_addr learned my addr 172.21.15.50:0/2031936228 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.128+0000 7f50c5e00640 1 -- 172.21.15.50:0/2031936228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b26020 msgr2=0x55b318b20220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:04.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.128+0000 7f50c5e00640 1 --2- 172.21.15.50:0/2031936228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b26020 0x55b318b20220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.128+0000 7f50c5e00640 1 -- 172.21.15.50:0/2031936228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1b760 msgr2=0x55b318b1fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:04.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.128+0000 7f50c5e00640 1 --2- 172.21.15.50:0/2031936228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1b760 0x55b318b1fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.128+0000 7f50c5e00640 1 -- 172.21.15.50:0/2031936228 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b318b20a50 con 0x55b318b1ae40 2024-09-10T10:15:04.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.128+0000 7f50c6800640 1 --2- 172.21.15.50:0/2031936228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b26020 0x55b318b20220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:15:04.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.129+0000 7f50c5e00640 1 --2- 172.21.15.50:0/2031936228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b1ae40 0x55b318b2e900 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f50b802a910 tx=0x7f50b8031840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0815c5bb7ab4dc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:04.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.129+0000 7f50a7400640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:15:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.129+0000 7f50a7400640 1 -- 172.21.15.50:0/2031936228 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8003e90 con 0x55b318b1ae40 2024-09-10T10:15:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.130+0000 7f50cf5df740 1 -- 172.21.15.50:0/2031936228 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50b8003ad0 con 0x55b318b1ae40 2024-09-10T10:15:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.130+0000 7f50a7400640 1 -- 172.21.15.50:0/2031936228 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f50b8004780 con 0x55b318b1ae40 2024-09-10T10:15:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.130+0000 7f50a7400640 1 -- 172.21.15.50:0/2031936228 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f50b8066050 con 0x55b318b1ae40 2024-09-10T10:15:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.130+0000 7f50cf5df740 10 client.26104 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.130+0000 7f50cf5df740 1 -- 172.21.15.50:0/2031936228 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b318ba0f90 con 0x55b318b1ae40 2024-09-10T10:15:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.130+0000 7f50a7400640 1 -- 172.21.15.50:0/2031936228 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50b8003ad0 con 0x55b318b1ae40 2024-09-10T10:15:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.131+0000 7f50a7400640 1 -- 172.21.15.50:0/2031936228 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f50b8059440 con 0x55b318b1ae40 2024-09-10T10:15:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.131+0000 7f50cf5df740 10 client.26104 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.131+0000 7f50cf5df740 10 client.26104 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:15:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.131+0000 7f50cf5df740 20 client.26104 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:04.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.131+0000 7f50cf5df740 1 --2- 172.21.15.50:0/2031936228 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55b318ba0f90 0x55b318ba3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:04.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.131+0000 7f50cf5df740 4 client.26104 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:15:04.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.131+0000 7f50cf5df740 1 -- 172.21.15.50:0/2031936228 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b318a88e60 con 0x55b318ba0f90 2024-09-10T10:15:04.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.132+0000 7f50c5400640 1 --2- 172.21.15.50:0/2031936228 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55b318ba0f90 0x55b318ba3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:04.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.132+0000 7f50c5400640 1 --2- 172.21.15.50:0/2031936228 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55b318ba0f90 0x55b318ba3380 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8cdbd037b318f292 server_cookie=49179b0a352a4076 in_seq=0 out_seq=0 2024-09-10T10:15:04.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.132+0000 7f50a7400640 10 client.26104 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:15:04.135 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:15:04.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.132+0000 7f50a7400640 1 -- 172.21.15.50:0/2031936228 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b318a88e60 con 0x55b318ba0f90 2024-09-10T10:15:04.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.132+0000 7f50a7400640 10 client.26104 handle_command_reply: tid=0 2024-09-10T10:15:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.132+0000 7f50cf5df740 1 client.26104 shutdown 2024-09-10T10:15:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.133+0000 7f50cf5df740 1 -- 172.21.15.50:0/2031936228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b1ae40 msgr2=0x55b318b2e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.133+0000 7f50cf5df740 1 --2- 172.21.15.50:0/2031936228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b1ae40 0x55b318b2e900 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f50b802a910 tx=0x7f50b8031840 comp rx=0 tx=0).stop 2024-09-10T10:15:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.133+0000 7f50cf5df740 1 -- 172.21.15.50:0/2031936228 shutdown_connections 2024-09-10T10:15:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.133+0000 7f50cf5df740 1 --2- 172.21.15.50:0/2031936228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b318b26020 0x55b318b20220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.133+0000 7f50cf5df740 1 --2- 172.21.15.50:0/2031936228 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55b318ba0f90 0x55b318ba3380 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.133+0000 7f50cf5df740 1 --2- 172.21.15.50:0/2031936228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b318b1b760 0x55b318b1fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.133+0000 7f50cf5df740 1 --2- 172.21.15.50:0/2031936228 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b318b1ae40 0x55b318b2e900 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.133+0000 7f50cf5df740 1 -- 172.21.15.50:0/2031936228 >> 172.21.15.50:0/2031936228 conn(0x55b318b173d0 msgr2=0x55b318b22db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.133+0000 7f50a7400640 0 client.26104 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:15:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.133+0000 7f50cf5df740 1 -- 172.21.15.50:0/2031936228 shutdown_connections 2024-09-10T10:15:04.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.133+0000 7f50cf5df740 1 -- 172.21.15.50:0/2031936228 wait complete. 2024-09-10T10:15:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.133+0000 7f50cf5df740 20 client.26104 trim_cache size 0 max 16384 2024-09-10T10:15:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.136+0000 7f50c7200640 1 -- 172.21.15.50:0/989811559 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f50ac0a2c80 msgr2=0x7f50ac0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.136+0000 7f50c7200640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f50ac0a2c80 0x7f50ac0a5140 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f50c806b4a0 tx=0x7f50c00096d0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.136+0000 7f50c7200640 1 -- 172.21.15.50:0/989811559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c8110190 msgr2=0x7f50c81a7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:04.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.136+0000 7f50c7200640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c8110190 0x7f50c81a7620 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f50b400d950 tx=0x7f50b400de10 comp rx=0 tx=0).stop 2024-09-10T10:15:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.137+0000 7f50c7200640 1 -- 172.21.15.50:0/989811559 shutdown_connections 2024-09-10T10:15:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.137+0000 7f50c7200640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f50ac0a2c80 0x7f50ac0a5140 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.137+0000 7f50c7200640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f50c811b140 0x7f50c81ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.137+0000 7f50c7200640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c8110190 0x7f50c81a7620 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.137+0000 7f50c7200640 1 --2- 172.21.15.50:0/989811559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50c806ea30 0x7f50c81a70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:04.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.137+0000 7f50c7200640 1 -- 172.21.15.50:0/989811559 >> 172.21.15.50:0/989811559 conn(0x7f50c8073180 msgr2=0x7f50c810e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.138+0000 7f50c7200640 1 -- 172.21.15.50:0/989811559 shutdown_connections 2024-09-10T10:15:04.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:04.138+0000 7f50c7200640 1 -- 172.21.15.50:0/989811559 wait complete. 2024-09-10T10:15:04.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:04 smithi050 ceph-mon[30354]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 272 MiB/s wr, 79 op/s 2024-09-10T10:15:04.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:04 smithi189 ceph-mon[34999]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 272 MiB/s wr, 79 op/s 2024-09-10T10:15:04.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:04 smithi084 ceph-mon[34812]: pgmap v507: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 272 MiB/s wr, 79 op/s 2024-09-10T10:15:06.008 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T10:15:06.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:06 smithi050 ceph-mon[30354]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 278 MiB/s wr, 77 op/s 2024-09-10T10:15:06.566 INFO:tasks.quiescer.fs.[cephfs]:Total duration (45.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-10T10:15:06.566 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.75 2024-09-10T10:15:06.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:15:06.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:06 smithi189 ceph-mon[34999]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 278 MiB/s wr, 77 op/s 2024-09-10T10:15:06.598 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:06 smithi084 ceph-mon[34812]: pgmap v508: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 278 MiB/s wr, 77 op/s 2024-09-10T10:15:07.015 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:08.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.205+0000 7ff472000640 1 --2- 172.21.15.50:0/403855472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff474109e00 0x7ff47410e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.206+0000 7ff479a00640 1 -- 172.21.15.50:0/403855472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff47410ea80 msgr2=0x7ff4741154f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.206+0000 7ff479a00640 1 --2- 172.21.15.50:0/403855472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff47410ea80 0x7ff4741154f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0074e0 tx=0x7ff46c02b0a0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.207+0000 7ff479a00640 1 -- 172.21.15.50:0/403855472 shutdown_connections 2024-09-10T10:15:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.207+0000 7ff479a00640 1 --2- 172.21.15.50:0/403855472 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff47410ea80 0x7ff4741154f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.207+0000 7ff479a00640 1 --2- 172.21.15.50:0/403855472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff474109e00 0x7ff47410e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.207+0000 7ff479a00640 1 --2- 172.21.15.50:0/403855472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff474109450 0x7ff474109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.207+0000 7ff479a00640 1 -- 172.21.15.50:0/403855472 >> 172.21.15.50:0/403855472 conn(0x7ff47406e2d0 msgr2=0x7ff47406e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.208+0000 7ff479a00640 1 -- 172.21.15.50:0/403855472 shutdown_connections 2024-09-10T10:15:08.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.208+0000 7ff479a00640 1 -- 172.21.15.50:0/403855472 wait complete. 2024-09-10T10:15:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.209+0000 7ff479a00640 1 Processor -- start 2024-09-10T10:15:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.210+0000 7ff479a00640 1 -- start start 2024-09-10T10:15:08.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.211+0000 7ff479a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff474109450 0x7ff4741a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.211+0000 7ff479a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff474109e00 0x7ff4741a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.211+0000 7ff472a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff474109450 0x7ff4741a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.212+0000 7ff472a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff474109450 0x7ff4741a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:59308/0 (socket says 172.21.15.50:59308) 2024-09-10T10:15:08.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.212+0000 7ff472a00640 1 -- 172.21.15.50:0/440778704 learned_addr learned my addr 172.21.15.50:0/440778704 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:08.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.212+0000 7ff479a00640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff47410ea80 0x7ff47419e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.212+0000 7ff472000640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff474109e00 0x7ff4741a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.212+0000 7ff479a00640 1 -- 172.21.15.50:0/440778704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff474118690 con 0x7ff47410ea80 2024-09-10T10:15:08.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.212+0000 7ff479a00640 1 -- 172.21.15.50:0/440778704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff474118510 con 0x7ff474109450 2024-09-10T10:15:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.212+0000 7ff479a00640 1 -- 172.21.15.50:0/440778704 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff474118810 con 0x7ff474109e00 2024-09-10T10:15:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.213+0000 7ff472a00640 1 -- 172.21.15.50:0/440778704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff474109e00 msgr2=0x7ff4741a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.213+0000 7ff472a00640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff474109e00 0x7ff4741a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.213+0000 7ff472a00640 1 -- 172.21.15.50:0/440778704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff47410ea80 msgr2=0x7ff47419e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.213+0000 7ff472a00640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff47410ea80 0x7ff47419e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.213+0000 7ff472a00640 1 -- 172.21.15.50:0/440778704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47419edb0 con 0x7ff474109450 2024-09-10T10:15:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.213+0000 7ff472000640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff474109e00 0x7ff4741a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:08.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.214+0000 7ff472a00640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff474109450 0x7ff4741a33c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff46400ba50 tx=0x7ff46400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:08.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.214+0000 7ff46b400640 1 -- 172.21.15.50:0/440778704 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464019070 con 0x7ff474109450 2024-09-10T10:15:08.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.215+0000 7ff479a00640 1 -- 172.21.15.50:0/440778704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47419f0a0 con 0x7ff474109450 2024-09-10T10:15:08.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.215+0000 7ff479a00640 1 -- 172.21.15.50:0/440778704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4741a2130 con 0x7ff474109450 2024-09-10T10:15:08.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.215+0000 7ff46b400640 1 -- 172.21.15.50:0/440778704 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff46400cbe0 con 0x7ff474109450 2024-09-10T10:15:08.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.215+0000 7ff46b400640 1 -- 172.21.15.50:0/440778704 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4640076e0 con 0x7ff474109450 2024-09-10T10:15:08.229 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:08 smithi050 ceph-mon[30354]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 274 MiB/s wr, 79 op/s 2024-09-10T10:15:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.221+0000 7ff46b400640 1 -- 172.21.15.50:0/440778704 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff46401c070 con 0x7ff474109450 2024-09-10T10:15:08.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.223+0000 7ff46b400640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ff4540a2c80 0x7ff4540a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.223+0000 7ff46b400640 1 -- 172.21.15.50:0/440778704 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7ff4640ce950 con 0x7ff474109450 2024-09-10T10:15:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.224+0000 7ff472000640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ff4540a2c80 0x7ff4540a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.226+0000 7ff472000640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ff4540a2c80 0x7ff4540a5140 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff47419fdf0 tx=0x7ff45c005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:08.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.229+0000 7ff47c467740 1 Processor -- start 2024-09-10T10:15:08.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.230+0000 7ff47c467740 1 -- start start 2024-09-10T10:15:08.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.230+0000 7ff47c467740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f5c70 0x5598963f6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.230+0000 7ff47c467740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598963f6590 0x559896400910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.230+0000 7ff47c467740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559896400e50 0x559896403240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.230+0000 7ff47c467740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55989635c3e0 con 0x5598963f6590 2024-09-10T10:15:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.230+0000 7ff47c467740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559896303d80 con 0x5598963f5c70 2024-09-10T10:15:08.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.230+0000 7ff47c467740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5598963583a0 con 0x559896400e50 2024-09-10T10:15:08.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.231+0000 7ff472a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f5c70 0x5598963f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.231+0000 7ff472a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f5c70 0x5598963f6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:59318/0 (socket says 172.21.15.50:59318) 2024-09-10T10:15:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.231+0000 7ff472a00640 1 -- 172.21.15.50:0/1706607540 learned_addr learned my addr 172.21.15.50:0/1706607540 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.231+0000 7ff473400640 1 --2- 172.21.15.50:0/1706607540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559896400e50 0x559896403240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.231+0000 7ff472a00640 1 -- 172.21.15.50:0/1706607540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559896400e50 msgr2=0x559896403240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.231+0000 7ff472a00640 1 --2- 172.21.15.50:0/1706607540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559896400e50 0x559896403240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.231+0000 7ff472a00640 1 -- 172.21.15.50:0/1706607540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598963f6590 msgr2=0x559896400910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.231+0000 7ff472a00640 1 --2- 172.21.15.50:0/1706607540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598963f6590 0x559896400910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.231+0000 7ff472a00640 1 -- 172.21.15.50:0/1706607540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559896322ae0 con 0x5598963f5c70 2024-09-10T10:15:08.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.234+0000 7ff472a00640 1 --2- 172.21.15.50:0/1706607540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f5c70 0x5598963f6050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff4640a3500 tx=0x7ff46409aa30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e61346825eb10ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.234+0000 7ff463e00640 1 -- 172.21.15.50:0/1706607540 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4640a3a30 con 0x5598963f5c70 2024-09-10T10:15:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.234+0000 7ff463e00640 1 -- 172.21.15.50:0/1706607540 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4640990c0 con 0x5598963f5c70 2024-09-10T10:15:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.234+0000 7ff463e00640 1 -- 172.21.15.50:0/1706607540 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4640a3a30 con 0x5598963f5c70 2024-09-10T10:15:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.235+0000 7ff47c467740 1 -- 172.21.15.50:0/1706607540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f5c70 msgr2=0x5598963f6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.235+0000 7ff47c467740 1 --2- 172.21.15.50:0/1706607540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f5c70 0x5598963f6050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff4640a3500 tx=0x7ff46409aa30 comp rx=0 tx=0).stop 2024-09-10T10:15:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.236+0000 7ff47c467740 1 -- 172.21.15.50:0/1706607540 shutdown_connections 2024-09-10T10:15:08.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.236+0000 7ff47c467740 1 --2- 172.21.15.50:0/1706607540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559896400e50 0x559896403240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.236+0000 7ff47c467740 1 --2- 172.21.15.50:0/1706607540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598963f6590 0x559896400910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.236+0000 7ff47c467740 1 --2- 172.21.15.50:0/1706607540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f5c70 0x5598963f6050 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.236+0000 7ff47c467740 1 -- 172.21.15.50:0/1706607540 >> 172.21.15.50:0/1706607540 conn(0x5598963f2200 msgr2=0x5598963f25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.236+0000 7ff47c467740 1 -- 172.21.15.50:0/1706607540 shutdown_connections 2024-09-10T10:15:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.236+0000 7ff47c467740 1 -- 172.21.15.50:0/1706607540 wait complete. 2024-09-10T10:15:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.236+0000 7ff47c467740 1 -- start start 2024-09-10T10:15:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.237+0000 7ff47c467740 1 Processor -- start 2024-09-10T10:15:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.237+0000 7ff47c467740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f5c70 0x5598963fdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.237+0000 7ff47c467740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598963f6590 0x5598963fe260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.238+0000 7ff47c467740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559896400e50 0x5598963fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.238+0000 7ff47c467740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559896403a20 con 0x5598963f6590 2024-09-10T10:15:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.238+0000 7ff47c467740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5598963170f0 con 0x5598963f5c70 2024-09-10T10:15:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.238+0000 7ff47c467740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559896403ba0 con 0x559896400e50 2024-09-10T10:15:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.238+0000 7ff47c467740 10 client.0 _ll_register_callbacks cb 0x5598962febd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.238+0000 7ff472a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f5c70 0x5598963fdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.238+0000 7ff473400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559896400e50 0x5598963fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.238+0000 7ff473400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559896400e50 0x5598963fe7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:37452/0 (socket says 172.21.15.50:37452) 2024-09-10T10:15:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.238+0000 7ff473400640 1 -- 172.21.15.50:0/3839900971 learned_addr learned my addr 172.21.15.50:0/3839900971 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.239+0000 7ff473400640 1 -- 172.21.15.50:0/3839900971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f5c70 msgr2=0x5598963fdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:08.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.239+0000 7ff473400640 1 --2- 172.21.15.50:0/3839900971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f5c70 0x5598963fdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.239+0000 7ff473400640 1 -- 172.21.15.50:0/3839900971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598963f6590 msgr2=0x5598963fe260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.239+0000 7ff473400640 1 --2- 172.21.15.50:0/3839900971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598963f6590 0x5598963fe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.239+0000 7ff473400640 1 -- 172.21.15.50:0/3839900971 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598960cd3c0 con 0x559896400e50 2024-09-10T10:15:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.239+0000 7ff473400640 1 --2- 172.21.15.50:0/3839900971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559896400e50 0x5598963fe7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0048f0 tx=0x7ff46c00ae70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c88e41aac4bc98fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.239+0000 7ff460c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:15:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.239+0000 7ff460c00640 1 -- 172.21.15.50:0/3839900971 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c038040 con 0x559896400e50 2024-09-10T10:15:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.240+0000 7ff460c00640 1 -- 172.21.15.50:0/3839900971 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7ff46c02bbe0 con 0x559896400e50 2024-09-10T10:15:08.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.240+0000 7ff47c467740 1 -- 172.21.15.50:0/3839900971 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4640990c0 con 0x559896400e50 2024-09-10T10:15:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.240+0000 7ff460c00640 1 -- 172.21.15.50:0/3839900971 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff46c04a050 con 0x559896400e50 2024-09-10T10:15:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.240+0000 7ff47c467740 10 client.26113 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.240+0000 7ff47c467740 1 -- 172.21.15.50:0/3839900971 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55989640fb00 con 0x559896400e50 2024-09-10T10:15:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.240+0000 7ff460c00640 1 -- 172.21.15.50:0/3839900971 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff46c02bde0 con 0x559896400e50 2024-09-10T10:15:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.241+0000 7ff460c00640 1 -- 172.21.15.50:0/3839900971 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff46c03b030 con 0x559896400e50 2024-09-10T10:15:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.241+0000 7ff47c467740 10 client.26113 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.241+0000 7ff47c467740 10 client.26113 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:15:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.241+0000 7ff47c467740 20 client.26113 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.241+0000 7ff47c467740 1 --2- 172.21.15.50:0/3839900971 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x559896411060 0x5598964134a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.241+0000 7ff47c467740 4 client.26113 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:15:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.241+0000 7ff47c467740 1 -- 172.21.15.50:0/3839900971 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff4640990c0 con 0x559896411060 2024-09-10T10:15:08.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.242+0000 7ff472a00640 1 --2- 172.21.15.50:0/3839900971 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x559896411060 0x5598964134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.242+0000 7ff472a00640 1 --2- 172.21.15.50:0/3839900971 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x559896411060 0x5598964134a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=43301b5109e3a3ee server_cookie=a022df46a2584f54 in_seq=0 out_seq=0 2024-09-10T10:15:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.242+0000 7ff460c00640 10 client.26113 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:15:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.243+0000 7ff460c00640 1 -- 172.21.15.50:0/3839900971 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff4640990c0 con 0x559896411060 2024-09-10T10:15:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.243+0000 7ff460c00640 10 client.26113 handle_command_reply: tid=0 2024-09-10T10:15:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.243+0000 7ff47c467740 1 client.26113 shutdown 2024-09-10T10:15:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.243+0000 7ff47c467740 1 -- 172.21.15.50:0/3839900971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559896400e50 msgr2=0x5598963fe7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:08.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.243+0000 7ff47c467740 1 --2- 172.21.15.50:0/3839900971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559896400e50 0x5598963fe7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0048f0 tx=0x7ff46c00ae70 comp rx=0 tx=0).stop 2024-09-10T10:15:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.245+0000 7ff47c467740 1 -- 172.21.15.50:0/3839900971 shutdown_connections 2024-09-10T10:15:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.245+0000 7ff47c467740 1 --2- 172.21.15.50:0/3839900971 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x559896411060 0x5598964134a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.245+0000 7ff47c467740 1 --2- 172.21.15.50:0/3839900971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559896400e50 0x5598963fe7a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.245+0000 7ff47c467740 1 --2- 172.21.15.50:0/3839900971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598963f6590 0x5598963fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.245+0000 7ff460c00640 0 client.26113 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:15:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.245+0000 7ff47c467740 1 --2- 172.21.15.50:0/3839900971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f5c70 0x5598963fdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.245+0000 7ff47c467740 1 -- 172.21.15.50:0/3839900971 >> 172.21.15.50:0/3839900971 conn(0x5598963f2200 msgr2=0x5598963f7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.245+0000 7ff47c467740 1 -- 172.21.15.50:0/3839900971 shutdown_connections 2024-09-10T10:15:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.245+0000 7ff47c467740 1 -- 172.21.15.50:0/3839900971 wait complete. 2024-09-10T10:15:08.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.245+0000 7ff47c467740 20 client.26113 trim_cache size 0 max 16384 2024-09-10T10:15:08.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.271+0000 7ff47c467740 1 Processor -- start 2024-09-10T10:15:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.273+0000 7ff47c467740 1 -- start start 2024-09-10T10:15:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.273+0000 7ff47c467740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 0x5598963f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.273+0000 7ff47c467740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f6590 0x559896418d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.274+0000 7ff47c467740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559896400e50 0x5598964192b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.274+0000 7ff47c467740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff450012460 con 0x559896400e50 2024-09-10T10:15:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.274+0000 7ff47c467740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff45000fd30 con 0x5598963f6590 2024-09-10T10:15:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.274+0000 7ff47c467740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff45000db80 con 0x5598963f5c70 2024-09-10T10:15:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.274+0000 7ff472a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 0x5598963f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.274+0000 7ff472a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 0x5598963f86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:37464/0 (socket says 172.21.15.50:37464) 2024-09-10T10:15:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.274+0000 7ff472000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f6590 0x559896418d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.275+0000 7ff472000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f6590 0x559896418d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:59336/0 (socket says 172.21.15.50:59336) 2024-09-10T10:15:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.275+0000 7ff472a00640 1 -- 172.21.15.50:0/118962240 learned_addr learned my addr 172.21.15.50:0/118962240 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.275+0000 7ff472a00640 1 -- 172.21.15.50:0/118962240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f6590 msgr2=0x559896418d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.275+0000 7ff472a00640 1 --2- 172.21.15.50:0/118962240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f6590 0x559896418d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.275+0000 7ff472a00640 1 -- 172.21.15.50:0/118962240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559896400e50 msgr2=0x5598964192b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.275+0000 7ff472a00640 1 --2- 172.21.15.50:0/118962240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559896400e50 0x5598964192b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.275+0000 7ff472a00640 1 -- 172.21.15.50:0/118962240 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598963ed770 con 0x5598963f5c70 2024-09-10T10:15:08.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.276+0000 7ff472000640 1 --2- 172.21.15.50:0/118962240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f6590 0x559896418d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:15:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.278+0000 7ff472a00640 1 --2- 172.21.15.50:0/118962240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 0x5598963f86d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff46400ba20 tx=0x7ff464004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b8c9300e5de6c63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.279+0000 7ff463400640 1 -- 172.21.15.50:0/118962240 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46407e070 con 0x5598963f5c70 2024-09-10T10:15:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.279+0000 7ff463400640 1 -- 172.21.15.50:0/118962240 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4640cc1f0 con 0x5598963f5c70 2024-09-10T10:15:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.279+0000 7ff463400640 1 -- 172.21.15.50:0/118962240 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4640a3a30 con 0x5598963f5c70 2024-09-10T10:15:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.281+0000 7ff47c467740 1 -- 172.21.15.50:0/118962240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 msgr2=0x5598963f86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.281+0000 7ff47c467740 1 --2- 172.21.15.50:0/118962240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 0x5598963f86d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff46400ba20 tx=0x7ff464004a40 comp rx=0 tx=0).stop 2024-09-10T10:15:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.281+0000 7ff47c467740 1 -- 172.21.15.50:0/118962240 shutdown_connections 2024-09-10T10:15:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.281+0000 7ff47c467740 1 --2- 172.21.15.50:0/118962240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559896400e50 0x5598964192b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.281+0000 7ff47c467740 1 --2- 172.21.15.50:0/118962240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5598963f6590 0x559896418d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.281+0000 7ff47c467740 1 --2- 172.21.15.50:0/118962240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 0x5598963f86d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.281+0000 7ff47c467740 1 -- 172.21.15.50:0/118962240 >> 172.21.15.50:0/118962240 conn(0x5598963f2200 msgr2=0x5598963ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.282+0000 7ff47c467740 1 -- 172.21.15.50:0/118962240 shutdown_connections 2024-09-10T10:15:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.282+0000 7ff47c467740 1 -- 172.21.15.50:0/118962240 wait complete. 2024-09-10T10:15:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.283+0000 7ff47c467740 1 -- start start 2024-09-10T10:15:08.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.283+0000 7ff47c467740 1 Processor -- start 2024-09-10T10:15:08.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.284+0000 7ff47c467740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 0x559896404b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.284+0000 7ff47c467740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598963f6590 0x559896405060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.284+0000 7ff47c467740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559896400e50 0x5598964055a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.284+0000 7ff47c467740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff45000e1f0 con 0x5598963f6590 2024-09-10T10:15:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.284+0000 7ff47c467740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff45000f660 con 0x559896400e50 2024-09-10T10:15:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.284+0000 7ff47c467740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff45000e8c0 con 0x5598963f5c70 2024-09-10T10:15:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.284+0000 7ff47c467740 10 client.0 _ll_register_callbacks cb 0x7ff46c0073e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:08.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.285+0000 7ff472000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598963f6590 0x559896405060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.285+0000 7ff472a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 0x559896404b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.285+0000 7ff473400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559896400e50 0x5598964055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.285+0000 7ff472a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 0x559896404b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:37472/0 (socket says 172.21.15.50:37472) 2024-09-10T10:15:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.285+0000 7ff472a00640 1 -- 172.21.15.50:0/4093568251 learned_addr learned my addr 172.21.15.50:0/4093568251 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.286+0000 7ff472a00640 1 -- 172.21.15.50:0/4093568251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559896400e50 msgr2=0x5598964055a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.286+0000 7ff472a00640 1 --2- 172.21.15.50:0/4093568251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559896400e50 0x5598964055a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.286+0000 7ff472a00640 1 -- 172.21.15.50:0/4093568251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598963f6590 msgr2=0x559896405060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.286+0000 7ff472a00640 1 --2- 172.21.15.50:0/4093568251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598963f6590 0x559896405060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.286+0000 7ff472a00640 1 -- 172.21.15.50:0/4093568251 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989647ad40 con 0x5598963f5c70 2024-09-10T10:15:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.287+0000 7ff472a00640 1 --2- 172.21.15.50:0/4093568251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 0x559896404b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff464014e70 tx=0x7ff464097100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d2ec51e3e65b108 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:08.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.287+0000 7ff460c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:15:08.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.291+0000 7ff460c00640 1 -- 172.21.15.50:0/4093568251 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4640a8060 con 0x5598963f5c70 2024-09-10T10:15:08.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.291+0000 7ff460c00640 1 -- 172.21.15.50:0/4093568251 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7ff464098e60 con 0x5598963f5c70 2024-09-10T10:15:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.293+0000 7ff47c467740 1 -- 172.21.15.50:0/4093568251 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4640cc1f0 con 0x5598963f5c70 2024-09-10T10:15:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.293+0000 7ff460c00640 1 -- 172.21.15.50:0/4093568251 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff46407e030 con 0x5598963f5c70 2024-09-10T10:15:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.294+0000 7ff47c467740 10 client.26119 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:08.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.296+0000 7ff47c467740 1 -- 172.21.15.50:0/4093568251 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55989647bf80 con 0x5598963f5c70 2024-09-10T10:15:08.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.298+0000 7ff460c00640 1 -- 172.21.15.50:0/4093568251 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4640cc1f0 con 0x5598963f5c70 2024-09-10T10:15:08.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.301+0000 7ff460c00640 1 -- 172.21.15.50:0/4093568251 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff464099c80 con 0x5598963f5c70 2024-09-10T10:15:08.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.302+0000 7ff47c467740 10 client.26119 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:08.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.302+0000 7ff47c467740 10 client.26119 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:15:08.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.303+0000 7ff47c467740 20 client.26119 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:08.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.304+0000 7ff47c467740 1 --2- 172.21.15.50:0/4093568251 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55989647c1b0 0x55989647e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:08.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.304+0000 7ff47c467740 4 client.26119 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:15:08.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.304+0000 7ff47c467740 1 -- 172.21.15.50:0/4093568251 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559896369950 con 0x55989647c1b0 2024-09-10T10:15:08.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.308+0000 7ff472000640 1 --2- 172.21.15.50:0/4093568251 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55989647c1b0 0x55989647e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.310+0000 7ff472000640 1 --2- 172.21.15.50:0/4093568251 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55989647c1b0 0x55989647e5a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ba7b4a9ffed63eb9 server_cookie=32d6c5b79942c4fd in_seq=0 out_seq=0 2024-09-10T10:15:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.311+0000 7ff460c00640 10 client.26119 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:15:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.313+0000 7ff460c00640 1 -- 172.21.15.50:0/4093568251 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559896369950 con 0x55989647c1b0 2024-09-10T10:15:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.313+0000 7ff460c00640 10 client.26119 handle_command_reply: tid=0 2024-09-10T10:15:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.313+0000 7ff47c467740 1 client.26119 shutdown 2024-09-10T10:15:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.316+0000 7ff47c467740 1 -- 172.21.15.50:0/4093568251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 msgr2=0x559896404b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:08.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.316+0000 7ff47c467740 1 --2- 172.21.15.50:0/4093568251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 0x559896404b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff464014e70 tx=0x7ff464097100 comp rx=0 tx=0).stop 2024-09-10T10:15:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.319+0000 7ff47c467740 1 -- 172.21.15.50:0/4093568251 shutdown_connections 2024-09-10T10:15:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.319+0000 7ff47c467740 1 --2- 172.21.15.50:0/4093568251 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55989647c1b0 0x55989647e5a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.320+0000 7ff47c467740 1 --2- 172.21.15.50:0/4093568251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559896400e50 0x5598964055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.320+0000 7ff47c467740 1 --2- 172.21.15.50:0/4093568251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598963f6590 0x559896405060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.320+0000 7ff47c467740 1 --2- 172.21.15.50:0/4093568251 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5598963f5c70 0x559896404b20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.320+0000 7ff47c467740 1 -- 172.21.15.50:0/4093568251 >> 172.21.15.50:0/4093568251 conn(0x5598963f2200 msgr2=0x5598963fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:08.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.321+0000 7ff460c00640 0 client.26119 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:15:08.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.322+0000 7ff47c467740 1 -- 172.21.15.50:0/4093568251 shutdown_connections 2024-09-10T10:15:08.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.323+0000 7ff47c467740 1 -- 172.21.15.50:0/4093568251 wait complete. 2024-09-10T10:15:08.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.324+0000 7ff47c467740 20 client.26119 trim_cache size 0 max 16384 2024-09-10T10:15:08.330 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:15:08.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.330+0000 7ff479a00640 1 -- 172.21.15.50:0/440778704 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ff4540a2c80 msgr2=0x7ff4540a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.330+0000 7ff479a00640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ff4540a2c80 0x7ff4540a5140 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff47419fdf0 tx=0x7ff45c005d90 comp rx=0 tx=0).stop 2024-09-10T10:15:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.330+0000 7ff479a00640 1 -- 172.21.15.50:0/440778704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff474109450 msgr2=0x7ff4741a33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.330+0000 7ff479a00640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff474109450 0x7ff4741a33c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff46400ba50 tx=0x7ff46400bf10 comp rx=0 tx=0).stop 2024-09-10T10:15:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.330+0000 7ff479a00640 1 -- 172.21.15.50:0/440778704 shutdown_connections 2024-09-10T10:15:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.330+0000 7ff479a00640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7ff4540a2c80 0x7ff4540a5140 secure :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff47419fdf0 tx=0x7ff45c005d90 comp rx=0 tx=0).stop 2024-09-10T10:15:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.330+0000 7ff479a00640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff47410ea80 0x7ff47419e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.330+0000 7ff479a00640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff474109e00 0x7ff4741a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.330+0000 7ff479a00640 1 --2- 172.21.15.50:0/440778704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff474109450 0x7ff4741a33c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.330+0000 7ff479a00640 1 -- 172.21.15.50:0/440778704 >> 172.21.15.50:0/440778704 conn(0x7ff47406e2d0 msgr2=0x7ff47410c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.331+0000 7ff479a00640 1 -- 172.21.15.50:0/440778704 shutdown_connections 2024-09-10T10:15:08.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:08.331+0000 7ff479a00640 1 -- 172.21.15.50:0/440778704 wait complete. 2024-09-10T10:15:08.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:08 smithi189 ceph-mon[34999]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 274 MiB/s wr, 79 op/s 2024-09-10T10:15:08.598 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:08 smithi084 ceph-mon[34812]: pgmap v509: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 274 MiB/s wr, 79 op/s 2024-09-10T10:15:08.738 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:09.698 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T10:15:10.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:10 smithi050 ceph-mon[30354]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 296 MiB/s wr, 82 op/s 2024-09-10T10:15:10.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.564+0000 7f305e200640 1 -- 172.21.15.50:0/3702947026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3058069290 msgr2=0x7f30581049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:10.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.564+0000 7f305e200640 1 --2- 172.21.15.50:0/3702947026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3058069290 0x7f30581049f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3048009900 tx=0x7f304802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:15:10.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.564+0000 7f305e200640 1 -- 172.21.15.50:0/3702947026 shutdown_connections 2024-09-10T10:15:10.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.564+0000 7f305e200640 1 --2- 172.21.15.50:0/3702947026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f305810ac90 0x7f305810d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:10.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.564+0000 7f305e200640 1 --2- 172.21.15.50:0/3702947026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3058100910 0x7f3058104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:10.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.564+0000 7f305e200640 1 --2- 172.21.15.50:0/3702947026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3058069290 0x7f30581049f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:10.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.564+0000 7f305e200640 1 -- 172.21.15.50:0/3702947026 >> 172.21.15.50:0/3702947026 conn(0x7f30580fba90 msgr2=0x7f30580fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:10.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.565+0000 7f305e200640 1 -- 172.21.15.50:0/3702947026 shutdown_connections 2024-09-10T10:15:10.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.565+0000 7f305e200640 1 -- 172.21.15.50:0/3702947026 wait complete. 2024-09-10T10:15:10.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.566+0000 7f305e200640 1 Processor -- start 2024-09-10T10:15:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.566+0000 7f305e200640 1 -- start start 2024-09-10T10:15:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.566+0000 7f305e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3058069290 0x7f305819f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.566+0000 7f305e200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3058100910 0x7f305819f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.566+0000 7f305e200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f305810ac90 0x7f3058109900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.566+0000 7f305e200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3058111f90 con 0x7f3058100910 2024-09-10T10:15:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.566+0000 7f305e200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3058111e10 con 0x7f3058069290 2024-09-10T10:15:10.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.566+0000 7f305e200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3058112110 con 0x7f305810ac90 2024-09-10T10:15:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.567+0000 7f3057400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3058069290 0x7f305819f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.567+0000 7f3057400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3058069290 0x7f305819f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:59360/0 (socket says 172.21.15.50:59360) 2024-09-10T10:15:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.567+0000 7f3057400640 1 -- 172.21.15.50:0/2926231725 learned_addr learned my addr 172.21.15.50:0/2926231725 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.567+0000 7f3057e00640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f305810ac90 0x7f3058109900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.567+0000 7f3056a00640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3058100910 0x7f305819f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.567+0000 7f3057400640 1 -- 172.21.15.50:0/2926231725 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f305810ac90 msgr2=0x7f3058109900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.567+0000 7f3057400640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f305810ac90 0x7f3058109900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:10.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.567+0000 7f3057400640 1 -- 172.21.15.50:0/2926231725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3058100910 msgr2=0x7f305819f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.567+0000 7f3057400640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3058100910 0x7f305819f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.567+0000 7f3057400640 1 -- 172.21.15.50:0/2926231725 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305810a080 con 0x7f3058069290 2024-09-10T10:15:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.567+0000 7f3057e00640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f305810ac90 0x7f3058109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.567+0000 7f3056a00640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3058100910 0x7f305819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:15:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.568+0000 7f3057400640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3058069290 0x7f305819f2b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3048004770 tx=0x7f3048003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.568+0000 7f304fe00640 1 -- 172.21.15.50:0/2926231725 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304803f070 con 0x7f3058069290 2024-09-10T10:15:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.568+0000 7f304fe00640 1 -- 172.21.15.50:0/2926231725 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3048031ca0 con 0x7f3058069290 2024-09-10T10:15:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.568+0000 7f305e200640 1 -- 172.21.15.50:0/2926231725 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f305810a310 con 0x7f3058069290 2024-09-10T10:15:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.568+0000 7f304fe00640 1 -- 172.21.15.50:0/2926231725 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3048035030 con 0x7f3058069290 2024-09-10T10:15:10.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.568+0000 7f305e200640 1 -- 172.21.15.50:0/2926231725 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3058197440 con 0x7f3058069290 2024-09-10T10:15:10.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.570+0000 7f305e200640 1 -- 172.21.15.50:0/2926231725 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30581014d0 con 0x7f3058069290 2024-09-10T10:15:10.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.572+0000 7f304fe00640 1 -- 172.21.15.50:0/2926231725 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3048042070 con 0x7f3058069290 2024-09-10T10:15:10.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.573+0000 7f304fe00640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f303c0a2c00 0x7f303c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.574+0000 7f304fe00640 1 -- 172.21.15.50:0/2926231725 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f30480efea0 con 0x7f3058069290 2024-09-10T10:15:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.574+0000 7f3056a00640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f303c0a2c00 0x7f303c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.575+0000 7f3056a00640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f303c0a2c00 0x7f303c0a50c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f305810aac0 tx=0x7f3044005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:10.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:10.576+0000 7f304fe00640 1 -- 172.21.15.50:0/2926231725 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3048049030 con 0x7f3058069290 2024-09-10T10:15:10.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:10 smithi189 ceph-mon[34999]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 296 MiB/s wr, 82 op/s 2024-09-10T10:15:10.598 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:10 smithi084 ceph-mon[34812]: pgmap v510: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 296 MiB/s wr, 82 op/s 2024-09-10T10:15:10.650 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:11.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.022+0000 7f305e200640 1 -- 172.21.15.50:0/2926231725 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30581049f0 con 0x7f3058069290 2024-09-10T10:15:11.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.023+0000 7f304fe00640 1 -- 172.21.15.50:0/2926231725 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f30581049f0 con 0x7f3058069290 2024-09-10T10:15:11.026 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:15:11.026 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:15:11.026 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:15:11.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.026+0000 7f305e200640 1 -- 172.21.15.50:0/2926231725 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f303c0a2c00 msgr2=0x7f303c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:11.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.026+0000 7f305e200640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f303c0a2c00 0x7f303c0a50c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f305810aac0 tx=0x7f3044005f90 comp rx=0 tx=0).stop 2024-09-10T10:15:11.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.026+0000 7f305e200640 1 -- 172.21.15.50:0/2926231725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3058069290 msgr2=0x7f305819f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.026+0000 7f305e200640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3058069290 0x7f305819f2b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3048004770 tx=0x7f3048003c10 comp rx=0 tx=0).stop 2024-09-10T10:15:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.026+0000 7f305e200640 1 -- 172.21.15.50:0/2926231725 shutdown_connections 2024-09-10T10:15:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.026+0000 7f305e200640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f303c0a2c00 0x7f303c0a50c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.026+0000 7f305e200640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f305810ac90 0x7f3058109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.026+0000 7f305e200640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3058100910 0x7f305819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.026+0000 7f305e200640 1 --2- 172.21.15.50:0/2926231725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3058069290 0x7f305819f2b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:11.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.026+0000 7f305e200640 1 -- 172.21.15.50:0/2926231725 >> 172.21.15.50:0/2926231725 conn(0x7f30580fba90 msgr2=0x7f305810eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.027+0000 7f305e200640 1 -- 172.21.15.50:0/2926231725 shutdown_connections 2024-09-10T10:15:11.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:11.027+0000 7f305e200640 1 -- 172.21.15.50:0/2926231725 wait complete. 2024-09-10T10:15:11.468 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:11 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2926231725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:11.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:11 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2926231725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:11.600 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:11 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2926231725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.198+0000 7fe34be00640 1 -- 172.21.15.50:0/295022930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3440a5140 msgr2=0x7fe3440b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.198+0000 7fe34be00640 1 --2- 172.21.15.50:0/295022930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3440a5140 0x7fe3440b7000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe338009900 tx=0x7fe33802a480 comp rx=0 tx=0).stop 2024-09-10T10:15:12.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.199+0000 7fe34be00640 1 -- 172.21.15.50:0/295022930 shutdown_connections 2024-09-10T10:15:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.199+0000 7fe34be00640 1 --2- 172.21.15.50:0/295022930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3440b7540 0x7fe3440b9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.199+0000 7fe34be00640 1 --2- 172.21.15.50:0/295022930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3440a5140 0x7fe3440b7000 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.199+0000 7fe34be00640 1 --2- 172.21.15.50:0/295022930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3440a4820 0x7fe3440a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.199+0000 7fe34be00640 1 -- 172.21.15.50:0/295022930 >> 172.21.15.50:0/295022930 conn(0x7fe34401a0e0 msgr2=0x7fe34401a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:12.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.201+0000 7fe34be00640 1 -- 172.21.15.50:0/295022930 shutdown_connections 2024-09-10T10:15:12.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.201+0000 7fe34be00640 1 -- 172.21.15.50:0/295022930 wait complete. 2024-09-10T10:15:12.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.203+0000 7fe34be00640 1 Processor -- start 2024-09-10T10:15:12.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.203+0000 7fe34be00640 1 -- start start 2024-09-10T10:15:12.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.204+0000 7fe34be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3440a4820 0x7fe344143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.204+0000 7fe34be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3440a5140 0x7fe344143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.204+0000 7fe34be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3440b7540 0x7fe344147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.204+0000 7fe34be00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3440bcfd0 con 0x7fe3440a4820 2024-09-10T10:15:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.204+0000 7fe34be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe3440bce50 con 0x7fe3440a5140 2024-09-10T10:15:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.204+0000 7fe34be00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3440bd150 con 0x7fe3440b7540 2024-09-10T10:15:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.205+0000 7fe34b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3440b7540 0x7fe344147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.205+0000 7fe34b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3440b7540 0x7fe344147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:37514/0 (socket says 172.21.15.50:37514) 2024-09-10T10:15:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.205+0000 7fe34b400640 1 -- 172.21.15.50:0/2694455353 learned_addr learned my addr 172.21.15.50:0/2694455353 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.205+0000 7fe34a000640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3440a5140 0x7fe344143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.205+0000 7fe34aa00640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3440a4820 0x7fe344143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.205+0000 7fe34b400640 1 -- 172.21.15.50:0/2694455353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3440a5140 msgr2=0x7fe344143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.205+0000 7fe34b400640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3440a5140 0x7fe344143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.205+0000 7fe34b400640 1 -- 172.21.15.50:0/2694455353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3440a4820 msgr2=0x7fe344143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:12.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.205+0000 7fe34b400640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3440a4820 0x7fe344143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.205+0000 7fe34b400640 1 -- 172.21.15.50:0/2694455353 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3441483e0 con 0x7fe3440b7540 2024-09-10T10:15:12.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.206+0000 7fe34b400640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3440b7540 0x7fe344147d00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe34c050280 tx=0x7fe34c072b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:12.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.207+0000 7fe343400640 1 -- 172.21.15.50:0/2694455353 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c06bbd0 con 0x7fe3440b7540 2024-09-10T10:15:12.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.207+0000 7fe343400640 1 -- 172.21.15.50:0/2694455353 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe34c06bd70 con 0x7fe3440b7540 2024-09-10T10:15:12.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.207+0000 7fe343400640 1 -- 172.21.15.50:0/2694455353 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c07a7a0 con 0x7fe3440b7540 2024-09-10T10:15:12.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.207+0000 7fe34be00640 1 -- 172.21.15.50:0/2694455353 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3441486d0 con 0x7fe3440b7540 2024-09-10T10:15:12.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.208+0000 7fe34be00640 1 -- 172.21.15.50:0/2694455353 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34414ffb0 con 0x7fe3440b7540 2024-09-10T10:15:12.216 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.214+0000 7fe354289740 1 Processor -- start 2024-09-10T10:15:12.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.215+0000 7fe343400640 1 -- 172.21.15.50:0/2694455353 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe34c06fae0 con 0x7fe3440b7540 2024-09-10T10:15:12.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.215+0000 7fe354289740 1 -- start start 2024-09-10T10:15:12.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.215+0000 7fe354289740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f5e70 0x5583750f6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.215+0000 7fe354289740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f6790 0x558375100b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.215+0000 7fe354289740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x558375103440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.215+0000 7fe354289740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55837505c3e0 con 0x5583750f5e70 2024-09-10T10:15:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.215+0000 7fe354289740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558375003d80 con 0x5583750f6790 2024-09-10T10:15:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.216+0000 7fe354289740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5583750583a0 con 0x558375101050 2024-09-10T10:15:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.216+0000 7fe34a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f5e70 0x5583750f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.216+0000 7fe34a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f5e70 0x5583750f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44910/0 (socket says 172.21.15.50:44910) 2024-09-10T10:15:12.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.216+0000 7fe34a000640 1 -- 172.21.15.50:0/394810840 learned_addr learned my addr 172.21.15.50:0/394810840 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.216+0000 7fe34a000640 1 --2- 172.21.15.50:0/394810840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x558375103440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.216+0000 7fe34aa00640 1 --2- 172.21.15.50:0/394810840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f6790 0x558375100b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.217+0000 7fe34a000640 1 -- 172.21.15.50:0/394810840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f6790 msgr2=0x558375100b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.217+0000 7fe34a000640 1 --2- 172.21.15.50:0/394810840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f6790 0x558375100b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.217+0000 7fe34a000640 1 -- 172.21.15.50:0/394810840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f5e70 msgr2=0x5583750f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.217+0000 7fe34a000640 1 --2- 172.21.15.50:0/394810840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f5e70 0x5583750f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.217+0000 7fe34a000640 1 -- 172.21.15.50:0/394810840 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558375022ae0 con 0x558375101050 2024-09-10T10:15:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.217+0000 7fe34aa00640 1 --2- 172.21.15.50:0/394810840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f6790 0x558375100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.217+0000 7fe34a000640 1 --2- 172.21.15.50:0/394810840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x558375103440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe338009900 tx=0x7fe33802a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99838cf2b12a454 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.217+0000 7fe343400640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe3300a2d10 0x7fe3300a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.218+0000 7fe343400640 1 -- 172.21.15.50:0/2694455353 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe34c1337e0 con 0x7fe3440b7540 2024-09-10T10:15:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.218+0000 7fe337e00640 1 -- 172.21.15.50:0/394810840 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338041070 con 0x558375101050 2024-09-10T10:15:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.218+0000 7fe337e00640 1 -- 172.21.15.50:0/394810840 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3380047a0 con 0x558375101050 2024-09-10T10:15:12.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.218+0000 7fe337e00640 1 -- 172.21.15.50:0/394810840 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338035040 con 0x558375101050 2024-09-10T10:15:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.218+0000 7fe34aa00640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe3300a2d10 0x7fe3300a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.219+0000 7fe354289740 1 -- 172.21.15.50:0/394810840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 msgr2=0x558375103440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.219+0000 7fe354289740 1 --2- 172.21.15.50:0/394810840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x558375103440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe338009900 tx=0x7fe33802a480 comp rx=0 tx=0).stop 2024-09-10T10:15:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.219+0000 7fe34aa00640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe3300a2d10 0x7fe3300a51d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe33c005fd0 tx=0x7fe33c005f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.219+0000 7fe354289740 1 -- 172.21.15.50:0/394810840 shutdown_connections 2024-09-10T10:15:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.219+0000 7fe354289740 1 --2- 172.21.15.50:0/394810840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x558375103440 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.219+0000 7fe354289740 1 --2- 172.21.15.50:0/394810840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f6790 0x558375100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.219+0000 7fe354289740 1 --2- 172.21.15.50:0/394810840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f5e70 0x5583750f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.219+0000 7fe354289740 1 -- 172.21.15.50:0/394810840 >> 172.21.15.50:0/394810840 conn(0x5583750f2400 msgr2=0x5583750f27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.219+0000 7fe354289740 1 -- 172.21.15.50:0/394810840 shutdown_connections 2024-09-10T10:15:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.220+0000 7fe354289740 1 -- 172.21.15.50:0/394810840 wait complete. 2024-09-10T10:15:12.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.220+0000 7fe354289740 1 -- start start 2024-09-10T10:15:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.220+0000 7fe354289740 1 Processor -- start 2024-09-10T10:15:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.221+0000 7fe354289740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f5e70 0x5583750fdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.221+0000 7fe354289740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f6790 0x5583750fe4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.221+0000 7fe354289740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x5583750fea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.221+0000 7fe354289740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558375114c30 con 0x5583750f6790 2024-09-10T10:15:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.221+0000 7fe354289740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5583750170f0 con 0x5583750f5e70 2024-09-10T10:15:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.221+0000 7fe354289740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558375114db0 con 0x558375101050 2024-09-10T10:15:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.221+0000 7fe354289740 10 client.0 _ll_register_callbacks cb 0x558374ffebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.221+0000 7fe34a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f6790 0x5583750fe4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.221+0000 7fe34a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f6790 0x5583750fe4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44918/0 (socket says 172.21.15.50:44918) 2024-09-10T10:15:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.221+0000 7fe34a000640 1 -- 172.21.15.50:0/972984186 learned_addr learned my addr 172.21.15.50:0/972984186 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.222+0000 7fe34a000640 1 -- 172.21.15.50:0/972984186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 msgr2=0x5583750fea00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:15:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.222+0000 7fe34a000640 1 --2- 172.21.15.50:0/972984186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x5583750fea00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.222+0000 7fe34a000640 1 -- 172.21.15.50:0/972984186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f5e70 msgr2=0x5583750fdf80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:15:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.222+0000 7fe34a000640 1 --2- 172.21.15.50:0/972984186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f5e70 0x5583750fdf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.222+0000 7fe34a000640 1 -- 172.21.15.50:0/972984186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558374dcd3c0 con 0x5583750f6790 2024-09-10T10:15:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.222+0000 7fe34a000640 1 --2- 172.21.15.50:0/972984186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f6790 0x5583750fe4c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe3380057c0 tx=0x7fe338004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c289aa08add847d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.222+0000 7fe334c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:15:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.222+0000 7fe334c00640 1 -- 172.21.15.50:0/972984186 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33804d030 con 0x5583750f6790 2024-09-10T10:15:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.223+0000 7fe354289740 1 -- 172.21.15.50:0/972984186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3380047a0 con 0x5583750f6790 2024-09-10T10:15:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.223+0000 7fe334c00640 1 -- 172.21.15.50:0/972984186 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe338005000 con 0x5583750f6790 2024-09-10T10:15:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.223+0000 7fe334c00640 1 -- 172.21.15.50:0/972984186 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe338000e60 con 0x5583750f6790 2024-09-10T10:15:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.223+0000 7fe354289740 10 client.16062 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.223+0000 7fe354289740 1 -- 172.21.15.50:0/972984186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558375120c60 con 0x5583750f6790 2024-09-10T10:15:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.224+0000 7fe334c00640 1 -- 172.21.15.50:0/972984186 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3380047a0 con 0x5583750f6790 2024-09-10T10:15:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.224+0000 7fe334c00640 1 -- 172.21.15.50:0/972984186 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe3380315b0 con 0x5583750f6790 2024-09-10T10:15:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.224+0000 7fe354289740 10 client.16062 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.224+0000 7fe354289740 10 client.16062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:15:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.224+0000 7fe354289740 20 client.16062 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.224+0000 7fe354289740 1 --2- 172.21.15.50:0/972984186 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x558375121fb0 0x5583751243a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.224+0000 7fe354289740 4 client.16062 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:15:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.224+0000 7fe354289740 1 -- 172.21.15.50:0/972984186 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558375069950 con 0x558375121fb0 2024-09-10T10:15:12.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.230+0000 7fe34aa00640 1 --2- 172.21.15.50:0/972984186 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x558375121fb0 0x5583751243a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.231+0000 7fe34aa00640 1 --2- 172.21.15.50:0/972984186 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x558375121fb0 0x5583751243a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=354034ed3fa58f13 server_cookie=511ad1082ab8de1a in_seq=0 out_seq=0 2024-09-10T10:15:12.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.232+0000 7fe334c00640 10 client.16062 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:12.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.233+0000 7fe334c00640 1 -- 172.21.15.50:0/972984186 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558375069950 con 0x558375121fb0 2024-09-10T10:15:12.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.233+0000 7fe334c00640 10 client.16062 handle_command_reply: tid=0 2024-09-10T10:15:12.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.233+0000 7fe354289740 1 client.16062 shutdown 2024-09-10T10:15:12.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.238+0000 7fe354289740 1 -- 172.21.15.50:0/972984186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f6790 msgr2=0x5583750fe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:12.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.238+0000 7fe354289740 1 --2- 172.21.15.50:0/972984186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f6790 0x5583750fe4c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe3380057c0 tx=0x7fe338004b60 comp rx=0 tx=0).stop 2024-09-10T10:15:12.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.238+0000 7fe354289740 1 -- 172.21.15.50:0/972984186 shutdown_connections 2024-09-10T10:15:12.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.238+0000 7fe354289740 1 --2- 172.21.15.50:0/972984186 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x558375121fb0 0x5583751243a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.238+0000 7fe354289740 1 --2- 172.21.15.50:0/972984186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x5583750fea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.238+0000 7fe354289740 1 --2- 172.21.15.50:0/972984186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f6790 0x5583750fe4c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.238+0000 7fe354289740 1 --2- 172.21.15.50:0/972984186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f5e70 0x5583750fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.238+0000 7fe354289740 1 -- 172.21.15.50:0/972984186 >> 172.21.15.50:0/972984186 conn(0x5583750f2400 msgr2=0x5583750f8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.239+0000 7fe334c00640 0 client.16062 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.239+0000 7fe354289740 1 -- 172.21.15.50:0/972984186 shutdown_connections 2024-09-10T10:15:12.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.240+0000 7fe354289740 1 -- 172.21.15.50:0/972984186 wait complete. 2024-09-10T10:15:12.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.243+0000 7fe354289740 20 client.16062 trim_cache size 0 max 16384 2024-09-10T10:15:12.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.265+0000 7fe354289740 1 Processor -- start 2024-09-10T10:15:12.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.265+0000 7fe354289740 1 -- start start 2024-09-10T10:15:12.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.265+0000 7fe354289740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f5e70 0x5583750fe850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.266+0000 7fe354289740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f6790 0x5583750ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.266+0000 7fe354289740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x558375129a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.266+0000 7fe354289740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe344153d50 con 0x5583750f6790 2024-09-10T10:15:12.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.266+0000 7fe354289740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe344151620 con 0x5583750f5e70 2024-09-10T10:15:12.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.266+0000 7fe354289740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe344144790 con 0x558375101050 2024-09-10T10:15:12.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.266+0000 7fe34a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f6790 0x5583750ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.267+0000 7fe34b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x558375129a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.267+0000 7fe34b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x558375129a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:37528/0 (socket says 172.21.15.50:37528) 2024-09-10T10:15:12.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.267+0000 7fe34b400640 1 -- 172.21.15.50:0/1808162969 learned_addr learned my addr 172.21.15.50:0/1808162969 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:12.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.267+0000 7fe34aa00640 1 --2- 172.21.15.50:0/1808162969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f5e70 0x5583750fe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.267+0000 7fe34b400640 1 -- 172.21.15.50:0/1808162969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f5e70 msgr2=0x5583750fe850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:12.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.267+0000 7fe34b400640 1 --2- 172.21.15.50:0/1808162969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f5e70 0x5583750fe850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.267+0000 7fe34b400640 1 -- 172.21.15.50:0/1808162969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f6790 msgr2=0x5583750ffef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:12.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.267+0000 7fe34b400640 1 --2- 172.21.15.50:0/1808162969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f6790 0x5583750ffef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.267+0000 7fe34b400640 1 -- 172.21.15.50:0/1808162969 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583750f3090 con 0x558375101050 2024-09-10T10:15:12.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.268+0000 7fe34b400640 1 --2- 172.21.15.50:0/1808162969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x558375129a00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe34c050a30 tx=0x7fe34c0ff790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b90a92bd66282e46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:12.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.268+0000 7fe337400640 1 -- 172.21.15.50:0/1808162969 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c115070 con 0x558375101050 2024-09-10T10:15:12.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.268+0000 7fe337400640 1 -- 172.21.15.50:0/1808162969 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe34c118e50 con 0x558375101050 2024-09-10T10:15:12.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.268+0000 7fe337400640 1 -- 172.21.15.50:0/1808162969 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c108430 con 0x558375101050 2024-09-10T10:15:12.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.269+0000 7fe354289740 1 -- 172.21.15.50:0/1808162969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 msgr2=0x558375129a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:12.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.269+0000 7fe354289740 1 --2- 172.21.15.50:0/1808162969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x558375129a00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe34c050a30 tx=0x7fe34c0ff790 comp rx=0 tx=0).stop 2024-09-10T10:15:12.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.269+0000 7fe354289740 1 -- 172.21.15.50:0/1808162969 shutdown_connections 2024-09-10T10:15:12.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.269+0000 7fe354289740 1 --2- 172.21.15.50:0/1808162969 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558375101050 0x558375129a00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.269+0000 7fe354289740 1 --2- 172.21.15.50:0/1808162969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f6790 0x5583750ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.269+0000 7fe354289740 1 --2- 172.21.15.50:0/1808162969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5583750f5e70 0x5583750fe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.269+0000 7fe354289740 1 -- 172.21.15.50:0/1808162969 >> 172.21.15.50:0/1808162969 conn(0x5583750f2400 msgr2=0x5583750ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:12.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.270+0000 7fe354289740 1 -- 172.21.15.50:0/1808162969 shutdown_connections 2024-09-10T10:15:12.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.270+0000 7fe354289740 1 -- 172.21.15.50:0/1808162969 wait complete. 2024-09-10T10:15:12.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.270+0000 7fe354289740 1 -- start start 2024-09-10T10:15:12.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.271+0000 7fe354289740 1 Processor -- start 2024-09-10T10:15:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.271+0000 7fe354289740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f5e70 0x5583750fb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.271+0000 7fe354289740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583750f6790 0x5583750fb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.271+0000 7fe354289740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558375101050 0x5583750fbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.271+0000 7fe354289740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3440b49d0 con 0x5583750f5e70 2024-09-10T10:15:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.271+0000 7fe354289740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe344150fa0 con 0x558375101050 2024-09-10T10:15:12.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.271+0000 7fe354289740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe344150220 con 0x5583750f6790 2024-09-10T10:15:12.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.271+0000 7fe354289740 10 client.0 _ll_register_callbacks cb 0x7fe338004580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:12.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.272+0000 7fe34b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558375101050 0x5583750fbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.272+0000 7fe34b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558375101050 0x5583750fbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:59436/0 (socket says 172.21.15.50:59436) 2024-09-10T10:15:12.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.272+0000 7fe34b400640 1 -- 172.21.15.50:0/1263820658 learned_addr learned my addr 172.21.15.50:0/1263820658 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:12.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.272+0000 7fe34a000640 1 --2- 172.21.15.50:0/1263820658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583750f6790 0x5583750fb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.272+0000 7fe34aa00640 1 --2- 172.21.15.50:0/1263820658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f5e70 0x5583750fb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.272+0000 7fe34b400640 1 -- 172.21.15.50:0/1263820658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583750f6790 msgr2=0x5583750fb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:12.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.272+0000 7fe34b400640 1 --2- 172.21.15.50:0/1263820658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583750f6790 0x5583750fb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.272+0000 7fe34b400640 1 -- 172.21.15.50:0/1263820658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f5e70 msgr2=0x5583750fb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:12.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.272+0000 7fe34b400640 1 --2- 172.21.15.50:0/1263820658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f5e70 0x5583750fb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.272+0000 7fe34b400640 1 -- 172.21.15.50:0/1263820658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837518ba80 con 0x558375101050 2024-09-10T10:15:12.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.273+0000 7fe34b400640 1 --2- 172.21.15.50:0/1263820658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558375101050 0x5583750fbaf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe34c108390 tx=0x7fe34c06fdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd5c1f6ce0b9b287 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:12.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.273+0000 7fe334c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:15:12.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.273+0000 7fe334c00640 1 -- 172.21.15.50:0/1263820658 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c115070 con 0x558375101050 2024-09-10T10:15:12.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.274+0000 7fe334c00640 1 -- 172.21.15.50:0/1263820658 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe34c108630 con 0x558375101050 2024-09-10T10:15:12.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.274+0000 7fe354289740 1 -- 172.21.15.50:0/1263820658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe34c118e50 con 0x558375101050 2024-09-10T10:15:12.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.274+0000 7fe334c00640 1 -- 172.21.15.50:0/1263820658 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe34c0ffc50 con 0x558375101050 2024-09-10T10:15:12.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.274+0000 7fe354289740 10 client.26141 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:12.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.274+0000 7fe354289740 1 -- 172.21.15.50:0/1263820658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55837518cd60 con 0x558375101050 2024-09-10T10:15:12.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.274+0000 7fe334c00640 1 -- 172.21.15.50:0/1263820658 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe34c118e50 con 0x558375101050 2024-09-10T10:15:12.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.274+0000 7fe334c00640 1 -- 172.21.15.50:0/1263820658 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe34c079070 con 0x558375101050 2024-09-10T10:15:12.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.275+0000 7fe354289740 10 client.26141 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:12.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.275+0000 7fe354289740 10 client.26141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:15:12.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.275+0000 7fe354289740 20 client.26141 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:12.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.275+0000 7fe354289740 1 --2- 172.21.15.50:0/1263820658 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55837518d430 0x55837518f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:12.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.275+0000 7fe354289740 4 client.26141 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:15:12.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.275+0000 7fe354289740 1 -- 172.21.15.50:0/1263820658 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558375063e60 con 0x55837518d430 2024-09-10T10:15:12.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.275+0000 7fe34aa00640 1 --2- 172.21.15.50:0/1263820658 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55837518d430 0x55837518f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:12.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.276+0000 7fe34aa00640 1 --2- 172.21.15.50:0/1263820658 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55837518d430 0x55837518f850 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=267c58ee41742992 server_cookie=6f9c681acc7da389 in_seq=0 out_seq=0 2024-09-10T10:15:12.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.276+0000 7fe334c00640 10 client.26141 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:12.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.276+0000 7fe334c00640 1 -- 172.21.15.50:0/1263820658 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558375063e60 con 0x55837518d430 2024-09-10T10:15:12.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.276+0000 7fe334c00640 10 client.26141 handle_command_reply: tid=0 2024-09-10T10:15:12.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.276+0000 7fe354289740 1 client.26141 shutdown 2024-09-10T10:15:12.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.276+0000 7fe354289740 1 -- 172.21.15.50:0/1263820658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558375101050 msgr2=0x5583750fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:12.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.277+0000 7fe354289740 1 --2- 172.21.15.50:0/1263820658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558375101050 0x5583750fbaf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe34c108390 tx=0x7fe34c06fdd0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.277+0000 7fe354289740 1 -- 172.21.15.50:0/1263820658 shutdown_connections 2024-09-10T10:15:12.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.277+0000 7fe354289740 1 --2- 172.21.15.50:0/1263820658 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55837518d430 0x55837518f850 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.277+0000 7fe354289740 1 --2- 172.21.15.50:0/1263820658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558375101050 0x5583750fbaf0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.277+0000 7fe354289740 1 --2- 172.21.15.50:0/1263820658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5583750f6790 0x5583750fb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.277+0000 7fe354289740 1 --2- 172.21.15.50:0/1263820658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583750f5e70 0x5583750fb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.277+0000 7fe354289740 1 -- 172.21.15.50:0/1263820658 >> 172.21.15.50:0/1263820658 conn(0x5583750f2400 msgr2=0x5583750f1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:12.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.277+0000 7fe334c00640 0 client.26141 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:12.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.277+0000 7fe354289740 1 -- 172.21.15.50:0/1263820658 shutdown_connections 2024-09-10T10:15:12.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.277+0000 7fe354289740 1 -- 172.21.15.50:0/1263820658 wait complete. 2024-09-10T10:15:12.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.280+0000 7fe354289740 20 client.26141 trim_cache size 0 max 16384 2024-09-10T10:15:12.283 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:15:12.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.285+0000 7fe34be00640 1 -- 172.21.15.50:0/2694455353 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe3300a2d10 msgr2=0x7fe3300a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:12.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.285+0000 7fe34be00640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe3300a2d10 0x7fe3300a51d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe33c005fd0 tx=0x7fe33c005f40 comp rx=0 tx=0).stop 2024-09-10T10:15:12.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.285+0000 7fe34be00640 1 -- 172.21.15.50:0/2694455353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3440b7540 msgr2=0x7fe344147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:12.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.285+0000 7fe34be00640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3440b7540 0x7fe344147d00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe34c050280 tx=0x7fe34c072b80 comp rx=0 tx=0).stop 2024-09-10T10:15:12.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.286+0000 7fe34be00640 1 -- 172.21.15.50:0/2694455353 shutdown_connections 2024-09-10T10:15:12.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.286+0000 7fe34be00640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe3300a2d10 0x7fe3300a51d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.286+0000 7fe34be00640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3440b7540 0x7fe344147d00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.286+0000 7fe34be00640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3440a5140 0x7fe344143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.286+0000 7fe34be00640 1 --2- 172.21.15.50:0/2694455353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3440a4820 0x7fe344143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.286+0000 7fe34be00640 1 -- 172.21.15.50:0/2694455353 >> 172.21.15.50:0/2694455353 conn(0x7fe34401a0e0 msgr2=0x7fe3440b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.288+0000 7fe34be00640 1 -- 172.21.15.50:0/2694455353 shutdown_connections 2024-09-10T10:15:12.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:12.289+0000 7fe34be00640 1 -- 172.21.15.50:0/2694455353 wait complete. 2024-09-10T10:15:12.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:12 smithi050 ceph-mon[30354]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 284 MiB/s wr, 79 op/s 2024-09-10T10:15:12.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:12 smithi189 ceph-mon[34999]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 284 MiB/s wr, 79 op/s 2024-09-10T10:15:12.598 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:12 smithi084 ceph-mon[34812]: pgmap v511: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 284 MiB/s wr, 79 op/s 2024-09-10T10:15:12.745 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 142.75 --await-for 45.0' 2024-09-10T10:15:12.746 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 142.75 --await-for 45.0 2024-09-10T10:15:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:14.398 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:14 smithi050 ceph-mon[30354]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 274 MiB/s wr, 78 op/s 2024-09-10T10:15:14.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:14 smithi189 ceph-mon[34999]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 274 MiB/s wr, 78 op/s 2024-09-10T10:15:14.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:14 smithi084 ceph-mon[34812]: pgmap v512: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 274 MiB/s wr, 78 op/s 2024-09-10T10:15:14.794 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T10:15:14.795 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T10:15:14.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.833+0000 7f0785e00640 1 -- 172.21.15.50:0/1877752380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07801079c0 msgr2=0x7f0780107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:14.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.833+0000 7f0785e00640 1 --2- 172.21.15.50:0/1877752380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07801079c0 0x7f0780107da0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0770009ca0 tx=0x7f077002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.833+0000 7f0785e00640 1 -- 172.21.15.50:0/1877752380 shutdown_connections 2024-09-10T10:15:14.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.833+0000 7f0785e00640 1 --2- 172.21.15.50:0/1877752380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780102360 0x7f078010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.833+0000 7f0785e00640 1 --2- 172.21.15.50:0/1877752380 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07801019c0 0x7f0780101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.833+0000 7f0785e00640 1 --2- 172.21.15.50:0/1877752380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07801079c0 0x7f0780107da0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.833+0000 7f0785e00640 1 -- 172.21.15.50:0/1877752380 >> 172.21.15.50:0/1877752380 conn(0x7f07800fd740 msgr2=0x7f07800ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:14.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.835+0000 7f0785e00640 1 -- 172.21.15.50:0/1877752380 shutdown_connections 2024-09-10T10:15:14.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.835+0000 7f0785e00640 1 -- 172.21.15.50:0/1877752380 wait complete. 2024-09-10T10:15:14.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.836+0000 7f0785e00640 1 Processor -- start 2024-09-10T10:15:14.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.836+0000 7f0785e00640 1 -- start start 2024-09-10T10:15:14.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.837+0000 7f0785e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07801019c0 0x7f078019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.837+0000 7f0785e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780102360 0x7f078019d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.837+0000 7f0785e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07801079c0 0x7f0780196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.837+0000 7f0785e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f078010fc00 con 0x7f0780102360 2024-09-10T10:15:14.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.837+0000 7f0785e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f078010fa80 con 0x7f07801079c0 2024-09-10T10:15:14.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.837+0000 7f0785e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f078010fd80 con 0x7f07801019c0 2024-09-10T10:15:14.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.837+0000 7f0784a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07801019c0 0x7f078019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.837+0000 7f0785400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07801079c0 0x7f0780196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.837+0000 7f0784a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07801019c0 0x7f078019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:37554/0 (socket says 172.21.15.50:37554) 2024-09-10T10:15:14.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.837+0000 7f0784a00640 1 -- 172.21.15.50:0/3347408475 learned_addr learned my addr 172.21.15.50:0/3347408475 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:14.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.837+0000 7f0784a00640 1 -- 172.21.15.50:0/3347408475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07801079c0 msgr2=0x7f0780196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:14.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.837+0000 7f0784a00640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07801079c0 0x7f0780196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.837+0000 7f0784a00640 1 -- 172.21.15.50:0/3347408475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780102360 msgr2=0x7f078019d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:14.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.838+0000 7f0777e00640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780102360 0x7f078019d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.838+0000 7f0784a00640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780102360 0x7f078019d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.838+0000 7f0784a00640 1 -- 172.21.15.50:0/3347408475 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07801968d0 con 0x7f07801019c0 2024-09-10T10:15:14.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.838+0000 7f0785400640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07801079c0 0x7f0780196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:14.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.838+0000 7f0777e00640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780102360 0x7f078019d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:14.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.838+0000 7f0784a00640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07801019c0 0x7f078019cdd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0770005e30 tx=0x7f0770003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:14.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.839+0000 7f077e000640 1 -- 172.21.15.50:0/3347408475 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07700316d0 con 0x7f07801019c0 2024-09-10T10:15:14.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.839+0000 7f077e000640 1 -- 172.21.15.50:0/3347408475 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0770031870 con 0x7f07801019c0 2024-09-10T10:15:14.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.839+0000 7f077e000640 1 -- 172.21.15.50:0/3347408475 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077002fb70 con 0x7f07801019c0 2024-09-10T10:15:14.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.840+0000 7f0785e00640 1 -- 172.21.15.50:0/3347408475 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0780196b60 con 0x7f07801019c0 2024-09-10T10:15:14.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.840+0000 7f0785e00640 1 -- 172.21.15.50:0/3347408475 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f078019ab30 con 0x7f07801019c0 2024-09-10T10:15:14.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.845+0000 7f077e000640 1 -- 172.21.15.50:0/3347408475 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f077002fd10 con 0x7f07801019c0 2024-09-10T10:15:14.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.847+0000 7f077e000640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f07640a2d40 0x7f07640a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.847+0000 7f077e000640 1 -- 172.21.15.50:0/3347408475 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f07700f0890 con 0x7f07801019c0 2024-09-10T10:15:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.848+0000 7f0789e0c740 1 Processor -- start 2024-09-10T10:15:14.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.848+0000 7f0777e00640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f07640a2d40 0x7f07640a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.849+0000 7f0789e0c740 1 -- start start 2024-09-10T10:15:14.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.851+0000 7f0789e0c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e661c6c0 0x5622e661caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.851+0000 7f0789e0c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e6627360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.851+0000 7f0789e0c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e66278a0 0x5622e6629c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.851+0000 7f0789e0c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5622e6581260 con 0x5622e66278a0 2024-09-10T10:15:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.851+0000 7f0789e0c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5622e6528500 con 0x5622e661c6c0 2024-09-10T10:15:14.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.851+0000 7f0789e0c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5622e657d220 con 0x5622e661cfe0 2024-09-10T10:15:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.851+0000 7f0784a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e661c6c0 0x5622e661caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.851+0000 7f0784a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e661c6c0 0x5622e661caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:59466/0 (socket says 172.21.15.50:59466) 2024-09-10T10:15:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.851+0000 7f0784a00640 1 -- 172.21.15.50:0/3330257164 learned_addr learned my addr 172.21.15.50:0/3330257164 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.852+0000 7f0784a00640 1 -- 172.21.15.50:0/3330257164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 msgr2=0x5622e6627360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:15:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.852+0000 7f0785400640 1 --2- 172.21.15.50:0/3330257164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e66278a0 0x5622e6629c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.853+0000 7f0777e00640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f07640a2d40 0x7f07640a5200 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0780197620 tx=0x7f0768005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.853+0000 7f0777e00640 1 --2- 172.21.15.50:0/3330257164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e6627360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.853+0000 7f0784a00640 1 --2- 172.21.15.50:0/3330257164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e6627360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.853+0000 7f0784a00640 1 -- 172.21.15.50:0/3330257164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e66278a0 msgr2=0x5622e6629c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.853+0000 7f0784a00640 1 --2- 172.21.15.50:0/3330257164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e66278a0 0x5622e6629c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.853+0000 7f0784a00640 1 -- 172.21.15.50:0/3330257164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622e62f2ba0 con 0x5622e661c6c0 2024-09-10T10:15:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.854+0000 7f0784a00640 1 --2- 172.21.15.50:0/3330257164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e661c6c0 0x5622e661caa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f07700bca90 tx=0x7f077002a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfba89e0807e6a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:14.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.854+0000 7f0775c00640 1 -- 172.21.15.50:0/3330257164 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07700bcd90 con 0x5622e661c6c0 2024-09-10T10:15:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.854+0000 7f0785400640 1 --2- 172.21.15.50:0/3330257164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e66278a0 0x5622e6629c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.854+0000 7f0777e00640 1 --2- 172.21.15.50:0/3330257164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e6627360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.854+0000 7f0775c00640 1 -- 172.21.15.50:0/3330257164 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0770036040 con 0x5622e661c6c0 2024-09-10T10:15:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.854+0000 7f0775c00640 1 -- 172.21.15.50:0/3330257164 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07700c54e0 con 0x5622e661c6c0 2024-09-10T10:15:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.855+0000 7f0789e0c740 1 -- 172.21.15.50:0/3330257164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e661c6c0 msgr2=0x5622e661caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:14.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.855+0000 7f0789e0c740 1 --2- 172.21.15.50:0/3330257164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e661c6c0 0x5622e661caa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f07700bca90 tx=0x7f077002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.856+0000 7f0789e0c740 1 -- 172.21.15.50:0/3330257164 shutdown_connections 2024-09-10T10:15:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.856+0000 7f0789e0c740 1 --2- 172.21.15.50:0/3330257164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e66278a0 0x5622e6629c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.856+0000 7f0789e0c740 1 --2- 172.21.15.50:0/3330257164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e6627360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.856+0000 7f0789e0c740 1 --2- 172.21.15.50:0/3330257164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e661c6c0 0x5622e661caa0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.856+0000 7f0789e0c740 1 -- 172.21.15.50:0/3330257164 >> 172.21.15.50:0/3330257164 conn(0x5622e6618c50 msgr2=0x5622e6619030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.856+0000 7f0789e0c740 1 -- 172.21.15.50:0/3330257164 shutdown_connections 2024-09-10T10:15:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.856+0000 7f0789e0c740 1 -- 172.21.15.50:0/3330257164 wait complete. 2024-09-10T10:15:14.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.856+0000 7f0789e0c740 1 -- start start 2024-09-10T10:15:14.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.857+0000 7f0789e0c740 1 Processor -- start 2024-09-10T10:15:14.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.857+0000 7f0789e0c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 0x5622e6624770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0789e0c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e6624cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0789e0c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e66278a0 0x5622e66251f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0789e0c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5622e6528500 con 0x5622e661c6c0 2024-09-10T10:15:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0789e0c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5622e653bbd0 con 0x5622e66278a0 2024-09-10T10:15:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0784a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 0x5622e6624770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0789e0c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5622e662a230 con 0x5622e661cfe0 2024-09-10T10:15:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0789e0c740 10 client.0 _ll_register_callbacks cb 0x5622e62900a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0784a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 0x5622e6624770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44976/0 (socket says 172.21.15.50:44976) 2024-09-10T10:15:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0784a00640 1 -- 172.21.15.50:0/134127060 learned_addr learned my addr 172.21.15.50:0/134127060 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:14.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0777e00640 1 --2- 172.21.15.50:0/134127060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e6624cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0784a00640 1 -- 172.21.15.50:0/134127060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 msgr2=0x5622e6624cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0784a00640 1 --2- 172.21.15.50:0/134127060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e6624cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0784a00640 1 -- 172.21.15.50:0/134127060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e66278a0 msgr2=0x5622e66251f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0784a00640 1 --2- 172.21.15.50:0/134127060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e66278a0 0x5622e66251f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.858+0000 7f0784a00640 1 -- 172.21.15.50:0/134127060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622e6633490 con 0x5622e661c6c0 2024-09-10T10:15:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.859+0000 7f0784a00640 1 --2- 172.21.15.50:0/134127060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 0x5622e6624770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0770004af0 tx=0x7f07700b9690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec173ada2204b28 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.859+0000 7f076e000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:15:14.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.859+0000 7f076e000640 1 -- 172.21.15.50:0/134127060 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07700ca060 con 0x5622e661c6c0 2024-09-10T10:15:14.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.860+0000 7f076e000640 1 -- 172.21.15.50:0/134127060 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f07700c54e0 con 0x5622e661c6c0 2024-09-10T10:15:14.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.860+0000 7f0789e0c740 1 -- 172.21.15.50:0/134127060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0770036040 con 0x5622e661c6c0 2024-09-10T10:15:14.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.860+0000 7f076e000640 1 -- 172.21.15.50:0/134127060 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f07700d9070 con 0x5622e661c6c0 2024-09-10T10:15:14.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.860+0000 7f0789e0c740 10 client.16074 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:14.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.860+0000 7f0789e0c740 1 -- 172.21.15.50:0/134127060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5622e6635d60 con 0x5622e661c6c0 2024-09-10T10:15:14.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.861+0000 7f076e000640 1 -- 172.21.15.50:0/134127060 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0770036040 con 0x5622e661c6c0 2024-09-10T10:15:14.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.861+0000 7f076e000640 1 -- 172.21.15.50:0/134127060 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f0770004bd0 con 0x5622e661c6c0 2024-09-10T10:15:14.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.862+0000 7f0789e0c740 10 client.16074 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:14.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.862+0000 7f0789e0c740 10 client.16074 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:15:14.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.862+0000 7f0789e0c740 20 client.16074 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:14.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.862+0000 7f0789e0c740 1 --2- 172.21.15.50:0/134127060 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5622e66371c0 0x5622e6639630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.862+0000 7f0789e0c740 4 client.16074 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:15:14.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.862+0000 7f0789e0c740 1 -- 172.21.15.50:0/134127060 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622e658e990 con 0x5622e66371c0 2024-09-10T10:15:14.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.863+0000 7f0777e00640 1 --2- 172.21.15.50:0/134127060 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5622e66371c0 0x5622e6639630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.863+0000 7f0777e00640 1 --2- 172.21.15.50:0/134127060 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5622e66371c0 0x5622e6639630 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e68660d16667730 server_cookie=c2f409663b5d41f2 in_seq=0 out_seq=0 2024-09-10T10:15:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.863+0000 7f076e000640 10 client.16074 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.864+0000 7f076e000640 1 -- 172.21.15.50:0/134127060 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5622e658e990 con 0x5622e66371c0 2024-09-10T10:15:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.864+0000 7f076e000640 10 client.16074 handle_command_reply: tid=0 2024-09-10T10:15:14.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.864+0000 7f0789e0c740 1 client.16074 shutdown 2024-09-10T10:15:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.865+0000 7f0789e0c740 1 -- 172.21.15.50:0/134127060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 msgr2=0x5622e6624770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:14.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.865+0000 7f0789e0c740 1 --2- 172.21.15.50:0/134127060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 0x5622e6624770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0770004af0 tx=0x7f07700b9690 comp rx=0 tx=0).stop 2024-09-10T10:15:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.866+0000 7f0789e0c740 1 -- 172.21.15.50:0/134127060 shutdown_connections 2024-09-10T10:15:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.866+0000 7f0789e0c740 1 --2- 172.21.15.50:0/134127060 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5622e66371c0 0x5622e6639630 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.866+0000 7f076e000640 0 client.16074 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.866+0000 7f0789e0c740 1 --2- 172.21.15.50:0/134127060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e66278a0 0x5622e66251f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.866+0000 7f0789e0c740 1 --2- 172.21.15.50:0/134127060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e6624cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.866+0000 7f0789e0c740 1 --2- 172.21.15.50:0/134127060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 0x5622e6624770 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.866+0000 7f0789e0c740 1 -- 172.21.15.50:0/134127060 >> 172.21.15.50:0/134127060 conn(0x5622e6618c50 msgr2=0x5622e6617e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:14.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.867+0000 7f0789e0c740 1 -- 172.21.15.50:0/134127060 shutdown_connections 2024-09-10T10:15:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.867+0000 7f0789e0c740 1 -- 172.21.15.50:0/134127060 wait complete. 2024-09-10T10:15:14.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.868+0000 7f0789e0c740 20 client.16074 trim_cache size 0 max 16384 2024-09-10T10:15:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.916+0000 7f0789e0c740 1 Processor -- start 2024-09-10T10:15:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.916+0000 7f0789e0c740 1 -- start start 2024-09-10T10:15:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.917+0000 7f0789e0c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 0x5622e663ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.917+0000 7f0789e0c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e663f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.918+0000 7f0784a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 0x5622e663ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.918+0000 7f0784a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 0x5622e663ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44982/0 (socket says 172.21.15.50:44982) 2024-09-10T10:15:14.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.918+0000 7f0777e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e663f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.918+0000 7f0777e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e663f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:37586/0 (socket says 172.21.15.50:37586) 2024-09-10T10:15:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.919+0000 7f0789e0c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e66278a0 0x5622e6625ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.919+0000 7f0789e0c740 1 -- 172.21.15.50:0/1306412970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07801c0220 con 0x5622e661c6c0 2024-09-10T10:15:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.919+0000 7f0789e0c740 1 -- 172.21.15.50:0/1306412970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f07801bdaf0 con 0x5622e66278a0 2024-09-10T10:15:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.919+0000 7f0789e0c740 1 -- 172.21.15.50:0/1306412970 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f07801bb940 con 0x5622e661cfe0 2024-09-10T10:15:14.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.919+0000 7f0784a00640 1 -- 172.21.15.50:0/1306412970 learned_addr learned my addr 172.21.15.50:0/1306412970 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.920+0000 7f0785400640 1 --2- 172.21.15.50:0/1306412970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e66278a0 0x5622e6625ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.921+0000 7f0784a00640 1 -- 172.21.15.50:0/1306412970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 msgr2=0x5622e663f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.921+0000 7f0784a00640 1 --2- 172.21.15.50:0/1306412970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e663f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.921+0000 7f0784a00640 1 -- 172.21.15.50:0/1306412970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e66278a0 msgr2=0x5622e6625ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.921+0000 7f0784a00640 1 --2- 172.21.15.50:0/1306412970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e66278a0 0x5622e6625ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.921+0000 7f0784a00640 1 -- 172.21.15.50:0/1306412970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622e661ce10 con 0x5622e661c6c0 2024-09-10T10:15:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.922+0000 7f0785400640 1 --2- 172.21.15.50:0/1306412970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e66278a0 0x5622e6625ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:15:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.922+0000 7f0777e00640 1 --2- 172.21.15.50:0/1306412970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e663f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.922+0000 7f0784a00640 1 --2- 172.21.15.50:0/1306412970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 0x5622e663ef00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f07700c5b30 tx=0x7f0770000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7452dc5c86b8c7cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:14.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.927+0000 7f0775200640 1 -- 172.21.15.50:0/1306412970 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07700ca040 con 0x5622e661c6c0 2024-09-10T10:15:14.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.927+0000 7f0775200640 1 -- 172.21.15.50:0/1306412970 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0770036040 con 0x5622e661c6c0 2024-09-10T10:15:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.930+0000 7f0775200640 1 -- 172.21.15.50:0/1306412970 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770004d80 con 0x5622e661c6c0 2024-09-10T10:15:14.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.930+0000 7f0789e0c740 1 -- 172.21.15.50:0/1306412970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 msgr2=0x5622e663ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:14.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.930+0000 7f0789e0c740 1 --2- 172.21.15.50:0/1306412970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 0x5622e663ef00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f07700c5b30 tx=0x7f0770000f40 comp rx=0 tx=0).stop 2024-09-10T10:15:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.937+0000 7f0789e0c740 1 -- 172.21.15.50:0/1306412970 shutdown_connections 2024-09-10T10:15:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.937+0000 7f0789e0c740 1 --2- 172.21.15.50:0/1306412970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e66278a0 0x5622e6625ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.937+0000 7f0789e0c740 1 --2- 172.21.15.50:0/1306412970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e663f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.937+0000 7f0789e0c740 1 --2- 172.21.15.50:0/1306412970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e661c6c0 0x5622e663ef00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.938+0000 7f0789e0c740 1 -- 172.21.15.50:0/1306412970 >> 172.21.15.50:0/1306412970 conn(0x5622e6618c50 msgr2=0x5622e661e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.942+0000 7f0789e0c740 1 -- 172.21.15.50:0/1306412970 shutdown_connections 2024-09-10T10:15:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.948+0000 7f0789e0c740 1 -- 172.21.15.50:0/1306412970 wait complete. 2024-09-10T10:15:14.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.951+0000 7f0789e0c740 1 -- start start 2024-09-10T10:15:14.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.951+0000 7f0789e0c740 1 Processor -- start 2024-09-10T10:15:14.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.954+0000 7f0789e0c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e661c6c0 0x5622e662b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.954+0000 7f0789e0c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e662b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.954+0000 7f0789e0c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e66278a0 0x5622e662bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.955+0000 7f0789e0c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07801bbfb0 con 0x5622e66278a0 2024-09-10T10:15:14.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.955+0000 7f0789e0c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f07801bd420 con 0x5622e661c6c0 2024-09-10T10:15:14.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.955+0000 7f0789e0c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f07801bc680 con 0x5622e661cfe0 2024-09-10T10:15:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.955+0000 7f0789e0c740 10 client.0 _ll_register_callbacks cb 0x7f07700b90e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.955+0000 7f0777e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e662b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.955+0000 7f0777e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e662b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:37596/0 (socket says 172.21.15.50:37596) 2024-09-10T10:15:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.955+0000 7f0777e00640 1 -- 172.21.15.50:0/3139545210 learned_addr learned my addr 172.21.15.50:0/3139545210 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.955+0000 7f0777e00640 1 -- 172.21.15.50:0/3139545210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e661c6c0 msgr2=0x5622e662b1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:15:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.955+0000 7f0777e00640 1 --2- 172.21.15.50:0/3139545210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e661c6c0 0x5622e662b1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.955+0000 7f0777e00640 1 -- 172.21.15.50:0/3139545210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e66278a0 msgr2=0x5622e662bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.955+0000 7f0777e00640 1 --2- 172.21.15.50:0/3139545210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e66278a0 0x5622e662bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.955+0000 7f0777e00640 1 -- 172.21.15.50:0/3139545210 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622e66a0fa0 con 0x5622e661cfe0 2024-09-10T10:15:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.956+0000 7f0777e00640 1 --2- 172.21.15.50:0/3139545210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e662b730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5622e6619ab0 tx=0x7f0768004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49efd5619985e51f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.956+0000 7f076e000640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:15:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.956+0000 7f076e000640 1 -- 172.21.15.50:0/3139545210 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07680297b0 con 0x5622e661cfe0 2024-09-10T10:15:14.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.956+0000 7f076e000640 1 -- 172.21.15.50:0/3139545210 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f0768029950 con 0x5622e661cfe0 2024-09-10T10:15:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.956+0000 7f0789e0c740 1 -- 172.21.15.50:0/3139545210 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0770036040 con 0x5622e661cfe0 2024-09-10T10:15:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.957+0000 7f076e000640 1 -- 172.21.15.50:0/3139545210 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0768037050 con 0x5622e661cfe0 2024-09-10T10:15:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.957+0000 7f0789e0c740 10 client.26149 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.957+0000 7f0789e0c740 1 -- 172.21.15.50:0/3139545210 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5622e66b3270 con 0x5622e661cfe0 2024-09-10T10:15:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.957+0000 7f076e000640 1 -- 172.21.15.50:0/3139545210 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0770036040 con 0x5622e661cfe0 2024-09-10T10:15:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.958+0000 7f076e000640 1 -- 172.21.15.50:0/3139545210 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f076800f040 con 0x5622e661cfe0 2024-09-10T10:15:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.958+0000 7f0789e0c740 10 client.26149 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.958+0000 7f0789e0c740 10 client.26149 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:15:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.958+0000 7f0789e0c740 20 client.26149 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.958+0000 7f0789e0c740 1 --2- 172.21.15.50:0/3139545210 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5622e66371c0 0x5622e66b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.958+0000 7f0789e0c740 4 client.26149 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.75, "await_for": 45.0}] 2024-09-10T10:15:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.958+0000 7f0789e0c740 1 -- 172.21.15.50:0/3139545210 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.75, "await_for": 45.0}) -- 0x5622e6588ce0 con 0x5622e66371c0 2024-09-10T10:15:14.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.959+0000 7f0784a00640 1 --2- 172.21.15.50:0/3139545210 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5622e66371c0 0x5622e66b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.963+0000 7f076e000640 10 client.26149 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:14.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.964+0000 7f0784a00640 1 --2- 172.21.15.50:0/3139545210 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5622e66371c0 0x5622e66b5aa0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35c404cc591ec310 server_cookie=d400a33b9bba0ba6 in_seq=0 out_seq=0 2024-09-10T10:15:14.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.977+0000 7f076e000640 1 -- 172.21.15.50:0/3139545210 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5622e6588ce0 con 0x5622e66371c0 2024-09-10T10:15:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.977+0000 7f076e000640 10 client.26149 handle_command_reply: tid=0 2024-09-10T10:15:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.977+0000 7f0789e0c740 1 client.26149 shutdown 2024-09-10T10:15:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.979+0000 7f0789e0c740 1 -- 172.21.15.50:0/3139545210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 msgr2=0x5622e662b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:14.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.979+0000 7f0789e0c740 1 --2- 172.21.15.50:0/3139545210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e662b730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5622e6619ab0 tx=0x7f0768004730 comp rx=0 tx=0).stop 2024-09-10T10:15:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.979+0000 7f0789e0c740 1 -- 172.21.15.50:0/3139545210 shutdown_connections 2024-09-10T10:15:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.979+0000 7f0789e0c740 1 --2- 172.21.15.50:0/3139545210 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x5622e66371c0 0x5622e66b5aa0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.979+0000 7f0789e0c740 1 --2- 172.21.15.50:0/3139545210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5622e66278a0 0x5622e662bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.979+0000 7f0789e0c740 1 --2- 172.21.15.50:0/3139545210 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5622e661cfe0 0x5622e662b730 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.979+0000 7f0789e0c740 1 --2- 172.21.15.50:0/3139545210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622e661c6c0 0x5622e662b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.979+0000 7f0789e0c740 1 -- 172.21.15.50:0/3139545210 >> 172.21.15.50:0/3139545210 conn(0x5622e6618c50 msgr2=0x5622e6632250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.981+0000 7f076e000640 0 client.26149 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.981+0000 7f0789e0c740 1 -- 172.21.15.50:0/3139545210 shutdown_connections 2024-09-10T10:15:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.981+0000 7f0789e0c740 1 -- 172.21.15.50:0/3139545210 wait complete. 2024-09-10T10:15:14.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.981+0000 7f0789e0c740 20 client.26149 trim_cache size 0 max 16384 2024-09-10T10:15:14.988 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:15:14.988 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 25, 2024-09-10T10:15:14.988 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24560, 2024-09-10T10:15:14.988 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 10, 2024-09-10T10:15:14.988 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-09-10T10:15:14.988 INFO:teuthology.orchestra.run.smithi050.stdout: "b7012dd8": { 2024-09-10T10:15:14.988 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 10, 2024-09-10T10:15:14.988 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 142.8, 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:14.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:14.990 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:14.990 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:14.990 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:14.990 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:15:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.986+0000 7f0785e00640 1 -- 172.21.15.50:0/3347408475 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f07640a2d40 msgr2=0x7f07640a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.986+0000 7f0785e00640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f07640a2d40 0x7f07640a5200 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0780197620 tx=0x7f0768005f90 comp rx=0 tx=0).stop 2024-09-10T10:15:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.986+0000 7f0785e00640 1 -- 172.21.15.50:0/3347408475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07801019c0 msgr2=0x7f078019cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.986+0000 7f0785e00640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07801019c0 0x7f078019cdd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0770005e30 tx=0x7f0770003f90 comp rx=0 tx=0).stop 2024-09-10T10:15:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.987+0000 7f0785e00640 1 -- 172.21.15.50:0/3347408475 shutdown_connections 2024-09-10T10:15:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.987+0000 7f0785e00640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f07640a2d40 0x7f07640a5200 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.987+0000 7f0785e00640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07801079c0 0x7f0780196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.987+0000 7f0785e00640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0780102360 0x7f078019d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.987+0000 7f0785e00640 1 --2- 172.21.15.50:0/3347408475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07801019c0 0x7f078019cdd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.987+0000 7f0785e00640 1 -- 172.21.15.50:0/3347408475 >> 172.21.15.50:0/3347408475 conn(0x7f07800fd740 msgr2=0x7f07800fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.987+0000 7f0785e00640 1 -- 172.21.15.50:0/3347408475 shutdown_connections 2024-09-10T10:15:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:14.988+0000 7f0785e00640 1 -- 172.21.15.50:0/3347408475 wait complete. 2024-09-10T10:15:15.889 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b7012dd8', quiesce took 9.3 seconds. Will release after: 13.45 2024-09-10T10:15:16.045 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:16.207 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:16 smithi050 ceph-mon[30354]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 292 MiB/s wr, 79 op/s 2024-09-10T10:15:16.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:16 smithi189 ceph-mon[34999]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 292 MiB/s wr, 79 op/s 2024-09-10T10:15:16.598 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:16 smithi084 ceph-mon[34812]: pgmap v513: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 292 MiB/s wr, 79 op/s 2024-09-10T10:15:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.320+0000 7fcb22400640 1 -- 172.21.15.50:0/1794445800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c1019d0 msgr2=0x7fcb1c101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.320+0000 7fcb22400640 1 --2- 172.21.15.50:0/1794445800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c1019d0 0x7fcb1c101e30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009930 tx=0x7fcb0802a460 comp rx=0 tx=0).stop 2024-09-10T10:15:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.320+0000 7fcb22400640 1 -- 172.21.15.50:0/1794445800 shutdown_connections 2024-09-10T10:15:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.320+0000 7fcb22400640 1 --2- 172.21.15.50:0/1794445800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb1c102370 0x7fcb1c10e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.320+0000 7fcb22400640 1 --2- 172.21.15.50:0/1794445800 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c1019d0 0x7fcb1c101e30 secure :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009930 tx=0x7fcb0802a460 comp rx=0 tx=0).stop 2024-09-10T10:15:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.320+0000 7fcb22400640 1 --2- 172.21.15.50:0/1794445800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1c1079d0 0x7fcb1c107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.320+0000 7fcb22400640 1 -- 172.21.15.50:0/1794445800 >> 172.21.15.50:0/1794445800 conn(0x7fcb1c0fd710 msgr2=0x7fcb1c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.324+0000 7fcb22400640 1 -- 172.21.15.50:0/1794445800 shutdown_connections 2024-09-10T10:15:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.325+0000 7fcb22400640 1 -- 172.21.15.50:0/1794445800 wait complete. 2024-09-10T10:15:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.327+0000 7fcb22400640 1 Processor -- start 2024-09-10T10:15:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.327+0000 7fcb22400640 1 -- start start 2024-09-10T10:15:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.328+0000 7fcb22400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c102370 0x7fcb1c19f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.328+0000 7fcb22400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb1c1079d0 0x7fcb1c10bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.328+0000 7fcb22400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1c10c040 0x7fcb1c10c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.329+0000 7fcb21000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c102370 0x7fcb1c19f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.329+0000 7fcb21000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c102370 0x7fcb1c19f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50186/0 (socket says 172.21.15.50:50186) 2024-09-10T10:15:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.329+0000 7fcb21000640 1 -- 172.21.15.50:0/2870954199 learned_addr learned my addr 172.21.15.50:0/2870954199 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.330+0000 7fcb22400640 1 -- 172.21.15.50:0/2870954199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c111e60 con 0x7fcb1c10c040 2024-09-10T10:15:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.330+0000 7fcb22400640 1 -- 172.21.15.50:0/2870954199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c111ce0 con 0x7fcb1c1079d0 2024-09-10T10:15:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.330+0000 7fcb22400640 1 -- 172.21.15.50:0/2870954199 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c111fe0 con 0x7fcb1c102370 2024-09-10T10:15:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.331+0000 7fcb21a00640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1c10c040 0x7fcb1c10c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.331+0000 7fcb21a00640 1 -- 172.21.15.50:0/2870954199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c102370 msgr2=0x7fcb1c19f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.331+0000 7fcb21a00640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c102370 0x7fcb1c19f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.331+0000 7fcb21a00640 1 -- 172.21.15.50:0/2870954199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb1c1079d0 msgr2=0x7fcb1c10bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.329+0000 7fcb1be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb1c1079d0 0x7fcb1c10bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.332+0000 7fcb21a00640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb1c1079d0 0x7fcb1c10bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.332+0000 7fcb21a00640 1 -- 172.21.15.50:0/2870954199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1c19ac20 con 0x7fcb1c10c040 2024-09-10T10:15:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.333+0000 7fcb1be00640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb1c1079d0 0x7fcb1c10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.333+0000 7fcb21a00640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1c10c040 0x7fcb1c10c4f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400be20 tx=0x7fcb1400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.334+0000 7fcb19600640 1 -- 172.21.15.50:0/2870954199 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14019070 con 0x7fcb1c10c040 2024-09-10T10:15:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.334+0000 7fcb22400640 1 -- 172.21.15.50:0/2870954199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1c19af10 con 0x7fcb1c10c040 2024-09-10T10:15:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.334+0000 7fcb22400640 1 -- 172.21.15.50:0/2870954199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb1c19b450 con 0x7fcb1c10c040 2024-09-10T10:15:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.335+0000 7fcb19600640 1 -- 172.21.15.50:0/2870954199 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb14014920 con 0x7fcb1c10c040 2024-09-10T10:15:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.335+0000 7fcb19600640 1 -- 172.21.15.50:0/2870954199 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14012940 con 0x7fcb1c10c040 2024-09-10T10:15:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.341+0000 7fcb263cb740 1 Processor -- start 2024-09-10T10:15:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.343+0000 7fcb19600640 1 -- 172.21.15.50:0/2870954199 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcb1401c070 con 0x7fcb1c10c040 2024-09-10T10:15:17.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.343+0000 7fcb263cb740 1 -- start start 2024-09-10T10:15:17.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.346+0000 7fcb19600640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcb040a2c80 0x7fcb040a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.346+0000 7fcb19600640 1 -- 172.21.15.50:0/2870954199 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fcb140ceac0 con 0x7fcb1c10c040 2024-09-10T10:15:17.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.347+0000 7fcb263cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b467fdcb0 0x559b467fe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.347+0000 7fcb1be00640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcb040a2c80 0x7fcb040a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.347+0000 7fcb263cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fe5d0 0x559b46808950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.347+0000 7fcb263cb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b46808e90 0x559b4680b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.347+0000 7fcb263cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559b46764290 con 0x559b467fe5d0 2024-09-10T10:15:17.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.347+0000 7fcb263cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559b4670bb40 con 0x559b467fdcb0 2024-09-10T10:15:17.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.347+0000 7fcb263cb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559b46760250 con 0x559b46808e90 2024-09-10T10:15:17.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.348+0000 7fcb1be00640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcb040a2c80 0x7fcb040a5140 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcb08006010 tx=0x7fcb08004180 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:17.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.348+0000 7fcb21000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b467fdcb0 0x559b467fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.348+0000 7fcb21000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b467fdcb0 0x559b467fe090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:53006/0 (socket says 172.21.15.50:53006) 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.349+0000 7fcb21000640 1 -- 172.21.15.50:0/3278201117 learned_addr learned my addr 172.21.15.50:0/3278201117 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.349+0000 7fcb21a00640 1 --2- 172.21.15.50:0/3278201117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b46808e90 0x559b4680b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.349+0000 7fcb21000640 1 -- 172.21.15.50:0/3278201117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b46808e90 msgr2=0x559b4680b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.349+0000 7fcb21000640 1 --2- 172.21.15.50:0/3278201117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b46808e90 0x559b4680b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.349+0000 7fcb21000640 1 -- 172.21.15.50:0/3278201117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fe5d0 msgr2=0x559b46808950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.349+0000 7fcb21000640 1 --2- 172.21.15.50:0/3278201117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fe5d0 0x559b46808950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.349+0000 7fcb21000640 1 -- 172.21.15.50:0/3278201117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b464d56a0 con 0x559b467fdcb0 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.350+0000 7fcb21000640 1 --2- 172.21.15.50:0/3278201117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b467fdcb0 0x559b467fe090 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009dc0 tx=0x7fcb10011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ed7116dd818b1dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.351+0000 7fcb0e000640 1 -- 172.21.15.50:0/3278201117 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10005220 con 0x559b467fdcb0 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.351+0000 7fcb0e000640 1 -- 172.21.15.50:0/3278201117 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb10004c80 con 0x559b467fdcb0 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.351+0000 7fcb0e000640 1 -- 172.21.15.50:0/3278201117 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10019970 con 0x559b467fdcb0 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.352+0000 7fcb263cb740 1 -- 172.21.15.50:0/3278201117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b467fdcb0 msgr2=0x559b467fe090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.352+0000 7fcb263cb740 1 --2- 172.21.15.50:0/3278201117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b467fdcb0 0x559b467fe090 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009dc0 tx=0x7fcb10011810 comp rx=0 tx=0).stop 2024-09-10T10:15:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.353+0000 7fcb263cb740 1 -- 172.21.15.50:0/3278201117 shutdown_connections 2024-09-10T10:15:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.353+0000 7fcb263cb740 1 --2- 172.21.15.50:0/3278201117 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b46808e90 0x559b4680b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.353+0000 7fcb263cb740 1 --2- 172.21.15.50:0/3278201117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fe5d0 0x559b46808950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.353+0000 7fcb263cb740 1 --2- 172.21.15.50:0/3278201117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b467fdcb0 0x559b467fe090 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.353+0000 7fcb263cb740 1 -- 172.21.15.50:0/3278201117 >> 172.21.15.50:0/3278201117 conn(0x559b467fa240 msgr2=0x559b467fa620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.353+0000 7fcb263cb740 1 -- 172.21.15.50:0/3278201117 shutdown_connections 2024-09-10T10:15:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.353+0000 7fcb263cb740 1 -- 172.21.15.50:0/3278201117 wait complete. 2024-09-10T10:15:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.354+0000 7fcb263cb740 1 -- start start 2024-09-10T10:15:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.355+0000 7fcb263cb740 1 Processor -- start 2024-09-10T10:15:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.356+0000 7fcb263cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fdcb0 0x559b468086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.356+0000 7fcb263cb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b467fe5d0 0x559b46805960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.356+0000 7fcb263cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b46808e90 0x559b46805ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.356+0000 7fcb263cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559b4680bb00 con 0x559b467fdcb0 2024-09-10T10:15:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.356+0000 7fcb263cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559b4671efa0 con 0x559b46808e90 2024-09-10T10:15:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.356+0000 7fcb263cb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559b4680bc80 con 0x559b467fe5d0 2024-09-10T10:15:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.357+0000 7fcb263cb740 10 client.0 _ll_register_callbacks cb 0x559b46472ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.359+0000 7fcb21a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b46808e90 0x559b46805ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.360+0000 7fcb1be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b467fe5d0 0x559b46805960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.360+0000 7fcb1be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b467fe5d0 0x559b46805960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50198/0 (socket says 172.21.15.50:50198) 2024-09-10T10:15:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.360+0000 7fcb1be00640 1 -- 172.21.15.50:0/1264811829 learned_addr learned my addr 172.21.15.50:0/1264811829 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.360+0000 7fcb21a00640 1 -- 172.21.15.50:0/1264811829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b467fe5d0 msgr2=0x559b46805960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.360+0000 7fcb21a00640 1 --2- 172.21.15.50:0/1264811829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b467fe5d0 0x559b46805960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.360+0000 7fcb21a00640 1 -- 172.21.15.50:0/1264811829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fdcb0 msgr2=0x559b468086b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:15:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.362+0000 7fcb21000640 1 --2- 172.21.15.50:0/1264811829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fdcb0 0x559b468086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.362+0000 7fcb21a00640 1 --2- 172.21.15.50:0/1264811829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fdcb0 0x559b468086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.362+0000 7fcb21a00640 1 -- 172.21.15.50:0/1264811829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b46806600 con 0x559b46808e90 2024-09-10T10:15:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.362+0000 7fcb21000640 1 --2- 172.21.15.50:0/1264811829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fdcb0 0x559b468086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.366+0000 7fcb21a00640 1 --2- 172.21.15.50:0/1264811829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b46808e90 0x559b46805ea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcb1409af70 tx=0x7fcb1409b0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2df4df5f9742fc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.367+0000 7fcb02a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:15:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.369+0000 7fcb02a00640 1 -- 172.21.15.50:0/1264811829 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb140cc2e0 con 0x559b46808e90 2024-09-10T10:15:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.369+0000 7fcb02a00640 1 -- 172.21.15.50:0/1264811829 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fcb14097650 con 0x559b46808e90 2024-09-10T10:15:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.369+0000 7fcb263cb740 1 -- 172.21.15.50:0/1264811829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb10004c80 con 0x559b46808e90 2024-09-10T10:15:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.370+0000 7fcb02a00640 1 -- 172.21.15.50:0/1264811829 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcb1407e050 con 0x559b46808e90 2024-09-10T10:15:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.370+0000 7fcb263cb740 10 client.26159 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.370+0000 7fcb263cb740 1 -- 172.21.15.50:0/1264811829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559b468289d0 con 0x559b46808e90 2024-09-10T10:15:17.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.370+0000 7fcb02a00640 1 -- 172.21.15.50:0/1264811829 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb10004c80 con 0x559b46808e90 2024-09-10T10:15:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.371+0000 7fcb02a00640 1 -- 172.21.15.50:0/1264811829 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fcb140b9b70 con 0x559b46808e90 2024-09-10T10:15:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.371+0000 7fcb263cb740 10 client.26159 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.371+0000 7fcb263cb740 10 client.26159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:15:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.371+0000 7fcb263cb740 20 client.26159 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.371+0000 7fcb263cb740 1 --2- 172.21.15.50:0/1264811829 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559b4682a280 0x559b4682c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.371+0000 7fcb263cb740 4 client.26159 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:15:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.371+0000 7fcb263cb740 1 -- 172.21.15.50:0/1264811829 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b46771800 con 0x559b4682a280 2024-09-10T10:15:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.372+0000 7fcb21000640 1 --2- 172.21.15.50:0/1264811829 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559b4682a280 0x559b4682c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.372+0000 7fcb21000640 1 --2- 172.21.15.50:0/1264811829 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559b4682a280 0x559b4682c670 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c816d0a3035f15d9 server_cookie=6585e94cdf1945fe in_seq=0 out_seq=0 2024-09-10T10:15:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.372+0000 7fcb02a00640 10 client.26159 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.373+0000 7fcb02a00640 1 -- 172.21.15.50:0/1264811829 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b46771800 con 0x559b4682a280 2024-09-10T10:15:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.373+0000 7fcb02a00640 10 client.26159 handle_command_reply: tid=0 2024-09-10T10:15:17.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.373+0000 7fcb263cb740 1 client.26159 shutdown 2024-09-10T10:15:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.374+0000 7fcb263cb740 1 -- 172.21.15.50:0/1264811829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b46808e90 msgr2=0x559b46805ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.374+0000 7fcb263cb740 1 --2- 172.21.15.50:0/1264811829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b46808e90 0x559b46805ea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcb1409af70 tx=0x7fcb1409b0a0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.374+0000 7fcb263cb740 1 -- 172.21.15.50:0/1264811829 shutdown_connections 2024-09-10T10:15:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.374+0000 7fcb263cb740 1 --2- 172.21.15.50:0/1264811829 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559b4682a280 0x559b4682c670 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.374+0000 7fcb263cb740 1 --2- 172.21.15.50:0/1264811829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b46808e90 0x559b46805ea0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.374+0000 7fcb263cb740 1 --2- 172.21.15.50:0/1264811829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b467fe5d0 0x559b46805960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.374+0000 7fcb263cb740 1 --2- 172.21.15.50:0/1264811829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fdcb0 0x559b468086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.374+0000 7fcb02a00640 0 client.26159 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.374+0000 7fcb263cb740 1 -- 172.21.15.50:0/1264811829 >> 172.21.15.50:0/1264811829 conn(0x559b467fa240 msgr2=0x559b467fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.374+0000 7fcb263cb740 1 -- 172.21.15.50:0/1264811829 shutdown_connections 2024-09-10T10:15:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.374+0000 7fcb263cb740 1 -- 172.21.15.50:0/1264811829 wait complete. 2024-09-10T10:15:17.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.374+0000 7fcb263cb740 20 client.26159 trim_cache size 0 max 16384 2024-09-10T10:15:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.403+0000 7fcb263cb740 1 Processor -- start 2024-09-10T10:15:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.403+0000 7fcb263cb740 1 -- start start 2024-09-10T10:15:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb263cb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b467fdcb0 0x559b46805d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb263cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fe5d0 0x559b467ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb263cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b46808e90 0x559b46831c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb263cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc0124d0 con 0x559b467fe5d0 2024-09-10T10:15:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb263cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc00fda0 con 0x559b46808e90 2024-09-10T10:15:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb263cb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc00dbf0 con 0x559b467fdcb0 2024-09-10T10:15:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb21000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b467fdcb0 0x559b46805d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb21000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b467fdcb0 0x559b46805d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50200/0 (socket says 172.21.15.50:50200) 2024-09-10T10:15:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb21000640 1 -- 172.21.15.50:0/4116787366 learned_addr learned my addr 172.21.15.50:0/4116787366 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb21000640 1 -- 172.21.15.50:0/4116787366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b46808e90 msgr2=0x559b46831c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:15:17.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb21000640 1 --2- 172.21.15.50:0/4116787366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b46808e90 0x559b46831c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb21000640 1 -- 172.21.15.50:0/4116787366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fe5d0 msgr2=0x559b467ffe60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb21000640 1 --2- 172.21.15.50:0/4116787366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fe5d0 0x559b467ffe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.404+0000 7fcb21000640 1 -- 172.21.15.50:0/4116787366 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b46814dc0 con 0x559b467fdcb0 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.405+0000 7fcb21000640 1 --2- 172.21.15.50:0/4116787366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b467fdcb0 0x559b46805d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000a010 tx=0x7fcb10009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af41c7f0d256dfa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.405+0000 7fcb0d600640 1 -- 172.21.15.50:0/4116787366 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10005080 con 0x559b467fdcb0 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.405+0000 7fcb0d600640 1 -- 172.21.15.50:0/4116787366 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb10005220 con 0x559b467fdcb0 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.405+0000 7fcb0d600640 1 -- 172.21.15.50:0/4116787366 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb100198d0 con 0x559b467fdcb0 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.406+0000 7fcb263cb740 1 -- 172.21.15.50:0/4116787366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b467fdcb0 msgr2=0x559b46805d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.406+0000 7fcb263cb740 1 --2- 172.21.15.50:0/4116787366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b467fdcb0 0x559b46805d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000a010 tx=0x7fcb10009700 comp rx=0 tx=0).stop 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.406+0000 7fcb263cb740 1 -- 172.21.15.50:0/4116787366 shutdown_connections 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.406+0000 7fcb263cb740 1 --2- 172.21.15.50:0/4116787366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b46808e90 0x559b46831c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.406+0000 7fcb263cb740 1 --2- 172.21.15.50:0/4116787366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fe5d0 0x559b467ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.406+0000 7fcb263cb740 1 --2- 172.21.15.50:0/4116787366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b467fdcb0 0x559b46805d80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.406+0000 7fcb263cb740 1 -- 172.21.15.50:0/4116787366 >> 172.21.15.50:0/4116787366 conn(0x559b467fa240 msgr2=0x559b467ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:17.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.407+0000 7fcb263cb740 1 -- 172.21.15.50:0/4116787366 shutdown_connections 2024-09-10T10:15:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.407+0000 7fcb263cb740 1 -- 172.21.15.50:0/4116787366 wait complete. 2024-09-10T10:15:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.407+0000 7fcb263cb740 1 -- start start 2024-09-10T10:15:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.407+0000 7fcb263cb740 1 Processor -- start 2024-09-10T10:15:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.408+0000 7fcb263cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fdcb0 0x559b4680cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.408+0000 7fcb263cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b467fe5d0 0x559b4680d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.408+0000 7fcb263cb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b46808e90 0x559b4680d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.408+0000 7fcb263cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc00e260 con 0x559b467fdcb0 2024-09-10T10:15:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.408+0000 7fcb263cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc00f6d0 con 0x559b467fe5d0 2024-09-10T10:15:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.408+0000 7fcb263cb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc00e930 con 0x559b46808e90 2024-09-10T10:15:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.408+0000 7fcb263cb740 10 client.0 _ll_register_callbacks cb 0x7fcb140bb0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.409+0000 7fcb21a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b46808e90 0x559b4680d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.409+0000 7fcb21a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b46808e90 0x559b4680d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50210/0 (socket says 172.21.15.50:50210) 2024-09-10T10:15:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.409+0000 7fcb21a00640 1 -- 172.21.15.50:0/3003984037 learned_addr learned my addr 172.21.15.50:0/3003984037 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.409+0000 7fcb21000640 1 --2- 172.21.15.50:0/3003984037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fdcb0 0x559b4680cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.409+0000 7fcb21a00640 1 -- 172.21.15.50:0/3003984037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b467fe5d0 msgr2=0x559b4680d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:15:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.409+0000 7fcb21a00640 1 --2- 172.21.15.50:0/3003984037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b467fe5d0 0x559b4680d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.409+0000 7fcb21a00640 1 -- 172.21.15.50:0/3003984037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fdcb0 msgr2=0x559b4680cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.409+0000 7fcb21a00640 1 --2- 172.21.15.50:0/3003984037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fdcb0 0x559b4680cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.409+0000 7fcb21a00640 1 -- 172.21.15.50:0/3003984037 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b46893cc0 con 0x559b46808e90 2024-09-10T10:15:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.409+0000 7fcb21000640 1 --2- 172.21.15.50:0/3003984037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fdcb0 0x559b4680cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.410+0000 7fcb21a00640 1 --2- 172.21.15.50:0/3003984037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b46808e90 0x559b4680d800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcb1409ace0 tx=0x7fcb14004a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9e23c8b006473a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.410+0000 7fcb02a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:15:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.410+0000 7fcb02a00640 1 -- 172.21.15.50:0/3003984037 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1409a940 con 0x559b46808e90 2024-09-10T10:15:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.410+0000 7fcb02a00640 1 -- 172.21.15.50:0/3003984037 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fcb14097650 con 0x559b46808e90 2024-09-10T10:15:17.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.410+0000 7fcb263cb740 1 -- 172.21.15.50:0/3003984037 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb10005220 con 0x559b46808e90 2024-09-10T10:15:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.411+0000 7fcb02a00640 1 -- 172.21.15.50:0/3003984037 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcb1409adb0 con 0x559b46808e90 2024-09-10T10:15:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.411+0000 7fcb263cb740 10 client.26167 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.411+0000 7fcb263cb740 1 -- 172.21.15.50:0/3003984037 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559b46894fe0 con 0x559b46808e90 2024-09-10T10:15:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.411+0000 7fcb02a00640 1 -- 172.21.15.50:0/3003984037 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb10005220 con 0x559b46808e90 2024-09-10T10:15:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.412+0000 7fcb02a00640 1 -- 172.21.15.50:0/3003984037 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fcb140ab030 con 0x559b46808e90 2024-09-10T10:15:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.412+0000 7fcb263cb740 10 client.26167 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.412+0000 7fcb263cb740 10 client.26167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:15:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.412+0000 7fcb263cb740 20 client.26167 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.412+0000 7fcb263cb740 1 --2- 172.21.15.50:0/3003984037 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559b468956a0 0x559b46897ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.412+0000 7fcb263cb740 4 client.26167 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T10:15:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.412+0000 7fcb263cb740 1 -- 172.21.15.50:0/3003984037 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559b4676bd10 con 0x559b468956a0 2024-09-10T10:15:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.412+0000 7fcb21000640 1 --2- 172.21.15.50:0/3003984037 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559b468956a0 0x559b46897ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:17.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.414+0000 7fcb02a00640 10 client.26167 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.414+0000 7fcb21000640 1 --2- 172.21.15.50:0/3003984037 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559b468956a0 0x559b46897ac0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5aaed543ade4396 server_cookie=fb72f57702daad75 in_seq=0 out_seq=0 2024-09-10T10:15:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.415+0000 7fcb02a00640 1 -- 172.21.15.50:0/3003984037 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559b4676bd10 con 0x559b468956a0 2024-09-10T10:15:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.415+0000 7fcb02a00640 10 client.26167 handle_command_reply: tid=0 2024-09-10T10:15:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.415+0000 7fcb263cb740 1 client.26167 shutdown 2024-09-10T10:15:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.416+0000 7fcb263cb740 1 -- 172.21.15.50:0/3003984037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b46808e90 msgr2=0x559b4680d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.416+0000 7fcb263cb740 1 --2- 172.21.15.50:0/3003984037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b46808e90 0x559b4680d800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcb1409ace0 tx=0x7fcb14004a60 comp rx=0 tx=0).stop 2024-09-10T10:15:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.416+0000 7fcb263cb740 1 -- 172.21.15.50:0/3003984037 shutdown_connections 2024-09-10T10:15:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.416+0000 7fcb263cb740 1 --2- 172.21.15.50:0/3003984037 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559b468956a0 0x559b46897ac0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.416+0000 7fcb263cb740 1 --2- 172.21.15.50:0/3003984037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559b46808e90 0x559b4680d800 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.416+0000 7fcb263cb740 1 --2- 172.21.15.50:0/3003984037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559b467fe5d0 0x559b4680d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.416+0000 7fcb263cb740 1 --2- 172.21.15.50:0/3003984037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b467fdcb0 0x559b4680cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.644 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:15:17.644 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-10T10:15:17.644 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "a2bb4191-7418-44fb-9a7a-f478c4c25b3f", 2024-09-10T10:15:17.644 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-10T10:15:17.644 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:15:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.416+0000 7fcb263cb740 1 -- 172.21.15.50:0/3003984037 >> 172.21.15.50:0/3003984037 conn(0x559b467fa240 msgr2=0x559b467fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.416+0000 7fcb02a00640 0 client.26167 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.416+0000 7fcb263cb740 1 -- 172.21.15.50:0/3003984037 shutdown_connections 2024-09-10T10:15:17.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.417+0000 7fcb263cb740 1 -- 172.21.15.50:0/3003984037 wait complete. 2024-09-10T10:15:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.417+0000 7fcb263cb740 20 client.26167 trim_cache size 0 max 16384 2024-09-10T10:15:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.421+0000 7fcb22400640 1 -- 172.21.15.50:0/2870954199 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcb040a2c80 msgr2=0x7fcb040a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.421+0000 7fcb22400640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcb040a2c80 0x7fcb040a5140 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcb08006010 tx=0x7fcb08004180 comp rx=0 tx=0).stop 2024-09-10T10:15:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.421+0000 7fcb22400640 1 -- 172.21.15.50:0/2870954199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1c10c040 msgr2=0x7fcb1c10c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.421+0000 7fcb22400640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1c10c040 0x7fcb1c10c4f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400be20 tx=0x7fcb1400bf10 comp rx=0 tx=0).stop 2024-09-10T10:15:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.425+0000 7fcb22400640 1 -- 172.21.15.50:0/2870954199 shutdown_connections 2024-09-10T10:15:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.425+0000 7fcb22400640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcb040a2c80 0x7fcb040a5140 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.425+0000 7fcb22400640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb1c10c040 0x7fcb1c10c4f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.425+0000 7fcb22400640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb1c1079d0 0x7fcb1c10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.425+0000 7fcb22400640 1 --2- 172.21.15.50:0/2870954199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb1c102370 0x7fcb1c19f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.425+0000 7fcb22400640 1 -- 172.21.15.50:0/2870954199 >> 172.21.15.50:0/2870954199 conn(0x7fcb1c0fd710 msgr2=0x7fcb1c10d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.425+0000 7fcb22400640 1 -- 172.21.15.50:0/2870954199 shutdown_connections 2024-09-10T10:15:17.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:17.425+0000 7fcb22400640 1 -- 172.21.15.50:0/2870954199 wait complete. 2024-09-10T10:15:18.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:18 smithi050 ceph-mon[30354]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 287 MiB/s wr, 80 op/s 2024-09-10T10:15:18.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:18 smithi050 ceph-mon[30354]: scrub queued for path: / 2024-09-10T10:15:18.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:18 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:15:18.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:18 smithi050 ceph-mon[30354]: scrub summary: active paths [/] 2024-09-10T10:15:18.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:18 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:15:18.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:18 smithi189 ceph-mon[34999]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 287 MiB/s wr, 80 op/s 2024-09-10T10:15:18.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:18 smithi189 ceph-mon[34999]: scrub queued for path: / 2024-09-10T10:15:18.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:18 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:15:18.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:18 smithi189 ceph-mon[34999]: scrub summary: active paths [/] 2024-09-10T10:15:18.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:18 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:15:18.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:18 smithi084 ceph-mon[34812]: pgmap v514: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 287 MiB/s wr, 80 op/s 2024-09-10T10:15:18.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:18 smithi084 ceph-mon[34812]: scrub queued for path: / 2024-09-10T10:15:18.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:18 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:15:18.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:18 smithi084 ceph-mon[34812]: scrub summary: active paths [/] 2024-09-10T10:15:18.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:18 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:15:18.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:15:19.365 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:19.533 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:19 smithi050 ceph-mon[30354]: scrub summary: idle 2024-09-10T10:15:19.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:19 smithi189 ceph-mon[34999]: scrub summary: idle 2024-09-10T10:15:19.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:19 smithi084 ceph-mon[34812]: scrub summary: idle 2024-09-10T10:15:20.217 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.214+0000 7f19f3200640 1 -- 172.21.15.50:0/1656577288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f4103e30 msgr2=0x7f19f4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.214+0000 7f19f3200640 1 --2- 172.21.15.50:0/1656577288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f4103e30 0x7f19f4104210 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009900 tx=0x7f19e402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.215+0000 7f19f3200640 1 -- 172.21.15.50:0/1656577288 shutdown_connections 2024-09-10T10:15:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.215+0000 7f19f3200640 1 --2- 172.21.15.50:0/1656577288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19f4108f60 0x7f19f4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.215+0000 7f19f3200640 1 --2- 172.21.15.50:0/1656577288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f41047e0 0x7f19f4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.215+0000 7f19f3200640 1 --2- 172.21.15.50:0/1656577288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f4103e30 0x7f19f4104210 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.215+0000 7f19f3200640 1 -- 172.21.15.50:0/1656577288 >> 172.21.15.50:0/1656577288 conn(0x7f19f40ff910 msgr2=0x7f19f4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.215+0000 7f19f3200640 1 -- 172.21.15.50:0/1656577288 shutdown_connections 2024-09-10T10:15:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.215+0000 7f19f3200640 1 -- 172.21.15.50:0/1656577288 wait complete. 2024-09-10T10:15:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.216+0000 7f19f3200640 1 Processor -- start 2024-09-10T10:15:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.216+0000 7f19f3200640 1 -- start start 2024-09-10T10:15:20.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.216+0000 7f19f3200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19f4103e30 0x7f19f4110990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f3200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f41047e0 0x7f19f410da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f3200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f4108f60 0x7f19f410dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f3200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4114010 con 0x7f19f4103e30 2024-09-10T10:15:20.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f3200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4113e90 con 0x7f19f41047e0 2024-09-10T10:15:20.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f3200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4114190 con 0x7f19f4108f60 2024-09-10T10:15:20.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f41047e0 0x7f19f410da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f41047e0 0x7f19f410da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:53048/0 (socket says 172.21.15.50:53048) 2024-09-10T10:15:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f1400640 1 -- 172.21.15.50:0/1898721572 learned_addr learned my addr 172.21.15.50:0/1898721572 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f1e00640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19f4103e30 0x7f19f4110990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f2800640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f4108f60 0x7f19f410dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f1400640 1 -- 172.21.15.50:0/1898721572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f4108f60 msgr2=0x7f19f410dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f1400640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f4108f60 0x7f19f410dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f1400640 1 -- 172.21.15.50:0/1898721572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19f4103e30 msgr2=0x7f19f4110990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f1400640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19f4103e30 0x7f19f4110990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.217+0000 7f19f1400640 1 -- 172.21.15.50:0/1898721572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f410e860 con 0x7f19f41047e0 2024-09-10T10:15:20.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.218+0000 7f19f1400640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f41047e0 0x7f19f410da40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f19e000ea60 tx=0x7f19e000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:20.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.218+0000 7f19eaa00640 1 -- 172.21.15.50:0/1898721572 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e000cde0 con 0x7f19f41047e0 2024-09-10T10:15:20.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.218+0000 7f19eaa00640 1 -- 172.21.15.50:0/1898721572 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e00035f0 con 0x7f19f41047e0 2024-09-10T10:15:20.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.218+0000 7f19eaa00640 1 -- 172.21.15.50:0/1898721572 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e0010670 con 0x7f19f41047e0 2024-09-10T10:15:20.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.218+0000 7f19f3200640 1 -- 172.21.15.50:0/1898721572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f41aae10 con 0x7f19f41047e0 2024-09-10T10:15:20.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.218+0000 7f19f3200640 1 -- 172.21.15.50:0/1898721572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f41ab210 con 0x7f19f41047e0 2024-09-10T10:15:20.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.222+0000 7f19fbbdf740 1 Processor -- start 2024-09-10T10:15:20.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.222+0000 7f19fbbdf740 1 -- start start 2024-09-10T10:15:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.223+0000 7f19fbbdf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74cd50 0x559efc74d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.223+0000 7f19fbbdf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 0x559efc7579f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.224+0000 7f19f2800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74cd50 0x559efc74d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.224+0000 7f19f2800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74cd50 0x559efc74d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50242/0 (socket says 172.21.15.50:50242) 2024-09-10T10:15:20.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.224+0000 7f19f2800640 1 -- 172.21.15.50:0/1748126068 learned_addr learned my addr 172.21.15.50:0/1748126068 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.224+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1748126068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc757f30 0x559efc75a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.225+0000 7f19f1e00640 1 --2- 172.21.15.50:0/1748126068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 0x559efc7579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.225+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1748126068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559efc6b33e0 con 0x559efc74d670 2024-09-10T10:15:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.225+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1748126068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559efc65ad80 con 0x559efc757f30 2024-09-10T10:15:20.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.225+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1748126068 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559efc6af3a0 con 0x559efc74cd50 2024-09-10T10:15:20.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.226+0000 7f19f1e00640 1 -- 172.21.15.50:0/1748126068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74cd50 msgr2=0x559efc74d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.226+0000 7f19f1e00640 1 --2- 172.21.15.50:0/1748126068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74cd50 0x559efc74d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.226+0000 7f19f1e00640 1 -- 172.21.15.50:0/1748126068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc757f30 msgr2=0x559efc75a320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:15:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.226+0000 7f19f1e00640 1 --2- 172.21.15.50:0/1748126068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc757f30 0x559efc75a320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.226+0000 7f19f1e00640 1 -- 172.21.15.50:0/1748126068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559efc679ae0 con 0x559efc74d670 2024-09-10T10:15:20.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.227+0000 7f19eaa00640 1 -- 172.21.15.50:0/1898721572 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f19e00037a0 con 0x7f19f41047e0 2024-09-10T10:15:20.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.227+0000 7f19f1e00640 1 --2- 172.21.15.50:0/1748126068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 0x559efc7579f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f19e402a9e0 tx=0x7f19e4005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28eb2ce32bf3cfe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:20.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.228+0000 7f19df400640 1 -- 172.21.15.50:0/1748126068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4035030 con 0x559efc74d670 2024-09-10T10:15:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.228+0000 7f19df400640 1 -- 172.21.15.50:0/1748126068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e40043c0 con 0x559efc74d670 2024-09-10T10:15:20.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.228+0000 7f19df400640 1 -- 172.21.15.50:0/1748126068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e40035f0 con 0x559efc74d670 2024-09-10T10:15:20.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.229+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1748126068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 msgr2=0x559efc7579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:20.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.229+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1748126068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 0x559efc7579f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f19e402a9e0 tx=0x7f19e4005e60 comp rx=0 tx=0).stop 2024-09-10T10:15:20.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.230+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1748126068 shutdown_connections 2024-09-10T10:15:20.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.230+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1748126068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc757f30 0x559efc75a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.230+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1748126068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 0x559efc7579f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.230+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1748126068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74cd50 0x559efc74d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.230+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1748126068 >> 172.21.15.50:0/1748126068 conn(0x559efc7492e0 msgr2=0x559efc7496c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:20.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.231+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1748126068 shutdown_connections 2024-09-10T10:15:20.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.232+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1748126068 wait complete. 2024-09-10T10:15:20.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.232+0000 7f19fbbdf740 1 -- start start 2024-09-10T10:15:20.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.233+0000 7f19fbbdf740 1 Processor -- start 2024-09-10T10:15:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.233+0000 7f19eaa00640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19d80a2b10 0x7f19d80a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.233+0000 7f19fbbdf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc74cd50 0x559efc754f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.233+0000 7f19fbbdf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74d670 0x559efc7554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.233+0000 7f19fbbdf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc757f30 0x559efc7559f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.233+0000 7f19fbbdf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559efc75aba0 con 0x559efc757f30 2024-09-10T10:15:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.233+0000 7f19fbbdf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559efc66e0f0 con 0x559efc74cd50 2024-09-10T10:15:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.233+0000 7f19fbbdf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559efc75ad20 con 0x559efc74d670 2024-09-10T10:15:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.233+0000 7f19fbbdf740 10 client.0 _ll_register_callbacks cb 0x559efc65f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.234+0000 7f19f2800640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19d80a2b10 0x7f19d80a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.234+0000 7f19f1400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74d670 0x559efc7554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.234+0000 7f19f1400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74d670 0x559efc7554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50248/0 (socket says 172.21.15.50:50248) 2024-09-10T10:15:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.234+0000 7f19f1400640 1 -- 172.21.15.50:0/1249536130 learned_addr learned my addr 172.21.15.50:0/1249536130 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:20.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.235+0000 7f19eaa00640 1 -- 172.21.15.50:0/1898721572 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f19e00cf870 con 0x7f19f41047e0 2024-09-10T10:15:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.235+0000 7f19f2800640 1 --2- 172.21.15.50:0/1249536130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc757f30 0x559efc7559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.235+0000 7f19f1e00640 1 --2- 172.21.15.50:0/1249536130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc74cd50 0x559efc754f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.235+0000 7f19f1400640 1 -- 172.21.15.50:0/1249536130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc74cd50 msgr2=0x559efc754f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.235+0000 7f19f1400640 1 --2- 172.21.15.50:0/1249536130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc74cd50 0x559efc754f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.235+0000 7f19f1400640 1 -- 172.21.15.50:0/1249536130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc757f30 msgr2=0x559efc7559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.235+0000 7f19f1400640 1 --2- 172.21.15.50:0/1249536130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc757f30 0x559efc7559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.235+0000 7f19f1400640 1 -- 172.21.15.50:0/1249536130 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559efc4243c0 con 0x559efc74d670 2024-09-10T10:15:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.236+0000 7f19f1400640 1 --2- 172.21.15.50:0/1249536130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74d670 0x559efc7554b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f19e000c760 tx=0x7f19e009b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c0d164f0e34a753 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.236+0000 7f19d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:15:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.236+0000 7f19f2800640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19d80a2b10 0x7f19d80a4fd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009530 tx=0x7f19ec009de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:20.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.236+0000 7f19d3e00640 1 -- 172.21.15.50:0/1249536130 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e001e2e0 con 0x559efc74d670 2024-09-10T10:15:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.236+0000 7f19d3e00640 1 -- 172.21.15.50:0/1249536130 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f19e0003b30 con 0x559efc74d670 2024-09-10T10:15:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.236+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1249536130 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19e40043c0 con 0x559efc74d670 2024-09-10T10:15:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.236+0000 7f19d3e00640 1 -- 172.21.15.50:0/1249536130 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f19e009bce0 con 0x559efc74d670 2024-09-10T10:15:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.236+0000 7f19fbbdf740 10 client.26176 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.236+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1249536130 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559efc7669f0 con 0x559efc74d670 2024-09-10T10:15:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.237+0000 7f19d3e00640 1 -- 172.21.15.50:0/1249536130 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e0083070 con 0x559efc74d670 2024-09-10T10:15:20.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.237+0000 7f19d3e00640 1 -- 172.21.15.50:0/1249536130 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f19e007ab50 con 0x559efc74d670 2024-09-10T10:15:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.237+0000 7f19fbbdf740 10 client.26176 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.237+0000 7f19fbbdf740 10 client.26176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:15:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.237+0000 7f19fbbdf740 20 client.26176 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.237+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1249536130 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559efc767e00 0x559efc76a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.237+0000 7f19fbbdf740 4 client.26176 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:15:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.237+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1249536130 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559efc6c0950 con 0x559efc767e00 2024-09-10T10:15:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.238+0000 7f19f1e00640 1 --2- 172.21.15.50:0/1249536130 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559efc767e00 0x559efc76a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.238+0000 7f19f1e00640 1 --2- 172.21.15.50:0/1249536130 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559efc767e00 0x559efc76a1f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67695667cbaba2bc server_cookie=8b60468a8def9e0b in_seq=0 out_seq=0 2024-09-10T10:15:20.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.238+0000 7f19d3e00640 10 client.26176 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.239+0000 7f19d3e00640 1 -- 172.21.15.50:0/1249536130 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559efc6c0950 con 0x559efc767e00 2024-09-10T10:15:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.239+0000 7f19d3e00640 10 client.26176 handle_command_reply: tid=0 2024-09-10T10:15:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.239+0000 7f19fbbdf740 1 client.26176 shutdown 2024-09-10T10:15:20.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.239+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1249536130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74d670 msgr2=0x559efc7554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:20.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.239+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1249536130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74d670 0x559efc7554b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f19e000c760 tx=0x7f19e009b820 comp rx=0 tx=0).stop 2024-09-10T10:15:20.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.240+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1249536130 shutdown_connections 2024-09-10T10:15:20.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.240+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1249536130 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559efc767e00 0x559efc76a1f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.240+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1249536130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc757f30 0x559efc7559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.240+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1249536130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74d670 0x559efc7554b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.240+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1249536130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc74cd50 0x559efc754f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.240+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1249536130 >> 172.21.15.50:0/1249536130 conn(0x559efc7492e0 msgr2=0x559efc74efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:20.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.240+0000 7f19d3e00640 0 client.26176 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:20.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.240+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1249536130 shutdown_connections 2024-09-10T10:15:20.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.240+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1249536130 wait complete. 2024-09-10T10:15:20.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.240+0000 7f19fbbdf740 20 client.26176 trim_cache size 0 max 16384 2024-09-10T10:15:20.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.264+0000 7f19fbbdf740 1 Processor -- start 2024-09-10T10:15:20.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.264+0000 7f19fbbdf740 1 -- start start 2024-09-10T10:15:20.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.265+0000 7f19fbbdf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc74cd50 0x559efc755840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.265+0000 7f19fbbdf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 0x559efc756ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.265+0000 7f19fbbdf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc757f30 0x559efc76faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.265+0000 7f19fbbdf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41b7940 con 0x559efc74d670 2024-09-10T10:15:20.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.265+0000 7f19fbbdf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41b5210 con 0x559efc74cd50 2024-09-10T10:15:20.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.265+0000 7f19fbbdf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41b3060 con 0x559efc757f30 2024-09-10T10:15:20.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.265+0000 7f19f2800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc757f30 0x559efc76faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.265+0000 7f19f2800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc757f30 0x559efc76faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50262/0 (socket says 172.21.15.50:50262) 2024-09-10T10:15:20.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.265+0000 7f19f2800640 1 -- 172.21.15.50:0/1699360465 learned_addr learned my addr 172.21.15.50:0/1699360465 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:20.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.265+0000 7f19f2800640 1 -- 172.21.15.50:0/1699360465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc74cd50 msgr2=0x559efc755840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:20.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.265+0000 7f19f2800640 1 --2- 172.21.15.50:0/1699360465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc74cd50 0x559efc755840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.265+0000 7f19f1400640 1 --2- 172.21.15.50:0/1699360465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 0x559efc756ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.265+0000 7f19f2800640 1 -- 172.21.15.50:0/1699360465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 msgr2=0x559efc756ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:20.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.266+0000 7f19f2800640 1 --2- 172.21.15.50:0/1699360465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 0x559efc756ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.266+0000 7f19f2800640 1 -- 172.21.15.50:0/1699360465 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559efc7534c0 con 0x559efc757f30 2024-09-10T10:15:20.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.266+0000 7f19f1400640 1 --2- 172.21.15.50:0/1699360465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 0x559efc756ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:20.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.267+0000 7f19f2800640 1 --2- 172.21.15.50:0/1699360465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc757f30 0x559efc76faa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0136f0 tx=0x7f19ec020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6d7497304d3dcfb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:20.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.267+0000 7f19dea00640 1 -- 172.21.15.50:0/1699360465 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec004b20 con 0x559efc757f30 2024-09-10T10:15:20.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.267+0000 7f19dea00640 1 -- 172.21.15.50:0/1699360465 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19ec004cc0 con 0x559efc757f30 2024-09-10T10:15:20.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.267+0000 7f19dea00640 1 -- 172.21.15.50:0/1699360465 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec005330 con 0x559efc757f30 2024-09-10T10:15:20.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.268+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1699360465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc757f30 msgr2=0x559efc76faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:20.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.268+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1699360465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc757f30 0x559efc76faa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0136f0 tx=0x7f19ec020000 comp rx=0 tx=0).stop 2024-09-10T10:15:20.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.268+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1699360465 shutdown_connections 2024-09-10T10:15:20.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.268+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1699360465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc757f30 0x559efc76faa0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.268+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1699360465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 0x559efc756ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.268+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/1699360465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc74cd50 0x559efc755840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.268+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1699360465 >> 172.21.15.50:0/1699360465 conn(0x559efc7492e0 msgr2=0x559efc7567d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:20.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.268+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1699360465 shutdown_connections 2024-09-10T10:15:20.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.268+0000 7f19fbbdf740 1 -- 172.21.15.50:0/1699360465 wait complete. 2024-09-10T10:15:20.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.268+0000 7f19fbbdf740 1 -- start start 2024-09-10T10:15:20.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.269+0000 7f19fbbdf740 1 Processor -- start 2024-09-10T10:15:20.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.269+0000 7f19fbbdf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74cd50 0x559efc760460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.269+0000 7f19fbbdf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 0x559efc75b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.269+0000 7f19fbbdf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc757f30 0x559efc75bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.269+0000 7f19fbbdf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41b36d0 con 0x559efc74d670 2024-09-10T10:15:20.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19fbbdf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41b4b40 con 0x559efc757f30 2024-09-10T10:15:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19fbbdf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41b3da0 con 0x559efc74cd50 2024-09-10T10:15:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19f1e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74cd50 0x559efc760460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19f2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc757f30 0x559efc75bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19fbbdf740 10 client.0 _ll_register_callbacks cb 0x7f19e0097f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19f2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc757f30 0x559efc75bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:53074/0 (socket says 172.21.15.50:53074) 2024-09-10T10:15:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19f2800640 1 -- 172.21.15.50:0/4088379113 learned_addr learned my addr 172.21.15.50:0/4088379113 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19f2800640 1 -- 172.21.15.50:0/4088379113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74cd50 msgr2=0x559efc760460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19f2800640 1 --2- 172.21.15.50:0/4088379113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74cd50 0x559efc760460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19f2800640 1 -- 172.21.15.50:0/4088379113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 msgr2=0x559efc75b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19f2800640 1 --2- 172.21.15.50:0/4088379113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 0x559efc75b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19f2800640 1 -- 172.21.15.50:0/4088379113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559efc75c290 con 0x559efc757f30 2024-09-10T10:15:20.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19f2800640 1 --2- 172.21.15.50:0/4088379113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc757f30 0x559efc75bcd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f19ec011fd0 tx=0x7f19ec01fc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11939da59e579605 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.270+0000 7f19d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:15:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.271+0000 7f19d3e00640 1 -- 172.21.15.50:0/4088379113 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec01f990 con 0x559efc757f30 2024-09-10T10:15:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.271+0000 7f19fbbdf740 1 -- 172.21.15.50:0/4088379113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19ec004cc0 con 0x559efc757f30 2024-09-10T10:15:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.271+0000 7f19d3e00640 1 -- 172.21.15.50:0/4088379113 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f19ec005090 con 0x559efc757f30 2024-09-10T10:15:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.271+0000 7f19d3e00640 1 -- 172.21.15.50:0/4088379113 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f19ec005290 con 0x559efc757f30 2024-09-10T10:15:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.271+0000 7f19fbbdf740 10 client.26171 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.271+0000 7f19fbbdf740 1 -- 172.21.15.50:0/4088379113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559efc7e3790 con 0x559efc757f30 2024-09-10T10:15:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.271+0000 7f19d3e00640 1 -- 172.21.15.50:0/4088379113 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19ec004cc0 con 0x559efc757f30 2024-09-10T10:15:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.272+0000 7f19d3e00640 1 -- 172.21.15.50:0/4088379113 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f19ec020070 con 0x559efc757f30 2024-09-10T10:15:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.272+0000 7f19fbbdf740 10 client.26171 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.272+0000 7f19fbbdf740 10 client.26171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:15:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.272+0000 7f19fbbdf740 20 client.26171 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.272+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/4088379113 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559efc7e3e90 0x559efc7e62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:20.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.272+0000 7f19fbbdf740 4 client.26171 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:15:20.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.272+0000 7f19fbbdf740 1 -- 172.21.15.50:0/4088379113 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559efc6bae60 con 0x559efc7e3e90 2024-09-10T10:15:20.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.272+0000 7f19f1e00640 1 --2- 172.21.15.50:0/4088379113 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559efc7e3e90 0x559efc7e62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:20.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19f1e00640 1 --2- 172.21.15.50:0/4088379113 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559efc7e3e90 0x559efc7e62b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd9347bd2a4b84ed server_cookie=ecd56b1cab8450ce in_seq=0 out_seq=0 2024-09-10T10:15:20.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19d3e00640 10 client.26171 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:20.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19d3e00640 1 -- 172.21.15.50:0/4088379113 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559efc6bae60 con 0x559efc7e3e90 2024-09-10T10:15:20.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19d3e00640 10 client.26171 handle_command_reply: tid=0 2024-09-10T10:15:20.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19fbbdf740 1 client.26171 shutdown 2024-09-10T10:15:20.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19fbbdf740 1 -- 172.21.15.50:0/4088379113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc757f30 msgr2=0x559efc75bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:20.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/4088379113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc757f30 0x559efc75bcd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f19ec011fd0 tx=0x7f19ec01fc70 comp rx=0 tx=0).stop 2024-09-10T10:15:20.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19fbbdf740 1 -- 172.21.15.50:0/4088379113 shutdown_connections 2024-09-10T10:15:20.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/4088379113 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559efc7e3e90 0x559efc7e62b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/4088379113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559efc757f30 0x559efc75bcd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/4088379113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559efc74d670 0x559efc75b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19fbbdf740 1 --2- 172.21.15.50:0/4088379113 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559efc74cd50 0x559efc760460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19d3e00640 0 client.26171 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.273+0000 7f19fbbdf740 1 -- 172.21.15.50:0/4088379113 >> 172.21.15.50:0/4088379113 conn(0x559efc7492e0 msgr2=0x559efc748380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.274+0000 7f19fbbdf740 1 -- 172.21.15.50:0/4088379113 shutdown_connections 2024-09-10T10:15:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.274+0000 7f19fbbdf740 1 -- 172.21.15.50:0/4088379113 wait complete. 2024-09-10T10:15:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.274+0000 7f19fbbdf740 20 client.26171 trim_cache size 0 max 16384 2024-09-10T10:15:20.277 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:15:20.277 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-10T10:15:20.277 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-10T10:15:20.278 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:15:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.275+0000 7f19f3200640 1 -- 172.21.15.50:0/1898721572 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19d80a2b10 msgr2=0x7f19d80a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.275+0000 7f19f3200640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19d80a2b10 0x7f19d80a4fd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009530 tx=0x7f19ec009de0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.275+0000 7f19f3200640 1 -- 172.21.15.50:0/1898721572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f41047e0 msgr2=0x7f19f410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.275+0000 7f19f3200640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f41047e0 0x7f19f410da40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f19e000ea60 tx=0x7f19e000ef20 comp rx=0 tx=0).stop 2024-09-10T10:15:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.275+0000 7f19f3200640 1 -- 172.21.15.50:0/1898721572 shutdown_connections 2024-09-10T10:15:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.275+0000 7f19f3200640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f19d80a2b10 0x7f19d80a4fd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.275+0000 7f19f3200640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f4108f60 0x7f19f410dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.275+0000 7f19f3200640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19f41047e0 0x7f19f410da40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.275+0000 7f19f3200640 1 --2- 172.21.15.50:0/1898721572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19f4103e30 0x7f19f4110990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.275+0000 7f19f3200640 1 -- 172.21.15.50:0/1898721572 >> 172.21.15.50:0/1898721572 conn(0x7f19f40ff910 msgr2=0x7f19f4100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.275+0000 7f19f3200640 1 -- 172.21.15.50:0/1898721572 shutdown_connections 2024-09-10T10:15:20.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:20.275+0000 7f19f3200640 1 -- 172.21.15.50:0/1898721572 wait complete. 2024-09-10T10:15:20.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:20 smithi050 ceph-mon[30354]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 323 MiB/s wr, 87 op/s 2024-09-10T10:15:20.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:20 smithi189 ceph-mon[34999]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 323 MiB/s wr, 87 op/s 2024-09-10T10:15:20.598 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:20 smithi084 ceph-mon[34812]: pgmap v515: 129 pgs: 129 active+clean; 10 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 323 MiB/s wr, 87 op/s 2024-09-10T10:15:21.159 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T10:15:21.159 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:15:21.554 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:22.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.153+0000 7f0835c00640 1 -- 172.21.15.50:0/3834813403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0830112a30 msgr2=0x7f0830114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.153+0000 7f0835c00640 1 --2- 172.21.15.50:0/3834813403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0830112a30 0x7f0830114e20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0828009ca0 tx=0x7f082802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.154+0000 7f0835c00640 1 -- 172.21.15.50:0/3834813403 shutdown_connections 2024-09-10T10:15:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.154+0000 7f0835c00640 1 --2- 172.21.15.50:0/3834813403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0830112a30 0x7f0830114e20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.154+0000 7f0835c00640 1 --2- 172.21.15.50:0/3834813403 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0830077040 0x7f08301124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.154+0000 7f0835c00640 1 --2- 172.21.15.50:0/3834813403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0830076720 0x7f0830076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.154+0000 7f0835c00640 1 -- 172.21.15.50:0/3834813403 >> 172.21.15.50:0/3834813403 conn(0x7f08300ffa90 msgr2=0x7f0830101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.154+0000 7f0835c00640 1 -- 172.21.15.50:0/3834813403 shutdown_connections 2024-09-10T10:15:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.154+0000 7f0835c00640 1 -- 172.21.15.50:0/3834813403 wait complete. 2024-09-10T10:15:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.155+0000 7f0835c00640 1 Processor -- start 2024-09-10T10:15:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.155+0000 7f0835c00640 1 -- start start 2024-09-10T10:15:22.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.155+0000 7f0835c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0830076720 0x7f08301a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.155+0000 7f0835c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0830077040 0x7f08301a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.155+0000 7f0835c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0830112a30 0x7f083019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.155+0000 7f0835c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0830118590 con 0x7f0830112a30 2024-09-10T10:15:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.155+0000 7f0835c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0830118410 con 0x7f0830076720 2024-09-10T10:15:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.155+0000 7f0835c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0830118710 con 0x7f0830077040 2024-09-10T10:15:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.155+0000 7f082ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0830076720 0x7f08301a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.155+0000 7f082f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0830112a30 0x7f083019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.155+0000 7f082ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0830076720 0x7f08301a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:53092/0 (socket says 172.21.15.50:53092) 2024-09-10T10:15:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.155+0000 7f082ea00640 1 -- 172.21.15.50:0/1952546923 learned_addr learned my addr 172.21.15.50:0/1952546923 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.156+0000 7f082e000640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0830077040 0x7f08301a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.156+0000 7f082ea00640 1 -- 172.21.15.50:0/1952546923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0830077040 msgr2=0x7f08301a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.156+0000 7f082ea00640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0830077040 0x7f08301a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.156+0000 7f082ea00640 1 -- 172.21.15.50:0/1952546923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0830112a30 msgr2=0x7f083019e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.156+0000 7f082ea00640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0830112a30 0x7f083019e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.156+0000 7f082ea00640 1 -- 172.21.15.50:0/1952546923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083019f000 con 0x7f0830076720 2024-09-10T10:15:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.156+0000 7f082f400640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0830112a30 0x7f083019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.156+0000 7f082ea00640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0830076720 0x7f08301a4710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f082000e9f0 tx=0x7f082000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.156+0000 7f0827400640 1 -- 172.21.15.50:0/1952546923 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082000cd80 con 0x7f0830076720 2024-09-10T10:15:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.156+0000 7f0827400640 1 -- 172.21.15.50:0/1952546923 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0820010910 con 0x7f0830076720 2024-09-10T10:15:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.156+0000 7f0835c00640 1 -- 172.21.15.50:0/1952546923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083019f2f0 con 0x7f0830076720 2024-09-10T10:15:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.156+0000 7f0827400640 1 -- 172.21.15.50:0/1952546923 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820018990 con 0x7f0830076720 2024-09-10T10:15:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.156+0000 7f0835c00640 1 -- 172.21.15.50:0/1952546923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08301ab5e0 con 0x7f0830076720 2024-09-10T10:15:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.158+0000 7f0835c00640 1 -- 172.21.15.50:0/1952546923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0830076b00 con 0x7f0830076720 2024-09-10T10:15:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.160+0000 7f0827400640 1 -- 172.21.15.50:0/1952546923 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0820010ac0 con 0x7f0830076720 2024-09-10T10:15:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.161+0000 7f0827400640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f08140a2b80 0x7f08140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:22.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.161+0000 7f0827400640 1 -- 172.21.15.50:0/1952546923 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f08200cfb80 con 0x7f0830076720 2024-09-10T10:15:22.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.161+0000 7f082e000640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f08140a2b80 0x7f08140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:22.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.162+0000 7f082e000640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f08140a2b80 0x7f08140a5040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f08300793e0 tx=0x7f081c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:22.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.163+0000 7f0827400640 1 -- 172.21.15.50:0/1952546923 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f082009c0a0 con 0x7f0830076720 2024-09-10T10:15:22.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.385+0000 7f0835c00640 1 -- 172.21.15.50:0/1952546923 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f083019fe00 con 0x7f0830076720 2024-09-10T10:15:22.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.386+0000 7f0827400640 1 -- 172.21.15.50:0/1952546923 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f08200a03a0 con 0x7f0830076720 2024-09-10T10:15:22.388 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:15:22.388 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:15:22.389 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:15:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.389+0000 7f0835c00640 1 -- 172.21.15.50:0/1952546923 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f08140a2b80 msgr2=0x7f08140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.389+0000 7f0835c00640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f08140a2b80 0x7f08140a5040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f08300793e0 tx=0x7f081c005f90 comp rx=0 tx=0).stop 2024-09-10T10:15:22.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.389+0000 7f0835c00640 1 -- 172.21.15.50:0/1952546923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0830076720 msgr2=0x7f08301a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.389+0000 7f0835c00640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0830076720 0x7f08301a4710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f082000e9f0 tx=0x7f082000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.389+0000 7f0835c00640 1 -- 172.21.15.50:0/1952546923 shutdown_connections 2024-09-10T10:15:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.389+0000 7f0835c00640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f08140a2b80 0x7f08140a5040 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.389+0000 7f0835c00640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0830112a30 0x7f083019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.389+0000 7f0835c00640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0830077040 0x7f08301a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.389+0000 7f0835c00640 1 --2- 172.21.15.50:0/1952546923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0830076720 0x7f08301a4710 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.389+0000 7f0835c00640 1 -- 172.21.15.50:0/1952546923 >> 172.21.15.50:0/1952546923 conn(0x7f08300ffa90 msgr2=0x7f0830101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.389+0000 7f0835c00640 1 -- 172.21.15.50:0/1952546923 shutdown_connections 2024-09-10T10:15:22.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:22.389+0000 7f0835c00640 1 -- 172.21.15.50:0/1952546923 wait complete. 2024-09-10T10:15:22.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:22 smithi189 ceph-mon[34999]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 313 MiB/s wr, 84 op/s 2024-09-10T10:15:22.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:22 smithi084 ceph-mon[34812]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 313 MiB/s wr, 84 op/s 2024-09-10T10:15:22.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:22 smithi050 ceph-mon[30354]: pgmap v516: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 313 MiB/s wr, 84 op/s 2024-09-10T10:15:23.063 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:15:23.063 INFO:tasks.workunit.client.0.smithi050.stdout: Children see throughput for 1 rewriters = 275323.53 kB/sec 2024-09-10T10:15:23.063 INFO:tasks.workunit.client.0.smithi050.stdout: Parent sees throughput for 1 rewriters = 275317.39 kB/sec 2024-09-10T10:15:23.063 INFO:tasks.workunit.client.0.smithi050.stdout: Min throughput per process = 275323.53 kB/sec 2024-09-10T10:15:23.063 INFO:tasks.workunit.client.0.smithi050.stdout: Max throughput per process = 275323.53 kB/sec 2024-09-10T10:15:23.063 INFO:tasks.workunit.client.0.smithi050.stdout: Avg throughput per process = 275323.53 kB/sec 2024-09-10T10:15:23.063 INFO:tasks.workunit.client.0.smithi050.stdout: Min xfer = 10485760.00 kB 2024-09-10T10:15:23.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:23 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1952546923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:23.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:23 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1952546923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:23.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:23 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1952546923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:24.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:24 smithi189 ceph-mon[34999]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 286 MiB/s wr, 79 op/s 2024-09-10T10:15:24.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:24 smithi084 ceph-mon[34812]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 286 MiB/s wr, 79 op/s 2024-09-10T10:15:24.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:24 smithi050 ceph-mon[30354]: pgmap v517: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 286 MiB/s wr, 79 op/s 2024-09-10T10:15:24.904 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T10:15:25.289 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:25.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.851+0000 7f5985a00640 1 -- 172.21.15.50:0/891500815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5980076720 msgr2=0x7f5980076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:25.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.851+0000 7f5985a00640 1 --2- 172.21.15.50:0/891500815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5980076720 0x7f5980076b00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5970009900 tx=0x7f597002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.851+0000 7f5985a00640 1 -- 172.21.15.50:0/891500815 shutdown_connections 2024-09-10T10:15:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.851+0000 7f5985a00640 1 --2- 172.21.15.50:0/891500815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5980112890 0x7f5980114c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.851+0000 7f5985a00640 1 --2- 172.21.15.50:0/891500815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5980077040 0x7f5980112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.851+0000 7f5985a00640 1 --2- 172.21.15.50:0/891500815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5980076720 0x7f5980076b00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.851+0000 7f5985a00640 1 -- 172.21.15.50:0/891500815 >> 172.21.15.50:0/891500815 conn(0x7f59800ff8b0 msgr2=0x7f5980101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.851+0000 7f5985a00640 1 -- 172.21.15.50:0/891500815 shutdown_connections 2024-09-10T10:15:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.851+0000 7f5985a00640 1 -- 172.21.15.50:0/891500815 wait complete. 2024-09-10T10:15:25.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.852+0000 7f5985a00640 1 Processor -- start 2024-09-10T10:15:25.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.852+0000 7f5985a00640 1 -- start start 2024-09-10T10:15:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.852+0000 7f5985a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5980076720 0x7f59801a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.852+0000 7f5985a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5980077040 0x7f59801a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.852+0000 7f5985a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5980112890 0x7f598019e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.852+0000 7f5985a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5980118570 con 0x7f5980112890 2024-09-10T10:15:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.852+0000 7f5985a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f59801183f0 con 0x7f5980077040 2024-09-10T10:15:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.852+0000 7f5985a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f59801186f0 con 0x7f5980076720 2024-09-10T10:15:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.853+0000 7f5985000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5980112890 0x7f598019e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.853+0000 7f5977e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5980077040 0x7f59801a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.853+0000 7f5985000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5980112890 0x7f598019e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46972/0 (socket says 172.21.15.50:46972) 2024-09-10T10:15:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.853+0000 7f5985000640 1 -- 172.21.15.50:0/2193821575 learned_addr learned my addr 172.21.15.50:0/2193821575 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.853+0000 7f597fe00640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5980076720 0x7f59801a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.853+0000 7f5985000640 1 -- 172.21.15.50:0/2193821575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5980076720 msgr2=0x7f59801a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.853+0000 7f5985000640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5980076720 0x7f59801a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.853+0000 7f5985000640 1 -- 172.21.15.50:0/2193821575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5980077040 msgr2=0x7f59801a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:25.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.853+0000 7f5985000640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5980077040 0x7f59801a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.853+0000 7f5985000640 1 -- 172.21.15.50:0/2193821575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598019efe0 con 0x7f5980112890 2024-09-10T10:15:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.853+0000 7f5977e00640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5980077040 0x7f59801a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.854+0000 7f5985000640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5980112890 0x7f598019e840 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f597800eb10 tx=0x7f597800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.854+0000 7f597d600640 1 -- 172.21.15.50:0/2193821575 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5978004b20 con 0x7f5980112890 2024-09-10T10:15:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.854+0000 7f597d600640 1 -- 172.21.15.50:0/2193821575 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5978004cc0 con 0x7f5980112890 2024-09-10T10:15:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.854+0000 7f597d600640 1 -- 172.21.15.50:0/2193821575 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5978010790 con 0x7f5980112890 2024-09-10T10:15:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.854+0000 7f5985a00640 1 -- 172.21.15.50:0/2193821575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f598019f2d0 con 0x7f5980112890 2024-09-10T10:15:25.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.854+0000 7f5985a00640 1 -- 172.21.15.50:0/2193821575 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59801ab520 con 0x7f5980112890 2024-09-10T10:15:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.857+0000 7f5989a40740 1 Processor -- start 2024-09-10T10:15:25.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.857+0000 7f597d600640 1 -- 172.21.15.50:0/2193821575 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5978005020 con 0x7f5980112890 2024-09-10T10:15:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.857+0000 7f5989a40740 1 -- start start 2024-09-10T10:15:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.858+0000 7f5989a40740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910b7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.858+0000 7f5989a40740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.858+0000 7f5989a40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910c4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.858+0000 7f5989a40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55749101d3e0 con 0x5574910c2020 2024-09-10T10:15:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.858+0000 7f5989a40740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557490fc4d80 con 0x5574910b6e40 2024-09-10T10:15:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.858+0000 7f5989a40740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5574910193a0 con 0x5574910b7760 2024-09-10T10:15:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.858+0000 7f597fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.858+0000 7f5977e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.858+0000 7f597fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910c1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50334/0 (socket says 172.21.15.50:50334) 2024-09-10T10:15:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.858+0000 7f597fe00640 1 -- 172.21.15.50:0/2551452372 learned_addr learned my addr 172.21.15.50:0/2551452372 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:25.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.858+0000 7f5977e00640 1 --2- 172.21.15.50:0/2551452372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.859+0000 7f597fe00640 1 -- 172.21.15.50:0/2551452372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 msgr2=0x5574910b7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.859+0000 7f597fe00640 1 --2- 172.21.15.50:0/2551452372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910b7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.859+0000 7f597fe00640 1 -- 172.21.15.50:0/2551452372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 msgr2=0x5574910c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.859+0000 7f597fe00640 1 --2- 172.21.15.50:0/2551452372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.859+0000 7f597fe00640 1 -- 172.21.15.50:0/2551452372 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557490fe3ae0 con 0x5574910b7760 2024-09-10T10:15:25.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.859+0000 7f5977e00640 1 --2- 172.21.15.50:0/2551452372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:15:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.859+0000 7f597d600640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f59640a2c00 0x7f59640a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.859+0000 7f597fe00640 1 --2- 172.21.15.50:0/2551452372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910c1ae0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5970009900 tx=0x7f5970005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f3884bc52453271 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.859+0000 7f597d600640 1 -- 172.21.15.50:0/2193821575 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f59780cfab0 con 0x7f5980112890 2024-09-10T10:15:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.859+0000 7f5977e00640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f59640a2c00 0x7f59640a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.859+0000 7f5975600640 1 -- 172.21.15.50:0/2551452372 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970035040 con 0x5574910b7760 2024-09-10T10:15:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.859+0000 7f5975600640 1 -- 172.21.15.50:0/2551452372 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5970004400 con 0x5574910b7760 2024-09-10T10:15:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.859+0000 7f5975600640 1 -- 172.21.15.50:0/2551452372 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59700035f0 con 0x5574910b7760 2024-09-10T10:15:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.860+0000 7f5989a40740 1 -- 172.21.15.50:0/2551452372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 msgr2=0x5574910c1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:25.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.860+0000 7f5977e00640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f59640a2c00 0x7f59640a50c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5574910b4750 tx=0x7f59680096c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.860+0000 7f5989a40740 1 --2- 172.21.15.50:0/2551452372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910c1ae0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5970009900 tx=0x7f5970005de0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.860+0000 7f5989a40740 1 -- 172.21.15.50:0/2551452372 shutdown_connections 2024-09-10T10:15:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.860+0000 7f5989a40740 1 --2- 172.21.15.50:0/2551452372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.860+0000 7f5989a40740 1 --2- 172.21.15.50:0/2551452372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910c1ae0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.860+0000 7f5989a40740 1 --2- 172.21.15.50:0/2551452372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.860+0000 7f5989a40740 1 -- 172.21.15.50:0/2551452372 >> 172.21.15.50:0/2551452372 conn(0x5574910b33d0 msgr2=0x5574910b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.861+0000 7f5989a40740 1 -- 172.21.15.50:0/2551452372 shutdown_connections 2024-09-10T10:15:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.861+0000 7f5989a40740 1 -- 172.21.15.50:0/2551452372 wait complete. 2024-09-10T10:15:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.861+0000 7f5989a40740 1 -- start start 2024-09-10T10:15:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.861+0000 7f5989a40740 1 Processor -- start 2024-09-10T10:15:25.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f5989a40740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910bef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f5989a40740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f5989a40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f5989a40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5574910c4bf0 con 0x5574910c2020 2024-09-10T10:15:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f5989a40740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557490fd80f0 con 0x5574910b6e40 2024-09-10T10:15:25.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f5989a40740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5574910c4d70 con 0x5574910b7760 2024-09-10T10:15:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f5989a40740 10 client.0 _ll_register_callbacks cb 0x557490fbfbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f5977e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f5985000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f597fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910bef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f5977e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910bf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50342/0 (socket says 172.21.15.50:50342) 2024-09-10T10:15:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f5977e00640 1 -- 172.21.15.50:0/2885199716 learned_addr learned my addr 172.21.15.50:0/2885199716 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f597fe00640 1 -- 172.21.15.50:0/2885199716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 msgr2=0x5574910bf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f597fe00640 1 --2- 172.21.15.50:0/2885199716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910bf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f597fe00640 1 -- 172.21.15.50:0/2885199716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 msgr2=0x5574910bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:25.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f597fe00640 1 --2- 172.21.15.50:0/2885199716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.862+0000 7f597fe00640 1 -- 172.21.15.50:0/2885199716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557490d8e3c0 con 0x5574910b6e40 2024-09-10T10:15:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.863+0000 7f597fe00640 1 --2- 172.21.15.50:0/2885199716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910bef80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f597002a910 tx=0x7f597002a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=410f3e7a1b61c699 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.863+0000 7f596e000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:15:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.863+0000 7f596e000640 1 -- 172.21.15.50:0/2885199716 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970053060 con 0x5574910b6e40 2024-09-10T10:15:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.863+0000 7f596e000640 1 -- 172.21.15.50:0/2885199716 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f5970004200 con 0x5574910b6e40 2024-09-10T10:15:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.863+0000 7f5989a40740 1 -- 172.21.15.50:0/2885199716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5970004400 con 0x5574910b6e40 2024-09-10T10:15:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.863+0000 7f596e000640 1 -- 172.21.15.50:0/2885199716 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f597005a050 con 0x5574910b6e40 2024-09-10T10:15:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.863+0000 7f5989a40740 10 client.26189 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.863+0000 7f5989a40740 1 -- 172.21.15.50:0/2885199716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5574910d0cb0 con 0x5574910b6e40 2024-09-10T10:15:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.864+0000 7f596e000640 1 -- 172.21.15.50:0/2885199716 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5970004400 con 0x5574910b6e40 2024-09-10T10:15:25.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.864+0000 7f596e000640 1 -- 172.21.15.50:0/2885199716 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f5970003a30 con 0x5574910b6e40 2024-09-10T10:15:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.864+0000 7f5989a40740 10 client.26189 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.864+0000 7f5989a40740 10 client.26189 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:15:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.864+0000 7f5989a40740 20 client.26189 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.864+0000 7f5989a40740 1 --2- 172.21.15.50:0/2885199716 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5574910d2000 0x5574910d43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.864+0000 7f5989a40740 4 client.26189 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:15:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.864+0000 7f5989a40740 1 -- 172.21.15.50:0/2885199716 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55749102a950 con 0x5574910d2000 2024-09-10T10:15:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.864+0000 7f5977e00640 1 --2- 172.21.15.50:0/2885199716 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5574910d2000 0x5574910d43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.865+0000 7f5977e00640 1 --2- 172.21.15.50:0/2885199716 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5574910d2000 0x5574910d43f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5587daee3e4eb2c6 server_cookie=5dfd13e5ac57d97e in_seq=0 out_seq=0 2024-09-10T10:15:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.865+0000 7f596e000640 10 client.26189 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:15:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f596e000640 1 -- 172.21.15.50:0/2885199716 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55749102a950 con 0x5574910d2000 2024-09-10T10:15:25.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f596e000640 10 client.26189 handle_command_reply: tid=0 2024-09-10T10:15:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f5989a40740 1 client.26189 shutdown 2024-09-10T10:15:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f5989a40740 1 -- 172.21.15.50:0/2885199716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 msgr2=0x5574910bef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f5989a40740 1 --2- 172.21.15.50:0/2885199716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910bef80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f597002a910 tx=0x7f597002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f5989a40740 1 -- 172.21.15.50:0/2885199716 shutdown_connections 2024-09-10T10:15:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f5989a40740 1 --2- 172.21.15.50:0/2885199716 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x5574910d2000 0x5574910d43f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f5989a40740 1 --2- 172.21.15.50:0/2885199716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f5989a40740 1 --2- 172.21.15.50:0/2885199716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910bf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f5989a40740 1 --2- 172.21.15.50:0/2885199716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910bef80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f5989a40740 1 -- 172.21.15.50:0/2885199716 >> 172.21.15.50:0/2885199716 conn(0x5574910b33d0 msgr2=0x5574910b90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f596e000640 0 client.26189 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:15:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f5989a40740 1 -- 172.21.15.50:0/2885199716 shutdown_connections 2024-09-10T10:15:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f5989a40740 1 -- 172.21.15.50:0/2885199716 wait complete. 2024-09-10T10:15:25.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.866+0000 7f5989a40740 20 client.26189 trim_cache size 0 max 16384 2024-09-10T10:15:25.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.880+0000 7f5989a40740 1 Processor -- start 2024-09-10T10:15:25.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.880+0000 7f5989a40740 1 -- start start 2024-09-10T10:15:25.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.880+0000 7f5989a40740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910d9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.880+0000 7f5989a40740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910d9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.880+0000 7f5989a40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910b8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.880+0000 7f5989a40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f59801b79a0 con 0x5574910c2020 2024-09-10T10:15:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.880+0000 7f5989a40740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f59801b5270 con 0x5574910b6e40 2024-09-10T10:15:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.880+0000 7f5989a40740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f59801b30c0 con 0x5574910b7760 2024-09-10T10:15:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.881+0000 7f5985000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.881+0000 7f5985000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910b8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47016/0 (socket says 172.21.15.50:47016) 2024-09-10T10:15:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.881+0000 7f5985000640 1 -- 172.21.15.50:0/2328273106 learned_addr learned my addr 172.21.15.50:0/2328273106 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.881+0000 7f597fe00640 1 --2- 172.21.15.50:0/2328273106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910d9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.881+0000 7f5977e00640 1 --2- 172.21.15.50:0/2328273106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910d9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.881+0000 7f5985000640 1 -- 172.21.15.50:0/2328273106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 msgr2=0x5574910d9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.881+0000 7f5985000640 1 --2- 172.21.15.50:0/2328273106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910d9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.881+0000 7f5985000640 1 -- 172.21.15.50:0/2328273106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 msgr2=0x5574910d9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.881+0000 7f5985000640 1 --2- 172.21.15.50:0/2328273106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910d9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.881+0000 7f5985000640 1 -- 172.21.15.50:0/2328273106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574910b4560 con 0x5574910c2020 2024-09-10T10:15:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.882+0000 7f5985000640 1 --2- 172.21.15.50:0/2328273106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910b8890 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f59780cd1c0 tx=0x7f59780982c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbc2e6224239931 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.882+0000 7f5974c00640 1 -- 172.21.15.50:0/2328273106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59780b7030 con 0x5574910c2020 2024-09-10T10:15:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.882+0000 7f5974c00640 1 -- 172.21.15.50:0/2328273106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f597809bf20 con 0x5574910c2020 2024-09-10T10:15:25.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.882+0000 7f5974c00640 1 -- 172.21.15.50:0/2328273106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59780b4070 con 0x5574910c2020 2024-09-10T10:15:25.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.882+0000 7f5989a40740 1 -- 172.21.15.50:0/2328273106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 msgr2=0x5574910b8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:25.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.882+0000 7f5989a40740 1 --2- 172.21.15.50:0/2328273106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910b8890 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f59780cd1c0 tx=0x7f59780982c0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.882+0000 7f5989a40740 1 -- 172.21.15.50:0/2328273106 shutdown_connections 2024-09-10T10:15:25.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.882+0000 7f5989a40740 1 --2- 172.21.15.50:0/2328273106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910c2020 0x5574910b8890 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.882+0000 7f5989a40740 1 --2- 172.21.15.50:0/2328273106 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910b7760 0x5574910d9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.882+0000 7f5989a40740 1 --2- 172.21.15.50:0/2328273106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910d9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.882+0000 7f5989a40740 1 -- 172.21.15.50:0/2328273106 >> 172.21.15.50:0/2328273106 conn(0x5574910b33d0 msgr2=0x5574910b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.883+0000 7f5989a40740 1 -- 172.21.15.50:0/2328273106 shutdown_connections 2024-09-10T10:15:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.883+0000 7f5989a40740 1 -- 172.21.15.50:0/2328273106 wait complete. 2024-09-10T10:15:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.883+0000 7f5989a40740 1 -- start start 2024-09-10T10:15:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.883+0000 7f5989a40740 1 Processor -- start 2024-09-10T10:15:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5989a40740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910ca810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5989a40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910b7760 0x5574910bbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5989a40740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910c2020 0x5574910bc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5989a40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f59801b3730 con 0x5574910b7760 2024-09-10T10:15:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5989a40740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f59801b4ba0 con 0x5574910b6e40 2024-09-10T10:15:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5989a40740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f59801b3e00 con 0x5574910c2020 2024-09-10T10:15:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5989a40740 10 client.0 _ll_register_callbacks cb 0x7f5968009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:25.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5977e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910b7760 0x5574910bbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5985000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910c2020 0x5574910bc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f597fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5985000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910c2020 0x5574910bc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50368/0 (socket says 172.21.15.50:50368) 2024-09-10T10:15:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5985000640 1 -- 172.21.15.50:0/4070125710 learned_addr learned my addr 172.21.15.50:0/4070125710 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5977e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910b7760 0x5574910bbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47018/0 (socket says 172.21.15.50:47018) 2024-09-10T10:15:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5985000640 1 -- 172.21.15.50:0/4070125710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 msgr2=0x5574910ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5985000640 1 --2- 172.21.15.50:0/4070125710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5985000640 1 -- 172.21.15.50:0/4070125710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910b7760 msgr2=0x5574910bbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5985000640 1 --2- 172.21.15.50:0/4070125710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910b7760 0x5574910bbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5985000640 1 -- 172.21.15.50:0/4070125710 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574910bcbf0 con 0x5574910c2020 2024-09-10T10:15:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f597fe00640 1 --2- 172.21.15.50:0/4070125710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.884+0000 7f5977e00640 1 --2- 172.21.15.50:0/4070125710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910b7760 0x5574910bbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:25.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.885+0000 7f5985000640 1 --2- 172.21.15.50:0/4070125710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910c2020 0x5574910bc3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f59780059b0 tx=0x7f59780a4c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=786c26c5a71c4b01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.885+0000 7f596e000640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.885+0000 7f596e000640 1 -- 172.21.15.50:0/4070125710 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597807e020 con 0x5574910c2020 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.885+0000 7f5989a40740 1 -- 172.21.15.50:0/4070125710 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f597809bf20 con 0x5574910c2020 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.885+0000 7f596e000640 1 -- 172.21.15.50:0/4070125710 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f59780a4910 con 0x5574910c2020 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.885+0000 7f596e000640 1 -- 172.21.15.50:0/4070125710 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f59780b7030 con 0x5574910c2020 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.885+0000 7f5989a40740 10 client.26206 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.885+0000 7f5989a40740 1 -- 172.21.15.50:0/4070125710 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55749113ca60 con 0x5574910c2020 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.885+0000 7f596e000640 1 -- 172.21.15.50:0/4070125710 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f597809bf20 con 0x5574910c2020 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.886+0000 7f596e000640 1 -- 172.21.15.50:0/4070125710 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f597809f030 con 0x5574910c2020 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.886+0000 7f5989a40740 10 client.26206 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.886+0000 7f5989a40740 10 client.26206 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.886+0000 7f5989a40740 20 client.26206 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.886+0000 7f5989a40740 1 --2- 172.21.15.50:0/4070125710 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55749113d0d0 0x55749113f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:25.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.886+0000 7f5989a40740 4 client.26206 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:15:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.886+0000 7f5989a40740 1 -- 172.21.15.50:0/4070125710 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557491024e60 con 0x55749113d0d0 2024-09-10T10:15:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.886+0000 7f597fe00640 1 --2- 172.21.15.50:0/4070125710 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55749113d0d0 0x55749113f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.886+0000 7f597fe00640 1 --2- 172.21.15.50:0/4070125710 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55749113d0d0 0x55749113f4c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=305cb58d6bb55d5 server_cookie=36c26d52d225ce76 in_seq=0 out_seq=0 2024-09-10T10:15:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.886+0000 7f596e000640 10 client.26206 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:15:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f596e000640 1 -- 172.21.15.50:0/4070125710 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557491024e60 con 0x55749113d0d0 2024-09-10T10:15:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f596e000640 10 client.26206 handle_command_reply: tid=0 2024-09-10T10:15:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f5989a40740 1 client.26206 shutdown 2024-09-10T10:15:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f5989a40740 1 -- 172.21.15.50:0/4070125710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910c2020 msgr2=0x5574910bc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f5989a40740 1 --2- 172.21.15.50:0/4070125710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910c2020 0x5574910bc3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f59780059b0 tx=0x7f59780a4c10 comp rx=0 tx=0).stop 2024-09-10T10:15:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f5989a40740 1 -- 172.21.15.50:0/4070125710 shutdown_connections 2024-09-10T10:15:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f5989a40740 1 --2- 172.21.15.50:0/4070125710 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5574910c2020 0x5574910bc3c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f5989a40740 1 --2- 172.21.15.50:0/4070125710 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55749113d0d0 0x55749113f4c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f5989a40740 1 --2- 172.21.15.50:0/4070125710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574910b7760 0x5574910bbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f5989a40740 1 --2- 172.21.15.50:0/4070125710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5574910b6e40 0x5574910ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f596e000640 0 client.26206 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:15:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f5989a40740 1 -- 172.21.15.50:0/4070125710 >> 172.21.15.50:0/4070125710 conn(0x5574910b33d0 msgr2=0x5574910b8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f5989a40740 1 -- 172.21.15.50:0/4070125710 shutdown_connections 2024-09-10T10:15:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f5989a40740 1 -- 172.21.15.50:0/4070125710 wait complete. 2024-09-10T10:15:25.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.887+0000 7f5989a40740 20 client.26206 trim_cache size 0 max 16384 2024-09-10T10:15:25.897 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:15:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.888+0000 7f5985a00640 1 -- 172.21.15.50:0/2193821575 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f59640a2c00 msgr2=0x7f59640a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.888+0000 7f5985a00640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f59640a2c00 0x7f59640a50c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5574910b4750 tx=0x7f59680096c0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.888+0000 7f5985a00640 1 -- 172.21.15.50:0/2193821575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5980112890 msgr2=0x7f598019e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.888+0000 7f5985a00640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5980112890 0x7f598019e840 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f597800eb10 tx=0x7f597800c2d0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.888+0000 7f5985a00640 1 -- 172.21.15.50:0/2193821575 shutdown_connections 2024-09-10T10:15:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.888+0000 7f5985a00640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f59640a2c00 0x7f59640a50c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.888+0000 7f5985a00640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5980112890 0x7f598019e840 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.888+0000 7f5985a00640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5980077040 0x7f59801a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.888+0000 7f5985a00640 1 --2- 172.21.15.50:0/2193821575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5980076720 0x7f59801a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.888+0000 7f5985a00640 1 -- 172.21.15.50:0/2193821575 >> 172.21.15.50:0/2193821575 conn(0x7f59800ff8b0 msgr2=0x7f5980101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:25.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.888+0000 7f5985a00640 1 -- 172.21.15.50:0/2193821575 shutdown_connections 2024-09-10T10:15:25.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:25.888+0000 7f5985a00640 1 -- 172.21.15.50:0/2193821575 wait complete. 2024-09-10T10:15:26.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:26 smithi189 ceph-mon[34999]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 271 MiB/s wr, 73 op/s 2024-09-10T10:15:26.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:26 smithi084 ceph-mon[34812]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 271 MiB/s wr, 73 op/s 2024-09-10T10:15:26.644 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:26 smithi050 ceph-mon[30354]: pgmap v518: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 271 MiB/s wr, 73 op/s 2024-09-10T10:15:26.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T10:15:27.231 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:27.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.898+0000 7f5bd5e00640 1 -- 172.21.15.50:0/1252539617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bd010e420 msgr2=0x7f5bd0110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:27.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.898+0000 7f5bd5e00640 1 --2- 172.21.15.50:0/1252539617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bd010e420 0x7f5bd0110810 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8009ca0 tx=0x7f5bc802a950 comp rx=0 tx=0).stop 2024-09-10T10:15:27.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.899+0000 7f5bd5e00640 1 -- 172.21.15.50:0/1252539617 shutdown_connections 2024-09-10T10:15:27.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.899+0000 7f5bd5e00640 1 --2- 172.21.15.50:0/1252539617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bd010e420 0x7f5bd0110810 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.899+0000 7f5bd5e00640 1 --2- 172.21.15.50:0/1252539617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd0074ee0 0x7f5bd010dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.899+0000 7f5bd5e00640 1 --2- 172.21.15.50:0/1252539617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5bd00745c0 0x7f5bd00749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.899+0000 7f5bd5e00640 1 -- 172.21.15.50:0/1252539617 >> 172.21.15.50:0/1252539617 conn(0x7f5bd00fd8e0 msgr2=0x7f5bd00ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:27.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.900+0000 7f5bd5e00640 1 -- 172.21.15.50:0/1252539617 shutdown_connections 2024-09-10T10:15:27.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.900+0000 7f5bd5e00640 1 -- 172.21.15.50:0/1252539617 wait complete. 2024-09-10T10:15:27.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.902+0000 7f5bd5e00640 1 Processor -- start 2024-09-10T10:15:27.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.902+0000 7f5bd5e00640 1 -- start start 2024-09-10T10:15:27.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.902+0000 7f5bd5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd00745c0 0x7f5bd019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.902+0000 7f5bd5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bd0074ee0 0x7f5bd019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.902+0000 7f5bd5e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5bd010e420 0x7f5bd019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.902+0000 7f5bd5e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd0114150 con 0x7f5bd0074ee0 2024-09-10T10:15:27.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.902+0000 7f5bd5e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd0113fd0 con 0x7f5bd00745c0 2024-09-10T10:15:27.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.902+0000 7f5bd5e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd01142d0 con 0x7f5bd010e420 2024-09-10T10:15:27.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.903+0000 7f5bcea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd00745c0 0x7f5bd019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.903+0000 7f5bcea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd00745c0 0x7f5bd019a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:39200/0 (socket says 172.21.15.50:39200) 2024-09-10T10:15:27.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.903+0000 7f5bcea00640 1 -- 172.21.15.50:0/2763497948 learned_addr learned my addr 172.21.15.50:0/2763497948 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:27.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.903+0000 7f5bce000640 1 --2- 172.21.15.50:0/2763497948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bd0074ee0 0x7f5bd019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.903+0000 7f5bcea00640 1 -- 172.21.15.50:0/2763497948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5bd010e420 msgr2=0x7f5bd019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.903+0000 7f5bcea00640 1 --2- 172.21.15.50:0/2763497948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5bd010e420 0x7f5bd019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.904+0000 7f5bcea00640 1 -- 172.21.15.50:0/2763497948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bd0074ee0 msgr2=0x7f5bd019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.904+0000 7f5bcea00640 1 --2- 172.21.15.50:0/2763497948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bd0074ee0 0x7f5bd019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.904+0000 7f5bcea00640 1 -- 172.21.15.50:0/2763497948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd019f5e0 con 0x7f5bd00745c0 2024-09-10T10:15:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.904+0000 7f5bcea00640 1 --2- 172.21.15.50:0/2763497948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd00745c0 0x7f5bd019a630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000e9f0 tx=0x7f5bc000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.904+0000 7f5bd4a00640 1 -- 172.21.15.50:0/2763497948 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc000cd80 con 0x7f5bd00745c0 2024-09-10T10:15:27.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.904+0000 7f5bd4a00640 1 -- 172.21.15.50:0/2763497948 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bc0010910 con 0x7f5bd00745c0 2024-09-10T10:15:27.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.904+0000 7f5bd4a00640 1 -- 172.21.15.50:0/2763497948 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0018990 con 0x7f5bd00745c0 2024-09-10T10:15:27.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.904+0000 7f5bd5e00640 1 -- 172.21.15.50:0/2763497948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd019f8d0 con 0x7f5bd00745c0 2024-09-10T10:15:27.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.905+0000 7f5bd5e00640 1 -- 172.21.15.50:0/2763497948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd01a71b0 con 0x7f5bd00745c0 2024-09-10T10:15:27.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.908+0000 7f5bd4a00640 1 -- 172.21.15.50:0/2763497948 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5bc0010ac0 con 0x7f5bd00745c0 2024-09-10T10:15:27.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.909+0000 7f5bd4a00640 1 --2- 172.21.15.50:0/2763497948 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5bb40a2c00 0x7f5bb40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.910+0000 7f5bd4a00640 1 -- 172.21.15.50:0/2763497948 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f5bc00cf6f0 con 0x7f5bd00745c0 2024-09-10T10:15:27.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.910+0000 7f5bce000640 1 --2- 172.21.15.50:0/2763497948 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5bb40a2c00 0x7f5bb40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.911+0000 7f5bd8828740 1 Processor -- start 2024-09-10T10:15:27.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.911+0000 7f5bce000640 1 --2- 172.21.15.50:0/2763497948 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5bb40a2c00 0x7f5bb40a50c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5bd010f820 tx=0x7f5bbc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:27.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.911+0000 7f5bd8828740 1 -- start start 2024-09-10T10:15:27.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.912+0000 7f5bd8828740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50cfb90 0x55b8d50cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.912+0000 7f5bd8828740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50d04b0 0x55b8d50e3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.912+0000 7f5bd8828740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.912+0000 7f5bd8828740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b8d50363e0 con 0x55b8d50cfb90 2024-09-10T10:15:27.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.912+0000 7f5bd8828740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b8d4fddd80 con 0x55b8d50d04b0 2024-09-10T10:15:27.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.912+0000 7f5bd8828740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b8d50323a0 con 0x55b8d50e3660 2024-09-10T10:15:27.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.912+0000 7f5bcea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50cfb90 0x55b8d50cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.912+0000 7f5bcea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50cfb90 0x55b8d50cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48332/0 (socket says 172.21.15.50:48332) 2024-09-10T10:15:27.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.912+0000 7f5bcea00640 1 -- 172.21.15.50:0/1368061120 learned_addr learned my addr 172.21.15.50:0/1368061120 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:27.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.912+0000 7f5bcf400640 1 --2- 172.21.15.50:0/1368061120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.913+0000 7f5bcea00640 1 -- 172.21.15.50:0/1368061120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 msgr2=0x55b8d50e5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:27.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.913+0000 7f5bcea00640 1 --2- 172.21.15.50:0/1368061120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50e5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.913+0000 7f5bcea00640 1 -- 172.21.15.50:0/1368061120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50d04b0 msgr2=0x55b8d50e3120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:15:27.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.913+0000 7f5bcea00640 1 --2- 172.21.15.50:0/1368061120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50d04b0 0x55b8d50e3120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.913+0000 7f5bcea00640 1 -- 172.21.15.50:0/1368061120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8d4ffcae0 con 0x55b8d50cfb90 2024-09-10T10:15:27.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.913+0000 7f5bcf400640 1 --2- 172.21.15.50:0/1368061120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50e5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:27.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.913+0000 7f5bcea00640 1 --2- 172.21.15.50:0/1368061120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50cfb90 0x55b8d50cff70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5bc009bb50 tx=0x7f5bc009b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856c3e35f521f203 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:27.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.914+0000 7f5bbbe00640 1 -- 172.21.15.50:0/1368061120 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc00a4830 con 0x55b8d50cfb90 2024-09-10T10:15:27.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.914+0000 7f5bbbe00640 1 -- 172.21.15.50:0/1368061120 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bc0099ec0 con 0x55b8d50cfb90 2024-09-10T10:15:27.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.914+0000 7f5bbbe00640 1 -- 172.21.15.50:0/1368061120 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc009b010 con 0x55b8d50cfb90 2024-09-10T10:15:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.915+0000 7f5bd8828740 1 -- 172.21.15.50:0/1368061120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50cfb90 msgr2=0x55b8d50cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.915+0000 7f5bd8828740 1 --2- 172.21.15.50:0/1368061120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50cfb90 0x55b8d50cff70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5bc009bb50 tx=0x7f5bc009b640 comp rx=0 tx=0).stop 2024-09-10T10:15:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.915+0000 7f5bd8828740 1 -- 172.21.15.50:0/1368061120 shutdown_connections 2024-09-10T10:15:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.915+0000 7f5bd8828740 1 --2- 172.21.15.50:0/1368061120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50e5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.915+0000 7f5bd8828740 1 --2- 172.21.15.50:0/1368061120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50d04b0 0x55b8d50e3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.915+0000 7f5bd8828740 1 --2- 172.21.15.50:0/1368061120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50cfb90 0x55b8d50cff70 secure :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5bc009bb50 tx=0x7f5bc009b640 comp rx=0 tx=0).stop 2024-09-10T10:15:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.916+0000 7f5bd8828740 1 -- 172.21.15.50:0/1368061120 >> 172.21.15.50:0/1368061120 conn(0x55b8d50cc200 msgr2=0x55b8d50cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.916+0000 7f5bd8828740 1 -- 172.21.15.50:0/1368061120 shutdown_connections 2024-09-10T10:15:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.916+0000 7f5bd8828740 1 -- 172.21.15.50:0/1368061120 wait complete. 2024-09-10T10:15:27.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.916+0000 7f5bd8828740 1 -- start start 2024-09-10T10:15:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.917+0000 7f5bd8828740 1 Processor -- start 2024-09-10T10:15:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.917+0000 7f5bd8828740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50d04b0 0x55b8d50e2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.917+0000 7f5bd8828740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50e2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.918+0000 7f5bd8828740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50dac60 0x55b8d50db0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.918+0000 7f5bd8828740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b8d50d2a90 con 0x55b8d50dac60 2024-09-10T10:15:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.918+0000 7f5bd8828740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b8d4ff10f0 con 0x55b8d50d04b0 2024-09-10T10:15:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.918+0000 7f5bd8828740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b8d50d2c10 con 0x55b8d50e3660 2024-09-10T10:15:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.918+0000 7f5bd8828740 10 client.0 _ll_register_callbacks cb 0x55b8d4fd8bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.918+0000 7f5bce000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50e2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.918+0000 7f5bce000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50e2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:34814/0 (socket says 172.21.15.50:34814) 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.918+0000 7f5bce000640 1 -- 172.21.15.50:0/3826007356 learned_addr learned my addr 172.21.15.50:0/3826007356 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.918+0000 7f5bcea00640 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50d04b0 0x55b8d50e2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.918+0000 7f5bcf400640 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50dac60 0x55b8d50db0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.919+0000 7f5bcea00640 1 -- 172.21.15.50:0/3826007356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 msgr2=0x55b8d50e2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.919+0000 7f5bcea00640 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50e2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.919+0000 7f5bcea00640 1 -- 172.21.15.50:0/3826007356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50dac60 msgr2=0x55b8d50db0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.919+0000 7f5bcea00640 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50dac60 0x55b8d50db0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.919+0000 7f5bcea00640 1 -- 172.21.15.50:0/3826007356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8d4da73c0 con 0x55b8d50d04b0 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.919+0000 7f5bcea00640 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50d04b0 0x55b8d50e2a90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55b8d50cd060 tx=0x7f5bc0009760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=461d66a65007ec80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.919+0000 7f5bb8c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.920+0000 7f5bb8c00640 1 -- 172.21.15.50:0/3826007356 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc00a8020 con 0x55b8d50d04b0 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.920+0000 7f5bb8c00640 1 -- 172.21.15.50:0/3826007356 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f5bc0098230 con 0x55b8d50d04b0 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.920+0000 7f5bcf400640 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50dac60 0x55b8d50db0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:15:27.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.920+0000 7f5bd8828740 1 -- 172.21.15.50:0/3826007356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bc0099ec0 con 0x55b8d50d04b0 2024-09-10T10:15:27.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.921+0000 7f5bb8c00640 1 -- 172.21.15.50:0/3826007356 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5bc00ba070 con 0x55b8d50d04b0 2024-09-10T10:15:27.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.922+0000 7f5bd8828740 10 client.26204 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.922+0000 7f5bd8828740 1 -- 172.21.15.50:0/3826007356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b8d50d2a90 con 0x55b8d50d04b0 2024-09-10T10:15:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.922+0000 7f5bb8c00640 1 -- 172.21.15.50:0/3826007356 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bc0099ec0 con 0x55b8d50d04b0 2024-09-10T10:15:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.922+0000 7f5bb8c00640 1 -- 172.21.15.50:0/3826007356 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f5bc009ab10 con 0x55b8d50d04b0 2024-09-10T10:15:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.922+0000 7f5bd8828740 10 client.26204 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.922+0000 7f5bd8828740 10 client.26204 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:15:27.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.922+0000 7f5bd8828740 20 client.26204 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.923+0000 7f5bd8828740 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b8d50eb2d0 0x55b8d50ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.924+0000 7f5bd8828740 4 client.26204 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:15:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.924+0000 7f5bd8828740 1 -- 172.21.15.50:0/3826007356 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8d5043950 con 0x55b8d50eb2d0 2024-09-10T10:15:27.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.924+0000 7f5bce000640 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b8d50eb2d0 0x55b8d50ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.925+0000 7f5bce000640 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b8d50eb2d0 0x55b8d50ed6c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=baf99146c17e2081 server_cookie=9233175fe7bd4342 in_seq=0 out_seq=0 2024-09-10T10:15:27.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.925+0000 7f5bb8c00640 10 client.26204 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:15:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.926+0000 7f5bb8c00640 1 -- 172.21.15.50:0/3826007356 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8d5043950 con 0x55b8d50eb2d0 2024-09-10T10:15:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.926+0000 7f5bb8c00640 10 client.26204 handle_command_reply: tid=0 2024-09-10T10:15:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.926+0000 7f5bd8828740 1 client.26204 shutdown 2024-09-10T10:15:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.927+0000 7f5bd8828740 1 -- 172.21.15.50:0/3826007356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50d04b0 msgr2=0x55b8d50e2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.927+0000 7f5bd8828740 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50d04b0 0x55b8d50e2a90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55b8d50cd060 tx=0x7f5bc0009760 comp rx=0 tx=0).stop 2024-09-10T10:15:27.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.927+0000 7f5bd8828740 1 -- 172.21.15.50:0/3826007356 shutdown_connections 2024-09-10T10:15:27.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.927+0000 7f5bd8828740 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b8d50eb2d0 0x55b8d50ed6c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.927+0000 7f5bd8828740 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50dac60 0x55b8d50db0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.927+0000 7f5bd8828740 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50e2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.927+0000 7f5bd8828740 1 --2- 172.21.15.50:0/3826007356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50d04b0 0x55b8d50e2a90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.927+0000 7f5bd8828740 1 -- 172.21.15.50:0/3826007356 >> 172.21.15.50:0/3826007356 conn(0x55b8d50cc200 msgr2=0x55b8d50d1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.927+0000 7f5bb8c00640 0 client.26204 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:15:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.928+0000 7f5bd8828740 1 -- 172.21.15.50:0/3826007356 shutdown_connections 2024-09-10T10:15:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.928+0000 7f5bd8828740 1 -- 172.21.15.50:0/3826007356 wait complete. 2024-09-10T10:15:27.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.928+0000 7f5bd8828740 20 client.26204 trim_cache size 0 max 16384 2024-09-10T10:15:27.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.949+0000 7f5bd8828740 1 Processor -- start 2024-09-10T10:15:27.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.950+0000 7f5bd8828740 1 -- start start 2024-09-10T10:15:27.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.950+0000 7f5bd8828740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50d04b0 0x55b8d50d9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.950+0000 7f5bd8828740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50dac60 0x55b8d50f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.950+0000 7f5bd8828740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50e3660 0x55b8d50f3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.950+0000 7f5bd8828740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd01c0580 con 0x55b8d50d04b0 2024-09-10T10:15:27.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.950+0000 7f5bd8828740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd01bde50 con 0x55b8d50e3660 2024-09-10T10:15:27.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.950+0000 7f5bd8828740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd01bbca0 con 0x55b8d50dac60 2024-09-10T10:15:27.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.951+0000 7f5bcea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50d04b0 0x55b8d50d9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.951+0000 7f5bcf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50e3660 0x55b8d50f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.951+0000 7f5bcea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50d04b0 0x55b8d50d9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48350/0 (socket says 172.21.15.50:48350) 2024-09-10T10:15:27.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.951+0000 7f5bcf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50e3660 0x55b8d50f3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:39224/0 (socket says 172.21.15.50:39224) 2024-09-10T10:15:27.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.951+0000 7f5bcea00640 1 -- 172.21.15.50:0/1324712576 learned_addr learned my addr 172.21.15.50:0/1324712576 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:27.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.951+0000 7f5bce000640 1 --2- 172.21.15.50:0/1324712576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50dac60 0x55b8d50f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.951+0000 7f5bcea00640 1 -- 172.21.15.50:0/1324712576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50dac60 msgr2=0x55b8d50f2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:27.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.951+0000 7f5bcea00640 1 --2- 172.21.15.50:0/1324712576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50dac60 0x55b8d50f2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.951+0000 7f5bcea00640 1 -- 172.21.15.50:0/1324712576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50e3660 msgr2=0x55b8d50f3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:27.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.951+0000 7f5bcea00640 1 --2- 172.21.15.50:0/1324712576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50e3660 0x55b8d50f3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.951+0000 7f5bcea00640 1 -- 172.21.15.50:0/1324712576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8d50c7770 con 0x55b8d50d04b0 2024-09-10T10:15:27.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.951+0000 7f5bcf400640 1 --2- 172.21.15.50:0/1324712576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50e3660 0x55b8d50f3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:27.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.952+0000 7f5bcea00640 1 --2- 172.21.15.50:0/1324712576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50d04b0 0x55b8d50d9b10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00cd1d0 tx=0x7f5bc0018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ad72ec39f2a837 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:27.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.952+0000 7f5bbb400640 1 -- 172.21.15.50:0/1324712576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc00a8030 con 0x55b8d50d04b0 2024-09-10T10:15:27.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.953+0000 7f5bbb400640 1 -- 172.21.15.50:0/1324712576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bc0018b30 con 0x55b8d50d04b0 2024-09-10T10:15:27.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.953+0000 7f5bbb400640 1 -- 172.21.15.50:0/1324712576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc009aa80 con 0x55b8d50d04b0 2024-09-10T10:15:27.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.954+0000 7f5bd8828740 1 -- 172.21.15.50:0/1324712576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50d04b0 msgr2=0x55b8d50d9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:27.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.954+0000 7f5bd8828740 1 --2- 172.21.15.50:0/1324712576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50d04b0 0x55b8d50d9b10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00cd1d0 tx=0x7f5bc0018420 comp rx=0 tx=0).stop 2024-09-10T10:15:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.955+0000 7f5bd8828740 1 -- 172.21.15.50:0/1324712576 shutdown_connections 2024-09-10T10:15:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.955+0000 7f5bd8828740 1 --2- 172.21.15.50:0/1324712576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50e3660 0x55b8d50f3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.956 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.955+0000 7f5bd8828740 1 --2- 172.21.15.50:0/1324712576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50dac60 0x55b8d50f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.955+0000 7f5bd8828740 1 --2- 172.21.15.50:0/1324712576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50d04b0 0x55b8d50d9b10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.955+0000 7f5bd8828740 1 -- 172.21.15.50:0/1324712576 >> 172.21.15.50:0/1324712576 conn(0x55b8d50cc200 msgr2=0x55b8d50d9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:27.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.955+0000 7f5bd8828740 1 -- 172.21.15.50:0/1324712576 shutdown_connections 2024-09-10T10:15:27.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.955+0000 7f5bd8828740 1 -- 172.21.15.50:0/1324712576 wait complete. 2024-09-10T10:15:27.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.956+0000 7f5bd8828740 1 -- start start 2024-09-10T10:15:27.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.956+0000 7f5bd8828740 1 Processor -- start 2024-09-10T10:15:27.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.957+0000 7f5bd8828740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50d04b0 0x55b8d50fca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.957+0000 7f5bd8828740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50dac60 0x55b8d50fcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.957+0000 7f5bd8828740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50fd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.959 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.957+0000 7f5bd8828740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd01bc310 con 0x55b8d50d04b0 2024-09-10T10:15:27.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.957+0000 7f5bd8828740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd01bd780 con 0x55b8d50dac60 2024-09-10T10:15:27.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.957+0000 7f5bd8828740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd01bc9e0 con 0x55b8d50e3660 2024-09-10T10:15:27.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.957+0000 7f5bd8828740 10 client.0 _ll_register_callbacks cb 0x7f5bbc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:27.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.958+0000 7f5bcea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50d04b0 0x55b8d50fca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.958+0000 7f5bce000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50dac60 0x55b8d50fcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.958+0000 7f5bce000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50dac60 0x55b8d50fcf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:39232/0 (socket says 172.21.15.50:39232) 2024-09-10T10:15:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.958+0000 7f5bce000640 1 -- 172.21.15.50:0/2728722664 learned_addr learned my addr 172.21.15.50:0/2728722664 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.959+0000 7f5bcf400640 1 --2- 172.21.15.50:0/2728722664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50fd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.959+0000 7f5bce000640 1 -- 172.21.15.50:0/2728722664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 msgr2=0x55b8d50fd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.959+0000 7f5bce000640 1 --2- 172.21.15.50:0/2728722664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50fd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.959+0000 7f5bce000640 1 -- 172.21.15.50:0/2728722664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50d04b0 msgr2=0x55b8d50fca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.959+0000 7f5bce000640 1 --2- 172.21.15.50:0/2728722664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50d04b0 0x55b8d50fca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.959+0000 7f5bce000640 1 -- 172.21.15.50:0/2728722664 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8d50e3340 con 0x55b8d50dac60 2024-09-10T10:15:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.959+0000 7f5bce000640 1 --2- 172.21.15.50:0/2728722664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50dac60 0x55b8d50fcf40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc011810 tx=0x7f5bbc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72bf0a1c6d673faf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.960+0000 7f5bb8c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:15:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.960+0000 7f5bb8c00640 1 -- 172.21.15.50:0/2728722664 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc02d060 con 0x55b8d50dac60 2024-09-10T10:15:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.960+0000 7f5bb8c00640 1 -- 172.21.15.50:0/2728722664 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f5bbc0272d0 con 0x55b8d50dac60 2024-09-10T10:15:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.960+0000 7f5bd8828740 1 -- 172.21.15.50:0/2728722664 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bc0018b30 con 0x55b8d50dac60 2024-09-10T10:15:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.960+0000 7f5bb8c00640 1 -- 172.21.15.50:0/2728722664 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5bbc034050 con 0x55b8d50dac60 2024-09-10T10:15:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.960+0000 7f5bd8828740 10 client.26210 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.960+0000 7f5bd8828740 1 -- 172.21.15.50:0/2728722664 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b8d5155f20 con 0x55b8d50dac60 2024-09-10T10:15:27.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.961+0000 7f5bb8c00640 1 -- 172.21.15.50:0/2728722664 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bc0018b30 con 0x55b8d50dac60 2024-09-10T10:15:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.961+0000 7f5bb8c00640 1 -- 172.21.15.50:0/2728722664 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f5bbc00e710 con 0x55b8d50dac60 2024-09-10T10:15:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.961+0000 7f5bd8828740 10 client.26210 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.961+0000 7f5bd8828740 10 client.26210 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:15:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.961+0000 7f5bd8828740 20 client.26210 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.961+0000 7f5bd8828740 1 --2- 172.21.15.50:0/2728722664 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b8d5156630 0x55b8d5158a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.961+0000 7f5bd8828740 4 client.26210 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:15:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.961+0000 7f5bd8828740 1 -- 172.21.15.50:0/2728722664 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b8d503de60 con 0x55b8d5156630 2024-09-10T10:15:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.961+0000 7f5bcea00640 1 --2- 172.21.15.50:0/2728722664 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b8d5156630 0x55b8d5158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.962+0000 7f5bcea00640 1 --2- 172.21.15.50:0/2728722664 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b8d5156630 0x55b8d5158a50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=50a3aca310a8a96e server_cookie=779e4957934abcbc in_seq=0 out_seq=0 2024-09-10T10:15:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.962+0000 7f5bb8c00640 10 client.26210 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:15:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.962+0000 7f5bb8c00640 1 -- 172.21.15.50:0/2728722664 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b8d503de60 con 0x55b8d5156630 2024-09-10T10:15:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.963+0000 7f5bb8c00640 10 client.26210 handle_command_reply: tid=0 2024-09-10T10:15:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.963+0000 7f5bd8828740 1 client.26210 shutdown 2024-09-10T10:15:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.964+0000 7f5bd8828740 1 -- 172.21.15.50:0/2728722664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50dac60 msgr2=0x55b8d50fcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.964+0000 7f5bd8828740 1 --2- 172.21.15.50:0/2728722664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50dac60 0x55b8d50fcf40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc011810 tx=0x7f5bbc004730 comp rx=0 tx=0).stop 2024-09-10T10:15:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.964+0000 7f5bd8828740 1 -- 172.21.15.50:0/2728722664 shutdown_connections 2024-09-10T10:15:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.964+0000 7f5bd8828740 1 --2- 172.21.15.50:0/2728722664 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x55b8d5156630 0x55b8d5158a50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.964+0000 7f5bd8828740 1 --2- 172.21.15.50:0/2728722664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8d50e3660 0x55b8d50fd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.964+0000 7f5bd8828740 1 --2- 172.21.15.50:0/2728722664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8d50dac60 0x55b8d50fcf40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.964+0000 7f5bd8828740 1 --2- 172.21.15.50:0/2728722664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b8d50d04b0 0x55b8d50fca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.964+0000 7f5bd8828740 1 -- 172.21.15.50:0/2728722664 >> 172.21.15.50:0/2728722664 conn(0x55b8d50cc200 msgr2=0x55b8d50cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.964+0000 7f5bb8c00640 0 client.26210 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:15:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.964+0000 7f5bd8828740 1 -- 172.21.15.50:0/2728722664 shutdown_connections 2024-09-10T10:15:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.964+0000 7f5bd8828740 1 -- 172.21.15.50:0/2728722664 wait complete. 2024-09-10T10:15:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.965+0000 7f5bd8828740 20 client.26210 trim_cache size 0 max 16384 2024-09-10T10:15:27.968 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:15:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.965+0000 7f5bd5e00640 1 -- 172.21.15.50:0/2763497948 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5bb40a2c00 msgr2=0x7f5bb40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.965+0000 7f5bd5e00640 1 --2- 172.21.15.50:0/2763497948 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5bb40a2c00 0x7f5bb40a50c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5bd010f820 tx=0x7f5bbc005f90 comp rx=0 tx=0).stop 2024-09-10T10:15:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.965+0000 7f5bd5e00640 1 -- 172.21.15.50:0/2763497948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd00745c0 msgr2=0x7f5bd019a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.965+0000 7f5bd5e00640 1 --2- 172.21.15.50:0/2763497948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd00745c0 0x7f5bd019a630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000e9f0 tx=0x7f5bc000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.967+0000 7f5bd5e00640 1 -- 172.21.15.50:0/2763497948 shutdown_connections 2024-09-10T10:15:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.967+0000 7f5bd5e00640 1 --2- 172.21.15.50:0/2763497948 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f5bb40a2c00 0x7f5bb40a50c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.967+0000 7f5bd5e00640 1 --2- 172.21.15.50:0/2763497948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5bd010e420 0x7f5bd019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.967+0000 7f5bd5e00640 1 --2- 172.21.15.50:0/2763497948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5bd0074ee0 0x7f5bd019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.967+0000 7f5bd5e00640 1 --2- 172.21.15.50:0/2763497948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bd00745c0 0x7f5bd019a630 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.967+0000 7f5bd5e00640 1 -- 172.21.15.50:0/2763497948 >> 172.21.15.50:0/2763497948 conn(0x7f5bd00fd8e0 msgr2=0x7f5bd00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.967+0000 7f5bd5e00640 1 -- 172.21.15.50:0/2763497948 shutdown_connections 2024-09-10T10:15:27.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:27.967+0000 7f5bd5e00640 1 -- 172.21.15.50:0/2763497948 wait complete. 2024-09-10T10:15:28.315 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:28 smithi050 ceph-mon[30354]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 230 MiB/s wr, 65 op/s 2024-09-10T10:15:28.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:28 smithi189 ceph-mon[34999]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 230 MiB/s wr, 65 op/s 2024-09-10T10:15:28.598 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:28 smithi084 ceph-mon[34812]: pgmap v519: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 230 MiB/s wr, 65 op/s 2024-09-10T10:15:28.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T10:15:29.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:15:29.489 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:30.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.110+0000 7f9651c00640 1 -- 172.21.15.50:0/4266856534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f964c1082a0 msgr2=0x7f964c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:30.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.110+0000 7f9651c00640 1 --2- 172.21.15.50:0/4266856534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f964c1082a0 0x7f964c10ec40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9644009be0 tx=0x7f964402a6c0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.111+0000 7f9651c00640 1 -- 172.21.15.50:0/4266856534 shutdown_connections 2024-09-10T10:15:30.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.111+0000 7f9651c00640 1 --2- 172.21.15.50:0/4266856534 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f964c1082a0 0x7f964c10ec40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.111+0000 7f9651c00640 1 --2- 172.21.15.50:0/4266856534 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f964c1036e0 0x7f964c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.111+0000 7f9651c00640 1 --2- 172.21.15.50:0/4266856534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964c102d30 0x7f964c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.111+0000 7f9651c00640 1 -- 172.21.15.50:0/4266856534 >> 172.21.15.50:0/4266856534 conn(0x7f964c0fc7d0 msgr2=0x7f964c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:30.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.111+0000 7f9651c00640 1 -- 172.21.15.50:0/4266856534 shutdown_connections 2024-09-10T10:15:30.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.111+0000 7f9651c00640 1 -- 172.21.15.50:0/4266856534 wait complete. 2024-09-10T10:15:30.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.113+0000 7f9651c00640 1 Processor -- start 2024-09-10T10:15:30.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.113+0000 7f9651c00640 1 -- start start 2024-09-10T10:15:30.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.113+0000 7f9651c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f964c102d30 0x7f964c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.113+0000 7f9651c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964c1036e0 0x7f964c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.113+0000 7f9651c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f964c1082a0 0x7f964c19edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.113+0000 7f9651c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f964c1120a0 con 0x7f964c1036e0 2024-09-10T10:15:30.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.113+0000 7f9651c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f964c111f20 con 0x7f964c102d30 2024-09-10T10:15:30.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.113+0000 7f9651c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f964c112220 con 0x7f964c1082a0 2024-09-10T10:15:30.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.114+0000 7f964aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f964c102d30 0x7f964c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.114+0000 7f964aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f964c102d30 0x7f964c19a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:39248/0 (socket says 172.21.15.50:39248) 2024-09-10T10:15:30.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.114+0000 7f964aa00640 1 -- 172.21.15.50:0/2280058404 learned_addr learned my addr 172.21.15.50:0/2280058404 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:30.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.114+0000 7f964b400640 1 --2- 172.21.15.50:0/2280058404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f964c1082a0 0x7f964c19edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.114+0000 7f964aa00640 1 -- 172.21.15.50:0/2280058404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f964c1082a0 msgr2=0x7f964c19edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:30.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.114+0000 7f964aa00640 1 --2- 172.21.15.50:0/2280058404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f964c1082a0 0x7f964c19edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.114+0000 7f964aa00640 1 -- 172.21.15.50:0/2280058404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964c1036e0 msgr2=0x7f964c19aa40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:15:30.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.114+0000 7f964aa00640 1 --2- 172.21.15.50:0/2280058404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964c1036e0 0x7f964c19aa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.114+0000 7f964aa00640 1 -- 172.21.15.50:0/2280058404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964c19f4b0 con 0x7f964c102d30 2024-09-10T10:15:30.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.115+0000 7f964aa00640 1 --2- 172.21.15.50:0/2280058404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f964c102d30 0x7f964c19a500 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f963c00e9c0 tx=0x7f963c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:30.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.115+0000 7f9643400640 1 -- 172.21.15.50:0/2280058404 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c00ccc0 con 0x7f964c102d30 2024-09-10T10:15:30.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.115+0000 7f9651c00640 1 -- 172.21.15.50:0/2280058404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964c19f7a0 con 0x7f964c102d30 2024-09-10T10:15:30.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.115+0000 7f9643400640 1 -- 172.21.15.50:0/2280058404 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f963c005500 con 0x7f964c102d30 2024-09-10T10:15:30.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.115+0000 7f9651c00640 1 -- 172.21.15.50:0/2280058404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964c1a7080 con 0x7f964c102d30 2024-09-10T10:15:30.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.115+0000 7f9643400640 1 -- 172.21.15.50:0/2280058404 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c010430 con 0x7f964c102d30 2024-09-10T10:15:30.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.119+0000 7f9654649740 1 Processor -- start 2024-09-10T10:15:30.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.120+0000 7f9643400640 1 -- 172.21.15.50:0/2280058404 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f963c0105d0 con 0x7f964c102d30 2024-09-10T10:15:30.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.121+0000 7f9654649740 1 -- start start 2024-09-10T10:15:30.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.121+0000 7f9643400640 1 --2- 172.21.15.50:0/2280058404 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f96300a2c00 0x7f96300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.122+0000 7f9643400640 1 -- 172.21.15.50:0/2280058404 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f963c0cf620 con 0x7f964c102d30 2024-09-10T10:15:30.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.122+0000 7f9654649740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c881b90 0x55e71c881f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.122+0000 7f964b400640 1 --2- 172.21.15.50:0/2280058404 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f96300a2c00 0x7f96300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.122+0000 7f9654649740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c8824b0 0x55e71c895120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.122+0000 7f9654649740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c895660 0x55e71c897a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.122+0000 7f9654649740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e71c7e83e0 con 0x55e71c881b90 2024-09-10T10:15:30.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.122+0000 7f9654649740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e71c78fd80 con 0x55e71c895660 2024-09-10T10:15:30.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.122+0000 7f9654649740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e71c7e43a0 con 0x55e71c8824b0 2024-09-10T10:15:30.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.123+0000 7f964aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c881b90 0x55e71c881f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.123+0000 7f964a000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c8824b0 0x55e71c895120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.123+0000 7f964aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c881b90 0x55e71c881f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48390/0 (socket says 172.21.15.50:48390) 2024-09-10T10:15:30.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.123+0000 7f964aa00640 1 -- 172.21.15.50:0/281566376 learned_addr learned my addr 172.21.15.50:0/281566376 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:30.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.123+0000 7f964b400640 1 --2- 172.21.15.50:0/281566376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c895660 0x55e71c897a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.124+0000 7f964a000640 1 -- 172.21.15.50:0/281566376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c895660 msgr2=0x55e71c897a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:30.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.124+0000 7f964a000640 1 --2- 172.21.15.50:0/281566376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c895660 0x55e71c897a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.124+0000 7f964a000640 1 -- 172.21.15.50:0/281566376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c881b90 msgr2=0x55e71c881f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:30.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.124+0000 7f964a000640 1 --2- 172.21.15.50:0/281566376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c881b90 0x55e71c881f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.124+0000 7f964a000640 1 -- 172.21.15.50:0/281566376 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e71c7aeae0 con 0x55e71c8824b0 2024-09-10T10:15:30.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.124+0000 7f964b400640 1 --2- 172.21.15.50:0/2280058404 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f96300a2c00 0x7f96300a50c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f96440099a0 tx=0x7f9644009280 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:30.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.125+0000 7f964a000640 1 --2- 172.21.15.50:0/281566376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c8824b0 0x55e71c895120 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f964c06a370 tx=0x7f9638009eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f02874b41f82661 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:30.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.125+0000 7f9637e00640 1 -- 172.21.15.50:0/281566376 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963800ec20 con 0x55e71c8824b0 2024-09-10T10:15:30.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.125+0000 7f9637e00640 1 -- 172.21.15.50:0/281566376 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f963800edc0 con 0x55e71c8824b0 2024-09-10T10:15:30.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.125+0000 7f9637e00640 1 -- 172.21.15.50:0/281566376 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638004b10 con 0x55e71c8824b0 2024-09-10T10:15:30.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.126+0000 7f9654649740 1 -- 172.21.15.50:0/281566376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c8824b0 msgr2=0x55e71c895120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:30.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.126+0000 7f9654649740 1 --2- 172.21.15.50:0/281566376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c8824b0 0x55e71c895120 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f964c06a370 tx=0x7f9638009eb0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.126+0000 7f9654649740 1 -- 172.21.15.50:0/281566376 shutdown_connections 2024-09-10T10:15:30.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.126+0000 7f9654649740 1 --2- 172.21.15.50:0/281566376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c895660 0x55e71c897a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.126+0000 7f9654649740 1 --2- 172.21.15.50:0/281566376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c8824b0 0x55e71c895120 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.126+0000 7f9654649740 1 --2- 172.21.15.50:0/281566376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c881b90 0x55e71c881f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.127+0000 7f9654649740 1 -- 172.21.15.50:0/281566376 >> 172.21.15.50:0/281566376 conn(0x55e71c87e200 msgr2=0x55e71c87e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:30.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.127+0000 7f9654649740 1 -- 172.21.15.50:0/281566376 shutdown_connections 2024-09-10T10:15:30.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.127+0000 7f9654649740 1 -- 172.21.15.50:0/281566376 wait complete. 2024-09-10T10:15:30.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.128+0000 7f9654649740 1 -- start start 2024-09-10T10:15:30.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.128+0000 7f9654649740 1 Processor -- start 2024-09-10T10:15:30.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.129+0000 7f9654649740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c892570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.129+0000 7f9654649740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c8824b0 0x55e71c892ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.129+0000 7f9654649740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c895660 0x55e71c892ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.129+0000 7f9654649740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e71c8981d0 con 0x55e71c8824b0 2024-09-10T10:15:30.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.129+0000 7f9654649740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e71c7a30f0 con 0x55e71c881b90 2024-09-10T10:15:30.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.129+0000 7f9654649740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e71c898350 con 0x55e71c895660 2024-09-10T10:15:30.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.129+0000 7f9654649740 10 client.0 _ll_register_callbacks cb 0x55e71c78abd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:30.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.130+0000 7f964a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c8824b0 0x55e71c892ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.130+0000 7f964aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c892570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.130+0000 7f964a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c8824b0 0x55e71c892ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48404/0 (socket says 172.21.15.50:48404) 2024-09-10T10:15:30.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.130+0000 7f964a000640 1 -- 172.21.15.50:0/3175572685 learned_addr learned my addr 172.21.15.50:0/3175572685 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:30.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.130+0000 7f964b400640 1 --2- 172.21.15.50:0/3175572685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c895660 0x55e71c892ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.130+0000 7f964a000640 1 -- 172.21.15.50:0/3175572685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c895660 msgr2=0x55e71c892ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:30.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.130+0000 7f964a000640 1 --2- 172.21.15.50:0/3175572685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c895660 0x55e71c892ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.131+0000 7f964a000640 1 -- 172.21.15.50:0/3175572685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 msgr2=0x55e71c892570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:30.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.131+0000 7f964a000640 1 --2- 172.21.15.50:0/3175572685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c892570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.131+0000 7f964a000640 1 -- 172.21.15.50:0/3175572685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e71c5593c0 con 0x55e71c8824b0 2024-09-10T10:15:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.131+0000 7f964a000640 1 --2- 172.21.15.50:0/3175572685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c8824b0 0x55e71c892ab0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f96380057c0 tx=0x7f96380052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d172d3ce4d9fc2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.131+0000 7f9634c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:15:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.131+0000 7f9634c00640 1 -- 172.21.15.50:0/3175572685 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638004460 con 0x55e71c8824b0 2024-09-10T10:15:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.132+0000 7f9634c00640 1 -- 172.21.15.50:0/3175572685 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f9638004810 con 0x55e71c8824b0 2024-09-10T10:15:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.132+0000 7f9654649740 1 -- 172.21.15.50:0/3175572685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f963800edc0 con 0x55e71c8824b0 2024-09-10T10:15:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.132+0000 7f9634c00640 1 -- 172.21.15.50:0/3175572685 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f963802f050 con 0x55e71c8824b0 2024-09-10T10:15:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.132+0000 7f9654649740 10 client.16146 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:30.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.132+0000 7f9654649740 1 -- 172.21.15.50:0/3175572685 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e71c8a42e0 con 0x55e71c8824b0 2024-09-10T10:15:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.132+0000 7f9634c00640 1 -- 172.21.15.50:0/3175572685 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f963800edc0 con 0x55e71c8824b0 2024-09-10T10:15:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.133+0000 7f9634c00640 1 -- 172.21.15.50:0/3175572685 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f9638003ae0 con 0x55e71c8824b0 2024-09-10T10:15:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.133+0000 7f9654649740 10 client.16146 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:30.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.133+0000 7f9654649740 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:15:30.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.133+0000 7f9654649740 20 client.16146 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:30.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.133+0000 7f9654649740 1 --2- 172.21.15.50:0/3175572685 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e71c8a56e0 0x55e71c8a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.133+0000 7f9654649740 4 client.16146 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:15:30.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.133+0000 7f9654649740 1 -- 172.21.15.50:0/3175572685 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e71c7f5950 con 0x55e71c8a56e0 2024-09-10T10:15:30.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.133+0000 7f964aa00640 1 --2- 172.21.15.50:0/3175572685 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e71c8a56e0 0x55e71c8a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.134+0000 7f964aa00640 1 --2- 172.21.15.50:0/3175572685 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e71c8a56e0 0x55e71c8a7ad0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71eaba170b154cbe server_cookie=ad24911742d37470 in_seq=0 out_seq=0 2024-09-10T10:15:30.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.134+0000 7f9634c00640 10 client.16146 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:30.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.135+0000 7f9634c00640 1 -- 172.21.15.50:0/3175572685 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e71c7f5950 con 0x55e71c8a56e0 2024-09-10T10:15:30.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.135+0000 7f9634c00640 10 client.16146 handle_command_reply: tid=0 2024-09-10T10:15:30.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.136+0000 7f9654649740 1 client.16146 shutdown 2024-09-10T10:15:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.136+0000 7f9654649740 1 -- 172.21.15.50:0/3175572685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c8824b0 msgr2=0x55e71c892ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:30.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.136+0000 7f9654649740 1 --2- 172.21.15.50:0/3175572685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c8824b0 0x55e71c892ab0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f96380057c0 tx=0x7f96380052d0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.137+0000 7f9654649740 1 -- 172.21.15.50:0/3175572685 shutdown_connections 2024-09-10T10:15:30.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.137+0000 7f9654649740 1 --2- 172.21.15.50:0/3175572685 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e71c8a56e0 0x55e71c8a7ad0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.137+0000 7f9654649740 1 --2- 172.21.15.50:0/3175572685 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c895660 0x55e71c892ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.137+0000 7f9654649740 1 --2- 172.21.15.50:0/3175572685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c8824b0 0x55e71c892ab0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.137+0000 7f9654649740 1 --2- 172.21.15.50:0/3175572685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c892570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.137+0000 7f9654649740 1 -- 172.21.15.50:0/3175572685 >> 172.21.15.50:0/3175572685 conn(0x55e71c87e200 msgr2=0x55e71c87d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:30.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.137+0000 7f9634c00640 0 client.16146 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:30.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.137+0000 7f9654649740 1 -- 172.21.15.50:0/3175572685 shutdown_connections 2024-09-10T10:15:30.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.137+0000 7f9654649740 1 -- 172.21.15.50:0/3175572685 wait complete. 2024-09-10T10:15:30.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.137+0000 7f9654649740 20 client.16146 trim_cache size 0 max 16384 2024-09-10T10:15:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.160+0000 7f9654649740 1 Processor -- start 2024-09-10T10:15:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.160+0000 7f9654649740 1 -- start start 2024-09-10T10:15:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.161+0000 7f9654649740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c8ad190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.161+0000 7f9654649740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c895660 0x55e71c8ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.161+0000 7f9654649740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c87cb60 0x55e71c87cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.161+0000 7f9654649740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f962c012490 con 0x55e71c895660 2024-09-10T10:15:30.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.161+0000 7f9654649740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f962c00fd60 con 0x55e71c881b90 2024-09-10T10:15:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.161+0000 7f9654649740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f962c00dbb0 con 0x55e71c87cb60 2024-09-10T10:15:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.161+0000 7f964a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c895660 0x55e71c8ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.161+0000 7f964a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c895660 0x55e71c8ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48412/0 (socket says 172.21.15.50:48412) 2024-09-10T10:15:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.161+0000 7f964aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c8ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.161+0000 7f964a000640 1 -- 172.21.15.50:0/3203000241 learned_addr learned my addr 172.21.15.50:0/3203000241 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.162+0000 7f964a000640 1 -- 172.21.15.50:0/3203000241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c87cb60 msgr2=0x55e71c87cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.162+0000 7f964a000640 1 --2- 172.21.15.50:0/3203000241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c87cb60 0x55e71c87cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.162+0000 7f964a000640 1 -- 172.21.15.50:0/3203000241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 msgr2=0x55e71c8ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.162+0000 7f964a000640 1 --2- 172.21.15.50:0/3203000241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c8ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.162+0000 7f964a000640 1 -- 172.21.15.50:0/3203000241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e71c879770 con 0x55e71c895660 2024-09-10T10:15:30.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.162+0000 7f964aa00640 1 --2- 172.21.15.50:0/3203000241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c8ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:15:30.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.163+0000 7f964a000640 1 --2- 172.21.15.50:0/3203000241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c895660 0x55e71c8ad6d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9638018490 tx=0x7f96380092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f5a0771e20b568 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:30.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.163+0000 7f9637400640 1 -- 172.21.15.50:0/3203000241 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638005340 con 0x55e71c895660 2024-09-10T10:15:30.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.164+0000 7f9637400640 1 -- 172.21.15.50:0/3203000241 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9638018d90 con 0x55e71c895660 2024-09-10T10:15:30.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.164+0000 7f9637400640 1 -- 172.21.15.50:0/3203000241 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638004750 con 0x55e71c895660 2024-09-10T10:15:30.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.165+0000 7f9654649740 1 -- 172.21.15.50:0/3203000241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c895660 msgr2=0x55e71c8ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:30.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.165+0000 7f9654649740 1 --2- 172.21.15.50:0/3203000241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c895660 0x55e71c8ad6d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9638018490 tx=0x7f96380092a0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.165+0000 7f9654649740 1 -- 172.21.15.50:0/3203000241 shutdown_connections 2024-09-10T10:15:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.165+0000 7f9654649740 1 --2- 172.21.15.50:0/3203000241 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c87cb60 0x55e71c87cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.165+0000 7f9654649740 1 --2- 172.21.15.50:0/3203000241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c895660 0x55e71c8ad6d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.165+0000 7f9654649740 1 --2- 172.21.15.50:0/3203000241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c8ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.165+0000 7f9654649740 1 -- 172.21.15.50:0/3203000241 >> 172.21.15.50:0/3203000241 conn(0x55e71c87e200 msgr2=0x55e71c891660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.165+0000 7f9654649740 1 -- 172.21.15.50:0/3203000241 shutdown_connections 2024-09-10T10:15:30.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.165+0000 7f9654649740 1 -- 172.21.15.50:0/3203000241 wait complete. 2024-09-10T10:15:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.166+0000 7f9654649740 1 -- start start 2024-09-10T10:15:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.166+0000 7f9654649740 1 Processor -- start 2024-09-10T10:15:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.167+0000 7f9654649740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c87cb60 0x55e71c89df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.167+0000 7f9654649740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c8992c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.167+0000 7f9654649740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c895660 0x55e71c899a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.167+0000 7f9654649740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f962c00e220 con 0x55e71c87cb60 2024-09-10T10:15:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.167+0000 7f9654649740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f962c00f690 con 0x55e71c881b90 2024-09-10T10:15:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.167+0000 7f9654649740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f962c00e8f0 con 0x55e71c895660 2024-09-10T10:15:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.167+0000 7f964aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c87cb60 0x55e71c89df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.167+0000 7f964aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c87cb60 0x55e71c89df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48422/0 (socket says 172.21.15.50:48422) 2024-09-10T10:15:30.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.167+0000 7f964aa00640 1 -- 172.21.15.50:0/3918638213 learned_addr learned my addr 172.21.15.50:0/3918638213 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:30.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.168+0000 7f964b400640 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c895660 0x55e71c899a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.168+0000 7f9654649740 10 client.0 _ll_register_callbacks cb 0x7f9644043030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:30.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.168+0000 7f964a000640 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c8992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.168+0000 7f964aa00640 1 -- 172.21.15.50:0/3918638213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c895660 msgr2=0x55e71c899a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:30.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.168+0000 7f964aa00640 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c895660 0x55e71c899a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.168+0000 7f964aa00640 1 -- 172.21.15.50:0/3918638213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 msgr2=0x55e71c8992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:30.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.168+0000 7f964aa00640 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c8992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.168+0000 7f964aa00640 1 -- 172.21.15.50:0/3918638213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e71c88d2f0 con 0x55e71c87cb60 2024-09-10T10:15:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.168+0000 7f964b400640 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c895660 0x55e71c899a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:15:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.168+0000 7f964a000640 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c8992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:15:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.169+0000 7f964aa00640 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c87cb60 0x55e71c89df90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f963c0ccde0 tx=0x7f963c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21658d571eaf05b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.169+0000 7f9634c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:15:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.169+0000 7f9634c00640 1 -- 172.21.15.50:0/3918638213 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c080070 con 0x55e71c87cb60 2024-09-10T10:15:30.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.170+0000 7f9634c00640 1 -- 172.21.15.50:0/3918638213 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f963c099df0 con 0x55e71c87cb60 2024-09-10T10:15:30.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.170+0000 7f9654649740 1 -- 172.21.15.50:0/3918638213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9638018d90 con 0x55e71c87cb60 2024-09-10T10:15:30.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.170+0000 7f9634c00640 1 -- 172.21.15.50:0/3918638213 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f963c098160 con 0x55e71c87cb60 2024-09-10T10:15:30.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.171+0000 7f9654649740 10 client.16152 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:30.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.171+0000 7f9654649740 1 -- 172.21.15.50:0/3918638213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e71c9101d0 con 0x55e71c87cb60 2024-09-10T10:15:30.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.171+0000 7f9634c00640 1 -- 172.21.15.50:0/3918638213 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9638018d90 con 0x55e71c87cb60 2024-09-10T10:15:30.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.171+0000 7f9634c00640 1 -- 172.21.15.50:0/3918638213 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f963c083030 con 0x55e71c87cb60 2024-09-10T10:15:30.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.172+0000 7f9654649740 10 client.16152 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:30.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.172+0000 7f9654649740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:15:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.172+0000 7f9654649740 20 client.16152 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.172+0000 7f9654649740 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e71c9108f0 0x55e71c912ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.172+0000 7f9654649740 4 client.16152 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:15:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.172+0000 7f9654649740 1 -- 172.21.15.50:0/3918638213 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e71c7efe60 con 0x55e71c9108f0 2024-09-10T10:15:30.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.173+0000 7f964a000640 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e71c9108f0 0x55e71c912ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.176+0000 7f9634c00640 10 client.16152 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:30.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.176+0000 7f964a000640 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e71c9108f0 0x55e71c912ce0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b3e81d9dc8681cd server_cookie=b29e04c8fe230182 in_seq=0 out_seq=0 2024-09-10T10:15:30.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.177+0000 7f9634c00640 1 -- 172.21.15.50:0/3918638213 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e71c7efe60 con 0x55e71c9108f0 2024-09-10T10:15:30.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.177+0000 7f9634c00640 10 client.16152 handle_command_reply: tid=0 2024-09-10T10:15:30.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.177+0000 7f9654649740 1 client.16152 shutdown 2024-09-10T10:15:30.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.178+0000 7f9654649740 1 -- 172.21.15.50:0/3918638213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c87cb60 msgr2=0x55e71c89df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:30.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.178+0000 7f9654649740 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c87cb60 0x55e71c89df90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f963c0ccde0 tx=0x7f963c00ce60 comp rx=0 tx=0).stop 2024-09-10T10:15:30.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.180+0000 7f9654649740 1 -- 172.21.15.50:0/3918638213 shutdown_connections 2024-09-10T10:15:30.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.180+0000 7f9654649740 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55e71c9108f0 0x55e71c912ce0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.180+0000 7f9654649740 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e71c895660 0x55e71c899a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.180+0000 7f9654649740 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e71c881b90 0x55e71c8992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.180+0000 7f9654649740 1 --2- 172.21.15.50:0/3918638213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e71c87cb60 0x55e71c89df90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.180+0000 7f9654649740 1 -- 172.21.15.50:0/3918638213 >> 172.21.15.50:0/3918638213 conn(0x55e71c87e200 msgr2=0x55e71c891660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:30.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.180+0000 7f9634c00640 0 client.16152 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:30.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.180+0000 7f9654649740 1 -- 172.21.15.50:0/3918638213 shutdown_connections 2024-09-10T10:15:30.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.180+0000 7f9654649740 1 -- 172.21.15.50:0/3918638213 wait complete. 2024-09-10T10:15:30.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.181+0000 7f9654649740 20 client.16152 trim_cache size 0 max 16384 2024-09-10T10:15:30.183 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:15:30.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.182+0000 7f9651c00640 1 -- 172.21.15.50:0/2280058404 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f96300a2c00 msgr2=0x7f96300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:30.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.182+0000 7f9651c00640 1 --2- 172.21.15.50:0/2280058404 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f96300a2c00 0x7f96300a50c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f96440099a0 tx=0x7f9644009280 comp rx=0 tx=0).stop 2024-09-10T10:15:30.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.182+0000 7f9651c00640 1 -- 172.21.15.50:0/2280058404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f964c102d30 msgr2=0x7f964c19a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:30.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.182+0000 7f9651c00640 1 --2- 172.21.15.50:0/2280058404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f964c102d30 0x7f964c19a500 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f963c00e9c0 tx=0x7f963c00ee80 comp rx=0 tx=0).stop 2024-09-10T10:15:30.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.183+0000 7f9651c00640 1 -- 172.21.15.50:0/2280058404 shutdown_connections 2024-09-10T10:15:30.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.183+0000 7f9651c00640 1 --2- 172.21.15.50:0/2280058404 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f96300a2c00 0x7f96300a50c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.183+0000 7f9651c00640 1 --2- 172.21.15.50:0/2280058404 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f964c1082a0 0x7f964c19edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.183+0000 7f9651c00640 1 --2- 172.21.15.50:0/2280058404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964c1036e0 0x7f964c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.183+0000 7f9651c00640 1 --2- 172.21.15.50:0/2280058404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f964c102d30 0x7f964c19a500 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:30.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.183+0000 7f9651c00640 1 -- 172.21.15.50:0/2280058404 >> 172.21.15.50:0/2280058404 conn(0x7f964c0fc7d0 msgr2=0x7f964c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:30.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.184+0000 7f9651c00640 1 -- 172.21.15.50:0/2280058404 shutdown_connections 2024-09-10T10:15:30.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:30.184+0000 7f9651c00640 1 -- 172.21.15.50:0/2280058404 wait complete. 2024-09-10T10:15:30.195 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:30.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:30 smithi189 ceph-mon[34999]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 MiB/s rd, 191 MiB/s wr, 65 op/s 2024-09-10T10:15:30.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:30 smithi084 ceph-mon[34812]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 MiB/s rd, 191 MiB/s wr, 65 op/s 2024-09-10T10:15:30.687 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:30 smithi050 ceph-mon[30354]: pgmap v520: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 MiB/s rd, 191 MiB/s wr, 65 op/s 2024-09-10T10:15:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.772+0000 7f3812600640 1 -- 172.21.15.50:0/913095435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f380c103650 msgr2=0x7f380c10bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.772+0000 7f3812600640 1 --2- 172.21.15.50:0/913095435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f380c103650 0x7f380c10bb40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009860 tx=0x7f37f402a3d0 comp rx=0 tx=0).stop 2024-09-10T10:15:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.773+0000 7f3812600640 1 -- 172.21.15.50:0/913095435 shutdown_connections 2024-09-10T10:15:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.773+0000 7f3812600640 1 --2- 172.21.15.50:0/913095435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f380c10c160 0x7f380c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.773+0000 7f3812600640 1 --2- 172.21.15.50:0/913095435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f380c103650 0x7f380c10bb40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.773+0000 7f3812600640 1 --2- 172.21.15.50:0/913095435 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f380c102d30 0x7f380c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.773+0000 7f3812600640 1 -- 172.21.15.50:0/913095435 >> 172.21.15.50:0/913095435 conn(0x7f380c0fc790 msgr2=0x7f380c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.773+0000 7f3812600640 1 -- 172.21.15.50:0/913095435 shutdown_connections 2024-09-10T10:15:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.773+0000 7f3812600640 1 -- 172.21.15.50:0/913095435 wait complete. 2024-09-10T10:15:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.774+0000 7f3812600640 1 Processor -- start 2024-09-10T10:15:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.775+0000 7f3812600640 1 -- start start 2024-09-10T10:15:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.775+0000 7f3812600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f380c102d30 0x7f380c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.775+0000 7f3812600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f380c103650 0x7f380c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.775+0000 7f3812600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f380c10c160 0x7f380c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.775+0000 7f3812600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f380c111fb0 con 0x7f380c103650 2024-09-10T10:15:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.775+0000 7f3812600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f380c111e30 con 0x7f380c102d30 2024-09-10T10:15:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.775+0000 7f3812600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f380c112130 con 0x7f380c10c160 2024-09-10T10:15:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.776+0000 7f3802a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f380c103650 0x7f380c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.776+0000 7f3802a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f380c103650 0x7f380c19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48440/0 (socket says 172.21.15.50:48440) 2024-09-10T10:15:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.776+0000 7f3802a00640 1 -- 172.21.15.50:0/1673994674 learned_addr learned my addr 172.21.15.50:0/1673994674 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.776+0000 7f380b400640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f380c102d30 0x7f380c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.776+0000 7f380be00640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f380c10c160 0x7f380c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.776+0000 7f3802a00640 1 -- 172.21.15.50:0/1673994674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f380c10c160 msgr2=0x7f380c19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.776+0000 7f3802a00640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f380c10c160 0x7f380c19ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.776+0000 7f3802a00640 1 -- 172.21.15.50:0/1673994674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f380c102d30 msgr2=0x7f380c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.776+0000 7f3802a00640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f380c102d30 0x7f380c19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.776+0000 7f3802a00640 1 -- 172.21.15.50:0/1673994674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380c19f660 con 0x7f380c103650 2024-09-10T10:15:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.777+0000 7f3802a00640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f380c103650 0x7f380c19abf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009980 tx=0x7f37f40309a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.777+0000 7f3808c00640 1 -- 172.21.15.50:0/1673994674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4040070 con 0x7f380c103650 2024-09-10T10:15:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.777+0000 7f3812600640 1 -- 172.21.15.50:0/1673994674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f380c19f8f0 con 0x7f380c103650 2024-09-10T10:15:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.777+0000 7f3808c00640 1 -- 172.21.15.50:0/1673994674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37f4005620 con 0x7f380c103650 2024-09-10T10:15:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.777+0000 7f3808c00640 1 -- 172.21.15.50:0/1673994674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4004920 con 0x7f380c103650 2024-09-10T10:15:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.777+0000 7f3812600640 1 -- 172.21.15.50:0/1673994674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f380c1a7230 con 0x7f380c103650 2024-09-10T10:15:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.779+0000 7f3812600640 1 -- 172.21.15.50:0/1673994674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f380c103110 con 0x7f380c103650 2024-09-10T10:15:31.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.781+0000 7f3808c00640 1 -- 172.21.15.50:0/1673994674 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f37f4043070 con 0x7f380c103650 2024-09-10T10:15:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.782+0000 7f3808c00640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f37f00a2c00 0x7f37f00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.783+0000 7f3808c00640 1 -- 172.21.15.50:0/1673994674 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f37f40f01a0 con 0x7f380c103650 2024-09-10T10:15:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.783+0000 7f380b400640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f37f00a2c00 0x7f37f00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:31.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.784+0000 7f380b400640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f37f00a2c00 0x7f37f00a50c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0096c0 tx=0x7f37fc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:31.788+0000 7f3808c00640 1 -- 172.21.15.50:0/1673994674 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f37f40bcd70 con 0x7f380c103650 2024-09-10T10:15:32.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.134+0000 7f3812600640 1 -- 172.21.15.50:0/1673994674 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f380c1a7530 con 0x7f380c103650 2024-09-10T10:15:32.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.136+0000 7f3808c00640 1 -- 172.21.15.50:0/1673994674 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f37f4031400 con 0x7f380c103650 2024-09-10T10:15:32.137 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:15:32.137 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:15:32.138 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:15:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.138+0000 7f3812600640 1 -- 172.21.15.50:0/1673994674 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f37f00a2c00 msgr2=0x7f37f00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.138+0000 7f3812600640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f37f00a2c00 0x7f37f00a50c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0096c0 tx=0x7f37fc009260 comp rx=0 tx=0).stop 2024-09-10T10:15:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.138+0000 7f3812600640 1 -- 172.21.15.50:0/1673994674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f380c103650 msgr2=0x7f380c19abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.138+0000 7f3812600640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f380c103650 0x7f380c19abf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009980 tx=0x7f37f40309a0 comp rx=0 tx=0).stop 2024-09-10T10:15:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.138+0000 7f3812600640 1 -- 172.21.15.50:0/1673994674 shutdown_connections 2024-09-10T10:15:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.138+0000 7f3812600640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f37f00a2c00 0x7f37f00a50c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.138+0000 7f3812600640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f380c10c160 0x7f380c19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.138+0000 7f3812600640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f380c103650 0x7f380c19abf0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.138+0000 7f3812600640 1 --2- 172.21.15.50:0/1673994674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f380c102d30 0x7f380c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.138+0000 7f3812600640 1 -- 172.21.15.50:0/1673994674 >> 172.21.15.50:0/1673994674 conn(0x7f380c0fc790 msgr2=0x7f380c0fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.138+0000 7f3812600640 1 -- 172.21.15.50:0/1673994674 shutdown_connections 2024-09-10T10:15:32.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:32.139+0000 7f3812600640 1 -- 172.21.15.50:0/1673994674 wait complete. 2024-09-10T10:15:32.183 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T10:15:32.183 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T10:15:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:32 smithi050 ceph-mon[30354]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 119 MiB/s rd, 117 MiB/s wr, 65 op/s 2024-09-10T10:15:32.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:32 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1673994674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:32.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:32 smithi189 ceph-mon[34999]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 119 MiB/s rd, 117 MiB/s wr, 65 op/s 2024-09-10T10:15:32.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:32 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1673994674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:32.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:32 smithi084 ceph-mon[34812]: pgmap v521: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 119 MiB/s rd, 117 MiB/s wr, 65 op/s 2024-09-10T10:15:32.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:32 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1673994674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:33.038 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id b7012dd8 --release --await' 2024-09-10T10:15:33.038 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24560 quiesce db --set-id b7012dd8 --release --await 2024-09-10T10:15:33.159 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.848+0000 7fb34e200640 1 -- 172.21.15.50:0/1084051272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3481079c0 msgr2=0x7fb348107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.848+0000 7fb34e200640 1 --2- 172.21.15.50:0/1084051272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3481079c0 0x7fb348107da0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb340009930 tx=0x7fb34002a440 comp rx=0 tx=0).stop 2024-09-10T10:15:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.849+0000 7fb34e200640 1 -- 172.21.15.50:0/1084051272 shutdown_connections 2024-09-10T10:15:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.849+0000 7fb34e200640 1 --2- 172.21.15.50:0/1084051272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb348102360 0x7fb34810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.849+0000 7fb34e200640 1 --2- 172.21.15.50:0/1084051272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3481019c0 0x7fb348101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.849+0000 7fb34e200640 1 --2- 172.21.15.50:0/1084051272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3481079c0 0x7fb348107da0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.849+0000 7fb34e200640 1 -- 172.21.15.50:0/1084051272 >> 172.21.15.50:0/1084051272 conn(0x7fb3480fd740 msgr2=0x7fb3480ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:33.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.849+0000 7fb34e200640 1 -- 172.21.15.50:0/1084051272 shutdown_connections 2024-09-10T10:15:33.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.849+0000 7fb34e200640 1 -- 172.21.15.50:0/1084051272 wait complete. 2024-09-10T10:15:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.850+0000 7fb34e200640 1 Processor -- start 2024-09-10T10:15:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.851+0000 7fb34e200640 1 -- start start 2024-09-10T10:15:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.851+0000 7fb34e200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3481019c0 0x7fb34819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.851+0000 7fb34e200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb348102360 0x7fb34819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.851+0000 7fb34e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3481079c0 0x7fb34819edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.851+0000 7fb34e200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb348111dc0 con 0x7fb348102360 2024-09-10T10:15:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.851+0000 7fb34e200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb348111c40 con 0x7fb3481079c0 2024-09-10T10:15:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.851+0000 7fb34e200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb348111f40 con 0x7fb3481019c0 2024-09-10T10:15:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.852+0000 7fb347e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb348102360 0x7fb34819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.852+0000 7fb34d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3481079c0 0x7fb34819edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.852+0000 7fb347e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb348102360 0x7fb34819aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48462/0 (socket says 172.21.15.50:48462) 2024-09-10T10:15:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.852+0000 7fb347e00640 1 -- 172.21.15.50:0/2312885196 learned_addr learned my addr 172.21.15.50:0/2312885196 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.852+0000 7fb34ce00640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3481019c0 0x7fb34819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.852+0000 7fb34ce00640 1 -- 172.21.15.50:0/2312885196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3481079c0 msgr2=0x7fb34819edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.852+0000 7fb34ce00640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3481079c0 0x7fb34819edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.852+0000 7fb34ce00640 1 -- 172.21.15.50:0/2312885196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb348102360 msgr2=0x7fb34819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.852+0000 7fb34ce00640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb348102360 0x7fb34819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.852+0000 7fb34ce00640 1 -- 172.21.15.50:0/2312885196 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34819f4d0 con 0x7fb3481019c0 2024-09-10T10:15:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.852+0000 7fb34d800640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3481079c0 0x7fb34819edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.853+0000 7fb34ce00640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3481019c0 0x7fb34819a520 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb340005940 tx=0x7fb340031b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.853+0000 7fb345600640 1 -- 172.21.15.50:0/2312885196 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34003f070 con 0x7fb3481019c0 2024-09-10T10:15:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.853+0000 7fb345600640 1 -- 172.21.15.50:0/2312885196 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb340003ad0 con 0x7fb3481019c0 2024-09-10T10:15:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.853+0000 7fb34e200640 1 -- 172.21.15.50:0/2312885196 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34819f760 con 0x7fb3481019c0 2024-09-10T10:15:33.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.853+0000 7fb345600640 1 -- 172.21.15.50:0/2312885196 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb340035070 con 0x7fb3481019c0 2024-09-10T10:15:33.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.854+0000 7fb34e200640 1 -- 172.21.15.50:0/2312885196 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3481a70a0 con 0x7fb3481019c0 2024-09-10T10:15:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.858+0000 7fb3523c7740 1 Processor -- start 2024-09-10T10:15:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.859+0000 7fb3523c7740 1 -- start start 2024-09-10T10:15:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.859+0000 7fb3523c7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe525090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.859+0000 7fb3523c7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe5255d0 0x561abe52f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.859+0000 7fb3523c7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52fe90 0x561abe532280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.859+0000 7fb3523c7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561abe48b290 con 0x561abe5255d0 2024-09-10T10:15:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.859+0000 7fb3523c7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561abe432b40 con 0x561abe52fe90 2024-09-10T10:15:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.859+0000 7fb3523c7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561abe487250 con 0x561abe524cb0 2024-09-10T10:15:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.860+0000 7fb347e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52fe90 0x561abe532280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.860+0000 7fb347e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52fe90 0x561abe532280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:39338/0 (socket says 172.21.15.50:39338) 2024-09-10T10:15:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.860+0000 7fb347e00640 1 -- 172.21.15.50:0/2109056111 learned_addr learned my addr 172.21.15.50:0/2109056111 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.860+0000 7fb34d800640 1 --2- 172.21.15.50:0/2109056111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe525090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:33.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.860+0000 7fb347e00640 1 -- 172.21.15.50:0/2109056111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 msgr2=0x561abe525090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:33.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.860+0000 7fb347e00640 1 --2- 172.21.15.50:0/2109056111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe525090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.860+0000 7fb347e00640 1 -- 172.21.15.50:0/2109056111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe5255d0 msgr2=0x561abe52f950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:15:33.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.860+0000 7fb347e00640 1 --2- 172.21.15.50:0/2109056111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe5255d0 0x561abe52f950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.860+0000 7fb347e00640 1 -- 172.21.15.50:0/2109056111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561abe1fc6a0 con 0x561abe52fe90 2024-09-10T10:15:33.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.861+0000 7fb347e00640 1 --2- 172.21.15.50:0/2109056111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52fe90 0x561abe532280 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb330009db0 tx=0x7fb330011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cf5a00b0fe78bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:33.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.861+0000 7fb33e000640 1 -- 172.21.15.50:0/2109056111 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330005220 con 0x561abe52fe90 2024-09-10T10:15:33.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.861+0000 7fb33e000640 1 -- 172.21.15.50:0/2109056111 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb330004c80 con 0x561abe52fe90 2024-09-10T10:15:33.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.861+0000 7fb33e000640 1 -- 172.21.15.50:0/2109056111 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330019950 con 0x561abe52fe90 2024-09-10T10:15:33.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.862+0000 7fb3523c7740 1 -- 172.21.15.50:0/2109056111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52fe90 msgr2=0x561abe532280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:33.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.862+0000 7fb3523c7740 1 --2- 172.21.15.50:0/2109056111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52fe90 0x561abe532280 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb330009db0 tx=0x7fb330011810 comp rx=0 tx=0).stop 2024-09-10T10:15:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.862+0000 7fb3523c7740 1 -- 172.21.15.50:0/2109056111 shutdown_connections 2024-09-10T10:15:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.862+0000 7fb345600640 1 -- 172.21.15.50:0/2312885196 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb34003bbb0 con 0x7fb3481019c0 2024-09-10T10:15:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.862+0000 7fb3523c7740 1 --2- 172.21.15.50:0/2109056111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52fe90 0x561abe532280 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.862+0000 7fb3523c7740 1 --2- 172.21.15.50:0/2109056111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe5255d0 0x561abe52f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.862+0000 7fb3523c7740 1 --2- 172.21.15.50:0/2109056111 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe525090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.862+0000 7fb3523c7740 1 -- 172.21.15.50:0/2109056111 >> 172.21.15.50:0/2109056111 conn(0x561abe521240 msgr2=0x561abe521620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.863+0000 7fb3523c7740 1 -- 172.21.15.50:0/2109056111 shutdown_connections 2024-09-10T10:15:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.863+0000 7fb3523c7740 1 -- 172.21.15.50:0/2109056111 wait complete. 2024-09-10T10:15:33.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.864+0000 7fb3523c7740 1 -- start start 2024-09-10T10:15:33.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.865+0000 7fb3523c7740 1 Processor -- start 2024-09-10T10:15:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.865+0000 7fb3523c7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe52f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.865+0000 7fb3523c7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52fe90 0x561abe52ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.865+0000 7fb3523c7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe52cf40 0x561abe52d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.865+0000 7fb3523c7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561abe53b310 con 0x561abe52cf40 2024-09-10T10:15:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.865+0000 7fb3523c7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561abe445fa0 con 0x561abe52fe90 2024-09-10T10:15:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.865+0000 7fb3523c7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561abe53b490 con 0x561abe524cb0 2024-09-10T10:15:33.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.865+0000 7fb3523c7740 10 client.0 _ll_register_callbacks cb 0x561abe199ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.866+0000 7fb34d800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe52f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.866+0000 7fb34d800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe52f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:34944/0 (socket says 172.21.15.50:34944) 2024-09-10T10:15:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.866+0000 7fb34d800640 1 -- 172.21.15.50:0/1553716328 learned_addr learned my addr 172.21.15.50:0/1553716328 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.866+0000 7fb345600640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb32c0a2b10 0x7fb32c0a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.866+0000 7fb345600640 1 -- 172.21.15.50:0/2312885196 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb3400ef360 con 0x7fb3481019c0 2024-09-10T10:15:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.866+0000 7fb34d800640 1 -- 172.21.15.50:0/1553716328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52fe90 msgr2=0x561abe52ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:33.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.866+0000 7fb34d800640 1 --2- 172.21.15.50:0/1553716328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52fe90 0x561abe52ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.866+0000 7fb34d800640 1 -- 172.21.15.50:0/1553716328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe52cf40 msgr2=0x561abe52d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.866+0000 7fb34d800640 1 --2- 172.21.15.50:0/1553716328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe52cf40 0x561abe52d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.866+0000 7fb34d800640 1 -- 172.21.15.50:0/1553716328 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561abe5448e0 con 0x561abe524cb0 2024-09-10T10:15:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.867+0000 7fb34d800640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb32c0a2b10 0x7fb32c0a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:33.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.867+0000 7fb34d800640 1 --2- 172.21.15.50:0/1553716328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe52f750 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb338005b30 tx=0x7fb3380128e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1da290c4c14aadc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.867+0000 7fb336a00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:15:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.867+0000 7fb336a00640 1 -- 172.21.15.50:0/1553716328 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338010910 con 0x561abe524cb0 2024-09-10T10:15:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.867+0000 7fb336a00640 1 -- 172.21.15.50:0/1553716328 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb338010b30 con 0x561abe524cb0 2024-09-10T10:15:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.868+0000 7fb3523c7740 1 -- 172.21.15.50:0/1553716328 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb330004c80 con 0x561abe524cb0 2024-09-10T10:15:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.868+0000 7fb336a00640 1 -- 172.21.15.50:0/1553716328 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb33801d440 con 0x561abe524cb0 2024-09-10T10:15:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.868+0000 7fb3523c7740 10 client.26245 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.868+0000 7fb3523c7740 1 -- 172.21.15.50:0/1553716328 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561abe547640 con 0x561abe524cb0 2024-09-10T10:15:33.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.869+0000 7fb336a00640 1 -- 172.21.15.50:0/1553716328 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb330004c80 con 0x561abe524cb0 2024-09-10T10:15:33.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.869+0000 7fb336a00640 1 -- 172.21.15.50:0/1553716328 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb338027410 con 0x561abe524cb0 2024-09-10T10:15:33.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.869+0000 7fb3523c7740 10 client.26245 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.869+0000 7fb3523c7740 10 client.26245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:15:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.869+0000 7fb3523c7740 20 client.26245 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.869+0000 7fb3523c7740 1 --2- 172.21.15.50:0/1553716328 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561abe548b50 0x561abe54afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.869+0000 7fb3523c7740 4 client.26245 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:15:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.869+0000 7fb3523c7740 1 -- 172.21.15.50:0/1553716328 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561abe498800 con 0x561abe548b50 2024-09-10T10:15:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.870+0000 7fb34ce00640 1 --2- 172.21.15.50:0/1553716328 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561abe548b50 0x561abe54afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.870+0000 7fb34d800640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb32c0a2b10 0x7fb32c0a4fd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb338022000 tx=0x7fb33801c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.871+0000 7fb34ce00640 1 --2- 172.21.15.50:0/1553716328 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561abe548b50 0x561abe54afa0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11bb96b19e56b7a6 server_cookie=a8ada0789b50c68b in_seq=0 out_seq=0 2024-09-10T10:15:33.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.871+0000 7fb336a00640 10 client.26245 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:33.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.873+0000 7fb336a00640 1 -- 172.21.15.50:0/1553716328 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561abe498800 con 0x561abe548b50 2024-09-10T10:15:33.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.873+0000 7fb336a00640 10 client.26245 handle_command_reply: tid=0 2024-09-10T10:15:33.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.873+0000 7fb3523c7740 1 client.26245 shutdown 2024-09-10T10:15:33.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.873+0000 7fb3523c7740 1 -- 172.21.15.50:0/1553716328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 msgr2=0x561abe52f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:33.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.873+0000 7fb3523c7740 1 --2- 172.21.15.50:0/1553716328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe52f750 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb338005b30 tx=0x7fb3380128e0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.873+0000 7fb3523c7740 1 -- 172.21.15.50:0/1553716328 shutdown_connections 2024-09-10T10:15:33.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.874+0000 7fb3523c7740 1 --2- 172.21.15.50:0/1553716328 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561abe548b50 0x561abe54afa0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.874+0000 7fb3523c7740 1 --2- 172.21.15.50:0/1553716328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe52cf40 0x561abe52d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.874+0000 7fb3523c7740 1 --2- 172.21.15.50:0/1553716328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52fe90 0x561abe52ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.874+0000 7fb3523c7740 1 --2- 172.21.15.50:0/1553716328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe52f750 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.874+0000 7fb3523c7740 1 -- 172.21.15.50:0/1553716328 >> 172.21.15.50:0/1553716328 conn(0x561abe521240 msgr2=0x561abe526f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.874+0000 7fb336a00640 0 client.26245 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.874+0000 7fb3523c7740 1 -- 172.21.15.50:0/1553716328 shutdown_connections 2024-09-10T10:15:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.874+0000 7fb3523c7740 1 -- 172.21.15.50:0/1553716328 wait complete. 2024-09-10T10:15:33.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.874+0000 7fb3523c7740 20 client.26245 trim_cache size 0 max 16384 2024-09-10T10:15:33.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.894+0000 7fb3523c7740 1 Processor -- start 2024-09-10T10:15:33.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.894+0000 7fb3523c7740 1 -- start start 2024-09-10T10:15:33.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.895+0000 7fb3523c7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe527f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.895+0000 7fb3523c7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52cf40 0x561abe52f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.895+0000 7fb3523c7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe52fe90 0x561abe550840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.895+0000 7fb3523c7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3481af350 con 0x561abe52fe90 2024-09-10T10:15:33.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.895+0000 7fb3523c7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb3481acc20 con 0x561abe52cf40 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.895+0000 7fb3523c7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb3481aaab0 con 0x561abe524cb0 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.895+0000 7fb34d800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe52fe90 0x561abe550840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.895+0000 7fb34ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe527f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.895+0000 7fb34ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe527f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:34946/0 (socket says 172.21.15.50:34946) 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.895+0000 7fb34ce00640 1 -- 172.21.15.50:0/1707796558 learned_addr learned my addr 172.21.15.50:0/1707796558 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.895+0000 7fb347e00640 1 --2- 172.21.15.50:0/1707796558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52cf40 0x561abe52f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.896+0000 7fb34ce00640 1 -- 172.21.15.50:0/1707796558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52cf40 msgr2=0x561abe52f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.896+0000 7fb34ce00640 1 --2- 172.21.15.50:0/1707796558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52cf40 0x561abe52f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.896+0000 7fb34ce00640 1 -- 172.21.15.50:0/1707796558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe52fe90 msgr2=0x561abe550840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.896+0000 7fb34ce00640 1 --2- 172.21.15.50:0/1707796558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe52fe90 0x561abe550840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.896+0000 7fb34ce00640 1 -- 172.21.15.50:0/1707796558 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561abe52b9f0 con 0x561abe524cb0 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.896+0000 7fb347e00640 1 --2- 172.21.15.50:0/1707796558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52cf40 0x561abe52f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.896+0000 7fb34d800640 1 --2- 172.21.15.50:0/1707796558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe52fe90 0x561abe550840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:33.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.896+0000 7fb34ce00640 1 --2- 172.21.15.50:0/1707796558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe527f50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb3400bb5d0 tx=0x7fb34003b6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cef4b20509db83a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:33.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.897+0000 7fb33d600640 1 -- 172.21.15.50:0/1707796558 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb340003c80 con 0x561abe524cb0 2024-09-10T10:15:33.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.897+0000 7fb33d600640 1 -- 172.21.15.50:0/1707796558 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3400bb8d0 con 0x561abe524cb0 2024-09-10T10:15:33.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.897+0000 7fb33d600640 1 -- 172.21.15.50:0/1707796558 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3400b9bd0 con 0x561abe524cb0 2024-09-10T10:15:33.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.899+0000 7fb3523c7740 1 -- 172.21.15.50:0/1707796558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 msgr2=0x561abe527f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:33.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.899+0000 7fb3523c7740 1 --2- 172.21.15.50:0/1707796558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe527f50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb3400bb5d0 tx=0x7fb34003b6b0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.899+0000 7fb3523c7740 1 -- 172.21.15.50:0/1707796558 shutdown_connections 2024-09-10T10:15:33.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.899+0000 7fb3523c7740 1 --2- 172.21.15.50:0/1707796558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe52fe90 0x561abe550840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.899+0000 7fb3523c7740 1 --2- 172.21.15.50:0/1707796558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52cf40 0x561abe52f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.899+0000 7fb3523c7740 1 --2- 172.21.15.50:0/1707796558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe524cb0 0x561abe527f50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.899+0000 7fb3523c7740 1 -- 172.21.15.50:0/1707796558 >> 172.21.15.50:0/1707796558 conn(0x561abe521240 msgr2=0x561abe527840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:33.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.899+0000 7fb3523c7740 1 -- 172.21.15.50:0/1707796558 shutdown_connections 2024-09-10T10:15:33.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.900+0000 7fb3523c7740 1 -- 172.21.15.50:0/1707796558 wait complete. 2024-09-10T10:15:33.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.900+0000 7fb3523c7740 1 -- start start 2024-09-10T10:15:33.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.900+0000 7fb3523c7740 1 Processor -- start 2024-09-10T10:15:33.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.901+0000 7fb3523c7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe524cb0 0x561abe541000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.901+0000 7fb3523c7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52cf40 0x561abe53c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.901+0000 7fb3523c7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe52fe90 0x561abe53cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.901+0000 7fb3523c7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3481ab100 con 0x561abe524cb0 2024-09-10T10:15:33.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.901+0000 7fb3523c7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb3481ac550 con 0x561abe52cf40 2024-09-10T10:15:33.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.901+0000 7fb3523c7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb3481ab7b0 con 0x561abe52fe90 2024-09-10T10:15:33.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.901+0000 7fb3523c7740 10 client.0 _ll_register_callbacks cb 0x7fb33800fb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:33.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.902+0000 7fb34ce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe524cb0 0x561abe541000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:33.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.902+0000 7fb34ce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe524cb0 0x561abe541000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48490/0 (socket says 172.21.15.50:48490) 2024-09-10T10:15:33.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.902+0000 7fb34ce00640 1 -- 172.21.15.50:0/251425061 learned_addr learned my addr 172.21.15.50:0/251425061 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:33.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.903+0000 7fb34ce00640 1 -- 172.21.15.50:0/251425061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe52fe90 msgr2=0x561abe53cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:33.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.903+0000 7fb34ce00640 1 --2- 172.21.15.50:0/251425061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe52fe90 0x561abe53cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.903+0000 7fb34ce00640 1 -- 172.21.15.50:0/251425061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52cf40 msgr2=0x561abe53c380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:15:33.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.903+0000 7fb34ce00640 1 --2- 172.21.15.50:0/251425061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52cf40 0x561abe53c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.903+0000 7fb34ce00640 1 -- 172.21.15.50:0/251425061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561abe52d730 con 0x561abe524cb0 2024-09-10T10:15:33.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.903+0000 7fb34ce00640 1 --2- 172.21.15.50:0/251425061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe524cb0 0x561abe541000 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb34002a960 tx=0x7fb340009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3a409181e3edd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:33.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.903+0000 7fb336a00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:15:33.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.903+0000 7fb336a00640 1 -- 172.21.15.50:0/251425061 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3400d8020 con 0x561abe524cb0 2024-09-10T10:15:33.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.903+0000 7fb336a00640 1 -- 172.21.15.50:0/251425061 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fb3400b9bd0 con 0x561abe524cb0 2024-09-10T10:15:33.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.903+0000 7fb3523c7740 1 -- 172.21.15.50:0/251425061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3400bb8d0 con 0x561abe524cb0 2024-09-10T10:15:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.904+0000 7fb336a00640 1 -- 172.21.15.50:0/251425061 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb3400a3050 con 0x561abe524cb0 2024-09-10T10:15:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.904+0000 7fb3523c7740 10 client.16170 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.904+0000 7fb3523c7740 1 -- 172.21.15.50:0/251425061 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561abe5b3840 con 0x561abe524cb0 2024-09-10T10:15:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.904+0000 7fb336a00640 1 -- 172.21.15.50:0/251425061 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3400bb8d0 con 0x561abe524cb0 2024-09-10T10:15:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.904+0000 7fb336a00640 1 -- 172.21.15.50:0/251425061 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fb3400b7f40 con 0x561abe524cb0 2024-09-10T10:15:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.904+0000 7fb3523c7740 10 client.16170 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.904+0000 7fb3523c7740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:15:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.904+0000 7fb3523c7740 20 client.16170 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:33.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.905+0000 7fb3523c7740 1 --2- 172.21.15.50:0/251425061 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561abe5b3e10 0x561abe5b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.905+0000 7fb3523c7740 4 client.16170 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T10:15:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.905+0000 7fb3523c7740 1 -- 172.21.15.50:0/251425061 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561abe492d10 con 0x561abe5b3e10 2024-09-10T10:15:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.906+0000 7fb347e00640 1 --2- 172.21.15.50:0/251425061 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561abe5b3e10 0x561abe5b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.906+0000 7fb347e00640 1 --2- 172.21.15.50:0/251425061 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561abe5b3e10 0x561abe5b6250 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53a1da2bff6ef11a server_cookie=cb7473e2e6fa09cd in_seq=0 out_seq=0 2024-09-10T10:15:33.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.906+0000 7fb336a00640 10 client.16170 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:33.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.907+0000 7fb336a00640 1 -- 172.21.15.50:0/251425061 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561abe492d10 con 0x561abe5b3e10 2024-09-10T10:15:33.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.907+0000 7fb336a00640 10 client.16170 handle_command_reply: tid=0 2024-09-10T10:15:33.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.908+0000 7fb3523c7740 1 client.16170 shutdown 2024-09-10T10:15:33.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.908+0000 7fb3523c7740 1 -- 172.21.15.50:0/251425061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe524cb0 msgr2=0x561abe541000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:33.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.908+0000 7fb3523c7740 1 --2- 172.21.15.50:0/251425061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe524cb0 0x561abe541000 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb34002a960 tx=0x7fb340009290 comp rx=0 tx=0).stop 2024-09-10T10:15:33.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.908+0000 7fb3523c7740 1 -- 172.21.15.50:0/251425061 shutdown_connections 2024-09-10T10:15:33.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.908+0000 7fb3523c7740 1 --2- 172.21.15.50:0/251425061 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x561abe5b3e10 0x561abe5b6250 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.908+0000 7fb3523c7740 1 --2- 172.21.15.50:0/251425061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561abe52fe90 0x561abe53cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.908+0000 7fb3523c7740 1 --2- 172.21.15.50:0/251425061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561abe52cf40 0x561abe53c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.908+0000 7fb3523c7740 1 --2- 172.21.15.50:0/251425061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561abe524cb0 0x561abe541000 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.908+0000 7fb3523c7740 1 -- 172.21.15.50:0/251425061 >> 172.21.15.50:0/251425061 conn(0x561abe521240 msgr2=0x561abe520290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:33.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.909+0000 7fb336a00640 0 client.16170 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.909+0000 7fb3523c7740 1 -- 172.21.15.50:0/251425061 shutdown_connections 2024-09-10T10:15:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.909+0000 7fb3523c7740 1 -- 172.21.15.50:0/251425061 wait complete. 2024-09-10T10:15:33.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.909+0000 7fb3523c7740 20 client.16170 trim_cache size 0 max 16384 2024-09-10T10:15:33.911 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:15:33.911 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-10T10:15:33.911 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "9c362160-5e76-476f-97c7-9e19bf921444", 2024-09-10T10:15:33.911 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-10T10:15:33.911 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:15:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.910+0000 7fb34e200640 1 -- 172.21.15.50:0/2312885196 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb32c0a2b10 msgr2=0x7fb32c0a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.910+0000 7fb34e200640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb32c0a2b10 0x7fb32c0a4fd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb338022000 tx=0x7fb33801c000 comp rx=0 tx=0).stop 2024-09-10T10:15:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.910+0000 7fb34e200640 1 -- 172.21.15.50:0/2312885196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3481019c0 msgr2=0x7fb34819a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.910+0000 7fb34e200640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3481019c0 0x7fb34819a520 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb340005940 tx=0x7fb340031b50 comp rx=0 tx=0).stop 2024-09-10T10:15:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.911+0000 7fb34e200640 1 -- 172.21.15.50:0/2312885196 shutdown_connections 2024-09-10T10:15:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.911+0000 7fb34e200640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fb32c0a2b10 0x7fb32c0a4fd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.911+0000 7fb34e200640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3481079c0 0x7fb34819edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.911+0000 7fb34e200640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb348102360 0x7fb34819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.911+0000 7fb34e200640 1 --2- 172.21.15.50:0/2312885196 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb3481019c0 0x7fb34819a520 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.911+0000 7fb34e200640 1 -- 172.21.15.50:0/2312885196 >> 172.21.15.50:0/2312885196 conn(0x7fb3480fd740 msgr2=0x7fb34810cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.911+0000 7fb34e200640 1 -- 172.21.15.50:0/2312885196 shutdown_connections 2024-09-10T10:15:33.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:33.911+0000 7fb34e200640 1 -- 172.21.15.50:0/2312885196 wait complete. 2024-09-10T10:15:33.917 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:34.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:34 smithi050 ceph-mon[30354]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 193 MiB/s rd, 62 MiB/s wr, 71 op/s 2024-09-10T10:15:34.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:34 smithi189 ceph-mon[34999]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 193 MiB/s rd, 62 MiB/s wr, 71 op/s 2024-09-10T10:15:34.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:34 smithi084 ceph-mon[34812]: pgmap v522: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 193 MiB/s rd, 62 MiB/s wr, 71 op/s 2024-09-10T10:15:35.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.862+0000 7f3c1be00640 1 -- 172.21.15.50:0/388352791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c1c103e30 msgr2=0x7f3c1c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.862+0000 7f3c1be00640 1 --2- 172.21.15.50:0/388352791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c1c103e30 0x7f3c1c104210 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c009900 tx=0x7f3c0c02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.863+0000 7f3c1be00640 1 -- 172.21.15.50:0/388352791 shutdown_connections 2024-09-10T10:15:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.863+0000 7f3c1be00640 1 --2- 172.21.15.50:0/388352791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1c108f60 0x7f3c1c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.863+0000 7f3c1be00640 1 --2- 172.21.15.50:0/388352791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c1c1047e0 0x7f3c1c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.863+0000 7f3c1be00640 1 --2- 172.21.15.50:0/388352791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c1c103e30 0x7f3c1c104210 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.863+0000 7f3c1be00640 1 -- 172.21.15.50:0/388352791 >> 172.21.15.50:0/388352791 conn(0x7f3c1c0ff910 msgr2=0x7f3c1c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.863+0000 7f3c1be00640 1 -- 172.21.15.50:0/388352791 shutdown_connections 2024-09-10T10:15:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.863+0000 7f3c1be00640 1 -- 172.21.15.50:0/388352791 wait complete. 2024-09-10T10:15:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.864+0000 7f3c1be00640 1 Processor -- start 2024-09-10T10:15:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.864+0000 7f3c1be00640 1 -- start start 2024-09-10T10:15:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.864+0000 7f3c1be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c1c103e30 0x7f3c1c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.864+0000 7f3c1be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c1c1047e0 0x7f3c1c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.864+0000 7f3c1be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1c108f60 0x7f3c1c19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.864+0000 7f3c1be00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c113fd0 con 0x7f3c1c103e30 2024-09-10T10:15:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.864+0000 7f3c1be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c113e50 con 0x7f3c1c108f60 2024-09-10T10:15:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.864+0000 7f3c1be00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c114150 con 0x7f3c1c1047e0 2024-09-10T10:15:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.865+0000 7f3c1aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c1c103e30 0x7f3c1c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.865+0000 7f3c1aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c1c103e30 0x7f3c1c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48502/0 (socket says 172.21.15.50:48502) 2024-09-10T10:15:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.865+0000 7f3c1aa00640 1 -- 172.21.15.50:0/3600044705 learned_addr learned my addr 172.21.15.50:0/3600044705 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.865+0000 7f3c1b400640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1c108f60 0x7f3c1c19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.865+0000 7f3c1a000640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c1c1047e0 0x7f3c1c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.865+0000 7f3c1aa00640 1 -- 172.21.15.50:0/3600044705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c1c1047e0 msgr2=0x7f3c1c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.865+0000 7f3c1aa00640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c1c1047e0 0x7f3c1c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.865+0000 7f3c1aa00640 1 -- 172.21.15.50:0/3600044705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1c108f60 msgr2=0x7f3c1c19ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.865+0000 7f3c1aa00640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1c108f60 0x7f3c1c19ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.865+0000 7f3c1aa00640 1 -- 172.21.15.50:0/3600044705 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c19f460 con 0x7f3c1c103e30 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.865+0000 7f3c1aa00640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c1c103e30 0x7f3c1c19a4b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c004770 tx=0x7f3c0c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.866+0000 7f3c13400640 1 -- 172.21.15.50:0/3600044705 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c03f070 con 0x7f3c1c103e30 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.866+0000 7f3c1be00640 1 -- 172.21.15.50:0/3600044705 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1c19f6f0 con 0x7f3c1c103e30 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.866+0000 7f3c13400640 1 -- 172.21.15.50:0/3600044705 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c0c031ca0 con 0x7f3c1c103e30 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.866+0000 7f3c13400640 1 -- 172.21.15.50:0/3600044705 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c035030 con 0x7f3c1c103e30 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.866+0000 7f3c1be00640 1 -- 172.21.15.50:0/3600044705 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1c1a7030 con 0x7f3c1c103e30 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.869+0000 7f3c13400640 1 -- 172.21.15.50:0/3600044705 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3c0c042070 con 0x7f3c1c103e30 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.871+0000 7f3c23f22740 1 Processor -- start 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.871+0000 7f3c23f22740 1 -- start start 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.871+0000 7f3c13400640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3c000a2b80 0x7f3c000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.871+0000 7f3c13400640 1 -- 172.21.15.50:0/3600044705 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f3c0c0efaa0 con 0x7f3c1c103e30 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.871+0000 7f3c23f22740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d70520 0x563a78d70900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.871+0000 7f3c23f22740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d70e40 0x563a78d7b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.871+0000 7f3c23f22740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d7b700 0x563a78d7daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.871+0000 7f3c23f22740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563a78cd6650 con 0x563a78d70e40 2024-09-10T10:15:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.871+0000 7f3c23f22740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563a78c7df10 con 0x563a78d7b700 2024-09-10T10:15:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.871+0000 7f3c23f22740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563a78cd2610 con 0x563a78d70520 2024-09-10T10:15:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.872+0000 7f3c1a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d70e40 0x563a78d7b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.872+0000 7f3c1a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d70e40 0x563a78d7b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48516/0 (socket says 172.21.15.50:48516) 2024-09-10T10:15:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.872+0000 7f3c1a000640 1 -- 172.21.15.50:0/661252146 learned_addr learned my addr 172.21.15.50:0/661252146 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.873+0000 7f3c1aa00640 1 --2- 172.21.15.50:0/661252146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d70520 0x563a78d70900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.873+0000 7f3c1b400640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3c000a2b80 0x7f3c000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.873+0000 7f3c1a000640 1 -- 172.21.15.50:0/661252146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d70520 msgr2=0x563a78d70900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.873+0000 7f3c1a000640 1 --2- 172.21.15.50:0/661252146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d70520 0x563a78d70900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.873+0000 7f3c1a000640 1 -- 172.21.15.50:0/661252146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d7b700 msgr2=0x563a78d7daf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:15:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.873+0000 7f3c1a000640 1 --2- 172.21.15.50:0/661252146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d7b700 0x563a78d7daf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.873+0000 7f3c1a000640 1 -- 172.21.15.50:0/661252146 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a789e5580 con 0x563a78d70e40 2024-09-10T10:15:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.873+0000 7f3c1a000640 1 --2- 172.21.15.50:0/661252146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d70e40 0x563a78d7b1c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009c90 tx=0x7f3c08011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36503c0bc1ec3a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.873+0000 7f3c1b400640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3c000a2b80 0x7f3c000a5040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x563a78d6de30 tx=0x7f3c140096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.873+0000 7f3c07e00640 1 -- 172.21.15.50:0/661252146 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0801e070 con 0x563a78d70e40 2024-09-10T10:15:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.874+0000 7f3c07e00640 1 -- 172.21.15.50:0/661252146 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c08019b10 con 0x563a78d70e40 2024-09-10T10:15:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.874+0000 7f3c07e00640 1 -- 172.21.15.50:0/661252146 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0800eba0 con 0x563a78d70e40 2024-09-10T10:15:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.874+0000 7f3c23f22740 1 -- 172.21.15.50:0/661252146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d70e40 msgr2=0x563a78d7b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.874+0000 7f3c23f22740 1 --2- 172.21.15.50:0/661252146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d70e40 0x563a78d7b1c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009c90 tx=0x7f3c08011810 comp rx=0 tx=0).stop 2024-09-10T10:15:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.874+0000 7f3c23f22740 1 -- 172.21.15.50:0/661252146 shutdown_connections 2024-09-10T10:15:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.874+0000 7f3c23f22740 1 --2- 172.21.15.50:0/661252146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d7b700 0x563a78d7daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.874+0000 7f3c23f22740 1 --2- 172.21.15.50:0/661252146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d70e40 0x563a78d7b1c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.874+0000 7f3c23f22740 1 --2- 172.21.15.50:0/661252146 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d70520 0x563a78d70900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.874+0000 7f3c23f22740 1 -- 172.21.15.50:0/661252146 >> 172.21.15.50:0/661252146 conn(0x563a78d6cab0 msgr2=0x563a78d6ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.875+0000 7f3c23f22740 1 -- 172.21.15.50:0/661252146 shutdown_connections 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.875+0000 7f3c23f22740 1 -- 172.21.15.50:0/661252146 wait complete. 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.875+0000 7f3c23f22740 1 -- start start 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.875+0000 7f3c23f22740 1 Processor -- start 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.876+0000 7f3c23f22740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d70520 0x563a78d78680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.876+0000 7f3c23f22740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d70e40 0x563a78d78bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.876+0000 7f3c23f22740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d7b700 0x563a78d79100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.876+0000 7f3c23f22740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563a78d7e2d0 con 0x563a78d70520 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.876+0000 7f3c23f22740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563a78c91350 con 0x563a78d70e40 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.876+0000 7f3c23f22740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563a78d7e450 con 0x563a78d7b700 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.876+0000 7f3c23f22740 10 client.0 _ll_register_callbacks cb 0x563a78cb4290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.876+0000 7f3c1aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d70520 0x563a78d78680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.876+0000 7f3c1b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d7b700 0x563a78d79100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.876+0000 7f3c1b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d7b700 0x563a78d79100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:35004/0 (socket says 172.21.15.50:35004) 2024-09-10T10:15:35.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.876+0000 7f3c1b400640 1 -- 172.21.15.50:0/3261659606 learned_addr learned my addr 172.21.15.50:0/3261659606 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.876+0000 7f3c1a000640 1 --2- 172.21.15.50:0/3261659606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d70e40 0x563a78d78bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.877+0000 7f3c1aa00640 1 -- 172.21.15.50:0/3261659606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d7b700 msgr2=0x563a78d79100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.877+0000 7f3c1aa00640 1 --2- 172.21.15.50:0/3261659606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d7b700 0x563a78d79100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.877+0000 7f3c1aa00640 1 -- 172.21.15.50:0/3261659606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d70e40 msgr2=0x563a78d78bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.877+0000 7f3c1aa00640 1 --2- 172.21.15.50:0/3261659606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d70e40 0x563a78d78bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.877+0000 7f3c1aa00640 1 -- 172.21.15.50:0/3261659606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a78aaf960 con 0x563a78d70520 2024-09-10T10:15:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.877+0000 7f3c1aa00640 1 --2- 172.21.15.50:0/3261659606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d70520 0x563a78d78680 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0ed1e0 tx=0x7f3c0c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d162cfda171160a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.877+0000 7f3c04c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:15:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.878+0000 7f3c04c00640 1 -- 172.21.15.50:0/3261659606 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c0d6020 con 0x563a78d70520 2024-09-10T10:15:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.878+0000 7f3c04c00640 1 -- 172.21.15.50:0/3261659606 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f3c0c0b8690 con 0x563a78d70520 2024-09-10T10:15:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.878+0000 7f3c23f22740 1 -- 172.21.15.50:0/3261659606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c08019b10 con 0x563a78d70520 2024-09-10T10:15:35.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.878+0000 7f3c04c00640 1 -- 172.21.15.50:0/3261659606 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3c0c049040 con 0x563a78d70520 2024-09-10T10:15:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.878+0000 7f3c23f22740 10 client.16182 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.878+0000 7f3c23f22740 1 -- 172.21.15.50:0/3261659606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563a78d89f80 con 0x563a78d70520 2024-09-10T10:15:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.878+0000 7f3c04c00640 1 -- 172.21.15.50:0/3261659606 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c08019b10 con 0x563a78d70520 2024-09-10T10:15:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.878+0000 7f3c04c00640 1 -- 172.21.15.50:0/3261659606 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3c0c0c4750 con 0x563a78d70520 2024-09-10T10:15:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.879+0000 7f3c23f22740 10 client.16182 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.879+0000 7f3c23f22740 10 client.16182 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:15:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.879+0000 7f3c23f22740 20 client.16182 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.879+0000 7f3c23f22740 1 --2- 172.21.15.50:0/3261659606 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a78d8b1f0 0x563a78d8d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.879+0000 7f3c23f22740 4 client.16182 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:15:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.879+0000 7f3c23f22740 1 -- 172.21.15.50:0/3261659606 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a78ce3bc0 con 0x563a78d8b1f0 2024-09-10T10:15:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.879+0000 7f3c1a000640 1 --2- 172.21.15.50:0/3261659606 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a78d8b1f0 0x563a78d8d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.882+0000 7f3c1a000640 1 --2- 172.21.15.50:0/3261659606 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a78d8b1f0 0x563a78d8d620 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70382204a9a3de27 server_cookie=e82969cb4d1f35f4 in_seq=0 out_seq=0 2024-09-10T10:15:35.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.884+0000 7f3c04c00640 10 client.16182 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.884+0000 7f3c04c00640 1 -- 172.21.15.50:0/3261659606 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a78ce3bc0 con 0x563a78d8b1f0 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.884+0000 7f3c04c00640 10 client.16182 handle_command_reply: tid=0 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.884+0000 7f3c23f22740 1 client.16182 shutdown 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.884+0000 7f3c23f22740 1 -- 172.21.15.50:0/3261659606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d70520 msgr2=0x563a78d78680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.884+0000 7f3c23f22740 1 --2- 172.21.15.50:0/3261659606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d70520 0x563a78d78680 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0ed1e0 tx=0x7f3c0c005d50 comp rx=0 tx=0).stop 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.884+0000 7f3c23f22740 1 -- 172.21.15.50:0/3261659606 shutdown_connections 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.884+0000 7f3c23f22740 1 --2- 172.21.15.50:0/3261659606 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a78d8b1f0 0x563a78d8d620 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.884+0000 7f3c23f22740 1 --2- 172.21.15.50:0/3261659606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d7b700 0x563a78d79100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.884+0000 7f3c23f22740 1 --2- 172.21.15.50:0/3261659606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d70e40 0x563a78d78bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.884+0000 7f3c23f22740 1 --2- 172.21.15.50:0/3261659606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d70520 0x563a78d78680 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.884+0000 7f3c23f22740 1 -- 172.21.15.50:0/3261659606 >> 172.21.15.50:0/3261659606 conn(0x563a78d6cab0 msgr2=0x563a78d6bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.885+0000 7f3c04c00640 0 client.16182 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.887+0000 7f3c23f22740 1 -- 172.21.15.50:0/3261659606 shutdown_connections 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.887+0000 7f3c23f22740 1 -- 172.21.15.50:0/3261659606 wait complete. 2024-09-10T10:15:35.135 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.888+0000 7f3c23f22740 20 client.16182 trim_cache size 0 max 16384 2024-09-10T10:15:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.909+0000 7f3c23f22740 1 Processor -- start 2024-09-10T10:15:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.909+0000 7f3c23f22740 1 -- start start 2024-09-10T10:15:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.909+0000 7f3c23f22740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d70e40 0x563a78d92f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.909+0000 7f3c23f22740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d7b700 0x563a78d93440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.909+0000 7f3c23f22740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d758e0 0x563a78d75d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.909+0000 7f3c23f22740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1b3600 con 0x563a78d7b700 2024-09-10T10:15:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.909+0000 7f3c23f22740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1b0ed0 con 0x563a78d70e40 2024-09-10T10:15:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.909+0000 7f3c23f22740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1aed20 con 0x563a78d758e0 2024-09-10T10:15:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.910+0000 7f3c1a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d7b700 0x563a78d93440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.910+0000 7f3c1a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d7b700 0x563a78d93440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48532/0 (socket says 172.21.15.50:48532) 2024-09-10T10:15:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.910+0000 7f3c1a000640 1 -- 172.21.15.50:0/939121564 learned_addr learned my addr 172.21.15.50:0/939121564 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.910+0000 7f3c1aa00640 1 --2- 172.21.15.50:0/939121564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d70e40 0x563a78d92f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.910+0000 7f3c1b400640 1 --2- 172.21.15.50:0/939121564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d758e0 0x563a78d75d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.910+0000 7f3c1a000640 1 -- 172.21.15.50:0/939121564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d758e0 msgr2=0x563a78d75d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.910+0000 7f3c1a000640 1 --2- 172.21.15.50:0/939121564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d758e0 0x563a78d75d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.910+0000 7f3c1a000640 1 -- 172.21.15.50:0/939121564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d70e40 msgr2=0x563a78d92f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.910+0000 7f3c1a000640 1 --2- 172.21.15.50:0/939121564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d70e40 0x563a78d92f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.910+0000 7f3c1a000640 1 -- 172.21.15.50:0/939121564 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a78d716c0 con 0x563a78d7b700 2024-09-10T10:15:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.910+0000 7f3c1b400640 1 --2- 172.21.15.50:0/939121564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d758e0 0x563a78d75d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:15:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.911+0000 7f3c1a000640 1 --2- 172.21.15.50:0/939121564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d7b700 0x563a78d93440 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009230 tx=0x7f3c0800e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75585f7a24a1f78 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.911+0000 7f3c07400640 1 -- 172.21.15.50:0/939121564 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0801e040 con 0x563a78d7b700 2024-09-10T10:15:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.911+0000 7f3c07400640 1 -- 172.21.15.50:0/939121564 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c0801f040 con 0x563a78d7b700 2024-09-10T10:15:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.911+0000 7f3c07400640 1 -- 172.21.15.50:0/939121564 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0800eea0 con 0x563a78d7b700 2024-09-10T10:15:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.912+0000 7f3c23f22740 1 -- 172.21.15.50:0/939121564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d7b700 msgr2=0x563a78d93440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.912+0000 7f3c23f22740 1 --2- 172.21.15.50:0/939121564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d7b700 0x563a78d93440 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009230 tx=0x7f3c0800e7c0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.912+0000 7f3c23f22740 1 -- 172.21.15.50:0/939121564 shutdown_connections 2024-09-10T10:15:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.912+0000 7f3c23f22740 1 --2- 172.21.15.50:0/939121564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d758e0 0x563a78d75d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.912+0000 7f3c23f22740 1 --2- 172.21.15.50:0/939121564 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d7b700 0x563a78d93440 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.912+0000 7f3c23f22740 1 --2- 172.21.15.50:0/939121564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d70e40 0x563a78d92f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.912+0000 7f3c23f22740 1 -- 172.21.15.50:0/939121564 >> 172.21.15.50:0/939121564 conn(0x563a78d6cab0 msgr2=0x563a78d6bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.912+0000 7f3c23f22740 1 -- 172.21.15.50:0/939121564 shutdown_connections 2024-09-10T10:15:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.912+0000 7f3c23f22740 1 -- 172.21.15.50:0/939121564 wait complete. 2024-09-10T10:15:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.913+0000 7f3c23f22740 1 -- start start 2024-09-10T10:15:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.913+0000 7f3c23f22740 1 Processor -- start 2024-09-10T10:15:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.914+0000 7f3c23f22740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d70e40 0x563a78d83b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.914+0000 7f3c23f22740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d758e0 0x563a78d80670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.914+0000 7f3c23f22740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d7b700 0x563a78d80bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.914+0000 7f3c23f22740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1af390 con 0x563a78d758e0 2024-09-10T10:15:35.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.914+0000 7f3c23f22740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1b0800 con 0x563a78d7b700 2024-09-10T10:15:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.914+0000 7f3c23f22740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1afa60 con 0x563a78d70e40 2024-09-10T10:15:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.914+0000 7f3c23f22740 10 client.0 _ll_register_callbacks cb 0x7f3c0c031e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.914+0000 7f3c1b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d7b700 0x563a78d80bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.914+0000 7f3c1b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d7b700 0x563a78d80bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:39436/0 (socket says 172.21.15.50:39436) 2024-09-10T10:15:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.914+0000 7f3c1b400640 1 -- 172.21.15.50:0/3558995162 learned_addr learned my addr 172.21.15.50:0/3558995162 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.914+0000 7f3c1aa00640 1 --2- 172.21.15.50:0/3558995162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d70e40 0x563a78d83b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.915+0000 7f3c1b400640 1 -- 172.21.15.50:0/3558995162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d70e40 msgr2=0x563a78d83b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.915+0000 7f3c1b400640 1 --2- 172.21.15.50:0/3558995162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d70e40 0x563a78d83b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.915+0000 7f3c1b400640 1 -- 172.21.15.50:0/3558995162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d758e0 msgr2=0x563a78d80670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:15:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.915+0000 7f3c1b400640 1 --2- 172.21.15.50:0/3558995162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d758e0 0x563a78d80670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.915+0000 7f3c1b400640 1 -- 172.21.15.50:0/3558995162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a78d81140 con 0x563a78d7b700 2024-09-10T10:15:35.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.916+0000 7f3c1b400640 1 --2- 172.21.15.50:0/3558995162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d7b700 0x563a78d80bb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3c14020920 tx=0x7f3c14004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb3fb22858d0468 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.916+0000 7f3c04c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:15:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.916+0000 7f3c04c00640 1 -- 172.21.15.50:0/3558995162 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14011d50 con 0x563a78d7b700 2024-09-10T10:15:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.916+0000 7f3c04c00640 1 -- 172.21.15.50:0/3558995162 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f3c1401e450 con 0x563a78d7b700 2024-09-10T10:15:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.916+0000 7f3c23f22740 1 -- 172.21.15.50:0/3558995162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c0801f040 con 0x563a78d7b700 2024-09-10T10:15:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.917+0000 7f3c04c00640 1 -- 172.21.15.50:0/3558995162 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3c1401e650 con 0x563a78d7b700 2024-09-10T10:15:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.917+0000 7f3c23f22740 10 client.26258 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.917+0000 7f3c23f22740 1 -- 172.21.15.50:0/3558995162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563a78df6ce0 con 0x563a78d7b700 2024-09-10T10:15:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.917+0000 7f3c04c00640 1 -- 172.21.15.50:0/3558995162 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c0801f040 con 0x563a78d7b700 2024-09-10T10:15:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.917+0000 7f3c04c00640 1 -- 172.21.15.50:0/3558995162 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3c14027070 con 0x563a78d7b700 2024-09-10T10:15:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.917+0000 7f3c23f22740 10 client.26258 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.917+0000 7f3c23f22740 10 client.26258 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:15:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.917+0000 7f3c23f22740 20 client.26258 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:35.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.917+0000 7f3c23f22740 1 --2- 172.21.15.50:0/3558995162 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a78df74e0 0x563a78df9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.918+0000 7f3c23f22740 4 client.26258 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b7012dd8", "release": true, "await": true}] 2024-09-10T10:15:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.918+0000 7f3c23f22740 1 -- 172.21.15.50:0/3558995162 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b7012dd8", "release": true, "await": true}) -- 0x563a78cde0d0 con 0x563a78df74e0 2024-09-10T10:15:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.918+0000 7f3c1aa00640 1 --2- 172.21.15.50:0/3558995162 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a78df74e0 0x563a78df9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.918+0000 7f3c04c00640 10 client.26258 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.919+0000 7f3c1aa00640 1 --2- 172.21.15.50:0/3558995162 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a78df74e0 0x563a78df9900 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4906ac97867b755 server_cookie=21aa7bcff8a39e4f in_seq=0 out_seq=0 2024-09-10T10:15:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.921+0000 7f3c04c00640 1 -- 172.21.15.50:0/3558995162 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563a78cde0d0 con 0x563a78df74e0 2024-09-10T10:15:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.921+0000 7f3c04c00640 10 client.26258 handle_command_reply: tid=0 2024-09-10T10:15:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.921+0000 7f3c23f22740 1 client.26258 shutdown 2024-09-10T10:15:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.921+0000 7f3c23f22740 1 -- 172.21.15.50:0/3558995162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d7b700 msgr2=0x563a78d80bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.921+0000 7f3c23f22740 1 --2- 172.21.15.50:0/3558995162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d7b700 0x563a78d80bb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3c14020920 tx=0x7f3c14004ab0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.921+0000 7f3c23f22740 1 -- 172.21.15.50:0/3558995162 shutdown_connections 2024-09-10T10:15:35.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.921+0000 7f3c23f22740 1 --2- 172.21.15.50:0/3558995162 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563a78df74e0 0x563a78df9900 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.921+0000 7f3c23f22740 1 --2- 172.21.15.50:0/3558995162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a78d7b700 0x563a78d80bb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.921+0000 7f3c23f22740 1 --2- 172.21.15.50:0/3558995162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a78d758e0 0x563a78d80670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.921+0000 7f3c23f22740 1 --2- 172.21.15.50:0/3558995162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563a78d70e40 0x563a78d83b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.921+0000 7f3c04c00640 0 client.26258 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.921+0000 7f3c23f22740 1 -- 172.21.15.50:0/3558995162 >> 172.21.15.50:0/3558995162 conn(0x563a78d6cab0 msgr2=0x563a78d6bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.922+0000 7f3c23f22740 1 -- 172.21.15.50:0/3558995162 shutdown_connections 2024-09-10T10:15:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.922+0000 7f3c23f22740 1 -- 172.21.15.50:0/3558995162 wait complete. 2024-09-10T10:15:35.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.922+0000 7f3c23f22740 20 client.26258 trim_cache size 0 max 16384 2024-09-10T10:15:35.142 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:15:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 25, 2024-09-10T10:15:35.142 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24560, 2024-09-10T10:15:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 12, 2024-09-10T10:15:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-09-10T10:15:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "b7012dd8": { 2024-09-10T10:15:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 12, 2024-09-10T10:15:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-09-10T10:15:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:15:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-09-10T10:15:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:15:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:15:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-09-10T10:15:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 142.8, 2024-09-10T10:15:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-09-10T10:15:35.143 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-09-10T10:15:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-09-10T10:15:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:15:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-09-10T10:15:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:15:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:35.144 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:35.144 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:15:35.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.923+0000 7f3c1be00640 1 -- 172.21.15.50:0/3600044705 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3c000a2b80 msgr2=0x7f3c000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.923+0000 7f3c1be00640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3c000a2b80 0x7f3c000a5040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x563a78d6de30 tx=0x7f3c140096a0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.923+0000 7f3c1be00640 1 -- 172.21.15.50:0/3600044705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c1c103e30 msgr2=0x7f3c1c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.923+0000 7f3c1be00640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c1c103e30 0x7f3c1c19a4b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c004770 tx=0x7f3c0c003c10 comp rx=0 tx=0).stop 2024-09-10T10:15:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.923+0000 7f3c1be00640 1 -- 172.21.15.50:0/3600044705 shutdown_connections 2024-09-10T10:15:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.923+0000 7f3c1be00640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3c000a2b80 0x7f3c000a5040 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.923+0000 7f3c1be00640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1c108f60 0x7f3c1c19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.923+0000 7f3c1be00640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c1c1047e0 0x7f3c1c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.923+0000 7f3c1be00640 1 --2- 172.21.15.50:0/3600044705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c1c103e30 0x7f3c1c19a4b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.923+0000 7f3c1be00640 1 -- 172.21.15.50:0/3600044705 >> 172.21.15.50:0/3600044705 conn(0x7f3c1c0ff910 msgr2=0x7f3c1c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.923+0000 7f3c1be00640 1 -- 172.21.15.50:0/3600044705 shutdown_connections 2024-09-10T10:15:35.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:34.923+0000 7f3c1be00640 1 -- 172.21.15.50:0/3600044705 wait complete. 2024-09-10T10:15:35.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:35 smithi050 ceph-mon[30354]: scrub queued for path: / 2024-09-10T10:15:35.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:35 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:15:35.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:35 smithi050 ceph-mon[30354]: scrub summary: active paths [/] 2024-09-10T10:15:35.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:35 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:15:35.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:35 smithi084 ceph-mon[34812]: scrub queued for path: / 2024-09-10T10:15:35.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:35 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:15:35.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:35 smithi084 ceph-mon[34812]: scrub summary: active paths [/] 2024-09-10T10:15:35.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:35 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:15:35.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:15:35.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:35 smithi189 ceph-mon[34999]: scrub queued for path: / 2024-09-10T10:15:35.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:35 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:15:35.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:35 smithi189 ceph-mon[34999]: scrub summary: active paths [/] 2024-09-10T10:15:35.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:35 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:15:36.052 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b7012dd8', total seconds elapsed: 29.5 2024-09-10T10:15:36.052 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.75 2024-09-10T10:15:36.053 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:15:36.261 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:36.339 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:36 smithi050 ceph-mon[30354]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 276 MiB/s rd, 34 MiB/s wr, 83 op/s 2024-09-10T10:15:36.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:36 smithi084 ceph-mon[34812]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 276 MiB/s rd, 34 MiB/s wr, 83 op/s 2024-09-10T10:15:36.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:36 smithi189 ceph-mon[34999]: pgmap v523: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 276 MiB/s rd, 34 MiB/s wr, 83 op/s 2024-09-10T10:15:36.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.958+0000 7f1ea9a00640 1 -- 172.21.15.50:0/2295106934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ea4077040 msgr2=0x7f1ea4112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:36.960 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.958+0000 7f1ea9a00640 1 --2- 172.21.15.50:0/2295106934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ea4077040 0x7f1ea4112510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009860 tx=0x7f1e9002a360 comp rx=0 tx=0).stop 2024-09-10T10:15:36.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.958+0000 7f1ea9a00640 1 -- 172.21.15.50:0/2295106934 shutdown_connections 2024-09-10T10:15:36.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.958+0000 7f1ea9a00640 1 --2- 172.21.15.50:0/2295106934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea4112a50 0x7f1ea4114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.958+0000 7f1ea9a00640 1 --2- 172.21.15.50:0/2295106934 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ea4077040 0x7f1ea4112510 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.958+0000 7f1ea9a00640 1 --2- 172.21.15.50:0/2295106934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea4076720 0x7f1ea4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.958+0000 7f1ea9a00640 1 -- 172.21.15.50:0/2295106934 >> 172.21.15.50:0/2295106934 conn(0x7f1ea40ffa50 msgr2=0x7f1ea4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:36.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.959+0000 7f1ea9a00640 1 -- 172.21.15.50:0/2295106934 shutdown_connections 2024-09-10T10:15:36.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.960+0000 7f1ea9a00640 1 -- 172.21.15.50:0/2295106934 wait complete. 2024-09-10T10:15:36.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.961+0000 7f1ea9a00640 1 Processor -- start 2024-09-10T10:15:36.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.964+0000 7f1ea9a00640 1 -- start start 2024-09-10T10:15:36.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.965+0000 7f1ea9a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea4076720 0x7f1ea41a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:36.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.965+0000 7f1ea9a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea4077040 0x7f1ea41a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:36.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.966+0000 7f1ea9a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ea4112a50 0x7f1ea419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:36.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.966+0000 7f1ea9a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41185c0 con 0x7f1ea4076720 2024-09-10T10:15:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.966+0000 7f1ea9a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4118440 con 0x7f1ea4077040 2024-09-10T10:15:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.966+0000 7f1ea9a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4118740 con 0x7f1ea4112a50 2024-09-10T10:15:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.966+0000 7f1ea2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea4076720 0x7f1ea41a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.966+0000 7f1ea2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea4076720 0x7f1ea41a4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43328/0 (socket says 172.21.15.50:43328) 2024-09-10T10:15:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.966+0000 7f1ea2a00640 1 -- 172.21.15.50:0/150987205 learned_addr learned my addr 172.21.15.50:0/150987205 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.966+0000 7f1ea3400640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ea4112a50 0x7f1ea419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:36.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.966+0000 7f1ea2000640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea4077040 0x7f1ea41a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:36.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.967+0000 7f1ea2000640 1 -- 172.21.15.50:0/150987205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ea4112a50 msgr2=0x7f1ea419e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:36.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.967+0000 7f1ea2000640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ea4112a50 0x7f1ea419e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.967+0000 7f1ea2000640 1 -- 172.21.15.50:0/150987205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea4076720 msgr2=0x7f1ea41a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:36.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.967+0000 7f1ea2000640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea4076720 0x7f1ea41a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.967+0000 7f1ea2000640 1 -- 172.21.15.50:0/150987205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea419f020 con 0x7f1ea4077040 2024-09-10T10:15:36.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.968+0000 7f1ea2000640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea4077040 0x7f1ea41a4c70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e90035040 tx=0x7f1e90032810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:36.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.968+0000 7f1e9b400640 1 -- 172.21.15.50:0/150987205 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e90037040 con 0x7f1ea4077040 2024-09-10T10:15:36.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.968+0000 7f1ea9a00640 1 -- 172.21.15.50:0/150987205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea419f2b0 con 0x7f1ea4077040 2024-09-10T10:15:36.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.968+0000 7f1e9b400640 1 -- 172.21.15.50:0/150987205 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e90033ca0 con 0x7f1ea4077040 2024-09-10T10:15:36.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.968+0000 7f1e9b400640 1 -- 172.21.15.50:0/150987205 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e900052b0 con 0x7f1ea4077040 2024-09-10T10:15:36.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.968+0000 7f1ea9a00640 1 -- 172.21.15.50:0/150987205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea41ab600 con 0x7f1ea4077040 2024-09-10T10:15:36.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.973+0000 7f1eac468740 1 Processor -- start 2024-09-10T10:15:36.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.973+0000 7f1e9b400640 1 -- 172.21.15.50:0/150987205 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1e90042020 con 0x7f1ea4077040 2024-09-10T10:15:36.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.973+0000 7f1eac468740 1 -- start start 2024-09-10T10:15:36.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.974+0000 7f1eac468740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc76483b90 0x55cc76483f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:36.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.974+0000 7f1eac468740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc764844b0 0x55cc7648e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:36.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.974+0000 7f1eac468740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc76491160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:36.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.974+0000 7f1eac468740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cc763ea3e0 con 0x55cc7648ed70 2024-09-10T10:15:36.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.974+0000 7f1eac468740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc76391d80 con 0x55cc76483b90 2024-09-10T10:15:36.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.974+0000 7f1eac468740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cc763e63a0 con 0x55cc764844b0 2024-09-10T10:15:36.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.974+0000 7f1ea3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc76483b90 0x55cc76483f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:36.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.974+0000 7f1ea3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc76483b90 0x55cc76483f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:43258/0 (socket says 172.21.15.50:43258) 2024-09-10T10:15:36.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.974+0000 7f1ea3400640 1 -- 172.21.15.50:0/2582668465 learned_addr learned my addr 172.21.15.50:0/2582668465 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:36.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.975+0000 7f1ea2a00640 1 --2- 172.21.15.50:0/2582668465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc764844b0 0x55cc7648e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:36.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.975+0000 7f1ea3400640 1 -- 172.21.15.50:0/2582668465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc764844b0 msgr2=0x55cc7648e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.975+0000 7f1ea3400640 1 --2- 172.21.15.50:0/2582668465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc764844b0 0x55cc7648e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.975+0000 7f1ea3400640 1 -- 172.21.15.50:0/2582668465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 msgr2=0x55cc76491160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:15:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.975+0000 7f1ea3400640 1 --2- 172.21.15.50:0/2582668465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc76491160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.975+0000 7f1e9b400640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e880a2c00 0x7f1e880a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.975+0000 7f1ea3400640 1 -- 172.21.15.50:0/2582668465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc763b0ae0 con 0x55cc76483b90 2024-09-10T10:15:36.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.975+0000 7f1e9b400640 1 -- 172.21.15.50:0/150987205 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f1e900ee980 con 0x7f1ea4077040 2024-09-10T10:15:36.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.976+0000 7f1ea3400640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e880a2c00 0x7f1e880a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:36.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.977+0000 7f1ea3400640 1 --2- 172.21.15.50:0/2582668465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc76483b90 0x55cc76483f70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009e00 tx=0x7f1e9c010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34e31df781fd0997 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:36.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.978+0000 7f1e8fe00640 1 -- 172.21.15.50:0/2582668465 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c022070 con 0x55cc76483b90 2024-09-10T10:15:36.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.978+0000 7f1e8fe00640 1 -- 172.21.15.50:0/2582668465 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e9c012c10 con 0x55cc76483b90 2024-09-10T10:15:36.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.978+0000 7f1e8fe00640 1 -- 172.21.15.50:0/2582668465 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c018030 con 0x55cc76483b90 2024-09-10T10:15:36.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.979+0000 7f1eac468740 1 -- 172.21.15.50:0/2582668465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc76483b90 msgr2=0x55cc76483f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:36.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.979+0000 7f1eac468740 1 --2- 172.21.15.50:0/2582668465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc76483b90 0x55cc76483f70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009e00 tx=0x7f1e9c010740 comp rx=0 tx=0).stop 2024-09-10T10:15:36.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.982+0000 7f1eac468740 1 -- 172.21.15.50:0/2582668465 shutdown_connections 2024-09-10T10:15:36.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.982+0000 7f1eac468740 1 --2- 172.21.15.50:0/2582668465 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc76491160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.982+0000 7f1eac468740 1 --2- 172.21.15.50:0/2582668465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc764844b0 0x55cc7648e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.982+0000 7f1eac468740 1 --2- 172.21.15.50:0/2582668465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc76483b90 0x55cc76483f70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.982+0000 7f1eac468740 1 -- 172.21.15.50:0/2582668465 >> 172.21.15.50:0/2582668465 conn(0x55cc76480120 msgr2=0x55cc76480500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:36.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.982+0000 7f1ea3400640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e880a2c00 0x7f1e880a50c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c01f000 tx=0x7f1e9c022000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:36.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.983+0000 7f1eac468740 1 -- 172.21.15.50:0/2582668465 shutdown_connections 2024-09-10T10:15:36.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.983+0000 7f1eac468740 1 -- 172.21.15.50:0/2582668465 wait complete. 2024-09-10T10:15:36.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.983+0000 7f1eac468740 1 -- start start 2024-09-10T10:15:36.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.984+0000 7f1eac468740 1 Processor -- start 2024-09-10T10:15:36.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.984+0000 7f1eac468740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc76483b90 0x55cc7648bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:36.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.984+0000 7f1eac468740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc764844b0 0x55cc7648c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:36.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.984+0000 7f1eac468740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc7648ed70 0x55cc7648c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:36.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.984+0000 7f1eac468740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cc764919e0 con 0x55cc76483b90 2024-09-10T10:15:36.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.984+0000 7f1eac468740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cc763a50f0 con 0x55cc764844b0 2024-09-10T10:15:36.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.984+0000 7f1eac468740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cc76491b60 con 0x55cc7648ed70 2024-09-10T10:15:36.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.984+0000 7f1eac468740 10 client.0 _ll_register_callbacks cb 0x55cc763969e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:36.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.985+0000 7f1ea2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc76483b90 0x55cc7648bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:36.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.985+0000 7f1ea2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc76483b90 0x55cc7648bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43334/0 (socket says 172.21.15.50:43334) 2024-09-10T10:15:36.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.985+0000 7f1ea2a00640 1 -- 172.21.15.50:0/3332922607 learned_addr learned my addr 172.21.15.50:0/3332922607 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:36.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.985+0000 7f1ea3400640 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc7648ed70 0x55cc7648c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:36.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.985+0000 7f1ea2000640 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc764844b0 0x55cc7648c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:36.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.986+0000 7f1ea2a00640 1 -- 172.21.15.50:0/3332922607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc7648ed70 msgr2=0x55cc7648c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:36.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.986+0000 7f1ea2a00640 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc7648ed70 0x55cc7648c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.986+0000 7f1ea2a00640 1 -- 172.21.15.50:0/3332922607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc764844b0 msgr2=0x55cc7648c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:36.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.986+0000 7f1ea2a00640 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc764844b0 0x55cc7648c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.986+0000 7f1ea2a00640 1 -- 172.21.15.50:0/3332922607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc7615b3c0 con 0x55cc76483b90 2024-09-10T10:15:36.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.986+0000 7f1ea3400640 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc7648ed70 0x55cc7648c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.986+0000 7f1ea2a00640 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc76483b90 0x55cc7648bcd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400bf00 tx=0x7f1e940117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadeb89cfcdd87d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.986+0000 7f1e8cc00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:15:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.986+0000 7f1e8cc00640 1 -- 172.21.15.50:0/3332922607 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94004230 con 0x55cc76483b90 2024-09-10T10:15:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.986+0000 7f1e8cc00640 1 -- 172.21.15.50:0/3332922607 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f1e940043d0 con 0x55cc76483b90 2024-09-10T10:15:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.986+0000 7f1eac468740 1 -- 172.21.15.50:0/3332922607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e9c012c10 con 0x55cc76483b90 2024-09-10T10:15:36.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.987+0000 7f1e8cc00640 1 -- 172.21.15.50:0/3332922607 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1e94024050 con 0x55cc76483b90 2024-09-10T10:15:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.987+0000 7f1eac468740 10 client.16194 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.987+0000 7f1eac468740 1 -- 172.21.15.50:0/3332922607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc7649d770 con 0x55cc76483b90 2024-09-10T10:15:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.987+0000 7f1e8cc00640 1 -- 172.21.15.50:0/3332922607 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e9c012c10 con 0x55cc76483b90 2024-09-10T10:15:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.988+0000 7f1e8cc00640 1 -- 172.21.15.50:0/3332922607 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f1e9401b8e0 con 0x55cc76483b90 2024-09-10T10:15:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.988+0000 7f1eac468740 10 client.16194 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.988+0000 7f1eac468740 10 client.16194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:15:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.988+0000 7f1eac468740 20 client.16194 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.988+0000 7f1eac468740 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cc7649ec30 0x55cc764a1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:36.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.988+0000 7f1eac468740 4 client.16194 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:15:36.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.988+0000 7f1eac468740 1 -- 172.21.15.50:0/3332922607 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc763f7950 con 0x55cc7649ec30 2024-09-10T10:15:36.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.990+0000 7f1ea2000640 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cc7649ec30 0x55cc764a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:36.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.991+0000 7f1ea2000640 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cc7649ec30 0x55cc764a1020 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64cef4868af53207 server_cookie=a02eb5c734881205 in_seq=0 out_seq=0 2024-09-10T10:15:36.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.991+0000 7f1e8cc00640 10 client.16194 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:36.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.992+0000 7f1e8cc00640 1 -- 172.21.15.50:0/3332922607 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc763f7950 con 0x55cc7649ec30 2024-09-10T10:15:36.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.992+0000 7f1e8cc00640 10 client.16194 handle_command_reply: tid=0 2024-09-10T10:15:36.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.992+0000 7f1eac468740 1 client.16194 shutdown 2024-09-10T10:15:36.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.992+0000 7f1eac468740 1 -- 172.21.15.50:0/3332922607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc76483b90 msgr2=0x55cc7648bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:36.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.992+0000 7f1eac468740 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc76483b90 0x55cc7648bcd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400bf00 tx=0x7f1e940117b0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.992+0000 7f1eac468740 1 -- 172.21.15.50:0/3332922607 shutdown_connections 2024-09-10T10:15:36.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.992+0000 7f1eac468740 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cc7649ec30 0x55cc764a1020 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.992+0000 7f1eac468740 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc7648ed70 0x55cc7648c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.992+0000 7f1eac468740 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc764844b0 0x55cc7648c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.992+0000 7f1eac468740 1 --2- 172.21.15.50:0/3332922607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc76483b90 0x55cc7648bcd0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.992+0000 7f1eac468740 1 -- 172.21.15.50:0/3332922607 >> 172.21.15.50:0/3332922607 conn(0x55cc76480120 msgr2=0x55cc76485e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.992+0000 7f1e8cc00640 0 client.16194 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.993+0000 7f1eac468740 1 -- 172.21.15.50:0/3332922607 shutdown_connections 2024-09-10T10:15:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.993+0000 7f1eac468740 1 -- 172.21.15.50:0/3332922607 wait complete. 2024-09-10T10:15:36.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:36.993+0000 7f1eac468740 20 client.16194 trim_cache size 0 max 16384 2024-09-10T10:15:36.996 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:37.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.015+0000 7f1eac468740 1 Processor -- start 2024-09-10T10:15:37.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.015+0000 7f1eac468740 1 -- start start 2024-09-10T10:15:37.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.016+0000 7f1eac468740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc76483b90 0x55cc76480730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:37.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.016+0000 7f1eac468740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc764844b0 0x55cc76485d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:37.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.016+0000 7f1eac468740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc764a68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:37.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.016+0000 7f1eac468740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41b7bf0 con 0x55cc7648ed70 2024-09-10T10:15:37.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.016+0000 7f1eac468740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41b54c0 con 0x55cc76483b90 2024-09-10T10:15:37.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.016+0000 7f1eac468740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41b3310 con 0x55cc764844b0 2024-09-10T10:15:37.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.016+0000 7f1ea3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc764a68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:37.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.016+0000 7f1ea2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc76483b90 0x55cc76480730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:37.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.016+0000 7f1ea2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc76483b90 0x55cc76480730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:43282/0 (socket says 172.21.15.50:43282) 2024-09-10T10:15:37.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.016+0000 7f1ea3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc764a68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43340/0 (socket says 172.21.15.50:43340) 2024-09-10T10:15:37.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.016+0000 7f1ea2a00640 1 -- 172.21.15.50:0/2199254873 learned_addr learned my addr 172.21.15.50:0/2199254873 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:37.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.016+0000 7f1ea2000640 1 --2- 172.21.15.50:0/2199254873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc764844b0 0x55cc76485d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:37.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.017+0000 7f1ea2000640 1 -- 172.21.15.50:0/2199254873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc76483b90 msgr2=0x55cc76480730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:37.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.017+0000 7f1ea2000640 1 --2- 172.21.15.50:0/2199254873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc76483b90 0x55cc76480730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.017+0000 7f1ea2000640 1 -- 172.21.15.50:0/2199254873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 msgr2=0x55cc764a68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:37.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.017+0000 7f1ea2000640 1 --2- 172.21.15.50:0/2199254873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc764a68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.017+0000 7f1ea2000640 1 -- 172.21.15.50:0/2199254873 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc7648ac80 con 0x55cc764844b0 2024-09-10T10:15:37.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.017+0000 7f1ea3400640 1 --2- 172.21.15.50:0/2199254873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc764a68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:37.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.017+0000 7f1ea2000640 1 --2- 172.21.15.50:0/2199254873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc764844b0 0x55cc76485d40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55cc764814a0 tx=0x7f1e90030850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3460870a89492b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:37.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.017+0000 7f1e8f400640 1 -- 172.21.15.50:0/2199254873 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e900bf1a0 con 0x55cc764844b0 2024-09-10T10:15:37.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.017+0000 7f1e8f400640 1 -- 172.21.15.50:0/2199254873 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e900c3a60 con 0x55cc764844b0 2024-09-10T10:15:37.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.017+0000 7f1e8f400640 1 -- 172.21.15.50:0/2199254873 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e900b7460 con 0x55cc764844b0 2024-09-10T10:15:37.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.018+0000 7f1eac468740 1 -- 172.21.15.50:0/2199254873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc764844b0 msgr2=0x55cc76485d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:37.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.018+0000 7f1eac468740 1 --2- 172.21.15.50:0/2199254873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc764844b0 0x55cc76485d40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55cc764814a0 tx=0x7f1e90030850 comp rx=0 tx=0).stop 2024-09-10T10:15:37.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.018+0000 7f1eac468740 1 -- 172.21.15.50:0/2199254873 shutdown_connections 2024-09-10T10:15:37.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.018+0000 7f1eac468740 1 --2- 172.21.15.50:0/2199254873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc764a68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.018+0000 7f1eac468740 1 --2- 172.21.15.50:0/2199254873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc764844b0 0x55cc76485d40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.018+0000 7f1eac468740 1 --2- 172.21.15.50:0/2199254873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc76483b90 0x55cc76480730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.018+0000 7f1eac468740 1 -- 172.21.15.50:0/2199254873 >> 172.21.15.50:0/2199254873 conn(0x55cc76480120 msgr2=0x55cc76485630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.018+0000 7f1eac468740 1 -- 172.21.15.50:0/2199254873 shutdown_connections 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.019+0000 7f1eac468740 1 -- 172.21.15.50:0/2199254873 wait complete. 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.019+0000 7f1eac468740 1 -- start start 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.019+0000 7f1eac468740 1 Processor -- start 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.019+0000 7f1eac468740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc76483b90 0x55cc76497090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.019+0000 7f1eac468740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc764844b0 0x55cc764975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.020+0000 7f1eac468740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc76488710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.020+0000 7f1eac468740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41b3980 con 0x55cc7648ed70 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.020+0000 7f1eac468740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41b4df0 con 0x55cc764844b0 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.020+0000 7f1eac468740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41b4050 con 0x55cc76483b90 2024-09-10T10:15:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.020+0000 7f1eac468740 10 client.0 _ll_register_callbacks cb 0x7f1e9400bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:37.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.020+0000 7f1ea2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc764844b0 0x55cc764975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:37.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.020+0000 7f1ea2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc764844b0 0x55cc764975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:43290/0 (socket says 172.21.15.50:43290) 2024-09-10T10:15:37.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.020+0000 7f1ea2000640 1 -- 172.21.15.50:0/3415579915 learned_addr learned my addr 172.21.15.50:0/3415579915 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:37.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.020+0000 7f1ea3400640 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc76488710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:37.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.020+0000 7f1ea2a00640 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc76483b90 0x55cc76497090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:37.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.021+0000 7f1ea2a00640 1 -- 172.21.15.50:0/3415579915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc764844b0 msgr2=0x55cc764975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:37.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.021+0000 7f1ea2a00640 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc764844b0 0x55cc764975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.021+0000 7f1ea2a00640 1 -- 172.21.15.50:0/3415579915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 msgr2=0x55cc76488710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:37.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.021+0000 7f1ea2a00640 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc76488710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.021+0000 7f1ea2a00640 1 -- 172.21.15.50:0/3415579915 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc76488ee0 con 0x55cc76483b90 2024-09-10T10:15:37.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.021+0000 7f1ea3400640 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc76488710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:37.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.022+0000 7f1ea2a00640 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc76483b90 0x55cc76497090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1e9401bea0 tx=0x7f1e94005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfd9eb831885828f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:37.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.022+0000 7f1e8cc00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:15:37.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.022+0000 7f1e8cc00640 1 -- 172.21.15.50:0/3415579915 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94021040 con 0x55cc76483b90 2024-09-10T10:15:37.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.023+0000 7f1e8cc00640 1 -- 172.21.15.50:0/3415579915 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f1e9401b670 con 0x55cc76483b90 2024-09-10T10:15:37.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.023+0000 7f1eac468740 1 -- 172.21.15.50:0/3415579915 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e900c3a60 con 0x55cc76483b90 2024-09-10T10:15:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.023+0000 7f1e8cc00640 1 -- 172.21.15.50:0/3415579915 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1e94011cb0 con 0x55cc76483b90 2024-09-10T10:15:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.023+0000 7f1eac468740 10 client.26278 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.023+0000 7f1eac468740 1 -- 172.21.15.50:0/3415579915 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc76509490 con 0x55cc76483b90 2024-09-10T10:15:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.023+0000 7f1e8cc00640 1 -- 172.21.15.50:0/3415579915 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e900c3a60 con 0x55cc76483b90 2024-09-10T10:15:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.024+0000 7f1e8cc00640 1 -- 172.21.15.50:0/3415579915 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f1e94030020 con 0x55cc76483b90 2024-09-10T10:15:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.024+0000 7f1eac468740 10 client.26278 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.024+0000 7f1eac468740 10 client.26278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:15:37.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.024+0000 7f1eac468740 20 client.26278 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.024+0000 7f1eac468740 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cc76509b50 0x55cc7650bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.024+0000 7f1eac468740 4 client.26278 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:15:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.024+0000 7f1eac468740 1 -- 172.21.15.50:0/3415579915 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc763f1e60 con 0x55cc76509b50 2024-09-10T10:15:37.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.025+0000 7f1ea2000640 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cc76509b50 0x55cc7650bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.026+0000 7f1ea2000640 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cc76509b50 0x55cc7650bf70 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2bfdb8f58d2aa86 server_cookie=b6e2607cb4d2a3eb in_seq=0 out_seq=0 2024-09-10T10:15:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.026+0000 7f1e8cc00640 10 client.26278 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.026+0000 7f1e8cc00640 1 -- 172.21.15.50:0/3415579915 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55cc763f1e60 con 0x55cc76509b50 2024-09-10T10:15:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.026+0000 7f1e8cc00640 10 client.26278 handle_command_reply: tid=0 2024-09-10T10:15:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.026+0000 7f1eac468740 1 client.26278 shutdown 2024-09-10T10:15:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.026+0000 7f1eac468740 1 -- 172.21.15.50:0/3415579915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc76483b90 msgr2=0x55cc76497090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.026+0000 7f1eac468740 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc76483b90 0x55cc76497090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1e9401bea0 tx=0x7f1e94005270 comp rx=0 tx=0).stop 2024-09-10T10:15:37.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.027+0000 7f1eac468740 1 -- 172.21.15.50:0/3415579915 shutdown_connections 2024-09-10T10:15:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.027+0000 7f1eac468740 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cc76509b50 0x55cc7650bf70 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.027+0000 7f1e8cc00640 0 client.26278 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.027+0000 7f1eac468740 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cc7648ed70 0x55cc76488710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.027+0000 7f1eac468740 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cc764844b0 0x55cc764975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.027+0000 7f1eac468740 1 --2- 172.21.15.50:0/3415579915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cc76483b90 0x55cc76497090 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.027+0000 7f1eac468740 1 -- 172.21.15.50:0/3415579915 >> 172.21.15.50:0/3415579915 conn(0x55cc76480120 msgr2=0x55cc7648c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.027+0000 7f1eac468740 1 -- 172.21.15.50:0/3415579915 shutdown_connections 2024-09-10T10:15:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.027+0000 7f1eac468740 1 -- 172.21.15.50:0/3415579915 wait complete. 2024-09-10T10:15:37.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.028+0000 7f1eac468740 20 client.26278 trim_cache size 0 max 16384 2024-09-10T10:15:37.030 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:15:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T10:15:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": { 2024-09-10T10:15:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "9c362160-5e76-476f-97c7-9e19bf921444": { 2024-09-10T10:15:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/", 2024-09-10T10:15:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tag": "9c362160-5e76-476f-97c7-9e19bf921444", 2024-09-10T10:15:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "options": "recursive,force" 2024-09-10T10:15:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:37.031 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:15:37.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.030+0000 7f1ea9a00640 1 -- 172.21.15.50:0/150987205 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e880a2c00 msgr2=0x7f1e880a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:37.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.030+0000 7f1ea9a00640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e880a2c00 0x7f1e880a50c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c01f000 tx=0x7f1e9c022000 comp rx=0 tx=0).stop 2024-09-10T10:15:37.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.030+0000 7f1ea9a00640 1 -- 172.21.15.50:0/150987205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea4077040 msgr2=0x7f1ea41a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:37.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.030+0000 7f1ea9a00640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea4077040 0x7f1ea41a4c70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e90035040 tx=0x7f1e90032810 comp rx=0 tx=0).stop 2024-09-10T10:15:37.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.032+0000 7f1ea9a00640 1 -- 172.21.15.50:0/150987205 shutdown_connections 2024-09-10T10:15:37.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.032+0000 7f1ea9a00640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e880a2c00 0x7f1e880a50c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.032+0000 7f1ea9a00640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1ea4112a50 0x7f1ea419e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.032+0000 7f1ea9a00640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea4077040 0x7f1ea41a4c70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.032+0000 7f1ea9a00640 1 --2- 172.21.15.50:0/150987205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ea4076720 0x7f1ea41a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:37.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.032+0000 7f1ea9a00640 1 -- 172.21.15.50:0/150987205 >> 172.21.15.50:0/150987205 conn(0x7f1ea40ffa50 msgr2=0x7f1ea4101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:37.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.033+0000 7f1ea9a00640 1 -- 172.21.15.50:0/150987205 shutdown_connections 2024-09-10T10:15:37.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:37.033+0000 7f1ea9a00640 1 -- 172.21.15.50:0/150987205 wait complete. 2024-09-10T10:15:38.368 INFO:tasks.cephfs.filesystem:scrub status for tag:9c362160-5e76-476f-97c7-9e19bf921444 - {'path': '/', 'tag': '9c362160-5e76-476f-97c7-9e19bf921444', 'options': 'recursive,force'} 2024-09-10T10:15:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.026+0000 7f8cfce00640 1 -- 172.21.15.50:0/3955076639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cf8102790 msgr2=0x7f8cf81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.026+0000 7f8cfce00640 1 --2- 172.21.15.50:0/3955076639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cf8102790 0x7f8cf81067e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009860 tx=0x7f8ce002a340 comp rx=0 tx=0).stop 2024-09-10T10:15:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.026+0000 7f8cfce00640 1 -- 172.21.15.50:0/3955076639 shutdown_connections 2024-09-10T10:15:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.026+0000 7f8cfce00640 1 --2- 172.21.15.50:0/3955076639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cf8106f10 0x7f8cf810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.026+0000 7f8cfce00640 1 --2- 172.21.15.50:0/3955076639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cf8102790 0x7f8cf81067e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.026+0000 7f8cfce00640 1 --2- 172.21.15.50:0/3955076639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cf8101de0 0x7f8cf81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.026+0000 7f8cfce00640 1 -- 172.21.15.50:0/3955076639 >> 172.21.15.50:0/3955076639 conn(0x7f8cf80fd8c0 msgr2=0x7f8cf80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.027+0000 7f8cfce00640 1 -- 172.21.15.50:0/3955076639 shutdown_connections 2024-09-10T10:15:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.027+0000 7f8cfce00640 1 -- 172.21.15.50:0/3955076639 wait complete. 2024-09-10T10:15:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.028+0000 7f8cfce00640 1 Processor -- start 2024-09-10T10:15:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.028+0000 7f8cfce00640 1 -- start start 2024-09-10T10:15:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.028+0000 7f8cfce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cf8101de0 0x7f8cf819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.028+0000 7f8cfce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cf8102790 0x7f8cf819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.028+0000 7f8cfce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cf8106f10 0x7f8cf819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.028+0000 7f8cfce00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8111f90 con 0x7f8cf8102790 2024-09-10T10:15:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.028+0000 7f8cfce00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8111e10 con 0x7f8cf8101de0 2024-09-10T10:15:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.028+0000 7f8cfce00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8112110 con 0x7f8cf8106f10 2024-09-10T10:15:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.029+0000 7f8cefe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cf8102790 0x7f8cf819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:38.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.029+0000 7f8cefe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cf8102790 0x7f8cf819ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43368/0 (socket says 172.21.15.50:43368) 2024-09-10T10:15:38.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.029+0000 7f8cefe00640 1 -- 172.21.15.50:0/204489484 learned_addr learned my addr 172.21.15.50:0/204489484 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:38.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.029+0000 7f8cf6800640 1 --2- 172.21.15.50:0/204489484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cf8106f10 0x7f8cf819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:38.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.029+0000 7f8cefe00640 1 -- 172.21.15.50:0/204489484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cf8106f10 msgr2=0x7f8cf819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:38.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.029+0000 7f8cefe00640 1 --2- 172.21.15.50:0/204489484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cf8106f10 0x7f8cf819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.029+0000 7f8cefe00640 1 -- 172.21.15.50:0/204489484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cf8101de0 msgr2=0x7f8cf819a730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T10:15:38.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.029+0000 7f8cefe00640 1 --2- 172.21.15.50:0/204489484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cf8101de0 0x7f8cf819a730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.029+0000 7f8cefe00640 1 -- 172.21.15.50:0/204489484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf819f6e0 con 0x7f8cf8102790 2024-09-10T10:15:38.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.030+0000 7f8cefe00640 1 --2- 172.21.15.50:0/204489484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cf8102790 0x7f8cf819ac70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0035040 tx=0x7f8ce0033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:38.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.030+0000 7f8ceea00640 1 -- 172.21.15.50:0/204489484 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce003f020 con 0x7f8cf8102790 2024-09-10T10:15:38.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.030+0000 7f8ceea00640 1 -- 172.21.15.50:0/204489484 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ce0004240 con 0x7f8cf8102790 2024-09-10T10:15:38.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.030+0000 7f8cfce00640 1 -- 172.21.15.50:0/204489484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf819f970 con 0x7f8cf8102790 2024-09-10T10:15:38.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.030+0000 7f8cfce00640 1 -- 172.21.15.50:0/204489484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf81a72b0 con 0x7f8cf8102790 2024-09-10T10:15:38.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.030+0000 7f8ceea00640 1 -- 172.21.15.50:0/204489484 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0037040 con 0x7f8cf8102790 2024-09-10T10:15:38.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.032+0000 7f8cfce00640 1 -- 172.21.15.50:0/204489484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf81021c0 con 0x7f8cf8102790 2024-09-10T10:15:38.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.035+0000 7f8ceea00640 1 -- 172.21.15.50:0/204489484 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8ce0042020 con 0x7f8cf8102790 2024-09-10T10:15:38.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.036+0000 7f8ceea00640 1 --2- 172.21.15.50:0/204489484 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8cdc0a2b80 0x7f8cdc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:15:38.528 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:15:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.036+0000 7f8ceea00640 1 -- 172.21.15.50:0/204489484 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f8ce00ef320 con 0x7f8cf8102790 2024-09-10T10:15:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.037+0000 7f8cf5e00640 1 --2- 172.21.15.50:0/204489484 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8cdc0a2b80 0x7f8cdc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.037+0000 7f8cf5e00640 1 --2- 172.21.15.50:0/204489484 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8cdc0a2b80 0x7f8cdc0a5040 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80096c0 tx=0x7f8ce8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.042+0000 7f8ceea00640 1 -- 172.21.15.50:0/204489484 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ce0049030 con 0x7f8cf8102790 2024-09-10T10:15:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.341+0000 7f8cfce00640 1 -- 172.21.15.50:0/204489484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cf81a7480 con 0x7f8cf8102790 2024-09-10T10:15:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.344+0000 7f8ceea00640 1 -- 172.21.15.50:0/204489484 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f8ce00bbe90 con 0x7f8cf8102790 2024-09-10T10:15:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:15:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.347+0000 7f8cfce00640 1 -- 172.21.15.50:0/204489484 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8cdc0a2b80 msgr2=0x7f8cdc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.347+0000 7f8cfce00640 1 --2- 172.21.15.50:0/204489484 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8cdc0a2b80 0x7f8cdc0a5040 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80096c0 tx=0x7f8ce8009260 comp rx=0 tx=0).stop 2024-09-10T10:15:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.347+0000 7f8cfce00640 1 -- 172.21.15.50:0/204489484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cf8102790 msgr2=0x7f8cf819ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.347+0000 7f8cfce00640 1 --2- 172.21.15.50:0/204489484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cf8102790 0x7f8cf819ac70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0035040 tx=0x7f8ce0033d90 comp rx=0 tx=0).stop 2024-09-10T10:15:38.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.348+0000 7f8cfce00640 1 -- 172.21.15.50:0/204489484 shutdown_connections 2024-09-10T10:15:38.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.348+0000 7f8cfce00640 1 --2- 172.21.15.50:0/204489484 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f8cdc0a2b80 0x7f8cdc0a5040 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.348+0000 7f8cfce00640 1 --2- 172.21.15.50:0/204489484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8cf8106f10 0x7f8cf819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.348+0000 7f8cfce00640 1 --2- 172.21.15.50:0/204489484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cf8102790 0x7f8cf819ac70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.348+0000 7f8cfce00640 1 --2- 172.21.15.50:0/204489484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cf8101de0 0x7f8cf819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:38.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.348+0000 7f8cfce00640 1 -- 172.21.15.50:0/204489484 >> 172.21.15.50:0/204489484 conn(0x7f8cf80fd8c0 msgr2=0x7f8cf80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:38.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.348+0000 7f8cfce00640 1 -- 172.21.15.50:0/204489484 shutdown_connections 2024-09-10T10:15:38.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:38.348+0000 7f8cfce00640 1 -- 172.21.15.50:0/204489484 wait complete. 2024-09-10T10:15:38.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:38 smithi084 ceph-mon[34812]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 354 MiB/s rd, 8.3 MiB/s wr, 98 op/s 2024-09-10T10:15:38.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:38 smithi050 ceph-mon[30354]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 354 MiB/s rd, 8.3 MiB/s wr, 98 op/s 2024-09-10T10:15:38.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:38 smithi189 ceph-mon[34999]: pgmap v524: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 354 MiB/s rd, 8.3 MiB/s wr, 98 op/s 2024-09-10T10:15:39.268 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 142.75 --await-for 45.0' 2024-09-10T10:15:39.268 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 142.75 --await-for 45.0 2024-09-10T10:15:39.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:39 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/204489484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:39.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:39 smithi050 ceph-mon[30354]: scrub summary: idle 2024-09-10T10:15:39.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:39 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/204489484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:39.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:39 smithi084 ceph-mon[34812]: scrub summary: idle 2024-09-10T10:15:39.787 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:15:39.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:39 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/204489484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:15:39.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:39 smithi189 ceph-mon[34999]: scrub summary: idle 2024-09-10T10:15:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.489+0000 7f4163c00640 1 -- 172.21.15.50:0/1321833839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c1049a0 msgr2=0x7f415c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.489+0000 7f4163c00640 1 --2- 172.21.15.50:0/1321833839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c1049a0 0x7f415c1089f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4148009900 tx=0x7f414802a410 comp rx=0 tx=0).stop 2024-09-10T10:15:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.489+0000 7f4163c00640 1 -- 172.21.15.50:0/1321833839 shutdown_connections 2024-09-10T10:15:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.489+0000 7f4163c00640 1 --2- 172.21.15.50:0/1321833839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f415c109120 0x7f415c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.489+0000 7f4163c00640 1 --2- 172.21.15.50:0/1321833839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c1049a0 0x7f415c1089f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.489+0000 7f4163c00640 1 --2- 172.21.15.50:0/1321833839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f415c103ff0 0x7f415c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.489+0000 7f4163c00640 1 -- 172.21.15.50:0/1321833839 >> 172.21.15.50:0/1321833839 conn(0x7f415c0ffab0 msgr2=0x7f415c101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.489+0000 7f4163c00640 1 -- 172.21.15.50:0/1321833839 shutdown_connections 2024-09-10T10:15:40.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.489+0000 7f4163c00640 1 -- 172.21.15.50:0/1321833839 wait complete. 2024-09-10T10:15:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.491+0000 7f4163c00640 1 Processor -- start 2024-09-10T10:15:40.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.491+0000 7f4163c00640 1 -- start start 2024-09-10T10:15:40.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.491+0000 7f4163c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f415c103ff0 0x7f415c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.491+0000 7f4163c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f415c1049a0 0x7f415c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.491+0000 7f4163c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c109120 0x7f415c19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.491+0000 7f4163c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f415c114120 con 0x7f415c109120 2024-09-10T10:15:40.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.491+0000 7f4163c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f415c113fa0 con 0x7f415c1049a0 2024-09-10T10:15:40.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.491+0000 7f4163c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f415c1142a0 con 0x7f415c103ff0 2024-09-10T10:15:40.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.492+0000 7f4161200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f415c103ff0 0x7f415c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.492+0000 7f4161200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f415c103ff0 0x7f415c19a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:55814/0 (socket says 172.21.15.50:55814) 2024-09-10T10:15:40.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.492+0000 7f4161200640 1 -- 172.21.15.50:0/11692580 learned_addr learned my addr 172.21.15.50:0/11692580 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:40.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.492+0000 7f415be00640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f415c1049a0 0x7f415c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.492+0000 7f4161c00640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c109120 0x7f415c19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.492+0000 7f4161200640 1 -- 172.21.15.50:0/11692580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f415c1049a0 msgr2=0x7f415c19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:40.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.492+0000 7f4161200640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f415c1049a0 0x7f415c19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.492+0000 7f4161200640 1 -- 172.21.15.50:0/11692580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c109120 msgr2=0x7f415c19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:40.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.492+0000 7f4161200640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c109120 0x7f415c19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.492+0000 7f4161200640 1 -- 172.21.15.50:0/11692580 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f415c19f650 con 0x7f415c103ff0 2024-09-10T10:15:40.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.492+0000 7f415be00640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f415c1049a0 0x7f415c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:15:40.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.493+0000 7f4161200640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f415c103ff0 0x7f415c19a6a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f414c00ebc0 tx=0x7f414c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:40.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.493+0000 7f4159600640 1 -- 172.21.15.50:0/11692580 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414c010630 con 0x7f415c103ff0 2024-09-10T10:15:40.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.494+0000 7f4159600640 1 -- 172.21.15.50:0/11692580 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f414c010cb0 con 0x7f415c103ff0 2024-09-10T10:15:40.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.494+0000 7f4159600640 1 -- 172.21.15.50:0/11692580 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414c018bd0 con 0x7f415c103ff0 2024-09-10T10:15:40.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.494+0000 7f4163c00640 1 -- 172.21.15.50:0/11692580 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f415c19f940 con 0x7f415c103ff0 2024-09-10T10:15:40.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.494+0000 7f4163c00640 1 -- 172.21.15.50:0/11692580 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f415c1a7220 con 0x7f415c103ff0 2024-09-10T10:15:40.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.499+0000 7f41665e1740 1 Processor -- start 2024-09-10T10:15:40.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.499+0000 7f41665e1740 1 -- start start 2024-09-10T10:15:40.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.499+0000 7f41665e1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7400 0x55f5545e77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.500+0000 7f41665e1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545e7d20 0x55f5545fa990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.500+0000 7f41665e1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545faed0 0x55f5545fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.500+0000 7f41665e1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f55454c260 con 0x55f5545faed0 2024-09-10T10:15:40.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.500+0000 7f41665e1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f5544f3500 con 0x55f5545e7400 2024-09-10T10:15:40.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.500+0000 7f41665e1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f554548220 con 0x55f5545e7d20 2024-09-10T10:15:40.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.501+0000 7f4159600640 1 -- 172.21.15.50:0/11692580 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f414c0107d0 con 0x7f415c103ff0 2024-09-10T10:15:40.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.502+0000 7f415be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545faed0 0x55f5545fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.502+0000 7f4161c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7400 0x55f5545e77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.502+0000 7f4161c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7400 0x55f5545e77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:43348/0 (socket says 172.21.15.50:43348) 2024-09-10T10:15:40.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.502+0000 7f4161c00640 1 -- 172.21.15.50:0/3783066247 learned_addr learned my addr 172.21.15.50:0/3783066247 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:40.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.502+0000 7f4161c00640 1 -- 172.21.15.50:0/3783066247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545e7d20 msgr2=0x55f5545fa990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:15:40.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.502+0000 7f4161c00640 1 --2- 172.21.15.50:0/3783066247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545e7d20 0x55f5545fa990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.502+0000 7f4161c00640 1 -- 172.21.15.50:0/3783066247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545faed0 msgr2=0x55f5545fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:40.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.502+0000 7f4161c00640 1 --2- 172.21.15.50:0/3783066247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545faed0 0x55f5545fd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.502+0000 7f4161c00640 1 -- 172.21.15.50:0/3783066247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5542bdba0 con 0x55f5545e7400 2024-09-10T10:15:40.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.503+0000 7f4161c00640 1 --2- 172.21.15.50:0/3783066247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7400 0x55f5545e77e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4154009b90 tx=0x7f41540117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34679d58ab787e22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:40.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.503+0000 7f4152000640 1 -- 172.21.15.50:0/3783066247 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154012450 con 0x55f5545e7400 2024-09-10T10:15:40.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.503+0000 7f4152000640 1 -- 172.21.15.50:0/3783066247 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4154012ad0 con 0x55f5545e7400 2024-09-10T10:15:40.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.503+0000 7f4152000640 1 -- 172.21.15.50:0/3783066247 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415400fab0 con 0x55f5545e7400 2024-09-10T10:15:40.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.503+0000 7f4159600640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f41400a2c80 0x7f41400a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.504+0000 7f4159600640 1 -- 172.21.15.50:0/11692580 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f414c0cfa80 con 0x7f415c103ff0 2024-09-10T10:15:40.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.504+0000 7f41665e1740 1 -- 172.21.15.50:0/3783066247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7400 msgr2=0x55f5545e77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:40.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.504+0000 7f41665e1740 1 --2- 172.21.15.50:0/3783066247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7400 0x55f5545e77e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4154009b90 tx=0x7f41540117b0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.504+0000 7f41665e1740 1 -- 172.21.15.50:0/3783066247 shutdown_connections 2024-09-10T10:15:40.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.504+0000 7f4161200640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f41400a2c80 0x7f41400a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.504+0000 7f41665e1740 1 --2- 172.21.15.50:0/3783066247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545faed0 0x55f5545fd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.504+0000 7f41665e1740 1 --2- 172.21.15.50:0/3783066247 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545e7d20 0x55f5545fa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.505+0000 7f41665e1740 1 --2- 172.21.15.50:0/3783066247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7400 0x55f5545e77e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.505+0000 7f41665e1740 1 -- 172.21.15.50:0/3783066247 >> 172.21.15.50:0/3783066247 conn(0x55f5545e3a70 msgr2=0x55f5545e3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:40.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.505+0000 7f4161200640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f41400a2c80 0x7f41400a5140 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f414c0988c0 tx=0x7f414c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:40.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.505+0000 7f41665e1740 1 -- 172.21.15.50:0/3783066247 shutdown_connections 2024-09-10T10:15:40.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.506+0000 7f41665e1740 1 -- 172.21.15.50:0/3783066247 wait complete. 2024-09-10T10:15:40.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.506+0000 7f41665e1740 1 -- start start 2024-09-10T10:15:40.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.507+0000 7f41665e1740 1 Processor -- start 2024-09-10T10:15:40.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.507+0000 7f41665e1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7400 0x55f5545f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.507+0000 7f41665e1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7d20 0x55f5545f8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.507+0000 7f41665e1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545faed0 0x55f5545f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.507+0000 7f41665e1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f5545fda40 con 0x55f5545e7400 2024-09-10T10:15:40.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.507+0000 7f41665e1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f554506bd0 con 0x55f5545e7d20 2024-09-10T10:15:40.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.507+0000 7f41665e1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f5545fdbc0 con 0x55f5545faed0 2024-09-10T10:15:40.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.507+0000 7f41665e1740 10 client.0 _ll_register_callbacks cb 0x55f55425b0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:40.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.508+0000 7f415be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7d20 0x55f5545f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.508+0000 7f4161c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7400 0x55f5545f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.508+0000 7f415be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7d20 0x55f5545f8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:43358/0 (socket says 172.21.15.50:43358) 2024-09-10T10:15:40.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.508+0000 7f415be00640 1 -- 172.21.15.50:0/4066339605 learned_addr learned my addr 172.21.15.50:0/4066339605 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:40.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.508+0000 7f415be00640 1 -- 172.21.15.50:0/4066339605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545faed0 msgr2=0x55f5545f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:40.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.508+0000 7f415be00640 1 --2- 172.21.15.50:0/4066339605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545faed0 0x55f5545f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.508+0000 7f415be00640 1 -- 172.21.15.50:0/4066339605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7400 msgr2=0x55f5545f7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:40.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.508+0000 7f415be00640 1 --2- 172.21.15.50:0/4066339605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7400 0x55f5545f7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.508+0000 7f415be00640 1 -- 172.21.15.50:0/4066339605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f554606f70 con 0x55f5545e7d20 2024-09-10T10:15:40.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.508+0000 7f415be00640 1 --2- 172.21.15.50:0/4066339605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7d20 0x55f5545f8360 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4148031850 tx=0x7f4148031880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6db64f7f0162b07e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:40.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.508+0000 7f4146a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:15:40.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.509+0000 7f4146a00640 1 -- 172.21.15.50:0/4066339605 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148035040 con 0x55f5545e7d20 2024-09-10T10:15:40.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.509+0000 7f4146a00640 1 -- 172.21.15.50:0/4066339605 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f4148004460 con 0x55f5545e7d20 2024-09-10T10:15:40.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.509+0000 7f41665e1740 1 -- 172.21.15.50:0/4066339605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4154012ad0 con 0x55f5545e7d20 2024-09-10T10:15:40.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.509+0000 7f4146a00640 1 -- 172.21.15.50:0/4066339605 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4148005020 con 0x55f5545e7d20 2024-09-10T10:15:40.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.510+0000 7f41665e1740 10 client.26291 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:40.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.510+0000 7f41665e1740 1 -- 172.21.15.50:0/4066339605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f554609900 con 0x55f5545e7d20 2024-09-10T10:15:40.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.510+0000 7f4146a00640 1 -- 172.21.15.50:0/4066339605 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f414804a020 con 0x55f5545e7d20 2024-09-10T10:15:40.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.510+0000 7f4146a00640 1 -- 172.21.15.50:0/4066339605 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f41480035f0 con 0x55f5545e7d20 2024-09-10T10:15:40.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.510+0000 7f41665e1740 10 client.26291 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:40.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.510+0000 7f41665e1740 10 client.26291 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:15:40.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.510+0000 7f41665e1740 20 client.26291 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:40.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.510+0000 7f41665e1740 1 --2- 172.21.15.50:0/4066339605 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f55460adc0 0x55f55460d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.510+0000 7f41665e1740 4 client.26291 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:15:40.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.510+0000 7f41665e1740 1 -- 172.21.15.50:0/4066339605 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f554559990 con 0x55f55460adc0 2024-09-10T10:15:40.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.511+0000 7f4161c00640 1 --2- 172.21.15.50:0/4066339605 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f55460adc0 0x55f55460d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.511+0000 7f4146a00640 10 client.26291 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:40.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.512+0000 7f4161c00640 1 --2- 172.21.15.50:0/4066339605 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f55460adc0 0x55f55460d1d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98f927773739f780 server_cookie=521b056b8f9836b in_seq=0 out_seq=0 2024-09-10T10:15:40.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.513+0000 7f4146a00640 1 -- 172.21.15.50:0/4066339605 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f554559990 con 0x55f55460adc0 2024-09-10T10:15:40.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.513+0000 7f4146a00640 10 client.26291 handle_command_reply: tid=0 2024-09-10T10:15:40.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.513+0000 7f41665e1740 1 client.26291 shutdown 2024-09-10T10:15:40.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.513+0000 7f41665e1740 1 -- 172.21.15.50:0/4066339605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7d20 msgr2=0x55f5545f8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:40.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.513+0000 7f41665e1740 1 --2- 172.21.15.50:0/4066339605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7d20 0x55f5545f8360 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4148031850 tx=0x7f4148031880 comp rx=0 tx=0).stop 2024-09-10T10:15:40.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.513+0000 7f41665e1740 1 -- 172.21.15.50:0/4066339605 shutdown_connections 2024-09-10T10:15:40.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.513+0000 7f41665e1740 1 --2- 172.21.15.50:0/4066339605 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f55460adc0 0x55f55460d1d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.513+0000 7f41665e1740 1 --2- 172.21.15.50:0/4066339605 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545faed0 0x55f5545f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.513+0000 7f41665e1740 1 --2- 172.21.15.50:0/4066339605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7d20 0x55f5545f8360 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.513+0000 7f4146a00640 0 client.26291 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:40.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.513+0000 7f41665e1740 1 --2- 172.21.15.50:0/4066339605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7400 0x55f5545f7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.513+0000 7f41665e1740 1 -- 172.21.15.50:0/4066339605 >> 172.21.15.50:0/4066339605 conn(0x55f5545e3a70 msgr2=0x55f5545e2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:40.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.514+0000 7f41665e1740 1 -- 172.21.15.50:0/4066339605 shutdown_connections 2024-09-10T10:15:40.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.514+0000 7f41665e1740 1 -- 172.21.15.50:0/4066339605 wait complete. 2024-09-10T10:15:40.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.514+0000 7f41665e1740 20 client.26291 trim_cache size 0 max 16384 2024-09-10T10:15:40.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.535+0000 7f41665e1740 1 Processor -- start 2024-09-10T10:15:40.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.535+0000 7f41665e1740 1 -- start start 2024-09-10T10:15:40.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.536+0000 7f41665e1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7400 0x55f5545f9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.536+0000 7f41665e1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545e7d20 0x55f554612aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.536+0000 7f41665e1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545faed0 0x55f554612fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.536+0000 7f41665e1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f415c1af410 con 0x55f5545e7400 2024-09-10T10:15:40.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.536+0000 7f41665e1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f415c1acce0 con 0x55f5545faed0 2024-09-10T10:15:40.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.536+0000 7f41665e1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f415c1aab30 con 0x55f5545e7d20 2024-09-10T10:15:40.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.536+0000 7f415be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545e7d20 0x55f554612aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.536+0000 7f415be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545e7d20 0x55f554612aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:55846/0 (socket says 172.21.15.50:55846) 2024-09-10T10:15:40.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.536+0000 7f415be00640 1 -- 172.21.15.50:0/2316685178 learned_addr learned my addr 172.21.15.50:0/2316685178 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:40.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.536+0000 7f4161c00640 1 --2- 172.21.15.50:0/2316685178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545faed0 0x55f554612fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.536+0000 7f4161c00640 1 --2- 172.21.15.50:0/2316685178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7400 0x55f5545f9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.537+0000 7f415be00640 1 -- 172.21.15.50:0/2316685178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545faed0 msgr2=0x55f554612fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:40.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.537+0000 7f415be00640 1 --2- 172.21.15.50:0/2316685178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545faed0 0x55f554612fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.537+0000 7f415be00640 1 -- 172.21.15.50:0/2316685178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7400 msgr2=0x55f5545f9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:40.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.537+0000 7f415be00640 1 --2- 172.21.15.50:0/2316685178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7400 0x55f5545f9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.537+0000 7f415be00640 1 -- 172.21.15.50:0/2316685178 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5545e9ce0 con 0x55f5545e7d20 2024-09-10T10:15:40.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.537+0000 7f4161c00640 1 --2- 172.21.15.50:0/2316685178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545faed0 0x55f554612fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:15:40.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.538+0000 7f415be00640 1 --2- 172.21.15.50:0/2316685178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545e7d20 0x55f554612aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f414802a930 tx=0x7f414802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e00be202d830e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:40.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.538+0000 7f4151600640 1 -- 172.21.15.50:0/2316685178 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148035070 con 0x55f5545e7d20 2024-09-10T10:15:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.538+0000 7f4151600640 1 -- 172.21.15.50:0/2316685178 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f414804a070 con 0x55f5545e7d20 2024-09-10T10:15:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.538+0000 7f4151600640 1 -- 172.21.15.50:0/2316685178 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41480044c0 con 0x55f5545e7d20 2024-09-10T10:15:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.539+0000 7f41665e1740 1 -- 172.21.15.50:0/2316685178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545e7d20 msgr2=0x55f554612aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.539+0000 7f41665e1740 1 --2- 172.21.15.50:0/2316685178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545e7d20 0x55f554612aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f414802a930 tx=0x7f414802a410 comp rx=0 tx=0).stop 2024-09-10T10:15:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.539+0000 7f41665e1740 1 -- 172.21.15.50:0/2316685178 shutdown_connections 2024-09-10T10:15:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.539+0000 7f41665e1740 1 --2- 172.21.15.50:0/2316685178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545faed0 0x55f554612fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.539+0000 7f41665e1740 1 --2- 172.21.15.50:0/2316685178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545e7d20 0x55f554612aa0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.539+0000 7f41665e1740 1 --2- 172.21.15.50:0/2316685178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7400 0x55f5545f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.539+0000 7f41665e1740 1 -- 172.21.15.50:0/2316685178 >> 172.21.15.50:0/2316685178 conn(0x55f5545e3a70 msgr2=0x55f5545f9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.539+0000 7f41665e1740 1 -- 172.21.15.50:0/2316685178 shutdown_connections 2024-09-10T10:15:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.539+0000 7f41665e1740 1 -- 172.21.15.50:0/2316685178 wait complete. 2024-09-10T10:15:40.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.540+0000 7f41665e1740 1 -- start start 2024-09-10T10:15:40.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.540+0000 7f41665e1740 1 Processor -- start 2024-09-10T10:15:40.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.541+0000 7f41665e1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7400 0x55f5545ff360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.541+0000 7f41665e1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7d20 0x55f5545ff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.541+0000 7f41665e1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545faed0 0x55f554674a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.541+0000 7f41665e1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f415c1ab1a0 con 0x55f5545e7d20 2024-09-10T10:15:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.541+0000 7f41665e1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f415c1ac610 con 0x55f5545e7400 2024-09-10T10:15:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.541+0000 7f41665e1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f415c1ab870 con 0x55f5545faed0 2024-09-10T10:15:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.541+0000 7f41665e1740 10 client.0 _ll_register_callbacks cb 0x7f4148009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:15:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.541+0000 7f4161c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7400 0x55f5545ff360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.541+0000 7f4161c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545faed0 0x55f554674a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.541+0000 7f4161c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545faed0 0x55f554674a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:55854/0 (socket says 172.21.15.50:55854) 2024-09-10T10:15:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.541+0000 7f4161c00640 1 -- 172.21.15.50:0/3942645254 learned_addr learned my addr 172.21.15.50:0/3942645254 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:15:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.542+0000 7f415be00640 1 --2- 172.21.15.50:0/3942645254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7d20 0x55f5545ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.542+0000 7f4161c00640 1 -- 172.21.15.50:0/3942645254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545faed0 msgr2=0x55f554674a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.542+0000 7f4161c00640 1 --2- 172.21.15.50:0/3942645254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545faed0 0x55f554674a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.542+0000 7f4161c00640 1 -- 172.21.15.50:0/3942645254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7d20 msgr2=0x55f5545ff8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:15:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.542+0000 7f4161c00640 1 --2- 172.21.15.50:0/3942645254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7d20 0x55f5545ff8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.542+0000 7f4161c00640 1 -- 172.21.15.50:0/3942645254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f554674fb0 con 0x55f5545e7400 2024-09-10T10:15:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.542+0000 7f415be00640 1 --2- 172.21.15.50:0/3942645254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7d20 0x55f5545ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:15:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.542+0000 7f4161c00640 1 --2- 172.21.15.50:0/3942645254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7400 0x55f5545ff360 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f415401c040 tx=0x7f4154005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d63158cb2abc18e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:15:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.542+0000 7f4146a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:15:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.543+0000 7f4146a00640 1 -- 172.21.15.50:0/3942645254 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41540050b0 con 0x55f5545e7400 2024-09-10T10:15:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.543+0000 7f4146a00640 1 -- 172.21.15.50:0/3942645254 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f4154005250 con 0x55f5545e7400 2024-09-10T10:15:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.543+0000 7f41665e1740 1 -- 172.21.15.50:0/3942645254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f414804a070 con 0x55f5545e7400 2024-09-10T10:15:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.543+0000 7f4146a00640 1 -- 172.21.15.50:0/3942645254 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4154005450 con 0x55f5545e7400 2024-09-10T10:15:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.543+0000 7f41665e1740 10 client.26297 fetch_fsmap learned FSMap version 25 2024-09-10T10:15:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.543+0000 7f41665e1740 1 -- 172.21.15.50:0/3942645254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f554676290 con 0x55f5545e7400 2024-09-10T10:15:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.543+0000 7f4146a00640 1 -- 172.21.15.50:0/3942645254 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f414804a070 con 0x55f5545e7400 2024-09-10T10:15:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.543+0000 7f4146a00640 1 -- 172.21.15.50:0/3942645254 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f41540035f0 con 0x55f5545e7400 2024-09-10T10:15:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.544+0000 7f41665e1740 10 client.26297 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:15:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.544+0000 7f41665e1740 10 client.26297 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:15:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.544+0000 7f41665e1740 20 client.26297 populate_metadata read hostname 'smithi050' 2024-09-10T10:15:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.544+0000 7f41665e1740 1 --2- 172.21.15.50:0/3942645254 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f554676740 0x55f554678b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:15:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.544+0000 7f41665e1740 4 client.26297 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.75, "await_for": 45.0}] 2024-09-10T10:15:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.544+0000 7f41665e1740 1 -- 172.21.15.50:0/3942645254 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.75, "await_for": 45.0}) -- 0x55f554553ce0 con 0x55f554676740 2024-09-10T10:15:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.544+0000 7f415be00640 1 --2- 172.21.15.50:0/3942645254 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f554676740 0x55f554678b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:15:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.545+0000 7f415be00640 1 --2- 172.21.15.50:0/3942645254 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f554676740 0x55f554678b30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac28416edd2174de server_cookie=6e1a8f14eae6d441 in_seq=0 out_seq=0 2024-09-10T10:15:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.545+0000 7f4146a00640 10 client.26297 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.578+0000 7f4146a00640 1 -- 172.21.15.50:0/3942645254 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f554553ce0 con 0x55f554676740 2024-09-10T10:15:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.578+0000 7f4146a00640 10 client.26297 handle_command_reply: tid=0 2024-09-10T10:15:40.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.578+0000 7f41665e1740 1 client.26297 shutdown 2024-09-10T10:15:40.580 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:40 smithi050 ceph-mon[30354]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 481 MiB/s rd, 511 B/s wr, 126 op/s 2024-09-10T10:15:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.578+0000 7f41665e1740 1 -- 172.21.15.50:0/3942645254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7400 msgr2=0x55f5545ff360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.578+0000 7f41665e1740 1 --2- 172.21.15.50:0/3942645254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7400 0x55f5545ff360 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f415401c040 tx=0x7f4154005040 comp rx=0 tx=0).stop 2024-09-10T10:15:40.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.578+0000 7f41665e1740 1 -- 172.21.15.50:0/3942645254 shutdown_connections 2024-09-10T10:15:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.578+0000 7f41665e1740 1 --2- 172.21.15.50:0/3942645254 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55f554676740 0x55f554678b30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.578+0000 7f41665e1740 1 --2- 172.21.15.50:0/3942645254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5545faed0 0x55f554674a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.578+0000 7f41665e1740 1 --2- 172.21.15.50:0/3942645254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f5545e7d20 0x55f5545ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.578+0000 7f41665e1740 1 --2- 172.21.15.50:0/3942645254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5545e7400 0x55f5545ff360 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.578+0000 7f41665e1740 1 -- 172.21.15.50:0/3942645254 >> 172.21.15.50:0/3942645254 conn(0x55f5545e3a70 msgr2=0x55f5545e2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.578+0000 7f4146a00640 0 client.26297 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:15:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.579+0000 7f41665e1740 1 -- 172.21.15.50:0/3942645254 shutdown_connections 2024-09-10T10:15:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.579+0000 7f41665e1740 1 -- 172.21.15.50:0/3942645254 wait complete. 2024-09-10T10:15:40.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.579+0000 7f41665e1740 20 client.26297 trim_cache size 0 max 16384 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 25, 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24560, 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 14, 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout: "ba4535a8": { 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 14, 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-09-10T10:15:40.582 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 142.8, 2024-09-10T10:15:40.583 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-09-10T10:15:40.583 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-09-10T10:15:40.583 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-09-10T10:15:40.583 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:15:40.583 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-09-10T10:15:40.583 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:15:40.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:40.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:40.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:40.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:40.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:15:40.583 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:15:40.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.580+0000 7f4163c00640 1 -- 172.21.15.50:0/11692580 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f41400a2c80 msgr2=0x7f41400a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:40.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.580+0000 7f4163c00640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f41400a2c80 0x7f41400a5140 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f414c0988c0 tx=0x7f414c000f40 comp rx=0 tx=0).stop 2024-09-10T10:15:40.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.580+0000 7f4163c00640 1 -- 172.21.15.50:0/11692580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f415c103ff0 msgr2=0x7f415c19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:15:40.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.580+0000 7f4163c00640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f415c103ff0 0x7f415c19a6a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f414c00ebc0 tx=0x7f414c00c6a0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.581+0000 7f4163c00640 1 -- 172.21.15.50:0/11692580 shutdown_connections 2024-09-10T10:15:40.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.581+0000 7f4163c00640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f41400a2c80 0x7f41400a5140 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.581+0000 7f4163c00640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f415c109120 0x7f415c19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.581+0000 7f4163c00640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f415c1049a0 0x7f415c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.581+0000 7f4163c00640 1 --2- 172.21.15.50:0/11692580 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f415c103ff0 0x7f415c19a6a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:15:40.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.581+0000 7f4163c00640 1 -- 172.21.15.50:0/11692580 >> 172.21.15.50:0/11692580 conn(0x7f415c0ffab0 msgr2=0x7f415c100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:15:40.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.581+0000 7f4163c00640 1 -- 172.21.15.50:0/11692580 shutdown_connections 2024-09-10T10:15:40.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:15:40.581+0000 7f4163c00640 1 -- 172.21.15.50:0/11692580 wait complete. 2024-09-10T10:15:40.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:40 smithi189 ceph-mon[34999]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 481 MiB/s rd, 511 B/s wr, 126 op/s 2024-09-10T10:15:40.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:40 smithi084 ceph-mon[34812]: pgmap v525: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 481 MiB/s rd, 511 B/s wr, 126 op/s 2024-09-10T10:15:41.477 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ba4535a8', quiesce took 5.4 seconds. Will release after: 17.35 2024-09-10T10:15:42.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:42 smithi050 ceph-mon[30354]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 544 MiB/s rd, 511 B/s wr, 142 op/s 2024-09-10T10:15:42.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:42 smithi189 ceph-mon[34999]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 544 MiB/s rd, 511 B/s wr, 142 op/s 2024-09-10T10:15:42.848 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:42 smithi084 ceph-mon[34812]: pgmap v526: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 544 MiB/s rd, 511 B/s wr, 142 op/s 2024-09-10T10:15:44.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:44 smithi050 ceph-mon[30354]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 548 MiB/s rd, 426 B/s wr, 144 op/s 2024-09-10T10:15:44.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:44 smithi189 ceph-mon[34999]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 548 MiB/s rd, 426 B/s wr, 144 op/s 2024-09-10T10:15:44.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:44 smithi084 ceph-mon[34812]: pgmap v527: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 548 MiB/s rd, 426 B/s wr, 144 op/s 2024-09-10T10:15:45.800 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:15:45.800 INFO:tasks.workunit.client.0.smithi050.stdout: Children see throughput for 1 readers = 533657.12 kB/sec 2024-09-10T10:15:45.801 INFO:tasks.workunit.client.0.smithi050.stdout: Parent sees throughput for 1 readers = 533633.71 kB/sec 2024-09-10T10:15:45.801 INFO:tasks.workunit.client.0.smithi050.stdout: Min throughput per process = 533657.12 kB/sec 2024-09-10T10:15:45.801 INFO:tasks.workunit.client.0.smithi050.stdout: Max throughput per process = 533657.12 kB/sec 2024-09-10T10:15:45.801 INFO:tasks.workunit.client.0.smithi050.stdout: Avg throughput per process = 533657.12 kB/sec 2024-09-10T10:15:45.801 INFO:tasks.workunit.client.0.smithi050.stdout: Min xfer = 10485760.00 kB 2024-09-10T10:15:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:46 smithi189 ceph-mon[34999]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 570 MiB/s rd, 426 B/s wr, 147 op/s 2024-09-10T10:15:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:15:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:15:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:15:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:46 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:15:46.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:46 smithi050 ceph-mon[30354]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 570 MiB/s rd, 426 B/s wr, 147 op/s 2024-09-10T10:15:46.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:15:46.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:15:46.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:15:46.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:46 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:15:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:46 smithi084 ceph-mon[34812]: pgmap v528: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 570 MiB/s rd, 426 B/s wr, 147 op/s 2024-09-10T10:15:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:15:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:15:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:15:46.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:46 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:15:48.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:48 smithi050 ceph-mon[30354]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 547 MiB/s rd, 767 B/s wr, 143 op/s 2024-09-10T10:15:48.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:48 smithi189 ceph-mon[34999]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 547 MiB/s rd, 767 B/s wr, 143 op/s 2024-09-10T10:15:48.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:48 smithi084 ceph-mon[34812]: pgmap v529: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 547 MiB/s rd, 767 B/s wr, 143 op/s 2024-09-10T10:15:50.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:50 smithi050 ceph-mon[30354]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 500 MiB/s rd, 341 B/s wr, 130 op/s 2024-09-10T10:15:50.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:50 smithi189 ceph-mon[34999]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 500 MiB/s rd, 341 B/s wr, 130 op/s 2024-09-10T10:15:50.848 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:50 smithi084 ceph-mon[34812]: pgmap v530: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 500 MiB/s rd, 341 B/s wr, 130 op/s 2024-09-10T10:15:52.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:52 smithi050 ceph-mon[30354]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 389 MiB/s rd, 341 B/s wr, 102 op/s 2024-09-10T10:15:52.836 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:52 smithi189 ceph-mon[34999]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 389 MiB/s rd, 341 B/s wr, 102 op/s 2024-09-10T10:15:52.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:52 smithi084 ceph-mon[34812]: pgmap v531: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 389 MiB/s rd, 341 B/s wr, 102 op/s 2024-09-10T10:15:54.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:54 smithi050 ceph-mon[30354]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 335 MiB/s rd, 341 B/s wr, 91 op/s 2024-09-10T10:15:54.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:54 smithi189 ceph-mon[34999]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 335 MiB/s rd, 341 B/s wr, 91 op/s 2024-09-10T10:15:54.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:54 smithi084 ceph-mon[34812]: pgmap v532: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 335 MiB/s rd, 341 B/s wr, 91 op/s 2024-09-10T10:15:56.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:56 smithi050 ceph-mon[30354]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 347 MiB/s rd, 426 B/s wr, 92 op/s 2024-09-10T10:15:56.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:56 smithi189 ceph-mon[34999]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 347 MiB/s rd, 426 B/s wr, 92 op/s 2024-09-10T10:15:56.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:56 smithi084 ceph-mon[34812]: pgmap v533: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 347 MiB/s rd, 426 B/s wr, 92 op/s 2024-09-10T10:15:58.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:15:58 smithi050 ceph-mon[30354]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 333 MiB/s rd, 426 B/s wr, 90 op/s 2024-09-10T10:15:58.829 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:15:58.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:15:58 smithi189 ceph-mon[34999]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 333 MiB/s rd, 426 B/s wr, 90 op/s 2024-09-10T10:15:58.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:15:58 smithi084 ceph-mon[34812]: pgmap v534: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 333 MiB/s rd, 426 B/s wr, 90 op/s 2024-09-10T10:15:59.373 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:00.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.048+0000 7f3fbf200640 1 -- 172.21.15.50:0/1862178343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb8109120 msgr2=0x7f3fb8110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:00.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.048+0000 7f3fbf200640 1 --2- 172.21.15.50:0/1862178343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb8109120 0x7f3fb8110ca0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009ca0 tx=0x7f3fb002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.048+0000 7f3fbf200640 1 -- 172.21.15.50:0/1862178343 shutdown_connections 2024-09-10T10:16:00.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.048+0000 7f3fbf200640 1 --2- 172.21.15.50:0/1862178343 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb8109120 0x7f3fb8110ca0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.048+0000 7f3fbf200640 1 --2- 172.21.15.50:0/1862178343 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb81049a0 0x7f3fb81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.048+0000 7f3fbf200640 1 --2- 172.21.15.50:0/1862178343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fb8103ff0 0x7f3fb81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.048+0000 7f3fbf200640 1 -- 172.21.15.50:0/1862178343 >> 172.21.15.50:0/1862178343 conn(0x7f3fb80ffa90 msgr2=0x7f3fb8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:00.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.048+0000 7f3fbf200640 1 -- 172.21.15.50:0/1862178343 shutdown_connections 2024-09-10T10:16:00.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.048+0000 7f3fbf200640 1 -- 172.21.15.50:0/1862178343 wait complete. 2024-09-10T10:16:00.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.050+0000 7f3fbf200640 1 Processor -- start 2024-09-10T10:16:00.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.050+0000 7f3fbf200640 1 -- start start 2024-09-10T10:16:00.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.050+0000 7f3fbf200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb8103ff0 0x7f3fb8110ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:00.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.051+0000 7f3fbf200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fb81049a0 0x7f3fb810db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:00.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.051+0000 7f3fbf200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb8109120 0x7f3fb810e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:00.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.051+0000 7f3fbf200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb8114180 con 0x7f3fb8109120 2024-09-10T10:16:00.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.051+0000 7f3fbf200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb8114000 con 0x7f3fb81049a0 2024-09-10T10:16:00.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.051+0000 7f3fbf200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb8114300 con 0x7f3fb8103ff0 2024-09-10T10:16:00.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.051+0000 7f3fb7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fb81049a0 0x7f3fb810db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:00.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.051+0000 7f3fb7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fb81049a0 0x7f3fb810db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:47020/0 (socket says 172.21.15.50:47020) 2024-09-10T10:16:00.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.051+0000 7f3fb7400640 1 -- 172.21.15.50:0/3297395764 learned_addr learned my addr 172.21.15.50:0/3297395764 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:00.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.052+0000 7f3fbd200640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb8109120 0x7f3fb810e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:00.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.052+0000 7f3fb7e00640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb8103ff0 0x7f3fb8110ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:00.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.052+0000 7f3fb7400640 1 -- 172.21.15.50:0/3297395764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb8103ff0 msgr2=0x7f3fb8110ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:00.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.052+0000 7f3fb7400640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb8103ff0 0x7f3fb8110ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.052+0000 7f3fb7400640 1 -- 172.21.15.50:0/3297395764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb8109120 msgr2=0x7f3fb810e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:00.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.052+0000 7f3fb7400640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb8109120 0x7f3fb810e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.052+0000 7f3fb7400640 1 -- 172.21.15.50:0/3297395764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb810e930 con 0x7f3fb81049a0 2024-09-10T10:16:00.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.052+0000 7f3fb7e00640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb8103ff0 0x7f3fb8110ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:16:00.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.052+0000 7f3fb7400640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fb81049a0 0x7f3fb810db60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400e9f0 tx=0x7f3fa400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:00.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.053+0000 7f3fb4c00640 1 -- 172.21.15.50:0/3297395764 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400cd80 con 0x7f3fb81049a0 2024-09-10T10:16:00.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.053+0000 7f3fb4c00640 1 -- 172.21.15.50:0/3297395764 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fa4010910 con 0x7f3fb81049a0 2024-09-10T10:16:00.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.053+0000 7f3fbf200640 1 -- 172.21.15.50:0/3297395764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb81aaf20 con 0x7f3fb81049a0 2024-09-10T10:16:00.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.053+0000 7f3fbf200640 1 -- 172.21.15.50:0/3297395764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb81ab370 con 0x7f3fb81049a0 2024-09-10T10:16:00.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.053+0000 7f3fb4c00640 1 -- 172.21.15.50:0/3297395764 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4018980 con 0x7f3fb81049a0 2024-09-10T10:16:00.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.054+0000 7f3fbf200640 1 -- 172.21.15.50:0/3297395764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f98005290 con 0x7f3fb81049a0 2024-09-10T10:16:00.058 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.057+0000 7f3fb4c00640 1 -- 172.21.15.50:0/3297395764 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3fa4010430 con 0x7f3fb81049a0 2024-09-10T10:16:00.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.058+0000 7f3fb4c00640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3f9c0a2c00 0x7f3f9c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:00.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.058+0000 7f3fb4c00640 1 -- 172.21.15.50:0/3297395764 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f3fa40cf530 con 0x7f3fb81049a0 2024-09-10T10:16:00.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.059+0000 7f3fb7e00640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3f9c0a2c00 0x7f3f9c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:00.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.060+0000 7f3fb7e00640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3f9c0a2c00 0x7f3f9c0a50c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009b50 tx=0x7f3fa8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:00.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.062+0000 7f3fb4c00640 1 -- 172.21.15.50:0/3297395764 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fa409c100 con 0x7f3fb81049a0 2024-09-10T10:16:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.381+0000 7f3fbf200640 1 -- 172.21.15.50:0/3297395764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f98005580 con 0x7f3fb81049a0 2024-09-10T10:16:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.382+0000 7f3fb4c00640 1 -- 172.21.15.50:0/3297395764 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f3fa409ba00 con 0x7f3fb81049a0 2024-09-10T10:16:00.384 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:16:00.384 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:16:00.384 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:16:00.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.385+0000 7f3fbf200640 1 -- 172.21.15.50:0/3297395764 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3f9c0a2c00 msgr2=0x7f3f9c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:00.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.385+0000 7f3fbf200640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3f9c0a2c00 0x7f3f9c0a50c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009b50 tx=0x7f3fa8005f90 comp rx=0 tx=0).stop 2024-09-10T10:16:00.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.385+0000 7f3fbf200640 1 -- 172.21.15.50:0/3297395764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fb81049a0 msgr2=0x7f3fb810db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:00.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.385+0000 7f3fbf200640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fb81049a0 0x7f3fb810db60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400e9f0 tx=0x7f3fa400eeb0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.385+0000 7f3fbf200640 1 -- 172.21.15.50:0/3297395764 shutdown_connections 2024-09-10T10:16:00.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.385+0000 7f3fbf200640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3f9c0a2c00 0x7f3f9c0a50c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.385+0000 7f3fbf200640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3fb8109120 0x7f3fb810e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.385+0000 7f3fbf200640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fb81049a0 0x7f3fb810db60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.385+0000 7f3fbf200640 1 --2- 172.21.15.50:0/3297395764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fb8103ff0 0x7f3fb8110ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:00.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.385+0000 7f3fbf200640 1 -- 172.21.15.50:0/3297395764 >> 172.21.15.50:0/3297395764 conn(0x7f3fb80ffa90 msgr2=0x7f3fb81004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:00.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.386+0000 7f3fbf200640 1 -- 172.21.15.50:0/3297395764 shutdown_connections 2024-09-10T10:16:00.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:00.386+0000 7f3fbf200640 1 -- 172.21.15.50:0/3297395764 wait complete. 2024-09-10T10:16:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:00 smithi050 ceph-mon[30354]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 411 MiB/s rd, 85 B/s wr, 108 op/s 2024-09-10T10:16:00.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:00 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3297395764' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:16:00.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:00 smithi189 ceph-mon[34999]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 411 MiB/s rd, 85 B/s wr, 108 op/s 2024-09-10T10:16:00.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:00 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3297395764' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:16:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:00 smithi084 ceph-mon[34812]: pgmap v535: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 411 MiB/s rd, 85 B/s wr, 108 op/s 2024-09-10T10:16:00.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:00 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3297395764' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:16:01.284 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id ba4535a8 --release --await' 2024-09-10T10:16:01.284 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24560 quiesce db --set-id ba4535a8 --release --await 2024-09-10T10:16:01.849 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:02.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.598+0000 7f3e66c00640 1 -- 172.21.15.50:0/2790076371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e601027a0 msgr2=0x7f3e601067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:02.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.598+0000 7f3e66c00640 1 --2- 172.21.15.50:0/2790076371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e601027a0 0x7f3e601067f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009860 tx=0x7f3e4802a340 comp rx=0 tx=0).stop 2024-09-10T10:16:02.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.598+0000 7f3e66c00640 1 -- 172.21.15.50:0/2790076371 shutdown_connections 2024-09-10T10:16:02.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.598+0000 7f3e66c00640 1 --2- 172.21.15.50:0/2790076371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e60106f20 0x7f3e6010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.598+0000 7f3e66c00640 1 --2- 172.21.15.50:0/2790076371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e601027a0 0x7f3e601067f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.598+0000 7f3e66c00640 1 --2- 172.21.15.50:0/2790076371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e60101df0 0x7f3e601021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.598+0000 7f3e66c00640 1 -- 172.21.15.50:0/2790076371 >> 172.21.15.50:0/2790076371 conn(0x7f3e600fd8b0 msgr2=0x7f3e600ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:02.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.598+0000 7f3e66c00640 1 -- 172.21.15.50:0/2790076371 shutdown_connections 2024-09-10T10:16:02.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.598+0000 7f3e66c00640 1 -- 172.21.15.50:0/2790076371 wait complete. 2024-09-10T10:16:02.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.599+0000 7f3e66c00640 1 Processor -- start 2024-09-10T10:16:02.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.599+0000 7f3e66c00640 1 -- start start 2024-09-10T10:16:02.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.600+0000 7f3e66c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e60101df0 0x7f3e6019f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.600+0000 7f3e66c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e601027a0 0x7f3e6019f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.600+0000 7f3e66c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e60106f20 0x7f3e6010de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.600+0000 7f3e66c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e60111f80 con 0x7f3e60101df0 2024-09-10T10:16:02.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.600+0000 7f3e66c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3e60111e00 con 0x7f3e60106f20 2024-09-10T10:16:02.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.600+0000 7f3e66c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e60112100 con 0x7f3e601027a0 2024-09-10T10:16:02.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.600+0000 7f3e5fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e60101df0 0x7f3e6019f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.600+0000 7f3e57e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e601027a0 0x7f3e6019f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.600+0000 7f3e57e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e601027a0 0x7f3e6019f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:56656/0 (socket says 172.21.15.50:56656) 2024-09-10T10:16:02.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.600+0000 7f3e57e00640 1 -- 172.21.15.50:0/4132025321 learned_addr learned my addr 172.21.15.50:0/4132025321 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:02.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.600+0000 7f3e64c00640 1 --2- 172.21.15.50:0/4132025321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e60106f20 0x7f3e6010de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.601+0000 7f3e57e00640 1 -- 172.21.15.50:0/4132025321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e60106f20 msgr2=0x7f3e6010de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:02.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.601+0000 7f3e57e00640 1 --2- 172.21.15.50:0/4132025321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e60106f20 0x7f3e6010de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.601+0000 7f3e57e00640 1 -- 172.21.15.50:0/4132025321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e60101df0 msgr2=0x7f3e6019f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:02.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.601+0000 7f3e57e00640 1 --2- 172.21.15.50:0/4132025321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e60101df0 0x7f3e6019f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.601+0000 7f3e57e00640 1 -- 172.21.15.50:0/4132025321 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6010e6c0 con 0x7f3e601027a0 2024-09-10T10:16:02.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.601+0000 7f3e57e00640 1 --2- 172.21.15.50:0/4132025321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e601027a0 0x7f3e6019f6a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e48035040 tx=0x7f3e48033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:02.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.601+0000 7f3e5d600640 1 -- 172.21.15.50:0/4132025321 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4803f020 con 0x7f3e601027a0 2024-09-10T10:16:02.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.601+0000 7f3e5d600640 1 -- 172.21.15.50:0/4132025321 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e48032770 con 0x7f3e601027a0 2024-09-10T10:16:02.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.601+0000 7f3e66c00640 1 -- 172.21.15.50:0/4132025321 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6010e950 con 0x7f3e601027a0 2024-09-10T10:16:02.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.602+0000 7f3e66c00640 1 -- 172.21.15.50:0/4132025321 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e6019acc0 con 0x7f3e601027a0 2024-09-10T10:16:02.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.602+0000 7f3e5d600640 1 -- 172.21.15.50:0/4132025321 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48037040 con 0x7f3e601027a0 2024-09-10T10:16:02.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.606+0000 7f3e6965c740 1 Processor -- start 2024-09-10T10:16:02.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.606+0000 7f3e5d600640 1 -- 172.21.15.50:0/4132025321 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3e48042020 con 0x7f3e601027a0 2024-09-10T10:16:02.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.607+0000 7f3e6965c740 1 -- start start 2024-09-10T10:16:02.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.607+0000 7f3e6965c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698ea310 0x560f698ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.607+0000 7f3e6965c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 0x560f698f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.607+0000 7f3e6965c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698f54f0 0x560f698f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.607+0000 7f3e6965c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560f69850650 con 0x560f698ea310 2024-09-10T10:16:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.607+0000 7f3e6965c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560f697f7f10 con 0x560f698f54f0 2024-09-10T10:16:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.607+0000 7f3e6965c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560f6984c610 con 0x560f698eac30 2024-09-10T10:16:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.608+0000 7f3e5fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 0x560f698f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.608+0000 7f3e5fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 0x560f698f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:56672/0 (socket says 172.21.15.50:56672) 2024-09-10T10:16:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.608+0000 7f3e5fe00640 1 -- 172.21.15.50:0/329623421 learned_addr learned my addr 172.21.15.50:0/329623421 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.608+0000 7f3e5d600640 1 --2- 172.21.15.50:0/4132025321 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3e440a2c00 0x7f3e440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.608+0000 7f3e5fe00640 1 -- 172.21.15.50:0/329623421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698f54f0 msgr2=0x560f698f78e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:16:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.608+0000 7f3e5fe00640 1 --2- 172.21.15.50:0/329623421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698f54f0 0x560f698f78e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.608+0000 7f3e5fe00640 1 -- 172.21.15.50:0/329623421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698ea310 msgr2=0x560f698ea6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:16:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.608+0000 7f3e5fe00640 1 --2- 172.21.15.50:0/329623421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698ea310 0x560f698ea6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.608+0000 7f3e5fe00640 1 -- 172.21.15.50:0/329623421 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f6955f580 con 0x560f698eac30 2024-09-10T10:16:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.608+0000 7f3e5d600640 1 -- 172.21.15.50:0/4132025321 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f3e480ef6a0 con 0x7f3e601027a0 2024-09-10T10:16:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.609+0000 7f3e5fe00640 1 --2- 172.21.15.50:0/329623421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 0x560f698f4fb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009b50 tx=0x7f3e50010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c76f3eef9361e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.609+0000 7f3e55200640 1 -- 172.21.15.50:0/329623421 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50009e40 con 0x560f698eac30 2024-09-10T10:16:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.609+0000 7f3e55200640 1 -- 172.21.15.50:0/329623421 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e5001b960 con 0x560f698eac30 2024-09-10T10:16:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.609+0000 7f3e55200640 1 -- 172.21.15.50:0/329623421 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50012b10 con 0x560f698eac30 2024-09-10T10:16:02.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.609+0000 7f3e64c00640 1 --2- 172.21.15.50:0/4132025321 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3e440a2c00 0x7f3e440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.610+0000 7f3e6965c740 1 -- 172.21.15.50:0/329623421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 msgr2=0x560f698f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.610+0000 7f3e6965c740 1 --2- 172.21.15.50:0/329623421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 0x560f698f4fb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009b50 tx=0x7f3e50010740 comp rx=0 tx=0).stop 2024-09-10T10:16:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.611+0000 7f3e64c00640 1 --2- 172.21.15.50:0/4132025321 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3e440a2c00 0x7f3e440a50c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3e58005fd0 tx=0x7f3e58009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.611+0000 7f3e6965c740 1 -- 172.21.15.50:0/329623421 shutdown_connections 2024-09-10T10:16:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.611+0000 7f3e6965c740 1 --2- 172.21.15.50:0/329623421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698f54f0 0x560f698f78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.611+0000 7f3e6965c740 1 --2- 172.21.15.50:0/329623421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 0x560f698f4fb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.611+0000 7f3e6965c740 1 --2- 172.21.15.50:0/329623421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698ea310 0x560f698ea6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.611+0000 7f3e6965c740 1 -- 172.21.15.50:0/329623421 >> 172.21.15.50:0/329623421 conn(0x560f698e68a0 msgr2=0x560f698e6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.611+0000 7f3e6965c740 1 -- 172.21.15.50:0/329623421 shutdown_connections 2024-09-10T10:16:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.611+0000 7f3e6965c740 1 -- 172.21.15.50:0/329623421 wait complete. 2024-09-10T10:16:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.612+0000 7f3e6965c740 1 -- start start 2024-09-10T10:16:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.612+0000 7f3e6965c740 1 Processor -- start 2024-09-10T10:16:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.613+0000 7f3e6965c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698ea310 0x560f698f2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.613+0000 7f3e6965c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 0x560f698f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.613+0000 7f3e6965c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698f54f0 0x560f698f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.613+0000 7f3e6965c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560f698f80c0 con 0x560f698f54f0 2024-09-10T10:16:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.613+0000 7f3e6965c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560f6980b350 con 0x560f698ea310 2024-09-10T10:16:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.613+0000 7f3e6965c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560f698f8240 con 0x560f698eac30 2024-09-10T10:16:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.614+0000 7f3e6965c740 10 client.0 _ll_register_callbacks cb 0x560f6982e290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.614+0000 7f3e5fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698ea310 0x560f698f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.614+0000 7f3e57e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 0x560f698f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.614+0000 7f3e57e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 0x560f698f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:56678/0 (socket says 172.21.15.50:56678) 2024-09-10T10:16:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.614+0000 7f3e57e00640 1 -- 172.21.15.50:0/917590093 learned_addr learned my addr 172.21.15.50:0/917590093 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:02.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.614+0000 7f3e64c00640 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698f54f0 0x560f698f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.615+0000 7f3e5fe00640 1 -- 172.21.15.50:0/917590093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 msgr2=0x560f698f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.615+0000 7f3e5fe00640 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 0x560f698f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.615+0000 7f3e5fe00640 1 -- 172.21.15.50:0/917590093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698f54f0 msgr2=0x560f698f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.615+0000 7f3e5fe00640 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698f54f0 0x560f698f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.615+0000 7f3e5fe00640 1 -- 172.21.15.50:0/917590093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f69629960 con 0x560f698ea310 2024-09-10T10:16:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.615+0000 7f3e57e00640 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 0x560f698f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:02.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.615+0000 7f3e64c00640 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698f54f0 0x560f698f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:02.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.616+0000 7f3e5fe00640 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698ea310 0x560f698f2490 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009b50 tx=0x7f3e5001bd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f50036526ddfb8cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:02.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.616+0000 7f3e4d600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:16:02.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.617+0000 7f3e4d600640 1 -- 172.21.15.50:0/917590093 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5001b680 con 0x560f698ea310 2024-09-10T10:16:02.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.617+0000 7f3e4d600640 1 -- 172.21.15.50:0/917590093 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f3e50005040 con 0x560f698ea310 2024-09-10T10:16:02.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.617+0000 7f3e6965c740 1 -- 172.21.15.50:0/917590093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e5001b960 con 0x560f698ea310 2024-09-10T10:16:02.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.618+0000 7f3e4d600640 1 -- 172.21.15.50:0/917590093 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e50009750 con 0x560f698ea310 2024-09-10T10:16:02.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.618+0000 7f3e6965c740 10 client.26312 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:02.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.618+0000 7f3e6965c740 1 -- 172.21.15.50:0/917590093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560f69903db0 con 0x560f698ea310 2024-09-10T10:16:02.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.619+0000 7f3e4d600640 1 -- 172.21.15.50:0/917590093 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e5001b960 con 0x560f698ea310 2024-09-10T10:16:02.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.620+0000 7f3e4d600640 1 -- 172.21.15.50:0/917590093 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3e5000f040 con 0x560f698ea310 2024-09-10T10:16:02.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.620+0000 7f3e6965c740 10 client.26312 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:02.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.620+0000 7f3e6965c740 10 client.26312 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:16:02.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.620+0000 7f3e6965c740 20 client.26312 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:02.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.620+0000 7f3e6965c740 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x560f69905160 0x560f69907550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.620+0000 7f3e6965c740 4 client.26312 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:16:02.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.620+0000 7f3e6965c740 1 -- 172.21.15.50:0/917590093 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f6985dbc0 con 0x560f69905160 2024-09-10T10:16:02.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.621+0000 7f3e57e00640 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x560f69905160 0x560f69907550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.624+0000 7f3e57e00640 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x560f69905160 0x560f69907550 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7784a8c5eeb7de13 server_cookie=59a57ee199c5b5e2 in_seq=0 out_seq=0 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.624+0000 7f3e4d600640 10 client.26312 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:02.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.625+0000 7f3e4d600640 1 -- 172.21.15.50:0/917590093 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f6985dbc0 con 0x560f69905160 2024-09-10T10:16:02.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.625+0000 7f3e4d600640 10 client.26312 handle_command_reply: tid=0 2024-09-10T10:16:02.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.625+0000 7f3e6965c740 1 client.26312 shutdown 2024-09-10T10:16:02.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.626+0000 7f3e6965c740 1 -- 172.21.15.50:0/917590093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698ea310 msgr2=0x560f698f2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:02.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.626+0000 7f3e6965c740 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698ea310 0x560f698f2490 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009b50 tx=0x7f3e5001bd40 comp rx=0 tx=0).stop 2024-09-10T10:16:02.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.626+0000 7f3e6965c740 1 -- 172.21.15.50:0/917590093 shutdown_connections 2024-09-10T10:16:02.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.626+0000 7f3e6965c740 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x560f69905160 0x560f69907550 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.626+0000 7f3e6965c740 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698f54f0 0x560f698f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.626+0000 7f3e6965c740 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698eac30 0x560f698f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.626+0000 7f3e6965c740 1 --2- 172.21.15.50:0/917590093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698ea310 0x560f698f2490 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009b50 tx=0x7f3e5001bd40 comp rx=0 tx=0).stop 2024-09-10T10:16:02.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.626+0000 7f3e6965c740 1 -- 172.21.15.50:0/917590093 >> 172.21.15.50:0/917590093 conn(0x560f698e68a0 msgr2=0x560f698e5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:02.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.626+0000 7f3e4d600640 0 client.26312 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:02.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.627+0000 7f3e6965c740 1 -- 172.21.15.50:0/917590093 shutdown_connections 2024-09-10T10:16:02.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.627+0000 7f3e6965c740 1 -- 172.21.15.50:0/917590093 wait complete. 2024-09-10T10:16:02.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.628+0000 7f3e6965c740 20 client.26312 trim_cache size 0 max 16384 2024-09-10T10:16:02.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.652+0000 7f3e6965c740 1 Processor -- start 2024-09-10T10:16:02.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.652+0000 7f3e6965c740 1 -- start start 2024-09-10T10:16:02.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.653+0000 7f3e6965c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698eac30 0x560f698ed920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.653+0000 7f3e6965c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698f54f0 0x560f698f1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.653+0000 7f3e6965c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f6990cc00 0x560f6990d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.653+0000 7f3e6965c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e601c0360 con 0x560f698f54f0 2024-09-10T10:16:02.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.653+0000 7f3e6965c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3e601bdc30 con 0x560f698eac30 2024-09-10T10:16:02.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.653+0000 7f3e6965c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e601bba80 con 0x560f6990cc00 2024-09-10T10:16:02.655 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:02 smithi050 ceph-mon[30354]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 498 MiB/s rd, 85 B/s wr, 130 op/s 2024-09-10T10:16:02.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.653+0000 7f3e57e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698f54f0 0x560f698f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.653+0000 7f3e57e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698f54f0 0x560f698f1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54364/0 (socket says 172.21.15.50:54364) 2024-09-10T10:16:02.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.653+0000 7f3e57e00640 1 -- 172.21.15.50:0/185132191 learned_addr learned my addr 172.21.15.50:0/185132191 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:02.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.653+0000 7f3e5fe00640 1 --2- 172.21.15.50:0/185132191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698eac30 0x560f698ed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.654+0000 7f3e5fe00640 1 -- 172.21.15.50:0/185132191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f6990cc00 msgr2=0x560f6990d090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:16:02.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.654+0000 7f3e5fe00640 1 --2- 172.21.15.50:0/185132191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f6990cc00 0x560f6990d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.654+0000 7f3e5fe00640 1 -- 172.21.15.50:0/185132191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698f54f0 msgr2=0x560f698f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:02.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.654+0000 7f3e5fe00640 1 --2- 172.21.15.50:0/185132191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698f54f0 0x560f698f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.654+0000 7f3e5fe00640 1 -- 172.21.15.50:0/185132191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f698e6340 con 0x560f698eac30 2024-09-10T10:16:02.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.655+0000 7f3e5fe00640 1 --2- 172.21.15.50:0/185132191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698eac30 0x560f698ed920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3e500098f0 tx=0x7f3e50010d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b298d54bd55c77f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:02.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.655+0000 7f3e4fe00640 1 -- 172.21.15.50:0/185132191 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5001b480 con 0x560f698eac30 2024-09-10T10:16:02.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.655+0000 7f3e4fe00640 1 -- 172.21.15.50:0/185132191 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e50012780 con 0x560f698eac30 2024-09-10T10:16:02.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.655+0000 7f3e4fe00640 1 -- 172.21.15.50:0/185132191 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50004ed0 con 0x560f698eac30 2024-09-10T10:16:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.656+0000 7f3e6965c740 1 -- 172.21.15.50:0/185132191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698eac30 msgr2=0x560f698ed920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.656+0000 7f3e6965c740 1 --2- 172.21.15.50:0/185132191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698eac30 0x560f698ed920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3e500098f0 tx=0x7f3e50010d70 comp rx=0 tx=0).stop 2024-09-10T10:16:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.656+0000 7f3e6965c740 1 -- 172.21.15.50:0/185132191 shutdown_connections 2024-09-10T10:16:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.656+0000 7f3e6965c740 1 --2- 172.21.15.50:0/185132191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f6990cc00 0x560f6990d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.656+0000 7f3e6965c740 1 --2- 172.21.15.50:0/185132191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f698f54f0 0x560f698f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.656+0000 7f3e6965c740 1 --2- 172.21.15.50:0/185132191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698eac30 0x560f698ed920 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.656+0000 7f3e6965c740 1 -- 172.21.15.50:0/185132191 >> 172.21.15.50:0/185132191 conn(0x560f698e68a0 msgr2=0x560f698f0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.657+0000 7f3e6965c740 1 -- 172.21.15.50:0/185132191 shutdown_connections 2024-09-10T10:16:02.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.657+0000 7f3e6965c740 1 -- 172.21.15.50:0/185132191 wait complete. 2024-09-10T10:16:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.657+0000 7f3e6965c740 1 -- start start 2024-09-10T10:16:02.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.658+0000 7f3e6965c740 1 Processor -- start 2024-09-10T10:16:02.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.658+0000 7f3e6965c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698eac30 0x560f698fd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.658+0000 7f3e6965c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698f54f0 0x560f698f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.658+0000 7f3e6965c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f6990cc00 0x560f698f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.659+0000 7f3e6965c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e601bc0f0 con 0x560f6990cc00 2024-09-10T10:16:02.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.659+0000 7f3e6965c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3e601bd560 con 0x560f698eac30 2024-09-10T10:16:02.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.659+0000 7f3e6965c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e601bc7c0 con 0x560f698f54f0 2024-09-10T10:16:02.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.659+0000 7f3e6965c740 10 client.0 _ll_register_callbacks cb 0x7f3e500099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:02.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.659+0000 7f3e5fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698eac30 0x560f698fd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.659+0000 7f3e57e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698f54f0 0x560f698f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.659+0000 7f3e57e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698f54f0 0x560f698f8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:56690/0 (socket says 172.21.15.50:56690) 2024-09-10T10:16:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.659+0000 7f3e57e00640 1 -- 172.21.15.50:0/109952932 learned_addr learned my addr 172.21.15.50:0/109952932 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.659+0000 7f3e64c00640 1 --2- 172.21.15.50:0/109952932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f6990cc00 0x560f698f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.660+0000 7f3e57e00640 1 -- 172.21.15.50:0/109952932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698eac30 msgr2=0x560f698fd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.660+0000 7f3e57e00640 1 --2- 172.21.15.50:0/109952932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698eac30 0x560f698fd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.660+0000 7f3e57e00640 1 -- 172.21.15.50:0/109952932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f6990cc00 msgr2=0x560f698f91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.660+0000 7f3e57e00640 1 --2- 172.21.15.50:0/109952932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f6990cc00 0x560f698f91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.660+0000 7f3e57e00640 1 -- 172.21.15.50:0/109952932 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f698f9760 con 0x560f698f54f0 2024-09-10T10:16:02.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.660+0000 7f3e64c00640 1 --2- 172.21.15.50:0/109952932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f6990cc00 0x560f698f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:02.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.661+0000 7f3e57e00640 1 --2- 172.21.15.50:0/109952932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698f54f0 0x560f698f8cb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e480bb5a0 tx=0x7f3e48005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c536af53fd8a0510 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:02.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.661+0000 7f3e4d600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:16:02.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.661+0000 7f3e4d600640 1 -- 172.21.15.50:0/109952932 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e480b9e70 con 0x560f698f54f0 2024-09-10T10:16:02.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.662+0000 7f3e4d600640 1 -- 172.21.15.50:0/109952932 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f3e48003b90 con 0x560f698f54f0 2024-09-10T10:16:02.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.662+0000 7f3e6965c740 1 -- 172.21.15.50:0/109952932 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e50012780 con 0x560f698f54f0 2024-09-10T10:16:02.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.662+0000 7f3e4d600640 1 -- 172.21.15.50:0/109952932 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e480ef3b0 con 0x560f698f54f0 2024-09-10T10:16:02.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.662+0000 7f3e6965c740 10 client.26311 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:02.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.662+0000 7f3e6965c740 1 -- 172.21.15.50:0/109952932 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560f6996f9d0 con 0x560f698f54f0 2024-09-10T10:16:02.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.662+0000 7f3e4d600640 1 -- 172.21.15.50:0/109952932 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e50012780 con 0x560f698f54f0 2024-09-10T10:16:02.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.662+0000 7f3e4d600640 1 -- 172.21.15.50:0/109952932 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3e4803a030 con 0x560f698f54f0 2024-09-10T10:16:02.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.662+0000 7f3e6965c740 10 client.26311 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:02.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.662+0000 7f3e6965c740 10 client.26311 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:16:02.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.662+0000 7f3e6965c740 20 client.26311 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:02.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.662+0000 7f3e6965c740 1 --2- 172.21.15.50:0/109952932 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x560f69970100 0x560f69972520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:02.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.662+0000 7f3e6965c740 4 client.26311 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ba4535a8", "release": true, "await": true}] 2024-09-10T10:16:02.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.662+0000 7f3e6965c740 1 -- 172.21.15.50:0/109952932 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ba4535a8", "release": true, "await": true}) -- 0x560f698580d0 con 0x560f69970100 2024-09-10T10:16:02.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.663+0000 7f3e5fe00640 1 --2- 172.21.15.50:0/109952932 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x560f69970100 0x560f69972520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:02.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.664+0000 7f3e4d600640 10 client.26311 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:02.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.664+0000 7f3e5fe00640 1 --2- 172.21.15.50:0/109952932 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x560f69970100 0x560f69972520 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d352c8c6f2af47c7 server_cookie=2742821861cc8e81 in_seq=0 out_seq=0 2024-09-10T10:16:02.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.667+0000 7f3e4d600640 1 -- 172.21.15.50:0/109952932 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560f698580d0 con 0x560f69970100 2024-09-10T10:16:02.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.667+0000 7f3e4d600640 10 client.26311 handle_command_reply: tid=0 2024-09-10T10:16:02.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.667+0000 7f3e6965c740 1 client.26311 shutdown 2024-09-10T10:16:02.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.667+0000 7f3e6965c740 1 -- 172.21.15.50:0/109952932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698f54f0 msgr2=0x560f698f8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:02.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.667+0000 7f3e6965c740 1 --2- 172.21.15.50:0/109952932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698f54f0 0x560f698f8cb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e480bb5a0 tx=0x7f3e48005f90 comp rx=0 tx=0).stop 2024-09-10T10:16:02.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.667+0000 7f3e6965c740 1 -- 172.21.15.50:0/109952932 shutdown_connections 2024-09-10T10:16:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.667+0000 7f3e6965c740 1 --2- 172.21.15.50:0/109952932 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x560f69970100 0x560f69972520 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.667+0000 7f3e6965c740 1 --2- 172.21.15.50:0/109952932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f6990cc00 0x560f698f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.667+0000 7f3e6965c740 1 --2- 172.21.15.50:0/109952932 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f698f54f0 0x560f698f8cb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.667+0000 7f3e6965c740 1 --2- 172.21.15.50:0/109952932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f698eac30 0x560f698fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.667+0000 7f3e6965c740 1 -- 172.21.15.50:0/109952932 >> 172.21.15.50:0/109952932 conn(0x560f698e68a0 msgr2=0x560f698f2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.667+0000 7f3e4d600640 0 client.26311 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.668+0000 7f3e6965c740 1 -- 172.21.15.50:0/109952932 shutdown_connections 2024-09-10T10:16:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.668+0000 7f3e6965c740 1 -- 172.21.15.50:0/109952932 wait complete. 2024-09-10T10:16:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.668+0000 7f3e6965c740 20 client.26311 trim_cache size 0 max 16384 2024-09-10T10:16:02.670 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:16:02.670 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 25, 2024-09-10T10:16:02.671 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24560, 2024-09-10T10:16:02.671 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 16, 2024-09-10T10:16:02.671 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-09-10T10:16:02.671 INFO:teuthology.orchestra.run.smithi050.stdout: "ba4535a8": { 2024-09-10T10:16:02.671 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 16, 2024-09-10T10:16:02.671 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-09-10T10:16:02.671 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:16:02.671 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-09-10T10:16:02.671 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:16:02.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:02.671 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-09-10T10:16:02.671 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 142.8, 2024-09-10T10:16:02.671 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-09-10T10:16:02.672 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-09-10T10:16:02.672 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-09-10T10:16:02.672 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-09-10T10:16:02.672 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-09-10T10:16:02.672 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-09-10T10:16:02.672 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:02.672 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:02.672 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:02.672 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:02.672 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:02.672 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:16:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.670+0000 7f3e66c00640 1 -- 172.21.15.50:0/4132025321 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3e440a2c00 msgr2=0x7f3e440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.670+0000 7f3e66c00640 1 --2- 172.21.15.50:0/4132025321 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3e440a2c00 0x7f3e440a50c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3e58005fd0 tx=0x7f3e58009500 comp rx=0 tx=0).stop 2024-09-10T10:16:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.670+0000 7f3e66c00640 1 -- 172.21.15.50:0/4132025321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e601027a0 msgr2=0x7f3e6019f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.670+0000 7f3e66c00640 1 --2- 172.21.15.50:0/4132025321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e601027a0 0x7f3e6019f6a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e48035040 tx=0x7f3e48033d90 comp rx=0 tx=0).stop 2024-09-10T10:16:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.670+0000 7f3e66c00640 1 -- 172.21.15.50:0/4132025321 shutdown_connections 2024-09-10T10:16:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.670+0000 7f3e66c00640 1 --2- 172.21.15.50:0/4132025321 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f3e440a2c00 0x7f3e440a50c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.670+0000 7f3e66c00640 1 --2- 172.21.15.50:0/4132025321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e60106f20 0x7f3e6010de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.670+0000 7f3e66c00640 1 --2- 172.21.15.50:0/4132025321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e601027a0 0x7f3e6019f6a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.670+0000 7f3e66c00640 1 --2- 172.21.15.50:0/4132025321 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e60101df0 0x7f3e6019f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.670+0000 7f3e66c00640 1 -- 172.21.15.50:0/4132025321 >> 172.21.15.50:0/4132025321 conn(0x7f3e600fd8b0 msgr2=0x7f3e600feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.670+0000 7f3e66c00640 1 -- 172.21.15.50:0/4132025321 shutdown_connections 2024-09-10T10:16:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:02.671+0000 7f3e66c00640 1 -- 172.21.15.50:0/4132025321 wait complete. 2024-09-10T10:16:02.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:02 smithi189 ceph-mon[34999]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 498 MiB/s rd, 85 B/s wr, 130 op/s 2024-09-10T10:16:02.848 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:02 smithi084 ceph-mon[34812]: pgmap v536: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 498 MiB/s rd, 85 B/s wr, 130 op/s 2024-09-10T10:16:03.608 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ba4535a8', total seconds elapsed: 27.6 2024-09-10T10:16:04.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:04 smithi050 ceph-mon[30354]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 560 MiB/s rd, 85 B/s wr, 147 op/s 2024-09-10T10:16:04.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:04 smithi189 ceph-mon[34999]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 560 MiB/s rd, 85 B/s wr, 147 op/s 2024-09-10T10:16:04.848 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:04 smithi084 ceph-mon[34812]: pgmap v537: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 560 MiB/s rd, 85 B/s wr, 147 op/s 2024-09-10T10:16:06.007 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:16:06.007 INFO:tasks.workunit.client.0.smithi050.stdout: Children see throughput for 1 re-readers = 611506.69 kB/sec 2024-09-10T10:16:06.008 INFO:tasks.workunit.client.0.smithi050.stdout: Parent sees throughput for 1 re-readers = 611476.86 kB/sec 2024-09-10T10:16:06.008 INFO:tasks.workunit.client.0.smithi050.stdout: Min throughput per process = 611506.69 kB/sec 2024-09-10T10:16:06.008 INFO:tasks.workunit.client.0.smithi050.stdout: Max throughput per process = 611506.69 kB/sec 2024-09-10T10:16:06.008 INFO:tasks.workunit.client.0.smithi050.stdout: Avg throughput per process = 611506.69 kB/sec 2024-09-10T10:16:06.008 INFO:tasks.workunit.client.0.smithi050.stdout: Min xfer = 10485760.00 kB 2024-09-10T10:16:06.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:06 smithi050 ceph-mon[30354]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 594 MiB/s rd, 85 B/s wr, 153 op/s 2024-09-10T10:16:06.835 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:06 smithi189 ceph-mon[34999]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 594 MiB/s rd, 85 B/s wr, 153 op/s 2024-09-10T10:16:06.849 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:06 smithi084 ceph-mon[34812]: pgmap v538: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 594 MiB/s rd, 85 B/s wr, 153 op/s 2024-09-10T10:16:08.369 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:16:08.763 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:09.070 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:08 smithi050 ceph-mon[30354]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 576 MiB/s rd, 150 op/s 2024-09-10T10:16:09.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:08 smithi189 ceph-mon[34999]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 576 MiB/s rd, 150 op/s 2024-09-10T10:16:09.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:08 smithi084 ceph-mon[34812]: pgmap v539: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 576 MiB/s rd, 150 op/s 2024-09-10T10:16:09.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.298+0000 7f33a7200640 1 -- 172.21.15.50:0/2714609731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33a01049a0 msgr2=0x7f33a01089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:09.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.298+0000 7f33a7200640 1 --2- 172.21.15.50:0/2714609731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33a01049a0 0x7f33a01089f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f338c009900 tx=0x7f338c02a410 comp rx=0 tx=0).stop 2024-09-10T10:16:09.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.298+0000 7f33a7200640 1 -- 172.21.15.50:0/2714609731 shutdown_connections 2024-09-10T10:16:09.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.298+0000 7f33a7200640 1 --2- 172.21.15.50:0/2714609731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a0109120 0x7f33a0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.298+0000 7f33a7200640 1 --2- 172.21.15.50:0/2714609731 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33a01049a0 0x7f33a01089f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.298+0000 7f33a7200640 1 --2- 172.21.15.50:0/2714609731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a0103ff0 0x7f33a01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.298+0000 7f33a7200640 1 -- 172.21.15.50:0/2714609731 >> 172.21.15.50:0/2714609731 conn(0x7f33a00ffa90 msgr2=0x7f33a0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:09.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.299+0000 7f33a7200640 1 -- 172.21.15.50:0/2714609731 shutdown_connections 2024-09-10T10:16:09.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.299+0000 7f33a7200640 1 -- 172.21.15.50:0/2714609731 wait complete. 2024-09-10T10:16:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.299+0000 7f33a7200640 1 Processor -- start 2024-09-10T10:16:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.300+0000 7f33a7200640 1 -- start start 2024-09-10T10:16:09.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.300+0000 7f33a7200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33a0103ff0 0x7f33a019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.300+0000 7f33a7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a01049a0 0x7f33a019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.300+0000 7f33a7200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a0109120 0x7f33a019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.300+0000 7f33a7200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33a0114120 con 0x7f33a0109120 2024-09-10T10:16:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.300+0000 7f33a7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f33a0113fa0 con 0x7f33a01049a0 2024-09-10T10:16:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.300+0000 7f33a7200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01142a0 con 0x7f33a0103ff0 2024-09-10T10:16:09.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.300+0000 7f339fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33a0103ff0 0x7f33a019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.300+0000 7f339f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a01049a0 0x7f33a019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.300+0000 7f339fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33a0103ff0 0x7f33a019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:49990/0 (socket says 172.21.15.50:49990) 2024-09-10T10:16:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.300+0000 7f339fe00640 1 -- 172.21.15.50:0/2393089065 learned_addr learned my addr 172.21.15.50:0/2393089065 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.300+0000 7f33a5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a0109120 0x7f33a019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.301+0000 7f339fe00640 1 -- 172.21.15.50:0/2393089065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a01049a0 msgr2=0x7f33a019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.301+0000 7f339fe00640 1 --2- 172.21.15.50:0/2393089065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a01049a0 0x7f33a019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.301+0000 7f339fe00640 1 -- 172.21.15.50:0/2393089065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a0109120 msgr2=0x7f33a019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:09.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.301+0000 7f339fe00640 1 --2- 172.21.15.50:0/2393089065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a0109120 0x7f33a019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.301+0000 7f339fe00640 1 -- 172.21.15.50:0/2393089065 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a019f5d0 con 0x7f33a0103ff0 2024-09-10T10:16:09.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.301+0000 7f339f400640 1 --2- 172.21.15.50:0/2393089065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a01049a0 0x7f33a019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:09.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.301+0000 7f339fe00640 1 --2- 172.21.15.50:0/2393089065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33a0103ff0 0x7f33a019a620 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f339000ea60 tx=0x7f339000ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:09.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.301+0000 7f339cc00640 1 -- 172.21.15.50:0/2393089065 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339000cd20 con 0x7f33a0103ff0 2024-09-10T10:16:09.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.301+0000 7f339cc00640 1 -- 172.21.15.50:0/2393089065 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33900035f0 con 0x7f33a0103ff0 2024-09-10T10:16:09.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.301+0000 7f339cc00640 1 -- 172.21.15.50:0/2393089065 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3390010690 con 0x7f33a0103ff0 2024-09-10T10:16:09.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.301+0000 7f33a7200640 1 -- 172.21.15.50:0/2393089065 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a019f8c0 con 0x7f33a0103ff0 2024-09-10T10:16:09.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.302+0000 7f33a7200640 1 -- 172.21.15.50:0/2393089065 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a01a71a0 con 0x7f33a0103ff0 2024-09-10T10:16:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.305+0000 7f33a9dda740 1 Processor -- start 2024-09-10T10:16:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.305+0000 7f33a9dda740 1 -- start start 2024-09-10T10:16:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.305+0000 7f339cc00640 1 -- 172.21.15.50:0/2393089065 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f33900037a0 con 0x7f33a0103ff0 2024-09-10T10:16:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.305+0000 7f33a9dda740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d7ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.305+0000 7f33a9dda740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d804b0 0x562731d8a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.305+0000 7f33a9dda740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 0x562731d8d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.305+0000 7f33a9dda740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562731ce63e0 con 0x562731d7fb90 2024-09-10T10:16:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.305+0000 7f33a9dda740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562731c8dd80 con 0x562731d804b0 2024-09-10T10:16:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.305+0000 7f33a9dda740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562731ce23a0 con 0x562731d8ad70 2024-09-10T10:16:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.305+0000 7f33a5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d7ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.306+0000 7f339fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d804b0 0x562731d8a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.306+0000 7f33a5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d7ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41148/0 (socket says 172.21.15.50:41148) 2024-09-10T10:16:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.306+0000 7f33a5200640 1 -- 172.21.15.50:0/638662205 learned_addr learned my addr 172.21.15.50:0/638662205 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.306+0000 7f339f400640 1 --2- 172.21.15.50:0/638662205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 0x562731d8d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.306+0000 7f33a5200640 1 -- 172.21.15.50:0/638662205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 msgr2=0x562731d8d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.306+0000 7f33a5200640 1 --2- 172.21.15.50:0/638662205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 0x562731d8d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.306+0000 7f33a5200640 1 -- 172.21.15.50:0/638662205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d804b0 msgr2=0x562731d8a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.306+0000 7f33a5200640 1 --2- 172.21.15.50:0/638662205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d804b0 0x562731d8a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.306+0000 7f33a5200640 1 -- 172.21.15.50:0/638662205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562731cacae0 con 0x562731d7fb90 2024-09-10T10:16:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.306+0000 7f339fe00640 1 --2- 172.21.15.50:0/638662205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d804b0 0x562731d8a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:09.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.306+0000 7f33a5200640 1 --2- 172.21.15.50:0/638662205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d7ff70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3398009f60 tx=0x7f3398009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c190e0fa17044d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:09.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.307+0000 7f339cc00640 1 --2- 172.21.15.50:0/2393089065 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f33840a2c00 0x7f33840a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.307+0000 7f3395600640 1 -- 172.21.15.50:0/638662205 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339801e070 con 0x562731d7fb90 2024-09-10T10:16:09.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.307+0000 7f3395600640 1 -- 172.21.15.50:0/638662205 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3398003c30 con 0x562731d7fb90 2024-09-10T10:16:09.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.307+0000 7f3395600640 1 -- 172.21.15.50:0/638662205 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339800f920 con 0x562731d7fb90 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.307+0000 7f339cc00640 1 -- 172.21.15.50:0/2393089065 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f33900cf650 con 0x7f33a0103ff0 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.307+0000 7f33a9dda740 1 -- 172.21.15.50:0/638662205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 msgr2=0x562731d7ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.307+0000 7f33a9dda740 1 --2- 172.21.15.50:0/638662205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d7ff70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3398009f60 tx=0x7f3398009f90 comp rx=0 tx=0).stop 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.308+0000 7f33a9dda740 1 -- 172.21.15.50:0/638662205 shutdown_connections 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.308+0000 7f33a9dda740 1 --2- 172.21.15.50:0/638662205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 0x562731d8d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.308+0000 7f33a9dda740 1 --2- 172.21.15.50:0/638662205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d804b0 0x562731d8a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.308+0000 7f33a9dda740 1 --2- 172.21.15.50:0/638662205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d7ff70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.308+0000 7f33a9dda740 1 -- 172.21.15.50:0/638662205 >> 172.21.15.50:0/638662205 conn(0x562731d7c120 msgr2=0x562731d7c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.308+0000 7f339fe00640 1 --2- 172.21.15.50:0/2393089065 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f33840a2c00 0x7f33840a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.308+0000 7f33a9dda740 1 -- 172.21.15.50:0/638662205 shutdown_connections 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.308+0000 7f33a9dda740 1 -- 172.21.15.50:0/638662205 wait complete. 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.308+0000 7f339fe00640 1 --2- 172.21.15.50:0/2393089065 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f33840a2c00 0x7f33840a50c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f33900cd130 tx=0x7f33900d5550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.308+0000 7f33a9dda740 1 -- start start 2024-09-10T10:16:09.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.309+0000 7f33a9dda740 1 Processor -- start 2024-09-10T10:16:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.309+0000 7f33a9dda740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d87cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.309+0000 7f33a9dda740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d804b0 0x562731d88210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.309+0000 7f33a9dda740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 0x562731d88750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.309+0000 7f33a9dda740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562731d8d9e0 con 0x562731d7fb90 2024-09-10T10:16:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.309+0000 7f33a9dda740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562731ca10f0 con 0x562731d804b0 2024-09-10T10:16:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.309+0000 7f33a9dda740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562731d8db60 con 0x562731d8ad70 2024-09-10T10:16:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.309+0000 7f33a9dda740 10 client.0 _ll_register_callbacks cb 0x562731c929e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.309+0000 7f33a5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d87cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.309+0000 7f33a5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d87cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41158/0 (socket says 172.21.15.50:41158) 2024-09-10T10:16:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.309+0000 7f33a5200640 1 -- 172.21.15.50:0/1345961447 learned_addr learned my addr 172.21.15.50:0/1345961447 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.310+0000 7f339f400640 1 --2- 172.21.15.50:0/1345961447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d804b0 0x562731d88210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.310+0000 7f33a5200640 1 --2- 172.21.15.50:0/1345961447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 0x562731d88750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.310+0000 7f33a5200640 1 -- 172.21.15.50:0/1345961447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 msgr2=0x562731d88750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.310+0000 7f33a5200640 1 --2- 172.21.15.50:0/1345961447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 0x562731d88750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.310+0000 7f33a5200640 1 -- 172.21.15.50:0/1345961447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d804b0 msgr2=0x562731d88210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.310+0000 7f33a5200640 1 --2- 172.21.15.50:0/1345961447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d804b0 0x562731d88210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.310+0000 7f33a5200640 1 -- 172.21.15.50:0/1345961447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562731a573c0 con 0x562731d7fb90 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.310+0000 7f33a5200640 1 --2- 172.21.15.50:0/1345961447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d87cd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f339801c040 tx=0x7f339800f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d24fc1079af0678 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.310+0000 7f338a000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.310+0000 7f338a000640 1 -- 172.21.15.50:0/1345961447 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339802d060 con 0x562731d7fb90 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.311+0000 7f338a000640 1 -- 172.21.15.50:0/1345961447 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f3398004460 con 0x562731d7fb90 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.311+0000 7f33a9dda740 1 -- 172.21.15.50:0/1345961447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3398003c30 con 0x562731d7fb90 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.311+0000 7f338a000640 1 -- 172.21.15.50:0/1345961447 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f339801e070 con 0x562731d7fb90 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.311+0000 7f33a9dda740 10 client.16254 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.311+0000 7f33a9dda740 1 -- 172.21.15.50:0/1345961447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562731d99710 con 0x562731d7fb90 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.311+0000 7f338a000640 1 -- 172.21.15.50:0/1345961447 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3398003c30 con 0x562731d7fb90 2024-09-10T10:16:09.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.311+0000 7f338a000640 1 -- 172.21.15.50:0/1345961447 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f33980194c0 con 0x562731d7fb90 2024-09-10T10:16:09.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.312+0000 7f33a9dda740 10 client.16254 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:09.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.312+0000 7f33a9dda740 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:16:09.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.312+0000 7f33a9dda740 20 client.16254 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:09.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.312+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1345961447 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562731d9abd0 0x562731d9cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.312+0000 7f33a9dda740 4 client.16254 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:16:09.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.312+0000 7f33a9dda740 1 -- 172.21.15.50:0/1345961447 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562731cf3950 con 0x562731d9abd0 2024-09-10T10:16:09.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.312+0000 7f339f400640 1 --2- 172.21.15.50:0/1345961447 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562731d9abd0 0x562731d9cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.313+0000 7f339f400640 1 --2- 172.21.15.50:0/1345961447 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562731d9abd0 0x562731d9cfc0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7c3b1602259259e server_cookie=b4524ad83c19323d in_seq=0 out_seq=0 2024-09-10T10:16:09.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.313+0000 7f338a000640 10 client.16254 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:09.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.314+0000 7f338a000640 1 -- 172.21.15.50:0/1345961447 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562731cf3950 con 0x562731d9abd0 2024-09-10T10:16:09.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.314+0000 7f338a000640 10 client.16254 handle_command_reply: tid=0 2024-09-10T10:16:09.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.314+0000 7f33a9dda740 1 client.16254 shutdown 2024-09-10T10:16:09.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.314+0000 7f33a9dda740 1 -- 172.21.15.50:0/1345961447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 msgr2=0x562731d87cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:09.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.314+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1345961447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d87cd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f339801c040 tx=0x7f339800f5c0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.314+0000 7f33a9dda740 1 -- 172.21.15.50:0/1345961447 shutdown_connections 2024-09-10T10:16:09.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.314+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1345961447 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562731d9abd0 0x562731d9cfc0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.314+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1345961447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 0x562731d88750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.314+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1345961447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d804b0 0x562731d88210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.314+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1345961447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d87cd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.314+0000 7f338a000640 0 client.16254 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:09.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.314+0000 7f33a9dda740 1 -- 172.21.15.50:0/1345961447 >> 172.21.15.50:0/1345961447 conn(0x562731d7c120 msgr2=0x562731d81e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:09.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.315+0000 7f33a9dda740 1 -- 172.21.15.50:0/1345961447 shutdown_connections 2024-09-10T10:16:09.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.315+0000 7f33a9dda740 1 -- 172.21.15.50:0/1345961447 wait complete. 2024-09-10T10:16:09.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.315+0000 7f33a9dda740 20 client.16254 trim_cache size 0 max 16384 2024-09-10T10:16:09.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.335+0000 7f33a9dda740 1 Processor -- start 2024-09-10T10:16:09.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.335+0000 7f33a9dda740 1 -- start start 2024-09-10T10:16:09.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.335+0000 7f33a9dda740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d7fb90 0x562731d825f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f33a9dda740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d804b0 0x562731da2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f33a9dda740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 0x562731da2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f33a9dda740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01b37e0 con 0x562731d804b0 2024-09-10T10:16:09.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f33a9dda740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01b10b0 con 0x562731d7fb90 2024-09-10T10:16:09.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f33a9dda740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01aef00 con 0x562731d8ad70 2024-09-10T10:16:09.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f339f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d804b0 0x562731da2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f339f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d804b0 0x562731da2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41164/0 (socket says 172.21.15.50:41164) 2024-09-10T10:16:09.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f339f400640 1 -- 172.21.15.50:0/1193382816 learned_addr learned my addr 172.21.15.50:0/1193382816 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:09.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f33a5200640 1 --2- 172.21.15.50:0/1193382816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d7fb90 0x562731d825f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f33a5200640 1 --2- 172.21.15.50:0/1193382816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 0x562731da2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f339f400640 1 -- 172.21.15.50:0/1193382816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 msgr2=0x562731da2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f339f400640 1 --2- 172.21.15.50:0/1193382816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 0x562731da2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f339f400640 1 -- 172.21.15.50:0/1193382816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d7fb90 msgr2=0x562731d825f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f339f400640 1 --2- 172.21.15.50:0/1193382816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d7fb90 0x562731d825f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f339f400640 1 -- 172.21.15.50:0/1193382816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562731d8d160 con 0x562731d804b0 2024-09-10T10:16:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.336+0000 7f33a5200640 1 --2- 172.21.15.50:0/1193382816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 0x562731da2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:16:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.337+0000 7f339f400640 1 --2- 172.21.15.50:0/1193382816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d804b0 0x562731da2680 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f338c009900 tx=0x7f338c032930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c8daf2e21d6c5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.337+0000 7f3394c00640 1 -- 172.21.15.50:0/1193382816 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c035040 con 0x562731d804b0 2024-09-10T10:16:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.337+0000 7f3394c00640 1 -- 172.21.15.50:0/1193382816 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f338c005020 con 0x562731d804b0 2024-09-10T10:16:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.337+0000 7f3394c00640 1 -- 172.21.15.50:0/1193382816 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c004ae0 con 0x562731d804b0 2024-09-10T10:16:09.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.338+0000 7f33a9dda740 1 -- 172.21.15.50:0/1193382816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d804b0 msgr2=0x562731da2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.338+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1193382816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d804b0 0x562731da2680 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f338c009900 tx=0x7f338c032930 comp rx=0 tx=0).stop 2024-09-10T10:16:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.338+0000 7f33a9dda740 1 -- 172.21.15.50:0/1193382816 shutdown_connections 2024-09-10T10:16:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.338+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1193382816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d8ad70 0x562731da2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.338+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1193382816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d804b0 0x562731da2680 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.338+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1193382816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d7fb90 0x562731d825f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.338+0000 7f33a9dda740 1 -- 172.21.15.50:0/1193382816 >> 172.21.15.50:0/1193382816 conn(0x562731d7c120 msgr2=0x562731d865a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.338+0000 7f33a9dda740 1 -- 172.21.15.50:0/1193382816 shutdown_connections 2024-09-10T10:16:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.338+0000 7f33a9dda740 1 -- 172.21.15.50:0/1193382816 wait complete. 2024-09-10T10:16:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.339+0000 7f33a9dda740 1 -- start start 2024-09-10T10:16:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.339+0000 7f33a9dda740 1 Processor -- start 2024-09-10T10:16:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.339+0000 7f33a9dda740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d935e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.339+0000 7f33a9dda740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d804b0 0x562731d84b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.339+0000 7f33a9dda740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d8ad70 0x562731d85110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.339+0000 7f33a9dda740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01af570 con 0x562731d7fb90 2024-09-10T10:16:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.339+0000 7f33a9dda740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01b09e0 con 0x562731d8ad70 2024-09-10T10:16:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.339+0000 7f33a9dda740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01afc40 con 0x562731d804b0 2024-09-10T10:16:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.339+0000 7f33a9dda740 10 client.0 _ll_register_callbacks cb 0x7f3390005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.340+0000 7f33a5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d935e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.340+0000 7f33a5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d935e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41176/0 (socket says 172.21.15.50:41176) 2024-09-10T10:16:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.340+0000 7f33a5200640 1 -- 172.21.15.50:0/1281475940 learned_addr learned my addr 172.21.15.50:0/1281475940 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.340+0000 7f339f400640 1 --2- 172.21.15.50:0/1281475940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d804b0 0x562731d84b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.340+0000 7f33a5200640 1 --2- 172.21.15.50:0/1281475940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d8ad70 0x562731d85110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.340+0000 7f33a5200640 1 -- 172.21.15.50:0/1281475940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d804b0 msgr2=0x562731d84b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.340+0000 7f33a5200640 1 --2- 172.21.15.50:0/1281475940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d804b0 0x562731d84b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.340+0000 7f33a5200640 1 -- 172.21.15.50:0/1281475940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d8ad70 msgr2=0x562731d85110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.340+0000 7f33a5200640 1 --2- 172.21.15.50:0/1281475940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d8ad70 0x562731d85110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.340+0000 7f33a5200640 1 -- 172.21.15.50:0/1281475940 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562731d85940 con 0x562731d7fb90 2024-09-10T10:16:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.341+0000 7f33a5200640 1 --2- 172.21.15.50:0/1281475940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d935e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f339801c010 tx=0x7f339800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22abd909f606da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.341+0000 7f338a000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:16:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.341+0000 7f338a000640 1 -- 172.21.15.50:0/1281475940 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398040030 con 0x562731d7fb90 2024-09-10T10:16:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.341+0000 7f338a000640 1 -- 172.21.15.50:0/1281475940 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f3398002030 con 0x562731d7fb90 2024-09-10T10:16:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.341+0000 7f33a9dda740 1 -- 172.21.15.50:0/1281475940 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f338c005020 con 0x562731d7fb90 2024-09-10T10:16:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.341+0000 7f338a000640 1 -- 172.21.15.50:0/1281475940 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3398019ad0 con 0x562731d7fb90 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.341+0000 7f33a9dda740 10 client.16260 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.341+0000 7f33a9dda740 1 -- 172.21.15.50:0/1281475940 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562731e05740 con 0x562731d7fb90 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.342+0000 7f338a000640 1 -- 172.21.15.50:0/1281475940 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f338c005020 con 0x562731d7fb90 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.342+0000 7f338a000640 1 -- 172.21.15.50:0/1281475940 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f339800f7f0 con 0x562731d7fb90 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.342+0000 7f33a9dda740 10 client.16260 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.342+0000 7f33a9dda740 10 client.16260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.342+0000 7f33a9dda740 20 client.16260 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.342+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1281475940 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562731e05c10 0x562731e08000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.342+0000 7f33a9dda740 4 client.16260 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.342+0000 7f33a9dda740 1 -- 172.21.15.50:0/1281475940 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562731cede60 con 0x562731e05c10 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.342+0000 7f339f400640 1 --2- 172.21.15.50:0/1281475940 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562731e05c10 0x562731e08000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f339f400640 1 --2- 172.21.15.50:0/1281475940 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562731e05c10 0x562731e08000 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bee8402407fdef0 server_cookie=9fed94314d849a66 in_seq=0 out_seq=0 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f338a000640 10 client.16260 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f338a000640 1 -- 172.21.15.50:0/1281475940 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562731cede60 con 0x562731e05c10 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f338a000640 10 client.16260 handle_command_reply: tid=0 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f33a9dda740 1 client.16260 shutdown 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f33a9dda740 1 -- 172.21.15.50:0/1281475940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 msgr2=0x562731d935e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1281475940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d935e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f339801c010 tx=0x7f339800f520 comp rx=0 tx=0).stop 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f33a9dda740 1 -- 172.21.15.50:0/1281475940 shutdown_connections 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1281475940 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x562731e05c10 0x562731e08000 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1281475940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562731d8ad70 0x562731d85110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1281475940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562731d804b0 0x562731d84b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f33a9dda740 1 --2- 172.21.15.50:0/1281475940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562731d7fb90 0x562731d935e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f338a000640 0 client.16260 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.343+0000 7f33a9dda740 1 -- 172.21.15.50:0/1281475940 >> 172.21.15.50:0/1281475940 conn(0x562731d7c120 msgr2=0x562731d7a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.344+0000 7f33a9dda740 1 -- 172.21.15.50:0/1281475940 shutdown_connections 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.344+0000 7f33a9dda740 1 -- 172.21.15.50:0/1281475940 wait complete. 2024-09-10T10:16:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.344+0000 7f33a9dda740 20 client.16260 trim_cache size 0 max 16384 2024-09-10T10:16:09.348 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:16:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-10T10:16:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-10T10:16:09.348 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:16:09.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.345+0000 7f33a7200640 1 -- 172.21.15.50:0/2393089065 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f33840a2c00 msgr2=0x7f33840a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:09.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.345+0000 7f33a7200640 1 --2- 172.21.15.50:0/2393089065 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f33840a2c00 0x7f33840a50c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f33900cd130 tx=0x7f33900d5550 comp rx=0 tx=0).stop 2024-09-10T10:16:09.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.345+0000 7f33a7200640 1 -- 172.21.15.50:0/2393089065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33a0103ff0 msgr2=0x7f33a019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:09.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.345+0000 7f33a7200640 1 --2- 172.21.15.50:0/2393089065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33a0103ff0 0x7f33a019a620 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f339000ea60 tx=0x7f339000ee60 comp rx=0 tx=0).stop 2024-09-10T10:16:09.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.345+0000 7f33a7200640 1 -- 172.21.15.50:0/2393089065 shutdown_connections 2024-09-10T10:16:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.345+0000 7f33a7200640 1 --2- 172.21.15.50:0/2393089065 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f33840a2c00 0x7f33840a50c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.345+0000 7f33a7200640 1 --2- 172.21.15.50:0/2393089065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a0109120 0x7f33a019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.345+0000 7f33a7200640 1 --2- 172.21.15.50:0/2393089065 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a01049a0 0x7f33a019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.345+0000 7f33a7200640 1 --2- 172.21.15.50:0/2393089065 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f33a0103ff0 0x7f33a019a620 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.345+0000 7f33a7200640 1 -- 172.21.15.50:0/2393089065 >> 172.21.15.50:0/2393089065 conn(0x7f33a00ffa90 msgr2=0x7f33a0100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.345+0000 7f33a7200640 1 -- 172.21.15.50:0/2393089065 shutdown_connections 2024-09-10T10:16:09.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:09.345+0000 7f33a7200640 1 -- 172.21.15.50:0/2393089065 wait complete. 2024-09-10T10:16:10.210 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T10:16:10.210 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:16:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:11.001 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:10 smithi050 ceph-mon[30354]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 582 MiB/s rd, 151 op/s 2024-09-10T10:16:11.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:10 smithi189 ceph-mon[34999]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 582 MiB/s rd, 151 op/s 2024-09-10T10:16:11.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:10 smithi084 ceph-mon[34812]: pgmap v540: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 582 MiB/s rd, 151 op/s 2024-09-10T10:16:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.151+0000 7f45aba00640 1 -- 172.21.15.50:0/761969911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a4109140 msgr2=0x7f45a4110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.151+0000 7f45aba00640 1 --2- 172.21.15.50:0/761969911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a4109140 0x7f45a4110cc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f459c009ca0 tx=0x7f459c02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:16:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.152+0000 7f45aba00640 1 -- 172.21.15.50:0/761969911 shutdown_connections 2024-09-10T10:16:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.152+0000 7f45aba00640 1 --2- 172.21.15.50:0/761969911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a4109140 0x7f45a4110cc0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.152+0000 7f45aba00640 1 --2- 172.21.15.50:0/761969911 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a41049c0 0x7f45a4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.152+0000 7f45aba00640 1 --2- 172.21.15.50:0/761969911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45a4104010 0x7f45a41043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.152+0000 7f45aba00640 1 -- 172.21.15.50:0/761969911 >> 172.21.15.50:0/761969911 conn(0x7f45a40ffa50 msgr2=0x7f45a4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.152+0000 7f45aba00640 1 -- 172.21.15.50:0/761969911 shutdown_connections 2024-09-10T10:16:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.152+0000 7f45aba00640 1 -- 172.21.15.50:0/761969911 wait complete. 2024-09-10T10:16:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.152+0000 7f45aba00640 1 Processor -- start 2024-09-10T10:16:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.153+0000 7f45aba00640 1 -- start start 2024-09-10T10:16:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.153+0000 7f45aba00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a4104010 0x7f45a419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.153+0000 7f45aba00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45a41049c0 0x7f45a419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.153+0000 7f45aba00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a4109140 0x7f45a419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.153+0000 7f45aba00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f45a41141a0 con 0x7f45a4104010 2024-09-10T10:16:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.153+0000 7f45aba00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f45a4114020 con 0x7f45a41049c0 2024-09-10T10:16:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.153+0000 7f45aba00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45a4114320 con 0x7f45a4109140 2024-09-10T10:16:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.153+0000 7f45a9000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a4104010 0x7f45a419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.153+0000 7f45a9000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a4104010 0x7f45a419a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41196/0 (socket says 172.21.15.50:41196) 2024-09-10T10:16:11.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.153+0000 7f45a9000640 1 -- 172.21.15.50:0/1176869524 learned_addr learned my addr 172.21.15.50:0/1176869524 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.153+0000 7f45a9a00640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a4109140 0x7f45a419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.153+0000 7f459be00640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45a41049c0 0x7f45a419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.154+0000 7f45a9000640 1 -- 172.21.15.50:0/1176869524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a4109140 msgr2=0x7f45a419ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.154+0000 7f45a9000640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a4109140 0x7f45a419ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.154+0000 7f45a9000640 1 -- 172.21.15.50:0/1176869524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45a41049c0 msgr2=0x7f45a419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.154+0000 7f45a9000640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45a41049c0 0x7f45a419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.154+0000 7f45a9000640 1 -- 172.21.15.50:0/1176869524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a419f650 con 0x7f45a4104010 2024-09-10T10:16:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.154+0000 7f45a9000640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a4104010 0x7f45a419a6a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f459400ea60 tx=0x7f459400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.154+0000 7f45a2000640 1 -- 172.21.15.50:0/1176869524 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459400cde0 con 0x7f45a4104010 2024-09-10T10:16:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.154+0000 7f45a2000640 1 -- 172.21.15.50:0/1176869524 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45940035f0 con 0x7f45a4104010 2024-09-10T10:16:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.154+0000 7f45a2000640 1 -- 172.21.15.50:0/1176869524 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594010670 con 0x7f45a4104010 2024-09-10T10:16:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.154+0000 7f45aba00640 1 -- 172.21.15.50:0/1176869524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a419f940 con 0x7f45a4104010 2024-09-10T10:16:11.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.154+0000 7f45aba00640 1 -- 172.21.15.50:0/1176869524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a41a7220 con 0x7f45a4104010 2024-09-10T10:16:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.156+0000 7f45aba00640 1 -- 172.21.15.50:0/1176869524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a41043f0 con 0x7f45a4104010 2024-09-10T10:16:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.157+0000 7f45a2000640 1 -- 172.21.15.50:0/1176869524 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f45940037a0 con 0x7f45a4104010 2024-09-10T10:16:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.159+0000 7f45a2000640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f45880a2c00 0x7f45880a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.159+0000 7f45a2000640 1 -- 172.21.15.50:0/1176869524 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f45940cf830 con 0x7f45a4104010 2024-09-10T10:16:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.159+0000 7f459be00640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f45880a2c00 0x7f45880a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.160+0000 7f459be00640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f45880a2c00 0x7f45880a50c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f458c005fd0 tx=0x7f458c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:11.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.163+0000 7f45a2000640 1 -- 172.21.15.50:0/1176869524 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f459409c3a0 con 0x7f45a4104010 2024-09-10T10:16:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.390+0000 7f45aba00640 1 -- 172.21.15.50:0/1176869524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45a419ba00 con 0x7f45a4104010 2024-09-10T10:16:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.391+0000 7f45a2000640 1 -- 172.21.15.50:0/1176869524 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f459409bca0 con 0x7f45a4104010 2024-09-10T10:16:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:16:11.393 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:16:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:16:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.394+0000 7f45aba00640 1 -- 172.21.15.50:0/1176869524 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f45880a2c00 msgr2=0x7f45880a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.394+0000 7f45aba00640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f45880a2c00 0x7f45880a50c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f458c005fd0 tx=0x7f458c005850 comp rx=0 tx=0).stop 2024-09-10T10:16:11.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.394+0000 7f45aba00640 1 -- 172.21.15.50:0/1176869524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a4104010 msgr2=0x7f45a419a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.394+0000 7f45aba00640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a4104010 0x7f45a419a6a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f459400ea60 tx=0x7f459400ef20 comp rx=0 tx=0).stop 2024-09-10T10:16:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.394+0000 7f45aba00640 1 -- 172.21.15.50:0/1176869524 shutdown_connections 2024-09-10T10:16:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.394+0000 7f45aba00640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f45880a2c00 0x7f45880a50c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.394+0000 7f45aba00640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45a4109140 0x7f45a419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.394+0000 7f45aba00640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45a41049c0 0x7f45a419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.394+0000 7f45aba00640 1 --2- 172.21.15.50:0/1176869524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45a4104010 0x7f45a419a6a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.394+0000 7f45aba00640 1 -- 172.21.15.50:0/1176869524 >> 172.21.15.50:0/1176869524 conn(0x7f45a40ffa50 msgr2=0x7f45a4100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.394+0000 7f45aba00640 1 -- 172.21.15.50:0/1176869524 shutdown_connections 2024-09-10T10:16:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:11.394+0000 7f45aba00640 1 -- 172.21.15.50:0/1176869524 wait complete. 2024-09-10T10:16:12.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:11 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1176869524' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:16:12.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:11 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1176869524' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:16:12.208 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:11 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1176869524' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:16:12.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T10:16:12.644 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:13.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:12 smithi189 ceph-mon[34999]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 472 MiB/s rd, 123 op/s 2024-09-10T10:16:13.096 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:12 smithi050 ceph-mon[30354]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 472 MiB/s rd, 123 op/s 2024-09-10T10:16:13.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:12 smithi084 ceph-mon[34812]: pgmap v541: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 472 MiB/s rd, 123 op/s 2024-09-10T10:16:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.212+0000 7fe2a3800640 1 -- 172.21.15.50:0/2807587982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c103ff0 msgr2=0x7fe29c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.212+0000 7fe2a3800640 1 --2- 172.21.15.50:0/2807587982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c103ff0 0x7fe29c1043d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe290009900 tx=0x7fe29002a410 comp rx=0 tx=0).stop 2024-09-10T10:16:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.212+0000 7fe2a3800640 1 -- 172.21.15.50:0/2807587982 shutdown_connections 2024-09-10T10:16:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.212+0000 7fe2a3800640 1 --2- 172.21.15.50:0/2807587982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe29c109120 0x7fe29c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.212+0000 7fe2a3800640 1 --2- 172.21.15.50:0/2807587982 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe29c1049a0 0x7fe29c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.212+0000 7fe2a3800640 1 --2- 172.21.15.50:0/2807587982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c103ff0 0x7fe29c1043d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.212+0000 7fe2a3800640 1 -- 172.21.15.50:0/2807587982 >> 172.21.15.50:0/2807587982 conn(0x7fe29c0ffa90 msgr2=0x7fe29c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.212+0000 7fe2a3800640 1 -- 172.21.15.50:0/2807587982 shutdown_connections 2024-09-10T10:16:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.212+0000 7fe2a3800640 1 -- 172.21.15.50:0/2807587982 wait complete. 2024-09-10T10:16:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.213+0000 7fe2a3800640 1 Processor -- start 2024-09-10T10:16:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.213+0000 7fe2a3800640 1 -- start start 2024-09-10T10:16:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.213+0000 7fe2a3800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe29c103ff0 0x7fe29c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.213+0000 7fe2a3800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe29c1049a0 0x7fe29c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.213+0000 7fe2a3800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c109120 0x7fe29c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.213+0000 7fe2a3800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c114140 con 0x7fe29c109120 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.213+0000 7fe2a3800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c113fc0 con 0x7fe29c103ff0 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.213+0000 7fe2a3800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1142c0 con 0x7fe29c1049a0 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.214+0000 7fe2a0e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe29c103ff0 0x7fe29c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.214+0000 7fe2a0e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe29c103ff0 0x7fe29c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:55420/0 (socket says 172.21.15.50:55420) 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.214+0000 7fe2a0e00640 1 -- 172.21.15.50:0/4072085586 learned_addr learned my addr 172.21.15.50:0/4072085586 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.214+0000 7fe2a1800640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c109120 0x7fe29c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.214+0000 7fe29be00640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe29c1049a0 0x7fe29c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.214+0000 7fe2a0e00640 1 -- 172.21.15.50:0/4072085586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe29c1049a0 msgr2=0x7fe29c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.214+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe29c1049a0 0x7fe29c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.214+0000 7fe2a0e00640 1 -- 172.21.15.50:0/4072085586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c109120 msgr2=0x7fe29c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.214+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c109120 0x7fe29c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.214+0000 7fe2a0e00640 1 -- 172.21.15.50:0/4072085586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c19f5b0 con 0x7fe29c103ff0 2024-09-10T10:16:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.214+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe29c103ff0 0x7fe29c19a600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe290006010 tx=0x7fe2900042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.215+0000 7fe299600640 1 -- 172.21.15.50:0/4072085586 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29003f030 con 0x7fe29c103ff0 2024-09-10T10:16:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.215+0000 7fe2a3800640 1 -- 172.21.15.50:0/4072085586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29c19f840 con 0x7fe29c103ff0 2024-09-10T10:16:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.215+0000 7fe299600640 1 -- 172.21.15.50:0/4072085586 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe290003ce0 con 0x7fe29c103ff0 2024-09-10T10:16:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.215+0000 7fe299600640 1 -- 172.21.15.50:0/4072085586 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290035070 con 0x7fe29c103ff0 2024-09-10T10:16:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.215+0000 7fe2a3800640 1 -- 172.21.15.50:0/4072085586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe29c1a7180 con 0x7fe29c103ff0 2024-09-10T10:16:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.218+0000 7fe2a63c9740 1 Processor -- start 2024-09-10T10:16:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.218+0000 7fe2a63c9740 1 -- start start 2024-09-10T10:16:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.218+0000 7fe299600640 1 -- 172.21.15.50:0/4072085586 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe290042030 con 0x7fe29c103ff0 2024-09-10T10:16:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.218+0000 7fe2a63c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58d2c70 0x55fbc58d3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.218+0000 7fe2a63c9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d3590 0x55fbc58dd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.218+0000 7fe2a63c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58dde50 0x55fbc58e0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.218+0000 7fe2a63c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fbc58393e0 con 0x55fbc58dde50 2024-09-10T10:16:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.218+0000 7fe2a63c9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fbc57e0d80 con 0x55fbc58d3590 2024-09-10T10:16:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.218+0000 7fe2a63c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fbc58353a0 con 0x55fbc58d2c70 2024-09-10T10:16:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.219+0000 7fe2a0e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d3590 0x55fbc58dd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.219+0000 7fe2a1800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58d2c70 0x55fbc58d3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.219+0000 7fe2a1800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58d2c70 0x55fbc58d3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50066/0 (socket says 172.21.15.50:50066) 2024-09-10T10:16:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.219+0000 7fe2a1800640 1 -- 172.21.15.50:0/289407499 learned_addr learned my addr 172.21.15.50:0/289407499 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.219+0000 7fe29be00640 1 --2- 172.21.15.50:0/289407499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58dde50 0x55fbc58e0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.219+0000 7fe2a0e00640 1 -- 172.21.15.50:0/289407499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58d2c70 msgr2=0x55fbc58d3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.219+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/289407499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58d2c70 0x55fbc58d3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.219+0000 7fe2a0e00640 1 -- 172.21.15.50:0/289407499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58dde50 msgr2=0x55fbc58e0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.219+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/289407499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58dde50 0x55fbc58e0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.219+0000 7fe2a0e00640 1 -- 172.21.15.50:0/289407499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc57ffae0 con 0x55fbc58d3590 2024-09-10T10:16:13.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.220+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/289407499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d3590 0x55fbc58dd910 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ed010 tx=0x7fe2900f5bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38a179657fccc53a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.220+0000 7fe28e000640 1 -- 172.21.15.50:0/289407499 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2900fa630 con 0x55fbc58d3590 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.220+0000 7fe28e000640 1 -- 172.21.15.50:0/289407499 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2900ff020 con 0x55fbc58d3590 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.220+0000 7fe28e000640 1 -- 172.21.15.50:0/289407499 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2900f9c00 con 0x55fbc58d3590 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.220+0000 7fe299600640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe2840a2b80 0x7fe2840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.220+0000 7fe2a63c9740 1 -- 172.21.15.50:0/289407499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d3590 msgr2=0x55fbc58dd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.220+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/289407499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d3590 0x55fbc58dd910 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ed010 tx=0x7fe2900f5bf0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.221+0000 7fe299600640 1 -- 172.21.15.50:0/4072085586 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe2900ef960 con 0x7fe29c103ff0 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.221+0000 7fe2a63c9740 1 -- 172.21.15.50:0/289407499 shutdown_connections 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.221+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/289407499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58dde50 0x55fbc58e0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.221+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/289407499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d3590 0x55fbc58dd910 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.221+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/289407499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58d2c70 0x55fbc58d3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.221+0000 7fe2a63c9740 1 -- 172.21.15.50:0/289407499 >> 172.21.15.50:0/289407499 conn(0x55fbc58cf200 msgr2=0x55fbc58cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.221+0000 7fe2a1800640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe2840a2b80 0x7fe2840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.221+0000 7fe2a63c9740 1 -- 172.21.15.50:0/289407499 shutdown_connections 2024-09-10T10:16:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.221+0000 7fe2a63c9740 1 -- 172.21.15.50:0/289407499 wait complete. 2024-09-10T10:16:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.222+0000 7fe2a63c9740 1 -- start start 2024-09-10T10:16:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.222+0000 7fe2a1800640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe2840a2b80 0x7fe2840a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe294005fd0 tx=0x7fe294009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.222+0000 7fe2a63c9740 1 Processor -- start 2024-09-10T10:16:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.222+0000 7fe2a63c9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d2c70 0x55fbc58dacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.222+0000 7fe2a63c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 0x55fbc58db230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.222+0000 7fe2a63c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58dde50 0x55fbc58db770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.222+0000 7fe2a63c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fbc58e07e0 con 0x55fbc58d3590 2024-09-10T10:16:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.222+0000 7fe2a63c9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fbc57f40f0 con 0x55fbc58d2c70 2024-09-10T10:16:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.222+0000 7fe2a63c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fbc58e0960 con 0x55fbc58dde50 2024-09-10T10:16:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.222+0000 7fe2a63c9740 10 client.0 _ll_register_callbacks cb 0x55fbc57dbbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.223+0000 7fe29be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 0x55fbc58db230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.223+0000 7fe29be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 0x55fbc58db230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41226/0 (socket says 172.21.15.50:41226) 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.223+0000 7fe29be00640 1 -- 172.21.15.50:0/3757080950 learned_addr learned my addr 172.21.15.50:0/3757080950 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.223+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d2c70 0x55fbc58dacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.223+0000 7fe2a1800640 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58dde50 0x55fbc58db770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.223+0000 7fe29be00640 1 -- 172.21.15.50:0/3757080950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58dde50 msgr2=0x55fbc58db770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.223+0000 7fe29be00640 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58dde50 0x55fbc58db770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.223+0000 7fe29be00640 1 -- 172.21.15.50:0/3757080950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d2c70 msgr2=0x55fbc58dacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.223+0000 7fe29be00640 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d2c70 0x55fbc58dacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.223+0000 7fe29be00640 1 -- 172.21.15.50:0/3757080950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc55aa3c0 con 0x55fbc58d3590 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.223+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d2c70 0x55fbc58dacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.223+0000 7fe29be00640 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 0x55fbc58db230 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe28800ba90 tx=0x7fe28800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731a9087dda51da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.223+0000 7fe282a00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.224+0000 7fe282a00640 1 -- 172.21.15.50:0/3757080950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288005020 con 0x55fbc58d3590 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.224+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3757080950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2900ff020 con 0x55fbc58d3590 2024-09-10T10:16:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.224+0000 7fe282a00640 1 -- 172.21.15.50:0/3757080950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe2880051c0 con 0x55fbc58d3590 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.224+0000 7fe282a00640 1 -- 172.21.15.50:0/3757080950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe288024050 con 0x55fbc58d3590 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.224+0000 7fe2a63c9740 10 client.16278 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.224+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3757080950 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fbc58ec7f0 con 0x55fbc58d3590 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.224+0000 7fe282a00640 1 -- 172.21.15.50:0/3757080950 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2900ff020 con 0x55fbc58d3590 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.225+0000 7fe282a00640 1 -- 172.21.15.50:0/3757080950 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe28801b470 con 0x55fbc58d3590 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.225+0000 7fe2a63c9740 10 client.16278 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.225+0000 7fe2a63c9740 10 client.16278 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.225+0000 7fe2a63c9740 20 client.16278 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.225+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55fbc58edc00 0x55fbc58f0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.225+0000 7fe2a63c9740 4 client.16278 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.225+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3757080950 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbc5846950 con 0x55fbc58edc00 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.225+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55fbc58edc00 0x55fbc58f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.226+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55fbc58edc00 0x55fbc58f0030 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1a557bfedb29b160 server_cookie=1caf821c9a50d276 in_seq=0 out_seq=0 2024-09-10T10:16:13.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.226+0000 7fe282a00640 10 client.16278 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.226+0000 7fe282a00640 1 -- 172.21.15.50:0/3757080950 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fbc5846950 con 0x55fbc58edc00 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.226+0000 7fe282a00640 10 client.16278 handle_command_reply: tid=0 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.226+0000 7fe2a63c9740 1 client.16278 shutdown 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.227+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3757080950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 msgr2=0x55fbc58db230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.227+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 0x55fbc58db230 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe28800ba90 tx=0x7fe28800bf50 comp rx=0 tx=0).stop 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.227+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3757080950 shutdown_connections 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.227+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58dde50 0x55fbc58db770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.227+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55fbc58edc00 0x55fbc58f0030 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.227+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 0x55fbc58db230 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.227+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/3757080950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d2c70 0x55fbc58dacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.227+0000 7fe282a00640 0 client.16278 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.227+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3757080950 >> 172.21.15.50:0/3757080950 conn(0x55fbc58cf200 msgr2=0x55fbc58d4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.227+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3757080950 shutdown_connections 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.227+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3757080950 wait complete. 2024-09-10T10:16:13.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.227+0000 7fe2a63c9740 20 client.16278 trim_cache size 0 max 16384 2024-09-10T10:16:13.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.241+0000 7fe2a63c9740 1 Processor -- start 2024-09-10T10:16:13.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.241+0000 7fe2a63c9740 1 -- start start 2024-09-10T10:16:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.241+0000 7fe2a63c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58d2c70 0x55fbc58d56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.241+0000 7fe2a63c9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d3590 0x55fbc58ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.241+0000 7fe2a63c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58dde50 0x55fbc58f5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.241+0000 7fe2a63c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1b3770 con 0x55fbc58dde50 2024-09-10T10:16:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.241+0000 7fe2a63c9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1b1040 con 0x55fbc58d3590 2024-09-10T10:16:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.241+0000 7fe2a63c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1aee90 con 0x55fbc58d2c70 2024-09-10T10:16:13.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.242+0000 7fe2a1800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58dde50 0x55fbc58f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.242+0000 7fe2a0e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58d2c70 0x55fbc58d56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.242+0000 7fe29be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d3590 0x55fbc58ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.242+0000 7fe2a0e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58d2c70 0x55fbc58d56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50092/0 (socket says 172.21.15.50:50092) 2024-09-10T10:16:13.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.242+0000 7fe2a1800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58dde50 0x55fbc58f5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41230/0 (socket says 172.21.15.50:41230) 2024-09-10T10:16:13.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.242+0000 7fe2a0e00640 1 -- 172.21.15.50:0/866491816 learned_addr learned my addr 172.21.15.50:0/866491816 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:13.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.242+0000 7fe2a0e00640 1 -- 172.21.15.50:0/866491816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d3590 msgr2=0x55fbc58ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:13.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.242+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/866491816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d3590 0x55fbc58ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.242+0000 7fe2a0e00640 1 -- 172.21.15.50:0/866491816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58dde50 msgr2=0x55fbc58f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:13.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.242+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/866491816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58dde50 0x55fbc58f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.242+0000 7fe2a0e00640 1 -- 172.21.15.50:0/866491816 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc58ca770 con 0x55fbc58d2c70 2024-09-10T10:16:13.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.242+0000 7fe29be00640 1 --2- 172.21.15.50:0/866491816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d3590 0x55fbc58ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:13.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.243+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/866491816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58d2c70 0x55fbc58d56d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe2900bbc40 tx=0x7fe2900f9720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be218ebaa1bfc346 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:13.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.243+0000 7fe28d600640 1 -- 172.21.15.50:0/866491816 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2900fe020 con 0x55fbc58d2c70 2024-09-10T10:16:13.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.243+0000 7fe28d600640 1 -- 172.21.15.50:0/866491816 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2900f5810 con 0x55fbc58d2c70 2024-09-10T10:16:13.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.243+0000 7fe28d600640 1 -- 172.21.15.50:0/866491816 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290049070 con 0x55fbc58d2c70 2024-09-10T10:16:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.244+0000 7fe2a63c9740 1 -- 172.21.15.50:0/866491816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58d2c70 msgr2=0x55fbc58d56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.244+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/866491816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58d2c70 0x55fbc58d56d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe2900bbc40 tx=0x7fe2900f9720 comp rx=0 tx=0).stop 2024-09-10T10:16:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.244+0000 7fe2a63c9740 1 -- 172.21.15.50:0/866491816 shutdown_connections 2024-09-10T10:16:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.244+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/866491816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58dde50 0x55fbc58f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.244+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/866491816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d3590 0x55fbc58ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.244+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/866491816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58d2c70 0x55fbc58d56d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.244+0000 7fe2a63c9740 1 -- 172.21.15.50:0/866491816 >> 172.21.15.50:0/866491816 conn(0x55fbc58cf200 msgr2=0x55fbc58cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.244+0000 7fe2a63c9740 1 -- 172.21.15.50:0/866491816 shutdown_connections 2024-09-10T10:16:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.244+0000 7fe2a63c9740 1 -- 172.21.15.50:0/866491816 wait complete. 2024-09-10T10:16:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.244+0000 7fe2a63c9740 1 -- start start 2024-09-10T10:16:13.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.245+0000 7fe2a63c9740 1 Processor -- start 2024-09-10T10:16:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.245+0000 7fe2a63c9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d2c70 0x55fbc58e1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.245+0000 7fe2a63c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 0x55fbc58e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.245+0000 7fe2a63c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58dde50 0x55fbc59578d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.245+0000 7fe2a63c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1af500 con 0x55fbc58d3590 2024-09-10T10:16:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.245+0000 7fe2a63c9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1b0970 con 0x55fbc58d2c70 2024-09-10T10:16:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.245+0000 7fe2a63c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1afbd0 con 0x55fbc58dde50 2024-09-10T10:16:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.245+0000 7fe2a63c9740 10 client.0 _ll_register_callbacks cb 0x7fe2880042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.245+0000 7fe29be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 0x55fbc58e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.245+0000 7fe29be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 0x55fbc58e20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41234/0 (socket says 172.21.15.50:41234) 2024-09-10T10:16:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.245+0000 7fe29be00640 1 -- 172.21.15.50:0/3213453533 learned_addr learned my addr 172.21.15.50:0/3213453533 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.245+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d2c70 0x55fbc58e1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.246+0000 7fe2a1800640 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58dde50 0x55fbc59578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.246+0000 7fe29be00640 1 -- 172.21.15.50:0/3213453533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58dde50 msgr2=0x55fbc59578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.246+0000 7fe29be00640 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58dde50 0x55fbc59578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.246+0000 7fe29be00640 1 -- 172.21.15.50:0/3213453533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d2c70 msgr2=0x55fbc58e1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.246+0000 7fe29be00640 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d2c70 0x55fbc58e1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.246+0000 7fe29be00640 1 -- 172.21.15.50:0/3213453533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc58e2950 con 0x55fbc58d3590 2024-09-10T10:16:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.246+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d2c70 0x55fbc58e1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:13.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.246+0000 7fe29be00640 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 0x55fbc58e20a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55fbc58da580 tx=0x7fe28800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92549cb398a80b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.246+0000 7fe282a00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.246+0000 7fe282a00640 1 -- 172.21.15.50:0/3213453533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28801bab0 con 0x55fbc58d3590 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.247+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3213453533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2900f5810 con 0x55fbc58d3590 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.247+0000 7fe282a00640 1 -- 172.21.15.50:0/3213453533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fe28801bc50 con 0x55fbc58d3590 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.247+0000 7fe282a00640 1 -- 172.21.15.50:0/3213453533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe288039050 con 0x55fbc58d3590 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.247+0000 7fe2a63c9740 10 client.16284 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.247+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3213453533 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fbc5958f20 con 0x55fbc58d3590 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.247+0000 7fe282a00640 1 -- 172.21.15.50:0/3213453533 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2900f5810 con 0x55fbc58d3590 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.247+0000 7fe282a00640 1 -- 172.21.15.50:0/3213453533 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe288004950 con 0x55fbc58d3590 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.247+0000 7fe2a63c9740 10 client.16284 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.247+0000 7fe2a63c9740 10 client.16284 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.247+0000 7fe2a63c9740 20 client.16284 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.247+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55fbc59596d0 0x55fbc595baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.247+0000 7fe2a63c9740 4 client.16284 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:16:13.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.248+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3213453533 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fbc5840e60 con 0x55fbc59596d0 2024-09-10T10:16:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.248+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55fbc59596d0 0x55fbc595baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe2a0e00640 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55fbc59596d0 0x55fbc595baf0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6f3e1b48efebf874 server_cookie=a4f4683b3fff0872 in_seq=0 out_seq=0 2024-09-10T10:16:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe282a00640 10 client.16284 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:16:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe282a00640 1 -- 172.21.15.50:0/3213453533 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fbc5840e60 con 0x55fbc59596d0 2024-09-10T10:16:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe282a00640 10 client.16284 handle_command_reply: tid=0 2024-09-10T10:16:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe2a63c9740 1 client.16284 shutdown 2024-09-10T10:16:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3213453533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 msgr2=0x55fbc58e20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:13.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 0x55fbc58e20a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55fbc58da580 tx=0x7fe28800b700 comp rx=0 tx=0).stop 2024-09-10T10:16:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3213453533 shutdown_connections 2024-09-10T10:16:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fbc58dde50 0x55fbc59578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55fbc59596d0 0x55fbc595baf0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fbc58d3590 0x55fbc58e20a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe2a63c9740 1 --2- 172.21.15.50:0/3213453533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fbc58d2c70 0x55fbc58e1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3213453533 >> 172.21.15.50:0/3213453533 conn(0x55fbc58cf200 msgr2=0x55fbc58dac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe282a00640 0 client.16284 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:16:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3213453533 shutdown_connections 2024-09-10T10:16:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe2a63c9740 1 -- 172.21.15.50:0/3213453533 wait complete. 2024-09-10T10:16:13.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.249+0000 7fe2a63c9740 20 client.16284 trim_cache size 0 max 16384 2024-09-10T10:16:13.254 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:16:13.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.250+0000 7fe2a3800640 1 -- 172.21.15.50:0/4072085586 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe2840a2b80 msgr2=0x7fe2840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:13.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.250+0000 7fe2a3800640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe2840a2b80 0x7fe2840a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe294005fd0 tx=0x7fe294009500 comp rx=0 tx=0).stop 2024-09-10T10:16:13.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.250+0000 7fe2a3800640 1 -- 172.21.15.50:0/4072085586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe29c103ff0 msgr2=0x7fe29c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:13.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.250+0000 7fe2a3800640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe29c103ff0 0x7fe29c19a600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe290006010 tx=0x7fe2900042f0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.250+0000 7fe2a3800640 1 -- 172.21.15.50:0/4072085586 shutdown_connections 2024-09-10T10:16:13.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.250+0000 7fe2a3800640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fe2840a2b80 0x7fe2840a5040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.250+0000 7fe2a3800640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe29c109120 0x7fe29c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.250+0000 7fe2a3800640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe29c1049a0 0x7fe29c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.250+0000 7fe2a3800640 1 --2- 172.21.15.50:0/4072085586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe29c103ff0 0x7fe29c19a600 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.250+0000 7fe2a3800640 1 -- 172.21.15.50:0/4072085586 >> 172.21.15.50:0/4072085586 conn(0x7fe29c0ffa90 msgr2=0x7fe29c100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.251+0000 7fe2a3800640 1 -- 172.21.15.50:0/4072085586 shutdown_connections 2024-09-10T10:16:13.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:13.251+0000 7fe2a3800640 1 -- 172.21.15.50:0/4072085586 wait complete. 2024-09-10T10:16:14.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:13 smithi189 ceph-mon[34999]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 355 MiB/s rd, 938 B/s wr, 96 op/s 2024-09-10T10:16:14.099 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:13 smithi084 ceph-mon[34812]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 355 MiB/s rd, 938 B/s wr, 96 op/s 2024-09-10T10:16:14.144 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:13 smithi050 ceph-mon[30354]: pgmap v542: 129 pgs: 129 active+clean; 10 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 355 MiB/s rd, 938 B/s wr, 96 op/s 2024-09-10T10:16:14.213 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T10:16:14.919 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:16.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:15 smithi189 ceph-mon[34999]: pgmap v543: 129 pgs: 129 active+clean; 9.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 277 MiB/s rd, 1023 B/s wr, 83 op/s 2024-09-10T10:16:16.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:15 smithi084 ceph-mon[34812]: pgmap v543: 129 pgs: 129 active+clean; 9.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 277 MiB/s rd, 1023 B/s wr, 83 op/s 2024-09-10T10:16:16.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:15 smithi050 ceph-mon[30354]: pgmap v543: 129 pgs: 129 active+clean; 9.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 277 MiB/s rd, 1023 B/s wr, 83 op/s 2024-09-10T10:16:17.854 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:16:17.854 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:16:17.854 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-09-10T10:16:17.854 INFO:tasks.workunit.client.0.smithi050.stdout:iozone test complete. 2024-09-10T10:16:17.858 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T10:16:17.858 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T10:16:17.930 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-09-10T10:16:17.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T10:16:17.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.712+0000 7fd840a00640 1 -- 172.21.15.50:0/1024744873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd83c074e30 msgr2=0x7fd83c10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:17.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.712+0000 7fd840a00640 1 --2- 172.21.15.50:0/1024744873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd83c074e30 0x7fd83c10dd40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd828009900 tx=0x7fd82802a490 comp rx=0 tx=0).stop 2024-09-10T10:16:17.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.712+0000 7fd840a00640 1 -- 172.21.15.50:0/1024744873 shutdown_connections 2024-09-10T10:16:17.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.712+0000 7fd840a00640 1 --2- 172.21.15.50:0/1024744873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c10e280 0x7fd83c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.712+0000 7fd840a00640 1 --2- 172.21.15.50:0/1024744873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd83c074e30 0x7fd83c10dd40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.712+0000 7fd840a00640 1 --2- 172.21.15.50:0/1024744873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd83c074510 0x7fd83c0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.712+0000 7fd840a00640 1 -- 172.21.15.50:0/1024744873 >> 172.21.15.50:0/1024744873 conn(0x7fd83c0fd740 msgr2=0x7fd83c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.712+0000 7fd840a00640 1 -- 172.21.15.50:0/1024744873 shutdown_connections 2024-09-10T10:16:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.714+0000 7fd840a00640 1 -- 172.21.15.50:0/1024744873 wait complete. 2024-09-10T10:16:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.715+0000 7fd840a00640 1 Processor -- start 2024-09-10T10:16:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.715+0000 7fd840a00640 1 -- start start 2024-09-10T10:16:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.715+0000 7fd840a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd83c074510 0x7fd83c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.715+0000 7fd840a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c074e30 0x7fd83c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd840a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd83c10e280 0x7fd83c19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd840a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c113fb0 con 0x7fd83c074e30 2024-09-10T10:16:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd840a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c113e30 con 0x7fd83c10e280 2024-09-10T10:16:17.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd840a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c114130 con 0x7fd83c074510 2024-09-10T10:16:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd83aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c074e30 0x7fd83c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd83aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c074e30 0x7fd83c19aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41260/0 (socket says 172.21.15.50:41260) 2024-09-10T10:16:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd83b400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd83c074510 0x7fd83c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd83aa00640 1 -- 172.21.15.50:0/376385356 learned_addr learned my addr 172.21.15.50:0/376385356 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd83be00640 1 --2- 172.21.15.50:0/376385356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd83c10e280 0x7fd83c19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd83be00640 1 -- 172.21.15.50:0/376385356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd83c074510 msgr2=0x7fd83c19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd83be00640 1 --2- 172.21.15.50:0/376385356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd83c074510 0x7fd83c19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd83be00640 1 -- 172.21.15.50:0/376385356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c074e30 msgr2=0x7fd83c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd83be00640 1 --2- 172.21.15.50:0/376385356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c074e30 0x7fd83c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.716+0000 7fd83be00640 1 -- 172.21.15.50:0/376385356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c19f4c0 con 0x7fd83c10e280 2024-09-10T10:16:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.717+0000 7fd83be00640 1 --2- 172.21.15.50:0/376385356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd83c10e280 0x7fd83c19ede0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd834005fd0 tx=0x7fd83400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.717+0000 7fd833e00640 1 -- 172.21.15.50:0/376385356 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83400cdf0 con 0x7fd83c10e280 2024-09-10T10:16:17.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.717+0000 7fd840a00640 1 -- 172.21.15.50:0/376385356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83c19f7b0 con 0x7fd83c10e280 2024-09-10T10:16:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.717+0000 7fd833e00640 1 -- 172.21.15.50:0/376385356 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd834005020 con 0x7fd83c10e280 2024-09-10T10:16:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.717+0000 7fd833e00640 1 -- 172.21.15.50:0/376385356 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8340106d0 con 0x7fd83c10e280 2024-09-10T10:16:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.717+0000 7fd840a00640 1 -- 172.21.15.50:0/376385356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83c1a7090 con 0x7fd83c10e280 2024-09-10T10:16:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.721+0000 7fd8449f6740 1 Processor -- start 2024-09-10T10:16:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.722+0000 7fd833e00640 1 -- 172.21.15.50:0/376385356 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd8340054d0 con 0x7fd83c10e280 2024-09-10T10:16:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.722+0000 7fd8449f6740 1 -- start start 2024-09-10T10:16:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.722+0000 7fd8449f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518ae40 0x559db518b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.722+0000 7fd8449f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518b760 0x559db5195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.722+0000 7fd8449f6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db5196020 0x559db5198410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.722+0000 7fd8449f6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559db50f13e0 con 0x559db5196020 2024-09-10T10:16:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.722+0000 7fd8449f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559db5098d80 con 0x559db518ae40 2024-09-10T10:16:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.722+0000 7fd8449f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559db50ed3a0 con 0x559db518b760 2024-09-10T10:16:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.723+0000 7fd83aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db5196020 0x559db5198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.723+0000 7fd83aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db5196020 0x559db5198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41268/0 (socket says 172.21.15.50:41268) 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.723+0000 7fd83aa00640 1 -- 172.21.15.50:0/3885420718 learned_addr learned my addr 172.21.15.50:0/3885420718 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.723+0000 7fd83b400640 1 --2- 172.21.15.50:0/3885420718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518b760 0x559db5195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.723+0000 7fd83aa00640 1 --2- 172.21.15.50:0/3885420718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518ae40 0x559db518b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.723+0000 7fd833e00640 1 --2- 172.21.15.50:0/376385356 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd8200a2b80 0x7fd8200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.723+0000 7fd83b400640 1 -- 172.21.15.50:0/3885420718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518ae40 msgr2=0x559db518b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.723+0000 7fd83b400640 1 --2- 172.21.15.50:0/3885420718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518ae40 0x559db518b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.723+0000 7fd83b400640 1 -- 172.21.15.50:0/3885420718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db5196020 msgr2=0x559db5198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.723+0000 7fd83b400640 1 --2- 172.21.15.50:0/3885420718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db5196020 0x559db5198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.723+0000 7fd83b400640 1 -- 172.21.15.50:0/3885420718 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559db50b7ae0 con 0x559db518b760 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.723+0000 7fd83aa00640 1 --2- 172.21.15.50:0/3885420718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db5196020 0x559db5198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.724+0000 7fd833e00640 1 -- 172.21.15.50:0/376385356 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fd8340cfae0 con 0x7fd83c10e280 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.724+0000 7fd83be00640 1 --2- 172.21.15.50:0/376385356 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd8200a2b80 0x7fd8200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.724+0000 7fd83b400640 1 --2- 172.21.15.50:0/3885420718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518b760 0x559db5195ae0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009c00 tx=0x7fd82c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7e2d9e63d16b9f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.724+0000 7fd827e00640 1 -- 172.21.15.50:0/3885420718 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c004230 con 0x559db518b760 2024-09-10T10:16:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.724+0000 7fd827e00640 1 -- 172.21.15.50:0/3885420718 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd82c0043d0 con 0x559db518b760 2024-09-10T10:16:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.724+0000 7fd827e00640 1 -- 172.21.15.50:0/3885420718 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c004d20 con 0x559db518b760 2024-09-10T10:16:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.725+0000 7fd8449f6740 1 -- 172.21.15.50:0/3885420718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518b760 msgr2=0x559db5195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.725+0000 7fd8449f6740 1 --2- 172.21.15.50:0/3885420718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518b760 0x559db5195ae0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009c00 tx=0x7fd82c011810 comp rx=0 tx=0).stop 2024-09-10T10:16:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.725+0000 7fd83be00640 1 --2- 172.21.15.50:0/376385356 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd8200a2b80 0x7fd8200a5040 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd834098920 tx=0x7fd8340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.725+0000 7fd8449f6740 1 -- 172.21.15.50:0/3885420718 shutdown_connections 2024-09-10T10:16:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.725+0000 7fd8449f6740 1 --2- 172.21.15.50:0/3885420718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db5196020 0x559db5198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.725+0000 7fd8449f6740 1 --2- 172.21.15.50:0/3885420718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518b760 0x559db5195ae0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.725+0000 7fd8449f6740 1 --2- 172.21.15.50:0/3885420718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518ae40 0x559db518b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.725+0000 7fd8449f6740 1 -- 172.21.15.50:0/3885420718 >> 172.21.15.50:0/3885420718 conn(0x559db51873d0 msgr2=0x559db51877b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.725+0000 7fd8449f6740 1 -- 172.21.15.50:0/3885420718 shutdown_connections 2024-09-10T10:16:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.725+0000 7fd8449f6740 1 -- 172.21.15.50:0/3885420718 wait complete. 2024-09-10T10:16:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.725+0000 7fd8449f6740 1 -- start start 2024-09-10T10:16:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.726+0000 7fd8449f6740 1 Processor -- start 2024-09-10T10:16:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.726+0000 7fd8449f6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 0x559db5192ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.726+0000 7fd8449f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518b760 0x559db5193420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.726+0000 7fd8449f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db5196020 0x559db5193960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.726+0000 7fd8449f6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559db5198bf0 con 0x559db518ae40 2024-09-10T10:16:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.726+0000 7fd8449f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559db50ac0f0 con 0x559db518b760 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.726+0000 7fd8449f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559db5198d70 con 0x559db5196020 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.726+0000 7fd8449f6740 10 client.0 _ll_register_callbacks cb 0x559db5093bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.726+0000 7fd83aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 0x559db5192ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.726+0000 7fd83aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 0x559db5192ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41274/0 (socket says 172.21.15.50:41274) 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.726+0000 7fd83aa00640 1 -- 172.21.15.50:0/474231771 learned_addr learned my addr 172.21.15.50:0/474231771 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.727+0000 7fd83aa00640 1 --2- 172.21.15.50:0/474231771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db5196020 0x559db5193960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.727+0000 7fd83b400640 1 --2- 172.21.15.50:0/474231771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518b760 0x559db5193420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.727+0000 7fd83aa00640 1 -- 172.21.15.50:0/474231771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db5196020 msgr2=0x559db5193960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.727+0000 7fd83aa00640 1 --2- 172.21.15.50:0/474231771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db5196020 0x559db5193960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.727+0000 7fd83aa00640 1 -- 172.21.15.50:0/474231771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518b760 msgr2=0x559db5193420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.727+0000 7fd83aa00640 1 --2- 172.21.15.50:0/474231771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518b760 0x559db5193420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.727+0000 7fd83aa00640 1 -- 172.21.15.50:0/474231771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559db4e623c0 con 0x559db518ae40 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.727+0000 7fd83aa00640 1 --2- 172.21.15.50:0/474231771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 0x559db5192ee0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd828006010 tx=0x7fd828005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d6ecc71f4d1049 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.727+0000 7fd824c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:16:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.727+0000 7fd824c00640 1 -- 172.21.15.50:0/474231771 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828035040 con 0x559db518ae40 2024-09-10T10:16:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.728+0000 7fd824c00640 1 -- 172.21.15.50:0/474231771 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fd828004480 con 0x559db518ae40 2024-09-10T10:16:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.728+0000 7fd8449f6740 1 -- 172.21.15.50:0/474231771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd82c0043d0 con 0x559db518ae40 2024-09-10T10:16:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.728+0000 7fd824c00640 1 -- 172.21.15.50:0/474231771 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd8280035f0 con 0x559db518ae40 2024-09-10T10:16:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.728+0000 7fd8449f6740 10 client.16296 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.728+0000 7fd8449f6740 1 -- 172.21.15.50:0/474231771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559db51a4c00 con 0x559db518ae40 2024-09-10T10:16:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.728+0000 7fd824c00640 1 -- 172.21.15.50:0/474231771 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd82c0043d0 con 0x559db518ae40 2024-09-10T10:16:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.728+0000 7fd824c00640 1 -- 172.21.15.50:0/474231771 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fd82804b070 con 0x559db518ae40 2024-09-10T10:16:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.728+0000 7fd8449f6740 10 client.16296 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.728+0000 7fd8449f6740 10 client.16296 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:16:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.728+0000 7fd8449f6740 20 client.16296 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.728+0000 7fd8449f6740 1 --2- 172.21.15.50:0/474231771 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x559db51a6010 0x559db51a8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.728+0000 7fd8449f6740 4 client.16296 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:16:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.728+0000 7fd8449f6740 1 -- 172.21.15.50:0/474231771 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559db50fe950 con 0x559db51a6010 2024-09-10T10:16:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.729+0000 7fd83b400640 1 --2- 172.21.15.50:0/474231771 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x559db51a6010 0x559db51a8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.729+0000 7fd83b400640 1 --2- 172.21.15.50:0/474231771 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x559db51a6010 0x559db51a8400 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c08e68c908cc7b1b server_cookie=16c522c175c56971 in_seq=0 out_seq=0 2024-09-10T10:16:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.729+0000 7fd824c00640 10 client.16296 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:16:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.730+0000 7fd824c00640 1 -- 172.21.15.50:0/474231771 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559db50fe950 con 0x559db51a6010 2024-09-10T10:16:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.730+0000 7fd824c00640 10 client.16296 handle_command_reply: tid=0 2024-09-10T10:16:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.730+0000 7fd8449f6740 1 client.16296 shutdown 2024-09-10T10:16:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.731+0000 7fd8449f6740 1 -- 172.21.15.50:0/474231771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 msgr2=0x559db5192ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.731+0000 7fd8449f6740 1 --2- 172.21.15.50:0/474231771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 0x559db5192ee0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd828006010 tx=0x7fd828005d50 comp rx=0 tx=0).stop 2024-09-10T10:16:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.731+0000 7fd8449f6740 1 -- 172.21.15.50:0/474231771 shutdown_connections 2024-09-10T10:16:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.731+0000 7fd8449f6740 1 --2- 172.21.15.50:0/474231771 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x559db51a6010 0x559db51a8400 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.972 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.731+0000 7fd8449f6740 1 --2- 172.21.15.50:0/474231771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db5196020 0x559db5193960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.731+0000 7fd8449f6740 1 --2- 172.21.15.50:0/474231771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518b760 0x559db5193420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.731+0000 7fd824c00640 0 client.16296 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:16:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.731+0000 7fd8449f6740 1 --2- 172.21.15.50:0/474231771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 0x559db5192ee0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.731+0000 7fd8449f6740 1 -- 172.21.15.50:0/474231771 >> 172.21.15.50:0/474231771 conn(0x559db51873d0 msgr2=0x559db518d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.731+0000 7fd8449f6740 1 -- 172.21.15.50:0/474231771 shutdown_connections 2024-09-10T10:16:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.731+0000 7fd8449f6740 1 -- 172.21.15.50:0/474231771 wait complete. 2024-09-10T10:16:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.731+0000 7fd8449f6740 20 client.16296 trim_cache size 0 max 16384 2024-09-10T10:16:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.746+0000 7fd8449f6740 1 Processor -- start 2024-09-10T10:16:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.746+0000 7fd8449f6740 1 -- start start 2024-09-10T10:16:17.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.746+0000 7fd8449f6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 0x559db518d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.746+0000 7fd8449f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518b760 0x559db5194e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.746+0000 7fd8449f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db5196020 0x559db51adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.746+0000 7fd8449f6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1b3630 con 0x559db518ae40 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.746+0000 7fd8449f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1b0f00 con 0x559db5196020 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.746+0000 7fd8449f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1aed50 con 0x559db518b760 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.746+0000 7fd83aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 0x559db518d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.746+0000 7fd83aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 0x559db518d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41288/0 (socket says 172.21.15.50:41288) 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.746+0000 7fd83aa00640 1 -- 172.21.15.50:0/641468459 learned_addr learned my addr 172.21.15.50:0/641468459 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.746+0000 7fd83b400640 1 --2- 172.21.15.50:0/641468459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518b760 0x559db5194e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.747+0000 7fd83aa00640 1 --2- 172.21.15.50:0/641468459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db5196020 0x559db51adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.747+0000 7fd83aa00640 1 -- 172.21.15.50:0/641468459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518b760 msgr2=0x559db5194e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.747+0000 7fd83aa00640 1 --2- 172.21.15.50:0/641468459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518b760 0x559db5194e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.747+0000 7fd83aa00640 1 -- 172.21.15.50:0/641468459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db5196020 msgr2=0x559db51adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.747+0000 7fd83aa00640 1 --2- 172.21.15.50:0/641468459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db5196020 0x559db51adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.747+0000 7fd83aa00640 1 -- 172.21.15.50:0/641468459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559db5188060 con 0x559db518ae40 2024-09-10T10:16:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.747+0000 7fd83aa00640 1 --2- 172.21.15.50:0/641468459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 0x559db518d8a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd828032d80 tx=0x7fd828032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2239c6c0f5689b8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.748+0000 7fd827400640 1 -- 172.21.15.50:0/641468459 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828035070 con 0x559db518ae40 2024-09-10T10:16:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.748+0000 7fd827400640 1 -- 172.21.15.50:0/641468459 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd828031d50 con 0x559db518ae40 2024-09-10T10:16:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.748+0000 7fd827400640 1 -- 172.21.15.50:0/641468459 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828003790 con 0x559db518ae40 2024-09-10T10:16:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.749+0000 7fd8449f6740 1 -- 172.21.15.50:0/641468459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 msgr2=0x559db518d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.749+0000 7fd8449f6740 1 --2- 172.21.15.50:0/641468459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 0x559db518d8a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd828032d80 tx=0x7fd828032d10 comp rx=0 tx=0).stop 2024-09-10T10:16:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.749+0000 7fd8449f6740 1 -- 172.21.15.50:0/641468459 shutdown_connections 2024-09-10T10:16:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.749+0000 7fd8449f6740 1 --2- 172.21.15.50:0/641468459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db5196020 0x559db51adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.749+0000 7fd8449f6740 1 --2- 172.21.15.50:0/641468459 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518b760 0x559db5194e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.749+0000 7fd8449f6740 1 --2- 172.21.15.50:0/641468459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db518ae40 0x559db518d8a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.749+0000 7fd8449f6740 1 -- 172.21.15.50:0/641468459 >> 172.21.15.50:0/641468459 conn(0x559db51873d0 msgr2=0x559db5194740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.749+0000 7fd8449f6740 1 -- 172.21.15.50:0/641468459 shutdown_connections 2024-09-10T10:16:17.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.749+0000 7fd8449f6740 1 -- 172.21.15.50:0/641468459 wait complete. 2024-09-10T10:16:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.749+0000 7fd8449f6740 1 -- start start 2024-09-10T10:16:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.750+0000 7fd8449f6740 1 Processor -- start 2024-09-10T10:16:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.750+0000 7fd8449f6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518ae40 0x559db5208fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.750+0000 7fd8449f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518b760 0x559db5209520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.750+0000 7fd8449f6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db5196020 0x559db5199560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.750+0000 7fd8449f6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1af3c0 con 0x559db5196020 2024-09-10T10:16:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.750+0000 7fd8449f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1b0830 con 0x559db518b760 2024-09-10T10:16:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.750+0000 7fd8449f6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1afa90 con 0x559db518ae40 2024-09-10T10:16:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.750+0000 7fd8449f6740 10 client.0 _ll_register_callbacks cb 0x7fd828009540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.750+0000 7fd83aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518ae40 0x559db5208fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.750+0000 7fd83aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518ae40 0x559db5208fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50142/0 (socket says 172.21.15.50:50142) 2024-09-10T10:16:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.750+0000 7fd83aa00640 1 -- 172.21.15.50:0/3999945676 learned_addr learned my addr 172.21.15.50:0/3999945676 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.750+0000 7fd83aa00640 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db5196020 0x559db5199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.751+0000 7fd83b400640 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518b760 0x559db5209520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.751+0000 7fd83aa00640 1 -- 172.21.15.50:0/3999945676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518b760 msgr2=0x559db5209520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.751+0000 7fd83aa00640 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518b760 0x559db5209520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.751+0000 7fd83aa00640 1 -- 172.21.15.50:0/3999945676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db5196020 msgr2=0x559db5199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.751+0000 7fd83aa00640 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db5196020 0x559db5199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.751+0000 7fd83aa00640 1 -- 172.21.15.50:0/3999945676 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559db5199d60 con 0x559db518ae40 2024-09-10T10:16:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.751+0000 7fd83b400640 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518b760 0x559db5209520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.751+0000 7fd83aa00640 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518ae40 0x559db5208fe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd828009850 tx=0x7fd828005390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9288e2fc67bb3457 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.751+0000 7fd824c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:16:17.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.751+0000 7fd824c00640 1 -- 172.21.15.50:0/3999945676 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828035070 con 0x559db518ae40 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.751+0000 7fd8449f6740 1 -- 172.21.15.50:0/3999945676 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd828031d50 con 0x559db518ae40 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.751+0000 7fd824c00640 1 -- 172.21.15.50:0/3999945676 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fd82803d900 con 0x559db518ae40 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.752+0000 7fd824c00640 1 -- 172.21.15.50:0/3999945676 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd82803db00 con 0x559db518ae40 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.752+0000 7fd8449f6740 10 client.26371 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.752+0000 7fd8449f6740 1 -- 172.21.15.50:0/3999945676 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559db5210780 con 0x559db518ae40 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.752+0000 7fd824c00640 1 -- 172.21.15.50:0/3999945676 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd828031d50 con 0x559db518ae40 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.752+0000 7fd824c00640 1 -- 172.21.15.50:0/3999945676 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fd82804b070 con 0x559db518ae40 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.752+0000 7fd8449f6740 10 client.26371 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.752+0000 7fd8449f6740 10 client.26371 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.752+0000 7fd8449f6740 20 client.26371 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.752+0000 7fd8449f6740 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x559db5210b60 0x559db5212f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.752+0000 7fd8449f6740 4 client.26371 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.752+0000 7fd8449f6740 1 -- 172.21.15.50:0/3999945676 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559db50f8e60 con 0x559db5210b60 2024-09-10T10:16:17.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd83b400640 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x559db5210b60 0x559db5212f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd83b400640 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x559db5210b60 0x559db5212f50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3cdac3c8096cb188 server_cookie=2a5755196dcb549a in_seq=0 out_seq=0 2024-09-10T10:16:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd824c00640 10 client.26371 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:16:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd824c00640 1 -- 172.21.15.50:0/3999945676 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559db50f8e60 con 0x559db5210b60 2024-09-10T10:16:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd824c00640 10 client.26371 handle_command_reply: tid=0 2024-09-10T10:16:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd8449f6740 1 client.26371 shutdown 2024-09-10T10:16:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd8449f6740 1 -- 172.21.15.50:0/3999945676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518ae40 msgr2=0x559db5208fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd8449f6740 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518ae40 0x559db5208fe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd828009850 tx=0x7fd828005390 comp rx=0 tx=0).stop 2024-09-10T10:16:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd8449f6740 1 -- 172.21.15.50:0/3999945676 shutdown_connections 2024-09-10T10:16:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd8449f6740 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x559db5210b60 0x559db5212f50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd8449f6740 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559db5196020 0x559db5199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd8449f6740 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559db518b760 0x559db5209520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd8449f6740 1 --2- 172.21.15.50:0/3999945676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559db518ae40 0x559db5208fe0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd824c00640 0 client.26371 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:16:17.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.753+0000 7fd8449f6740 1 -- 172.21.15.50:0/3999945676 >> 172.21.15.50:0/3999945676 conn(0x559db51873d0 msgr2=0x559db51936c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:17.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.754+0000 7fd8449f6740 1 -- 172.21.15.50:0/3999945676 shutdown_connections 2024-09-10T10:16:17.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.754+0000 7fd8449f6740 1 -- 172.21.15.50:0/3999945676 wait complete. 2024-09-10T10:16:17.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.754+0000 7fd8449f6740 20 client.26371 trim_cache size 0 max 16384 2024-09-10T10:16:17.980 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:16:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.754+0000 7fd840a00640 1 -- 172.21.15.50:0/376385356 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd8200a2b80 msgr2=0x7fd8200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.754+0000 7fd840a00640 1 --2- 172.21.15.50:0/376385356 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd8200a2b80 0x7fd8200a5040 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd834098920 tx=0x7fd8340058d0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.754+0000 7fd840a00640 1 -- 172.21.15.50:0/376385356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd83c10e280 msgr2=0x7fd83c19ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.754+0000 7fd840a00640 1 --2- 172.21.15.50:0/376385356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd83c10e280 0x7fd83c19ede0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd834005fd0 tx=0x7fd83400ef10 comp rx=0 tx=0).stop 2024-09-10T10:16:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.755+0000 7fd840a00640 1 -- 172.21.15.50:0/376385356 shutdown_connections 2024-09-10T10:16:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.755+0000 7fd840a00640 1 --2- 172.21.15.50:0/376385356 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd8200a2b80 0x7fd8200a5040 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.755+0000 7fd840a00640 1 --2- 172.21.15.50:0/376385356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd83c10e280 0x7fd83c19ede0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.755+0000 7fd840a00640 1 --2- 172.21.15.50:0/376385356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd83c074e30 0x7fd83c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.755+0000 7fd840a00640 1 --2- 172.21.15.50:0/376385356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd83c074510 0x7fd83c19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:17.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.755+0000 7fd840a00640 1 -- 172.21.15.50:0/376385356 >> 172.21.15.50:0/376385356 conn(0x7fd83c0fd740 msgr2=0x7fd83c0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:17.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.755+0000 7fd840a00640 1 -- 172.21.15.50:0/376385356 shutdown_connections 2024-09-10T10:16:17.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:15.755+0000 7fd840a00640 1 -- 172.21.15.50:0/376385356 wait complete. 2024-09-10T10:16:18.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:17 smithi050 ceph-mon[30354]: pgmap v544: 129 pgs: 129 active+clean; 6.9 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 188 MiB/s rd, 1023 B/s wr, 120 op/s 2024-09-10T10:16:18.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:17 smithi189 ceph-mon[34999]: pgmap v544: 129 pgs: 129 active+clean; 6.9 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 188 MiB/s rd, 1023 B/s wr, 120 op/s 2024-09-10T10:16:18.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:17 smithi084 ceph-mon[34812]: pgmap v544: 129 pgs: 129 active+clean; 6.9 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 188 MiB/s rd, 1023 B/s wr, 120 op/s 2024-09-10T10:16:18.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T10:16:19.031 DEBUG:teuthology.parallel:result is None 2024-09-10T10:16:19.031 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T10:16:19.098 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T10:16:19.098 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-10T10:16:19.109 INFO:tasks.quiescer:joining Quiescers 2024-09-10T10:16:19.109 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-10T10:16:19.109 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:16:19.194 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:19.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.793+0000 7effe2000640 1 -- 172.21.15.50:0/1768903376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc109120 msgr2=0x7effdc110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:19.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.793+0000 7effe2000640 1 --2- 172.21.15.50:0/1768903376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc109120 0x7effdc110ca0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7effd4009ca0 tx=0x7effd402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.793+0000 7effe2000640 1 -- 172.21.15.50:0/1768903376 shutdown_connections 2024-09-10T10:16:19.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.793+0000 7effe2000640 1 --2- 172.21.15.50:0/1768903376 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc109120 0x7effdc110ca0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.793+0000 7effe2000640 1 --2- 172.21.15.50:0/1768903376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effdc1049a0 0x7effdc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.793+0000 7effe2000640 1 --2- 172.21.15.50:0/1768903376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effdc103ff0 0x7effdc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.793+0000 7effe2000640 1 -- 172.21.15.50:0/1768903376 >> 172.21.15.50:0/1768903376 conn(0x7effdc0ffa90 msgr2=0x7effdc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:19.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.793+0000 7effe2000640 1 -- 172.21.15.50:0/1768903376 shutdown_connections 2024-09-10T10:16:19.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.794+0000 7effe2000640 1 -- 172.21.15.50:0/1768903376 wait complete. 2024-09-10T10:16:19.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.794+0000 7effe2000640 1 Processor -- start 2024-09-10T10:16:19.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.795+0000 7effe2000640 1 -- start start 2024-09-10T10:16:19.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.795+0000 7effe2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effdc103ff0 0x7effdc19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.795+0000 7effe2000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc1049a0 0x7effdc19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.795+0000 7effe2000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effdc109120 0x7effdc19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.795+0000 7effe2000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7effdc114180 con 0x7effdc1049a0 2024-09-10T10:16:19.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.795+0000 7effe2000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7effdc114000 con 0x7effdc103ff0 2024-09-10T10:16:19.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.795+0000 7effe2000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7effdc114300 con 0x7effdc109120 2024-09-10T10:16:19.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.795+0000 7effdaa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc1049a0 0x7effdc19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.795+0000 7effdb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effdc103ff0 0x7effdc19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.795+0000 7effdbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effdc109120 0x7effdc19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.795+0000 7effdb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effdc103ff0 0x7effdc19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37404/0 (socket says 172.21.15.50:37404) 2024-09-10T10:16:19.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.795+0000 7effdb400640 1 -- 172.21.15.50:0/188003694 learned_addr learned my addr 172.21.15.50:0/188003694 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:19.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.796+0000 7effdb400640 1 -- 172.21.15.50:0/188003694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effdc109120 msgr2=0x7effdc19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.796+0000 7effdb400640 1 --2- 172.21.15.50:0/188003694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effdc109120 0x7effdc19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.796+0000 7effdb400640 1 -- 172.21.15.50:0/188003694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc1049a0 msgr2=0x7effdc19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.796+0000 7effdb400640 1 --2- 172.21.15.50:0/188003694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc1049a0 0x7effdc19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.796+0000 7effdb400640 1 -- 172.21.15.50:0/188003694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc19f5f0 con 0x7effdc103ff0 2024-09-10T10:16:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.796+0000 7effdb400640 1 --2- 172.21.15.50:0/188003694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effdc103ff0 0x7effdc19a640 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7effcc00d950 tx=0x7effcc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.797+0000 7effd3e00640 1 -- 172.21.15.50:0/188003694 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc017070 con 0x7effdc103ff0 2024-09-10T10:16:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.797+0000 7effd3e00640 1 -- 172.21.15.50:0/188003694 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effcc009c30 con 0x7effdc103ff0 2024-09-10T10:16:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.797+0000 7effd3e00640 1 -- 172.21.15.50:0/188003694 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc00f6b0 con 0x7effdc103ff0 2024-09-10T10:16:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.797+0000 7effe2000640 1 -- 172.21.15.50:0/188003694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effdc19f8e0 con 0x7effdc103ff0 2024-09-10T10:16:19.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.797+0000 7effe2000640 1 -- 172.21.15.50:0/188003694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effdc1a71c0 con 0x7effdc103ff0 2024-09-10T10:16:19.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.800+0000 7effe4a0e740 1 Processor -- start 2024-09-10T10:16:19.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.800+0000 7effe4a0e740 1 -- start start 2024-09-10T10:16:19.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.800+0000 7effd3e00640 1 -- 172.21.15.50:0/188003694 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7effcc0109d0 con 0x7effdc103ff0 2024-09-10T10:16:19.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.800+0000 7effe4a0e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d65c70 0x564a98d66050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.800+0000 7effe4a0e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d66590 0x564a98d70910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effe4a0e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d70e50 0x564a98d73240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effe4a0e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564a98ccc3e0 con 0x564a98d70e50 2024-09-10T10:16:19.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effe4a0e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564a98c73d80 con 0x564a98d66590 2024-09-10T10:16:19.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effe4a0e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564a98cc83a0 con 0x564a98d65c70 2024-09-10T10:16:19.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effdbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d65c70 0x564a98d66050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effdbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d65c70 0x564a98d66050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50096/0 (socket says 172.21.15.50:50096) 2024-09-10T10:16:19.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effdbe00640 1 -- 172.21.15.50:0/3637837740 learned_addr learned my addr 172.21.15.50:0/3637837740 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:19.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effdb400640 1 --2- 172.21.15.50:0/3637837740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d66590 0x564a98d70910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effdaa00640 1 --2- 172.21.15.50:0/3637837740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d70e50 0x564a98d73240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effdbe00640 1 -- 172.21.15.50:0/3637837740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d66590 msgr2=0x564a98d70910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:19.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effdbe00640 1 --2- 172.21.15.50:0/3637837740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d66590 0x564a98d70910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effdbe00640 1 -- 172.21.15.50:0/3637837740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d70e50 msgr2=0x564a98d73240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:19.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effdbe00640 1 --2- 172.21.15.50:0/3637837740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d70e50 0x564a98d73240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.801+0000 7effdbe00640 1 -- 172.21.15.50:0/3637837740 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a98c92ae0 con 0x564a98d65c70 2024-09-10T10:16:19.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.802+0000 7effdbe00640 1 --2- 172.21.15.50:0/3637837740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d65c70 0x564a98d66050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7effd4009ca0 tx=0x7effd402f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64b406bdbb7e9ad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:19.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.802+0000 7effc7e00640 1 -- 172.21.15.50:0/3637837740 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4003970 con 0x564a98d65c70 2024-09-10T10:16:19.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.802+0000 7effd3e00640 1 --2- 172.21.15.50:0/188003694 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7effc00a2b80 0x7effc00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.802+0000 7effc7e00640 1 -- 172.21.15.50:0/3637837740 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effd4036030 con 0x564a98d65c70 2024-09-10T10:16:19.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.802+0000 7effc7e00640 1 -- 172.21.15.50:0/3637837740 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4004360 con 0x564a98d65c70 2024-09-10T10:16:19.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.802+0000 7effd3e00640 1 -- 172.21.15.50:0/188003694 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7effcc0cefd0 con 0x7effdc103ff0 2024-09-10T10:16:19.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.802+0000 7effdb400640 1 --2- 172.21.15.50:0/188003694 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7effc00a2b80 0x7effc00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.803+0000 7effe4a0e740 1 -- 172.21.15.50:0/3637837740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d65c70 msgr2=0x564a98d66050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.803+0000 7effe4a0e740 1 --2- 172.21.15.50:0/3637837740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d65c70 0x564a98d66050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7effd4009ca0 tx=0x7effd402f3c0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.803+0000 7effdb400640 1 --2- 172.21.15.50:0/188003694 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7effc00a2b80 0x7effc00a5040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7effcc0cf270 tx=0x7effcc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.803+0000 7effe4a0e740 1 -- 172.21.15.50:0/3637837740 shutdown_connections 2024-09-10T10:16:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.803+0000 7effe4a0e740 1 --2- 172.21.15.50:0/3637837740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d70e50 0x564a98d73240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.803+0000 7effe4a0e740 1 --2- 172.21.15.50:0/3637837740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d66590 0x564a98d70910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.803+0000 7effe4a0e740 1 --2- 172.21.15.50:0/3637837740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d65c70 0x564a98d66050 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.803+0000 7effe4a0e740 1 -- 172.21.15.50:0/3637837740 >> 172.21.15.50:0/3637837740 conn(0x564a98d62200 msgr2=0x564a98d625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:19.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.803+0000 7effe4a0e740 1 -- 172.21.15.50:0/3637837740 shutdown_connections 2024-09-10T10:16:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.803+0000 7effe4a0e740 1 -- 172.21.15.50:0/3637837740 wait complete. 2024-09-10T10:16:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.804+0000 7effe4a0e740 1 -- start start 2024-09-10T10:16:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.804+0000 7effe4a0e740 1 Processor -- start 2024-09-10T10:16:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.805+0000 7effe4a0e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d65c70 0x564a98d6dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.805+0000 7effe4a0e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d66590 0x564a98d6e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.805+0000 7effe4a0e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d70e50 0x564a98d6e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.805+0000 7effe4a0e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564a98d738a0 con 0x564a98d65c70 2024-09-10T10:16:19.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.805+0000 7effe4a0e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564a98c870f0 con 0x564a98d70e50 2024-09-10T10:16:19.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.805+0000 7effe4a0e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564a98d73a20 con 0x564a98d66590 2024-09-10T10:16:19.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.805+0000 7effe4a0e740 10 client.0 _ll_register_callbacks cb 0x564a98c6ebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:19.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.805+0000 7effdaa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d66590 0x564a98d6e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.805+0000 7effdbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d65c70 0x564a98d6dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.805+0000 7effdaa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d66590 0x564a98d6e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50112/0 (socket says 172.21.15.50:50112) 2024-09-10T10:16:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.805+0000 7effdaa00640 1 -- 172.21.15.50:0/2822422667 learned_addr learned my addr 172.21.15.50:0/2822422667 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.805+0000 7effdbe00640 1 --2- 172.21.15.50:0/2822422667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d70e50 0x564a98d6e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.806+0000 7effdbe00640 1 -- 172.21.15.50:0/2822422667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d66590 msgr2=0x564a98d6e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.806+0000 7effdbe00640 1 --2- 172.21.15.50:0/2822422667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d66590 0x564a98d6e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.806+0000 7effdbe00640 1 -- 172.21.15.50:0/2822422667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d70e50 msgr2=0x564a98d6e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.806+0000 7effdbe00640 1 --2- 172.21.15.50:0/2822422667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d70e50 0x564a98d6e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.806+0000 7effdbe00640 1 -- 172.21.15.50:0/2822422667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a98a3d3c0 con 0x564a98d65c70 2024-09-10T10:16:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.806+0000 7effdbe00640 1 --2- 172.21.15.50:0/2822422667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d65c70 0x564a98d6dce0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7effd4009bf0 tx=0x7effd4031ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f18c07107bd353 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.806+0000 7effc4c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:16:19.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.806+0000 7effc4c00640 1 -- 172.21.15.50:0/2822422667 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4058060 con 0x564a98d65c70 2024-09-10T10:16:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.806+0000 7effc4c00640 1 -- 172.21.15.50:0/2822422667 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7effd4004340 con 0x564a98d65c70 2024-09-10T10:16:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.806+0000 7effe4a0e740 1 -- 172.21.15.50:0/2822422667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effd4036030 con 0x564a98d65c70 2024-09-10T10:16:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.807+0000 7effc4c00640 1 -- 172.21.15.50:0/2822422667 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7effd405f050 con 0x564a98d65c70 2024-09-10T10:16:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.807+0000 7effe4a0e740 10 client.16314 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.807+0000 7effe4a0e740 1 -- 172.21.15.50:0/2822422667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564a98d738a0 con 0x564a98d65c70 2024-09-10T10:16:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.807+0000 7effc4c00640 1 -- 172.21.15.50:0/2822422667 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effd4036030 con 0x564a98d65c70 2024-09-10T10:16:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.807+0000 7effc4c00640 1 -- 172.21.15.50:0/2822422667 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7effd4043070 con 0x564a98d65c70 2024-09-10T10:16:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.807+0000 7effe4a0e740 10 client.16314 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.808+0000 7effe4a0e740 10 client.16314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:16:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.808+0000 7effe4a0e740 20 client.16314 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.808+0000 7effe4a0e740 1 --2- 172.21.15.50:0/2822422667 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564a98d89200 0x564a98d8b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.808+0000 7effe4a0e740 4 client.16314 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:16:19.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.808+0000 7effe4a0e740 1 -- 172.21.15.50:0/2822422667 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a98cd9950 con 0x564a98d89200 2024-09-10T10:16:19.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.808+0000 7effdaa00640 1 --2- 172.21.15.50:0/2822422667 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564a98d89200 0x564a98d8b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.809+0000 7effdaa00640 1 --2- 172.21.15.50:0/2822422667 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564a98d89200 0x564a98d8b5f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2ab3848234dd0dc server_cookie=fab0e9ae7ebbab39 in_seq=0 out_seq=0 2024-09-10T10:16:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.809+0000 7effc4c00640 10 client.16314 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.810+0000 7effc4c00640 1 -- 172.21.15.50:0/2822422667 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a98cd9950 con 0x564a98d89200 2024-09-10T10:16:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.810+0000 7effc4c00640 10 client.16314 handle_command_reply: tid=0 2024-09-10T10:16:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.810+0000 7effe4a0e740 1 client.16314 shutdown 2024-09-10T10:16:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.810+0000 7effe4a0e740 1 -- 172.21.15.50:0/2822422667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d65c70 msgr2=0x564a98d6dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.810+0000 7effe4a0e740 1 --2- 172.21.15.50:0/2822422667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d65c70 0x564a98d6dce0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7effd4009bf0 tx=0x7effd4031ab0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.810+0000 7effe4a0e740 1 -- 172.21.15.50:0/2822422667 shutdown_connections 2024-09-10T10:16:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.810+0000 7effe4a0e740 1 --2- 172.21.15.50:0/2822422667 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564a98d89200 0x564a98d8b5f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.810+0000 7effe4a0e740 1 --2- 172.21.15.50:0/2822422667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d70e50 0x564a98d6e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.810+0000 7effe4a0e740 1 --2- 172.21.15.50:0/2822422667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d66590 0x564a98d6e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.810+0000 7effe4a0e740 1 --2- 172.21.15.50:0/2822422667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d65c70 0x564a98d6dce0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.810+0000 7effe4a0e740 1 -- 172.21.15.50:0/2822422667 >> 172.21.15.50:0/2822422667 conn(0x564a98d62200 msgr2=0x564a98d61380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:19.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.810+0000 7effc4c00640 0 client.16314 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:19.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.811+0000 7effe4a0e740 1 -- 172.21.15.50:0/2822422667 shutdown_connections 2024-09-10T10:16:19.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.811+0000 7effe4a0e740 1 -- 172.21.15.50:0/2822422667 wait complete. 2024-09-10T10:16:19.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.811+0000 7effe4a0e740 20 client.16314 trim_cache size 0 max 16384 2024-09-10T10:16:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.826+0000 7effe4a0e740 1 Processor -- start 2024-09-10T10:16:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.826+0000 7effe4a0e740 1 -- start start 2024-09-10T10:16:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.826+0000 7effe4a0e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d65c70 0x564a98d6fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.826+0000 7effe4a0e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d66590 0x564a98d90f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.826+0000 7effe4a0e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d70e50 0x564a98d91440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.826+0000 7effe4a0e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1af360 con 0x564a98d66590 2024-09-10T10:16:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.826+0000 7effe4a0e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1acc30 con 0x564a98d70e50 2024-09-10T10:16:19.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.826+0000 7effe4a0e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1aaac0 con 0x564a98d65c70 2024-09-10T10:16:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.827+0000 7effdaa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d66590 0x564a98d90f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.827+0000 7effdbe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d65c70 0x564a98d6fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.827+0000 7effdaa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d66590 0x564a98d90f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55052/0 (socket says 172.21.15.50:55052) 2024-09-10T10:16:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.827+0000 7effdaa00640 1 -- 172.21.15.50:0/1893680461 learned_addr learned my addr 172.21.15.50:0/1893680461 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:19.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.827+0000 7effdbe00640 1 --2- 172.21.15.50:0/1893680461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d70e50 0x564a98d91440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.827+0000 7effdbe00640 1 -- 172.21.15.50:0/1893680461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d70e50 msgr2=0x564a98d91440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.827+0000 7effdbe00640 1 --2- 172.21.15.50:0/1893680461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d70e50 0x564a98d91440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.827+0000 7effdbe00640 1 -- 172.21.15.50:0/1893680461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d66590 msgr2=0x564a98d90f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.827+0000 7effdbe00640 1 --2- 172.21.15.50:0/1893680461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d66590 0x564a98d90f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.827+0000 7effdbe00640 1 -- 172.21.15.50:0/1893680461 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a98d8bc20 con 0x564a98d65c70 2024-09-10T10:16:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.828+0000 7effdbe00640 1 --2- 172.21.15.50:0/1893680461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d65c70 0x564a98d6fc50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7effd4000f80 tx=0x7effd4047040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3019f64a3089c407 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.828+0000 7effc7400640 1 -- 172.21.15.50:0/1893680461 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4058030 con 0x564a98d65c70 2024-09-10T10:16:19.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.828+0000 7effc7400640 1 -- 172.21.15.50:0/1893680461 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effd4036070 con 0x564a98d65c70 2024-09-10T10:16:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.829+0000 7effe4a0e740 1 -- 172.21.15.50:0/1893680461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d65c70 msgr2=0x564a98d6fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.829+0000 7effe4a0e740 1 --2- 172.21.15.50:0/1893680461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d65c70 0x564a98d6fc50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7effd4000f80 tx=0x7effd4047040 comp rx=0 tx=0).stop 2024-09-10T10:16:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.829+0000 7effe4a0e740 1 -- 172.21.15.50:0/1893680461 shutdown_connections 2024-09-10T10:16:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.829+0000 7effe4a0e740 1 --2- 172.21.15.50:0/1893680461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d70e50 0x564a98d91440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.829+0000 7effe4a0e740 1 --2- 172.21.15.50:0/1893680461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d66590 0x564a98d90f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.829+0000 7effe4a0e740 1 --2- 172.21.15.50:0/1893680461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d65c70 0x564a98d6fc50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.829+0000 7effe4a0e740 1 -- 172.21.15.50:0/1893680461 >> 172.21.15.50:0/1893680461 conn(0x564a98d62200 msgr2=0x564a98d6f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:19.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.829+0000 7effe4a0e740 1 -- 172.21.15.50:0/1893680461 shutdown_connections 2024-09-10T10:16:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.829+0000 7effe4a0e740 1 -- 172.21.15.50:0/1893680461 wait complete. 2024-09-10T10:16:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.830+0000 7effe4a0e740 1 -- start start 2024-09-10T10:16:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.830+0000 7effe4a0e740 1 Processor -- start 2024-09-10T10:16:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.831+0000 7effe4a0e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d65c70 0x564a98d7d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.831+0000 7effe4a0e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d66590 0x564a98d7d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.831+0000 7effe4a0e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d70e50 0x564a98d7dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.831+0000 7effe4a0e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1ab110 con 0x564a98d70e50 2024-09-10T10:16:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.831+0000 7effe4a0e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1ac560 con 0x564a98d65c70 2024-09-10T10:16:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.831+0000 7effe4a0e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7effdc1ab7c0 con 0x564a98d66590 2024-09-10T10:16:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.831+0000 7effe4a0e740 10 client.0 _ll_register_callbacks cb 0x7effd402f310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.831+0000 7effdaa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d66590 0x564a98d7d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.831+0000 7effdbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d70e50 0x564a98d7dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.831+0000 7effdaa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d66590 0x564a98d7d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50132/0 (socket says 172.21.15.50:50132) 2024-09-10T10:16:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.831+0000 7effdaa00640 1 -- 172.21.15.50:0/3391106030 learned_addr learned my addr 172.21.15.50:0/3391106030 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:19.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.831+0000 7effdbe00640 1 --2- 172.21.15.50:0/3391106030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d65c70 0x564a98d7d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.832+0000 7effdaa00640 1 -- 172.21.15.50:0/3391106030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d65c70 msgr2=0x564a98d7d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.832+0000 7effdaa00640 1 --2- 172.21.15.50:0/3391106030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d65c70 0x564a98d7d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.832+0000 7effdaa00640 1 -- 172.21.15.50:0/3391106030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d70e50 msgr2=0x564a98d7dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.832+0000 7effdaa00640 1 --2- 172.21.15.50:0/3391106030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d70e50 0x564a98d7dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.832+0000 7effdaa00640 1 -- 172.21.15.50:0/3391106030 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a98d62e90 con 0x564a98d66590 2024-09-10T10:16:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.832+0000 7effdbe00640 1 --2- 172.21.15.50:0/3391106030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d70e50 0x564a98d7dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:16:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.832+0000 7effdaa00640 1 --2- 172.21.15.50:0/3391106030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d66590 0x564a98d7d840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x564a98d6d570 tx=0x7effc8009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6000d004aab01985 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:19.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.832+0000 7effc4c00640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:16:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.832+0000 7effc4c00640 1 -- 172.21.15.50:0/3391106030 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8005220 con 0x564a98d66590 2024-09-10T10:16:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.832+0000 7effe4a0e740 1 -- 172.21.15.50:0/3391106030 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effd4036070 con 0x564a98d66590 2024-09-10T10:16:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.832+0000 7effc4c00640 1 -- 172.21.15.50:0/3391106030 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7effc80053c0 con 0x564a98d66590 2024-09-10T10:16:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.833+0000 7effc4c00640 1 -- 172.21.15.50:0/3391106030 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7effc8030050 con 0x564a98d66590 2024-09-10T10:16:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.833+0000 7effe4a0e740 10 client.26389 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.833+0000 7effe4a0e740 1 -- 172.21.15.50:0/3391106030 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564a98d5d770 con 0x564a98d66590 2024-09-10T10:16:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.833+0000 7effc4c00640 1 -- 172.21.15.50:0/3391106030 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effd4036070 con 0x564a98d66590 2024-09-10T10:16:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.833+0000 7effc4c00640 1 -- 172.21.15.50:0/3391106030 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7effc801fa60 con 0x564a98d66590 2024-09-10T10:16:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.833+0000 7effe4a0e740 10 client.26389 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.833+0000 7effe4a0e740 10 client.26389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:16:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.833+0000 7effe4a0e740 20 client.26389 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:19.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.833+0000 7effe4a0e740 1 --2- 172.21.15.50:0/3391106030 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564a98df4650 0x564a98df6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:19.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.833+0000 7effe4a0e740 4 client.26389 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:16:19.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.833+0000 7effe4a0e740 1 -- 172.21.15.50:0/3391106030 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564a98d69900 con 0x564a98df4650 2024-09-10T10:16:19.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.834+0000 7effdbe00640 1 --2- 172.21.15.50:0/3391106030 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564a98df4650 0x564a98df6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.834+0000 7effdbe00640 1 --2- 172.21.15.50:0/3391106030 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564a98df4650 0x564a98df6a70 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b44e89e1cf454778 server_cookie=6a13744e1e253d99 in_seq=0 out_seq=0 2024-09-10T10:16:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.834+0000 7effc4c00640 10 client.26389 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.834+0000 7effc4c00640 1 -- 172.21.15.50:0/3391106030 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564a98d69900 con 0x564a98df4650 2024-09-10T10:16:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.834+0000 7effc4c00640 10 client.26389 handle_command_reply: tid=0 2024-09-10T10:16:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.834+0000 7effe4a0e740 1 client.26389 shutdown 2024-09-10T10:16:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.835+0000 7effe4a0e740 1 -- 172.21.15.50:0/3391106030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d66590 msgr2=0x564a98d7d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.835+0000 7effe4a0e740 1 --2- 172.21.15.50:0/3391106030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d66590 0x564a98d7d840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x564a98d6d570 tx=0x7effc8009f90 comp rx=0 tx=0).stop 2024-09-10T10:16:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.835+0000 7effe4a0e740 1 -- 172.21.15.50:0/3391106030 shutdown_connections 2024-09-10T10:16:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.835+0000 7effe4a0e740 1 --2- 172.21.15.50:0/3391106030 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x564a98df4650 0x564a98df6a70 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.835+0000 7effe4a0e740 1 --2- 172.21.15.50:0/3391106030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a98d70e50 0x564a98d7dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.835+0000 7effe4a0e740 1 --2- 172.21.15.50:0/3391106030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564a98d66590 0x564a98d7d840 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.835+0000 7effe4a0e740 1 --2- 172.21.15.50:0/3391106030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a98d65c70 0x564a98d7d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.835+0000 7effc4c00640 0 client.26389 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.835+0000 7effe4a0e740 1 -- 172.21.15.50:0/3391106030 >> 172.21.15.50:0/3391106030 conn(0x564a98d62200 msgr2=0x564a98d676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.835+0000 7effe4a0e740 1 -- 172.21.15.50:0/3391106030 shutdown_connections 2024-09-10T10:16:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.835+0000 7effe4a0e740 1 -- 172.21.15.50:0/3391106030 wait complete. 2024-09-10T10:16:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.836+0000 7effe4a0e740 20 client.26389 trim_cache size 0 max 16384 2024-09-10T10:16:19.839 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:16:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.836+0000 7effe2000640 1 -- 172.21.15.50:0/188003694 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7effc00a2b80 msgr2=0x7effc00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.836+0000 7effe2000640 1 --2- 172.21.15.50:0/188003694 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7effc00a2b80 0x7effc00a5040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7effcc0cf270 tx=0x7effcc000bc0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.836+0000 7effe2000640 1 -- 172.21.15.50:0/188003694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effdc103ff0 msgr2=0x7effdc19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.836+0000 7effe2000640 1 --2- 172.21.15.50:0/188003694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effdc103ff0 0x7effdc19a640 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7effcc00d950 tx=0x7effcc00de10 comp rx=0 tx=0).stop 2024-09-10T10:16:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.837+0000 7effe2000640 1 -- 172.21.15.50:0/188003694 shutdown_connections 2024-09-10T10:16:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.837+0000 7effe2000640 1 --2- 172.21.15.50:0/188003694 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7effc00a2b80 0x7effc00a5040 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.837+0000 7effe2000640 1 --2- 172.21.15.50:0/188003694 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effdc109120 0x7effdc19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.837+0000 7effe2000640 1 --2- 172.21.15.50:0/188003694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effdc1049a0 0x7effdc19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.837+0000 7effe2000640 1 --2- 172.21.15.50:0/188003694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effdc103ff0 0x7effdc19a640 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.837+0000 7effe2000640 1 -- 172.21.15.50:0/188003694 >> 172.21.15.50:0/188003694 conn(0x7effdc0ffa90 msgr2=0x7effdc100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.837+0000 7effe2000640 1 -- 172.21.15.50:0/188003694 shutdown_connections 2024-09-10T10:16:19.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:19.837+0000 7effe2000640 1 -- 172.21.15.50:0/188003694 wait complete. 2024-09-10T10:16:19.848 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:20.297 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:19 smithi050 ceph-mon[30354]: pgmap v545: 129 pgs: 129 active+clean; 1.4 GiB data, 680 MiB used, 1.0 TiB / 1.0 TiB avail; 117 MiB/s rd, 1.2 KiB/s wr, 219 op/s 2024-09-10T10:16:20.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:19 smithi189 ceph-mon[34999]: pgmap v545: 129 pgs: 129 active+clean; 1.4 GiB data, 680 MiB used, 1.0 TiB / 1.0 TiB avail; 117 MiB/s rd, 1.2 KiB/s wr, 219 op/s 2024-09-10T10:16:20.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:19 smithi084 ceph-mon[34812]: pgmap v545: 129 pgs: 129 active+clean; 1.4 GiB data, 680 MiB used, 1.0 TiB / 1.0 TiB avail; 117 MiB/s rd, 1.2 KiB/s wr, 219 op/s 2024-09-10T10:16:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.249+0000 7f9da1200640 1 -- 172.21.15.50:0/1347135915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d9c108f60 msgr2=0x7f9d9c110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.249+0000 7f9da1200640 1 --2- 172.21.15.50:0/1347135915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d9c108f60 0x7f9d9c110ae0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9d94009ca0 tx=0x7f9d9402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.249+0000 7f9da1200640 1 -- 172.21.15.50:0/1347135915 shutdown_connections 2024-09-10T10:16:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.249+0000 7f9da1200640 1 --2- 172.21.15.50:0/1347135915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d9c108f60 0x7f9d9c110ae0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.249+0000 7f9da1200640 1 --2- 172.21.15.50:0/1347135915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d9c1047e0 0x7f9d9c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.249+0000 7f9da1200640 1 --2- 172.21.15.50:0/1347135915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d9c103e30 0x7f9d9c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.249+0000 7f9da1200640 1 -- 172.21.15.50:0/1347135915 >> 172.21.15.50:0/1347135915 conn(0x7f9d9c0ff8d0 msgr2=0x7f9d9c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.249+0000 7f9da1200640 1 -- 172.21.15.50:0/1347135915 shutdown_connections 2024-09-10T10:16:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.249+0000 7f9da1200640 1 -- 172.21.15.50:0/1347135915 wait complete. 2024-09-10T10:16:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.250+0000 7f9da1200640 1 Processor -- start 2024-09-10T10:16:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.250+0000 7f9da1200640 1 -- start start 2024-09-10T10:16:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.251+0000 7f9da1200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d9c103e30 0x7f9d9c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.251+0000 7f9da1200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d9c1047e0 0x7f9d9c19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.251+0000 7f9da1200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d9c108f60 0x7f9d9c19ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.251+0000 7f9da1200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9c113fc0 con 0x7f9d9c103e30 2024-09-10T10:16:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.251+0000 7f9da1200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9c113e40 con 0x7f9d9c108f60 2024-09-10T10:16:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.251+0000 7f9da1200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9c114140 con 0x7f9d9c1047e0 2024-09-10T10:16:21.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.251+0000 7f9d9b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d9c103e30 0x7f9d9c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:21.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.251+0000 7f9d9b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d9c103e30 0x7f9d9c19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55080/0 (socket says 172.21.15.50:55080) 2024-09-10T10:16:21.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.251+0000 7f9d9aa00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d9c1047e0 0x7f9d9c19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:21.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.251+0000 7f9d9b400640 1 -- 172.21.15.50:0/1728377820 learned_addr learned my addr 172.21.15.50:0/1728377820 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:21.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.252+0000 7f9d9be00640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d9c108f60 0x7f9d9c19ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:21.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.252+0000 7f9d9aa00640 1 -- 172.21.15.50:0/1728377820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d9c108f60 msgr2=0x7f9d9c19ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:21.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.252+0000 7f9d9aa00640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d9c108f60 0x7f9d9c19ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.252+0000 7f9d9aa00640 1 -- 172.21.15.50:0/1728377820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d9c103e30 msgr2=0x7f9d9c19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:21.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.252+0000 7f9d9aa00640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d9c103e30 0x7f9d9c19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.252+0000 7f9d9aa00640 1 -- 172.21.15.50:0/1728377820 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9c19f390 con 0x7f9d9c1047e0 2024-09-10T10:16:21.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.252+0000 7f9d9b400640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d9c103e30 0x7f9d9c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:21.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.252+0000 7f9d9aa00640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d9c1047e0 0x7f9d9c19a920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e9f0 tx=0x7f9d8800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:21.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.252+0000 7f9d93e00640 1 -- 172.21.15.50:0/1728377820 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800ccc0 con 0x7f9d9c1047e0 2024-09-10T10:16:21.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.252+0000 7f9da1200640 1 -- 172.21.15.50:0/1728377820 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d9c19f680 con 0x7f9d9c1047e0 2024-09-10T10:16:21.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.252+0000 7f9d93e00640 1 -- 172.21.15.50:0/1728377820 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d88010910 con 0x7f9d9c1047e0 2024-09-10T10:16:21.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.252+0000 7f9d93e00640 1 -- 172.21.15.50:0/1728377820 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d88018960 con 0x7f9d9c1047e0 2024-09-10T10:16:21.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.253+0000 7f9da1200640 1 -- 172.21.15.50:0/1728377820 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d9c1a6f60 con 0x7f9d9c1047e0 2024-09-10T10:16:21.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.254+0000 7f9da1200640 1 -- 172.21.15.50:0/1728377820 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d9c104210 con 0x7f9d9c1047e0 2024-09-10T10:16:21.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.257+0000 7f9d93e00640 1 -- 172.21.15.50:0/1728377820 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9d88010ac0 con 0x7f9d9c1047e0 2024-09-10T10:16:21.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.258+0000 7f9d93e00640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9d800a2c00 0x7f9d800a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:21.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.258+0000 7f9d93e00640 1 -- 172.21.15.50:0/1728377820 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f9d880cfa50 con 0x7f9d9c1047e0 2024-09-10T10:16:21.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.258+0000 7f9d9b400640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9d800a2c00 0x7f9d800a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:21.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.259+0000 7f9d9b400640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9d800a2c00 0x7f9d800a50c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c005fd0 tx=0x7f9d8c00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:21.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.259+0000 7f9d93e00640 1 -- 172.21.15.50:0/1728377820 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d8809bf70 con 0x7f9d9c1047e0 2024-09-10T10:16:21.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.482+0000 7f9da1200640 1 -- 172.21.15.50:0/1728377820 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d9c10c200 con 0x7f9d9c1047e0 2024-09-10T10:16:21.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.483+0000 7f9d93e00640 1 -- 172.21.15.50:0/1728377820 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f9d880a0270 con 0x7f9d9c1047e0 2024-09-10T10:16:21.485 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:16:21.485 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:16:21.485 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:16:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.485+0000 7f9da1200640 1 -- 172.21.15.50:0/1728377820 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9d800a2c00 msgr2=0x7f9d800a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.485+0000 7f9da1200640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9d800a2c00 0x7f9d800a50c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c005fd0 tx=0x7f9d8c00b4a0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.485+0000 7f9da1200640 1 -- 172.21.15.50:0/1728377820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d9c1047e0 msgr2=0x7f9d9c19a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.485+0000 7f9da1200640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d9c1047e0 0x7f9d9c19a920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e9f0 tx=0x7f9d8800eeb0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.485+0000 7f9da1200640 1 -- 172.21.15.50:0/1728377820 shutdown_connections 2024-09-10T10:16:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.485+0000 7f9da1200640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9d800a2c00 0x7f9d800a50c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.485+0000 7f9da1200640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d9c108f60 0x7f9d9c19ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.485+0000 7f9da1200640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9d9c1047e0 0x7f9d9c19a920 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.485+0000 7f9da1200640 1 --2- 172.21.15.50:0/1728377820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d9c103e30 0x7f9d9c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:21.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.485+0000 7f9da1200640 1 -- 172.21.15.50:0/1728377820 >> 172.21.15.50:0/1728377820 conn(0x7f9d9c0ff8d0 msgr2=0x7f9d9c100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:21.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.485+0000 7f9da1200640 1 -- 172.21.15.50:0/1728377820 shutdown_connections 2024-09-10T10:16:21.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:21.486+0000 7f9da1200640 1 -- 172.21.15.50:0/1728377820 wait complete. 2024-09-10T10:16:21.757 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T10:16:21.758 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T10:16:22.167 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:21 smithi050 ceph-mon[30354]: pgmap v546: 129 pgs: 129 active+clean; 1.2 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 1.2 KiB/s wr, 226 op/s 2024-09-10T10:16:22.167 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:21 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1728377820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:16:22.203 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --cancel --all' 2024-09-10T10:16:22.203 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24560 quiesce db --cancel --all 2024-09-10T10:16:22.329 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:22.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:21 smithi189 ceph-mon[34999]: pgmap v546: 129 pgs: 129 active+clean; 1.2 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 1.2 KiB/s wr, 226 op/s 2024-09-10T10:16:22.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:21 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1728377820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:16:22.396 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:21 smithi084 ceph-mon[34812]: pgmap v546: 129 pgs: 129 active+clean; 1.2 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 1.2 KiB/s wr, 226 op/s 2024-09-10T10:16:22.397 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:21 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1728377820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:16:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.839+0000 7f4272e00640 1 -- 172.21.15.50:0/3914028170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c108f60 msgr2=0x7f426c110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.839+0000 7f4272e00640 1 --2- 172.21.15.50:0/3914028170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c108f60 0x7f426c110ae0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4264009ca0 tx=0x7f426402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.839+0000 7f4272e00640 1 -- 172.21.15.50:0/3914028170 shutdown_connections 2024-09-10T10:16:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.839+0000 7f4272e00640 1 --2- 172.21.15.50:0/3914028170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c108f60 0x7f426c110ae0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.839+0000 7f4272e00640 1 --2- 172.21.15.50:0/3914028170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f426c1047e0 0x7f426c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.839+0000 7f4272e00640 1 --2- 172.21.15.50:0/3914028170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426c103e30 0x7f426c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.839+0000 7f4272e00640 1 -- 172.21.15.50:0/3914028170 >> 172.21.15.50:0/3914028170 conn(0x7f426c0ff910 msgr2=0x7f426c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:22.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.839+0000 7f4272e00640 1 -- 172.21.15.50:0/3914028170 shutdown_connections 2024-09-10T10:16:22.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.840+0000 7f4272e00640 1 -- 172.21.15.50:0/3914028170 wait complete. 2024-09-10T10:16:22.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.840+0000 7f4272e00640 1 Processor -- start 2024-09-10T10:16:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.841+0000 7f4272e00640 1 -- start start 2024-09-10T10:16:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.841+0000 7f4272e00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f426c103e30 0x7f426c19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.841+0000 7f4272e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426c1047e0 0x7f426c19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.841+0000 7f4272e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c108f60 0x7f426c19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.841+0000 7f4272e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f426c114010 con 0x7f426c108f60 2024-09-10T10:16:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.841+0000 7f4272e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f426c113e90 con 0x7f426c1047e0 2024-09-10T10:16:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.841+0000 7f4272e00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f426c114190 con 0x7f426c103e30 2024-09-10T10:16:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.841+0000 7f4271a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f426c103e30 0x7f426c19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.841+0000 7f4272400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c108f60 0x7f426c19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.841+0000 7f4271a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f426c103e30 0x7f426c19a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50170/0 (socket says 172.21.15.50:50170) 2024-09-10T10:16:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.841+0000 7f4271a00640 1 -- 172.21.15.50:0/347092937 learned_addr learned my addr 172.21.15.50:0/347092937 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.841+0000 7f4272400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c108f60 0x7f426c19ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55104/0 (socket says 172.21.15.50:55104) 2024-09-10T10:16:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.841+0000 7f4271000640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426c1047e0 0x7f426c19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.842+0000 7f4271a00640 1 -- 172.21.15.50:0/347092937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426c1047e0 msgr2=0x7f426c19a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.842+0000 7f4271a00640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426c1047e0 0x7f426c19a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.842+0000 7f4271a00640 1 -- 172.21.15.50:0/347092937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c108f60 msgr2=0x7f426c19ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.842+0000 7f4271a00640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c108f60 0x7f426c19ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.842+0000 7f4271a00640 1 -- 172.21.15.50:0/347092937 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426c19f3c0 con 0x7f426c103e30 2024-09-10T10:16:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.842+0000 7f4272400640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c108f60 0x7f426c19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.842+0000 7f4271a00640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f426c103e30 0x7f426c19a410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f426000e9f0 tx=0x7f426000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.843+0000 7f426a000640 1 -- 172.21.15.50:0/347092937 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426000cd80 con 0x7f426c103e30 2024-09-10T10:16:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.843+0000 7f4272e00640 1 -- 172.21.15.50:0/347092937 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f426c19f6b0 con 0x7f426c103e30 2024-09-10T10:16:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.843+0000 7f426a000640 1 -- 172.21.15.50:0/347092937 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4260010910 con 0x7f426c103e30 2024-09-10T10:16:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.843+0000 7f426a000640 1 -- 172.21.15.50:0/347092937 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600188f0 con 0x7f426c103e30 2024-09-10T10:16:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.843+0000 7f4272e00640 1 -- 172.21.15.50:0/347092937 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f426c1a6f90 con 0x7f426c103e30 2024-09-10T10:16:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.846+0000 7f427700b740 1 Processor -- start 2024-09-10T10:16:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.846+0000 7f427700b740 1 -- start start 2024-09-10T10:16:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.846+0000 7f426a000640 1 -- 172.21.15.50:0/347092937 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4260010ac0 con 0x7f426c103e30 2024-09-10T10:16:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.846+0000 7f427700b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbbcb0 0x555fc7dbc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.846+0000 7f427700b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbc5d0 0x555fc7dc6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.846+0000 7f427700b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 0x555fc7dc9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.846+0000 7f427700b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555fc7d22290 con 0x555fc7dbbcb0 2024-09-10T10:16:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.846+0000 7f427700b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555fc7cc9b40 con 0x555fc7dbc5d0 2024-09-10T10:16:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.846+0000 7f427700b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555fc7d1e250 con 0x555fc7dc6e90 2024-09-10T10:16:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.847+0000 7f4272400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbbcb0 0x555fc7dbc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.847+0000 7f4271a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbc5d0 0x555fc7dc6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.847+0000 7f4271a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbc5d0 0x555fc7dc6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37480/0 (socket says 172.21.15.50:37480) 2024-09-10T10:16:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.847+0000 7f4271a00640 1 -- 172.21.15.50:0/1897097504 learned_addr learned my addr 172.21.15.50:0/1897097504 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.847+0000 7f4271000640 1 --2- 172.21.15.50:0/1897097504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 0x555fc7dc9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.847+0000 7f4271a00640 1 -- 172.21.15.50:0/1897097504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 msgr2=0x555fc7dc9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.847+0000 7f4271a00640 1 --2- 172.21.15.50:0/1897097504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 0x555fc7dc9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.847+0000 7f4271a00640 1 -- 172.21.15.50:0/1897097504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbbcb0 msgr2=0x555fc7dbc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.847+0000 7f4271a00640 1 --2- 172.21.15.50:0/1897097504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbbcb0 0x555fc7dbc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.847+0000 7f4271a00640 1 -- 172.21.15.50:0/1897097504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fc7a936a0 con 0x555fc7dbc5d0 2024-09-10T10:16:22.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.848+0000 7f4272400640 1 --2- 172.21.15.50:0/1897097504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbbcb0 0x555fc7dbc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:16:22.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.848+0000 7f4271a00640 1 --2- 172.21.15.50:0/1897097504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbc5d0 0x555fc7dc6950 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f42600d5c20 tx=0x7f42600d7670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb7a3e683f4a5e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:22.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.848+0000 7f426a000640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f42540a2b80 0x7f42540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.848+0000 7f425ea00640 1 -- 172.21.15.50:0/1897097504 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600de070 con 0x555fc7dbc5d0 2024-09-10T10:16:22.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.848+0000 7f426a000640 1 -- 172.21.15.50:0/347092937 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f42600cf7f0 con 0x7f426c103e30 2024-09-10T10:16:22.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.848+0000 7f425ea00640 1 -- 172.21.15.50:0/1897097504 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4260087f80 con 0x555fc7dbc5d0 2024-09-10T10:16:22.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.848+0000 7f425ea00640 1 -- 172.21.15.50:0/1897097504 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426009b850 con 0x555fc7dbc5d0 2024-09-10T10:16:22.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.848+0000 7f4272400640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f42540a2b80 0x7f42540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.849+0000 7f427700b740 1 -- 172.21.15.50:0/1897097504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbc5d0 msgr2=0x555fc7dc6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.849+0000 7f4272400640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f42540a2b80 0x7f42540a5040 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4264006010 tx=0x7f4264005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.849+0000 7f427700b740 1 --2- 172.21.15.50:0/1897097504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbc5d0 0x555fc7dc6950 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f42600d5c20 tx=0x7f42600d7670 comp rx=0 tx=0).stop 2024-09-10T10:16:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.849+0000 7f427700b740 1 -- 172.21.15.50:0/1897097504 shutdown_connections 2024-09-10T10:16:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.849+0000 7f427700b740 1 --2- 172.21.15.50:0/1897097504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 0x555fc7dc9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.849+0000 7f427700b740 1 --2- 172.21.15.50:0/1897097504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbc5d0 0x555fc7dc6950 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.849+0000 7f427700b740 1 --2- 172.21.15.50:0/1897097504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbbcb0 0x555fc7dbc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.849+0000 7f427700b740 1 -- 172.21.15.50:0/1897097504 >> 172.21.15.50:0/1897097504 conn(0x555fc7db8240 msgr2=0x555fc7db8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.850+0000 7f427700b740 1 -- 172.21.15.50:0/1897097504 shutdown_connections 2024-09-10T10:16:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.850+0000 7f427700b740 1 -- 172.21.15.50:0/1897097504 wait complete. 2024-09-10T10:16:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.850+0000 7f427700b740 1 -- start start 2024-09-10T10:16:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.850+0000 7f427700b740 1 Processor -- start 2024-09-10T10:16:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.851+0000 7f427700b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbbcb0 0x555fc7dc6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.851+0000 7f427700b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbc5d0 0x555fc7dc3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.851+0000 7f427700b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 0x555fc7dc3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.851+0000 7f427700b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555fc7dc9b00 con 0x555fc7dbc5d0 2024-09-10T10:16:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.851+0000 7f427700b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555fc7cdcfa0 con 0x555fc7dbbcb0 2024-09-10T10:16:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.851+0000 7f427700b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555fc7dc9c80 con 0x555fc7dc6e90 2024-09-10T10:16:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.851+0000 7f427700b740 10 client.0 _ll_register_callbacks cb 0x555fc7a30ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.851+0000 7f4271a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbbcb0 0x555fc7dc6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.851+0000 7f4271a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbbcb0 0x555fc7dc6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37494/0 (socket says 172.21.15.50:37494) 2024-09-10T10:16:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.851+0000 7f4271a00640 1 -- 172.21.15.50:0/931266582 learned_addr learned my addr 172.21.15.50:0/931266582 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.851+0000 7f4272400640 1 --2- 172.21.15.50:0/931266582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 0x555fc7dc3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.852+0000 7f4271000640 1 --2- 172.21.15.50:0/931266582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbc5d0 0x555fc7dc3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.852+0000 7f4271a00640 1 -- 172.21.15.50:0/931266582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 msgr2=0x555fc7dc3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.852+0000 7f4271a00640 1 --2- 172.21.15.50:0/931266582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 0x555fc7dc3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.852+0000 7f4271a00640 1 -- 172.21.15.50:0/931266582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbc5d0 msgr2=0x555fc7dc3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.852+0000 7f4271a00640 1 --2- 172.21.15.50:0/931266582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbc5d0 0x555fc7dc3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.852+0000 7f4271a00640 1 -- 172.21.15.50:0/931266582 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fc7dc4770 con 0x555fc7dbbcb0 2024-09-10T10:16:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.852+0000 7f4271a00640 1 --2- 172.21.15.50:0/931266582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbbcb0 0x555fc7dc6750 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f426009bca0 tx=0x7f4260009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e5c5cb5ca2576e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.852+0000 7f4253400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:16:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.852+0000 7f4253400640 1 -- 172.21.15.50:0/931266582 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600de070 con 0x555fc7dbbcb0 2024-09-10T10:16:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.852+0000 7f4253400640 1 -- 172.21.15.50:0/931266582 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f42600cd010 con 0x555fc7dbbcb0 2024-09-10T10:16:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.852+0000 7f427700b740 1 -- 172.21.15.50:0/931266582 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4260087f80 con 0x555fc7dbbcb0 2024-09-10T10:16:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.853+0000 7f4253400640 1 -- 172.21.15.50:0/931266582 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f426009b670 con 0x555fc7dbbcb0 2024-09-10T10:16:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.853+0000 7f427700b740 10 client.26414 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.853+0000 7f427700b740 1 -- 172.21.15.50:0/931266582 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555fc7dd59a0 con 0x555fc7dbbcb0 2024-09-10T10:16:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.853+0000 7f4253400640 1 -- 172.21.15.50:0/931266582 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4260087f80 con 0x555fc7dbbcb0 2024-09-10T10:16:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.853+0000 7f4253400640 1 -- 172.21.15.50:0/931266582 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f42600cfbe0 con 0x555fc7dbbcb0 2024-09-10T10:16:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.853+0000 7f427700b740 10 client.26414 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.853+0000 7f427700b740 10 client.26414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:16:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.853+0000 7f427700b740 20 client.26414 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.853+0000 7f427700b740 1 --2- 172.21.15.50:0/931266582 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555fc7dd6cf0 0x555fc7dd90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.853+0000 7f427700b740 4 client.26414 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:16:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.853+0000 7f427700b740 1 -- 172.21.15.50:0/931266582 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fc7d2f800 con 0x555fc7dd6cf0 2024-09-10T10:16:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.854+0000 7f4271000640 1 --2- 172.21.15.50:0/931266582 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555fc7dd6cf0 0x555fc7dd90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.854+0000 7f4253400640 10 client.26414 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.854+0000 7f4271000640 1 --2- 172.21.15.50:0/931266582 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555fc7dd6cf0 0x555fc7dd90e0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdb7791aba04a299 server_cookie=6255fc84ed1478e9 in_seq=0 out_seq=0 2024-09-10T10:16:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.855+0000 7f4253400640 1 -- 172.21.15.50:0/931266582 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555fc7d2f800 con 0x555fc7dd6cf0 2024-09-10T10:16:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.855+0000 7f4253400640 10 client.26414 handle_command_reply: tid=0 2024-09-10T10:16:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.855+0000 7f427700b740 1 client.26414 shutdown 2024-09-10T10:16:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.855+0000 7f427700b740 1 -- 172.21.15.50:0/931266582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbbcb0 msgr2=0x555fc7dc6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.855+0000 7f427700b740 1 --2- 172.21.15.50:0/931266582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbbcb0 0x555fc7dc6750 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f426009bca0 tx=0x7f4260009700 comp rx=0 tx=0).stop 2024-09-10T10:16:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.855+0000 7f427700b740 1 -- 172.21.15.50:0/931266582 shutdown_connections 2024-09-10T10:16:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.855+0000 7f427700b740 1 --2- 172.21.15.50:0/931266582 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555fc7dd6cf0 0x555fc7dd90e0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.855+0000 7f427700b740 1 --2- 172.21.15.50:0/931266582 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 0x555fc7dc3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.855+0000 7f427700b740 1 --2- 172.21.15.50:0/931266582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbc5d0 0x555fc7dc3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.855+0000 7f4253400640 0 client.26414 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.855+0000 7f427700b740 1 --2- 172.21.15.50:0/931266582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbbcb0 0x555fc7dc6750 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.855+0000 7f427700b740 1 -- 172.21.15.50:0/931266582 >> 172.21.15.50:0/931266582 conn(0x555fc7db8240 msgr2=0x555fc7dbdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.856+0000 7f427700b740 1 -- 172.21.15.50:0/931266582 shutdown_connections 2024-09-10T10:16:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.856+0000 7f427700b740 1 -- 172.21.15.50:0/931266582 wait complete. 2024-09-10T10:16:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.856+0000 7f427700b740 20 client.26414 trim_cache size 0 max 16384 2024-09-10T10:16:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.886+0000 7f427700b740 1 Processor -- start 2024-09-10T10:16:22.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.886+0000 7f427700b740 1 -- start start 2024-09-10T10:16:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.887+0000 7f427700b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dbbcb0 0x555fc7dbefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.887+0000 7f427700b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbc5d0 0x555fc7ddc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.887+0000 7f427700b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dc6e90 0x555fc7ddc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.887+0000 7f427700b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f426c1b3640 con 0x555fc7dc6e90 2024-09-10T10:16:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.887+0000 7f427700b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f426c1b0f10 con 0x555fc7dbc5d0 2024-09-10T10:16:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.887+0000 7f427700b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f426c1aed60 con 0x555fc7dbbcb0 2024-09-10T10:16:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.887+0000 7f4271a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dbbcb0 0x555fc7dbefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.887+0000 7f4271a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dbbcb0 0x555fc7dbefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50196/0 (socket says 172.21.15.50:50196) 2024-09-10T10:16:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.887+0000 7f4271a00640 1 -- 172.21.15.50:0/3118876576 learned_addr learned my addr 172.21.15.50:0/3118876576 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.887+0000 7f4272400640 1 --2- 172.21.15.50:0/3118876576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dc6e90 0x555fc7ddc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.887+0000 7f4271000640 1 --2- 172.21.15.50:0/3118876576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbc5d0 0x555fc7ddc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.888+0000 7f4271a00640 1 -- 172.21.15.50:0/3118876576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbc5d0 msgr2=0x555fc7ddc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.888+0000 7f4271a00640 1 --2- 172.21.15.50:0/3118876576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbc5d0 0x555fc7ddc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.888+0000 7f4271a00640 1 -- 172.21.15.50:0/3118876576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dc6e90 msgr2=0x555fc7ddc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.888+0000 7f4271a00640 1 --2- 172.21.15.50:0/3118876576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dc6e90 0x555fc7ddc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.888+0000 7f4271a00640 1 -- 172.21.15.50:0/3118876576 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fc7dc29f0 con 0x555fc7dbbcb0 2024-09-10T10:16:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.888+0000 7f4271a00640 1 --2- 172.21.15.50:0/3118876576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dbbcb0 0x555fc7dbefb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f426000e9c0 tx=0x7f426009bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc71817e0e16bd80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.888+0000 7f425e000640 1 -- 172.21.15.50:0/3118876576 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600de070 con 0x555fc7dbbcb0 2024-09-10T10:16:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.889+0000 7f425e000640 1 -- 172.21.15.50:0/3118876576 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42600d57f0 con 0x555fc7dbbcb0 2024-09-10T10:16:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.889+0000 7f425e000640 1 -- 172.21.15.50:0/3118876576 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600cfb50 con 0x555fc7dbbcb0 2024-09-10T10:16:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.889+0000 7f427700b740 1 -- 172.21.15.50:0/3118876576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dbbcb0 msgr2=0x555fc7dbefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.889+0000 7f427700b740 1 --2- 172.21.15.50:0/3118876576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dbbcb0 0x555fc7dbefb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f426000e9c0 tx=0x7f426009bc10 comp rx=0 tx=0).stop 2024-09-10T10:16:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.890+0000 7f427700b740 1 -- 172.21.15.50:0/3118876576 shutdown_connections 2024-09-10T10:16:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.890+0000 7f427700b740 1 --2- 172.21.15.50:0/3118876576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dc6e90 0x555fc7ddc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.890+0000 7f427700b740 1 --2- 172.21.15.50:0/3118876576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbc5d0 0x555fc7ddc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.890+0000 7f427700b740 1 --2- 172.21.15.50:0/3118876576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dbbcb0 0x555fc7dbefb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.890+0000 7f427700b740 1 -- 172.21.15.50:0/3118876576 >> 172.21.15.50:0/3118876576 conn(0x555fc7db8240 msgr2=0x555fc7dbe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.890+0000 7f427700b740 1 -- 172.21.15.50:0/3118876576 shutdown_connections 2024-09-10T10:16:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.890+0000 7f427700b740 1 -- 172.21.15.50:0/3118876576 wait complete. 2024-09-10T10:16:22.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.890+0000 7f427700b740 1 -- start start 2024-09-10T10:16:22.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.890+0000 7f427700b740 1 Processor -- start 2024-09-10T10:16:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.891+0000 7f427700b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbbcb0 0x555fc7dda560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.891+0000 7f427700b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbc5d0 0x555fc7ddaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.891+0000 7f427700b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 0x555fc7e40630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.891+0000 7f427700b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f426c1af3d0 con 0x555fc7dbc5d0 2024-09-10T10:16:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.891+0000 7f427700b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f426c1b0840 con 0x555fc7dbbcb0 2024-09-10T10:16:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.891+0000 7f427700b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f426c1afaa0 con 0x555fc7dc6e90 2024-09-10T10:16:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.891+0000 7f427700b740 10 client.0 _ll_register_callbacks cb 0x7f42600d5a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.891+0000 7f4271000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbc5d0 0x555fc7ddaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.891+0000 7f4271a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbbcb0 0x555fc7dda560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.891+0000 7f4271000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbc5d0 0x555fc7ddaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55144/0 (socket says 172.21.15.50:55144) 2024-09-10T10:16:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.891+0000 7f4271000640 1 -- 172.21.15.50:0/3256761021 learned_addr learned my addr 172.21.15.50:0/3256761021 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.891+0000 7f4272400640 1 --2- 172.21.15.50:0/3256761021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 0x555fc7e40630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.892+0000 7f4271a00640 1 -- 172.21.15.50:0/3256761021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 msgr2=0x555fc7e40630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.892+0000 7f4271a00640 1 --2- 172.21.15.50:0/3256761021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 0x555fc7e40630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.892+0000 7f4271a00640 1 -- 172.21.15.50:0/3256761021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbc5d0 msgr2=0x555fc7ddaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.892+0000 7f4271a00640 1 --2- 172.21.15.50:0/3256761021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbc5d0 0x555fc7ddaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.892+0000 7f4271a00640 1 -- 172.21.15.50:0/3256761021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fc7e40b70 con 0x555fc7dbbcb0 2024-09-10T10:16:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.892+0000 7f4271000640 1 --2- 172.21.15.50:0/3256761021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbc5d0 0x555fc7ddaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.892+0000 7f4271a00640 1 --2- 172.21.15.50:0/3256761021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbbcb0 0x555fc7dda560 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f426009bca0 tx=0x7f4260009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a92d99c03cde6c39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.892+0000 7f4253400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.892+0000 7f4253400640 1 -- 172.21.15.50:0/3256761021 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600de050 con 0x555fc7dbbcb0 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.892+0000 7f4253400640 1 -- 172.21.15.50:0/3256761021 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f42600cfd10 con 0x555fc7dbbcb0 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.892+0000 7f427700b740 1 -- 172.21.15.50:0/3256761021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42600d57f0 con 0x555fc7dbbcb0 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.893+0000 7f4253400640 1 -- 172.21.15.50:0/3256761021 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f42600b4e60 con 0x555fc7dbbcb0 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.893+0000 7f427700b740 10 client.26420 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.893+0000 7f427700b740 1 -- 172.21.15.50:0/3256761021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555fc7e40b70 con 0x555fc7dbbcb0 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.893+0000 7f4253400640 1 -- 172.21.15.50:0/3256761021 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42600d57f0 con 0x555fc7dbbcb0 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.893+0000 7f4253400640 1 -- 172.21.15.50:0/3256761021 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f426009b160 con 0x555fc7dbbcb0 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.893+0000 7f427700b740 10 client.26420 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.893+0000 7f427700b740 10 client.26420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.893+0000 7f427700b740 20 client.26420 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.893+0000 7f427700b740 1 --2- 172.21.15.50:0/3256761021 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555fc7e42120 0x555fc7e44510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.893+0000 7f427700b740 4 client.26420 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T10:16:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.893+0000 7f427700b740 1 -- 172.21.15.50:0/3256761021 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555fc7d29d10 con 0x555fc7e42120 2024-09-10T10:16:22.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.894+0000 7f4271000640 1 --2- 172.21.15.50:0/3256761021 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555fc7e42120 0x555fc7e44510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.894+0000 7f4253400640 10 client.26420 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.894+0000 7f4271000640 1 --2- 172.21.15.50:0/3256761021 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555fc7e42120 0x555fc7e44510 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c3986d778a39c2c server_cookie=8f5c5b89b38c30d7 in_seq=0 out_seq=0 2024-09-10T10:16:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.895+0000 7f4253400640 1 -- 172.21.15.50:0/3256761021 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555fc7d29d10 con 0x555fc7e42120 2024-09-10T10:16:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.895+0000 7f4253400640 10 client.26420 handle_command_reply: tid=0 2024-09-10T10:16:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.895+0000 7f427700b740 1 client.26420 shutdown 2024-09-10T10:16:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.896+0000 7f427700b740 1 -- 172.21.15.50:0/3256761021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbbcb0 msgr2=0x555fc7dda560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.896+0000 7f427700b740 1 --2- 172.21.15.50:0/3256761021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbbcb0 0x555fc7dda560 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f426009bca0 tx=0x7f4260009700 comp rx=0 tx=0).stop 2024-09-10T10:16:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.896+0000 7f427700b740 1 -- 172.21.15.50:0/3256761021 shutdown_connections 2024-09-10T10:16:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.896+0000 7f427700b740 1 --2- 172.21.15.50:0/3256761021 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x555fc7e42120 0x555fc7e44510 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.896+0000 7f427700b740 1 --2- 172.21.15.50:0/3256761021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555fc7dc6e90 0x555fc7e40630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.896+0000 7f427700b740 1 --2- 172.21.15.50:0/3256761021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555fc7dbc5d0 0x555fc7ddaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.896+0000 7f427700b740 1 --2- 172.21.15.50:0/3256761021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fc7dbbcb0 0x555fc7dda560 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.896+0000 7f4253400640 0 client.26420 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.896+0000 7f427700b740 1 -- 172.21.15.50:0/3256761021 >> 172.21.15.50:0/3256761021 conn(0x555fc7db8240 msgr2=0x555fc7dd26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.896+0000 7f427700b740 1 -- 172.21.15.50:0/3256761021 shutdown_connections 2024-09-10T10:16:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.896+0000 7f427700b740 1 -- 172.21.15.50:0/3256761021 wait complete. 2024-09-10T10:16:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.896+0000 7f427700b740 20 client.26420 trim_cache size 0 max 16384 2024-09-10T10:16:22.900 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:16:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: "return_code": 0, 2024-09-10T10:16:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_tag": "15ae54b5-c07b-4ea3-8dd9-235a8423dc0a", 2024-09-10T10:16:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": "asynchronous" 2024-09-10T10:16:22.901 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:16:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.897+0000 7f4272e00640 1 -- 172.21.15.50:0/347092937 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f42540a2b80 msgr2=0x7f42540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.897+0000 7f4272e00640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f42540a2b80 0x7f42540a5040 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4264006010 tx=0x7f4264005d80 comp rx=0 tx=0).stop 2024-09-10T10:16:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.897+0000 7f4272e00640 1 -- 172.21.15.50:0/347092937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f426c103e30 msgr2=0x7f426c19a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.897+0000 7f4272e00640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f426c103e30 0x7f426c19a410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f426000e9f0 tx=0x7f426000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.897+0000 7f4272e00640 1 -- 172.21.15.50:0/347092937 shutdown_connections 2024-09-10T10:16:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.897+0000 7f4272e00640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f42540a2b80 0x7f42540a5040 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.897+0000 7f4272e00640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f426c108f60 0x7f426c19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.897+0000 7f4272e00640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426c1047e0 0x7f426c19a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.897+0000 7f4272e00640 1 --2- 172.21.15.50:0/347092937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f426c103e30 0x7f426c19a410 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:22.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.897+0000 7f4272e00640 1 -- 172.21.15.50:0/347092937 >> 172.21.15.50:0/347092937 conn(0x7f426c0ff910 msgr2=0x7f426c1003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:22.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.897+0000 7f4272e00640 1 -- 172.21.15.50:0/347092937 shutdown_connections 2024-09-10T10:16:22.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:22.897+0000 7f4272e00640 1 -- 172.21.15.50:0/347092937 wait complete. 2024-09-10T10:16:22.902 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:23.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.803+0000 7f9ff8200640 1 -- 172.21.15.50:0/1856618279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff0101df0 msgr2=0x7f9ff01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.803+0000 7f9ff8200640 1 --2- 172.21.15.50:0/1856618279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff0101df0 0x7f9ff01021d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009900 tx=0x7f9fe402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.803+0000 7f9ff8200640 1 -- 172.21.15.50:0/1856618279 shutdown_connections 2024-09-10T10:16:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.803+0000 7f9ff8200640 1 --2- 172.21.15.50:0/1856618279 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ff0106f20 0x7f9ff010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.803+0000 7f9ff8200640 1 --2- 172.21.15.50:0/1856618279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ff01027a0 0x7f9ff01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.803+0000 7f9ff8200640 1 --2- 172.21.15.50:0/1856618279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff0101df0 0x7f9ff01021d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.803+0000 7f9ff8200640 1 -- 172.21.15.50:0/1856618279 >> 172.21.15.50:0/1856618279 conn(0x7f9ff00fd8b0 msgr2=0x7f9ff00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.803+0000 7f9ff8200640 1 -- 172.21.15.50:0/1856618279 shutdown_connections 2024-09-10T10:16:23.805 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.803+0000 7f9ff8200640 1 -- 172.21.15.50:0/1856618279 wait complete. 2024-09-10T10:16:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.804+0000 7f9ff8200640 1 Processor -- start 2024-09-10T10:16:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.804+0000 7f9ff8200640 1 -- start start 2024-09-10T10:16:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.804+0000 7f9ff8200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ff0101df0 0x7f9ff00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.804+0000 7f9ff8200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff01027a0 0x7f9ff0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.804+0000 7f9ff8200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ff0106f20 0x7f9ff0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.804+0000 7f9ff8200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0111fd0 con 0x7f9ff01027a0 2024-09-10T10:16:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.804+0000 7f9ff8200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0111e50 con 0x7f9ff0106f20 2024-09-10T10:16:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.804+0000 7f9ff8200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0112150 con 0x7f9ff0101df0 2024-09-10T10:16:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.805+0000 7f9ff4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff01027a0 0x7f9ff0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.805+0000 7f9ff4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff01027a0 0x7f9ff0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55172/0 (socket says 172.21.15.50:55172) 2024-09-10T10:16:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.805+0000 7f9ff4e00640 1 -- 172.21.15.50:0/945445732 learned_addr learned my addr 172.21.15.50:0/945445732 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.805+0000 7f9ff6200640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ff0106f20 0x7f9ff0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.805+0000 7f9ff5800640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ff0101df0 0x7f9ff00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.805+0000 7f9ff4e00640 1 -- 172.21.15.50:0/945445732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ff0101df0 msgr2=0x7f9ff00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.805+0000 7f9ff4e00640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ff0101df0 0x7f9ff00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.805+0000 7f9ff4e00640 1 -- 172.21.15.50:0/945445732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ff0106f20 msgr2=0x7f9ff0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.805+0000 7f9ff4e00640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ff0106f20 0x7f9ff0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.805+0000 7f9ff4e00640 1 -- 172.21.15.50:0/945445732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff01aad80 con 0x7f9ff01027a0 2024-09-10T10:16:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.805+0000 7f9ff4e00640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff01027a0 0x7f9ff0074a30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00e9f0 tx=0x7f9fdc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.806+0000 7f9fee000640 1 -- 172.21.15.50:0/945445732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00cd80 con 0x7f9ff01027a0 2024-09-10T10:16:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.806+0000 7f9fee000640 1 -- 172.21.15.50:0/945445732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fdc010910 con 0x7f9ff01027a0 2024-09-10T10:16:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.806+0000 7f9fee000640 1 -- 172.21.15.50:0/945445732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc018990 con 0x7f9ff01027a0 2024-09-10T10:16:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.806+0000 7f9ff8200640 1 -- 172.21.15.50:0/945445732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff01aafb0 con 0x7f9ff01027a0 2024-09-10T10:16:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.806+0000 7f9ff8200640 1 -- 172.21.15.50:0/945445732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff01ab460 con 0x7f9ff01027a0 2024-09-10T10:16:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.809+0000 7f9ffac63740 1 Processor -- start 2024-09-10T10:16:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.809+0000 7f9fee000640 1 -- 172.21.15.50:0/945445732 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9fdc010ac0 con 0x7f9ff01027a0 2024-09-10T10:16:23.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.809+0000 7f9ffac63740 1 -- start start 2024-09-10T10:16:23.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.809+0000 7f9ffac63740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f318ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.809+0000 7f9ffac63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f318ff0 0x55cb1f323370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ffac63740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3238b0 0x55cb1f325ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ffac63740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cb1f27f340 con 0x55cb1f3186d0 2024-09-10T10:16:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ffac63740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cb1f226bf0 con 0x55cb1f3238b0 2024-09-10T10:16:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ffac63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cb1f27b300 con 0x55cb1f318ff0 2024-09-10T10:16:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ff5800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f318ff0 0x55cb1f323370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ff5800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f318ff0 0x55cb1f323370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50232/0 (socket says 172.21.15.50:50232) 2024-09-10T10:16:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ff5800640 1 -- 172.21.15.50:0/3668487642 learned_addr learned my addr 172.21.15.50:0/3668487642 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ff6200640 1 --2- 172.21.15.50:0/3668487642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f318ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ff4e00640 1 --2- 172.21.15.50:0/3668487642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3238b0 0x55cb1f325ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ff5800640 1 -- 172.21.15.50:0/3668487642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3238b0 msgr2=0x55cb1f325ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:23.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ff5800640 1 --2- 172.21.15.50:0/3668487642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3238b0 0x55cb1f325ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ff5800640 1 -- 172.21.15.50:0/3668487642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 msgr2=0x55cb1f318ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ff5800640 1 --2- 172.21.15.50:0/3668487642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f318ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.810+0000 7f9ff5800640 1 -- 172.21.15.50:0/3668487642 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb1eff0620 con 0x55cb1f318ff0 2024-09-10T10:16:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.811+0000 7f9ff5800640 1 --2- 172.21.15.50:0/3668487642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f318ff0 0x55cb1f323370 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009900 tx=0x7f9fe4005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9cc6a7c8f97ed62 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.811+0000 7f9fee000640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9fd80a2c00 0x7f9fd80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.811+0000 7f9fe2a00640 1 -- 172.21.15.50:0/3668487642 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4035040 con 0x55cb1f318ff0 2024-09-10T10:16:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.811+0000 7f9fe2a00640 1 -- 172.21.15.50:0/3668487642 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe4004400 con 0x55cb1f318ff0 2024-09-10T10:16:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.811+0000 7f9fe2a00640 1 -- 172.21.15.50:0/3668487642 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40035f0 con 0x55cb1f318ff0 2024-09-10T10:16:23.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.811+0000 7f9fee000640 1 -- 172.21.15.50:0/945445732 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f9fdc0cf640 con 0x7f9ff01027a0 2024-09-10T10:16:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.811+0000 7f9ff6200640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9fd80a2c00 0x7f9fd80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.812+0000 7f9ffac63740 1 -- 172.21.15.50:0/3668487642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f318ff0 msgr2=0x55cb1f323370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.812+0000 7f9ffac63740 1 --2- 172.21.15.50:0/3668487642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f318ff0 0x55cb1f323370 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009900 tx=0x7f9fe4005de0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.812+0000 7f9ffac63740 1 -- 172.21.15.50:0/3668487642 shutdown_connections 2024-09-10T10:16:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.812+0000 7f9ffac63740 1 --2- 172.21.15.50:0/3668487642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3238b0 0x55cb1f325ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.812+0000 7f9ffac63740 1 --2- 172.21.15.50:0/3668487642 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f318ff0 0x55cb1f323370 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.812+0000 7f9ffac63740 1 --2- 172.21.15.50:0/3668487642 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f318ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.812+0000 7f9ffac63740 1 -- 172.21.15.50:0/3668487642 >> 172.21.15.50:0/3668487642 conn(0x55cb1f314c60 msgr2=0x55cb1f315040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.812+0000 7f9ff6200640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9fd80a2c00 0x7f9fd80a50c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8005fd0 tx=0x7f9fe8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.812+0000 7f9ffac63740 1 -- 172.21.15.50:0/3668487642 shutdown_connections 2024-09-10T10:16:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.812+0000 7f9ffac63740 1 -- 172.21.15.50:0/3668487642 wait complete. 2024-09-10T10:16:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.813+0000 7f9ffac63740 1 -- start start 2024-09-10T10:16:23.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.813+0000 7f9ffac63740 1 Processor -- start 2024-09-10T10:16:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.813+0000 7f9ffac63740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3186d0 0x55cb1f3206d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.813+0000 7f9ffac63740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f318ff0 0x55cb1f320c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.813+0000 7f9ffac63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f3238b0 0x55cb1f321150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.813+0000 7f9ffac63740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cb1f326480 con 0x55cb1f318ff0 2024-09-10T10:16:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.813+0000 7f9ffac63740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cb1f23a060 con 0x55cb1f3186d0 2024-09-10T10:16:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.813+0000 7f9ffac63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cb1f326600 con 0x55cb1f3238b0 2024-09-10T10:16:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.813+0000 7f9ffac63740 10 client.0 _ll_register_callbacks cb 0x55cb1f228af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.814+0000 7f9ff5800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3186d0 0x55cb1f3206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.814+0000 7f9ff4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f318ff0 0x55cb1f320c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.814+0000 7f9ff6200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f3238b0 0x55cb1f321150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.814+0000 7f9ff5800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3186d0 0x55cb1f3206d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37540/0 (socket says 172.21.15.50:37540) 2024-09-10T10:16:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.814+0000 7f9ff5800640 1 -- 172.21.15.50:0/1459185979 learned_addr learned my addr 172.21.15.50:0/1459185979 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.814+0000 7f9ff5800640 1 -- 172.21.15.50:0/1459185979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f3238b0 msgr2=0x55cb1f321150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.814+0000 7f9ff5800640 1 --2- 172.21.15.50:0/1459185979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f3238b0 0x55cb1f321150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.814+0000 7f9ff5800640 1 -- 172.21.15.50:0/1459185979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f318ff0 msgr2=0x55cb1f320c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:23.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.814+0000 7f9ff5800640 1 --2- 172.21.15.50:0/1459185979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f318ff0 0x55cb1f320c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.814+0000 7f9ff5800640 1 -- 172.21.15.50:0/1459185979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb1f32f950 con 0x55cb1f3186d0 2024-09-10T10:16:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.814+0000 7f9ff5800640 1 --2- 172.21.15.50:0/1459185979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3186d0 0x55cb1f3206d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40048f0 tx=0x7f9fe4004ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6342ca415ecf67d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.814+0000 7f9fd7400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:16:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.815+0000 7f9fd7400640 1 -- 172.21.15.50:0/1459185979 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4052060 con 0x55cb1f3186d0 2024-09-10T10:16:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.815+0000 7f9fd7400640 1 -- 172.21.15.50:0/1459185979 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f9fe4004200 con 0x55cb1f3186d0 2024-09-10T10:16:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.815+0000 7f9ffac63740 1 -- 172.21.15.50:0/1459185979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fe4004400 con 0x55cb1f3186d0 2024-09-10T10:16:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.815+0000 7f9fd7400640 1 -- 172.21.15.50:0/1459185979 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9fe4059050 con 0x55cb1f3186d0 2024-09-10T10:16:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.815+0000 7f9ffac63740 10 client.26432 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.815+0000 7f9ffac63740 1 -- 172.21.15.50:0/1459185979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cb1f332290 con 0x55cb1f3186d0 2024-09-10T10:16:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.816+0000 7f9fd7400640 1 -- 172.21.15.50:0/1459185979 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe4004400 con 0x55cb1f3186d0 2024-09-10T10:16:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.816+0000 7f9fd7400640 1 -- 172.21.15.50:0/1459185979 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f9fe4031bc0 con 0x55cb1f3186d0 2024-09-10T10:16:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.816+0000 7f9ffac63740 10 client.26432 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:23.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.816+0000 7f9ffac63740 10 client.26432 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:16:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.816+0000 7f9ffac63740 20 client.26432 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.816+0000 7f9ffac63740 1 --2- 172.21.15.50:0/1459185979 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cb1f3335e0 0x55cb1f3359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.816+0000 7f9ffac63740 4 client.26432 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:16:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.816+0000 7f9ffac63740 1 -- 172.21.15.50:0/1459185979 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb1f28c8b0 con 0x55cb1f3335e0 2024-09-10T10:16:23.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.816+0000 7f9ff4e00640 1 --2- 172.21.15.50:0/1459185979 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cb1f3335e0 0x55cb1f3359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.817+0000 7f9ff4e00640 1 --2- 172.21.15.50:0/1459185979 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cb1f3335e0 0x55cb1f3359d0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7187912d30a2f6f server_cookie=50ea52cecc1d366f in_seq=0 out_seq=0 2024-09-10T10:16:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.817+0000 7f9fd7400640 10 client.26432 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.817+0000 7f9fd7400640 1 -- 172.21.15.50:0/1459185979 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb1f28c8b0 con 0x55cb1f3335e0 2024-09-10T10:16:23.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.817+0000 7f9fd7400640 10 client.26432 handle_command_reply: tid=0 2024-09-10T10:16:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.817+0000 7f9ffac63740 1 client.26432 shutdown 2024-09-10T10:16:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.818+0000 7f9ffac63740 1 -- 172.21.15.50:0/1459185979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3186d0 msgr2=0x55cb1f3206d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.818+0000 7f9ffac63740 1 --2- 172.21.15.50:0/1459185979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3186d0 0x55cb1f3206d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40048f0 tx=0x7f9fe4004ae0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.818+0000 7f9ffac63740 1 -- 172.21.15.50:0/1459185979 shutdown_connections 2024-09-10T10:16:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.818+0000 7f9ffac63740 1 --2- 172.21.15.50:0/1459185979 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cb1f3335e0 0x55cb1f3359d0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.818+0000 7f9fd7400640 0 client.26432 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.818+0000 7f9ffac63740 1 --2- 172.21.15.50:0/1459185979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f3238b0 0x55cb1f321150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.818+0000 7f9ffac63740 1 --2- 172.21.15.50:0/1459185979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f318ff0 0x55cb1f320c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.818+0000 7f9ffac63740 1 --2- 172.21.15.50:0/1459185979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3186d0 0x55cb1f3206d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.818+0000 7f9ffac63740 1 -- 172.21.15.50:0/1459185979 >> 172.21.15.50:0/1459185979 conn(0x55cb1f314c60 msgr2=0x55cb1f31a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.818+0000 7f9ffac63740 1 -- 172.21.15.50:0/1459185979 shutdown_connections 2024-09-10T10:16:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.818+0000 7f9ffac63740 1 -- 172.21.15.50:0/1459185979 wait complete. 2024-09-10T10:16:23.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.818+0000 7f9ffac63740 20 client.26432 trim_cache size 0 max 16384 2024-09-10T10:16:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.836+0000 7f9ffac63740 1 Processor -- start 2024-09-10T10:16:23.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.836+0000 7f9ffac63740 1 -- start start 2024-09-10T10:16:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.836+0000 7f9ffac63740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f31a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.836+0000 7f9ffac63740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f318ff0 0x55cb1f33afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.836+0000 7f9ffac63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f3238b0 0x55cb1f33b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.836+0000 7f9ffac63740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01b7b10 con 0x55cb1f3186d0 2024-09-10T10:16:23.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.837+0000 7f9ffac63740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01b53e0 con 0x55cb1f318ff0 2024-09-10T10:16:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.837+0000 7f9ffac63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01b3230 con 0x55cb1f3238b0 2024-09-10T10:16:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.837+0000 7f9ff5800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f31a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.837+0000 7f9ff4e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f318ff0 0x55cb1f33afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.837+0000 7f9ff5800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f31a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55204/0 (socket says 172.21.15.50:55204) 2024-09-10T10:16:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.837+0000 7f9ff5800640 1 -- 172.21.15.50:0/582264542 learned_addr learned my addr 172.21.15.50:0/582264542 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:23.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.837+0000 7f9ff6200640 1 --2- 172.21.15.50:0/582264542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f3238b0 0x55cb1f33b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.837+0000 7f9ff4e00640 1 -- 172.21.15.50:0/582264542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f3238b0 msgr2=0x55cb1f33b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.837+0000 7f9ff4e00640 1 --2- 172.21.15.50:0/582264542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f3238b0 0x55cb1f33b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.837+0000 7f9ff4e00640 1 -- 172.21.15.50:0/582264542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 msgr2=0x55cb1f31a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.837+0000 7f9ff4e00640 1 --2- 172.21.15.50:0/582264542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f31a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.837+0000 7f9ff4e00640 1 -- 172.21.15.50:0/582264542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb1f318e20 con 0x55cb1f318ff0 2024-09-10T10:16:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.838+0000 7f9ff4e00640 1 --2- 172.21.15.50:0/582264542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f318ff0 0x55cb1f33afa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55cb1f315fe0 tx=0x7f9fdc018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53590fcf2ad6daed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.838+0000 7f9fe2000640 1 -- 172.21.15.50:0/582264542 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0a4720 con 0x55cb1f318ff0 2024-09-10T10:16:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.838+0000 7f9fe2000640 1 -- 172.21.15.50:0/582264542 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fdc099e60 con 0x55cb1f318ff0 2024-09-10T10:16:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.838+0000 7f9fe2000640 1 -- 172.21.15.50:0/582264542 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc018b30 con 0x55cb1f318ff0 2024-09-10T10:16:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.838+0000 7f9ffac63740 1 -- 172.21.15.50:0/582264542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f318ff0 msgr2=0x55cb1f33afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.838+0000 7f9ffac63740 1 --2- 172.21.15.50:0/582264542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f318ff0 0x55cb1f33afa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55cb1f315fe0 tx=0x7f9fdc018420 comp rx=0 tx=0).stop 2024-09-10T10:16:23.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.839+0000 7f9ffac63740 1 -- 172.21.15.50:0/582264542 shutdown_connections 2024-09-10T10:16:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.839+0000 7f9ffac63740 1 --2- 172.21.15.50:0/582264542 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f3238b0 0x55cb1f33b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.839+0000 7f9ffac63740 1 --2- 172.21.15.50:0/582264542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f318ff0 0x55cb1f33afa0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.839+0000 7f9ffac63740 1 --2- 172.21.15.50:0/582264542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f31a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.839+0000 7f9ffac63740 1 -- 172.21.15.50:0/582264542 >> 172.21.15.50:0/582264542 conn(0x55cb1f314c60 msgr2=0x55cb1f322750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.839+0000 7f9ffac63740 1 -- 172.21.15.50:0/582264542 shutdown_connections 2024-09-10T10:16:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.839+0000 7f9ffac63740 1 -- 172.21.15.50:0/582264542 wait complete. 2024-09-10T10:16:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.839+0000 7f9ffac63740 1 -- start start 2024-09-10T10:16:23.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.839+0000 7f9ffac63740 1 Processor -- start 2024-09-10T10:16:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.840+0000 7f9ffac63740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f32bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.840+0000 7f9ffac63740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f318ff0 0x55cb1f328020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.840+0000 7f9ffac63740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3238b0 0x55cb1f328560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.840+0000 7f9ffac63740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01b38a0 con 0x55cb1f3186d0 2024-09-10T10:16:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.840+0000 7f9ffac63740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01b4d10 con 0x55cb1f3238b0 2024-09-10T10:16:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.840+0000 7f9ffac63740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01b3f70 con 0x55cb1f318ff0 2024-09-10T10:16:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.840+0000 7f9ffac63740 10 client.0 _ll_register_callbacks cb 0x7f9fe4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.840+0000 7f9ff5800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f32bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.840+0000 7f9ff6200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3238b0 0x55cb1f328560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.840+0000 7f9ff5800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f32bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55218/0 (socket says 172.21.15.50:55218) 2024-09-10T10:16:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.840+0000 7f9ff5800640 1 -- 172.21.15.50:0/750422735 learned_addr learned my addr 172.21.15.50:0/750422735 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.840+0000 7f9ff4e00640 1 --2- 172.21.15.50:0/750422735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f318ff0 0x55cb1f328020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.841+0000 7f9ff6200640 1 -- 172.21.15.50:0/750422735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f318ff0 msgr2=0x55cb1f328020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:23.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.841+0000 7f9ff6200640 1 --2- 172.21.15.50:0/750422735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f318ff0 0x55cb1f328020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.841+0000 7f9ff6200640 1 -- 172.21.15.50:0/750422735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 msgr2=0x55cb1f32bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.841+0000 7f9ff6200640 1 --2- 172.21.15.50:0/750422735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f32bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.841+0000 7f9ff6200640 1 -- 172.21.15.50:0/750422735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb1f328aa0 con 0x55cb1f3238b0 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.841+0000 7f9ff5800640 1 --2- 172.21.15.50:0/750422735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f32bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.841+0000 7f9ff6200640 1 --2- 172.21.15.50:0/750422735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3238b0 0x55cb1f328560 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8004080 tx=0x7f9fe8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8195b90292f612b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.841+0000 7f9fd7400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.841+0000 7f9fd7400640 1 -- 172.21.15.50:0/750422735 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe802f060 con 0x55cb1f3238b0 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.841+0000 7f9fd7400640 1 -- 172.21.15.50:0/750422735 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f9fe801f7d0 con 0x55cb1f3238b0 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.841+0000 7f9ffac63740 1 -- 172.21.15.50:0/750422735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fdc099e60 con 0x55cb1f3238b0 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.842+0000 7f9fd7400640 1 -- 172.21.15.50:0/750422735 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9fe8036050 con 0x55cb1f3238b0 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.842+0000 7f9ffac63740 10 client.26438 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.842+0000 7f9ffac63740 1 -- 172.21.15.50:0/750422735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cb1f39ecf0 con 0x55cb1f3238b0 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.842+0000 7f9fd7400640 1 -- 172.21.15.50:0/750422735 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fdc099e60 con 0x55cb1f3238b0 2024-09-10T10:16:23.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.842+0000 7f9fd7400640 1 -- 172.21.15.50:0/750422735 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f9fe802abe0 con 0x55cb1f3238b0 2024-09-10T10:16:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.842+0000 7f9ffac63740 10 client.26438 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.842+0000 7f9ffac63740 10 client.26438 resolve_mds: validated gid 24560 aka daemon mds.b 2024-09-10T10:16:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.842+0000 7f9ffac63740 20 client.26438 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.842+0000 7f9ffac63740 1 --2- 172.21.15.50:0/750422735 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cb1f3335e0 0x55cb1f3a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.842+0000 7f9ffac63740 4 client.26438 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-10T10:16:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.842+0000 7f9ffac63740 1 -- 172.21.15.50:0/750422735 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55cb1f286dc0 con 0x55cb1f3335e0 2024-09-10T10:16:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.843+0000 7f9ff5800640 1 --2- 172.21.15.50:0/750422735 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cb1f3335e0 0x55cb1f3a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.843+0000 7f9ff5800640 1 --2- 172.21.15.50:0/750422735 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cb1f3335e0 0x55cb1f3a14b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fac0584be8cc3d50 server_cookie=56cf7989c32c1f89 in_seq=0 out_seq=0 2024-09-10T10:16:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.843+0000 7f9fd7400640 10 client.26438 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.843+0000 7f9fd7400640 1 -- 172.21.15.50:0/750422735 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55cb1f286dc0 con 0x55cb1f3335e0 2024-09-10T10:16:23.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.843+0000 7f9fd7400640 10 client.26438 handle_command_reply: tid=0 2024-09-10T10:16:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.843+0000 7f9ffac63740 1 client.26438 shutdown 2024-09-10T10:16:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.844+0000 7f9ffac63740 1 -- 172.21.15.50:0/750422735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3238b0 msgr2=0x55cb1f328560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.844+0000 7f9ffac63740 1 --2- 172.21.15.50:0/750422735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3238b0 0x55cb1f328560 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8004080 tx=0x7f9fe8004a40 comp rx=0 tx=0).stop 2024-09-10T10:16:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.844+0000 7f9ffac63740 1 -- 172.21.15.50:0/750422735 shutdown_connections 2024-09-10T10:16:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.844+0000 7f9ffac63740 1 --2- 172.21.15.50:0/750422735 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x55cb1f3335e0 0x55cb1f3a14b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.844+0000 7f9ffac63740 1 --2- 172.21.15.50:0/750422735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb1f3238b0 0x55cb1f328560 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.844+0000 7f9ffac63740 1 --2- 172.21.15.50:0/750422735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb1f318ff0 0x55cb1f328020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.844+0000 7f9ffac63740 1 --2- 172.21.15.50:0/750422735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cb1f3186d0 0x55cb1f32bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.844+0000 7f9ffac63740 1 -- 172.21.15.50:0/750422735 >> 172.21.15.50:0/750422735 conn(0x55cb1f314c60 msgr2=0x55cb1f321f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.844+0000 7f9fd7400640 0 client.26438 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.844+0000 7f9ffac63740 1 -- 172.21.15.50:0/750422735 shutdown_connections 2024-09-10T10:16:23.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.844+0000 7f9ffac63740 1 -- 172.21.15.50:0/750422735 wait complete. 2024-09-10T10:16:23.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.844+0000 7f9ffac63740 20 client.26438 trim_cache size 0 max 16384 2024-09-10T10:16:23.850 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:16:23.850 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 25, 2024-09-10T10:16:23.850 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24560, 2024-09-10T10:16:23.850 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 16, 2024-09-10T10:16:23.850 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": {} 2024-09-10T10:16:23.850 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:16:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.845+0000 7f9ff8200640 1 -- 172.21.15.50:0/945445732 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9fd80a2c00 msgr2=0x7f9fd80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.845+0000 7f9ff8200640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9fd80a2c00 0x7f9fd80a50c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8005fd0 tx=0x7f9fe8009500 comp rx=0 tx=0).stop 2024-09-10T10:16:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.845+0000 7f9ff8200640 1 -- 172.21.15.50:0/945445732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff01027a0 msgr2=0x7f9ff0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.845+0000 7f9ff8200640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff01027a0 0x7f9ff0074a30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00e9f0 tx=0x7f9fdc00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.845+0000 7f9ff8200640 1 -- 172.21.15.50:0/945445732 shutdown_connections 2024-09-10T10:16:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.845+0000 7f9ff8200640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f9fd80a2c00 0x7f9fd80a50c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.845+0000 7f9ff8200640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ff0106f20 0x7f9ff0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.845+0000 7f9ff8200640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ff01027a0 0x7f9ff0074a30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.845+0000 7f9ff8200640 1 --2- 172.21.15.50:0/945445732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ff0101df0 0x7f9ff00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:23.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.845+0000 7f9ff8200640 1 -- 172.21.15.50:0/945445732 >> 172.21.15.50:0/945445732 conn(0x7f9ff00fd8b0 msgr2=0x7f9ff00feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:23.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.845+0000 7f9ff8200640 1 -- 172.21.15.50:0/945445732 shutdown_connections 2024-09-10T10:16:23.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:23.845+0000 7f9ff8200640 1 -- 172.21.15.50:0/945445732 wait complete. 2024-09-10T10:16:24.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:23 smithi050 ceph-mon[30354]: scrub queued for path: / 2024-09-10T10:16:24.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:23 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:16:24.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:23 smithi050 ceph-mon[30354]: scrub summary: active paths [/] 2024-09-10T10:16:24.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:23 smithi050 ceph-mon[30354]: scrub summary: idle+waiting paths [/] 2024-09-10T10:16:24.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:23 smithi050 ceph-mon[30354]: pgmap v547: 129 pgs: 129 active+clean; 1.2 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.1 KiB/s wr, 221 op/s 2024-09-10T10:16:24.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:23 smithi050 ceph-mon[30354]: scrub summary: idle 2024-09-10T10:16:24.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T10:16:24.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:23 smithi189 ceph-mon[34999]: scrub queued for path: / 2024-09-10T10:16:24.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:23 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:16:24.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:23 smithi189 ceph-mon[34999]: scrub summary: active paths [/] 2024-09-10T10:16:24.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:23 smithi189 ceph-mon[34999]: scrub summary: idle+waiting paths [/] 2024-09-10T10:16:24.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:23 smithi189 ceph-mon[34999]: pgmap v547: 129 pgs: 129 active+clean; 1.2 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.1 KiB/s wr, 221 op/s 2024-09-10T10:16:24.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:23 smithi189 ceph-mon[34999]: scrub summary: idle 2024-09-10T10:16:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:23 smithi084 ceph-mon[34812]: scrub queued for path: / 2024-09-10T10:16:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:23 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:16:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:23 smithi084 ceph-mon[34812]: scrub summary: active paths [/] 2024-09-10T10:16:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:23 smithi084 ceph-mon[34812]: scrub summary: idle+waiting paths [/] 2024-09-10T10:16:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:23 smithi084 ceph-mon[34812]: pgmap v547: 129 pgs: 129 active+clean; 1.2 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.1 KiB/s wr, 221 op/s 2024-09-10T10:16:24.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:23 smithi084 ceph-mon[34812]: scrub summary: idle 2024-09-10T10:16:25.031 INFO:tasks.quiescer:done joining Quiescers 2024-09-10T10:16:25.031 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-10T10:16:25.044 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-10T10:16:25.107 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:25.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.680+0000 7f962c600640 1 -- 172.21.15.50:0/2421740883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9624076720 msgr2=0x7f9624076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:25.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.680+0000 7f962c600640 1 --2- 172.21.15.50:0/2421740883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9624076720 0x7f9624076b00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9618009900 tx=0x7f961802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.680+0000 7f962c600640 1 -- 172.21.15.50:0/2421740883 shutdown_connections 2024-09-10T10:16:25.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.680+0000 7f962c600640 1 --2- 172.21.15.50:0/2421740883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624112a30 0x7f9624114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.680+0000 7f962c600640 1 --2- 172.21.15.50:0/2421740883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9624077040 0x7f96241124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.680+0000 7f962c600640 1 --2- 172.21.15.50:0/2421740883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9624076720 0x7f9624076b00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.680+0000 7f962c600640 1 -- 172.21.15.50:0/2421740883 >> 172.21.15.50:0/2421740883 conn(0x7f96240ffa90 msgr2=0x7f9624101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:25.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.680+0000 7f962c600640 1 -- 172.21.15.50:0/2421740883 shutdown_connections 2024-09-10T10:16:25.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.681+0000 7f962c600640 1 -- 172.21.15.50:0/2421740883 wait complete. 2024-09-10T10:16:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.681+0000 7f962c600640 1 Processor -- start 2024-09-10T10:16:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.682+0000 7f962c600640 1 -- start start 2024-09-10T10:16:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.682+0000 7f962c600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9624076720 0x7f96241a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.682+0000 7f962c600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9624077040 0x7f96241a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.682+0000 7f962c600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624112a30 0x7f962419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.682+0000 7f962c600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9624118610 con 0x7f9624076720 2024-09-10T10:16:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.682+0000 7f962c600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9624118490 con 0x7f9624077040 2024-09-10T10:16:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.682+0000 7f962c600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9624118790 con 0x7f9624112a30 2024-09-10T10:16:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.682+0000 7f9629c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9624076720 0x7f96241a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.682+0000 7f9629200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9624077040 0x7f96241a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.682+0000 7f9629200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9624077040 0x7f96241a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37572/0 (socket says 172.21.15.50:37572) 2024-09-10T10:16:25.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.682+0000 7f9629200640 1 -- 172.21.15.50:0/1847782385 learned_addr learned my addr 172.21.15.50:0/1847782385 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.682+0000 7f962a600640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624112a30 0x7f962419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.683+0000 7f9629200640 1 -- 172.21.15.50:0/1847782385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624112a30 msgr2=0x7f962419e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.683+0000 7f9629200640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624112a30 0x7f962419e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.683+0000 7f9629200640 1 -- 172.21.15.50:0/1847782385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9624076720 msgr2=0x7f96241a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.683+0000 7f9629200640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9624076720 0x7f96241a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.683+0000 7f9629200640 1 -- 172.21.15.50:0/1847782385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962419efa0 con 0x7f9624077040 2024-09-10T10:16:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.683+0000 7f9629c00640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9624076720 0x7f96241a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.683+0000 7f9629200640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9624077040 0x7f96241a4bf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f961000ea60 tx=0x7f961000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.683+0000 7f9622000640 1 -- 172.21.15.50:0/1847782385 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961000cde0 con 0x7f9624077040 2024-09-10T10:16:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.683+0000 7f962c600640 1 -- 172.21.15.50:0/1847782385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f962419f290 con 0x7f9624077040 2024-09-10T10:16:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.683+0000 7f9622000640 1 -- 172.21.15.50:0/1847782385 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96100035f0 con 0x7f9624077040 2024-09-10T10:16:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.683+0000 7f9622000640 1 -- 172.21.15.50:0/1847782385 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610010670 con 0x7f9624077040 2024-09-10T10:16:25.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.684+0000 7f962c600640 1 -- 172.21.15.50:0/1847782385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96241ab580 con 0x7f9624077040 2024-09-10T10:16:25.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.686+0000 7f962f1e9740 1 Processor -- start 2024-09-10T10:16:25.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.687+0000 7f962f1e9740 1 -- start start 2024-09-10T10:16:25.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.687+0000 7f962f1e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 0x559c87de0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.687+0000 7f9622000640 1 -- 172.21.15.50:0/1847782385 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f96100037a0 con 0x7f9624077040 2024-09-10T10:16:25.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.687+0000 7f962f1e9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87de14b0 0x559c87deb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.687+0000 7f962f1e9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87debd70 0x559c87dee160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.687+0000 7f962f1e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559c87d473e0 con 0x559c87de0b90 2024-09-10T10:16:25.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.687+0000 7f962f1e9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559c87ceed80 con 0x559c87debd70 2024-09-10T10:16:25.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.687+0000 7f962f1e9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559c87d433a0 con 0x559c87de14b0 2024-09-10T10:16:25.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.687+0000 7f962a600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 0x559c87de0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.687+0000 7f962a600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 0x559c87de0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55262/0 (socket says 172.21.15.50:55262) 2024-09-10T10:16:25.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.687+0000 7f962a600640 1 -- 172.21.15.50:0/3147910578 learned_addr learned my addr 172.21.15.50:0/3147910578 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:25.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.688+0000 7f9629200640 1 --2- 172.21.15.50:0/3147910578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87debd70 0x559c87dee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.688+0000 7f9629c00640 1 --2- 172.21.15.50:0/3147910578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87de14b0 0x559c87deb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.688+0000 7f962a600640 1 -- 172.21.15.50:0/3147910578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87de14b0 msgr2=0x559c87deb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:25.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.688+0000 7f962a600640 1 --2- 172.21.15.50:0/3147910578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87de14b0 0x559c87deb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.688+0000 7f962a600640 1 -- 172.21.15.50:0/3147910578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87debd70 msgr2=0x559c87dee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:25.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.688+0000 7f962a600640 1 --2- 172.21.15.50:0/3147910578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87debd70 0x559c87dee160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.688+0000 7f962a600640 1 -- 172.21.15.50:0/3147910578 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c87d0dae0 con 0x559c87de0b90 2024-09-10T10:16:25.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.688+0000 7f962a600640 1 --2- 172.21.15.50:0/3147910578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 0x559c87de0f70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f961c009f10 tx=0x7f961c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb746f5344beeb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:25.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.689+0000 7f9616a00640 1 -- 172.21.15.50:0/3147910578 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961c016070 con 0x559c87de0b90 2024-09-10T10:16:25.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.689+0000 7f9616a00640 1 -- 172.21.15.50:0/3147910578 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f961c01bb40 con 0x559c87de0b90 2024-09-10T10:16:25.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.689+0000 7f9616a00640 1 -- 172.21.15.50:0/3147910578 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961c012cb0 con 0x559c87de0b90 2024-09-10T10:16:25.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.689+0000 7f9622000640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f960c0a2b80 0x7f960c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.689+0000 7f9622000640 1 -- 172.21.15.50:0/1847782385 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f96100cf6e0 con 0x7f9624077040 2024-09-10T10:16:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.689+0000 7f9629c00640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f960c0a2b80 0x7f960c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.689+0000 7f962f1e9740 1 -- 172.21.15.50:0/3147910578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 msgr2=0x559c87de0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.689+0000 7f962f1e9740 1 --2- 172.21.15.50:0/3147910578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 0x559c87de0f70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f961c009f10 tx=0x7f961c010740 comp rx=0 tx=0).stop 2024-09-10T10:16:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.690+0000 7f962f1e9740 1 -- 172.21.15.50:0/3147910578 shutdown_connections 2024-09-10T10:16:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.690+0000 7f962f1e9740 1 --2- 172.21.15.50:0/3147910578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87debd70 0x559c87dee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.690+0000 7f962f1e9740 1 --2- 172.21.15.50:0/3147910578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87de14b0 0x559c87deb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.690+0000 7f962f1e9740 1 --2- 172.21.15.50:0/3147910578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 0x559c87de0f70 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.690+0000 7f962f1e9740 1 -- 172.21.15.50:0/3147910578 >> 172.21.15.50:0/3147910578 conn(0x559c87ddd120 msgr2=0x559c87ddd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.690+0000 7f962f1e9740 1 -- 172.21.15.50:0/3147910578 shutdown_connections 2024-09-10T10:16:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.690+0000 7f962f1e9740 1 -- 172.21.15.50:0/3147910578 wait complete. 2024-09-10T10:16:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.690+0000 7f9629c00640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f960c0a2b80 0x7f960c0a5040 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9618006010 tx=0x7f9618031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:25.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.690+0000 7f962f1e9740 1 -- start start 2024-09-10T10:16:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.691+0000 7f962f1e9740 1 Processor -- start 2024-09-10T10:16:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.691+0000 7f962f1e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 0x559c87de8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.691+0000 7f962f1e9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de14b0 0x559c87de91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.691+0000 7f962f1e9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87debd70 0x559c87de9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.691+0000 7f962f1e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559c87dee9e0 con 0x559c87de0b90 2024-09-10T10:16:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.691+0000 7f962f1e9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559c87d020f0 con 0x559c87de14b0 2024-09-10T10:16:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.691+0000 7f962f1e9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559c87deeb60 con 0x559c87debd70 2024-09-10T10:16:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.691+0000 7f962f1e9740 10 client.0 _ll_register_callbacks cb 0x559c87cf39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.691+0000 7f9629c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 0x559c87de8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.691+0000 7f9629c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 0x559c87de8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55266/0 (socket says 172.21.15.50:55266) 2024-09-10T10:16:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.691+0000 7f9629c00640 1 -- 172.21.15.50:0/3008979412 learned_addr learned my addr 172.21.15.50:0/3008979412 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.691+0000 7f9629200640 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de14b0 0x559c87de91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.692+0000 7f962a600640 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87debd70 0x559c87de9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.692+0000 7f9629c00640 1 -- 172.21.15.50:0/3008979412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87debd70 msgr2=0x559c87de9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:25.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.692+0000 7f9629c00640 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87debd70 0x559c87de9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.692+0000 7f9629c00640 1 -- 172.21.15.50:0/3008979412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de14b0 msgr2=0x559c87de91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:25.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.692+0000 7f9629c00640 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de14b0 0x559c87de91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.692+0000 7f9629c00640 1 -- 172.21.15.50:0/3008979412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c87ab83c0 con 0x559c87de0b90 2024-09-10T10:16:25.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.692+0000 7f9629200640 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de14b0 0x559c87de91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:25.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.692+0000 7f9629c00640 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 0x559c87de8c80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9618033000 tx=0x7f961802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b7a441a826902 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:25.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.692+0000 7f960b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:16:25.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.693+0000 7f960b400640 1 -- 172.21.15.50:0/3008979412 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9618035040 con 0x559c87de0b90 2024-09-10T10:16:25.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.693+0000 7f960b400640 1 -- 172.21.15.50:0/3008979412 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f96180317b0 con 0x559c87de0b90 2024-09-10T10:16:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.693+0000 7f962f1e9740 1 -- 172.21.15.50:0/3008979412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f961c01bb40 con 0x559c87de0b90 2024-09-10T10:16:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.693+0000 7f960b400640 1 -- 172.21.15.50:0/3008979412 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f96180319b0 con 0x559c87de0b90 2024-09-10T10:16:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.693+0000 7f962f1e9740 10 client.16374 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.693+0000 7f962f1e9740 1 -- 172.21.15.50:0/3008979412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559c87dfa6c0 con 0x559c87de0b90 2024-09-10T10:16:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.693+0000 7f960b400640 1 -- 172.21.15.50:0/3008979412 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f961c01bb40 con 0x559c87de0b90 2024-09-10T10:16:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.693+0000 7f960b400640 1 -- 172.21.15.50:0/3008979412 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f9618044030 con 0x559c87de0b90 2024-09-10T10:16:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.693+0000 7f962f1e9740 10 client.16374 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.693+0000 7f962f1e9740 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:16:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.694+0000 7f962f1e9740 20 client.16374 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.694+0000 7f962f1e9740 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559c87dfbb80 0x559c87dfdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.694+0000 7f962f1e9740 4 client.16374 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:16:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.694+0000 7f962f1e9740 1 -- 172.21.15.50:0/3008979412 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c87d54950 con 0x559c87dfbb80 2024-09-10T10:16:25.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.694+0000 7f9629200640 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559c87dfbb80 0x559c87dfdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.694+0000 7f9629200640 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559c87dfbb80 0x559c87dfdff0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94ecb6a4ade59f00 server_cookie=a03444aa0e4188a9 in_seq=0 out_seq=0 2024-09-10T10:16:25.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.694+0000 7f960b400640 10 client.16374 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.695+0000 7f960b400640 1 -- 172.21.15.50:0/3008979412 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c87d54950 con 0x559c87dfbb80 2024-09-10T10:16:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.695+0000 7f960b400640 10 client.16374 handle_command_reply: tid=0 2024-09-10T10:16:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.695+0000 7f962f1e9740 1 client.16374 shutdown 2024-09-10T10:16:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.695+0000 7f962f1e9740 1 -- 172.21.15.50:0/3008979412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 msgr2=0x559c87de8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.695+0000 7f962f1e9740 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 0x559c87de8c80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9618033000 tx=0x7f961802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.696+0000 7f962f1e9740 1 -- 172.21.15.50:0/3008979412 shutdown_connections 2024-09-10T10:16:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.696+0000 7f962f1e9740 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559c87dfbb80 0x559c87dfdff0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.696+0000 7f962f1e9740 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87debd70 0x559c87de9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.696+0000 7f962f1e9740 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de14b0 0x559c87de91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.696+0000 7f962f1e9740 1 --2- 172.21.15.50:0/3008979412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de0b90 0x559c87de8c80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.696+0000 7f962f1e9740 1 -- 172.21.15.50:0/3008979412 >> 172.21.15.50:0/3008979412 conn(0x559c87ddd120 msgr2=0x559c87de2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:25.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.696+0000 7f960b400640 0 client.16374 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:25.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.696+0000 7f962f1e9740 1 -- 172.21.15.50:0/3008979412 shutdown_connections 2024-09-10T10:16:25.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.696+0000 7f962f1e9740 1 -- 172.21.15.50:0/3008979412 wait complete. 2024-09-10T10:16:25.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.696+0000 7f962f1e9740 20 client.16374 trim_cache size 0 max 16384 2024-09-10T10:16:25.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.721+0000 7f962f1e9740 1 Processor -- start 2024-09-10T10:16:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.721+0000 7f962f1e9740 1 -- start start 2024-09-10T10:16:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.721+0000 7f962f1e9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de0b90 0x559c87de7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.721+0000 7f962f1e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de14b0 0x559c87e038c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.721+0000 7f962f1e9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87debd70 0x559c87e03e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.721+0000 7f962f1e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96241b7b50 con 0x559c87de14b0 2024-09-10T10:16:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.721+0000 7f962f1e9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f96241b5420 con 0x559c87de0b90 2024-09-10T10:16:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.721+0000 7f962f1e9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96241b3270 con 0x559c87debd70 2024-09-10T10:16:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.722+0000 7f9629200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de14b0 0x559c87e038c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.722+0000 7f9629200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de14b0 0x559c87e038c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55272/0 (socket says 172.21.15.50:55272) 2024-09-10T10:16:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.722+0000 7f962a600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87debd70 0x559c87e03e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.722+0000 7f9629200640 1 -- 172.21.15.50:0/1703479336 learned_addr learned my addr 172.21.15.50:0/1703479336 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.722+0000 7f9629c00640 1 --2- 172.21.15.50:0/1703479336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de0b90 0x559c87de7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.722+0000 7f9629200640 1 -- 172.21.15.50:0/1703479336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87debd70 msgr2=0x559c87e03e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:25.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.722+0000 7f9629200640 1 --2- 172.21.15.50:0/1703479336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87debd70 0x559c87e03e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.722+0000 7f9629200640 1 -- 172.21.15.50:0/1703479336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de0b90 msgr2=0x559c87de7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.722+0000 7f9629200640 1 --2- 172.21.15.50:0/1703479336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de0b90 0x559c87de7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.722+0000 7f9629200640 1 -- 172.21.15.50:0/1703479336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c87dd73c0 con 0x559c87de14b0 2024-09-10T10:16:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.722+0000 7f962a600640 1 --2- 172.21.15.50:0/1703479336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87debd70 0x559c87e03e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.722+0000 7f9629c00640 1 --2- 172.21.15.50:0/1703479336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de0b90 0x559c87de7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.722+0000 7f9629200640 1 --2- 172.21.15.50:0/1703479336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de14b0 0x559c87e038c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f961009bae0 tx=0x7f96100d5530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8308f238f48b816e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.723+0000 7f9616000640 1 -- 172.21.15.50:0/1703479336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961009b690 con 0x559c87de14b0 2024-09-10T10:16:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.723+0000 7f9616000640 1 -- 172.21.15.50:0/1703479336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f961009c250 con 0x559c87de14b0 2024-09-10T10:16:25.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.723+0000 7f9616000640 1 -- 172.21.15.50:0/1703479336 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961009b4b0 con 0x559c87de14b0 2024-09-10T10:16:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.723+0000 7f962f1e9740 1 -- 172.21.15.50:0/1703479336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de14b0 msgr2=0x559c87e038c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.723+0000 7f962f1e9740 1 --2- 172.21.15.50:0/1703479336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de14b0 0x559c87e038c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f961009bae0 tx=0x7f96100d5530 comp rx=0 tx=0).stop 2024-09-10T10:16:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.723+0000 7f962f1e9740 1 -- 172.21.15.50:0/1703479336 shutdown_connections 2024-09-10T10:16:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.723+0000 7f962f1e9740 1 --2- 172.21.15.50:0/1703479336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87debd70 0x559c87e03e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.723+0000 7f962f1e9740 1 --2- 172.21.15.50:0/1703479336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87de14b0 0x559c87e038c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.723+0000 7f962f1e9740 1 --2- 172.21.15.50:0/1703479336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de0b90 0x559c87de7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.723+0000 7f962f1e9740 1 -- 172.21.15.50:0/1703479336 >> 172.21.15.50:0/1703479336 conn(0x559c87ddd120 msgr2=0x559c87de7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:25.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.724+0000 7f962f1e9740 1 -- 172.21.15.50:0/1703479336 shutdown_connections 2024-09-10T10:16:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.724+0000 7f962f1e9740 1 -- 172.21.15.50:0/1703479336 wait complete. 2024-09-10T10:16:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.724+0000 7f962f1e9740 1 -- start start 2024-09-10T10:16:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.724+0000 7f962f1e9740 1 Processor -- start 2024-09-10T10:16:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.725+0000 7f962f1e9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87de0b90 0x559c87df4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.725+0000 7f962f1e9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de14b0 0x559c87de5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.725+0000 7f962f1e9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87debd70 0x559c87de6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.725+0000 7f962f1e9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96241b38e0 con 0x559c87debd70 2024-09-10T10:16:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.725+0000 7f962f1e9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f96241b4d50 con 0x559c87de14b0 2024-09-10T10:16:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.725+0000 7f962f1e9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f96241b3fb0 con 0x559c87de0b90 2024-09-10T10:16:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.725+0000 7f962f1e9740 10 client.0 _ll_register_callbacks cb 0x7f9618005220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.725+0000 7f9629c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87de0b90 0x559c87df4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.725+0000 7f9629c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87de0b90 0x559c87df4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:50328/0 (socket says 172.21.15.50:50328) 2024-09-10T10:16:25.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.725+0000 7f962a600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87debd70 0x559c87de6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.725+0000 7f9629c00640 1 -- 172.21.15.50:0/1799436307 learned_addr learned my addr 172.21.15.50:0/1799436307 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.725+0000 7f9629200640 1 --2- 172.21.15.50:0/1799436307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de14b0 0x559c87de5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.726+0000 7f962a600640 1 -- 172.21.15.50:0/1799436307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87de0b90 msgr2=0x559c87df4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.726+0000 7f962a600640 1 --2- 172.21.15.50:0/1799436307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87de0b90 0x559c87df4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.726+0000 7f962a600640 1 -- 172.21.15.50:0/1799436307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de14b0 msgr2=0x559c87de5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.726+0000 7f962a600640 1 --2- 172.21.15.50:0/1799436307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de14b0 0x559c87de5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.726+0000 7f962a600640 1 -- 172.21.15.50:0/1799436307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c87e65890 con 0x559c87debd70 2024-09-10T10:16:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.726+0000 7f9629200640 1 --2- 172.21.15.50:0/1799436307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de14b0 0x559c87de5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.726+0000 7f962a600640 1 --2- 172.21.15.50:0/1799436307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87debd70 0x559c87de6370 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f961c0127b0 tx=0x7f961c0126f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef326a87f152d72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:25.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.726+0000 7f960b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:16:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.726+0000 7f960b400640 1 -- 172.21.15.50:0/1799436307 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961c02a020 con 0x559c87debd70 2024-09-10T10:16:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.726+0000 7f960b400640 1 -- 172.21.15.50:0/1799436307 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f961c0128f0 con 0x559c87debd70 2024-09-10T10:16:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.726+0000 7f962f1e9740 1 -- 172.21.15.50:0/1799436307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f961009c250 con 0x559c87debd70 2024-09-10T10:16:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.727+0000 7f960b400640 1 -- 172.21.15.50:0/1799436307 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f961c035050 con 0x559c87debd70 2024-09-10T10:16:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.727+0000 7f962f1e9740 10 client.16380 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.727+0000 7f962f1e9740 1 -- 172.21.15.50:0/1799436307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559c87e66a60 con 0x559c87debd70 2024-09-10T10:16:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.727+0000 7f960b400640 1 -- 172.21.15.50:0/1799436307 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f961009c250 con 0x559c87debd70 2024-09-10T10:16:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.727+0000 7f960b400640 1 -- 172.21.15.50:0/1799436307 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f961c00f040 con 0x559c87debd70 2024-09-10T10:16:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.727+0000 7f962f1e9740 10 client.16380 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.727+0000 7f962f1e9740 10 client.16380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:16:25.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.727+0000 7f962f1e9740 20 client.16380 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.727+0000 7f962f1e9740 1 --2- 172.21.15.50:0/1799436307 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559c87e66f00 0x559c87e692f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.727+0000 7f962f1e9740 4 client.16380 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T10:16:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.727+0000 7f962f1e9740 1 -- 172.21.15.50:0/1799436307 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559c87d4ee60 con 0x559c87e66f00 2024-09-10T10:16:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.728+0000 7f9629c00640 1 --2- 172.21.15.50:0/1799436307 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559c87e66f00 0x559c87e692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.728+0000 7f9629c00640 1 --2- 172.21.15.50:0/1799436307 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559c87e66f00 0x559c87e692f0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53fb0eb43f19fa6b server_cookie=3be2360f910e915a in_seq=0 out_seq=0 2024-09-10T10:16:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.728+0000 7f960b400640 10 client.16380 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.728+0000 7f960b400640 1 -- 172.21.15.50:0/1799436307 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559c87d4ee60 con 0x559c87e66f00 2024-09-10T10:16:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.728+0000 7f960b400640 10 client.16380 handle_command_reply: tid=0 2024-09-10T10:16:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.728+0000 7f962f1e9740 1 client.16380 shutdown 2024-09-10T10:16:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.728+0000 7f962f1e9740 1 -- 172.21.15.50:0/1799436307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87debd70 msgr2=0x559c87de6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.728+0000 7f962f1e9740 1 --2- 172.21.15.50:0/1799436307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87debd70 0x559c87de6370 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f961c0127b0 tx=0x7f961c0126f0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.729+0000 7f962f1e9740 1 -- 172.21.15.50:0/1799436307 shutdown_connections 2024-09-10T10:16:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.729+0000 7f962f1e9740 1 --2- 172.21.15.50:0/1799436307 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x559c87e66f00 0x559c87e692f0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.729+0000 7f962f1e9740 1 --2- 172.21.15.50:0/1799436307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559c87debd70 0x559c87de6370 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.729+0000 7f962f1e9740 1 --2- 172.21.15.50:0/1799436307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559c87de14b0 0x559c87de5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.729+0000 7f962f1e9740 1 --2- 172.21.15.50:0/1799436307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c87de0b90 0x559c87df4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.729+0000 7f962f1e9740 1 -- 172.21.15.50:0/1799436307 >> 172.21.15.50:0/1799436307 conn(0x559c87ddd120 msgr2=0x559c87de7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.729+0000 7f960b400640 0 client.16380 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.729+0000 7f962f1e9740 1 -- 172.21.15.50:0/1799436307 shutdown_connections 2024-09-10T10:16:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.729+0000 7f962f1e9740 1 -- 172.21.15.50:0/1799436307 wait complete. 2024-09-10T10:16:25.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.729+0000 7f962f1e9740 20 client.16380 trim_cache size 0 max 16384 2024-09-10T10:16:25.734 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:16:25.735 INFO:teuthology.orchestra.run.smithi050.stdout: "status": "no active scrubs running", 2024-09-10T10:16:25.735 INFO:teuthology.orchestra.run.smithi050.stdout: "scrubs": {} 2024-09-10T10:16:25.735 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:16:25.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.730+0000 7f962c600640 1 -- 172.21.15.50:0/1847782385 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f960c0a2b80 msgr2=0x7f960c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.730+0000 7f962c600640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f960c0a2b80 0x7f960c0a5040 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9618006010 tx=0x7f9618031510 comp rx=0 tx=0).stop 2024-09-10T10:16:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.730+0000 7f962c600640 1 -- 172.21.15.50:0/1847782385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9624077040 msgr2=0x7f96241a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.730+0000 7f962c600640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9624077040 0x7f96241a4bf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f961000ea60 tx=0x7f961000ef20 comp rx=0 tx=0).stop 2024-09-10T10:16:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.730+0000 7f962c600640 1 -- 172.21.15.50:0/1847782385 shutdown_connections 2024-09-10T10:16:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.730+0000 7f962c600640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f960c0a2b80 0x7f960c0a5040 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.730+0000 7f962c600640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9624112a30 0x7f962419e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.730+0000 7f962c600640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9624077040 0x7f96241a4bf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.730+0000 7f962c600640 1 --2- 172.21.15.50:0/1847782385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9624076720 0x7f96241a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.730+0000 7f962c600640 1 -- 172.21.15.50:0/1847782385 >> 172.21.15.50:0/1847782385 conn(0x7f96240ffa90 msgr2=0x7f9624101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.730+0000 7f962c600640 1 -- 172.21.15.50:0/1847782385 shutdown_connections 2024-09-10T10:16:25.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:25.730+0000 7f962c600640 1 -- 172.21.15.50:0/1847782385 wait complete. 2024-09-10T10:16:26.235 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:25 smithi050 ceph-mon[30354]: pgmap v548: 129 pgs: 129 active+clean; 1.2 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 219 op/s 2024-09-10T10:16:26.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:25 smithi189 ceph-mon[34999]: pgmap v548: 129 pgs: 129 active+clean; 1.2 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 219 op/s 2024-09-10T10:16:26.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:25 smithi084 ceph-mon[34812]: pgmap v548: 129 pgs: 129 active+clean; 1.2 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 219 op/s 2024-09-10T10:16:26.663 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T10:16:26.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:16:27.041 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:27.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.596+0000 7f8712c00640 1 -- 172.21.15.50:0/1262895578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c1019c0 msgr2=0x7f870c101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:27.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.596+0000 7f8712c00640 1 --2- 172.21.15.50:0/1262895578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c1019c0 0x7f870c101e20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009930 tx=0x7f86f802a420 comp rx=0 tx=0).stop 2024-09-10T10:16:27.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.596+0000 7f8712c00640 1 -- 172.21.15.50:0/1262895578 shutdown_connections 2024-09-10T10:16:27.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.596+0000 7f8712c00640 1 --2- 172.21.15.50:0/1262895578 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f870c102360 0x7f870c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:27.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.596+0000 7f8712c00640 1 --2- 172.21.15.50:0/1262895578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c1019c0 0x7f870c101e20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:27.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.596+0000 7f8712c00640 1 --2- 172.21.15.50:0/1262895578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c1079c0 0x7f870c107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:27.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.596+0000 7f8712c00640 1 -- 172.21.15.50:0/1262895578 >> 172.21.15.50:0/1262895578 conn(0x7f870c0fd740 msgr2=0x7f870c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:27.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.596+0000 7f8712c00640 1 -- 172.21.15.50:0/1262895578 shutdown_connections 2024-09-10T10:16:27.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.596+0000 7f8712c00640 1 -- 172.21.15.50:0/1262895578 wait complete. 2024-09-10T10:16:27.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.597+0000 7f8712c00640 1 Processor -- start 2024-09-10T10:16:27.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.597+0000 7f8712c00640 1 -- start start 2024-09-10T10:16:27.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8712c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c1019c0 0x7f870c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8712c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c102360 0x7f870c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8712c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f870c1079c0 0x7f870c19edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8712c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f870c111dd0 con 0x7f870c1019c0 2024-09-10T10:16:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8712c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f870c111c50 con 0x7f870c102360 2024-09-10T10:16:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8712c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f870c111f50 con 0x7f870c1079c0 2024-09-10T10:16:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8711800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c1019c0 0x7f870c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8711800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c1019c0 0x7f870c19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49524/0 (socket says 172.21.15.50:49524) 2024-09-10T10:16:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8711800640 1 -- 172.21.15.50:0/1817966782 learned_addr learned my addr 172.21.15.50:0/1817966782 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8710e00640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c102360 0x7f870c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8712200640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f870c1079c0 0x7f870c19edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8711800640 1 -- 172.21.15.50:0/1817966782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f870c1079c0 msgr2=0x7f870c19edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8711800640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f870c1079c0 0x7f870c19edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:27.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8711800640 1 -- 172.21.15.50:0/1817966782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c102360 msgr2=0x7f870c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8711800640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c102360 0x7f870c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8711800640 1 -- 172.21.15.50:0/1817966782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c19f4a0 con 0x7f870c1019c0 2024-09-10T10:16:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.598+0000 7f8710e00640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c102360 0x7f870c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.599+0000 7f8711800640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c1019c0 0x7f870c19a4f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f870000ebc0 tx=0x7f870000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.599+0000 7f870a000640 1 -- 172.21.15.50:0/1817966782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700010630 con 0x7f870c1019c0 2024-09-10T10:16:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.599+0000 7f8712c00640 1 -- 172.21.15.50:0/1817966782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f870c19f790 con 0x7f870c1019c0 2024-09-10T10:16:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.599+0000 7f870a000640 1 -- 172.21.15.50:0/1817966782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8700010cb0 con 0x7f870c1019c0 2024-09-10T10:16:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.599+0000 7f870a000640 1 -- 172.21.15.50:0/1817966782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700018bd0 con 0x7f870c1019c0 2024-09-10T10:16:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.599+0000 7f8712c00640 1 -- 172.21.15.50:0/1817966782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f870c1a7070 con 0x7f870c1019c0 2024-09-10T10:16:27.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.600+0000 7f8712c00640 1 -- 172.21.15.50:0/1817966782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f870c101e20 con 0x7f870c1019c0 2024-09-10T10:16:27.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.602+0000 7f870a000640 1 -- 172.21.15.50:0/1817966782 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f87000107d0 con 0x7f870c1019c0 2024-09-10T10:16:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.603+0000 7f870a000640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f86f40a2b80 0x7f86f40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.604+0000 7f870a000640 1 -- 172.21.15.50:0/1817966782 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f87000cf990 con 0x7f870c1019c0 2024-09-10T10:16:27.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.604+0000 7f8710e00640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f86f40a2b80 0x7f86f40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:27.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.604+0000 7f8710e00640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f86f40a2b80 0x7f86f40a5040 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f86f8006010 tx=0x7f86f8031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.608+0000 7f870a000640 1 -- 172.21.15.50:0/1817966782 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f870009beb0 con 0x7f870c1019c0 2024-09-10T10:16:27.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.831+0000 7f8712c00640 1 -- 172.21.15.50:0/1817966782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f870c1a7360 con 0x7f870c1019c0 2024-09-10T10:16:27.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.832+0000 7f870a000640 1 -- 172.21.15.50:0/1817966782 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f87000a01b0 con 0x7f870c1019c0 2024-09-10T10:16:27.834 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:16:27.834 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:16:27.834 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:16:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.835+0000 7f8712c00640 1 -- 172.21.15.50:0/1817966782 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f86f40a2b80 msgr2=0x7f86f40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.835+0000 7f8712c00640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f86f40a2b80 0x7f86f40a5040 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f86f8006010 tx=0x7f86f8031510 comp rx=0 tx=0).stop 2024-09-10T10:16:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.835+0000 7f8712c00640 1 -- 172.21.15.50:0/1817966782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c1019c0 msgr2=0x7f870c19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:27.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.835+0000 7f8712c00640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c1019c0 0x7f870c19a4f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f870000ebc0 tx=0x7f870000c6a0 comp rx=0 tx=0).stop 2024-09-10T10:16:27.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.835+0000 7f8712c00640 1 -- 172.21.15.50:0/1817966782 shutdown_connections 2024-09-10T10:16:27.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.835+0000 7f8712c00640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f86f40a2b80 0x7f86f40a5040 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:27.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.835+0000 7f8712c00640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f870c1079c0 0x7f870c19edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:27.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.835+0000 7f8712c00640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f870c102360 0x7f870c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:27.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.835+0000 7f8712c00640 1 --2- 172.21.15.50:0/1817966782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f870c1019c0 0x7f870c19a4f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:27.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.835+0000 7f8712c00640 1 -- 172.21.15.50:0/1817966782 >> 172.21.15.50:0/1817966782 conn(0x7f870c0fd740 msgr2=0x7f870c10d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:27.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.835+0000 7f8712c00640 1 -- 172.21.15.50:0/1817966782 shutdown_connections 2024-09-10T10:16:27.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:27.835+0000 7f8712c00640 1 -- 172.21.15.50:0/1817966782 wait complete. 2024-09-10T10:16:28.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:27 smithi050 ceph-mon[30354]: pgmap v549: 129 pgs: 129 active+clean; 1.3 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 212 op/s 2024-09-10T10:16:28.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:27 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1817966782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:16:28.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:27 smithi189 ceph-mon[34999]: pgmap v549: 129 pgs: 129 active+clean; 1.3 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 212 op/s 2024-09-10T10:16:28.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:27 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1817966782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:16:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:27 smithi084 ceph-mon[34812]: pgmap v549: 129 pgs: 129 active+clean; 1.3 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 212 op/s 2024-09-10T10:16:28.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:27 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1817966782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:16:28.695 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T10:16:29.081 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.666+0000 7f248d000640 1 -- 172.21.15.50:0/716499945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2488076720 msgr2=0x7f2488076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.666+0000 7f248d000640 1 --2- 172.21.15.50:0/716499945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2488076720 0x7f2488076b00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2478009900 tx=0x7f247802a410 comp rx=0 tx=0).stop 2024-09-10T10:16:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.666+0000 7f248d000640 1 -- 172.21.15.50:0/716499945 shutdown_connections 2024-09-10T10:16:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.666+0000 7f248d000640 1 --2- 172.21.15.50:0/716499945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2488112870 0x7f2488114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.666+0000 7f248d000640 1 --2- 172.21.15.50:0/716499945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2488077040 0x7f2488112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.666+0000 7f248d000640 1 --2- 172.21.15.50:0/716499945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2488076720 0x7f2488076b00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.666+0000 7f248d000640 1 -- 172.21.15.50:0/716499945 >> 172.21.15.50:0/716499945 conn(0x7f24880ff910 msgr2=0x7f2488101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:29.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.666+0000 7f248d000640 1 -- 172.21.15.50:0/716499945 shutdown_connections 2024-09-10T10:16:29.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.666+0000 7f248d000640 1 -- 172.21.15.50:0/716499945 wait complete. 2024-09-10T10:16:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.667+0000 7f248d000640 1 Processor -- start 2024-09-10T10:16:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.667+0000 7f248d000640 1 -- start start 2024-09-10T10:16:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.668+0000 7f248d000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2488076720 0x7f24881a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.668+0000 7f248d000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2488077040 0x7f24881a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.668+0000 7f248d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2488112870 0x7f248819e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.668+0000 7f248d000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2488118400 con 0x7f2488077040 2024-09-10T10:16:29.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.668+0000 7f248d000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2488118280 con 0x7f2488112870 2024-09-10T10:16:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.668+0000 7f248d000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2488118580 con 0x7f2488076720 2024-09-10T10:16:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.668+0000 7f2486a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2488077040 0x7f24881a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.668+0000 7f2486a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2488077040 0x7f24881a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49540/0 (socket says 172.21.15.50:49540) 2024-09-10T10:16:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.668+0000 7f2486a00640 1 -- 172.21.15.50:0/463800797 learned_addr learned my addr 172.21.15.50:0/463800797 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.668+0000 7f2487400640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2488076720 0x7f24881a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.668+0000 7f2487e00640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2488112870 0x7f248819e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.669+0000 7f2487400640 1 -- 172.21.15.50:0/463800797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2488112870 msgr2=0x7f248819e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.669+0000 7f2487400640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2488112870 0x7f248819e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.669+0000 7f2487400640 1 -- 172.21.15.50:0/463800797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2488077040 msgr2=0x7f24881a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:29.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.669+0000 7f2487400640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2488077040 0x7f24881a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.669+0000 7f2487400640 1 -- 172.21.15.50:0/463800797 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248819ef40 con 0x7f2488076720 2024-09-10T10:16:29.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.669+0000 7f2487400640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2488076720 0x7f24881a4620 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2478005940 tx=0x7f24780040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:29.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.669+0000 7f247fe00640 1 -- 172.21.15.50:0/463800797 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247803f030 con 0x7f2488076720 2024-09-10T10:16:29.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.670+0000 7f247fe00640 1 -- 172.21.15.50:0/463800797 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24780044c0 con 0x7f2488076720 2024-09-10T10:16:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.670+0000 7f247fe00640 1 -- 172.21.15.50:0/463800797 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478035070 con 0x7f2488076720 2024-09-10T10:16:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.670+0000 7f248d000640 1 -- 172.21.15.50:0/463800797 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248819f1d0 con 0x7f2488076720 2024-09-10T10:16:29.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.670+0000 7f248d000640 1 -- 172.21.15.50:0/463800797 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24881ab480 con 0x7f2488076720 2024-09-10T10:16:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.673+0000 7f24911d4740 1 Processor -- start 2024-09-10T10:16:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.673+0000 7f24911d4740 1 -- start start 2024-09-10T10:16:29.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.673+0000 7f247fe00640 1 -- 172.21.15.50:0/463800797 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2478042030 con 0x7f2488076720 2024-09-10T10:16:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.673+0000 7f24911d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a65b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.673+0000 7f24911d4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65b760 0x55f12a665ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.673+0000 7f24911d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a666020 0x55f12a668410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.673+0000 7f24911d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f12a5c13e0 con 0x55f12a65ae40 2024-09-10T10:16:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.673+0000 7f24911d4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f12a568d80 con 0x55f12a65b760 2024-09-10T10:16:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.673+0000 7f24911d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f12a5bd3a0 con 0x55f12a666020 2024-09-10T10:16:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.673+0000 7f2487e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a65b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.674+0000 7f2487e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a65b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49542/0 (socket says 172.21.15.50:49542) 2024-09-10T10:16:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.674+0000 7f2487e00640 1 -- 172.21.15.50:0/700721837 learned_addr learned my addr 172.21.15.50:0/700721837 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.674+0000 7f2487400640 1 --2- 172.21.15.50:0/700721837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65b760 0x55f12a665ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.674+0000 7f2486a00640 1 --2- 172.21.15.50:0/700721837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a666020 0x55f12a668410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.674+0000 7f2487e00640 1 -- 172.21.15.50:0/700721837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a666020 msgr2=0x55f12a668410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.674+0000 7f2487e00640 1 --2- 172.21.15.50:0/700721837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a666020 0x55f12a668410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.674+0000 7f2487e00640 1 -- 172.21.15.50:0/700721837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65b760 msgr2=0x55f12a665ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.674+0000 7f2487e00640 1 --2- 172.21.15.50:0/700721837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65b760 0x55f12a665ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.674+0000 7f2487e00640 1 -- 172.21.15.50:0/700721837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f12a587ae0 con 0x55f12a65ae40 2024-09-10T10:16:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.674+0000 7f2487e00640 1 --2- 172.21.15.50:0/700721837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a65b220 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2480009f30 tx=0x7f24800118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2e9794910b7ddf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:29.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.675+0000 7f247cc00640 1 -- 172.21.15.50:0/700721837 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480004d20 con 0x55f12a65ae40 2024-09-10T10:16:29.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.675+0000 7f247cc00640 1 -- 172.21.15.50:0/700721837 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2480004050 con 0x55f12a65ae40 2024-09-10T10:16:29.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.675+0000 7f247cc00640 1 -- 172.21.15.50:0/700721837 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480005260 con 0x55f12a65ae40 2024-09-10T10:16:29.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.675+0000 7f247fe00640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f246c0a2b80 0x7f246c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.675+0000 7f247fe00640 1 -- 172.21.15.50:0/463800797 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f24780ef6d0 con 0x7f2488076720 2024-09-10T10:16:29.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.675+0000 7f2487400640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f246c0a2b80 0x7f246c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.675+0000 7f24911d4740 1 -- 172.21.15.50:0/700721837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 msgr2=0x55f12a65b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.675+0000 7f24911d4740 1 --2- 172.21.15.50:0/700721837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a65b220 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2480009f30 tx=0x7f24800118d0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.676+0000 7f24911d4740 1 -- 172.21.15.50:0/700721837 shutdown_connections 2024-09-10T10:16:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.676+0000 7f24911d4740 1 --2- 172.21.15.50:0/700721837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a666020 0x55f12a668410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.676+0000 7f24911d4740 1 --2- 172.21.15.50:0/700721837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65b760 0x55f12a665ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.676+0000 7f24911d4740 1 --2- 172.21.15.50:0/700721837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a65b220 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.676+0000 7f24911d4740 1 -- 172.21.15.50:0/700721837 >> 172.21.15.50:0/700721837 conn(0x55f12a6573d0 msgr2=0x55f12a6577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.676+0000 7f2487400640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f246c0a2b80 0x7f246c0a5040 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f24780c4280 tx=0x7f24780f5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.676+0000 7f24911d4740 1 -- 172.21.15.50:0/700721837 shutdown_connections 2024-09-10T10:16:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.676+0000 7f24911d4740 1 -- 172.21.15.50:0/700721837 wait complete. 2024-09-10T10:16:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.676+0000 7f24911d4740 1 -- start start 2024-09-10T10:16:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.677+0000 7f24911d4740 1 Processor -- start 2024-09-10T10:16:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.677+0000 7f24911d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a662eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.677+0000 7f24911d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a65b760 0x55f12a6633f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.677+0000 7f24911d4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a666020 0x55f12a663930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.677+0000 7f24911d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f12a668bf0 con 0x55f12a65ae40 2024-09-10T10:16:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.677+0000 7f24911d4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f12a57c0f0 con 0x55f12a666020 2024-09-10T10:16:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.677+0000 7f24911d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f12a668d70 con 0x55f12a65b760 2024-09-10T10:16:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.677+0000 7f24911d4740 10 client.0 _ll_register_callbacks cb 0x55f12a563bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.677+0000 7f2487e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a662eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.677+0000 7f2487e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a662eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49558/0 (socket says 172.21.15.50:49558) 2024-09-10T10:16:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.677+0000 7f2487e00640 1 -- 172.21.15.50:0/3564554930 learned_addr learned my addr 172.21.15.50:0/3564554930 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:29.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.678+0000 7f2486a00640 1 --2- 172.21.15.50:0/3564554930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a65b760 0x55f12a6633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.678+0000 7f2487e00640 1 --2- 172.21.15.50:0/3564554930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a666020 0x55f12a663930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.678+0000 7f2487e00640 1 -- 172.21.15.50:0/3564554930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a65b760 msgr2=0x55f12a6633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.678+0000 7f2487e00640 1 --2- 172.21.15.50:0/3564554930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a65b760 0x55f12a6633f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.678+0000 7f2487e00640 1 -- 172.21.15.50:0/3564554930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a666020 msgr2=0x55f12a663930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.678+0000 7f2487e00640 1 --2- 172.21.15.50:0/3564554930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a666020 0x55f12a663930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.678+0000 7f2487e00640 1 -- 172.21.15.50:0/3564554930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f12a3323c0 con 0x55f12a65ae40 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.678+0000 7f2487e00640 1 --2- 172.21.15.50:0/3564554930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a662eb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2480009d40 tx=0x7f2480004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f151255c49fe61 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.678+0000 7f2471600640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.679+0000 7f2471600640 1 -- 172.21.15.50:0/3564554930 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480005240 con 0x55f12a65ae40 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.679+0000 7f2471600640 1 -- 172.21.15.50:0/3564554930 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f24800053e0 con 0x55f12a65ae40 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.679+0000 7f24911d4740 1 -- 172.21.15.50:0/3564554930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2480004050 con 0x55f12a65ae40 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.679+0000 7f2471600640 1 -- 172.21.15.50:0/3564554930 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2480036050 con 0x55f12a65ae40 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.679+0000 7f24911d4740 10 client.16398 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.679+0000 7f24911d4740 1 -- 172.21.15.50:0/3564554930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f12a674bf0 con 0x55f12a65ae40 2024-09-10T10:16:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.679+0000 7f2471600640 1 -- 172.21.15.50:0/3564554930 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2480004050 con 0x55f12a65ae40 2024-09-10T10:16:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.680+0000 7f2471600640 1 -- 172.21.15.50:0/3564554930 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f2480025070 con 0x55f12a65ae40 2024-09-10T10:16:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.680+0000 7f24911d4740 10 client.16398 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.680+0000 7f24911d4740 10 client.16398 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:16:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.680+0000 7f24911d4740 20 client.16398 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.680+0000 7f24911d4740 1 --2- 172.21.15.50:0/3564554930 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55f12a676050 0x55f12a678440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.680+0000 7f24911d4740 4 client.16398 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:16:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.680+0000 7f24911d4740 1 -- 172.21.15.50:0/3564554930 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f12a5ce950 con 0x55f12a676050 2024-09-10T10:16:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.680+0000 7f2486a00640 1 --2- 172.21.15.50:0/3564554930 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55f12a676050 0x55f12a678440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.680+0000 7f2486a00640 1 --2- 172.21.15.50:0/3564554930 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55f12a676050 0x55f12a678440 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=57fdecb15f86a0aa server_cookie=6ae3b3c0eacf6ead in_seq=0 out_seq=0 2024-09-10T10:16:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.681+0000 7f2471600640 10 client.16398 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:16:29.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.681+0000 7f2471600640 1 -- 172.21.15.50:0/3564554930 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f12a5ce950 con 0x55f12a676050 2024-09-10T10:16:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.681+0000 7f2471600640 10 client.16398 handle_command_reply: tid=0 2024-09-10T10:16:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.681+0000 7f24911d4740 1 client.16398 shutdown 2024-09-10T10:16:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.682+0000 7f24911d4740 1 -- 172.21.15.50:0/3564554930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 msgr2=0x55f12a662eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.682+0000 7f24911d4740 1 --2- 172.21.15.50:0/3564554930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a662eb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2480009d40 tx=0x7f2480004830 comp rx=0 tx=0).stop 2024-09-10T10:16:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.682+0000 7f24911d4740 1 -- 172.21.15.50:0/3564554930 shutdown_connections 2024-09-10T10:16:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.682+0000 7f24911d4740 1 --2- 172.21.15.50:0/3564554930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a666020 0x55f12a663930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.682+0000 7f24911d4740 1 --2- 172.21.15.50:0/3564554930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a65b760 0x55f12a6633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.682+0000 7f24911d4740 1 --2- 172.21.15.50:0/3564554930 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55f12a676050 0x55f12a678440 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.682+0000 7f24911d4740 1 --2- 172.21.15.50:0/3564554930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a662eb0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.682+0000 7f24911d4740 1 -- 172.21.15.50:0/3564554930 >> 172.21.15.50:0/3564554930 conn(0x55f12a6573d0 msgr2=0x55f12a65d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.682+0000 7f2471600640 0 client.16398 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:16:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.682+0000 7f24911d4740 1 -- 172.21.15.50:0/3564554930 shutdown_connections 2024-09-10T10:16:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.682+0000 7f24911d4740 1 -- 172.21.15.50:0/3564554930 wait complete. 2024-09-10T10:16:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.682+0000 7f24911d4740 20 client.16398 trim_cache size 0 max 16384 2024-09-10T10:16:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.696+0000 7f24911d4740 1 Processor -- start 2024-09-10T10:16:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.696+0000 7f24911d4740 1 -- start start 2024-09-10T10:16:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.696+0000 7f24911d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a67dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.696+0000 7f24911d4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65b760 0x55f12a67e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.696+0000 7f24911d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a666020 0x55f12a662e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.696+0000 7f24911d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24881b7a40 con 0x55f12a65ae40 2024-09-10T10:16:29.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.696+0000 7f24911d4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f24881b5310 con 0x55f12a65b760 2024-09-10T10:16:29.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.696+0000 7f24911d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f24881b3160 con 0x55f12a666020 2024-09-10T10:16:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.697+0000 7f2487e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a67dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.697+0000 7f2487e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a67dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49560/0 (socket says 172.21.15.50:49560) 2024-09-10T10:16:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.697+0000 7f2487e00640 1 -- 172.21.15.50:0/113570896 learned_addr learned my addr 172.21.15.50:0/113570896 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.697+0000 7f2486a00640 1 --2- 172.21.15.50:0/113570896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65b760 0x55f12a67e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.697+0000 7f2487e00640 1 --2- 172.21.15.50:0/113570896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a666020 0x55f12a662e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.697+0000 7f2486a00640 1 -- 172.21.15.50:0/113570896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a666020 msgr2=0x55f12a662e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.697+0000 7f2486a00640 1 --2- 172.21.15.50:0/113570896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a666020 0x55f12a662e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.697+0000 7f2486a00640 1 -- 172.21.15.50:0/113570896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 msgr2=0x55f12a67dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.697+0000 7f2486a00640 1 --2- 172.21.15.50:0/113570896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a67dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.697+0000 7f2486a00640 1 -- 172.21.15.50:0/113570896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f12a657200 con 0x55f12a65b760 2024-09-10T10:16:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.697+0000 7f2487e00640 1 --2- 172.21.15.50:0/113570896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a67dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.697+0000 7f2486a00640 1 --2- 172.21.15.50:0/113570896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65b760 0x55f12a67e110 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55f12a662740 tx=0x7f2474005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c090b7c3b7e17f06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.698+0000 7f2473e00640 1 -- 172.21.15.50:0/113570896 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474005220 con 0x55f12a65b760 2024-09-10T10:16:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.698+0000 7f2473e00640 1 -- 172.21.15.50:0/113570896 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2474004c80 con 0x55f12a65b760 2024-09-10T10:16:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.698+0000 7f2473e00640 1 -- 172.21.15.50:0/113570896 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247401d9a0 con 0x55f12a65b760 2024-09-10T10:16:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.698+0000 7f24911d4740 1 -- 172.21.15.50:0/113570896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65b760 msgr2=0x55f12a67e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.698+0000 7f24911d4740 1 --2- 172.21.15.50:0/113570896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65b760 0x55f12a67e110 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55f12a662740 tx=0x7f2474005f90 comp rx=0 tx=0).stop 2024-09-10T10:16:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.698+0000 7f24911d4740 1 -- 172.21.15.50:0/113570896 shutdown_connections 2024-09-10T10:16:29.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.698+0000 7f24911d4740 1 --2- 172.21.15.50:0/113570896 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a666020 0x55f12a662e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.698+0000 7f24911d4740 1 --2- 172.21.15.50:0/113570896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65b760 0x55f12a67e110 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.698+0000 7f24911d4740 1 --2- 172.21.15.50:0/113570896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a65ae40 0x55f12a67dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.698+0000 7f24911d4740 1 -- 172.21.15.50:0/113570896 >> 172.21.15.50:0/113570896 conn(0x55f12a6573d0 msgr2=0x55f12a661fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:29.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.699+0000 7f24911d4740 1 -- 172.21.15.50:0/113570896 shutdown_connections 2024-09-10T10:16:29.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.699+0000 7f24911d4740 1 -- 172.21.15.50:0/113570896 wait complete. 2024-09-10T10:16:29.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.699+0000 7f24911d4740 1 -- start start 2024-09-10T10:16:29.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.699+0000 7f24911d4740 1 Processor -- start 2024-09-10T10:16:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f24911d4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65ae40 0x55f12a66e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f24911d4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a65b760 0x55f12a669830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f24911d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a666020 0x55f12a669d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f24911d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24881b37d0 con 0x55f12a666020 2024-09-10T10:16:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f24911d4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f24881b4c40 con 0x55f12a65ae40 2024-09-10T10:16:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f24911d4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f24881b3ea0 con 0x55f12a65b760 2024-09-10T10:16:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f24911d4740 10 client.0 _ll_register_callbacks cb 0x7f24780f5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:29.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f2486a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a65b760 0x55f12a669830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f2487e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65ae40 0x55f12a66e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f2486a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a65b760 0x55f12a669830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:34046/0 (socket says 172.21.15.50:34046) 2024-09-10T10:16:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f2486a00640 1 -- 172.21.15.50:0/3620726161 learned_addr learned my addr 172.21.15.50:0/3620726161 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f2487e00640 1 --2- 172.21.15.50:0/3620726161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a666020 0x55f12a669d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f2486a00640 1 -- 172.21.15.50:0/3620726161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65ae40 msgr2=0x55f12a66e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f2486a00640 1 --2- 172.21.15.50:0/3620726161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65ae40 0x55f12a66e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f2486a00640 1 -- 172.21.15.50:0/3620726161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a666020 msgr2=0x55f12a669d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f2486a00640 1 --2- 172.21.15.50:0/3620726161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a666020 0x55f12a669d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.700+0000 7f2486a00640 1 -- 172.21.15.50:0/3620726161 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f12a66a330 con 0x55f12a65b760 2024-09-10T10:16:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.701+0000 7f2486a00640 1 --2- 172.21.15.50:0/3620726161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a65b760 0x55f12a669830 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55f12a6644f0 tx=0x7f2474004ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=546d49c15456b3a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.701+0000 7f2471600640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T10:16:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.701+0000 7f2471600640 1 -- 172.21.15.50:0/3620726161 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474004a90 con 0x55f12a65b760 2024-09-10T10:16:29.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.701+0000 7f24911d4740 1 -- 172.21.15.50:0/3620726161 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2474004c80 con 0x55f12a65b760 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.701+0000 7f2471600640 1 -- 172.21.15.50:0/3620726161 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f2474005000 con 0x55f12a65b760 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.701+0000 7f2471600640 1 -- 172.21.15.50:0/3620726161 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2474005240 con 0x55f12a65b760 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.701+0000 7f24911d4740 10 client.26473 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.701+0000 7f24911d4740 1 -- 172.21.15.50:0/3620726161 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f12a6e0970 con 0x55f12a65b760 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.702+0000 7f2471600640 1 -- 172.21.15.50:0/3620726161 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2474004c80 con 0x55f12a65b760 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.702+0000 7f2471600640 1 -- 172.21.15.50:0/3620726161 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f247402d070 con 0x55f12a65b760 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.702+0000 7f24911d4740 10 client.26473 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.702+0000 7f24911d4740 10 client.26473 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.702+0000 7f24911d4740 20 client.26473 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.702+0000 7f24911d4740 1 --2- 172.21.15.50:0/3620726161 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55f12a6e1010 0x55f12a6e3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.702+0000 7f24911d4740 4 client.26473 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.702+0000 7f24911d4740 1 -- 172.21.15.50:0/3620726161 --> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f12a5c8e60 con 0x55f12a6e1010 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.702+0000 7f2487e00640 1 --2- 172.21.15.50:0/3620726161 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55f12a6e1010 0x55f12a6e3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:29.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f2487e00640 1 --2- 172.21.15.50:0/3620726161 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55f12a6e1010 0x55f12a6e3430 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a67cee790e2791f1 server_cookie=394f636b30d37da9 in_seq=0 out_seq=0 2024-09-10T10:16:29.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f2471600640 10 client.26473 ms_handle_connect on v2:172.21.15.189:6838/2768859315 2024-09-10T10:16:29.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f2471600640 1 -- 172.21.15.50:0/3620726161 <== mds.2 v2:172.21.15.189:6838/2768859315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f12a5c8e60 con 0x55f12a6e1010 2024-09-10T10:16:29.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f2471600640 10 client.26473 handle_command_reply: tid=0 2024-09-10T10:16:29.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f24911d4740 1 client.26473 shutdown 2024-09-10T10:16:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f24911d4740 1 -- 172.21.15.50:0/3620726161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a65b760 msgr2=0x55f12a669830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f24911d4740 1 --2- 172.21.15.50:0/3620726161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a65b760 0x55f12a669830 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55f12a6644f0 tx=0x7f2474004ec0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f24911d4740 1 -- 172.21.15.50:0/3620726161 shutdown_connections 2024-09-10T10:16:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f24911d4740 1 --2- 172.21.15.50:0/3620726161 >> [v2:172.21.15.189:6838/2768859315,v1:172.21.15.189:6839/2768859315] conn(0x55f12a6e1010 0x55f12a6e3430 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f24911d4740 1 --2- 172.21.15.50:0/3620726161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12a666020 0x55f12a669d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f24911d4740 1 --2- 172.21.15.50:0/3620726161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f12a65b760 0x55f12a669830 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f24911d4740 1 --2- 172.21.15.50:0/3620726161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f12a65ae40 0x55f12a66e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f2471600640 0 client.26473 ms_handle_reset on v2:172.21.15.189:6838/2768859315 2024-09-10T10:16:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f24911d4740 1 -- 172.21.15.50:0/3620726161 >> 172.21.15.50:0/3620726161 conn(0x55f12a6573d0 msgr2=0x55f12a664710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f24911d4740 1 -- 172.21.15.50:0/3620726161 shutdown_connections 2024-09-10T10:16:29.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.703+0000 7f24911d4740 1 -- 172.21.15.50:0/3620726161 wait complete. 2024-09-10T10:16:29.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.704+0000 7f24911d4740 20 client.26473 trim_cache size 0 max 16384 2024-09-10T10:16:29.710 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:16:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.704+0000 7f248d000640 1 -- 172.21.15.50:0/463800797 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f246c0a2b80 msgr2=0x7f246c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.704+0000 7f248d000640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f246c0a2b80 0x7f246c0a5040 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f24780c4280 tx=0x7f24780f5530 comp rx=0 tx=0).stop 2024-09-10T10:16:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.704+0000 7f248d000640 1 -- 172.21.15.50:0/463800797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2488076720 msgr2=0x7f24881a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.704+0000 7f248d000640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2488076720 0x7f24881a4620 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2478005940 tx=0x7f24780040c0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.704+0000 7f248d000640 1 -- 172.21.15.50:0/463800797 shutdown_connections 2024-09-10T10:16:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.704+0000 7f248d000640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f246c0a2b80 0x7f246c0a5040 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.704+0000 7f248d000640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2488112870 0x7f248819e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.704+0000 7f248d000640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2488077040 0x7f24881a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.704+0000 7f248d000640 1 --2- 172.21.15.50:0/463800797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2488076720 0x7f24881a4620 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.704+0000 7f248d000640 1 -- 172.21.15.50:0/463800797 >> 172.21.15.50:0/463800797 conn(0x7f24880ff910 msgr2=0x7f2488101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.704+0000 7f248d000640 1 -- 172.21.15.50:0/463800797 shutdown_connections 2024-09-10T10:16:29.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:29.704+0000 7f248d000640 1 -- 172.21.15.50:0/463800797 wait complete. 2024-09-10T10:16:30.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:29 smithi189 ceph-mon[34999]: pgmap v550: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 154 op/s 2024-09-10T10:16:30.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:29 smithi084 ceph-mon[34812]: pgmap v550: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 154 op/s 2024-09-10T10:16:30.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:29 smithi050 ceph-mon[30354]: pgmap v550: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 154 op/s 2024-09-10T10:16:30.579 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T10:16:30.957 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.548+0000 7f1e30800640 1 -- 172.21.15.50:0/2192127121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e28109120 msgr2=0x7f1e28110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.548+0000 7f1e30800640 1 --2- 172.21.15.50:0/2192127121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e28109120 0x7f1e28110ca0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009ca0 tx=0x7f1e2402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.548+0000 7f1e30800640 1 -- 172.21.15.50:0/2192127121 shutdown_connections 2024-09-10T10:16:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.548+0000 7f1e30800640 1 --2- 172.21.15.50:0/2192127121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e28109120 0x7f1e28110ca0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.548+0000 7f1e30800640 1 --2- 172.21.15.50:0/2192127121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e281049a0 0x7f1e281089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.548+0000 7f1e30800640 1 --2- 172.21.15.50:0/2192127121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e28103ff0 0x7f1e281043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.548+0000 7f1e30800640 1 -- 172.21.15.50:0/2192127121 >> 172.21.15.50:0/2192127121 conn(0x7f1e280ffa90 msgr2=0x7f1e28101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:31.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.548+0000 7f1e30800640 1 -- 172.21.15.50:0/2192127121 shutdown_connections 2024-09-10T10:16:31.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.548+0000 7f1e30800640 1 -- 172.21.15.50:0/2192127121 wait complete. 2024-09-10T10:16:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.549+0000 7f1e30800640 1 Processor -- start 2024-09-10T10:16:31.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.550+0000 7f1e30800640 1 -- start start 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.550+0000 7f1e30800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e28103ff0 0x7f1e2819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.550+0000 7f1e30800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e281049a0 0x7f1e2819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.550+0000 7f1e30800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e28109120 0x7f1e2819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.550+0000 7f1e30800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281141a0 con 0x7f1e281049a0 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.550+0000 7f1e30800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28114020 con 0x7f1e28103ff0 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.550+0000 7f1e30800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28114320 con 0x7f1e28109120 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.550+0000 7f1e2de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e28103ff0 0x7f1e2819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.550+0000 7f1e2d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e281049a0 0x7f1e2819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.550+0000 7f1e2de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e28103ff0 0x7f1e2819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:43654/0 (socket says 172.21.15.50:43654) 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.550+0000 7f1e2de00640 1 -- 172.21.15.50:0/524022623 learned_addr learned my addr 172.21.15.50:0/524022623 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.550+0000 7f1e2e800640 1 --2- 172.21.15.50:0/524022623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e28109120 0x7f1e2819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.551+0000 7f1e2de00640 1 -- 172.21.15.50:0/524022623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e28109120 msgr2=0x7f1e2819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.551+0000 7f1e2de00640 1 --2- 172.21.15.50:0/524022623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e28109120 0x7f1e2819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.551+0000 7f1e2de00640 1 -- 172.21.15.50:0/524022623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e281049a0 msgr2=0x7f1e2819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.551+0000 7f1e2de00640 1 --2- 172.21.15.50:0/524022623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e281049a0 0x7f1e2819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.551+0000 7f1e2de00640 1 -- 172.21.15.50:0/524022623 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2819f5b0 con 0x7f1e28103ff0 2024-09-10T10:16:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.551+0000 7f1e2de00640 1 --2- 172.21.15.50:0/524022623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e28103ff0 0x7f1e2819a600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00e9f0 tx=0x7f1e1c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.551+0000 7f1e22a00640 1 -- 172.21.15.50:0/524022623 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00cd80 con 0x7f1e28103ff0 2024-09-10T10:16:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.551+0000 7f1e22a00640 1 -- 172.21.15.50:0/524022623 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e1c010910 con 0x7f1e28103ff0 2024-09-10T10:16:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.551+0000 7f1e30800640 1 -- 172.21.15.50:0/524022623 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2819f8a0 con 0x7f1e28103ff0 2024-09-10T10:16:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.551+0000 7f1e22a00640 1 -- 172.21.15.50:0/524022623 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c018990 con 0x7f1e28103ff0 2024-09-10T10:16:31.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.551+0000 7f1e30800640 1 -- 172.21.15.50:0/524022623 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e281a7180 con 0x7f1e28103ff0 2024-09-10T10:16:31.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.554+0000 7f1e3325c740 1 Processor -- start 2024-09-10T10:16:31.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.555+0000 7f1e22a00640 1 -- 172.21.15.50:0/524022623 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1e1c010ac0 con 0x7f1e28103ff0 2024-09-10T10:16:31.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.555+0000 7f1e3325c740 1 -- start start 2024-09-10T10:16:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.555+0000 7f1e3325c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2ecc70 0x562d6b2ed050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.555+0000 7f1e3325c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ed590 0x562d6b2f7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.555+0000 7f1e3325c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2f7e50 0x562d6b2fa240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.555+0000 7f1e3325c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562d6b2533e0 con 0x562d6b2ed590 2024-09-10T10:16:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.555+0000 7f1e3325c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d6b1fad80 con 0x562d6b2ecc70 2024-09-10T10:16:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.555+0000 7f1e3325c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562d6b24f3a0 con 0x562d6b2f7e50 2024-09-10T10:16:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.555+0000 7f1e2de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ed590 0x562d6b2f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.555+0000 7f1e2de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ed590 0x562d6b2f7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49602/0 (socket says 172.21.15.50:49602) 2024-09-10T10:16:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.555+0000 7f1e2de00640 1 -- 172.21.15.50:0/3785919639 learned_addr learned my addr 172.21.15.50:0/3785919639 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.555+0000 7f1e2e800640 1 --2- 172.21.15.50:0/3785919639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2ecc70 0x562d6b2ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.555+0000 7f1e2d400640 1 --2- 172.21.15.50:0/3785919639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2f7e50 0x562d6b2fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.556+0000 7f1e2d400640 1 -- 172.21.15.50:0/3785919639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2ecc70 msgr2=0x562d6b2ed050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:31.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.556+0000 7f1e2d400640 1 --2- 172.21.15.50:0/3785919639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2ecc70 0x562d6b2ed050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.556+0000 7f1e2d400640 1 -- 172.21.15.50:0/3785919639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ed590 msgr2=0x562d6b2f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.556+0000 7f1e2d400640 1 --2- 172.21.15.50:0/3785919639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ed590 0x562d6b2f7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.556+0000 7f1e2d400640 1 -- 172.21.15.50:0/3785919639 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d6b219ae0 con 0x562d6b2f7e50 2024-09-10T10:16:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.556+0000 7f1e2d400640 1 --2- 172.21.15.50:0/3785919639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2f7e50 0x562d6b2fa240 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009bd0 tx=0x7f1e18011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59877556323490f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.556+0000 7f1e17000640 1 -- 172.21.15.50:0/3785919639 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18004050 con 0x562d6b2f7e50 2024-09-10T10:16:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.556+0000 7f1e17000640 1 -- 172.21.15.50:0/3785919639 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e18005500 con 0x562d6b2f7e50 2024-09-10T10:16:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.556+0000 7f1e17000640 1 -- 172.21.15.50:0/3785919639 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18004d90 con 0x562d6b2f7e50 2024-09-10T10:16:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.556+0000 7f1e22a00640 1 --2- 172.21.15.50:0/524022623 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e100a2c00 0x7f1e100a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.557+0000 7f1e22a00640 1 -- 172.21.15.50:0/524022623 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f1e1c0cf750 con 0x7f1e28103ff0 2024-09-10T10:16:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.557+0000 7f1e2e800640 1 --2- 172.21.15.50:0/524022623 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e100a2c00 0x7f1e100a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.557+0000 7f1e3325c740 1 -- 172.21.15.50:0/3785919639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2f7e50 msgr2=0x562d6b2fa240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.557+0000 7f1e3325c740 1 --2- 172.21.15.50:0/3785919639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2f7e50 0x562d6b2fa240 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009bd0 tx=0x7f1e18011810 comp rx=0 tx=0).stop 2024-09-10T10:16:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.557+0000 7f1e3325c740 1 -- 172.21.15.50:0/3785919639 shutdown_connections 2024-09-10T10:16:31.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.557+0000 7f1e3325c740 1 --2- 172.21.15.50:0/3785919639 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2f7e50 0x562d6b2fa240 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.557+0000 7f1e3325c740 1 --2- 172.21.15.50:0/3785919639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ed590 0x562d6b2f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.557+0000 7f1e3325c740 1 --2- 172.21.15.50:0/3785919639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2ecc70 0x562d6b2ed050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.557+0000 7f1e3325c740 1 -- 172.21.15.50:0/3785919639 >> 172.21.15.50:0/3785919639 conn(0x562d6b2e9200 msgr2=0x562d6b2e95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.558+0000 7f1e3325c740 1 -- 172.21.15.50:0/3785919639 shutdown_connections 2024-09-10T10:16:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.558+0000 7f1e3325c740 1 -- 172.21.15.50:0/3785919639 wait complete. 2024-09-10T10:16:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.558+0000 7f1e2e800640 1 --2- 172.21.15.50:0/524022623 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e100a2c00 0x7f1e100a50c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1e2402f540 tx=0x7f1e2402f3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.558+0000 7f1e3325c740 1 -- start start 2024-09-10T10:16:31.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.558+0000 7f1e3325c740 1 Processor -- start 2024-09-10T10:16:31.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e3325c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ecc70 0x562d6b2f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e3325c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ed590 0x562d6b2f5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e3325c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2f7e50 0x562d6b2f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e3325c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562d6b2faa20 con 0x562d6b2ed590 2024-09-10T10:16:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e3325c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d6b20e0f0 con 0x562d6b2f7e50 2024-09-10T10:16:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e3325c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562d6b2faba0 con 0x562d6b2ecc70 2024-09-10T10:16:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e3325c740 10 client.0 _ll_register_callbacks cb 0x562d6b1f5bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e2d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ed590 0x562d6b2f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e2d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ed590 0x562d6b2f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49614/0 (socket says 172.21.15.50:49614) 2024-09-10T10:16:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e2de00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ecc70 0x562d6b2f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e2d400640 1 -- 172.21.15.50:0/2260493637 learned_addr learned my addr 172.21.15.50:0/2260493637 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e2e800640 1 --2- 172.21.15.50:0/2260493637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2f7e50 0x562d6b2f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e2d400640 1 -- 172.21.15.50:0/2260493637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ecc70 msgr2=0x562d6b2f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:31.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e2d400640 1 --2- 172.21.15.50:0/2260493637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ecc70 0x562d6b2f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e2d400640 1 -- 172.21.15.50:0/2260493637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2f7e50 msgr2=0x562d6b2f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e2d400640 1 --2- 172.21.15.50:0/2260493637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2f7e50 0x562d6b2f56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e2d400640 1 -- 172.21.15.50:0/2260493637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d6afc43c0 con 0x562d6b2ed590 2024-09-10T10:16:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.559+0000 7f1e2de00640 1 --2- 172.21.15.50:0/2260493637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ecc70 0x562d6b2f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.560+0000 7f1e2d400640 1 --2- 172.21.15.50:0/2260493637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ed590 0x562d6b2f5170 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1e18004650 tx=0x7f1e18004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47784079b1c21f87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.560+0000 7f1e0b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:16:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.560+0000 7f1e0b400640 1 -- 172.21.15.50:0/2260493637 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18029070 con 0x562d6b2ed590 2024-09-10T10:16:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.560+0000 7f1e3325c740 1 -- 172.21.15.50:0/2260493637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e18005500 con 0x562d6b2ed590 2024-09-10T10:16:31.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.560+0000 7f1e0b400640 1 -- 172.21.15.50:0/2260493637 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f1e180051c0 con 0x562d6b2ed590 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.560+0000 7f1e0b400640 1 -- 172.21.15.50:0/2260493637 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1e18035050 con 0x562d6b2ed590 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.560+0000 7f1e3325c740 10 client.16416 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.561+0000 7f1e3325c740 1 -- 172.21.15.50:0/2260493637 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562d6b306990 con 0x562d6b2ed590 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.561+0000 7f1e0b400640 1 -- 172.21.15.50:0/2260493637 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e18005500 con 0x562d6b2ed590 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.561+0000 7f1e0b400640 1 -- 172.21.15.50:0/2260493637 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f1e18023430 con 0x562d6b2ed590 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.561+0000 7f1e3325c740 10 client.16416 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.561+0000 7f1e3325c740 10 client.16416 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.561+0000 7f1e3325c740 20 client.16416 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.561+0000 7f1e3325c740 1 --2- 172.21.15.50:0/2260493637 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562d6b307da0 0x562d6b30a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.561+0000 7f1e3325c740 4 client.16416 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.561+0000 7f1e3325c740 1 -- 172.21.15.50:0/2260493637 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d6b260950 con 0x562d6b307da0 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.562+0000 7f1e2de00640 1 --2- 172.21.15.50:0/2260493637 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562d6b307da0 0x562d6b30a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.562+0000 7f1e2de00640 1 --2- 172.21.15.50:0/2260493637 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562d6b307da0 0x562d6b30a190 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b759195f97c24c4 server_cookie=18d0804cddecd85d in_seq=0 out_seq=0 2024-09-10T10:16:31.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.562+0000 7f1e0b400640 10 client.16416 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:16:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e0b400640 1 -- 172.21.15.50:0/2260493637 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d6b260950 con 0x562d6b307da0 2024-09-10T10:16:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e0b400640 10 client.16416 handle_command_reply: tid=0 2024-09-10T10:16:31.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e3325c740 1 client.16416 shutdown 2024-09-10T10:16:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e3325c740 1 -- 172.21.15.50:0/2260493637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ed590 msgr2=0x562d6b2f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e3325c740 1 --2- 172.21.15.50:0/2260493637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ed590 0x562d6b2f5170 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1e18004650 tx=0x7f1e18004dc0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e3325c740 1 -- 172.21.15.50:0/2260493637 shutdown_connections 2024-09-10T10:16:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e3325c740 1 --2- 172.21.15.50:0/2260493637 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562d6b307da0 0x562d6b30a190 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e3325c740 1 --2- 172.21.15.50:0/2260493637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2f7e50 0x562d6b2f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e3325c740 1 --2- 172.21.15.50:0/2260493637 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ed590 0x562d6b2f5170 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e3325c740 1 --2- 172.21.15.50:0/2260493637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ecc70 0x562d6b2f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e3325c740 1 -- 172.21.15.50:0/2260493637 >> 172.21.15.50:0/2260493637 conn(0x562d6b2e9200 msgr2=0x562d6b2eef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e0b400640 0 client.16416 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:16:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e3325c740 1 -- 172.21.15.50:0/2260493637 shutdown_connections 2024-09-10T10:16:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.563+0000 7f1e3325c740 1 -- 172.21.15.50:0/2260493637 wait complete. 2024-09-10T10:16:31.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.564+0000 7f1e3325c740 20 client.16416 trim_cache size 0 max 16384 2024-09-10T10:16:31.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.577+0000 7f1e3325c740 1 Processor -- start 2024-09-10T10:16:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.577+0000 7f1e3325c740 1 -- start start 2024-09-10T10:16:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.578+0000 7f1e3325c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ecc70 0x562d6b30f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.578+0000 7f1e3325c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2ed590 0x562d6b30feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.578+0000 7f1e3325c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2f7e50 0x562d6b2ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.578+0000 7f1e3325c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281b3810 con 0x562d6b2f7e50 2024-09-10T10:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.578+0000 7f1e3325c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281b10e0 con 0x562d6b2ed590 2024-09-10T10:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.578+0000 7f1e3325c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281aef30 con 0x562d6b2ecc70 2024-09-10T10:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.578+0000 7f1e2e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2f7e50 0x562d6b2ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.578+0000 7f1e2e800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2f7e50 0x562d6b2ee6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49628/0 (socket says 172.21.15.50:49628) 2024-09-10T10:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.578+0000 7f1e2e800640 1 -- 172.21.15.50:0/1274636650 learned_addr learned my addr 172.21.15.50:0/1274636650 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.578+0000 7f1e2d400640 1 --2- 172.21.15.50:0/1274636650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2ed590 0x562d6b30feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.578+0000 7f1e2de00640 1 --2- 172.21.15.50:0/1274636650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ecc70 0x562d6b30f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.579+0000 7f1e2e800640 1 -- 172.21.15.50:0/1274636650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ecc70 msgr2=0x562d6b30f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:31.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.579+0000 7f1e2e800640 1 --2- 172.21.15.50:0/1274636650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ecc70 0x562d6b30f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.579+0000 7f1e2e800640 1 -- 172.21.15.50:0/1274636650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2ed590 msgr2=0x562d6b30feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.579+0000 7f1e2e800640 1 --2- 172.21.15.50:0/1274636650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2ed590 0x562d6b30feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.579+0000 7f1e2e800640 1 -- 172.21.15.50:0/1274636650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d6b2ed3c0 con 0x562d6b2f7e50 2024-09-10T10:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.579+0000 7f1e2e800640 1 --2- 172.21.15.50:0/1274636650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2f7e50 0x562d6b2ee6c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1e24035000 tx=0x7f1e24044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b78b2e5d491b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.579+0000 7f1e16600640 1 -- 172.21.15.50:0/1274636650 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e240319d0 con 0x562d6b2f7e50 2024-09-10T10:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.579+0000 7f1e16600640 1 -- 172.21.15.50:0/1274636650 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e24036040 con 0x562d6b2f7e50 2024-09-10T10:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.579+0000 7f1e16600640 1 -- 172.21.15.50:0/1274636650 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e240044f0 con 0x562d6b2f7e50 2024-09-10T10:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.580+0000 7f1e3325c740 1 -- 172.21.15.50:0/1274636650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2f7e50 msgr2=0x562d6b2ee6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.580+0000 7f1e3325c740 1 --2- 172.21.15.50:0/1274636650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2f7e50 0x562d6b2ee6c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1e24035000 tx=0x7f1e24044000 comp rx=0 tx=0).stop 2024-09-10T10:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.580+0000 7f1e3325c740 1 -- 172.21.15.50:0/1274636650 shutdown_connections 2024-09-10T10:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.580+0000 7f1e3325c740 1 --2- 172.21.15.50:0/1274636650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2f7e50 0x562d6b2ee6c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.580+0000 7f1e3325c740 1 --2- 172.21.15.50:0/1274636650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2ed590 0x562d6b30feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.580+0000 7f1e3325c740 1 --2- 172.21.15.50:0/1274636650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ecc70 0x562d6b30f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.580+0000 7f1e3325c740 1 -- 172.21.15.50:0/1274636650 >> 172.21.15.50:0/1274636650 conn(0x562d6b2e9200 msgr2=0x562d6b2f6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.580+0000 7f1e3325c740 1 -- 172.21.15.50:0/1274636650 shutdown_connections 2024-09-10T10:16:31.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.580+0000 7f1e3325c740 1 -- 172.21.15.50:0/1274636650 wait complete. 2024-09-10T10:16:31.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.581+0000 7f1e3325c740 1 -- start start 2024-09-10T10:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.581+0000 7f1e3325c740 1 Processor -- start 2024-09-10T10:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.581+0000 7f1e3325c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ecc70 0x562d6b300230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.581+0000 7f1e3325c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ed590 0x562d6b2f8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.581+0000 7f1e3325c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2f7e50 0x562d6b2f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.581+0000 7f1e3325c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281af5a0 con 0x562d6b2ecc70 2024-09-10T10:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.581+0000 7f1e3325c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281b0a10 con 0x562d6b2f7e50 2024-09-10T10:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.581+0000 7f1e3325c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281afc70 con 0x562d6b2ed590 2024-09-10T10:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.581+0000 7f1e3325c740 10 client.0 _ll_register_callbacks cb 0x7f1e1c0d5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.582+0000 7f1e2d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ed590 0x562d6b2f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.582+0000 7f1e2de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ecc70 0x562d6b300230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.582+0000 7f1e2d400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ed590 0x562d6b2f8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:34092/0 (socket says 172.21.15.50:34092) 2024-09-10T10:16:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.582+0000 7f1e2d400640 1 -- 172.21.15.50:0/104785562 learned_addr learned my addr 172.21.15.50:0/104785562 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.582+0000 7f1e2e800640 1 --2- 172.21.15.50:0/104785562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2f7e50 0x562d6b2f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.582+0000 7f1e2de00640 1 -- 172.21.15.50:0/104785562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ed590 msgr2=0x562d6b2f8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.582+0000 7f1e2de00640 1 --2- 172.21.15.50:0/104785562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ed590 0x562d6b2f8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.582+0000 7f1e2de00640 1 -- 172.21.15.50:0/104785562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2f7e50 msgr2=0x562d6b2f8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.582+0000 7f1e2de00640 1 --2- 172.21.15.50:0/104785562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2f7e50 0x562d6b2f8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.582+0000 7f1e2de00640 1 -- 172.21.15.50:0/104785562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d6b2f9400 con 0x562d6b2ecc70 2024-09-10T10:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.582+0000 7f1e2e800640 1 --2- 172.21.15.50:0/104785562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2f7e50 0x562d6b2f8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.582+0000 7f1e2de00640 1 --2- 172.21.15.50:0/104785562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ecc70 0x562d6b300230 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c098590 tx=0x7f1e1c0d5530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7213d4f29fb562db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.582+0000 7f1e0b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e0b400640 1 -- 172.21.15.50:0/104785562 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c09c2c0 con 0x562d6b2ecc70 2024-09-10T10:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e0b400640 1 -- 172.21.15.50:0/104785562 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f1e1c0cf400 con 0x562d6b2ecc70 2024-09-10T10:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e3325c740 1 -- 172.21.15.50:0/104785562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e24036040 con 0x562d6b2ecc70 2024-09-10T10:16:31.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e0b400640 1 -- 172.21.15.50:0/104785562 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1e1c09bbc0 con 0x562d6b2ecc70 2024-09-10T10:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e3325c740 10 client.16422 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e3325c740 1 -- 172.21.15.50:0/104785562 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562d6b2feb40 con 0x562d6b2ecc70 2024-09-10T10:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e0b400640 1 -- 172.21.15.50:0/104785562 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e24036040 con 0x562d6b2ecc70 2024-09-10T10:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e0b400640 1 -- 172.21.15.50:0/104785562 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f1e1c018b30 con 0x562d6b2ecc70 2024-09-10T10:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e3325c740 10 client.16422 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e3325c740 10 client.16422 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T10:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e3325c740 20 client.16422 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e3325c740 1 --2- 172.21.15.50:0/104785562 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562d6b372dd0 0x562d6b3751c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e3325c740 4 client.16422 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:16:31.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.583+0000 7f1e3325c740 1 -- 172.21.15.50:0/104785562 --> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562d6b25ae60 con 0x562d6b372dd0 2024-09-10T10:16:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.584+0000 7f1e2d400640 1 --2- 172.21.15.50:0/104785562 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562d6b372dd0 0x562d6b3751c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:31.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.584+0000 7f1e2d400640 1 --2- 172.21.15.50:0/104785562 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562d6b372dd0 0x562d6b3751c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f3543dd47226561 server_cookie=d7a6756204328205 in_seq=0 out_seq=0 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.584+0000 7f1e0b400640 10 client.16422 ms_handle_connect on v2:172.21.15.84:6836/1457195028 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e0b400640 1 -- 172.21.15.50:0/104785562 <== mds.1 v2:172.21.15.84:6836/1457195028 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562d6b25ae60 con 0x562d6b372dd0 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e0b400640 10 client.16422 handle_command_reply: tid=0 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e3325c740 1 client.16422 shutdown 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e3325c740 1 -- 172.21.15.50:0/104785562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ecc70 msgr2=0x562d6b300230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e3325c740 1 --2- 172.21.15.50:0/104785562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ecc70 0x562d6b300230 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c098590 tx=0x7f1e1c0d5530 comp rx=0 tx=0).stop 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e3325c740 1 -- 172.21.15.50:0/104785562 shutdown_connections 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e3325c740 1 --2- 172.21.15.50:0/104785562 >> [v2:172.21.15.84:6836/1457195028,v1:172.21.15.84:6837/1457195028] conn(0x562d6b372dd0 0x562d6b3751c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e3325c740 1 --2- 172.21.15.50:0/104785562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d6b2f7e50 0x562d6b2f8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e3325c740 1 --2- 172.21.15.50:0/104785562 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562d6b2ed590 0x562d6b2f8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e3325c740 1 --2- 172.21.15.50:0/104785562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d6b2ecc70 0x562d6b300230 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e3325c740 1 -- 172.21.15.50:0/104785562 >> 172.21.15.50:0/104785562 conn(0x562d6b2e9200 msgr2=0x562d6b302ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e0b400640 0 client.16422 ms_handle_reset on v2:172.21.15.84:6836/1457195028 2024-09-10T10:16:31.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e3325c740 1 -- 172.21.15.50:0/104785562 shutdown_connections 2024-09-10T10:16:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e3325c740 1 -- 172.21.15.50:0/104785562 wait complete. 2024-09-10T10:16:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.585+0000 7f1e3325c740 20 client.16422 trim_cache size 0 max 16384 2024-09-10T10:16:31.591 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:16:31.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.586+0000 7f1e30800640 1 -- 172.21.15.50:0/524022623 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e100a2c00 msgr2=0x7f1e100a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.586+0000 7f1e30800640 1 --2- 172.21.15.50:0/524022623 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e100a2c00 0x7f1e100a50c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1e2402f540 tx=0x7f1e2402f3b0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.586+0000 7f1e30800640 1 -- 172.21.15.50:0/524022623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e28103ff0 msgr2=0x7f1e2819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.586+0000 7f1e30800640 1 --2- 172.21.15.50:0/524022623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e28103ff0 0x7f1e2819a600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00e9f0 tx=0x7f1e1c00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.586+0000 7f1e30800640 1 -- 172.21.15.50:0/524022623 shutdown_connections 2024-09-10T10:16:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.586+0000 7f1e30800640 1 --2- 172.21.15.50:0/524022623 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f1e100a2c00 0x7f1e100a50c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.586+0000 7f1e30800640 1 --2- 172.21.15.50:0/524022623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1e28109120 0x7f1e2819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.586+0000 7f1e30800640 1 --2- 172.21.15.50:0/524022623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e281049a0 0x7f1e2819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.586+0000 7f1e30800640 1 --2- 172.21.15.50:0/524022623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e28103ff0 0x7f1e2819a600 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.586+0000 7f1e30800640 1 -- 172.21.15.50:0/524022623 >> 172.21.15.50:0/524022623 conn(0x7f1e280ffa90 msgr2=0x7f1e281005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.586+0000 7f1e30800640 1 -- 172.21.15.50:0/524022623 shutdown_connections 2024-09-10T10:16:31.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:31.586+0000 7f1e30800640 1 -- 172.21.15.50:0/524022623 wait complete. 2024-09-10T10:16:32.289 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:32 smithi050 ceph-mon[30354]: pgmap v551: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 36 op/s 2024-09-10T10:16:32.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:32 smithi189 ceph-mon[34999]: pgmap v551: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 36 op/s 2024-09-10T10:16:32.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:32 smithi084 ceph-mon[34812]: pgmap v551: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 36 op/s 2024-09-10T10:16:32.500 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T10:16:32.879 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.464+0000 7fcb77200640 1 -- 172.21.15.50:0/897515197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb781019d0 msgr2=0x7fcb78101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.464+0000 7fcb77200640 1 --2- 172.21.15.50:0/897515197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb781019d0 0x7fcb78101e30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009930 tx=0x7fcb6002a420 comp rx=0 tx=0).stop 2024-09-10T10:16:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.464+0000 7fcb77200640 1 -- 172.21.15.50:0/897515197 shutdown_connections 2024-09-10T10:16:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.464+0000 7fcb77200640 1 --2- 172.21.15.50:0/897515197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb78102370 0x7fcb7810e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.464+0000 7fcb77200640 1 --2- 172.21.15.50:0/897515197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb781019d0 0x7fcb78101e30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.464+0000 7fcb77200640 1 --2- 172.21.15.50:0/897515197 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb781079d0 0x7fcb78107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.464+0000 7fcb77200640 1 -- 172.21.15.50:0/897515197 >> 172.21.15.50:0/897515197 conn(0x7fcb780fd710 msgr2=0x7fcb780ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.464+0000 7fcb77200640 1 -- 172.21.15.50:0/897515197 shutdown_connections 2024-09-10T10:16:33.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.464+0000 7fcb77200640 1 -- 172.21.15.50:0/897515197 wait complete. 2024-09-10T10:16:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.465+0000 7fcb77200640 1 Processor -- start 2024-09-10T10:16:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.465+0000 7fcb77200640 1 -- start start 2024-09-10T10:16:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.466+0000 7fcb77200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb781019d0 0x7fcb7819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.466+0000 7fcb77200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb78102370 0x7fcb7819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.466+0000 7fcb77200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb781079d0 0x7fcb7819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.466+0000 7fcb77200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb78111de0 con 0x7fcb781079d0 2024-09-10T10:16:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.466+0000 7fcb77200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcb78111c60 con 0x7fcb78102370 2024-09-10T10:16:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.466+0000 7fcb77200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb78111f60 con 0x7fcb781019d0 2024-09-10T10:16:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.466+0000 7fcb76800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb781079d0 0x7fcb7819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.466+0000 7fcb76800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb781079d0 0x7fcb7819ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49672/0 (socket says 172.21.15.50:49672) 2024-09-10T10:16:33.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.466+0000 7fcb76800640 1 -- 172.21.15.50:0/1774030041 learned_addr learned my addr 172.21.15.50:0/1774030041 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.466+0000 7fcb75e00640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb781019d0 0x7fcb7819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.466+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb78102370 0x7fcb7819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.466+0000 7fcb76800640 1 -- 172.21.15.50:0/1774030041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb781019d0 msgr2=0x7fcb7819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.467+0000 7fcb76800640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb781019d0 0x7fcb7819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.467+0000 7fcb76800640 1 -- 172.21.15.50:0/1774030041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb78102370 msgr2=0x7fcb7819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.467+0000 7fcb76800640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb78102370 0x7fcb7819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.467+0000 7fcb76800640 1 -- 172.21.15.50:0/1774030041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7819f470 con 0x7fcb781079d0 2024-09-10T10:16:33.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.467+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb78102370 0x7fcb7819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.467+0000 7fcb76800640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb781079d0 0x7fcb7819ed90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000eb10 tx=0x7fcb7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.467+0000 7fcb6ea00640 1 -- 172.21.15.50:0/1774030041 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70004b20 con 0x7fcb781079d0 2024-09-10T10:16:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.467+0000 7fcb77200640 1 -- 172.21.15.50:0/1774030041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7819f760 con 0x7fcb781079d0 2024-09-10T10:16:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.467+0000 7fcb77200640 1 -- 172.21.15.50:0/1774030041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb781a7040 con 0x7fcb781079d0 2024-09-10T10:16:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.468+0000 7fcb6ea00640 1 -- 172.21.15.50:0/1774030041 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb70004cc0 con 0x7fcb781079d0 2024-09-10T10:16:33.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.468+0000 7fcb6ea00640 1 -- 172.21.15.50:0/1774030041 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70010760 con 0x7fcb781079d0 2024-09-10T10:16:33.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.470+0000 7fcb7f62b740 1 Processor -- start 2024-09-10T10:16:33.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.471+0000 7fcb6ea00640 1 -- 172.21.15.50:0/1774030041 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcb70005020 con 0x7fcb781079d0 2024-09-10T10:16:33.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.471+0000 7fcb7f62b740 1 -- start start 2024-09-10T10:16:33.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.471+0000 7fcb7f62b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.471+0000 7fcb7f62b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 0x563fa92d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.471+0000 7fcb7f62b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92d3020 0x563fa92d5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.471+0000 7fcb7f62b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563fa922e3e0 con 0x563fa92c8760 2024-09-10T10:16:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.471+0000 7fcb7f62b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563fa91d5d80 con 0x563fa92d3020 2024-09-10T10:16:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.471+0000 7fcb7f62b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563fa922a3a0 con 0x563fa92c7e40 2024-09-10T10:16:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.472+0000 7fcb75e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 0x563fa92d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.472+0000 7fcb6fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92d3020 0x563fa92d5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.472+0000 7fcb75e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 0x563fa92d2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49676/0 (socket says 172.21.15.50:49676) 2024-09-10T10:16:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.472+0000 7fcb75e00640 1 -- 172.21.15.50:0/448722457 learned_addr learned my addr 172.21.15.50:0/448722457 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.472+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/448722457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.472+0000 7fcb75e00640 1 -- 172.21.15.50:0/448722457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 msgr2=0x563fa92c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.472+0000 7fcb75e00640 1 --2- 172.21.15.50:0/448722457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.472+0000 7fcb75e00640 1 -- 172.21.15.50:0/448722457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92d3020 msgr2=0x563fa92d5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.472+0000 7fcb75e00640 1 --2- 172.21.15.50:0/448722457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92d3020 0x563fa92d5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.472+0000 7fcb75e00640 1 -- 172.21.15.50:0/448722457 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa91f4ae0 con 0x563fa92c8760 2024-09-10T10:16:33.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.472+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/448722457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.473+0000 7fcb6ea00640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcb5c0a2c00 0x7fcb5c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.473+0000 7fcb6ea00640 1 -- 172.21.15.50:0/1774030041 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fcb700cf710 con 0x7fcb781079d0 2024-09-10T10:16:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.473+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcb5c0a2c00 0x7fcb5c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.473+0000 7fcb75e00640 1 --2- 172.21.15.50:0/448722457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 0x563fa92d2ae0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800bc90 tx=0x7fcb680107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fadd9fbbecd6967 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.474+0000 7fcb67000640 1 -- 172.21.15.50:0/448722457 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6801c480 con 0x563fa92c8760 2024-09-10T10:16:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.474+0000 7fcb67000640 1 -- 172.21.15.50:0/448722457 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb6801cb00 con 0x563fa92c8760 2024-09-10T10:16:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.474+0000 7fcb67000640 1 -- 172.21.15.50:0/448722457 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68011bf0 con 0x563fa92c8760 2024-09-10T10:16:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.474+0000 7fcb7f62b740 1 -- 172.21.15.50:0/448722457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 msgr2=0x563fa92d2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.474+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/448722457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 0x563fa92d2ae0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800bc90 tx=0x7fcb680107a0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.474+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcb5c0a2c00 0x7fcb5c0a50c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcb60006010 tx=0x7fcb60000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.475+0000 7fcb7f62b740 1 -- 172.21.15.50:0/448722457 shutdown_connections 2024-09-10T10:16:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.475+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/448722457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92d3020 0x563fa92d5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.475+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/448722457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 0x563fa92d2ae0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.475+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/448722457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.475+0000 7fcb7f62b740 1 -- 172.21.15.50:0/448722457 >> 172.21.15.50:0/448722457 conn(0x563fa92c43d0 msgr2=0x563fa92c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.475+0000 7fcb7f62b740 1 -- 172.21.15.50:0/448722457 shutdown_connections 2024-09-10T10:16:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.475+0000 7fcb7f62b740 1 -- 172.21.15.50:0/448722457 wait complete. 2024-09-10T10:16:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.475+0000 7fcb7f62b740 1 -- start start 2024-09-10T10:16:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.476+0000 7fcb7f62b740 1 Processor -- start 2024-09-10T10:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.476+0000 7fcb7f62b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c7e40 0x563fa92cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.476+0000 7fcb7f62b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92c8760 0x563fa92d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.476+0000 7fcb7f62b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92d3020 0x563fa92d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.476+0000 7fcb7f62b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563fa92d5bf0 con 0x563fa92c7e40 2024-09-10T10:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.476+0000 7fcb7f62b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563fa91e90f0 con 0x563fa92c8760 2024-09-10T10:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.476+0000 7fcb7f62b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563fa92d5d70 con 0x563fa92d3020 2024-09-10T10:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.476+0000 7fcb7f62b740 10 client.0 _ll_register_callbacks cb 0x563fa91d0bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.476+0000 7fcb75e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c7e40 0x563fa92cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.476+0000 7fcb75e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c7e40 0x563fa92cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49682/0 (socket says 172.21.15.50:49682) 2024-09-10T10:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.476+0000 7fcb6fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92c8760 0x563fa92d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.476+0000 7fcb75e00640 1 -- 172.21.15.50:0/1974837423 learned_addr learned my addr 172.21.15.50:0/1974837423 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.477+0000 7fcb76800640 1 --2- 172.21.15.50:0/1974837423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92d3020 0x563fa92d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.477+0000 7fcb75e00640 1 -- 172.21.15.50:0/1974837423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92d3020 msgr2=0x563fa92d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.477+0000 7fcb75e00640 1 --2- 172.21.15.50:0/1974837423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92d3020 0x563fa92d08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.477+0000 7fcb75e00640 1 -- 172.21.15.50:0/1974837423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92c8760 msgr2=0x563fa92d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.477+0000 7fcb75e00640 1 --2- 172.21.15.50:0/1974837423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92c8760 0x563fa92d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.477+0000 7fcb75e00640 1 -- 172.21.15.50:0/1974837423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fa8f9f3c0 con 0x563fa92c7e40 2024-09-10T10:16:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.477+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/1974837423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92c8760 0x563fa92d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.477+0000 7fcb75e00640 1 --2- 172.21.15.50:0/1974837423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c7e40 0x563fa92cfe50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800b620 tx=0x7fcb6801c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcee7937251ca31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.477+0000 7fcb5b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:16:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.478+0000 7fcb5b400640 1 -- 172.21.15.50:0/1974837423 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6801c950 con 0x563fa92c7e40 2024-09-10T10:16:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.478+0000 7fcb5b400640 1 -- 172.21.15.50:0/1974837423 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fcb6800bd80 con 0x563fa92c7e40 2024-09-10T10:16:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.478+0000 7fcb7f62b740 1 -- 172.21.15.50:0/1974837423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb6801cb00 con 0x563fa92c7e40 2024-09-10T10:16:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.478+0000 7fcb5b400640 1 -- 172.21.15.50:0/1974837423 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcb68011b40 con 0x563fa92c7e40 2024-09-10T10:16:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.478+0000 7fcb7f62b740 10 client.16434 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:33.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.478+0000 7fcb7f62b740 1 -- 172.21.15.50:0/1974837423 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563fa92e1be0 con 0x563fa92c7e40 2024-09-10T10:16:33.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.478+0000 7fcb5b400640 1 -- 172.21.15.50:0/1974837423 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb6801cb00 con 0x563fa92c7e40 2024-09-10T10:16:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.479+0000 7fcb5b400640 1 -- 172.21.15.50:0/1974837423 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fcb68005270 con 0x563fa92c7e40 2024-09-10T10:16:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.479+0000 7fcb7f62b740 10 client.16434 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.479+0000 7fcb7f62b740 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:16:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.479+0000 7fcb7f62b740 20 client.16434 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.479+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/1974837423 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563fa92e2f90 0x563fa92e5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.479+0000 7fcb7f62b740 4 client.16434 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.479+0000 7fcb7f62b740 1 -- 172.21.15.50:0/1974837423 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fa923b950 con 0x563fa92e2f90 2024-09-10T10:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.479+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/1974837423 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563fa92e2f90 0x563fa92e5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.480+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/1974837423 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563fa92e2f90 0x563fa92e5380 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6291faf731a09dc0 server_cookie=f279d735705c60d2 in_seq=0 out_seq=0 2024-09-10T10:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.480+0000 7fcb5b400640 10 client.16434 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.480+0000 7fcb5b400640 1 -- 172.21.15.50:0/1974837423 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563fa923b950 con 0x563fa92e2f90 2024-09-10T10:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb5b400640 10 client.16434 handle_command_reply: tid=0 2024-09-10T10:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb7f62b740 1 client.16434 shutdown 2024-09-10T10:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb7f62b740 1 -- 172.21.15.50:0/1974837423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c7e40 msgr2=0x563fa92cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/1974837423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c7e40 0x563fa92cfe50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800b620 tx=0x7fcb6801c730 comp rx=0 tx=0).stop 2024-09-10T10:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb7f62b740 1 -- 172.21.15.50:0/1974837423 shutdown_connections 2024-09-10T10:16:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/1974837423 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563fa92e2f90 0x563fa92e5380 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/1974837423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92d3020 0x563fa92d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/1974837423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92c8760 0x563fa92d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/1974837423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c7e40 0x563fa92cfe50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb7f62b740 1 -- 172.21.15.50:0/1974837423 >> 172.21.15.50:0/1974837423 conn(0x563fa92c43d0 msgr2=0x563fa92ca0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb5b400640 0 client.16434 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb7f62b740 1 -- 172.21.15.50:0/1974837423 shutdown_connections 2024-09-10T10:16:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb7f62b740 1 -- 172.21.15.50:0/1974837423 wait complete. 2024-09-10T10:16:33.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.481+0000 7fcb7f62b740 20 client.16434 trim_cache size 0 max 16384 2024-09-10T10:16:33.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.495+0000 7fcb7f62b740 1 Processor -- start 2024-09-10T10:16:33.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.495+0000 7fcb7f62b740 1 -- start start 2024-09-10T10:16:33.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.496+0000 7fcb7f62b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.496+0000 7fcb7f62b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92c8760 0x563fa92eab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.496+0000 7fcb7f62b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92d3020 0x563fa92eb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.496+0000 7fcb7f62b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb54012460 con 0x563fa92d3020 2024-09-10T10:16:33.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.496+0000 7fcb7f62b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5400fd30 con 0x563fa92c8760 2024-09-10T10:16:33.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.496+0000 7fcb7f62b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5400db80 con 0x563fa92c7e40 2024-09-10T10:16:33.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.496+0000 7fcb76800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92d3020 0x563fa92eb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.496+0000 7fcb6fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92c8760 0x563fa92eab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.496+0000 7fcb76800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92d3020 0x563fa92eb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49686/0 (socket says 172.21.15.50:49686) 2024-09-10T10:16:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.496+0000 7fcb76800640 1 -- 172.21.15.50:0/4245716000 learned_addr learned my addr 172.21.15.50:0/4245716000 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.496+0000 7fcb75e00640 1 --2- 172.21.15.50:0/4245716000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.496+0000 7fcb6fe00640 1 -- 172.21.15.50:0/4245716000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 msgr2=0x563fa92cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.496+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/4245716000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.497+0000 7fcb6fe00640 1 -- 172.21.15.50:0/4245716000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92d3020 msgr2=0x563fa92eb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.497+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/4245716000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92d3020 0x563fa92eb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.497+0000 7fcb6fe00640 1 -- 172.21.15.50:0/4245716000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa92c4200 con 0x563fa92c8760 2024-09-10T10:16:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.497+0000 7fcb75e00640 1 --2- 172.21.15.50:0/4245716000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.497+0000 7fcb76800640 1 --2- 172.21.15.50:0/4245716000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92d3020 0x563fa92eb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.497+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/4245716000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92c8760 0x563fa92eab90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb6002a940 tx=0x7fcb6002a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d332c01e84fe8d71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.497+0000 7fcb66600640 1 -- 172.21.15.50:0/4245716000 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6005a070 con 0x563fa92c8760 2024-09-10T10:16:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.497+0000 7fcb66600640 1 -- 172.21.15.50:0/4245716000 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb60005030 con 0x563fa92c8760 2024-09-10T10:16:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.497+0000 7fcb66600640 1 -- 172.21.15.50:0/4245716000 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb60035050 con 0x563fa92c8760 2024-09-10T10:16:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.498+0000 7fcb7f62b740 1 -- 172.21.15.50:0/4245716000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92c8760 msgr2=0x563fa92eab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.498+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/4245716000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92c8760 0x563fa92eab90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb6002a940 tx=0x7fcb6002a420 comp rx=0 tx=0).stop 2024-09-10T10:16:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.498+0000 7fcb7f62b740 1 -- 172.21.15.50:0/4245716000 shutdown_connections 2024-09-10T10:16:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.498+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/4245716000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92d3020 0x563fa92eb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.498+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/4245716000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92c8760 0x563fa92eab90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.498+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/4245716000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.498+0000 7fcb7f62b740 1 -- 172.21.15.50:0/4245716000 >> 172.21.15.50:0/4245716000 conn(0x563fa92c43d0 msgr2=0x563fa92c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:33.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.498+0000 7fcb7f62b740 1 -- 172.21.15.50:0/4245716000 shutdown_connections 2024-09-10T10:16:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.498+0000 7fcb7f62b740 1 -- 172.21.15.50:0/4245716000 wait complete. 2024-09-10T10:16:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.499+0000 7fcb7f62b740 1 -- start start 2024-09-10T10:16:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.499+0000 7fcb7f62b740 1 Processor -- start 2024-09-10T10:16:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.499+0000 7fcb7f62b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92d6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.499+0000 7fcb7f62b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 0x563fa92d6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.499+0000 7fcb7f62b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92d3020 0x563fa934bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.499+0000 7fcb7f62b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5400e1f0 con 0x563fa92c8760 2024-09-10T10:16:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.499+0000 7fcb7f62b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5400f660 con 0x563fa92d3020 2024-09-10T10:16:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.499+0000 7fcb7f62b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5400e8c0 con 0x563fa92c7e40 2024-09-10T10:16:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.500+0000 7fcb7f62b740 10 client.0 _ll_register_callbacks cb 0x7fcb600044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:16:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.500+0000 7fcb6fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 0x563fa92d6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.500+0000 7fcb6fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 0x563fa92d6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49688/0 (socket says 172.21.15.50:49688) 2024-09-10T10:16:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.500+0000 7fcb6fe00640 1 -- 172.21.15.50:0/3998167298 learned_addr learned my addr 172.21.15.50:0/3998167298 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.500+0000 7fcb75e00640 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92d6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.500+0000 7fcb76800640 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92d3020 0x563fa934bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.500+0000 7fcb6fe00640 1 -- 172.21.15.50:0/3998167298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 msgr2=0x563fa92d6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.500+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92d6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.500+0000 7fcb6fe00640 1 -- 172.21.15.50:0/3998167298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92d3020 msgr2=0x563fa934bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:16:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.500+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92d3020 0x563fa934bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.500+0000 7fcb6fe00640 1 -- 172.21.15.50:0/3998167298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fa934c090 con 0x563fa92c8760 2024-09-10T10:16:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.500+0000 7fcb75e00640 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92d6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.501+0000 7fcb6fe00640 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 0x563fa92d6660 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcb6002aa10 tx=0x7fcb60009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c857c01b50aeb6cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:33.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.501+0000 7fcb5b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-09-10T10:16:33.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.501+0000 7fcb5b400640 1 -- 172.21.15.50:0/3998167298 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb60035050 con 0x563fa92c8760 2024-09-10T10:16:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.501+0000 7fcb7f62b740 1 -- 172.21.15.50:0/3998167298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb60005030 con 0x563fa92c8760 2024-09-10T10:16:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.501+0000 7fcb5b400640 1 -- 172.21.15.50:0/3998167298 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fcb60031b40 con 0x563fa92c8760 2024-09-10T10:16:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.501+0000 7fcb5b400640 1 -- 172.21.15.50:0/3998167298 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcb60068050 con 0x563fa92c8760 2024-09-10T10:16:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.501+0000 7fcb7f62b740 10 client.16440 fetch_fsmap learned FSMap version 25 2024-09-10T10:16:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.501+0000 7fcb7f62b740 1 -- 172.21.15.50:0/3998167298 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563fa934d240 con 0x563fa92c8760 2024-09-10T10:16:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.502+0000 7fcb5b400640 1 -- 172.21.15.50:0/3998167298 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb60005030 con 0x563fa92c8760 2024-09-10T10:16:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.502+0000 7fcb5b400640 1 -- 172.21.15.50:0/3998167298 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fcb60054410 con 0x563fa92c8760 2024-09-10T10:16:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.502+0000 7fcb7f62b740 10 client.16440 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T10:16:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.502+0000 7fcb7f62b740 10 client.16440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T10:16:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.502+0000 7fcb7f62b740 20 client.16440 populate_metadata read hostname 'smithi050' 2024-09-10T10:16:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.502+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563fa934d980 0x563fa934fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.502+0000 7fcb7f62b740 4 client.16440 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T10:16:33.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.502+0000 7fcb7f62b740 1 -- 172.21.15.50:0/3998167298 --> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563fa9235e60 con 0x563fa934d980 2024-09-10T10:16:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.502+0000 7fcb75e00640 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563fa934d980 0x563fa934fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.503+0000 7fcb5b400640 10 client.16440 ms_handle_connect on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.503+0000 7fcb75e00640 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563fa934d980 0x563fa934fda0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=417bc14e41b21450 server_cookie=9847680c8ee4e0db in_seq=0 out_seq=0 2024-09-10T10:16:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.503+0000 7fcb5b400640 1 -- 172.21.15.50:0/3998167298 <== mds.0 v2:172.21.15.84:6838/4235486934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563fa9235e60 con 0x563fa934d980 2024-09-10T10:16:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.503+0000 7fcb5b400640 10 client.16440 handle_command_reply: tid=0 2024-09-10T10:16:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.503+0000 7fcb7f62b740 1 client.16440 shutdown 2024-09-10T10:16:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.504+0000 7fcb7f62b740 1 -- 172.21.15.50:0/3998167298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 msgr2=0x563fa92d6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.504+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 0x563fa92d6660 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcb6002aa10 tx=0x7fcb60009230 comp rx=0 tx=0).stop 2024-09-10T10:16:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.504+0000 7fcb7f62b740 1 -- 172.21.15.50:0/3998167298 shutdown_connections 2024-09-10T10:16:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.504+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.84:6838/4235486934,v1:172.21.15.84:6839/4235486934] conn(0x563fa934d980 0x563fa934fda0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.504+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fa92d3020 0x563fa934bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.504+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563fa92c8760 0x563fa92d6660 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.504+0000 7fcb7f62b740 1 --2- 172.21.15.50:0/3998167298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fa92c7e40 0x563fa92d6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.504+0000 7fcb7f62b740 1 -- 172.21.15.50:0/3998167298 >> 172.21.15.50:0/3998167298 conn(0x563fa92c43d0 msgr2=0x563fa92ddea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:33.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.504+0000 7fcb5b400640 0 client.16440 ms_handle_reset on v2:172.21.15.84:6838/4235486934 2024-09-10T10:16:33.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.504+0000 7fcb7f62b740 1 -- 172.21.15.50:0/3998167298 shutdown_connections 2024-09-10T10:16:33.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.504+0000 7fcb7f62b740 1 -- 172.21.15.50:0/3998167298 wait complete. 2024-09-10T10:16:33.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.504+0000 7fcb7f62b740 20 client.16440 trim_cache size 0 max 16384 2024-09-10T10:16:33.509 INFO:teuthology.orchestra.run.smithi050.stdout:[] 2024-09-10T10:16:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.505+0000 7fcb77200640 1 -- 172.21.15.50:0/1774030041 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcb5c0a2c00 msgr2=0x7fcb5c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.505+0000 7fcb77200640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcb5c0a2c00 0x7fcb5c0a50c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcb60006010 tx=0x7fcb60000bc0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.505+0000 7fcb77200640 1 -- 172.21.15.50:0/1774030041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb781079d0 msgr2=0x7fcb7819ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.505+0000 7fcb77200640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb781079d0 0x7fcb7819ed90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000eb10 tx=0x7fcb7000c2d0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.505+0000 7fcb77200640 1 -- 172.21.15.50:0/1774030041 shutdown_connections 2024-09-10T10:16:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.505+0000 7fcb77200640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fcb5c0a2c00 0x7fcb5c0a50c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.505+0000 7fcb77200640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb781079d0 0x7fcb7819ed90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.505+0000 7fcb77200640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb78102370 0x7fcb7819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.505+0000 7fcb77200640 1 --2- 172.21.15.50:0/1774030041 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcb781019d0 0x7fcb7819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:33.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.505+0000 7fcb77200640 1 -- 172.21.15.50:0/1774030041 >> 172.21.15.50:0/1774030041 conn(0x7fcb780fd710 msgr2=0x7fcb7810d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:33.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.505+0000 7fcb77200640 1 -- 172.21.15.50:0/1774030041 shutdown_connections 2024-09-10T10:16:33.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:33.505+0000 7fcb77200640 1 -- 172.21.15.50:0/1774030041 wait complete. 2024-09-10T10:16:34.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:34 smithi050 ceph-mon[30354]: pgmap v552: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-10T10:16:34.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:34 smithi189 ceph-mon[34999]: pgmap v552: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-10T10:16:34.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:34 smithi084 ceph-mon[34812]: pgmap v552: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-10T10:16:34.369 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-10T10:16:34.370 INFO:tasks.fwd_scrub:done joining 2024-09-10T10:16:34.370 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T10:16:34.381 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T10:16:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.542+0000 7fa85fe00640 1 -- 172.21.15.50:0/3942555851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8601023e0 msgr2=0x7fa8601047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.542+0000 7fa85fe00640 1 --2- 172.21.15.50:0/3942555851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8601023e0 0x7fa8601047d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa850009900 tx=0x7fa85002a400 comp rx=0 tx=0).stop 2024-09-10T10:16:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.542+0000 7fa85fe00640 1 -- 172.21.15.50:0/3942555851 shutdown_connections 2024-09-10T10:16:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.542+0000 7fa85fe00640 1 --2- 172.21.15.50:0/3942555851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa860107640 0x7fa860109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.542+0000 7fa85fe00640 1 --2- 172.21.15.50:0/3942555851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa860104d10 0x7fa860107100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.542+0000 7fa85fe00640 1 --2- 172.21.15.50:0/3942555851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8601023e0 0x7fa8601047d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.542+0000 7fa85fe00640 1 -- 172.21.15.50:0/3942555851 >> 172.21.15.50:0/3942555851 conn(0x7fa8600fc000 msgr2=0x7fa8600fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.542+0000 7fa85fe00640 1 -- 172.21.15.50:0/3942555851 shutdown_connections 2024-09-10T10:16:34.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.542+0000 7fa85fe00640 1 -- 172.21.15.50:0/3942555851 wait complete. 2024-09-10T10:16:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.543+0000 7fa85fe00640 1 Processor -- start 2024-09-10T10:16:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.543+0000 7fa85fe00640 1 -- start start 2024-09-10T10:16:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8601023e0 0x7fa860199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85fe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa860104d10 0x7fa86019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa860107640 0x7fa8601a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85fe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa86010d670 con 0x7fa8601023e0 2024-09-10T10:16:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85fe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa86010d4f0 con 0x7fa860107640 2024-09-10T10:16:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85fe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa86010d7f0 con 0x7fa860104d10 2024-09-10T10:16:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8601023e0 0x7fa860199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8601023e0 0x7fa860199f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49704/0 (socket says 172.21.15.50:49704) 2024-09-10T10:16:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85ea00640 1 -- 172.21.15.50:0/4293903328 learned_addr learned my addr 172.21.15.50:0/4293903328 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa857e00640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa860104d10 0x7fa86019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85f400640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa860107640 0x7fa8601a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85ea00640 1 -- 172.21.15.50:0/4293903328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa860104d10 msgr2=0x7fa86019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85ea00640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa860104d10 0x7fa86019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85ea00640 1 -- 172.21.15.50:0/4293903328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa860107640 msgr2=0x7fa8601a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85ea00640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa860107640 0x7fa8601a14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.544+0000 7fa85ea00640 1 -- 172.21.15.50:0/4293903328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8601a1b50 con 0x7fa8601023e0 2024-09-10T10:16:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.545+0000 7fa85f400640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa860107640 0x7fa8601a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.545+0000 7fa85ea00640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8601023e0 0x7fa860199f30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa850031440 tx=0x7fa850032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.545+0000 7fa857400640 1 -- 172.21.15.50:0/4293903328 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85003f030 con 0x7fa8601023e0 2024-09-10T10:16:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.545+0000 7fa857400640 1 -- 172.21.15.50:0/4293903328 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa850003ce0 con 0x7fa8601023e0 2024-09-10T10:16:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.545+0000 7fa857400640 1 -- 172.21.15.50:0/4293903328 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850035070 con 0x7fa8601023e0 2024-09-10T10:16:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.545+0000 7fa85fe00640 1 -- 172.21.15.50:0/4293903328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8601a1de0 con 0x7fa8601023e0 2024-09-10T10:16:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.545+0000 7fa85fe00640 1 -- 172.21.15.50:0/4293903328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8601a21c0 con 0x7fa8601023e0 2024-09-10T10:16:34.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.546+0000 7fa85fe00640 1 -- 172.21.15.50:0/4293903328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa860109180 con 0x7fa8601023e0 2024-09-10T10:16:34.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.548+0000 7fa857400640 1 -- 172.21.15.50:0/4293903328 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa850042030 con 0x7fa8601023e0 2024-09-10T10:16:34.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.550+0000 7fa857400640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa8440a2c10 0x7fa8440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:34.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.550+0000 7fa857400640 1 -- 172.21.15.50:0/4293903328 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa8500efc50 con 0x7fa8601023e0 2024-09-10T10:16:34.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.550+0000 7fa857e00640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa8440a2c10 0x7fa8440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:34.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.551+0000 7fa857e00640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa8440a2c10 0x7fa8440a50d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa86019b440 tx=0x7fa848005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:34.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.556+0000 7fa857400640 1 -- 172.21.15.50:0/4293903328 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8500bc170 con 0x7fa8601023e0 2024-09-10T10:16:34.744 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.743+0000 7fa85fe00640 1 -- 172.21.15.50:0/4293903328 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa860062e90 con 0x7fa8601023e0 2024-09-10T10:16:34.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.746+0000 7fa857400640 1 -- 172.21.15.50:0/4293903328 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24775 (secure 0 0 0) 0x7fa8500c0470 con 0x7fa8601023e0 2024-09-10T10:16:34.748 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:16:34.748 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:10:00.717554+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:16:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.748+0000 7fa85fe00640 1 -- 172.21.15.50:0/4293903328 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa8440a2c10 msgr2=0x7fa8440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.748+0000 7fa85fe00640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa8440a2c10 0x7fa8440a50d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa86019b440 tx=0x7fa848005f90 comp rx=0 tx=0).stop 2024-09-10T10:16:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.748+0000 7fa85fe00640 1 -- 172.21.15.50:0/4293903328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8601023e0 msgr2=0x7fa860199f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.748+0000 7fa85fe00640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8601023e0 0x7fa860199f30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa850031440 tx=0x7fa850032ce0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.748+0000 7fa85fe00640 1 -- 172.21.15.50:0/4293903328 shutdown_connections 2024-09-10T10:16:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.748+0000 7fa85fe00640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa8440a2c10 0x7fa8440a50d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.748+0000 7fa85fe00640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa860107640 0x7fa8601a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.748+0000 7fa85fe00640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa860104d10 0x7fa86019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.748+0000 7fa85fe00640 1 --2- 172.21.15.50:0/4293903328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8601023e0 0x7fa860199f30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.748+0000 7fa85fe00640 1 -- 172.21.15.50:0/4293903328 >> 172.21.15.50:0/4293903328 conn(0x7fa8600fc000 msgr2=0x7fa860101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:34.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.749+0000 7fa85fe00640 1 -- 172.21.15.50:0/4293903328 shutdown_connections 2024-09-10T10:16:34.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.749+0000 7fa85fe00640 1 -- 172.21.15.50:0/4293903328 wait complete. 2024-09-10T10:16:34.766 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T10:03:29.276863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T10:08:31.657814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T10:08:34.330951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-10T10:08:42.905904+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-10T10:16:34.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T10:16:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.929+0000 7fc243000640 1 -- 172.21.15.50:0/151608998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c103c10 msgr2=0x7fc23c104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.929+0000 7fc243000640 1 --2- 172.21.15.50:0/151608998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c103c10 0x7fc23c104010 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc230009900 tx=0x7fc23002a410 comp rx=0 tx=0).stop 2024-09-10T10:16:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.929+0000 7fc243000640 1 -- 172.21.15.50:0/151608998 shutdown_connections 2024-09-10T10:16:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.929+0000 7fc243000640 1 --2- 172.21.15.50:0/151608998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23c1057c0 0x7fc23c10c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.929+0000 7fc243000640 1 --2- 172.21.15.50:0/151608998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc23c104e00 0x7fc23c105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.929+0000 7fc243000640 1 --2- 172.21.15.50:0/151608998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c103c10 0x7fc23c104010 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.929+0000 7fc243000640 1 -- 172.21.15.50:0/151608998 >> 172.21.15.50:0/151608998 conn(0x7fc23c0ff390 msgr2=0x7fc23c1017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:34.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.930+0000 7fc243000640 1 -- 172.21.15.50:0/151608998 shutdown_connections 2024-09-10T10:16:34.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.930+0000 7fc243000640 1 -- 172.21.15.50:0/151608998 wait complete. 2024-09-10T10:16:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.930+0000 7fc243000640 1 Processor -- start 2024-09-10T10:16:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc243000640 1 -- start start 2024-09-10T10:16:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc243000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc23c103c10 0x7fc23c199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc243000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c104e00 0x7fc23c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc243000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23c1057c0 0x7fc23c1a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc243000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c10f890 con 0x7fc23c104e00 2024-09-10T10:16:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc243000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c10f710 con 0x7fc23c1057c0 2024-09-10T10:16:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc243000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c10fa10 con 0x7fc23c103c10 2024-09-10T10:16:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc241200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c104e00 0x7fc23c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc241200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c104e00 0x7fc23c19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49720/0 (socket says 172.21.15.50:49720) 2024-09-10T10:16:34.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc241200640 1 -- 172.21.15.50:0/580347806 learned_addr learned my addr 172.21.15.50:0/580347806 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:34.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc241c00640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc23c103c10 0x7fc23c199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:34.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc242600640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23c1057c0 0x7fc23c1a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:34.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc241200640 1 -- 172.21.15.50:0/580347806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc23c103c10 msgr2=0x7fc23c199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:34.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc241200640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc23c103c10 0x7fc23c199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc241200640 1 -- 172.21.15.50:0/580347806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23c1057c0 msgr2=0x7fc23c1a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:34.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.931+0000 7fc241200640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23c1057c0 0x7fc23c1a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:34.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.932+0000 7fc241200640 1 -- 172.21.15.50:0/580347806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c1a1b60 con 0x7fc23c104e00 2024-09-10T10:16:34.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.932+0000 7fc241200640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c104e00 0x7fc23c19a480 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc22800e9f0 tx=0x7fc22800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:34.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.932+0000 7fc23a000640 1 -- 172.21.15.50:0/580347806 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22800cd80 con 0x7fc23c104e00 2024-09-10T10:16:34.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.932+0000 7fc23a000640 1 -- 172.21.15.50:0/580347806 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc228005500 con 0x7fc23c104e00 2024-09-10T10:16:34.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.932+0000 7fc243000640 1 -- 172.21.15.50:0/580347806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc23c1a1e50 con 0x7fc23c104e00 2024-09-10T10:16:34.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.932+0000 7fc23a000640 1 -- 172.21.15.50:0/580347806 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc228010690 con 0x7fc23c104e00 2024-09-10T10:16:34.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.932+0000 7fc243000640 1 -- 172.21.15.50:0/580347806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc23c1a2310 con 0x7fc23c104e00 2024-09-10T10:16:34.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.933+0000 7fc243000640 1 -- 172.21.15.50:0/580347806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc23c10b050 con 0x7fc23c104e00 2024-09-10T10:16:34.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.936+0000 7fc23a000640 1 -- 172.21.15.50:0/580347806 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc2280046c0 con 0x7fc23c104e00 2024-09-10T10:16:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.937+0000 7fc23a000640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc2240a2c10 0x7fc2240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.937+0000 7fc23a000640 1 -- 172.21.15.50:0/580347806 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fc2280cf780 con 0x7fc23c104e00 2024-09-10T10:16:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.938+0000 7fc241c00640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc2240a2c10 0x7fc2240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:34.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.938+0000 7fc241c00640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc2240a2c10 0x7fc2240a50d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc230005ab0 tx=0x7fc230000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:34.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:34.941+0000 7fc23a000640 1 -- 172.21.15.50:0/580347806 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc22809c2f0 con 0x7fc23c104e00 2024-09-10T10:16:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.126+0000 7fc243000640 1 -- 172.21.15.50:0/580347806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc23c062df0 con 0x7fc23c104e00 2024-09-10T10:16:35.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.127+0000 7fc23a000640 1 -- 172.21.15.50:0/580347806 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7fc22809bbf0 con 0x7fc23c104e00 2024-09-10T10:16:35.128 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-09-10T10:16:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.129+0000 7fc243000640 1 -- 172.21.15.50:0/580347806 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc2240a2c10 msgr2=0x7fc2240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:35.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.129+0000 7fc243000640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc2240a2c10 0x7fc2240a50d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc230005ab0 tx=0x7fc230000bc0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.129+0000 7fc243000640 1 -- 172.21.15.50:0/580347806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c104e00 msgr2=0x7fc23c19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.129+0000 7fc243000640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c104e00 0x7fc23c19a480 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc22800e9f0 tx=0x7fc22800edf0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.129+0000 7fc243000640 1 -- 172.21.15.50:0/580347806 shutdown_connections 2024-09-10T10:16:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.129+0000 7fc243000640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fc2240a2c10 0x7fc2240a50d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.129+0000 7fc243000640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc23c1057c0 0x7fc23c1a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.129+0000 7fc243000640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc23c104e00 0x7fc23c19a480 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.129+0000 7fc243000640 1 --2- 172.21.15.50:0/580347806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc23c103c10 0x7fc23c199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.129+0000 7fc243000640 1 -- 172.21.15.50:0/580347806 >> 172.21.15.50:0/580347806 conn(0x7fc23c0ff390 msgr2=0x7fc23c108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.129+0000 7fc243000640 1 -- 172.21.15.50:0/580347806 shutdown_connections 2024-09-10T10:16:35.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.129+0000 7fc243000640 1 -- 172.21.15.50:0/580347806 wait complete. 2024-09-10T10:16:35.144 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:35 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4293903328' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:16:35.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T10:16:35.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.306+0000 7f97b5c00640 1 -- 172.21.15.50:0/1085498498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b0104f10 msgr2=0x7f97b0105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:35.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.306+0000 7f97b5c00640 1 --2- 172.21.15.50:0/1085498498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b0104f10 0x7f97b0105390 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f979c009900 tx=0x7f979c02a3f0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.306+0000 7f97b5c00640 1 -- 172.21.15.50:0/1085498498 shutdown_connections 2024-09-10T10:16:35.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.306+0000 7f97b5c00640 1 --2- 172.21.15.50:0/1085498498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b01058d0 0x7f97b010c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.306+0000 7f97b5c00640 1 --2- 172.21.15.50:0/1085498498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b0104f10 0x7f97b0105390 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.306+0000 7f97b5c00640 1 --2- 172.21.15.50:0/1085498498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97b0103d20 0x7f97b0104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.306+0000 7f97b5c00640 1 -- 172.21.15.50:0/1085498498 >> 172.21.15.50:0/1085498498 conn(0x7f97b00ff4a0 msgr2=0x7f97b01018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:35.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.306+0000 7f97b5c00640 1 -- 172.21.15.50:0/1085498498 shutdown_connections 2024-09-10T10:16:35.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.306+0000 7f97b5c00640 1 -- 172.21.15.50:0/1085498498 wait complete. 2024-09-10T10:16:35.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.307+0000 7f97b5c00640 1 Processor -- start 2024-09-10T10:16:35.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.307+0000 7f97b5c00640 1 -- start start 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97b5c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b0103d20 0x7f97b019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97b5c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b0104f10 0x7f97b019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97b5c00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97b01058d0 0x7f97b01a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97b5c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f97b010f9f0 con 0x7f97b0104f10 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97b5c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f97b010f870 con 0x7f97b0103d20 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97b5c00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97b010fb70 con 0x7f97b01058d0 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97ae000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b0104f10 0x7f97b019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97ae000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b0104f10 0x7f97b019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49740/0 (socket says 172.21.15.50:49740) 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97ae000640 1 -- 172.21.15.50:0/428667727 learned_addr learned my addr 172.21.15.50:0/428667727 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97aea00640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b0103d20 0x7f97b019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97af400640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97b01058d0 0x7f97b01a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97ae000640 1 -- 172.21.15.50:0/428667727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97b01058d0 msgr2=0x7f97b01a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97ae000640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97b01058d0 0x7f97b01a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97ae000640 1 -- 172.21.15.50:0/428667727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b0103d20 msgr2=0x7f97b019a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:35.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97ae000640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b0103d20 0x7f97b019a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97ae000640 1 -- 172.21.15.50:0/428667727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b01a1cd0 con 0x7f97b0104f10 2024-09-10T10:16:35.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.308+0000 7f97aea00640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b0103d20 0x7f97b019a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:35.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.309+0000 7f97ae000640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b0104f10 0x7f97b019a5f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f979c031440 tx=0x7f979c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:35.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.309+0000 7f97a7400640 1 -- 172.21.15.50:0/428667727 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c03f030 con 0x7f97b0104f10 2024-09-10T10:16:35.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.309+0000 7f97a7400640 1 -- 172.21.15.50:0/428667727 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f979c003ce0 con 0x7f97b0104f10 2024-09-10T10:16:35.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.309+0000 7f97a7400640 1 -- 172.21.15.50:0/428667727 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c035070 con 0x7f97b0104f10 2024-09-10T10:16:35.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.309+0000 7f97b5c00640 1 -- 172.21.15.50:0/428667727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b01a1f60 con 0x7f97b0104f10 2024-09-10T10:16:35.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.309+0000 7f97b5c00640 1 -- 172.21.15.50:0/428667727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b01a2370 con 0x7f97b0104f10 2024-09-10T10:16:35.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.310+0000 7f97b5c00640 1 -- 172.21.15.50:0/428667727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b010b100 con 0x7f97b0104f10 2024-09-10T10:16:35.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.312+0000 7f97a7400640 1 -- 172.21.15.50:0/428667727 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f979c042030 con 0x7f97b0104f10 2024-09-10T10:16:35.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.313+0000 7f97a7400640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97940a2c10 0x7f97940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:35.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.313+0000 7f97a7400640 1 -- 172.21.15.50:0/428667727 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f979c0ef7f0 con 0x7f97b0104f10 2024-09-10T10:16:35.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.314+0000 7f97aea00640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97940a2c10 0x7f97940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:35.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.314+0000 7f97aea00640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97940a2c10 0x7f97940a50d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f97b0104d70 tx=0x7f97a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:35.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.317+0000 7f97a7400640 1 -- 172.21.15.50:0/428667727 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f979c0bbd10 con 0x7f97b0104f10 2024-09-10T10:16:35.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:35 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4293903328' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:16:35.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:35 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4293903328' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:16:35.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.506+0000 7f97b5c00640 1 -- 172.21.15.50:0/428667727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f97b0062e20 con 0x7f97b0104f10 2024-09-10T10:16:35.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.507+0000 7f97a7400640 1 -- 172.21.15.50:0/428667727 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) ==== 104+0+11 (secure 0 0 0) 0x7f979c0c0010 con 0x7f97b0104f10 2024-09-10T10:16:35.508 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-10T10:16:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.509+0000 7f97b5c00640 1 -- 172.21.15.50:0/428667727 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97940a2c10 msgr2=0x7f97940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.509+0000 7f97b5c00640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97940a2c10 0x7f97940a50d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f97b0104d70 tx=0x7f97a0005f90 comp rx=0 tx=0).stop 2024-09-10T10:16:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.509+0000 7f97b5c00640 1 -- 172.21.15.50:0/428667727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b0104f10 msgr2=0x7f97b019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.509+0000 7f97b5c00640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b0104f10 0x7f97b019a5f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f979c031440 tx=0x7f979c032ce0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.509+0000 7f97b5c00640 1 -- 172.21.15.50:0/428667727 shutdown_connections 2024-09-10T10:16:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.509+0000 7f97b5c00640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97940a2c10 0x7f97940a50d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.509+0000 7f97b5c00640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97b01058d0 0x7f97b01a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.509+0000 7f97b5c00640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b0104f10 0x7f97b019a5f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.509+0000 7f97b5c00640 1 --2- 172.21.15.50:0/428667727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b0103d20 0x7f97b019a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.509+0000 7f97b5c00640 1 -- 172.21.15.50:0/428667727 >> 172.21.15.50:0/428667727 conn(0x7f97b00ff4a0 msgr2=0x7f97b01082d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.509+0000 7f97b5c00640 1 -- 172.21.15.50:0/428667727 shutdown_connections 2024-09-10T10:16:35.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.509+0000 7f97b5c00640 1 -- 172.21.15.50:0/428667727 wait complete. 2024-09-10T10:16:35.526 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T10:16:35.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.686+0000 7f6e89a00640 1 -- 172.21.15.50:0/1443819374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e840761d0 msgr2=0x7f6e84074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:35.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.686+0000 7f6e89a00640 1 --2- 172.21.15.50:0/1443819374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e840761d0 0x7f6e84074620 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009900 tx=0x7f6e7402a480 comp rx=0 tx=0).stop 2024-09-10T10:16:35.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.686+0000 7f6e89a00640 1 -- 172.21.15.50:0/1443819374 shutdown_connections 2024-09-10T10:16:35.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.686+0000 7f6e89a00640 1 --2- 172.21.15.50:0/1443819374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e84109990 0x7f6e8410be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.686+0000 7f6e89a00640 1 --2- 172.21.15.50:0/1443819374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e84074bf0 0x7f6e84075050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.686+0000 7f6e89a00640 1 --2- 172.21.15.50:0/1443819374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e840761d0 0x7f6e84074620 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.686+0000 7f6e89a00640 1 -- 172.21.15.50:0/1443819374 >> 172.21.15.50:0/1443819374 conn(0x7f6e840fd2a0 msgr2=0x7f6e840ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:35.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.686+0000 7f6e89a00640 1 -- 172.21.15.50:0/1443819374 shutdown_connections 2024-09-10T10:16:35.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.686+0000 7f6e89a00640 1 -- 172.21.15.50:0/1443819374 wait complete. 2024-09-10T10:16:35.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.687+0000 7f6e89a00640 1 Processor -- start 2024-09-10T10:16:35.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.687+0000 7f6e89a00640 1 -- start start 2024-09-10T10:16:35.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.687+0000 7f6e89a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e84074bf0 0x7f6e8419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.687+0000 7f6e89a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e840761d0 0x7f6e8419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.687+0000 7f6e89a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e84109990 0x7f6e841a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.687+0000 7f6e89a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8410f9e0 con 0x7f6e84109990 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.687+0000 7f6e89a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8410f860 con 0x7f6e84074bf0 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.687+0000 7f6e89a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8410fb60 con 0x7f6e840761d0 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.688+0000 7f6e83400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e84109990 0x7f6e841a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.688+0000 7f6e83400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e84109990 0x7f6e841a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49758/0 (socket says 172.21.15.50:49758) 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.688+0000 7f6e83400640 1 -- 172.21.15.50:0/1608613960 learned_addr learned my addr 172.21.15.50:0/1608613960 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.688+0000 7f6e82a00640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e84074bf0 0x7f6e8419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.688+0000 7f6e82000640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e840761d0 0x7f6e8419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.688+0000 7f6e83400640 1 -- 172.21.15.50:0/1608613960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e840761d0 msgr2=0x7f6e8419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.688+0000 7f6e83400640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e840761d0 0x7f6e8419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.688+0000 7f6e83400640 1 -- 172.21.15.50:0/1608613960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e84074bf0 msgr2=0x7f6e8419a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:35.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.688+0000 7f6e83400640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e84074bf0 0x7f6e8419a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.688+0000 7f6e83400640 1 -- 172.21.15.50:0/1608613960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e841a1cb0 con 0x7f6e84109990 2024-09-10T10:16:35.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.688+0000 7f6e83400640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e84109990 0x7f6e841a1640 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00eb10 tx=0x7f6e7c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:35.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.689+0000 7f6e7b400640 1 -- 172.21.15.50:0/1608613960 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c004b20 con 0x7f6e84109990 2024-09-10T10:16:35.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.689+0000 7f6e7b400640 1 -- 172.21.15.50:0/1608613960 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e7c004cc0 con 0x7f6e84109990 2024-09-10T10:16:35.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.689+0000 7f6e89a00640 1 -- 172.21.15.50:0/1608613960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e841a1fa0 con 0x7f6e84109990 2024-09-10T10:16:35.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.689+0000 7f6e7b400640 1 -- 172.21.15.50:0/1608613960 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c010760 con 0x7f6e84109990 2024-09-10T10:16:35.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.689+0000 7f6e89a00640 1 -- 172.21.15.50:0/1608613960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e841a2460 con 0x7f6e84109990 2024-09-10T10:16:35.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.690+0000 7f6e89a00640 1 -- 172.21.15.50:0/1608613960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e84108750 con 0x7f6e84109990 2024-09-10T10:16:35.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.692+0000 7f6e7b400640 1 -- 172.21.15.50:0/1608613960 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6e7c005020 con 0x7f6e84109990 2024-09-10T10:16:35.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.693+0000 7f6e7b400640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e680a2c10 0x7f6e680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:35.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.693+0000 7f6e7b400640 1 -- 172.21.15.50:0/1608613960 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f6e7c0cf960 con 0x7f6e84109990 2024-09-10T10:16:35.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.693+0000 7f6e82a00640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e680a2c10 0x7f6e680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:35.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.694+0000 7f6e82a00640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e680a2c10 0x7f6e680a50d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6e74031440 tx=0x7f6e740315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:35.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.697+0000 7f6e7b400640 1 -- 172.21.15.50:0/1608613960 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e7c09c4d0 con 0x7f6e84109990 2024-09-10T10:16:35.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.882+0000 7f6e89a00640 1 -- 172.21.15.50:0/1608613960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6e84062e90 con 0x7f6e84109990 2024-09-10T10:16:35.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.882+0000 7f6e7b400640 1 -- 172.21.15.50:0/1608613960 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) ==== 100+0+11 (secure 0 0 0) 0x7f6e7c09bdd0 con 0x7f6e84109990 2024-09-10T10:16:35.884 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-09-10T10:16:35.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.885+0000 7f6e89a00640 1 -- 172.21.15.50:0/1608613960 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e680a2c10 msgr2=0x7f6e680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:35.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.885+0000 7f6e89a00640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e680a2c10 0x7f6e680a50d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6e74031440 tx=0x7f6e740315b0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.885+0000 7f6e89a00640 1 -- 172.21.15.50:0/1608613960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e84109990 msgr2=0x7f6e841a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:35.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.885+0000 7f6e89a00640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e84109990 0x7f6e841a1640 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00eb10 tx=0x7f6e7c00c2d0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.885+0000 7f6e89a00640 1 -- 172.21.15.50:0/1608613960 shutdown_connections 2024-09-10T10:16:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.885+0000 7f6e89a00640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f6e680a2c10 0x7f6e680a50d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.885+0000 7f6e89a00640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e84109990 0x7f6e841a1640 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.885+0000 7f6e89a00640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6e840761d0 0x7f6e8419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.885+0000 7f6e89a00640 1 --2- 172.21.15.50:0/1608613960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e84074bf0 0x7f6e8419a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.885+0000 7f6e89a00640 1 -- 172.21.15.50:0/1608613960 >> 172.21.15.50:0/1608613960 conn(0x7f6e840fd2a0 msgr2=0x7f6e84105920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.885+0000 7f6e89a00640 1 -- 172.21.15.50:0/1608613960 shutdown_connections 2024-09-10T10:16:35.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:35.885+0000 7f6e89a00640 1 -- 172.21.15.50:0/1608613960 wait complete. 2024-09-10T10:16:35.902 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-10T10:16:36.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.064+0000 7fac91a00640 1 -- 172.21.15.50:0/2852089734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac8c103d20 msgr2=0x7fac8c104120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:36.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.064+0000 7fac91a00640 1 --2- 172.21.15.50:0/2852089734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac8c103d20 0x7fac8c104120 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009900 tx=0x7fac7c02a410 comp rx=0 tx=0).stop 2024-09-10T10:16:36.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.064+0000 7fac91a00640 1 -- 172.21.15.50:0/2852089734 shutdown_connections 2024-09-10T10:16:36.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.064+0000 7fac91a00640 1 --2- 172.21.15.50:0/2852089734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac8c1058d0 0x7fac8c10c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.064+0000 7fac91a00640 1 --2- 172.21.15.50:0/2852089734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c104f10 0x7fac8c105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.064+0000 7fac91a00640 1 --2- 172.21.15.50:0/2852089734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac8c103d20 0x7fac8c104120 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.064+0000 7fac91a00640 1 -- 172.21.15.50:0/2852089734 >> 172.21.15.50:0/2852089734 conn(0x7fac8c0ff4a0 msgr2=0x7fac8c1018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:36.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.064+0000 7fac91a00640 1 -- 172.21.15.50:0/2852089734 shutdown_connections 2024-09-10T10:16:36.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.064+0000 7fac91a00640 1 -- 172.21.15.50:0/2852089734 wait complete. 2024-09-10T10:16:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.065+0000 7fac91a00640 1 Processor -- start 2024-09-10T10:16:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.065+0000 7fac91a00640 1 -- start start 2024-09-10T10:16:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac91a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac8c103d20 0x7fac8c19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac91a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c104f10 0x7fac8c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac91a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac8c1058d0 0x7fac8c1a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac91a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c10f980 con 0x7fac8c103d20 2024-09-10T10:16:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac91a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c10f800 con 0x7fac8c1058d0 2024-09-10T10:16:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac91a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c10fb00 con 0x7fac8c104f10 2024-09-10T10:16:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac8aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac8c103d20 0x7fac8c19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac8aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac8c103d20 0x7fac8c19a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49780/0 (socket says 172.21.15.50:49780) 2024-09-10T10:16:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac8aa00640 1 -- 172.21.15.50:0/3886391576 learned_addr learned my addr 172.21.15.50:0/3886391576 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac8a000640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c104f10 0x7fac8c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:36.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac8b400640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac8c1058d0 0x7fac8c1a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:36.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac8aa00640 1 -- 172.21.15.50:0/3886391576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c104f10 msgr2=0x7fac8c19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:36.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac8aa00640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c104f10 0x7fac8c19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac8aa00640 1 -- 172.21.15.50:0/3886391576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac8c1058d0 msgr2=0x7fac8c1a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:36.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac8aa00640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac8c1058d0 0x7fac8c1a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.066+0000 7fac8aa00640 1 -- 172.21.15.50:0/3886391576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c1a1cb0 con 0x7fac8c103d20 2024-09-10T10:16:36.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.067+0000 7fac8aa00640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac8c103d20 0x7fac8c19a090 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fac7c031610 tx=0x7fac7c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:36.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.067+0000 7fac83400640 1 -- 172.21.15.50:0/3886391576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c03f030 con 0x7fac8c103d20 2024-09-10T10:16:36.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.067+0000 7fac83400640 1 -- 172.21.15.50:0/3886391576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac7c003ad0 con 0x7fac8c103d20 2024-09-10T10:16:36.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.067+0000 7fac83400640 1 -- 172.21.15.50:0/3886391576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c035070 con 0x7fac8c103d20 2024-09-10T10:16:36.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.067+0000 7fac91a00640 1 -- 172.21.15.50:0/3886391576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8c1a1f40 con 0x7fac8c103d20 2024-09-10T10:16:36.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.067+0000 7fac91a00640 1 -- 172.21.15.50:0/3886391576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac8c1a2350 con 0x7fac8c103d20 2024-09-10T10:16:36.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.068+0000 7fac91a00640 1 -- 172.21.15.50:0/3886391576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac8c10b150 con 0x7fac8c103d20 2024-09-10T10:16:36.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.070+0000 7fac83400640 1 -- 172.21.15.50:0/3886391576 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fac7c042030 con 0x7fac8c103d20 2024-09-10T10:16:36.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.071+0000 7fac83400640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac700a2c10 0x7fac700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:36.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.071+0000 7fac83400640 1 -- 172.21.15.50:0/3886391576 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fac7c0ef9b0 con 0x7fac8c103d20 2024-09-10T10:16:36.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.072+0000 7fac8a000640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac700a2c10 0x7fac700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:36.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.072+0000 7fac8a000640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac700a2c10 0x7fac700a50d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fac8c19b5a0 tx=0x7fac7800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:36.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.075+0000 7fac83400640 1 -- 172.21.15.50:0/3886391576 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac7c0bbf30 con 0x7fac8c103d20 2024-09-10T10:16:36.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:36 smithi050 ceph-mon[30354]: pgmap v553: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-10T10:16:36.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:36 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/580347806' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:16:36.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:36 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/428667727' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T10:16:36.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:36 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1608613960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T10:16:36.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.261+0000 7fac91a00640 1 -- 172.21.15.50:0/3886391576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fac8c062630 con 0x7fac8c103d20 2024-09-10T10:16:36.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.261+0000 7fac83400640 1 -- 172.21.15.50:0/3886391576 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v95) ==== 103+0+11 (secure 0 0 0) 0x7fac7c0c0230 con 0x7fac8c103d20 2024-09-10T10:16:36.263 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-09-10T10:16:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.264+0000 7fac91a00640 1 -- 172.21.15.50:0/3886391576 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac700a2c10 msgr2=0x7fac700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.264+0000 7fac91a00640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac700a2c10 0x7fac700a50d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fac8c19b5a0 tx=0x7fac7800b410 comp rx=0 tx=0).stop 2024-09-10T10:16:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.264+0000 7fac91a00640 1 -- 172.21.15.50:0/3886391576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac8c103d20 msgr2=0x7fac8c19a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.264+0000 7fac91a00640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac8c103d20 0x7fac8c19a090 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fac7c031610 tx=0x7fac7c004270 comp rx=0 tx=0).stop 2024-09-10T10:16:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.264+0000 7fac91a00640 1 -- 172.21.15.50:0/3886391576 shutdown_connections 2024-09-10T10:16:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.264+0000 7fac91a00640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fac700a2c10 0x7fac700a50d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.264+0000 7fac91a00640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac8c1058d0 0x7fac8c1a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.264+0000 7fac91a00640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac8c104f10 0x7fac8c19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.264+0000 7fac91a00640 1 --2- 172.21.15.50:0/3886391576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac8c103d20 0x7fac8c19a090 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.264+0000 7fac91a00640 1 -- 172.21.15.50:0/3886391576 >> 172.21.15.50:0/3886391576 conn(0x7fac8c0ff4a0 msgr2=0x7fac8c108320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.264+0000 7fac91a00640 1 -- 172.21.15.50:0/3886391576 shutdown_connections 2024-09-10T10:16:36.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.264+0000 7fac91a00640 1 -- 172.21.15.50:0/3886391576 wait complete. 2024-09-10T10:16:36.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T10:16:36.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:36 smithi189 ceph-mon[34999]: pgmap v553: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-10T10:16:36.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:36 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/580347806' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:16:36.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:36 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/428667727' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T10:16:36.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:36 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1608613960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T10:16:36.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:36 smithi084 ceph-mon[34812]: pgmap v553: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-10T10:16:36.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:36 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/580347806' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:16:36.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:36 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/428667727' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T10:16:36.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:36 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1608613960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T10:16:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.439+0000 7f97e9a00640 1 -- 172.21.15.50:0/590139897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97e41036c0 msgr2=0x7f97e4109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.439+0000 7f97e9a00640 1 --2- 172.21.15.50:0/590139897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97e41036c0 0x7f97e4109f50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009ca0 tx=0x7f97dc02a8b0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.440+0000 7f97e9a00640 1 -- 172.21.15.50:0/590139897 shutdown_connections 2024-09-10T10:16:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.440+0000 7f97e9a00640 1 --2- 172.21.15.50:0/590139897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97e41036c0 0x7f97e4109f50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.440+0000 7f97e9a00640 1 --2- 172.21.15.50:0/590139897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97e4102d00 0x7f97e4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.440+0000 7f97e9a00640 1 --2- 172.21.15.50:0/590139897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e4101b10 0x7f97e4101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.440+0000 7f97e9a00640 1 -- 172.21.15.50:0/590139897 >> 172.21.15.50:0/590139897 conn(0x7f97e40fd2b0 msgr2=0x7f97e40ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.440+0000 7f97e9a00640 1 -- 172.21.15.50:0/590139897 shutdown_connections 2024-09-10T10:16:36.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.440+0000 7f97e9a00640 1 -- 172.21.15.50:0/590139897 wait complete. 2024-09-10T10:16:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.441+0000 7f97e9a00640 1 Processor -- start 2024-09-10T10:16:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.441+0000 7f97e9a00640 1 -- start start 2024-09-10T10:16:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.441+0000 7f97e9a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97e4101b10 0x7f97e419a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.441+0000 7f97e9a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e4102d00 0x7f97e419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.441+0000 7f97e9a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97e41036c0 0x7f97e41a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.441+0000 7f97e9a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f97e410d7e0 con 0x7f97e41036c0 2024-09-10T10:16:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.441+0000 7f97e9a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f97e410d660 con 0x7f97e4102d00 2024-09-10T10:16:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.441+0000 7f97e9a00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97e410d960 con 0x7f97e4101b10 2024-09-10T10:16:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.442+0000 7f97e2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97e4101b10 0x7f97e419a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:36.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.442+0000 7f97e3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97e41036c0 0x7f97e41a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.442+0000 7f97dbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e4102d00 0x7f97e419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.442+0000 7f97e2a00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97e4101b10 0x7f97e419a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:34282/0 (socket says 172.21.15.50:34282) 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.442+0000 7f97e2a00640 1 -- 172.21.15.50:0/1471923958 learned_addr learned my addr 172.21.15.50:0/1471923958 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.442+0000 7f97e2a00640 1 -- 172.21.15.50:0/1471923958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e4102d00 msgr2=0x7f97e419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.442+0000 7f97e2a00640 1 --2- 172.21.15.50:0/1471923958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e4102d00 0x7f97e419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.442+0000 7f97e2a00640 1 -- 172.21.15.50:0/1471923958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97e41036c0 msgr2=0x7f97e41a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.442+0000 7f97e2a00640 1 --2- 172.21.15.50:0/1471923958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97e41036c0 0x7f97e41a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.442+0000 7f97e2a00640 1 -- 172.21.15.50:0/1471923958 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e41a1c40 con 0x7f97e4101b10 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.442+0000 7f97e2a00640 1 --2- 172.21.15.50:0/1471923958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97e4101b10 0x7f97e419a020 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f97d400e9c0 tx=0x7f97d400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.442+0000 7f97db400640 1 -- 172.21.15.50:0/1471923958 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d400cd80 con 0x7f97e4101b10 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.443+0000 7f97e9a00640 1 -- 172.21.15.50:0/1471923958 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e41a1f30 con 0x7f97e4101b10 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.443+0000 7f97db400640 1 -- 172.21.15.50:0/1471923958 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97d40035f0 con 0x7f97e4101b10 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.443+0000 7f97db400640 1 -- 172.21.15.50:0/1471923958 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4010690 con 0x7f97e4101b10 2024-09-10T10:16:36.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.443+0000 7f97e9a00640 1 -- 172.21.15.50:0/1471923958 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e41a23f0 con 0x7f97e4101b10 2024-09-10T10:16:36.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.444+0000 7f97e9a00640 1 -- 172.21.15.50:0/1471923958 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97e41a26b0 con 0x7f97e4101b10 2024-09-10T10:16:36.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.446+0000 7f97db400640 1 -- 172.21.15.50:0/1471923958 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f97d40037a0 con 0x7f97e4101b10 2024-09-10T10:16:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.447+0000 7f97db400640 1 --2- 172.21.15.50:0/1471923958 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97c80a2b90 0x7f97c80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.447+0000 7f97db400640 1 -- 172.21.15.50:0/1471923958 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f97d40cf890 con 0x7f97e4101b10 2024-09-10T10:16:36.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.447+0000 7f97dbe00640 1 --2- 172.21.15.50:0/1471923958 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97c80a2b90 0x7f97c80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:36.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.448+0000 7f97dbe00640 1 --2- 172.21.15.50:0/1471923958 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97c80a2b90 0x7f97c80a5050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f97e419b530 tx=0x7f97cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:36.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.449+0000 7f97db400640 1 -- 172.21.15.50:0/1471923958 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f97d409c490 con 0x7f97e4101b10 2024-09-10T10:16:36.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.682+0000 7f97e9a00640 1 -- 172.21.15.50:0/1471923958 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f97e41a2880 con 0x7f97e4101b10 2024-09-10T10:16:36.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.691+0000 7f97db400640 1 -- 172.21.15.50:0/1471923958 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740369 (secure 0 0 0) 0x7f97d409bd90 con 0x7f97e4101b10 2024-09-10T10:16:36.703 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:16:36.703 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:16:36.703 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 18, 2024-09-10T10:16:36.703 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.703 INFO:teuthology.orchestra.run.smithi050.stdout: "active_gid": 14150, 2024-09-10T10:16:36.703 INFO:teuthology.orchestra.run.smithi050.stdout: "active_name": "x", 2024-09-10T10:16:36.704 INFO:teuthology.orchestra.run.smithi050.stdout: "active_addrs": { 2024-09-10T10:16:36.704 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-10T10:16:36.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.704 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-10T10:16:36.704 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2024-09-10T10:16:36.704 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2546156966 2024-09-10T10:16:36.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.704 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-10T10:16:36.704 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2024-09-10T10:16:36.704 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2546156966 2024-09-10T10:16:36.704 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.704 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-10T10:16:36.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.705 INFO:teuthology.orchestra.run.smithi050.stdout: "active_addr": "172.21.15.50:6801/2546156966", 2024-09-10T10:16:36.705 INFO:teuthology.orchestra.run.smithi050.stdout: "active_change": "2024-09-10T10:00:58.655399+0000", 2024-09-10T10:16:36.705 INFO:teuthology.orchestra.run.smithi050.stdout: "active_mgr_features": 4540701547738038271, 2024-09-10T10:16:36.705 INFO:teuthology.orchestra.run.smithi050.stdout: "available": true, 2024-09-10T10:16:36.705 INFO:teuthology.orchestra.run.smithi050.stdout: "standbys": [ 2024-09-10T10:16:36.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.705 INFO:teuthology.orchestra.run.smithi050.stdout: "gid": 24112, 2024-09-10T10:16:36.705 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "z", 2024-09-10T10:16:36.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_features": 4540701547738038271, 2024-09-10T10:16:36.705 INFO:teuthology.orchestra.run.smithi050.stdout: "available_modules": [ 2024-09-10T10:16:36.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "alerts", 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T10:16:36.706 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.707 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.707 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.707 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.707 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.707 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.707 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.707 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.707 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.707 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.707 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.707 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.707 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.708 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.708 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.708 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.708 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.708 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.708 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.708 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.708 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.708 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.708 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.708 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.709 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.709 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.709 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.709 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.709 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.709 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.709 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.709 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.709 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.709 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.709 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.709 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.710 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.711 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.712 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.712 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.712 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.712 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.712 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.712 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_destination": { 2024-09-10T10:16:36.712 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_destination", 2024-09-10T10:16:36.712 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.712 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.712 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.712 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.712 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email address to send alerts to", 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_from_name": { 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_from_name", 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "Ceph", 2024-09-10T10:16:36.713 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.714 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.714 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.714 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email From: name", 2024-09-10T10:16:36.714 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.714 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.714 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.714 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_host": { 2024-09-10T10:16:36.714 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_host", 2024-09-10T10:16:36.714 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.714 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.714 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.714 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP server", 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_password": { 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_password", 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.715 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Password to authenticate with", 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_port": { 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_port", 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "465", 2024-09-10T10:16:36.716 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.717 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.717 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.717 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP port", 2024-09-10T10:16:36.717 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.717 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.717 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.717 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_sender": { 2024-09-10T10:16:36.717 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_sender", 2024-09-10T10:16:36.717 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.717 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.717 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.717 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.718 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.718 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.718 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.718 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP envelope sender", 2024-09-10T10:16:36.718 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.718 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.718 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.718 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_ssl": { 2024-09-10T10:16:36.718 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_ssl", 2024-09-10T10:16:36.718 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.718 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_user": { 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_user", 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.719 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.720 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.720 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.720 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.720 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.720 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.720 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "User to authenticate as", 2024-09-10T10:16:36.720 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.720 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.720 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.720 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.720 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "balancer", 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "active": { 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "active", 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.721 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_time": { 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_time", 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0000", 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T10:16:36.722 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T10:16:36.723 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.723 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.723 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_weekday": { 2024-09-10T10:16:36.723 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_weekday", 2024-09-10T10:16:36.723 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:36.723 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.723 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.723 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:36.723 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-09-10T10:16:36.723 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-09-10T10:16:36.723 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.723 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T10:16:36.724 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T10:16:36.724 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.724 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.724 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_max_iterations": { 2024-09-10T10:16:36.724 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_max_iterations", 2024-09-10T10:16:36.724 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:36.724 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.724 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.724 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "25", 2024-09-10T10:16:36.724 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-09-10T10:16:36.724 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "250", 2024-09-10T10:16:36.724 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.725 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T10:16:36.725 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.725 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.725 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.725 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_metrics": { 2024-09-10T10:16:36.725 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_metrics", 2024-09-10T10:16:36.725 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.725 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.725 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.725 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T10:16:36.725 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.725 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T10:16:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T10:16:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_step": { 2024-09-10T10:16:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_step", 2024-09-10T10:16:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.5", 2024-09-10T10:16:36.726 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0.001", 2024-09-10T10:16:36.727 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "0.999", 2024-09-10T10:16:36.727 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.727 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "aggressiveness of optimization", 2024-09-10T10:16:36.727 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T10:16:36.727 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.727 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.727 INFO:teuthology.orchestra.run.smithi050.stdout: "end_time": { 2024-09-10T10:16:36.727 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_time", 2024-09-10T10:16:36.727 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.727 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.727 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.728 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2359", 2024-09-10T10:16:36.728 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.728 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.728 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.728 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T10:16:36.728 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T10:16:36.728 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.728 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.728 INFO:teuthology.orchestra.run.smithi050.stdout: "end_weekday": { 2024-09-10T10:16:36.728 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_weekday", 2024-09-10T10:16:36.728 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:36.729 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.729 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.729 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:36.729 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-09-10T10:16:36.729 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-09-10T10:16:36.729 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.729 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T10:16:36.729 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T10:16:36.729 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.729 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.729 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.730 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.730 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.730 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.730 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.730 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.730 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.730 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.730 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.730 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.730 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.730 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.730 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.730 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.731 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.731 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.731 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.731 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.731 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.731 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.731 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.731 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.731 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.731 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.732 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.732 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.732 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.732 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.732 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.732 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.732 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.732 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.732 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.732 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.732 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.733 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.734 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: "min_score": { 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_score", 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.735 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.736 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T10:16:36.736 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.736 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.736 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.736 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-09-10T10:16:36.736 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-09-10T10:16:36.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.736 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.736 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.736 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "upmap", 2024-09-10T10:16:36.736 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.736 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.737 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.737 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-compat", 2024-09-10T10:16:36.737 INFO:teuthology.orchestra.run.smithi050.stdout: "none", 2024-09-10T10:16:36.737 INFO:teuthology.orchestra.run.smithi050.stdout: "read", 2024-09-10T10:16:36.737 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap", 2024-09-10T10:16:36.737 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap-read" 2024-09-10T10:16:36.737 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.737 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Balancer mode", 2024-09-10T10:16:36.737 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.737 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.737 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.737 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_ids": { 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_ids", 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.738 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.739 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_deviation": { 2024-09-10T10:16:36.740 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_deviation", 2024-09-10T10:16:36.740 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.740 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.740 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.740 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-09-10T10:16:36.740 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-09-10T10:16:36.740 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.740 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.740 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T10:16:36.740 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T10:16:36.740 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.740 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_optimizations": { 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_optimizations", 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.741 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.742 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.742 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm", 2024-09-10T10:16:36.742 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.742 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.742 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.742 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_down_multiplier": { 2024-09-10T10:16:36.742 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_down_multiplier", 2024-09-10T10:16:36.742 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:36.742 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.742 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.742 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-09-10T10:16:36.743 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.743 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.743 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.743 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T10:16:36.743 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.743 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.743 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.743 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_refresh_rate": { 2024-09-10T10:16:36.743 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_refresh_rate", 2024-09-10T10:16:36.743 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.743 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.743 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "20", 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_starting_port": { 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_starting_port", 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.744 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.745 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4721", 2024-09-10T10:16:36.745 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.745 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.745 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.745 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T10:16:36.745 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.745 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.745 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.745 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_ptrace": { 2024-09-10T10:16:36.745 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_ptrace", 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_interval": { 2024-09-10T10:16:36.746 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_interval", 2024-09-10T10:16:36.747 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.747 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.747 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.747 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:36.747 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.747 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.747 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.747 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T10:16:36.747 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.747 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.747 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.747 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_memory_target_ratio": { 2024-09-10T10:16:36.748 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T10:16:36.748 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:36.748 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.748 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.748 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.7", 2024-09-10T10:16:36.748 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.748 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.748 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.748 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T10:16:36.748 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.748 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.748 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm_log_destination": { 2024-09-10T10:16:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm_log_destination", 2024-09-10T10:16:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: "file", 2024-09-10T10:16:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: "file,syslog", 2024-09-10T10:16:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: "syslog" 2024-09-10T10:16:36.749 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.750 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T10:16:36.750 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.750 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.750 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.750 INFO:teuthology.orchestra.run.smithi050.stdout: "cgroups_split": { 2024-09-10T10:16:36.750 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cgroups_split", 2024-09-10T10:16:36.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.750 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.750 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.750 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.750 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.750 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.751 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.751 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T10:16:36.751 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.751 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.751 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.751 INFO:teuthology.orchestra.run.smithi050.stdout: "config_checks_enabled": { 2024-09-10T10:16:36.751 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_checks_enabled", 2024-09-10T10:16:36.751 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.751 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.751 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.751 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.751 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.752 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.752 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.752 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T10:16:36.752 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.752 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.752 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.752 INFO:teuthology.orchestra.run.smithi050.stdout: "config_dashboard": { 2024-09-10T10:16:36.752 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_dashboard", 2024-09-10T10:16:36.752 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.752 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.752 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.752 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.753 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.753 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.753 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.753 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T10:16:36.753 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.753 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.753 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.753 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_alertmanager": { 2024-09-10T10:16:36.753 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_alertmanager", 2024-09-10T10:16:36.753 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.753 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.753 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.754 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T10:16:36.754 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.754 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.754 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.754 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-09-10T10:16:36.754 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.754 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.754 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.754 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_base": { 2024-09-10T10:16:36.754 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_base", 2024-09-10T10:16:36.754 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.754 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Container image name, without the tag", 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_elasticsearch": { 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_elasticsearch", 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.755 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "elasticsearch container image", 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_grafana": { 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_grafana", 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.756 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T10:16:36.757 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.757 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.757 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.757 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-09-10T10:16:36.757 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.757 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.757 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.757 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_haproxy": { 2024-09-10T10:16:36.757 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_haproxy", 2024-09-10T10:16:36.757 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.757 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.757 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "HAproxy container image", 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_agent": { 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_agent", 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.758 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.759 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T10:16:36.759 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.759 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.759 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.759 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger agent container image", 2024-09-10T10:16:36.759 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.759 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.759 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.759 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_collector": { 2024-09-10T10:16:36.759 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_collector", 2024-09-10T10:16:36.759 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.760 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.760 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.760 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T10:16:36.760 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.760 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.760 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.760 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger collector container image", 2024-09-10T10:16:36.760 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.760 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.760 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.760 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_query": { 2024-09-10T10:16:36.760 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_query", 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger query container image", 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_keepalived": { 2024-09-10T10:16:36.761 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_keepalived", 2024-09-10T10:16:36.762 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.762 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.762 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.762 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T10:16:36.762 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.762 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.762 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.762 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Keepalived container image", 2024-09-10T10:16:36.762 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.762 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.762 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.762 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_loki": { 2024-09-10T10:16:36.763 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_loki", 2024-09-10T10:16:36.763 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.763 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.763 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.763 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T10:16:36.763 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.763 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.763 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.763 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Loki container image", 2024-09-10T10:16:36.763 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.763 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.763 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.764 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_node_exporter": { 2024-09-10T10:16:36.764 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_node_exporter", 2024-09-10T10:16:36.764 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.764 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.764 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.764 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T10:16:36.764 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.764 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.764 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.764 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-09-10T10:16:36.764 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.764 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.764 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nvmeof": { 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nvmeof", 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nvme-of container image", 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.765 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_prometheus": { 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_prometheus", 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_promtail": { 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_promtail", 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Promtail container image", 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_samba": { 2024-09-10T10:16:36.767 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_samba", 2024-09-10T10:16:36.768 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.768 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.768 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.768 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T10:16:36.768 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.768 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.768 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.768 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Samba/SMB container image", 2024-09-10T10:16:36.768 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.768 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.768 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.768 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_snmp_gateway": { 2024-09-10T10:16:36.769 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_snmp_gateway", 2024-09-10T10:16:36.769 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.769 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.769 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.769 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T10:16:36.769 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.769 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.769 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.769 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SNMP Gateway container image", 2024-09-10T10:16:36.769 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.769 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.769 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.770 INFO:teuthology.orchestra.run.smithi050.stdout: "container_init": { 2024-09-10T10:16:36.770 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_init", 2024-09-10T10:16:36.770 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.770 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.770 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.770 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.770 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.770 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.770 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.770 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T10:16:36.770 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.770 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.770 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: "daemon_cache_timeout": { 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "daemon_cache_timeout", 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: "default_cephadm_command_timeout": { 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "900", 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.773 INFO:teuthology.orchestra.run.smithi050.stdout: "default_registry": { 2024-09-10T10:16:36.773 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_registry", 2024-09-10T10:16:36.773 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.773 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.773 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.773 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io", 2024-09-10T10:16:36.773 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.773 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.773 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.773 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T10:16:36.773 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.773 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.773 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.774 INFO:teuthology.orchestra.run.smithi050.stdout: "device_cache_timeout": { 2024-09-10T10:16:36.774 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_cache_timeout", 2024-09-10T10:16:36.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.774 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.774 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.774 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1800", 2024-09-10T10:16:36.774 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.774 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.774 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.774 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache device inventory", 2024-09-10T10:16:36.774 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.774 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: "device_enhanced_scan": { 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_enhanced_scan", 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.775 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: "facts_cache_timeout": { 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "facts_cache_timeout", 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache host facts data", 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.777 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.777 INFO:teuthology.orchestra.run.smithi050.stdout: "grafana_dashboards_path": { 2024-09-10T10:16:36.777 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "grafana_dashboards_path", 2024-09-10T10:16:36.777 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.777 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.777 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.777 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T10:16:36.777 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.777 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.777 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.777 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T10:16:36.777 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "host_check_interval": { 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "host_check_interval", 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to perform a host check", 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.778 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.779 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.779 INFO:teuthology.orchestra.run.smithi050.stdout: "hw_monitoring": { 2024-09-10T10:16:36.779 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hw_monitoring", 2024-09-10T10:16:36.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.779 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.779 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.779 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.779 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.779 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.779 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.779 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T10:16:36.779 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.780 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.780 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.780 INFO:teuthology.orchestra.run.smithi050.stdout: "inventory_list_all": { 2024-09-10T10:16:36.780 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "inventory_list_all", 2024-09-10T10:16:36.780 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.780 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.780 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.780 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.780 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.780 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.780 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.780 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T10:16:36.781 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.781 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.781 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.781 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.781 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.781 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.781 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.781 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.781 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.781 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.781 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.781 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.782 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.782 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.782 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.782 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.782 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.782 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.782 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.782 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.782 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.782 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.782 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.782 INFO:teuthology.orchestra.run.smithi050.stdout: "log_refresh_metadata": { 2024-09-10T10:16:36.783 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_refresh_metadata", 2024-09-10T10:16:36.783 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.783 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.783 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.783 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.783 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.783 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.783 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.783 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T10:16:36.783 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.783 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.783 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.784 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.784 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.784 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.784 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.784 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.784 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.784 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.784 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.784 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T10:16:36.784 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.784 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.784 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.785 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.785 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.785 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.785 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.785 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.785 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.785 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.785 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.785 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.785 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.785 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.785 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.786 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.787 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.787 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.787 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.787 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.787 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.787 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.787 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.787 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.787 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T10:16:36.787 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T10:16:36.787 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.787 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.788 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.788 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.788 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.788 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.788 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.788 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T10:16:36.788 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.788 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.788 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.788 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T10:16:36.788 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T10:16:36.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.789 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.789 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.789 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "*", 2024-09-10T10:16:36.789 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.789 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.789 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.789 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T10:16:36.789 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.789 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.789 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.789 INFO:teuthology.orchestra.run.smithi050.stdout: "max_count_per_host": { 2024-09-10T10:16:36.789 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_count_per_host", 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of daemons per service per host", 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd_draining_count": { 2024-09-10T10:16:36.790 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_osd_draining_count", 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: "migration_current": { 2024-09-10T10:16:36.791 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "migration_current", 2024-09-10T10:16:36.792 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.792 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.792 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.792 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.792 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.792 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.792 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.792 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "internal - do not modify", 2024-09-10T10:16:36.792 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.792 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.792 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.792 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-09-10T10:16:36.793 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-09-10T10:16:36.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.793 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.793 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "root", 2024-09-10T10:16:36.793 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.793 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.793 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.793 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm-package", 2024-09-10T10:16:36.793 INFO:teuthology.orchestra.run.smithi050.stdout: "root" 2024-09-10T10:16:36.793 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.793 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T10:16:36.793 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: "oob_default_addr": { 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "oob_default_addr", 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "169.254.1.1", 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T10:16:36.794 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.795 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.795 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.795 INFO:teuthology.orchestra.run.smithi050.stdout: "prometheus_alerts_path": { 2024-09-10T10:16:36.795 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus_alerts_path", 2024-09-10T10:16:36.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.795 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.795 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.795 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T10:16:36.795 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.795 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.795 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.795 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T10:16:36.796 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.796 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.796 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.796 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_insecure": { 2024-09-10T10:16:36.796 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_insecure", 2024-09-10T10:16:36.796 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.796 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.796 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.796 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.796 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.797 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.797 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.797 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T10:16:36.797 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.797 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.797 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.797 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_password": { 2024-09-10T10:16:36.797 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_password", 2024-09-10T10:16:36.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.797 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.797 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.797 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.798 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.798 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.798 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.798 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T10:16:36.798 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.798 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.798 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.798 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_url": { 2024-09-10T10:16:36.798 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_url", 2024-09-10T10:16:36.798 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.798 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.798 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_username": { 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_username", 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.799 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.800 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.800 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.800 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.800 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.800 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T10:16:36.800 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.800 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.800 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.800 INFO:teuthology.orchestra.run.smithi050.stdout: "secure_monitoring_stack": { 2024-09-10T10:16:36.800 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secure_monitoring_stack", 2024-09-10T10:16:36.800 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: "service_discovery_port": { 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "service_discovery_port", 2024-09-10T10:16:36.801 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.802 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.802 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.802 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8765", 2024-09-10T10:16:36.802 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.802 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.802 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.802 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "cephadm service discovery port", 2024-09-10T10:16:36.802 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.802 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.802 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.802 INFO:teuthology.orchestra.run.smithi050.stdout: "ssh_config_file": { 2024-09-10T10:16:36.802 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssh_config_file", 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: "use_agent": { 2024-09-10T10:16:36.803 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_agent", 2024-09-10T10:16:36.804 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.804 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.804 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.804 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.804 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.804 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.804 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.804 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T10:16:36.804 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.804 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.804 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: "use_repo_digest": { 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_repo_digest", 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_failed_host_check": { 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_failed_host_check", 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_daemons": { 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_daemons", 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_hosts": { 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_hosts", 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.808 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.809 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.809 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crash", 2024-09-10T10:16:36.809 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.809 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.809 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.809 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.809 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.809 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.809 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.809 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.809 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.810 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.810 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.810 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.810 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.810 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.810 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.810 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.810 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.810 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.810 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.810 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.810 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.810 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.811 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.812 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.812 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.812 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.812 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.812 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.812 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.812 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.812 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.812 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.812 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.812 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.813 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: "retain_interval": { 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retain_interval", 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.814 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "31536000", 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_recent_interval": { 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_recent_interval", 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.815 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.816 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.816 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1209600", 2024-09-10T10:16:36.816 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.816 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.816 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.816 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T10:16:36.816 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.816 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.816 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dashboard", 2024-09-10T10:16:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T10:16:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T10:16:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.819 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.819 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.819 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.819 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.819 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T10:16:36.819 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T10:16:36.819 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.819 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.819 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.819 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.819 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.819 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_ENABLED": { 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.820 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T10:16:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T10:16:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.821 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.822 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.823 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.823 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.823 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.823 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.823 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.823 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.823 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T10:16:36.823 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T10:16:36.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.823 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.823 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.824 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.824 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.824 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.824 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.824 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.824 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.824 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.824 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.824 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T10:16:36.824 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T10:16:36.824 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.824 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.825 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.826 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.827 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.827 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.827 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.827 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.827 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.827 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.827 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.827 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.827 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.827 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T10:16:36.827 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T10:16:36.827 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.828 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.828 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.828 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.828 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.828 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.828 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.828 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.828 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.828 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.828 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.828 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T10:16:36.828 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T10:16:36.829 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.829 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.829 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.829 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.829 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.829 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.829 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.829 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.829 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.829 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.829 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.829 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.830 INFO:teuthology.orchestra.run.smithi050.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.831 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T10:16:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T10:16:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-09-10T10:16:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_URL": { 2024-09-10T10:16:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_URL", 2024-09-10T10:16:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.834 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T10:16:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T10:16:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-09-10T10:16:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.835 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.836 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T10:16:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T10:16:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.837 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.838 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.839 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.840 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.841 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.842 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T10:16:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T10:16:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.843 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.844 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.845 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.846 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.847 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.848 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.849 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.849 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.849 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.849 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T10:16:36.849 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T10:16:36.849 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.849 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.849 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.849 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.849 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.849 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.849 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.850 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.850 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.850 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.850 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.850 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T10:16:36.850 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T10:16:36.850 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.850 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.850 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.850 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T10:16:36.850 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:36.851 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8", 2024-09-10T10:16:36.852 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "45", 2024-09-10T10:16:36.853 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.854 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.854 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.854 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.854 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.854 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.854 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.854 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T10:16:36.854 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T10:16:36.854 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.854 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.854 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.854 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.855 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-09-10T10:16:36.856 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.856 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.856 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.856 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.856 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.856 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.856 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.856 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T10:16:36.856 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T10:16:36.856 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.856 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.856 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.858 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.858 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.858 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.858 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.858 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.858 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.858 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.858 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.858 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T10:16:36.858 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T10:16:36.858 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T10:16:36.859 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T10:16:36.860 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.861 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.861 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.861 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-09-10T10:16:36.861 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.861 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.861 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.861 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.861 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.861 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.861 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.861 INFO:teuthology.orchestra.run.smithi050.stdout: "cross_origin_url": { 2024-09-10T10:16:36.861 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cross_origin_url", 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: "crt_file": { 2024-09-10T10:16:36.862 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crt_file", 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: "debug": { 2024-09-10T10:16:36.863 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "debug", 2024-09-10T10:16:36.864 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.864 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.864 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.864 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.864 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.864 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.864 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.864 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable/disable debug options", 2024-09-10T10:16:36.864 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.864 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.864 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: "jwt_token_ttl": { 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "jwt_token_ttl", 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "28800", 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.865 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.866 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.867 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.868 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.869 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.869 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.869 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.869 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.869 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.869 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.869 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.869 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.869 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.869 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.869 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.870 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.870 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.870 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.870 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.870 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.870 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.870 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.870 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.870 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.870 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.870 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.870 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.870 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.871 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.872 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.872 INFO:teuthology.orchestra.run.smithi050.stdout: "motd": { 2024-09-10T10:16:36.872 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "motd", 2024-09-10T10:16:36.872 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.872 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.872 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.872 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.872 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.872 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.872 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.872 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "The message of the day", 2024-09-10T10:16:36.872 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect_resolve_ip_addr": { 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.873 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.874 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8080", 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.876 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.876 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.876 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-09-10T10:16:36.876 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-09-10T10:16:36.876 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.876 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.876 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.876 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.876 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.876 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.876 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.876 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl_server_port": { 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl_server_port", 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8443", 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.877 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.878 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.878 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.878 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.878 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-09-10T10:16:36.878 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-09-10T10:16:36.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.878 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.878 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.878 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "redirect", 2024-09-10T10:16:36.878 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.878 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect" 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.879 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: "url_prefix": { 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url_prefix", 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.880 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.881 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.881 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.881 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.881 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.881 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.881 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.881 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.881 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.881 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_monitoring": { 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_monitoring", 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "monitor device health metrics", 2024-09-10T10:16:36.882 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.883 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.884 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.884 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.884 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.884 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.884 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.884 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.884 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.884 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.884 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.884 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.884 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.884 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.885 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: "mark_out_threshold": { 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mark_out_threshold", 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2419200", 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": { 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_name", 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "device_health_metrics", 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.889 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: "retention_period": { 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retention_period", 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15552000", 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.890 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain device health metrics", 2024-09-10T10:16:36.891 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.891 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.891 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.891 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_frequency": { 2024-09-10T10:16:36.891 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_frequency", 2024-09-10T10:16:36.891 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.891 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.891 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.891 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-09-10T10:16:36.891 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.891 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.892 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.892 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T10:16:36.892 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.892 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.892 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.892 INFO:teuthology.orchestra.run.smithi050.stdout: "self_heal": { 2024-09-10T10:16:36.892 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "self_heal", 2024-09-10T10:16:36.892 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.892 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.892 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.892 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.893 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:36.894 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.894 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.894 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.894 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T10:16:36.894 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.894 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.894 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.894 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_threshold": { 2024-09-10T10:16:36.894 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_threshold", 2024-09-10T10:16:36.894 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.894 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.894 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7257600", 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "diskprediction_local", 2024-09-10T10:16:36.895 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.896 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.897 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.898 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.899 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.900 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "predict_interval": { 2024-09-10T10:16:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predict_interval", 2024-09-10T10:16:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-09-10T10:16:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.901 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "predictor_model": { 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predictor_model", 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "prophetstor", 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.902 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.903 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "influx", 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": false, 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "influxdb python module not found", 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.904 INFO:teuthology.orchestra.run.smithi050.stdout: "batch_size": { 2024-09-10T10:16:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "batch_size", 2024-09-10T10:16:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5000", 2024-09-10T10:16:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T10:16:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "database": { 2024-09-10T10:16:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "database", 2024-09-10T10:16:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "ceph", 2024-09-10T10:16:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T10:16:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.906 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": { 2024-09-10T10:16:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hostname", 2024-09-10T10:16:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server hostname", 2024-09-10T10:16:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.907 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "30", 2024-09-10T10:16:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "5", 2024-09-10T10:16:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T10:16:36.908 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.909 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.910 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.911 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.912 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.912 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.912 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.912 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.912 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.912 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.912 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.912 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.912 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.912 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.912 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.912 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.912 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.913 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.913 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.913 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.913 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.913 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.913 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.913 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.913 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.913 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.913 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.913 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.913 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.914 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.914 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.914 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.914 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.914 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.914 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.914 INFO:teuthology.orchestra.run.smithi050.stdout: "password": { 2024-09-10T10:16:36.914 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "password", 2024-09-10T10:16:36.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.914 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.914 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.914 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "password of InfluxDB server user", 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: "port": { 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "port", 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.915 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8086", 2024-09-10T10:16:36.916 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.916 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.916 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.916 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server port", 2024-09-10T10:16:36.916 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.916 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.916 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.916 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-09-10T10:16:36.916 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-09-10T10:16:36.916 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.916 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.916 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.917 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "false", 2024-09-10T10:16:36.917 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.917 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.917 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.917 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T10:16:36.917 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.917 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.917 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.917 INFO:teuthology.orchestra.run.smithi050.stdout: "threads": { 2024-09-10T10:16:36.917 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threads", 2024-09-10T10:16:36.917 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.917 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "32", 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: "username": { 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "username", 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.918 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.919 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.919 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.919 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.919 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.919 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.919 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "username of InfluxDB server user", 2024-09-10T10:16:36.919 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.919 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.919 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.919 INFO:teuthology.orchestra.run.smithi050.stdout: "verify_ssl": { 2024-09-10T10:16:36.919 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "verify_ssl", 2024-09-10T10:16:36.919 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.920 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.920 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.920 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "true", 2024-09-10T10:16:36.920 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.920 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.920 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.920 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T10:16:36.920 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.920 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.920 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.920 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.920 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "insights", 2024-09-10T10:16:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.921 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.923 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.923 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.923 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.923 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.923 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.923 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.923 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.923 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.923 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.923 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.923 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.923 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.923 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.924 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.924 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.924 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.924 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.924 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.924 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.924 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.924 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.924 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.924 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.924 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.924 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.925 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.925 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.925 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.925 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.925 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.925 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.925 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.925 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.925 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.925 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.925 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.925 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.926 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "iostat", 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.927 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.928 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.929 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.929 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.929 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.929 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.929 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.929 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.929 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.929 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.929 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.929 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.929 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.930 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.931 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "k8sevents", 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_event_retention_days": { 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ceph_event_retention_days", 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.932 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7", 2024-09-10T10:16:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T10:16:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: "config_check_secs": { 2024-09-10T10:16:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_check_secs", 2024-09-10T10:16:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.933 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.934 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.934 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:36.934 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "10", 2024-09-10T10:16:36.934 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.934 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.934 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T10:16:36.934 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.934 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.934 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.934 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.934 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.934 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.935 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.935 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.935 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.935 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.935 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.935 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.935 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.935 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.935 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.935 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.935 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.935 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.936 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.937 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.937 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.937 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.937 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.937 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.937 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.937 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.937 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.937 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.937 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.937 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.939 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.939 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.939 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.939 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.939 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.939 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.939 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.939 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.939 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.939 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.939 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.939 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.939 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.940 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.940 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.940 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "localpool", 2024-09-10T10:16:36.940 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.940 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.940 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.940 INFO:teuthology.orchestra.run.smithi050.stdout: "failure_domain": { 2024-09-10T10:16:36.940 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "failure_domain", 2024-09-10T10:16:36.940 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.940 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.940 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "host", 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "failure domain for any created local pool", 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.941 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.942 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.943 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.944 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.944 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.944 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.944 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.944 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.944 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.944 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.944 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.944 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.944 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.944 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.944 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.945 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.945 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.945 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.945 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.945 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.945 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.945 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.945 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.945 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.945 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.945 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": { 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_size", 2024-09-10T10:16:36.946 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default min_size for any created local pool", 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: "num_rep": { 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "num_rep", 2024-09-10T10:16:36.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.948 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.948 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.948 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3", 2024-09-10T10:16:36.948 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.948 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.948 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.948 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default replica count for any created local pool", 2024-09-10T10:16:36.948 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.948 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.948 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.948 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": { 2024-09-10T10:16:36.948 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_num", 2024-09-10T10:16:36.949 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:36.949 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.949 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.949 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "128", 2024-09-10T10:16:36.949 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.949 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.949 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.949 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T10:16:36.949 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.949 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.949 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.950 INFO:teuthology.orchestra.run.smithi050.stdout: "prefix": { 2024-09-10T10:16:36.950 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prefix", 2024-09-10T10:16:36.950 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.950 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.950 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.950 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.950 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.950 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.950 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.950 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name prefix for any created local pool", 2024-09-10T10:16:36.950 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.950 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.950 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: "subtree": { 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "subtree", 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "rack", 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.952 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.952 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.952 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mds_autoscaler", 2024-09-10T10:16:36.952 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.952 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.952 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.952 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.952 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.952 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.952 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.952 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.953 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.954 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.954 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.954 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.954 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.954 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.954 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.954 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.954 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.954 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.954 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.954 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.954 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.955 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.956 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.956 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.956 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.956 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.956 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.956 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.956 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.956 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.956 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.956 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.956 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirroring", 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.958 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.959 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.960 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.960 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.960 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.960 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.960 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.960 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.960 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.960 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.960 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.960 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.960 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.960 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.961 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.962 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "nfs", 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.963 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.964 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.965 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.965 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.965 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.965 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.965 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.965 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.965 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.965 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.965 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.965 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.965 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.965 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.966 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.968 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.968 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.968 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.968 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.968 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.968 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.968 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.968 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.968 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.968 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.969 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-09-10T10:16:36.969 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.969 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.969 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.969 INFO:teuthology.orchestra.run.smithi050.stdout: "fail_fs": { 2024-09-10T10:16:36.969 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "fail_fs", 2024-09-10T10:16:36.969 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.969 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.969 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.969 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.969 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.969 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.970 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.971 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.972 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.973 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.973 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.973 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.973 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.973 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.973 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.973 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.973 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.973 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.973 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.973 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.974 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.975 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.975 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.975 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.975 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.975 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.975 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.975 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.975 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator": { 2024-09-10T10:16:36.975 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-09-10T10:16:36.975 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.975 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.975 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: "rook", 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: "test_orchestrator" 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Orchestrator backend", 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.977 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_perf_query", 2024-09-10T10:16:36.977 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.977 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.977 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.977 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.977 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.977 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.977 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.977 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.977 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.978 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.978 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.978 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.978 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.978 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.978 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.978 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.978 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.978 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.978 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.978 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.978 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.978 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.979 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.979 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.979 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.979 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.979 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.979 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.979 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.979 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.979 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.979 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.979 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.979 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.980 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.981 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.981 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.981 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.981 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.981 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.981 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.981 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.981 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.981 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.981 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.981 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.981 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_support", 2024-09-10T10:16:36.982 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.983 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.984 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.985 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.986 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.986 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.986 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.986 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.986 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.986 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.986 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.986 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.986 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.986 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.986 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.986 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.986 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.987 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.988 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.988 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.988 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.988 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.988 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_autoscaler", 2024-09-10T10:16:36.988 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.988 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.988 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.988 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.988 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.988 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.989 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.990 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.991 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.991 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.991 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:36.991 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:36.991 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.991 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.991 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.991 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:36.991 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.991 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.991 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.991 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.992 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.992 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.992 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.992 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.992 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.992 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.992 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.992 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.992 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.992 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.992 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:36.993 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:36.993 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.993 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.993 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.993 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.993 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.993 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.993 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.993 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.993 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.993 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.993 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: "threshold": { 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threshold", 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1.0", 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "scaling threshold", 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.995 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "progress", 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_pg_recovery_event": { 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_pg_recovery_event", 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:36.996 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:36.997 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:36.998 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:36.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.001 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.002 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "max_completed_events": { 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_completed_events", 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.003 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "50", 2024-09-10T10:16:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "number of past completed events to remember", 2024-09-10T10:16:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.004 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-09-10T10:16:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long the module is going to sleep", 2024-09-10T10:16:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus", 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "cache": { 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cache", 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.006 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "exclude_perf_counters": { 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "exclude_perf_counters", 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.007 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T10:16:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T10:16:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.008 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.009 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.010 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.011 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.012 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools": { 2024-09-10T10:16:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools", 2024-09-10T10:16:37.013 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T10:16:37.014 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300", 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_interval": { 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_interval", 2024-09-10T10:16:37.015 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15.0", 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-09-10T10:16:37.016 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-09-10T10:16:37.017 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "9283", 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "stale_cache_strategy": { 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stale_cache_strategy", 2024-09-10T10:16:37.018 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "log", 2024-09-10T10:16:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-09-10T10:16:37.019 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-09-10T10:16:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "default", 2024-09-10T10:16:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "default", 2024-09-10T10:16:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "error" 2024-09-10T10:16:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.020 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.021 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2024-09-10T10:16:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.022 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.023 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.024 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.025 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.026 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_snap_create": { 2024-09-10T10:16:37.027 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_snap_create", 2024-09-10T10:16:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.028 INFO:teuthology.orchestra.run.smithi050.stdout: "mirror_snapshot_schedule": { 2024-09-10T10:16:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T10:16:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "trash_purge_schedule": { 2024-09-10T10:16:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "trash_purge_schedule", 2024-09-10T10:16:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.030 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "restful", 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_auth": { 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_auth", 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.031 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.032 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.033 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.034 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.035 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.036 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.037 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.038 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.039 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-09-10T10:16:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-09-10T10:16:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.040 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rgw", 2024-09-10T10:16:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.041 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.042 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.043 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.044 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.045 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rook", 2024-09-10T10:16:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.047 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.048 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.049 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.051 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "storage_class": { 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "storage_class", 2024-09-10T10:16:37.052 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "local", 2024-09-10T10:16:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T10:16:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "selftest", 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.054 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.055 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.057 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.058 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "roption1": { 2024-09-10T10:16:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption1", 2024-09-10T10:16:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.059 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "roption2": { 2024-09-10T10:16:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption2", 2024-09-10T10:16:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.060 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "xyz", 2024-09-10T10:16:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption1": { 2024-09-10T10:16:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption1", 2024-09-10T10:16:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.061 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption2": { 2024-09-10T10:16:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption2", 2024-09-10T10:16:37.062 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption3": { 2024-09-10T10:16:37.063 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption3", 2024-09-10T10:16:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption4": { 2024-09-10T10:16:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption4", 2024-09-10T10:16:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.065 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption5": { 2024-09-10T10:16:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption5", 2024-09-10T10:16:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.066 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption6": { 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption6", 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.067 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption7": { 2024-09-10T10:16:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption7", 2024-09-10T10:16:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-09-10T10:16:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "42", 2024-09-10T10:16:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.068 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "testkey": { 2024-09-10T10:16:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testkey", 2024-09-10T10:16:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.069 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "testlkey": { 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testlkey", 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.070 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "testnewline": { 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testnewline", 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.071 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2024-09-10T10:16:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_m_granularity": { 2024-09-10T10:16:37.072 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_m_granularity", 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "dump_on_update": { 2024-09-10T10:16:37.073 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dump_on_update", 2024-09-10T10:16:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "dump database to debug log on update", 2024-09-10T10:16:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.074 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.075 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.076 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.077 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.078 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.079 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stats", 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.081 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.082 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.083 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.084 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "status", 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.086 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.087 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.088 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.089 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.090 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telegraf", 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.091 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "address": { 2024-09-10T10:16:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "address", 2024-09-10T10:16:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T10:16:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.092 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15", 2024-09-10T10:16:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.093 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.094 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.095 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.096 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.097 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.098 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telemetry", 2024-09-10T10:16:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.099 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_basic": { 2024-09-10T10:16:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_basic", 2024-09-10T10:16:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T10:16:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.100 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_crash": { 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_crash", 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.101 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_device": { 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_device", 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.102 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_ident": { 2024-09-10T10:16:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_ident", 2024-09-10T10:16:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T10:16:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.103 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_perf": { 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_perf", 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.104 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: "contact": { 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "contact", 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.105 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.106 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.106 INFO:teuthology.orchestra.run.smithi050.stdout: "description": { 2024-09-10T10:16:37.106 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "description", 2024-09-10T10:16:37.106 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.106 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.106 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.106 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.106 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.106 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.106 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.106 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.107 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.107 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.107 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.107 INFO:teuthology.orchestra.run.smithi050.stdout: "device_url": { 2024-09-10T10:16:37.107 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_url", 2024-09-10T10:16:37.107 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.107 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.107 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.107 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T10:16:37.107 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.107 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.107 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.108 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.108 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.108 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.108 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.108 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-09-10T10:16:37.108 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-09-10T10:16:37.108 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.108 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.108 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.108 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.108 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "24", 2024-09-10T10:16:37.109 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "8", 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: "last_opt_revision": { 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "last_opt_revision", 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1", 2024-09-10T10:16:37.110 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.111 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.111 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.111 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.111 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.111 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.111 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.111 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard": { 2024-09-10T10:16:37.111 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard", 2024-09-10T10:16:37.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.111 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.111 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.111 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.112 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.112 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.112 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.112 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.112 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.112 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.112 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.112 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard_description": { 2024-09-10T10:16:37.112 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard_description", 2024-09-10T10:16:37.112 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.112 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.112 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.113 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.113 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.113 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.113 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.113 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.113 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.113 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.113 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.113 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.113 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.113 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.113 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.114 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.114 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.114 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.114 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.114 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.114 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.114 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.114 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.114 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.114 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.114 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.114 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.114 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.115 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.116 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.116 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.116 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.116 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.116 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.116 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.116 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.116 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.116 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.116 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.116 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.116 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.117 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.118 INFO:teuthology.orchestra.run.smithi050.stdout: "organization": { 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "organization", 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.119 INFO:teuthology.orchestra.run.smithi050.stdout: "proxy": { 2024-09-10T10:16:37.120 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "proxy", 2024-09-10T10:16:37.120 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.120 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.120 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.120 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.120 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.120 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.120 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.120 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.120 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.120 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.120 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.121 INFO:teuthology.orchestra.run.smithi050.stdout: "url": { 2024-09-10T10:16:37.121 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url", 2024-09-10T10:16:37.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.121 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.121 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.121 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T10:16:37.121 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.121 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.121 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.121 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.121 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.121 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.122 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.122 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "test_orchestrator", 2024-09-10T10:16:37.122 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.122 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.122 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.122 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.122 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.122 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.123 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.124 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.125 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.126 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.126 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.126 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.126 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.126 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.126 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.126 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.126 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.126 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.126 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.126 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.126 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.127 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.127 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.127 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.127 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.127 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.127 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.127 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.127 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.127 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.127 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.128 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2024-09-10T10:16:37.128 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.128 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.128 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.128 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.128 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.128 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.128 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.128 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.128 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.128 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.131 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.131 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.131 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.131 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.131 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.131 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.131 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.131 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.131 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.131 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.131 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.131 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.132 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.132 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.132 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.132 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.132 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.132 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.132 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.132 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.132 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.132 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.132 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.133 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.133 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.133 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.133 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.133 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.133 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.133 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.133 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.133 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.133 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_clones": { 2024-09-10T10:16:37.133 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_clones", 2024-09-10T10:16:37.134 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.134 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.134 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.134 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4", 2024-09-10T10:16:37.134 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.134 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.134 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.134 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T10:16:37.134 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.134 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.134 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.134 INFO:teuthology.orchestra.run.smithi050.stdout: "periodic_async_work": { 2024-09-10T10:16:37.135 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "periodic_async_work", 2024-09-10T10:16:37.135 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.135 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.135 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.135 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.135 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.135 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.135 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.135 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Periodically check for async work", 2024-09-10T10:16:37.135 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.135 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.135 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.136 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_delay": { 2024-09-10T10:16:37.136 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_delay", 2024-09-10T10:16:37.136 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.136 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.136 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.136 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:37.136 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.136 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.136 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.136 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T10:16:37.136 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.136 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_no_wait": { 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.137 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.138 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.138 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.138 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.138 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix", 2024-09-10T10:16:37.138 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.138 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.138 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.138 INFO:teuthology.orchestra.run.smithi050.stdout: "discovery_interval": { 2024-09-10T10:16:37.138 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "discovery_interval", 2024-09-10T10:16:37.138 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:37.138 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.139 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.139 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "100", 2024-09-10T10:16:37.139 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.139 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.139 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.139 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.139 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.139 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.139 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.139 INFO:teuthology.orchestra.run.smithi050.stdout: "identifier": { 2024-09-10T10:16:37.139 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "identifier", 2024-09-10T10:16:37.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:37.140 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:37.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.141 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.141 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.141 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:37.141 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.141 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.141 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.141 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.141 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.141 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.141 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.141 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.142 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.142 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.142 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.142 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.142 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.142 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.142 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.142 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.142 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.142 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.142 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.142 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.143 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.143 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.143 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.143 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.143 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.143 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.143 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.143 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.143 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.143 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.143 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.143 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.144 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.145 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.145 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.145 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.145 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.145 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.145 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.145 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.145 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.145 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.145 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.145 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.145 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.145 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.146 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.146 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.146 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.146 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.146 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.146 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.146 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.146 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.146 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.146 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.147 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.147 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.147 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.147 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.147 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_host": { 2024-09-10T10:16:37.147 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_host", 2024-09-10T10:16:37.147 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.147 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.147 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.147 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.147 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.147 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.148 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.148 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.148 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.148 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.148 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.148 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_port": { 2024-09-10T10:16:37.148 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_port", 2024-09-10T10:16:37.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.148 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.148 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.148 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10051", 2024-09-10T10:16:37.148 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.149 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.149 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.149 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.149 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.149 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.149 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.149 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_sender": { 2024-09-10T10:16:37.149 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_sender", 2024-09-10T10:16:37.149 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.149 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.149 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.149 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T10:16:37.150 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.150 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.150 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.150 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.150 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.150 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.150 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.150 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.150 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.150 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.150 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-10T10:16:37.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.151 INFO:teuthology.orchestra.run.smithi050.stdout: "gid": 24119, 2024-09-10T10:16:37.151 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "y", 2024-09-10T10:16:37.151 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_features": 4540701547738038271, 2024-09-10T10:16:37.151 INFO:teuthology.orchestra.run.smithi050.stdout: "available_modules": [ 2024-09-10T10:16:37.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.151 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "alerts", 2024-09-10T10:16:37.151 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.151 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.151 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.151 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:37.151 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:37.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.152 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.152 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.152 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:37.152 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.152 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.152 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.152 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T10:16:37.152 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.152 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.152 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.152 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.153 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.153 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.153 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.153 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.153 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.153 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.153 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.153 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.153 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.153 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.153 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.153 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.154 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.154 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.154 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.154 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.154 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.154 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.154 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.154 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.154 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.154 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.154 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.154 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.155 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.156 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.156 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.156 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.156 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.156 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.156 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.156 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.156 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.156 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.156 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.156 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.156 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.156 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.157 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.157 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.157 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.157 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.157 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.157 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.157 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.157 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.157 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.157 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.157 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.157 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.158 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.158 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.158 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.158 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_destination": { 2024-09-10T10:16:37.158 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_destination", 2024-09-10T10:16:37.158 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.158 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.158 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.158 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.158 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.158 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.159 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.159 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email address to send alerts to", 2024-09-10T10:16:37.159 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.159 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.159 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.159 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_from_name": { 2024-09-10T10:16:37.159 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_from_name", 2024-09-10T10:16:37.159 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.159 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.159 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.159 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "Ceph", 2024-09-10T10:16:37.160 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.160 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.160 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.160 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email From: name", 2024-09-10T10:16:37.160 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.160 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.160 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.160 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_host": { 2024-09-10T10:16:37.160 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_host", 2024-09-10T10:16:37.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.160 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.161 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.161 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.161 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.161 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.161 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.161 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP server", 2024-09-10T10:16:37.161 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.161 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.161 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.161 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_password": { 2024-09-10T10:16:37.161 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_password", 2024-09-10T10:16:37.161 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Password to authenticate with", 2024-09-10T10:16:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_port": { 2024-09-10T10:16:37.162 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_port", 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "465", 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP port", 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_sender": { 2024-09-10T10:16:37.163 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_sender", 2024-09-10T10:16:37.164 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.164 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.164 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.164 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.164 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.164 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.164 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.164 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP envelope sender", 2024-09-10T10:16:37.164 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.164 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.164 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.164 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_ssl": { 2024-09-10T10:16:37.165 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_ssl", 2024-09-10T10:16:37.165 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.165 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.165 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.165 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.165 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.165 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.165 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.165 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T10:16:37.165 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.165 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.165 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_user": { 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_user", 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "User to authenticate as", 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "balancer", 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: "active": { 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "active", 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.167 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.168 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.168 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.168 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T10:16:37.168 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.168 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.168 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.168 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_time": { 2024-09-10T10:16:37.168 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_time", 2024-09-10T10:16:37.168 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.168 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.168 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.168 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0000", 2024-09-10T10:16:37.169 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.169 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.169 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.169 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T10:16:37.169 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T10:16:37.169 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.169 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.169 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_weekday": { 2024-09-10T10:16:37.169 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_weekday", 2024-09-10T10:16:37.169 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:37.169 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.169 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_max_iterations": { 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_max_iterations", 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.170 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "25", 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "250", 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_metrics": { 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_metrics", 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.171 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_step": { 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_step", 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.172 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.173 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.5", 2024-09-10T10:16:37.173 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0.001", 2024-09-10T10:16:37.173 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "0.999", 2024-09-10T10:16:37.173 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.173 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "aggressiveness of optimization", 2024-09-10T10:16:37.173 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T10:16:37.173 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.173 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.173 INFO:teuthology.orchestra.run.smithi050.stdout: "end_time": { 2024-09-10T10:16:37.173 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_time", 2024-09-10T10:16:37.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.173 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2359", 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: "end_weekday": { 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_weekday", 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:37.174 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.175 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.176 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.176 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.176 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.176 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.176 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.176 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.176 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.176 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.176 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.176 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.176 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.176 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.176 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.177 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.178 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.178 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.178 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.178 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.178 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.178 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.178 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.178 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.178 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.178 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.178 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.179 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.179 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.179 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.179 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.179 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.179 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.179 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.179 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.179 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.179 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.179 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.179 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.180 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.180 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.180 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.180 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.180 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.180 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.180 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.180 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.180 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.180 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.180 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.180 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.180 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.181 INFO:teuthology.orchestra.run.smithi050.stdout: "min_score": { 2024-09-10T10:16:37.181 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_score", 2024-09-10T10:16:37.181 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.181 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.181 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.181 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:37.181 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.181 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.181 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.181 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T10:16:37.181 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.181 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.182 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.182 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-09-10T10:16:37.182 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-09-10T10:16:37.182 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.182 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.182 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.182 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "upmap", 2024-09-10T10:16:37.182 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.182 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.182 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.182 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-compat", 2024-09-10T10:16:37.182 INFO:teuthology.orchestra.run.smithi050.stdout: "none", 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: "read", 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap", 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap-read" 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Balancer mode", 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_ids": { 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_ids", 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.183 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.184 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.184 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.184 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.184 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T10:16:37.184 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.184 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.184 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.184 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:37.184 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:37.184 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.184 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.184 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.185 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:37.185 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.185 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.185 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.185 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T10:16:37.185 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.185 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.185 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.185 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_deviation": { 2024-09-10T10:16:37.185 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_deviation", 2024-09-10T10:16:37.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.185 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_optimizations": { 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_optimizations", 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:37.186 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.187 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm", 2024-09-10T10:16:37.188 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.188 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.188 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.188 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_down_multiplier": { 2024-09-10T10:16:37.188 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_down_multiplier", 2024-09-10T10:16:37.188 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.188 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.188 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.188 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-09-10T10:16:37.188 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.188 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.188 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.188 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_refresh_rate": { 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_refresh_rate", 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "20", 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.189 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_starting_port": { 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_starting_port", 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4721", 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.190 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T10:16:37.191 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.191 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.191 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.191 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_ptrace": { 2024-09-10T10:16:37.191 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_ptrace", 2024-09-10T10:16:37.191 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.191 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.191 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.191 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.191 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.191 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.191 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.192 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T10:16:37.192 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T10:16:37.192 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.192 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.192 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_interval": { 2024-09-10T10:16:37.192 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_interval", 2024-09-10T10:16:37.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.192 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.192 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.192 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:37.192 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.193 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.193 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.193 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T10:16:37.193 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.193 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.193 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.193 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_memory_target_ratio": { 2024-09-10T10:16:37.193 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T10:16:37.193 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.193 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.193 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.193 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.7", 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm_log_destination": { 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm_log_destination", 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.194 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: "file", 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: "file,syslog", 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: "syslog" 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: "cgroups_split": { 2024-09-10T10:16:37.195 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cgroups_split", 2024-09-10T10:16:37.196 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.196 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.196 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.196 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.196 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.196 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.196 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.196 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T10:16:37.196 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.196 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.196 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.196 INFO:teuthology.orchestra.run.smithi050.stdout: "config_checks_enabled": { 2024-09-10T10:16:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_checks_enabled", 2024-09-10T10:16:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T10:16:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: "config_dashboard": { 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_dashboard", 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.199 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_alertmanager": { 2024-09-10T10:16:37.199 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_alertmanager", 2024-09-10T10:16:37.199 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.199 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.199 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.199 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T10:16:37.199 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.199 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.199 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.199 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-09-10T10:16:37.199 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.199 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.199 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_base": { 2024-09-10T10:16:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_base", 2024-09-10T10:16:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T10:16:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Container image name, without the tag", 2024-09-10T10:16:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.200 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_elasticsearch": { 2024-09-10T10:16:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_elasticsearch", 2024-09-10T10:16:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T10:16:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "elasticsearch container image", 2024-09-10T10:16:37.201 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_grafana": { 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_grafana", 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-09-10T10:16:37.202 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_haproxy": { 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_haproxy", 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "HAproxy container image", 2024-09-10T10:16:37.203 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_agent": { 2024-09-10T10:16:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_agent", 2024-09-10T10:16:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T10:16:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.204 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger agent container image", 2024-09-10T10:16:37.205 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.205 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.205 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.205 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_collector": { 2024-09-10T10:16:37.205 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_collector", 2024-09-10T10:16:37.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.205 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.205 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.205 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T10:16:37.205 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.205 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.205 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger collector container image", 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_query": { 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_query", 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.206 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger query container image", 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_keepalived": { 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_keepalived", 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.207 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Keepalived container image", 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_loki": { 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_loki", 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.208 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Loki container image", 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_node_exporter": { 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_node_exporter", 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.209 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nvmeof": { 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nvmeof", 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.210 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nvme-of container image", 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_prometheus": { 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_prometheus", 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.211 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_promtail": { 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_promtail", 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.212 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Promtail container image", 2024-09-10T10:16:37.213 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.213 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.213 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.213 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_samba": { 2024-09-10T10:16:37.213 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_samba", 2024-09-10T10:16:37.213 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.213 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.213 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.213 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T10:16:37.213 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.213 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.213 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.214 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Samba/SMB container image", 2024-09-10T10:16:37.214 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.214 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.214 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.214 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_snmp_gateway": { 2024-09-10T10:16:37.214 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_snmp_gateway", 2024-09-10T10:16:37.214 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.214 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.214 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.214 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T10:16:37.214 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.214 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SNMP Gateway container image", 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: "container_init": { 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_init", 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.215 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.216 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.216 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T10:16:37.216 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.216 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.216 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.216 INFO:teuthology.orchestra.run.smithi050.stdout: "daemon_cache_timeout": { 2024-09-10T10:16:37.216 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "daemon_cache_timeout", 2024-09-10T10:16:37.216 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.216 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.216 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.216 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:37.216 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.217 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.217 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.217 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T10:16:37.217 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.217 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.217 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.217 INFO:teuthology.orchestra.run.smithi050.stdout: "default_cephadm_command_timeout": { 2024-09-10T10:16:37.217 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T10:16:37.217 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.217 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.217 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.217 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "900", 2024-09-10T10:16:37.218 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.218 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.218 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.218 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T10:16:37.218 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.218 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.218 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.218 INFO:teuthology.orchestra.run.smithi050.stdout: "default_registry": { 2024-09-10T10:16:37.218 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_registry", 2024-09-10T10:16:37.218 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.218 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.218 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.219 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io", 2024-09-10T10:16:37.219 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.219 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.219 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.219 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T10:16:37.219 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.219 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.219 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.219 INFO:teuthology.orchestra.run.smithi050.stdout: "device_cache_timeout": { 2024-09-10T10:16:37.219 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_cache_timeout", 2024-09-10T10:16:37.219 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.219 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1800", 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache device inventory", 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: "device_enhanced_scan": { 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_enhanced_scan", 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.220 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: "facts_cache_timeout": { 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "facts_cache_timeout", 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.221 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache host facts data", 2024-09-10T10:16:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: "grafana_dashboards_path": { 2024-09-10T10:16:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "grafana_dashboards_path", 2024-09-10T10:16:37.222 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: "host_check_interval": { 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "host_check_interval", 2024-09-10T10:16:37.223 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to perform a host check", 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: "hw_monitoring": { 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hw_monitoring", 2024-09-10T10:16:37.224 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: "inventory_list_all": { 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "inventory_list_all", 2024-09-10T10:16:37.225 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.226 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.227 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.227 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.227 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.227 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.227 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.227 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.227 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.227 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.227 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.227 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.227 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.227 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.227 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: "log_refresh_metadata": { 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_refresh_metadata", 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.228 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.229 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T10:16:37.229 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.229 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.229 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.229 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.229 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.229 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.229 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.229 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.229 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.229 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.230 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.232 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.233 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T10:16:37.233 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T10:16:37.233 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.233 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.233 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.233 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.233 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.233 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.233 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.233 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T10:16:37.233 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.233 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "*", 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.234 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: "max_count_per_host": { 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_count_per_host", 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of daemons per service per host", 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.235 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.236 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.236 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd_draining_count": { 2024-09-10T10:16:37.236 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_osd_draining_count", 2024-09-10T10:16:37.236 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.236 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.236 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.236 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.236 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.236 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.236 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.236 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T10:16:37.236 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: "migration_current": { 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "migration_current", 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "internal - do not modify", 2024-09-10T10:16:37.237 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "root", 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm-package", 2024-09-10T10:16:37.238 INFO:teuthology.orchestra.run.smithi050.stdout: "root" 2024-09-10T10:16:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T10:16:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: "oob_default_addr": { 2024-09-10T10:16:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "oob_default_addr", 2024-09-10T10:16:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "169.254.1.1", 2024-09-10T10:16:37.239 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: "prometheus_alerts_path": { 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus_alerts_path", 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T10:16:37.240 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.241 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.241 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.241 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T10:16:37.241 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.241 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.241 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.241 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_insecure": { 2024-09-10T10:16:37.241 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_insecure", 2024-09-10T10:16:37.241 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.241 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.241 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.241 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T10:16:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_password": { 2024-09-10T10:16:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_password", 2024-09-10T10:16:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.242 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_url": { 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_url", 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.243 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.244 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.244 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.244 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.244 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.244 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.244 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T10:16:37.244 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.244 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.244 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.244 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_username": { 2024-09-10T10:16:37.244 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_username", 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: "secure_monitoring_stack": { 2024-09-10T10:16:37.245 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secure_monitoring_stack", 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: "service_discovery_port": { 2024-09-10T10:16:37.246 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "service_discovery_port", 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8765", 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "cephadm service discovery port", 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: "ssh_config_file": { 2024-09-10T10:16:37.247 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssh_config_file", 2024-09-10T10:16:37.248 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.248 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.248 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.248 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.248 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.248 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.248 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.248 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T10:16:37.248 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.248 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.248 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.248 INFO:teuthology.orchestra.run.smithi050.stdout: "use_agent": { 2024-09-10T10:16:37.249 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_agent", 2024-09-10T10:16:37.249 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.249 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.249 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.249 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.249 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.249 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.249 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.249 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T10:16:37.249 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.249 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.249 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.250 INFO:teuthology.orchestra.run.smithi050.stdout: "use_repo_digest": { 2024-09-10T10:16:37.250 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_repo_digest", 2024-09-10T10:16:37.250 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.250 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.250 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.250 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.250 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.250 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.250 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.250 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T10:16:37.250 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.250 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.250 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_failed_host_check": { 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_failed_host_check", 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.251 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_daemons": { 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_daemons", 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.252 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.253 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_hosts": { 2024-09-10T10:16:37.253 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_hosts", 2024-09-10T10:16:37.253 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.253 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.253 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.253 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.253 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.253 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.253 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.253 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T10:16:37.253 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.253 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crash", 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.255 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.255 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.255 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.255 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.255 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.255 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.255 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.255 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.255 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.255 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.255 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.255 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.256 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.257 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.257 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.257 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.257 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.257 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.257 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.260 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.260 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.260 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.260 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.260 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.260 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.260 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.260 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.260 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.261 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.261 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.261 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.261 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.261 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.261 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.261 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.261 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.261 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.261 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.261 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.261 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: "retain_interval": { 2024-09-10T10:16:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retain_interval", 2024-09-10T10:16:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "31536000", 2024-09-10T10:16:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T10:16:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_recent_interval": { 2024-09-10T10:16:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_recent_interval", 2024-09-10T10:16:37.264 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.264 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.264 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.264 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1209600", 2024-09-10T10:16:37.264 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.264 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.264 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.264 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T10:16:37.264 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.264 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.264 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.264 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dashboard", 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.265 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.266 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.267 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.268 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.268 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.268 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.268 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.268 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.268 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.268 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_ENABLED": { 2024-09-10T10:16:37.268 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T10:16:37.268 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.268 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.268 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.268 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.269 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.270 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.271 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.272 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.272 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.272 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.272 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.272 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.272 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.272 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T10:16:37.272 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T10:16:37.272 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.272 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.272 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.273 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.273 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.273 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.273 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.273 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.273 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.273 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.273 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.273 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T10:16:37.273 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T10:16:37.273 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.273 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T10:16:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T10:16:37.274 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T10:16:37.275 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T10:16:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.276 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T10:16:37.277 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T10:16:37.277 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.277 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.277 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.277 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.277 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.277 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.277 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.277 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.277 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.277 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.277 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.280 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T10:16:37.280 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T10:16:37.280 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.280 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.280 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.280 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-09-10T10:16:37.280 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.280 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.280 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.280 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.280 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.281 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.281 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.281 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T10:16:37.281 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T10:16:37.281 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.281 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.281 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.281 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.281 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.281 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.281 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.281 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.282 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.282 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.282 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.282 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_URL": { 2024-09-10T10:16:37.282 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_URL", 2024-09-10T10:16:37.282 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.282 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.282 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.282 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.282 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.282 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.282 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.283 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.284 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.285 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.285 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.285 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.285 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.285 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T10:16:37.285 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T10:16:37.285 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.285 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.285 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.285 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.285 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.286 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.287 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.288 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T10:16:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T10:16:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.289 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.290 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.291 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.292 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T10:16:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T10:16:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.293 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.294 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.295 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.295 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.295 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.295 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.295 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.295 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.295 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.295 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T10:16:37.295 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T10:16:37.295 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.295 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.295 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.296 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.296 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.296 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.296 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.296 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.296 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.296 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.296 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.296 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T10:16:37.296 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T10:16:37.296 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.297 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.297 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.297 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.297 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.297 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.297 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.297 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.297 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.297 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.297 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.297 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T10:16:37.297 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T10:16:37.298 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.298 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.298 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.298 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.298 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.298 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.298 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.298 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.298 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.298 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.298 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.298 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T10:16:37.299 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T10:16:37.299 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.299 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.299 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.299 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T10:16:37.299 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.299 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.299 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.299 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.299 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.299 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.299 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.300 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T10:16:37.300 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T10:16:37.300 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.300 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.300 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.300 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.300 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.300 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.300 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.300 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.300 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.300 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.300 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T10:16:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T10:16:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8", 2024-09-10T10:16:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.301 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.302 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.302 INFO:teuthology.orchestra.run.smithi050.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T10:16:37.302 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T10:16:37.302 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.302 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.302 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.302 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "45", 2024-09-10T10:16:37.302 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.302 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.302 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.302 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T10:16:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T10:16:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.303 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.304 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.304 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.304 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.304 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.304 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T10:16:37.304 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T10:16:37.304 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.304 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.304 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.304 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-09-10T10:16:37.304 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.304 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.305 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.305 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.305 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.305 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.305 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.305 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T10:16:37.305 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T10:16:37.305 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.305 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.305 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.305 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.306 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.306 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.306 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.306 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.306 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.306 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.306 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.306 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T10:16:37.306 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T10:16:37.306 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.306 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.306 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.307 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.308 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:37.308 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.308 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.308 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.308 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.308 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.308 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.308 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.308 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T10:16:37.308 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T10:16:37.308 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.309 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.309 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.309 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.309 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.309 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.309 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.309 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.309 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.309 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.309 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.309 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T10:16:37.309 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T10:16:37.310 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.310 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.310 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.310 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-09-10T10:16:37.310 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.310 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.310 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.310 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.310 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.310 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.310 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.310 INFO:teuthology.orchestra.run.smithi050.stdout: "cross_origin_url": { 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cross_origin_url", 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "crt_file": { 2024-09-10T10:16:37.311 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crt_file", 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: "debug": { 2024-09-10T10:16:37.312 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "debug", 2024-09-10T10:16:37.313 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.313 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.313 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.313 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.313 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.313 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.313 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.313 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable/disable debug options", 2024-09-10T10:16:37.313 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.313 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.313 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.313 INFO:teuthology.orchestra.run.smithi050.stdout: "jwt_token_ttl": { 2024-09-10T10:16:37.314 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "jwt_token_ttl", 2024-09-10T10:16:37.314 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.314 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.314 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.314 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "28800", 2024-09-10T10:16:37.314 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.314 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.314 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.314 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.314 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.314 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.314 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.316 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.317 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.317 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.317 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.317 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.317 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.317 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.317 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.317 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.317 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.317 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.317 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.318 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.319 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.320 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "motd": { 2024-09-10T10:16:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "motd", 2024-09-10T10:16:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "The message of the day", 2024-09-10T10:16:37.321 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect_resolve_ip_addr": { 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.322 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-09-10T10:16:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-09-10T10:16:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-09-10T10:16:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.323 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8080", 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.324 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-09-10T10:16:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-09-10T10:16:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.325 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl_server_port": { 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl_server_port", 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8443", 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.326 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "redirect", 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.327 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect" 2024-09-10T10:16:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-09-10T10:16:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-09-10T10:16:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.328 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-09-10T10:16:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-09-10T10:16:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-09-10T10:16:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "url_prefix": { 2024-09-10T10:16:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url_prefix", 2024-09-10T10:16:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.329 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.330 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_monitoring": { 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_monitoring", 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "monitor device health metrics", 2024-09-10T10:16:37.331 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.332 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.333 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.334 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.335 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.336 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.337 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.337 INFO:teuthology.orchestra.run.smithi050.stdout: "mark_out_threshold": { 2024-09-10T10:16:37.337 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mark_out_threshold", 2024-09-10T10:16:37.337 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.337 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.337 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.337 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2419200", 2024-09-10T10:16:37.337 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.337 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.337 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.337 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T10:16:37.337 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": { 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_name", 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "device_health_metrics", 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.338 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: "retention_period": { 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retention_period", 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15552000", 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain device health metrics", 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.339 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_frequency": { 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_frequency", 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.340 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.341 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.341 INFO:teuthology.orchestra.run.smithi050.stdout: "self_heal": { 2024-09-10T10:16:37.341 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "self_heal", 2024-09-10T10:16:37.341 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.341 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.341 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.341 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.341 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.341 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.341 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.341 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.342 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_threshold": { 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_threshold", 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7257600", 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.343 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "diskprediction_local", 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.344 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.345 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.346 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.347 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.347 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.347 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.347 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.347 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.347 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.347 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.347 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.347 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.347 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.347 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.347 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.348 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: "predict_interval": { 2024-09-10T10:16:37.349 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predict_interval", 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "predictor_model": { 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predictor_model", 2024-09-10T10:16:37.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.351 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.351 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.351 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "prophetstor", 2024-09-10T10:16:37.351 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.351 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.351 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.351 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.351 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.351 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.351 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.351 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.352 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.353 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "influx", 2024-09-10T10:16:37.353 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": false, 2024-09-10T10:16:37.353 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "influxdb python module not found", 2024-09-10T10:16:37.353 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.353 INFO:teuthology.orchestra.run.smithi050.stdout: "batch_size": { 2024-09-10T10:16:37.353 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "batch_size", 2024-09-10T10:16:37.353 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.353 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.353 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.353 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5000", 2024-09-10T10:16:37.353 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: "database": { 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "database", 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "ceph", 2024-09-10T10:16:37.354 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.355 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.355 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.355 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T10:16:37.355 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.355 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.355 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.355 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": { 2024-09-10T10:16:37.355 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hostname", 2024-09-10T10:16:37.355 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.355 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.355 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.356 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.356 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.356 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.356 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server hostname", 2024-09-10T10:16:37.356 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.356 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.356 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.356 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:37.356 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:37.356 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.356 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.356 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "30", 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "5", 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.357 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.358 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.359 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.360 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.361 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: "password": { 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "password", 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.362 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "password of InfluxDB server user", 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "port": { 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "port", 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.363 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8086", 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server port", 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.364 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "false", 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "threads": { 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threads", 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.365 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "32", 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: "username": { 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "username", 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.366 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "username of InfluxDB server user", 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "verify_ssl": { 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "verify_ssl", 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "true", 2024-09-10T10:16:37.367 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "insights", 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.368 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.369 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.369 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.369 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.369 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.369 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.369 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.369 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.369 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.369 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.369 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.369 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.369 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.369 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.370 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.371 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.373 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.374 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "iostat", 2024-09-10T10:16:37.374 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.374 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.374 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.374 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.374 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.374 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.374 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.374 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.374 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.374 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.375 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.375 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.375 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.375 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.375 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.375 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.375 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.375 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.375 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.375 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.375 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.375 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.375 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.376 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.376 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.376 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.376 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.376 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.376 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.376 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.376 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.376 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.376 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.376 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.376 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.377 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "k8sevents", 2024-09-10T10:16:37.379 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_event_retention_days": { 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ceph_event_retention_days", 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7", 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.380 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: "config_check_secs": { 2024-09-10T10:16:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_check_secs", 2024-09-10T10:16:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "10", 2024-09-10T10:16:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T10:16:37.381 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.382 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.383 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.384 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.385 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.386 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "localpool", 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: "failure_domain": { 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "failure_domain", 2024-09-10T10:16:37.387 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "host", 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "failure domain for any created local pool", 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.388 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.389 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.390 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.391 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.392 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.393 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.393 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.393 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.393 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.393 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.393 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.393 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.393 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.393 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.393 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.393 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": { 2024-09-10T10:16:37.393 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_size", 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default min_size for any created local pool", 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "num_rep": { 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "num_rep", 2024-09-10T10:16:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.395 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.395 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.395 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3", 2024-09-10T10:16:37.395 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.395 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.395 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.395 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default replica count for any created local pool", 2024-09-10T10:16:37.395 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.395 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.395 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.395 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": { 2024-09-10T10:16:37.395 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_num", 2024-09-10T10:16:37.396 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.396 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.396 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.396 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "128", 2024-09-10T10:16:37.396 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.396 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.396 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.396 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T10:16:37.396 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.396 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: "prefix": { 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prefix", 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name prefix for any created local pool", 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.397 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.398 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.398 INFO:teuthology.orchestra.run.smithi050.stdout: "subtree": { 2024-09-10T10:16:37.398 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "subtree", 2024-09-10T10:16:37.398 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.398 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.398 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.398 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "rack", 2024-09-10T10:16:37.398 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.398 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.398 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.398 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T10:16:37.399 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T10:16:37.399 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.399 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.399 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.399 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.399 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mds_autoscaler", 2024-09-10T10:16:37.399 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.399 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.399 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.399 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.399 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.400 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.401 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.401 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.401 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.401 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.401 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.401 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.401 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.401 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.401 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.401 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.401 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.402 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.403 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.403 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.403 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.403 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.403 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.403 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.403 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.403 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.403 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.403 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.403 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.403 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.404 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.405 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirroring", 2024-09-10T10:16:37.405 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.405 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.405 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.405 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.405 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.405 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.405 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.405 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.406 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.406 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.406 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.406 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.406 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.406 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.406 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.406 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.406 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.406 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.406 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.406 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.406 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.407 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.408 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.409 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.409 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.409 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.409 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.409 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.409 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.409 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.409 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.409 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.409 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.409 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.411 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "nfs", 2024-09-10T10:16:37.411 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.411 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.411 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.411 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.411 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.411 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.411 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.411 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.411 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.411 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.411 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.411 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.412 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.412 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.412 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.412 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.412 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.412 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.412 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.412 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.412 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.412 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.412 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.412 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.413 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.413 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.413 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.413 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.413 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.413 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.413 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.413 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.413 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.413 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.413 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.413 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.414 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.415 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.415 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.415 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.415 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.415 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.415 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.415 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.415 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.415 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.415 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.415 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.415 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.416 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: "fail_fs": { 2024-09-10T10:16:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "fail_fs", 2024-09-10T10:16:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T10:16:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.417 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.418 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.419 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.420 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.421 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.421 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.421 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.421 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.421 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.421 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.421 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.421 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.421 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.421 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.421 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.421 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.422 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.423 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.423 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.423 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator": { 2024-09-10T10:16:37.423 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-09-10T10:16:37.423 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.423 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.423 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.423 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.423 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.423 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.423 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.423 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: "rook", 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: "test_orchestrator" 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Orchestrator backend", 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_perf_query", 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.424 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.425 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.425 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.425 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.425 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.425 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.425 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.425 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.425 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.425 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.425 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.425 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.425 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.426 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.426 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.426 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.426 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.426 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.426 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.426 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.426 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.426 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.426 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.426 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.426 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.427 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.428 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.428 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.428 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.428 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.428 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.428 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.428 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.428 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.428 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.428 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.428 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.428 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.429 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.429 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.429 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.429 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.429 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.429 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.429 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.429 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.429 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.429 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.429 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.429 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_support", 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.430 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.431 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.431 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.431 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.431 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.431 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.431 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.431 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.431 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.431 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.431 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.431 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.431 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.432 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.433 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.434 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.435 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.436 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.436 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.436 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.436 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.436 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_autoscaler", 2024-09-10T10:16:37.436 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.436 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.436 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.436 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.436 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.437 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.437 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.437 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.437 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.437 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.437 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.437 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.437 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.437 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.437 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.437 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.437 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.438 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.439 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.440 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.440 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.440 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.440 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.440 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.440 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.440 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.440 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.440 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.440 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.440 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.440 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.441 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.441 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.441 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.441 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.441 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.441 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.441 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.441 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.441 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.441 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.441 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.442 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.442 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.442 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.442 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.442 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:37.442 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:37.442 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.442 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.442 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.442 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:37.442 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.443 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.443 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.443 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.443 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.443 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.443 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.443 INFO:teuthology.orchestra.run.smithi050.stdout: "threshold": { 2024-09-10T10:16:37.443 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threshold", 2024-09-10T10:16:37.443 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.443 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.443 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.443 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-09-10T10:16:37.444 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1.0", 2024-09-10T10:16:37.444 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.444 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.444 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "scaling threshold", 2024-09-10T10:16:37.444 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T10:16:37.444 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.444 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.444 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.444 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.444 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "progress", 2024-09-10T10:16:37.444 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_pg_recovery_event": { 2024-09-10T10:16:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_pg_recovery_event", 2024-09-10T10:16:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T10:16:37.445 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.446 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.447 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.447 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.447 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.447 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.447 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.447 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.447 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.447 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.447 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.447 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.447 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.448 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.448 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.448 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.448 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.448 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.448 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.448 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.448 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.448 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.448 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.448 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.448 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.449 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.450 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.450 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.450 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.450 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.450 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.450 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.450 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.450 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.450 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.450 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.450 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.450 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.450 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.451 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "max_completed_events": { 2024-09-10T10:16:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_completed_events", 2024-09-10T10:16:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.452 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "50", 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "number of past completed events to remember", 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.453 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-09-10T10:16:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long the module is going to sleep", 2024-09-10T10:16:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus", 2024-09-10T10:16:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "cache": { 2024-09-10T10:16:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cache", 2024-09-10T10:16:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "exclude_perf_counters": { 2024-09-10T10:16:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "exclude_perf_counters", 2024-09-10T10:16:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T10:16:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T10:16:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.458 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.459 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.460 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.461 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools": { 2024-09-10T10:16:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools", 2024-09-10T10:16:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.462 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.463 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300", 2024-09-10T10:16:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_interval": { 2024-09-10T10:16:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_interval", 2024-09-10T10:16:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.464 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15.0", 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.465 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-09-10T10:16:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T10:16:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-09-10T10:16:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-09-10T10:16:37.466 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "9283", 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "stale_cache_strategy": { 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stale_cache_strategy", 2024-09-10T10:16:37.467 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "log", 2024-09-10T10:16:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-09-10T10:16:37.468 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-09-10T10:16:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "default", 2024-09-10T10:16:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "default", 2024-09-10T10:16:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "error" 2024-09-10T10:16:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.469 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-09-10T10:16:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-09-10T10:16:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-09-10T10:16:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-09-10T10:16:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-09-10T10:16:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.470 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.471 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.472 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.473 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.474 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.475 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_snap_create": { 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_snap_create", 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "mirror_snapshot_schedule": { 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.478 INFO:teuthology.orchestra.run.smithi050.stdout: "trash_purge_schedule": { 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "trash_purge_schedule", 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "restful", 2024-09-10T10:16:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_auth": { 2024-09-10T10:16:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_auth", 2024-09-10T10:16:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.480 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-09-10T10:16:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-09-10T10:16:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.481 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.482 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.483 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.484 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.485 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.486 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.487 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.488 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rgw", 2024-09-10T10:16:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.490 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.491 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.492 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.493 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.494 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rook", 2024-09-10T10:16:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.495 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.496 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.497 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.498 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.499 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.500 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "storage_class": { 2024-09-10T10:16:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "storage_class", 2024-09-10T10:16:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.501 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "local", 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.502 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "selftest", 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.503 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.504 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.505 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "roption1": { 2024-09-10T10:16:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption1", 2024-09-10T10:16:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.508 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "roption2": { 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption2", 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.509 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "xyz", 2024-09-10T10:16:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption1": { 2024-09-10T10:16:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption1", 2024-09-10T10:16:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.510 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption2": { 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption2", 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.511 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption3": { 2024-09-10T10:16:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption3", 2024-09-10T10:16:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.512 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption4": { 2024-09-10T10:16:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption4", 2024-09-10T10:16:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.513 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption5": { 2024-09-10T10:16:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption5", 2024-09-10T10:16:37.514 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption6": { 2024-09-10T10:16:37.515 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption6", 2024-09-10T10:16:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.516 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption7": { 2024-09-10T10:16:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption7", 2024-09-10T10:16:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-09-10T10:16:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "42", 2024-09-10T10:16:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "testkey": { 2024-09-10T10:16:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testkey", 2024-09-10T10:16:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.518 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "testlkey": { 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testlkey", 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.519 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "testnewline": { 2024-09-10T10:16:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testnewline", 2024-09-10T10:16:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.520 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_m_granularity": { 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_m_granularity", 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.521 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T10:16:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "dump_on_update": { 2024-09-10T10:16:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dump_on_update", 2024-09-10T10:16:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.522 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "dump database to debug log on update", 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.523 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.524 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.525 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.526 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.527 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stats", 2024-09-10T10:16:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.529 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.530 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.531 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.532 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.533 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "status", 2024-09-10T10:16:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.535 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.536 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.537 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telegraf", 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "address": { 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "address", 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15", 2024-09-10T10:16:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telemetry", 2024-09-10T10:16:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_basic": { 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_basic", 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_crash": { 2024-09-10T10:16:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_crash", 2024-09-10T10:16:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T10:16:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_device": { 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_device", 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T10:16:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_ident": { 2024-09-10T10:16:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_ident", 2024-09-10T10:16:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_perf": { 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_perf", 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T10:16:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "contact": { 2024-09-10T10:16:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "contact", 2024-09-10T10:16:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "description": { 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "description", 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "device_url": { 2024-09-10T10:16:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_url", 2024-09-10T10:16:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T10:16:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-09-10T10:16:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-09-10T10:16:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "24", 2024-09-10T10:16:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "8", 2024-09-10T10:16:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "last_opt_revision": { 2024-09-10T10:16:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "last_opt_revision", 2024-09-10T10:16:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1", 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard": { 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard", 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard_description": { 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard_description", 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "organization": { 2024-09-10T10:16:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "organization", 2024-09-10T10:16:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "proxy": { 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "proxy", 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "url": { 2024-09-10T10:16:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url", 2024-09-10T10:16:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "test_orchestrator", 2024-09-10T10:16:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_clones": { 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_clones", 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4", 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "periodic_async_work": { 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "periodic_async_work", 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Periodically check for async work", 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_delay": { 2024-09-10T10:16:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_delay", 2024-09-10T10:16:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T10:16:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_no_wait": { 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix", 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "discovery_interval": { 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "discovery_interval", 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "100", 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "identifier": { 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "identifier", 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_host": { 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_host", 2024-09-10T10:16:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_port": { 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_port", 2024-09-10T10:16:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10051", 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_sender": { 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_sender", 2024-09-10T10:16:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "modules": [ 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "dashboard", 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "iostat", 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "nfs", 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "restful" 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "available_modules": [ 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "alerts", 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T10:16:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_destination": { 2024-09-10T10:16:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_destination", 2024-09-10T10:16:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email address to send alerts to", 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_from_name": { 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_from_name", 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "Ceph", 2024-09-10T10:16:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email From: name", 2024-09-10T10:16:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_host": { 2024-09-10T10:16:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_host", 2024-09-10T10:16:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP server", 2024-09-10T10:16:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_password": { 2024-09-10T10:16:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_password", 2024-09-10T10:16:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Password to authenticate with", 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_port": { 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_port", 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "465", 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP port", 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_sender": { 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_sender", 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP envelope sender", 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_ssl": { 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_ssl", 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_user": { 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_user", 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "User to authenticate as", 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "balancer", 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "active": { 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "active", 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_time": { 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_time", 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0000", 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_weekday": { 2024-09-10T10:16:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_weekday", 2024-09-10T10:16:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-09-10T10:16:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-09-10T10:16:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T10:16:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T10:16:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_max_iterations": { 2024-09-10T10:16:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_max_iterations", 2024-09-10T10:16:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "25", 2024-09-10T10:16:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-09-10T10:16:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "250", 2024-09-10T10:16:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_metrics": { 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_metrics", 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_step": { 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_step", 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.5", 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0.001", 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "0.999", 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "aggressiveness of optimization", 2024-09-10T10:16:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T10:16:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "end_time": { 2024-09-10T10:16:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_time", 2024-09-10T10:16:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2359", 2024-09-10T10:16:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T10:16:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T10:16:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "end_weekday": { 2024-09-10T10:16:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_weekday", 2024-09-10T10:16:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-09-10T10:16:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-09-10T10:16:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T10:16:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T10:16:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "min_score": { 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_score", 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "upmap", 2024-09-10T10:16:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-compat", 2024-09-10T10:16:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "none", 2024-09-10T10:16:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "read", 2024-09-10T10:16:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap", 2024-09-10T10:16:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap-read" 2024-09-10T10:16:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Balancer mode", 2024-09-10T10:16:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_ids": { 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_ids", 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_deviation": { 2024-09-10T10:16:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_deviation", 2024-09-10T10:16:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-09-10T10:16:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-09-10T10:16:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T10:16:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_optimizations": { 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_optimizations", 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T10:16:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.634 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.634 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.634 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.634 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.634 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm", 2024-09-10T10:16:37.634 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.634 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.634 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.634 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_down_multiplier": { 2024-09-10T10:16:37.634 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_down_multiplier", 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_refresh_rate": { 2024-09-10T10:16:37.635 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_refresh_rate", 2024-09-10T10:16:37.636 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.636 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.636 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.636 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "20", 2024-09-10T10:16:37.636 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.636 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.636 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.636 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T10:16:37.636 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.636 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.636 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.636 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_starting_port": { 2024-09-10T10:16:37.637 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_starting_port", 2024-09-10T10:16:37.637 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.637 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.637 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.637 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4721", 2024-09-10T10:16:37.637 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.637 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.637 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.637 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T10:16:37.637 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.637 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.637 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_ptrace": { 2024-09-10T10:16:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_ptrace", 2024-09-10T10:16:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T10:16:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T10:16:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.639 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.639 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_interval": { 2024-09-10T10:16:37.639 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_interval", 2024-09-10T10:16:37.639 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.639 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.639 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.639 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:37.639 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.639 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.639 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.639 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T10:16:37.639 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_memory_target_ratio": { 2024-09-10T10:16:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T10:16:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.7", 2024-09-10T10:16:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.640 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T10:16:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm_log_destination": { 2024-09-10T10:16:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm_log_destination", 2024-09-10T10:16:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.641 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: "file", 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: "file,syslog", 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: "syslog" 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: "cgroups_split": { 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cgroups_split", 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.642 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.643 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.643 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.643 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.643 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.643 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T10:16:37.643 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.643 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.643 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.643 INFO:teuthology.orchestra.run.smithi050.stdout: "config_checks_enabled": { 2024-09-10T10:16:37.643 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_checks_enabled", 2024-09-10T10:16:37.643 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.643 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: "config_dashboard": { 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_dashboard", 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.644 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.645 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.645 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.645 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.645 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.645 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.645 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T10:16:37.645 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.645 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.645 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.645 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_alertmanager": { 2024-09-10T10:16:37.645 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_alertmanager", 2024-09-10T10:16:37.645 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_base": { 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_base", 2024-09-10T10:16:37.646 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Container image name, without the tag", 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_elasticsearch": { 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_elasticsearch", 2024-09-10T10:16:37.647 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "elasticsearch container image", 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_grafana": { 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_grafana", 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.648 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_haproxy": { 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_haproxy", 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.649 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.650 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.650 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T10:16:37.650 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.650 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.650 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.650 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "HAproxy container image", 2024-09-10T10:16:37.650 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.650 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.650 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.650 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_agent": { 2024-09-10T10:16:37.650 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_agent", 2024-09-10T10:16:37.650 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.651 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.651 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.651 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T10:16:37.651 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.651 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.651 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.651 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger agent container image", 2024-09-10T10:16:37.651 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.651 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.651 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.651 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_collector": { 2024-09-10T10:16:37.651 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_collector", 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger collector container image", 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_query": { 2024-09-10T10:16:37.652 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_query", 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger query container image", 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_keepalived": { 2024-09-10T10:16:37.653 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_keepalived", 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Keepalived container image", 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_loki": { 2024-09-10T10:16:37.654 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_loki", 2024-09-10T10:16:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T10:16:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Loki container image", 2024-09-10T10:16:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.655 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_node_exporter": { 2024-09-10T10:16:37.656 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_node_exporter", 2024-09-10T10:16:37.656 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.656 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.656 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.656 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T10:16:37.656 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.656 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.656 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.656 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-09-10T10:16:37.656 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.656 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.656 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.657 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nvmeof": { 2024-09-10T10:16:37.657 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nvmeof", 2024-09-10T10:16:37.657 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.657 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.657 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.657 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T10:16:37.657 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.657 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.657 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.657 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nvme-of container image", 2024-09-10T10:16:37.657 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.657 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.657 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_prometheus": { 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_prometheus", 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.658 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.659 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_promtail": { 2024-09-10T10:16:37.659 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_promtail", 2024-09-10T10:16:37.659 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.659 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.659 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.659 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T10:16:37.659 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.659 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.659 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.659 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Promtail container image", 2024-09-10T10:16:37.659 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.659 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_samba": { 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_samba", 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Samba/SMB container image", 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.660 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_snmp_gateway": { 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_snmp_gateway", 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SNMP Gateway container image", 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.661 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: "container_init": { 2024-09-10T10:16:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_init", 2024-09-10T10:16:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T10:16:37.662 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.663 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.663 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.663 INFO:teuthology.orchestra.run.smithi050.stdout: "daemon_cache_timeout": { 2024-09-10T10:16:37.663 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "daemon_cache_timeout", 2024-09-10T10:16:37.663 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.663 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.663 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.663 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:37.663 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.663 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.663 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: "default_cephadm_command_timeout": { 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "900", 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.664 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T10:16:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: "default_registry": { 2024-09-10T10:16:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_registry", 2024-09-10T10:16:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io", 2024-09-10T10:16:37.665 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: "device_cache_timeout": { 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_cache_timeout", 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1800", 2024-09-10T10:16:37.666 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache device inventory", 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: "device_enhanced_scan": { 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_enhanced_scan", 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.667 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T10:16:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: "facts_cache_timeout": { 2024-09-10T10:16:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "facts_cache_timeout", 2024-09-10T10:16:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.668 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache host facts data", 2024-09-10T10:16:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: "grafana_dashboards_path": { 2024-09-10T10:16:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "grafana_dashboards_path", 2024-09-10T10:16:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.669 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: "host_check_interval": { 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "host_check_interval", 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.670 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to perform a host check", 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: "hw_monitoring": { 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hw_monitoring", 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.671 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.672 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.672 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.672 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.672 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.672 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T10:16:37.672 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.672 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.672 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.672 INFO:teuthology.orchestra.run.smithi050.stdout: "inventory_list_all": { 2024-09-10T10:16:37.672 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "inventory_list_all", 2024-09-10T10:16:37.672 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.672 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.673 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.673 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.673 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.673 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.673 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.673 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T10:16:37.673 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.673 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.673 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.673 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.673 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.673 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.674 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.676 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.676 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.676 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.676 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.676 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.676 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.676 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.676 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.676 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "log_refresh_metadata": { 2024-09-10T10:16:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_refresh_metadata", 2024-09-10T10:16:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.677 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.678 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.679 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.680 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.681 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.682 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "*", 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.683 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T10:16:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "max_count_per_host": { 2024-09-10T10:16:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_count_per_host", 2024-09-10T10:16:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.684 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of daemons per service per host", 2024-09-10T10:16:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd_draining_count": { 2024-09-10T10:16:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_osd_draining_count", 2024-09-10T10:16:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.685 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "migration_current": { 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "migration_current", 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.686 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "internal - do not modify", 2024-09-10T10:16:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-09-10T10:16:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-09-10T10:16:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.687 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "root", 2024-09-10T10:16:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm-package", 2024-09-10T10:16:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "root" 2024-09-10T10:16:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T10:16:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "oob_default_addr": { 2024-09-10T10:16:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "oob_default_addr", 2024-09-10T10:16:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "169.254.1.1", 2024-09-10T10:16:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T10:16:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.689 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "prometheus_alerts_path": { 2024-09-10T10:16:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus_alerts_path", 2024-09-10T10:16:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T10:16:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.690 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_insecure": { 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_insecure", 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.691 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T10:16:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_password": { 2024-09-10T10:16:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_password", 2024-09-10T10:16:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.692 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_url": { 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_url", 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.693 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T10:16:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_username": { 2024-09-10T10:16:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_username", 2024-09-10T10:16:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.694 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "secure_monitoring_stack": { 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secure_monitoring_stack", 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.695 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "service_discovery_port": { 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "service_discovery_port", 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8765", 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.696 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "cephadm service discovery port", 2024-09-10T10:16:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "ssh_config_file": { 2024-09-10T10:16:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssh_config_file", 2024-09-10T10:16:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.697 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "use_agent": { 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_agent", 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.698 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: "use_repo_digest": { 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_repo_digest", 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.699 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.700 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.700 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T10:16:37.700 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.700 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.700 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.700 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_failed_host_check": { 2024-09-10T10:16:37.700 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_failed_host_check", 2024-09-10T10:16:37.700 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.700 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.700 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.700 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_daemons": { 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_daemons", 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.701 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_hosts": { 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_hosts", 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.702 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T10:16:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crash", 2024-09-10T10:16:37.703 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.704 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.705 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.706 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.707 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.708 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "retain_interval": { 2024-09-10T10:16:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retain_interval", 2024-09-10T10:16:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "31536000", 2024-09-10T10:16:37.709 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T10:16:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_recent_interval": { 2024-09-10T10:16:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_recent_interval", 2024-09-10T10:16:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.710 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1209600", 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dashboard", 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.711 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T10:16:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T10:16:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.712 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T10:16:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T10:16:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.713 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T10:16:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T10:16:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.714 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_ENABLED": { 2024-09-10T10:16:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T10:16:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.715 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.716 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.717 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T10:16:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T10:16:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.718 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T10:16:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T10:16:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.719 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T10:16:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T10:16:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.720 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.721 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.722 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T10:16:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T10:16:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.723 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T10:16:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T10:16:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.724 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T10:16:37.725 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T10:16:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.726 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.727 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_URL": { 2024-09-10T10:16:37.728 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_URL", 2024-09-10T10:16:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.729 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T10:16:37.730 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.731 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.732 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T10:16:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T10:16:37.733 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.734 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.735 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.736 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.737 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.738 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.739 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T10:16:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T10:16:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.740 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T10:16:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T10:16:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.743 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T10:16:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T10:16:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.744 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.745 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.746 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8", 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "45", 2024-09-10T10:16:37.747 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.748 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-09-10T10:16:37.749 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T10:16:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T10:16:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.750 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.751 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:37.752 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.753 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.754 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "cross_origin_url": { 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cross_origin_url", 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.755 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "crt_file": { 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crt_file", 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.756 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "debug": { 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "debug", 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable/disable debug options", 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "jwt_token_ttl": { 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "jwt_token_ttl", 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "28800", 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.759 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.760 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.761 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.762 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "motd": { 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "motd", 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "The message of the day", 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect_resolve_ip_addr": { 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.766 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.767 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8080", 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-09-10T10:16:37.768 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-09-10T10:16:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.769 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl_server_port": { 2024-09-10T10:16:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl_server_port", 2024-09-10T10:16:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8443", 2024-09-10T10:16:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "redirect", 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect" 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.771 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "url_prefix": { 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url_prefix", 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_monitoring": { 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_monitoring", 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.774 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "monitor device health metrics", 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.775 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.776 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.777 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.777 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.777 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.777 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.777 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.777 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.777 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.777 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.777 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.777 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.777 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.777 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.778 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.779 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "mark_out_threshold": { 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mark_out_threshold", 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2419200", 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.780 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.781 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.781 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": { 2024-09-10T10:16:37.781 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_name", 2024-09-10T10:16:37.781 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.781 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.781 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.781 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "device_health_metrics", 2024-09-10T10:16:37.781 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.781 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.781 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.781 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T10:16:37.781 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: "retention_period": { 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retention_period", 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15552000", 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain device health metrics", 2024-09-10T10:16:37.782 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_frequency": { 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_frequency", 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T10:16:37.783 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.784 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.784 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.784 INFO:teuthology.orchestra.run.smithi050.stdout: "self_heal": { 2024-09-10T10:16:37.784 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "self_heal", 2024-09-10T10:16:37.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.784 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.784 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.784 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.784 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.784 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.784 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.784 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T10:16:37.785 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.785 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.785 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.785 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:37.785 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:37.785 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.785 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.785 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.785 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:37.785 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.785 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.785 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_threshold": { 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_threshold", 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7257600", 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.786 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "diskprediction_local", 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "predict_interval": { 2024-09-10T10:16:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predict_interval", 2024-09-10T10:16:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-09-10T10:16:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "predictor_model": { 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predictor_model", 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "prophetstor", 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "influx", 2024-09-10T10:16:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": false, 2024-09-10T10:16:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "influxdb python module not found", 2024-09-10T10:16:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "batch_size": { 2024-09-10T10:16:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "batch_size", 2024-09-10T10:16:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5000", 2024-09-10T10:16:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T10:16:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "database": { 2024-09-10T10:16:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "database", 2024-09-10T10:16:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "ceph", 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": { 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hostname", 2024-09-10T10:16:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server hostname", 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "30", 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "5", 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "password": { 2024-09-10T10:16:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "password", 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "password of InfluxDB server user", 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "port": { 2024-09-10T10:16:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "port", 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8086", 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server port", 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-09-10T10:16:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-09-10T10:16:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "false", 2024-09-10T10:16:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T10:16:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "threads": { 2024-09-10T10:16:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threads", 2024-09-10T10:16:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-09-10T10:16:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-09-10T10:16:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "32", 2024-09-10T10:16:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T10:16:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "username": { 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "username", 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "username of InfluxDB server user", 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "verify_ssl": { 2024-09-10T10:16:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "verify_ssl", 2024-09-10T10:16:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "true", 2024-09-10T10:16:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T10:16:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "insights", 2024-09-10T10:16:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "iostat", 2024-09-10T10:16:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "k8sevents", 2024-09-10T10:16:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_event_retention_days": { 2024-09-10T10:16:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ceph_event_retention_days", 2024-09-10T10:16:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7", 2024-09-10T10:16:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T10:16:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "config_check_secs": { 2024-09-10T10:16:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_check_secs", 2024-09-10T10:16:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "10", 2024-09-10T10:16:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "localpool", 2024-09-10T10:16:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "failure_domain": { 2024-09-10T10:16:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "failure_domain", 2024-09-10T10:16:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "host", 2024-09-10T10:16:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "failure domain for any created local pool", 2024-09-10T10:16:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T10:16:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": { 2024-09-10T10:16:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_size", 2024-09-10T10:16:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default min_size for any created local pool", 2024-09-10T10:16:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T10:16:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "num_rep": { 2024-09-10T10:16:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "num_rep", 2024-09-10T10:16:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3", 2024-09-10T10:16:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default replica count for any created local pool", 2024-09-10T10:16:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": { 2024-09-10T10:16:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_num", 2024-09-10T10:16:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "128", 2024-09-10T10:16:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T10:16:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "prefix": { 2024-09-10T10:16:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prefix", 2024-09-10T10:16:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name prefix for any created local pool", 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "subtree": { 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "subtree", 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "rack", 2024-09-10T10:16:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mds_autoscaler", 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirroring", 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "nfs", 2024-09-10T10:16:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "fail_fs": { 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "fail_fs", 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator": { 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2024-09-10T10:16:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "rook", 2024-09-10T10:16:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "test_orchestrator" 2024-09-10T10:16:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Orchestrator backend", 2024-09-10T10:16:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_perf_query", 2024-09-10T10:16:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_support", 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_autoscaler", 2024-09-10T10:16:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "threshold": { 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threshold", 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1.0", 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "scaling threshold", 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "progress", 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_pg_recovery_event": { 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_pg_recovery_event", 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "max_completed_events": { 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_completed_events", 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "50", 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "number of past completed events to remember", 2024-09-10T10:16:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-09-10T10:16:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-09-10T10:16:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-09-10T10:16:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long the module is going to sleep", 2024-09-10T10:16:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus", 2024-09-10T10:16:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "cache": { 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cache", 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "exclude_perf_counters": { 2024-09-10T10:16:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "exclude_perf_counters", 2024-09-10T10:16:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T10:16:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T10:16:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools": { 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools", 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300", 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_interval": { 2024-09-10T10:16:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_interval", 2024-09-10T10:16:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15.0", 2024-09-10T10:16:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-09-10T10:16:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-09-10T10:16:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-09-10T10:16:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "9283", 2024-09-10T10:16:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "stale_cache_strategy": { 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stale_cache_strategy", 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "log", 2024-09-10T10:16:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-09-10T10:16:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-09-10T10:16:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "default", 2024-09-10T10:16:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "default", 2024-09-10T10:16:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "error" 2024-09-10T10:16:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-09-10T10:16:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_snap_create": { 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_snap_create", 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-09-10T10:16:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "mirror_snapshot_schedule": { 2024-09-10T10:16:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T10:16:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "trash_purge_schedule": { 2024-09-10T10:16:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "trash_purge_schedule", 2024-09-10T10:16:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "restful", 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_auth": { 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_auth", 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-09-10T10:16:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-09-10T10:16:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-09-10T10:16:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-09-10T10:16:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rgw", 2024-09-10T10:16:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rook", 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "storage_class": { 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "storage_class", 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "local", 2024-09-10T10:16:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T10:16:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "selftest", 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "roption1": { 2024-09-10T10:16:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption1", 2024-09-10T10:16:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "roption2": { 2024-09-10T10:16:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption2", 2024-09-10T10:16:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "xyz", 2024-09-10T10:16:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption1": { 2024-09-10T10:16:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption1", 2024-09-10T10:16:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption2": { 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption2", 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption3": { 2024-09-10T10:16:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption3", 2024-09-10T10:16:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-09-10T10:16:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption4": { 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption4", 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption5": { 2024-09-10T10:16:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption5", 2024-09-10T10:16:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption6": { 2024-09-10T10:16:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption6", 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption7": { 2024-09-10T10:16:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption7", 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "42", 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "testkey": { 2024-09-10T10:16:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testkey", 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "testlkey": { 2024-09-10T10:16:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testlkey", 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "testnewline": { 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testnewline", 2024-09-10T10:16:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_m_granularity": { 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_m_granularity", 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "dump_on_update": { 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dump_on_update", 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "dump database to debug log on update", 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stats", 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "status", 2024-09-10T10:16:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telegraf", 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "address": { 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "address", 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15", 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telemetry", 2024-09-10T10:16:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_basic": { 2024-09-10T10:16:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_basic", 2024-09-10T10:16:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_crash": { 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_crash", 2024-09-10T10:16:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T10:16:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_device": { 2024-09-10T10:16:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_device", 2024-09-10T10:16:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T10:16:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_ident": { 2024-09-10T10:16:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_ident", 2024-09-10T10:16:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T10:16:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_perf": { 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_perf", 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "contact": { 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "contact", 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "description": { 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "description", 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "device_url": { 2024-09-10T10:16:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_url", 2024-09-10T10:16:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T10:16:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-09-10T10:16:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-09-10T10:16:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "24", 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "8", 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "last_opt_revision": { 2024-09-10T10:16:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "last_opt_revision", 2024-09-10T10:16:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1", 2024-09-10T10:16:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard": { 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard", 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard_description": { 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard_description", 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "organization": { 2024-09-10T10:16:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "organization", 2024-09-10T10:16:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "proxy": { 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "proxy", 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "url": { 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url", 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "test_orchestrator", 2024-09-10T10:16:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2024-09-10T10:16:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_clones": { 2024-09-10T10:16:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_clones", 2024-09-10T10:16:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4", 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "periodic_async_work": { 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "periodic_async_work", 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Periodically check for async work", 2024-09-10T10:16:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_delay": { 2024-09-10T10:16:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_delay", 2024-09-10T10:16:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-09-10T10:16:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T10:16:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_no_wait": { 2024-09-10T10:16:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T10:16:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-09-10T10:16:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T10:16:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix", 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "discovery_interval": { 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "discovery_interval", 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "100", 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "identifier": { 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "identifier", 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-09-10T10:16:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-09-10T10:16:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-09-10T10:16:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-09-10T10:16:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-09-10T10:16:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-09-10T10:16:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-09-10T10:16:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-09-10T10:16:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-10T10:16:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-09-10T10:16:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_host": { 2024-09-10T10:16:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_host", 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_port": { 2024-09-10T10:16:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_port", 2024-09-10T10:16:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-09-10T10:16:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10051", 2024-09-10T10:16:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_sender": { 2024-09-10T10:16:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_sender", 2024-09-10T10:16:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-09-10T10:16:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-09-10T10:16:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-09-10T10:16:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T10:16:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-09-10T10:16:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-09-10T10:16:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-09-10T10:16:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-09-10T10:16:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-09-10T10:16:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-09-10T10:16:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "services": { 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "dashboard": "https://172.21.15.50:8443/" 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "always_on_modules": { 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "octopus": [ 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-09-10T10:16:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-09-10T10:16:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-09-10T10:16:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-09-10T10:16:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-09-10T10:16:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-09-10T10:16:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-09-10T10:16:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "pacific": [ 2024-09-10T10:16:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-09-10T10:16:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-09-10T10:16:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-09-10T10:16:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-09-10T10:16:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-09-10T10:16:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-09-10T10:16:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-09-10T10:16:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-09-10T10:16:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-09-10T10:16:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-09-10T10:16:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "quincy": [ 2024-09-10T10:16:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-09-10T10:16:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-09-10T10:16:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-09-10T10:16:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-09-10T10:16:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-09-10T10:16:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-09-10T10:16:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "reef": [ 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-09-10T10:16:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "squid": [ 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-10T10:16:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "last_failure_osd_epoch": 3, 2024-09-10T10:16:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "active_clients": [ 2024-09-10T10:16:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2024-09-10T10:16:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-10T10:16:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-10T10:16:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-09-10T10:16:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4162959260 2024-09-10T10:16:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-10T10:16:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "libcephsqlite", 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4041739567 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 938495945 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 910497902 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-10T10:16:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-10T10:16:38.047 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:16:38.048 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:37 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/3886391576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-10T10:16:38.048 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:37 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/1471923958' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T10:16:38.048 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:37 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/3886391576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-10T10:16:38.048 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:37 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/1471923958' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T10:16:38.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.698+0000 7f97e9a00640 1 -- 172.21.15.50:0/1471923958 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97c80a2b90 msgr2=0x7f97c80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:38.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.698+0000 7f97e9a00640 1 --2- 172.21.15.50:0/1471923958 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97c80a2b90 0x7f97c80a5050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f97e419b530 tx=0x7f97cc005f90 comp rx=0 tx=0).stop 2024-09-10T10:16:38.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.698+0000 7f97e9a00640 1 -- 172.21.15.50:0/1471923958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97e4101b10 msgr2=0x7f97e419a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:38.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.698+0000 7f97e9a00640 1 --2- 172.21.15.50:0/1471923958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97e4101b10 0x7f97e419a020 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f97d400e9c0 tx=0x7f97d400ee80 comp rx=0 tx=0).stop 2024-09-10T10:16:38.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.698+0000 7f97e9a00640 1 -- 172.21.15.50:0/1471923958 shutdown_connections 2024-09-10T10:16:38.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.698+0000 7f97e9a00640 1 --2- 172.21.15.50:0/1471923958 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f97c80a2b90 0x7f97c80a5050 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:38.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.698+0000 7f97e9a00640 1 --2- 172.21.15.50:0/1471923958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97e41036c0 0x7f97e41a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:38.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.698+0000 7f97e9a00640 1 --2- 172.21.15.50:0/1471923958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e4102d00 0x7f97e419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:38.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.698+0000 7f97e9a00640 1 --2- 172.21.15.50:0/1471923958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97e4101b10 0x7f97e419a020 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:38.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.698+0000 7f97e9a00640 1 -- 172.21.15.50:0/1471923958 >> 172.21.15.50:0/1471923958 conn(0x7f97e40fd2b0 msgr2=0x7f97e4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:38.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.698+0000 7f97e9a00640 1 -- 172.21.15.50:0/1471923958 shutdown_connections 2024-09-10T10:16:38.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:36.698+0000 7f97e9a00640 1 -- 172.21.15.50:0/1471923958 wait complete. 2024-09-10T10:16:38.056 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T10:16:38.056 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T10:16:38.056 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:37 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/3886391576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-10T10:16:38.056 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:37 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/1471923958' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T10:16:38.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:38 smithi189 ceph-mon[34999]: pgmap v554: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-10T10:16:38.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:38 smithi084 ceph-mon[34812]: pgmap v554: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-10T10:16:38.445 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:38.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:38 smithi050 ceph-mon[30354]: pgmap v554: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-10T10:16:39.032 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:16:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:16:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 0, 2024-09-10T10:16:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2, 2024-09-10T10:16:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 0, 2024-09-10T10:16:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 0, 2024-09-10T10:16:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-09-10T10:16:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2024-09-10T10:16:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.003665076, 2024-09-10T10:16:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T10:16:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000480161, 2024-09-10T10:16:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:16:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 1, 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 103, 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 160, 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 96656, 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 3, 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.012929183, 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.010053611, 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.001309247, 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 101, 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.007317769, 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000072453 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 96656 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 143, 2024-09-10T10:16:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 138, 2024-09-10T10:16:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 458160, 2024-09-10T10:16:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 83360, 2024-09-10T10:16:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2024-09-10T10:16:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2024-09-10T10:16:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.032989250, 2024-09-10T10:16:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.016203371, 2024-09-10T10:16:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.021063756, 2024-09-10T10:16:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 138, 2024-09-10T10:16:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.018024793, 2024-09-10T10:16:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000130614 2024-09-10T10:16:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 458160, 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 83360 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-09-10T10:16:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:16:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:16:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 148840, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 28, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:16:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:16:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-10T10:16:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-09-10T10:16:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-10T10:16:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 140, 2024-09-10T10:16:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 435529, 2024-09-10T10:16:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 140, 2024-09-10T10:16:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-10T10:16:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-10T10:16:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 140, 2024-09-10T10:16:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 435529, 2024-09-10T10:16:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-10T10:16:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:39.044 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:16:39.803 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-10T10:16:39.803 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-10T10:16:39.803 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-10T10:16:39.803 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-10T10:16:39.803 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T10:16:39.803 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T10:16:40.184 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:40.323 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:40 smithi050 ceph-mon[30354]: pgmap v555: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-10T10:16:40.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:40 smithi189 ceph-mon[34999]: pgmap v555: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-10T10:16:40.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:40 smithi084 ceph-mon[34812]: pgmap v555: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-10T10:16:40.755 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:16:40.755 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:16:40.755 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 0, 2024-09-10T10:16:40.755 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2, 2024-09-10T10:16:40.755 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 0, 2024-09-10T10:16:40.755 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 0, 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.003503160, 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000608907, 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:40.756 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 1, 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 108, 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 160, 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 97536, 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 3, 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.013752549, 2024-09-10T10:16:40.757 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.010526992, 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.001708838, 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 106, 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.007756013, 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000073169 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 97536 2024-09-10T10:16:40.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 149, 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 145, 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 459792, 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 87360, 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.035585923, 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.014504160, 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.025736309, 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 145, 2024-09-10T10:16:40.759 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.030607734, 2024-09-10T10:16:40.760 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000211087 2024-09-10T10:16:40.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:40.760 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:40.760 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:40.760 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:40.760 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:40.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:40.760 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 459792, 2024-09-10T10:16:40.760 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 87360 2024-09-10T10:16:40.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:40.760 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-09-10T10:16:40.760 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2024-09-10T10:16:40.760 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:16:40.761 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:16:40.762 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:16:40.762 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:16:40.762 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:16:40.762 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-09-10T10:16:40.762 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:16:40.762 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-09-10T10:16:40.762 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:16:40.762 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:16:40.762 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:16:40.762 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:16:40.762 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:16:40.762 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:16:40.762 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:16:40.763 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-09-10T10:16:40.763 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:16:40.763 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:16:40.763 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:16:40.763 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-09-10T10:16:40.763 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-09-10T10:16:40.763 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-09-10T10:16:40.763 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:16:40.763 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:16:40.763 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:16:40.763 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:16:40.763 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 149998, 2024-09-10T10:16:40.763 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 30, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-09-10T10:16:40.764 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-09-10T10:16:40.765 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2024-09-10T10:16:40.765 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2024-09-10T10:16:40.765 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-09-10T10:16:40.765 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-09-10T10:16:40.765 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-09-10T10:16:40.765 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-09-10T10:16:40.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:40.765 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:16:40.765 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-10T10:16:40.765 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-09-10T10:16:40.765 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-10T10:16:40.765 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 147, 2024-09-10T10:16:40.765 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 436503, 2024-09-10T10:16:40.766 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:40.766 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 147, 2024-09-10T10:16:40.766 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-10T10:16:40.766 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-10T10:16:40.766 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 147, 2024-09-10T10:16:40.766 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 436503, 2024-09-10T10:16:40.766 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-10T10:16:40.766 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:40.766 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:40.766 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:40.766 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:40.766 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:40.766 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:16:41.620 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-10T10:16:41.620 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-10T10:16:41.620 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-10T10:16:41.621 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-10T10:16:41.621 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T10:16:41.621 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T10:16:41.999 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:42.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:42 smithi050 ceph-mon[30354]: pgmap v556: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T10:16:42.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:42 smithi189 ceph-mon[34999]: pgmap v556: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T10:16:42.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:42 smithi084 ceph-mon[34812]: pgmap v556: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T10:16:42.573 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:16:42.573 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:16:42.573 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 145, 2024-09-10T10:16:42.573 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 140, 2024-09-10T10:16:42.573 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 458704, 2024-09-10T10:16:42.574 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 84640, 2024-09-10T10:16:42.574 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-09-10T10:16:42.574 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2024-09-10T10:16:42.574 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.035790692, 2024-09-10T10:16:42.574 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.015700947, 2024-09-10T10:16:42.574 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.021427325, 2024-09-10T10:16:42.574 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:42.574 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:42.574 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 140, 2024-09-10T10:16:42.574 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.016113590, 2024-09-10T10:16:42.574 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000115097 2024-09-10T10:16:42.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:42.574 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 458704, 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 84640 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 1, 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 105, 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 160, 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 97008, 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 3, 2024-09-10T10:16:42.575 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.013636020, 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.010492244, 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.001627814, 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 103, 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.020018311, 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000194352 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 97008 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 0, 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2, 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 0, 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 0, 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.000638395, 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000524121, 2024-09-10T10:16:42.577 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-09-10T10:16:42.578 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:16:42.579 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:16:42.580 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 148967, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 29, 2024-09-10T10:16:42.581 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-09-10T10:16:42.582 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 142, 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 435789, 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 142, 2024-09-10T10:16:42.583 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-10T10:16:42.584 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-10T10:16:42.584 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 142, 2024-09-10T10:16:42.584 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 435789, 2024-09-10T10:16:42.584 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-10T10:16:42.584 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:42.584 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:42.584 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:42.584 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:42.584 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:42.584 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:16:43.438 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-10T10:16:43.438 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-10T10:16:43.439 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-10T10:16:43.439 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-10T10:16:43.439 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T10:16:43.439 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T10:16:43.818 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:44.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:44 smithi050 ceph-mon[30354]: pgmap v557: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T10:16:44.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:44 smithi189 ceph-mon[34999]: pgmap v557: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T10:16:44.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:44 smithi084 ceph-mon[34812]: pgmap v557: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T10:16:44.400 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-10T10:16:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:16:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 0, 2024-09-10T10:16:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2, 2024-09-10T10:16:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 0, 2024-09-10T10:16:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 0, 2024-09-10T10:16:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-09-10T10:16:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2024-09-10T10:16:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.003110399, 2024-09-10T10:16:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T10:16:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000535886, 2024-09-10T10:16:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 152, 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 147, 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 460672, 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 88640, 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.033569566, 2024-09-10T10:16:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.015539396, 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.022415662, 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 147, 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.018398566, 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000125160 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 460672, 2024-09-10T10:16:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 88640 2024-09-10T10:16:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:16:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 1, 2024-09-10T10:16:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 109, 2024-09-10T10:16:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 160, 2024-09-10T10:16:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 97712, 2024-09-10T10:16:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 3, 2024-09-10T10:16:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2024-09-10T10:16:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.013403613, 2024-09-10T10:16:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.010589730, 2024-09-10T10:16:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.001188849, 2024-09-10T10:16:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 107, 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.006554313, 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000061255 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 97712 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-09-10T10:16:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:16:44.406 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:16:44.407 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:16:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-09-10T10:16:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:16:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:16:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:16:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-09-10T10:16:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-09-10T10:16:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-09-10T10:16:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:16:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:16:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:16:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:16:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 148984, 2024-09-10T10:16:44.408 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 30, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-09-10T10:16:44.409 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-09-10T10:16:44.410 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2024-09-10T10:16:44.410 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2024-09-10T10:16:44.410 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-09-10T10:16:44.410 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-09-10T10:16:44.410 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-09-10T10:16:44.410 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-09-10T10:16:44.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-10T10:16:44.410 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:16:44.410 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-09-10T10:16:44.410 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-09-10T10:16:44.410 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-09-10T10:16:44.410 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 149, 2024-09-10T10:16:44.410 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 436763, 2024-09-10T10:16:44.411 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:44.411 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 149, 2024-09-10T10:16:44.411 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-09-10T10:16:44.411 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-09-10T10:16:44.411 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 149, 2024-09-10T10:16:44.411 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 436763, 2024-09-10T10:16:44.411 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-09-10T10:16:44.411 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-09-10T10:16:44.411 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-09-10T10:16:44.411 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-09-10T10:16:44.411 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:44.411 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-10T10:16:44.411 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-10T10:16:45.147 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-10T10:16:45.147 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-10T10:16:45.147 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-10T10:16:45.147 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-10T10:16:45.147 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T10:16:45.148 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T10:16:45.407 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:16:45.953 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-10T10:16:45.953 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:16:45.953 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 1991, 2024-09-10T10:16:45.954 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 2001, 2024-09-10T10:16:45.954 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 534594, 2024-09-10T10:16:45.954 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 2476225, 2024-09-10T10:16:45.954 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 103, 2024-09-10T10:16:45.954 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 3, 2024-09-10T10:16:45.954 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.177331655, 2024-09-10T10:16:45.954 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.052211199, 2024-09-10T10:16:45.954 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.080925400, 2024-09-10T10:16:45.954 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.033942136, 2024-09-10T10:16:45.954 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:45.954 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2002, 2024-09-10T10:16:45.954 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.481351910, 2024-09-10T10:16:45.955 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000240435 2024-09-10T10:16:45.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.955 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:45.955 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 917, 2024-09-10T10:16:45.955 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000200292, 2024-09-10T10:16:45.955 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000218 2024-09-10T10:16:45.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.955 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:16:45.955 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:16:45.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.955 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:16:45.955 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 2032, 2024-09-10T10:16:45.955 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 1727, 2024-09-10T10:16:45.956 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 1055928, 2024-09-10T10:16:45.956 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 648506, 2024-09-10T10:16:45.956 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 10, 2024-09-10T10:16:45.956 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 6, 2024-09-10T10:16:45.956 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.165092091, 2024-09-10T10:16:45.956 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.046235514, 2024-09-10T10:16:45.956 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.073895817, 2024-09-10T10:16:45.956 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.048492280, 2024-09-10T10:16:45.956 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:45.956 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 1726, 2024-09-10T10:16:45.956 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.208141864, 2024-09-10T10:16:45.956 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000120592 2024-09-10T10:16:45.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.957 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:45.957 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 435, 2024-09-10T10:16:45.957 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000172752, 2024-09-10T10:16:45.957 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000397 2024-09-10T10:16:45.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.957 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 567408, 2024-09-10T10:16:45.957 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 134352 2024-09-10T10:16:45.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.957 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:16:45.957 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 2379, 2024-09-10T10:16:45.957 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 2496, 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 590345, 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 1077203, 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 14, 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 7, 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.164786617, 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.053380133, 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.062951107, 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.045101556, 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2492, 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.277194426, 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000111233 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.958 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 862, 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000182037, 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000211 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 267040 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 1, 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-MDSRank": { 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-09-10T10:16:45.959 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-09-10T10:16:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 586, 2024-09-10T10:16:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.128755969, 2024-09-10T10:16:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000219720 2024-09-10T10:16:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-PurgeQueue": { 2024-09-10T10:16:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-09-10T10:16:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-09-10T10:16:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 3467, 2024-09-10T10:16:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.093042976, 2024-09-10T10:16:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000026836 2024-09-10T10:16:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.961 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-09-10T10:16:45.961 INFO:teuthology.orchestra.run.smithi084.stdout: "request": 69, 2024-09-10T10:16:45.961 INFO:teuthology.orchestra.run.smithi084.stdout: "reply": 69, 2024-09-10T10:16:45.961 INFO:teuthology.orchestra.run.smithi084.stdout: "reply_latency": { 2024-09-10T10:16:45.961 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 69, 2024-09-10T10:16:45.961 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 16.997059090, 2024-09-10T10:16:45.961 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.246334189 2024-09-10T10:16:45.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.961 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_reply": 0, 2024-09-10T10:16:45.961 INFO:teuthology.orchestra.run.smithi084.stdout: "forward": 0, 2024-09-10T10:16:45.961 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_complete": 0, 2024-09-10T10:16:45.961 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_keys": 0, 2024-09-10T10:16:45.961 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_commit": 12, 2024-09-10T10:16:45.962 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_split": 0, 2024-09-10T10:16:45.962 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_merge": 0, 2024-09-10T10:16:45.962 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes": 24, 2024-09-10T10:16:45.962 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_top": 0, 2024-09-10T10:16:45.962 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_bottom": 24, 2024-09-10T10:16:45.962 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pin_tail": 0, 2024-09-10T10:16:45.962 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pinned": 23, 2024-09-10T10:16:45.962 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_expired": 0, 2024-09-10T10:16:45.962 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_with_caps": 2, 2024-09-10T10:16:45.962 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": 2, 2024-09-10T10:16:45.962 INFO:teuthology.orchestra.run.smithi084.stdout: "subtrees": 2, 2024-09-10T10:16:45.962 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse": 123, 2024-09-10T10:16:45.962 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_hit": 110, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_forward": 0, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_discover": 0, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_remote_ino": 0, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_lock": 0, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "load_cent": 14, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "q": 0, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "exported": 0, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "exported_inodes": 0, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "imported": 0, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "imported_inodes": 0, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_dir_fetch": 0, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_backtrace_fetch": 145, 2024-09-10T10:16:45.963 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_peer_discover": 0, 2024-09-10T10:16:45.964 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rfiles": 4, 2024-09-10T10:16:45.964 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rbytes": 234, 2024-09-10T10:16:45.964 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rsnaps": 0, 2024-09-10T10:16:45.964 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_fetch": 145, 2024-09-10T10:16:45.964 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_set_tag": 0, 2024-09-10T10:16:45.964 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:16:45.964 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:16:45.964 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_inodes": 94, 2024-09-10T10:16:45.964 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_base_inodes": 11, 2024-09-10T10:16:45.964 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dirfrag_rstats": 83, 2024-09-10T10:16:45.964 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_file_inodes": 51, 2024-09-10T10:16:45.964 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_inode_file_caps": 0, 2024-09-10T10:16:45.964 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_revoke": 23, 2024-09-10T10:16:45.965 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_grant": 122, 2024-09-10T10:16:45.965 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:16:45.965 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:16:45.965 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:16:45.965 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps": 169, 2024-09-10T10:16:45.965 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps_dirty": 139, 2024-09-10T10:16:45.965 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_cap_release": 8, 2024-09-10T10:16:45.965 INFO:teuthology.orchestra.run.smithi084.stdout: "process_request_cap_release": 29 2024-09-10T10:16:45.965 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.965 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_cache": { 2024-09-10T10:16:45.965 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update": 9, 2024-09-10T10:16:45.965 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update_receipt": 0, 2024-09-10T10:16:45.965 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_try_discover": 0, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_send_discover": 0, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_handle_discover": 20, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays": 0, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_delayed": 0, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_created": 5, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_enqueued": 5, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_reintegrated": 0, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_migrated": 0, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_processing": 0, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_started": 0, 2024-09-10T10:16:45.966 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_completed": 0, 2024-09-10T10:16:45.967 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_path": 4, 2024-09-10T10:16:45.967 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_inode": 52, 2024-09-10T10:16:45.967 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_enqueue_scrub": 11, 2024-09-10T10:16:45.967 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_exportdir": 0, 2024-09-10T10:16:45.967 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_flush": 0, 2024-09-10T10:16:45.967 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragmentdir": 0, 2024-09-10T10:16:45.967 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragstats": 0, 2024-09-10T10:16:45.967 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_inodestats": 0 2024-09-10T10:16:45.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.967 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_log": { 2024-09-10T10:16:45.967 INFO:teuthology.orchestra.run.smithi084.stdout: "evlrg": 0, 2024-09-10T10:16:45.967 INFO:teuthology.orchestra.run.smithi084.stdout: "evadd": 221, 2024-09-10T10:16:45.968 INFO:teuthology.orchestra.run.smithi084.stdout: "evex": 0, 2024-09-10T10:16:45.968 INFO:teuthology.orchestra.run.smithi084.stdout: "evtrm": 0, 2024-09-10T10:16:45.968 INFO:teuthology.orchestra.run.smithi084.stdout: "ev": 221, 2024-09-10T10:16:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: "evexg": 0, 2024-09-10T10:16:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: "evexd": 0, 2024-09-10T10:16:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: "segadd": 2, 2024-09-10T10:16:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: "segex": 0, 2024-09-10T10:16:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: "segtrm": 0, 2024-09-10T10:16:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: "seg": 2, 2024-09-10T10:16:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: "segmjr": 2, 2024-09-10T10:16:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: "segexg": 0, 2024-09-10T10:16:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: "segexd": 0, 2024-09-10T10:16:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: "expos": 4194304, 2024-09-10T10:16:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: "wrpos": 4911347, 2024-09-10T10:16:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: "rdpos": 0, 2024-09-10T10:16:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: "jlat": { 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 201, 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.370634369, 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.001843952 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: "replayed": 0 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_mem": { 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 23, 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: "ino+": 39, 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: "ino-": 16, 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: "dir": 18, 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: "dir+": 20, 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: "dir-": 2, 2024-09-10T10:16:45.970 INFO:teuthology.orchestra.run.smithi084.stdout: "dn": 24, 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: "dn+": 33, 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: "dn-": 9, 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: "cap": 2, 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: "cap+": 22, 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: "cap-": 20, 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: "rss": 53568, 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: "heap": 231712 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_server": { 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_client_request": 97, 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_server_request": 0, 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_request": 69, 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_session": 17, 2024-09-10T10:16:45.971 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_peer_request": 0, 2024-09-10T10:16:45.972 INFO:teuthology.orchestra.run.smithi084.stdout: "req_create_latency": { 2024-09-10T10:16:45.972 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 7, 2024-09-10T10:16:45.972 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.006369800, 2024-09-10T10:16:45.972 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000909971 2024-09-10T10:16:45.972 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.972 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getattr_latency": { 2024-09-10T10:16:45.972 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 28, 2024-09-10T10:16:45.972 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.007570924, 2024-09-10T10:16:45.972 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000270390 2024-09-10T10:16:45.972 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.972 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getfilelock_latency": { 2024-09-10T10:16:45.972 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.973 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.973 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.973 INFO:teuthology.orchestra.run.smithi084.stdout: "req_link_latency": { 2024-09-10T10:16:45.973 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.973 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.973 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.973 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookup_latency": { 2024-09-10T10:16:45.973 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 3, 2024-09-10T10:16:45.973 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.001173909, 2024-09-10T10:16:45.973 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000391303 2024-09-10T10:16:45.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.974 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookuphash_latency": { 2024-09-10T10:16:45.974 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.974 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.974 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.974 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupino_latency": { 2024-09-10T10:16:45.974 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 1, 2024-09-10T10:16:45.974 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000182422, 2024-09-10T10:16:45.974 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000182422 2024-09-10T10:16:45.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.974 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupname_latency": { 2024-09-10T10:16:45.974 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupparent_latency": { 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupsnap_latency": { 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.975 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lssnap_latency": { 2024-09-10T10:16:45.976 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.976 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.976 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.976 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mkdir_latency": { 2024-09-10T10:16:45.977 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 8, 2024-09-10T10:16:45.977 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 16.938934772, 2024-09-10T10:16:45.977 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 2.117366846 2024-09-10T10:16:45.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.977 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mknod_latency": { 2024-09-10T10:16:45.977 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.977 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.977 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.977 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mksnap_latency": { 2024-09-10T10:16:45.977 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.977 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.977 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: "req_open_latency": { 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 3, 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.001567503, 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000522501 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: "req_readdir_latency": { 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2, 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000881871, 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000440935 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rename_latency": { 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2, 2024-09-10T10:16:45.978 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.001959406, 2024-09-10T10:16:45.979 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000979703 2024-09-10T10:16:45.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.979 INFO:teuthology.orchestra.run.smithi084.stdout: "req_renamesnap_latency": { 2024-09-10T10:16:45.979 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.979 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.979 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.979 INFO:teuthology.orchestra.run.smithi084.stdout: "req_snapdiff_latency": { 2024-09-10T10:16:45.979 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.979 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.979 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.979 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmdir_latency": { 2024-09-10T10:16:45.980 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2, 2024-09-10T10:16:45.980 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.009894811, 2024-09-10T10:16:45.980 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.004947405 2024-09-10T10:16:45.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.980 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmsnap_latency": { 2024-09-10T10:16:45.980 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.980 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.980 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.980 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmxattr_latency": { 2024-09-10T10:16:45.980 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.980 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.980 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setattr_latency": { 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2, 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.001275880, 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000637940 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setdirlayout_latency": { 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setfilelock_latency": { 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.981 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.982 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.982 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setlayout_latency": { 2024-09-10T10:16:45.982 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.982 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.982 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.982 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setxattr_latency": { 2024-09-10T10:16:45.982 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 8, 2024-09-10T10:16:45.982 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.021273534, 2024-09-10T10:16:45.982 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.002659191 2024-09-10T10:16:45.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.982 INFO:teuthology.orchestra.run.smithi084.stdout: "req_symlink_latency": { 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: "req_unlink_latency": { 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 3, 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.005974258, 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.001991419 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getvxattr_latency": { 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.983 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.984 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:45.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.984 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_sessions": { 2024-09-10T10:16:45.984 INFO:teuthology.orchestra.run.smithi084.stdout: "session_count": 1, 2024-09-10T10:16:45.984 INFO:teuthology.orchestra.run.smithi084.stdout: "session_add": 3, 2024-09-10T10:16:45.984 INFO:teuthology.orchestra.run.smithi084.stdout: "session_remove": 2, 2024-09-10T10:16:45.984 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_open": 1, 2024-09-10T10:16:45.984 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_stale": 0, 2024-09-10T10:16:45.984 INFO:teuthology.orchestra.run.smithi084.stdout: "total_load": 9, 2024-09-10T10:16:45.984 INFO:teuthology.orchestra.run.smithi084.stdout: "average_load": 9, 2024-09-10T10:16:45.984 INFO:teuthology.orchestra.run.smithi084.stdout: "avg_session_uptime": 328, 2024-09-10T10:16:45.984 INFO:teuthology.orchestra.run.smithi084.stdout: "mdthresh_evicted": 0 2024-09-10T10:16:45.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:16:45.985 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:16:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 286453, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 93, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:16:45.987 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 8856, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 166, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 96162, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 672, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-10T10:16:45.988 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: "objecter": { 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: "op_active": 0, 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: "op_laggy": 0, 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send": 4569, 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send_bytes": 737020, 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: "op_resend": 36, 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: "op_reply": 4569, 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: "op_latency": { 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 4569, 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 44.151141425, 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.009663195 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.989 INFO:teuthology.orchestra.run.smithi084.stdout: "op_inflight": 0, 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "oplen_avg": { 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 4569, 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 4629 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "op": 4569, 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "op_r": 172, 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "op_w": 4397, 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "op_rmw": 0, 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "op_pg": 0, 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_stat": 0, 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_create": 11, 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_read": 16, 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_write": 206, 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writefull": 31, 2024-09-10T10:16:45.990 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writesame": 0, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_append": 0, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_zero": 0, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_truncate": 0, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_delete": 4103, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_mapext": 0, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_sparse_read": 0, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_clonerange": 0, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_getxattr": 156, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_setxattr": 22, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_rmxattr": 0, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_call": 0, 2024-09-10T10:16:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_watch": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_notify": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_other": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_active": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_send": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_resend": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_ping": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_active": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_send": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_resend": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_active": 0, 2024-09-10T10:16:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_send": 0, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_resend": 0, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_active": 0, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_send": 0, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_resend": 0, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "command_active": 0, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "command_send": 0, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "command_resend": 0, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "map_epoch": 95, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "map_full": 0, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "map_inc": 11, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_sessions": 12, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_open": 12, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_close": 0, 2024-09-10T10:16:45.993 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_laggy": 0, 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_wr": 68, 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_rd": 0, 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_del": 16 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: "oft": { 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_objs": 1, 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_updates": 0, 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_removes": 0 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: "osd-slow-ops": { 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_ops_count": 57 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.994 INFO:teuthology.orchestra.run.smithi084.stdout: "purge_queue": { 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops": 0, 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops_high_water": 2561, 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing": 0, 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_high_water": 1, 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed_ops": 3591, 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed": 5, 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_item_in_journal": 0 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 6398, 2024-09-10T10:16:45.995 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 1593273, 2024-09-10T10:16:45.996 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:45.996 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 6398, 2024-09-10T10:16:45.996 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-10T10:16:45.996 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-10T10:16:45.996 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 6398, 2024-09-10T10:16:45.996 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 1593273, 2024-09-10T10:16:45.996 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:45.996 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.996 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.996 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.996 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:45.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.996 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_bytes": { 2024-09-10T10:16:45.997 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:45.997 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-10T10:16:45.997 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:45.997 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-10T10:16:45.997 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-10T10:16:45.997 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:45.997 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:45.997 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 4569, 2024-09-10T10:16:45.997 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 737549, 2024-09-10T10:16:45.997 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 4569, 2024-09-10T10:16:45.997 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 737549, 2024-09-10T10:16:45.997 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:45.997 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_ops": { 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 1024, 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 4569, 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 4569, 2024-09-10T10:16:45.998 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 4569, 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 4569, 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 5, 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 529, 2024-09-10T10:16:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 5, 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 5, 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 529, 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle-0x55f143470960": { 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:46.000 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-09-10T10:16:46.001 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:46.001 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 221, 2024-09-10T10:16:46.001 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 717043, 2024-09-10T10:16:46.001 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:46.001 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 221, 2024-09-10T10:16:46.001 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-10T10:16:46.001 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-10T10:16:46.001 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 201, 2024-09-10T10:16:46.001 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 717043, 2024-09-10T10:16:46.001 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:46.001 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:46.001 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:46.001 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:46.002 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:46.002 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:46.002 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-10T10:16:46.315 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:46 smithi050 ceph-mon[30354]: pgmap v558: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:16:46.328 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:46 smithi084 ceph-mon[34812]: pgmap v558: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:16:46.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:46 smithi189 ceph-mon[34999]: pgmap v558: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:16:46.951 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-10T10:16:46.951 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-10T10:16:46.952 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=9 2024-09-10T10:16:46.952 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-10T10:16:46.952 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T10:16:46.952 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T10:16:47.203 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:16:47.323 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:47 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:16:47.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:47 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:16:47.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:47 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:16:47.746 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-10T10:16:47.747 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:16:47.747 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 1236, 2024-09-10T10:16:47.747 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 1238, 2024-09-10T10:16:47.747 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 352858, 2024-09-10T10:16:47.747 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 393055, 2024-09-10T10:16:47.747 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 6, 2024-09-10T10:16:47.747 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-10T10:16:47.747 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.093411540, 2024-09-10T10:16:47.747 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.031102634, 2024-09-10T10:16:47.747 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.023251246, 2024-09-10T10:16:47.747 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.031096861, 2024-09-10T10:16:47.747 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:47.747 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 1236, 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.038516581, 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000031162 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 162, 2024-09-10T10:16:47.748 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 155, 2024-09-10T10:16:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 484636, 2024-09-10T10:16:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 89882, 2024-09-10T10:16:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 3, 2024-09-10T10:16:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-10T10:16:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.024785510, 2024-09-10T10:16:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.010275091, 2024-09-10T10:16:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.018378489, 2024-09-10T10:16:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000052232, 2024-09-10T10:16:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 155, 2024-09-10T10:16:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.013321866, 2024-09-10T10:16:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000085947 2024-09-10T10:16:47.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.750 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:47.750 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.750 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.750 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.750 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 484080, 2024-09-10T10:16:47.750 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 89184 2024-09-10T10:16:47.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.750 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:16:47.750 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 2, 2024-09-10T10:16:47.750 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 110, 2024-09-10T10:16:47.750 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 428, 2024-09-10T10:16:47.751 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 251134, 2024-09-10T10:16:47.751 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-10T10:16:47.751 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 3, 2024-09-10T10:16:47.751 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.006590782, 2024-09-10T10:16:47.751 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.004464439, 2024-09-10T10:16:47.751 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.000891055, 2024-09-10T10:16:47.751 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000017601, 2024-09-10T10:16:47.751 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:47.751 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 108, 2024-09-10T10:16:47.751 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.007563469, 2024-09-10T10:16:47.751 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000070032 2024-09-10T10:16:47.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.751 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:47.752 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.752 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.752 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.752 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T10:16:47.752 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 250816 2024-09-10T10:16:47.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.752 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-10T10:16:47.752 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 1, 2024-09-10T10:16:47.752 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-10T10:16:47.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.752 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-MDSRank": { 2024-09-10T10:16:47.752 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-09-10T10:16:47.753 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-09-10T10:16:47.753 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2118, 2024-09-10T10:16:47.753 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.049042142, 2024-09-10T10:16:47.753 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000023154 2024-09-10T10:16:47.753 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:47.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.753 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-PurgeQueue": { 2024-09-10T10:16:47.753 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-09-10T10:16:47.753 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-09-10T10:16:47.753 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.753 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.754 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.754 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:47.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.754 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-09-10T10:16:47.754 INFO:teuthology.orchestra.run.smithi084.stdout: "request": 0, 2024-09-10T10:16:47.754 INFO:teuthology.orchestra.run.smithi084.stdout: "reply": 0, 2024-09-10T10:16:47.754 INFO:teuthology.orchestra.run.smithi084.stdout: "reply_latency": { 2024-09-10T10:16:47.754 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.754 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.754 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.754 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_reply": 0, 2024-09-10T10:16:47.754 INFO:teuthology.orchestra.run.smithi084.stdout: "forward": 0, 2024-09-10T10:16:47.755 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_complete": 0, 2024-09-10T10:16:47.755 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_keys": 0, 2024-09-10T10:16:47.755 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_commit": 0, 2024-09-10T10:16:47.755 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_split": 0, 2024-09-10T10:16:47.755 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_merge": 0, 2024-09-10T10:16:47.755 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes": 0, 2024-09-10T10:16:47.755 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_top": 0, 2024-09-10T10:16:47.755 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_bottom": 0, 2024-09-10T10:16:47.755 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pin_tail": 0, 2024-09-10T10:16:47.755 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pinned": 0, 2024-09-10T10:16:47.755 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_expired": 0, 2024-09-10T10:16:47.755 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_with_caps": 0, 2024-09-10T10:16:47.755 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": 0, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "subtrees": 1, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse": 0, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_hit": 0, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_forward": 0, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_discover": 0, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_remote_ino": 0, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_lock": 0, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "load_cent": 0, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "q": 0, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "exported": 0, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "exported_inodes": 0, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "imported": 0, 2024-09-10T10:16:47.756 INFO:teuthology.orchestra.run.smithi084.stdout: "imported_inodes": 0, 2024-09-10T10:16:47.757 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_dir_fetch": 0, 2024-09-10T10:16:47.757 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:16:47.757 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_peer_discover": 0, 2024-09-10T10:16:47.757 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rfiles": 0, 2024-09-10T10:16:47.757 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rbytes": 0, 2024-09-10T10:16:47.757 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rsnaps": 0, 2024-09-10T10:16:47.757 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:16:47.757 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_set_tag": 0, 2024-09-10T10:16:47.757 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:16:47.757 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:16:47.757 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:16:47.757 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:16:47.757 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_file_inodes": 0, 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_inode_file_caps": 0, 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_grant": 0, 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps": 0, 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps_dirty": 0, 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_cap_release": 0, 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: "process_request_cap_release": 0 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_cache": { 2024-09-10T10:16:47.758 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update": 0, 2024-09-10T10:16:47.759 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update_receipt": 0, 2024-09-10T10:16:47.759 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_try_discover": 0, 2024-09-10T10:16:47.759 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_send_discover": 0, 2024-09-10T10:16:47.759 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_handle_discover": 0, 2024-09-10T10:16:47.759 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays": 0, 2024-09-10T10:16:47.759 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_delayed": 0, 2024-09-10T10:16:47.759 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:16:47.759 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_created": 0, 2024-09-10T10:16:47.759 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_enqueued": 0, 2024-09-10T10:16:47.759 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_reintegrated": 0, 2024-09-10T10:16:47.760 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_migrated": 0, 2024-09-10T10:16:47.760 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_processing": 0, 2024-09-10T10:16:47.760 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:16:47.760 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:16:47.760 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_started": 0, 2024-09-10T10:16:47.760 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_completed": 0, 2024-09-10T10:16:47.760 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_path": 0, 2024-09-10T10:16:47.760 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_inode": 0, 2024-09-10T10:16:47.760 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:16:47.760 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_exportdir": 0, 2024-09-10T10:16:47.760 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_flush": 0, 2024-09-10T10:16:47.760 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragmentdir": 0, 2024-09-10T10:16:47.760 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragstats": 0, 2024-09-10T10:16:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_inodestats": 0 2024-09-10T10:16:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_log": { 2024-09-10T10:16:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: "evlrg": 0, 2024-09-10T10:16:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: "evadd": 0, 2024-09-10T10:16:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: "evex": 0, 2024-09-10T10:16:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: "evtrm": 0, 2024-09-10T10:16:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: "ev": 5, 2024-09-10T10:16:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: "evexg": 0, 2024-09-10T10:16:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: "evexd": 0, 2024-09-10T10:16:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: "segadd": 0, 2024-09-10T10:16:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: "segex": 0, 2024-09-10T10:16:47.761 INFO:teuthology.orchestra.run.smithi084.stdout: "segtrm": 0, 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: "seg": 2, 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: "segmjr": 2, 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: "segexg": 0, 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: "segexd": 0, 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: "expos": 4194304, 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: "wrpos": 4195737, 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: "rdpos": 4195426, 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: "jlat": { 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: "replayed": 5 2024-09-10T10:16:47.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_mem": { 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 3, 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "ino+": 3, 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "ino-": 0, 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "dir": 1, 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "dir+": 1, 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "dir-": 0, 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "dn": 0, 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "dn+": 0, 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "dn-": 0, 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "cap": 0, 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "cap+": 0, 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "cap-": 0, 2024-09-10T10:16:47.763 INFO:teuthology.orchestra.run.smithi084.stdout: "rss": 48288, 2024-09-10T10:16:47.764 INFO:teuthology.orchestra.run.smithi084.stdout: "heap": 215328 2024-09-10T10:16:47.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.764 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_server": { 2024-09-10T10:16:47.764 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_client_request": 0, 2024-09-10T10:16:47.764 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_server_request": 0, 2024-09-10T10:16:47.764 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_request": 0, 2024-09-10T10:16:47.764 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_session": 0, 2024-09-10T10:16:47.764 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_peer_request": 0, 2024-09-10T10:16:47.764 INFO:teuthology.orchestra.run.smithi084.stdout: "req_create_latency": { 2024-09-10T10:16:47.764 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.764 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.764 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getattr_latency": { 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getfilelock_latency": { 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: "req_link_latency": { 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.766 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookup_latency": { 2024-09-10T10:16:47.766 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.766 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.766 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.766 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookuphash_latency": { 2024-09-10T10:16:47.766 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.766 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.766 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.766 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupino_latency": { 2024-09-10T10:16:47.766 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupname_latency": { 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupparent_latency": { 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupsnap_latency": { 2024-09-10T10:16:47.767 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lssnap_latency": { 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mkdir_latency": { 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.768 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mknod_latency": { 2024-09-10T10:16:47.769 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.769 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.769 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.769 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mksnap_latency": { 2024-09-10T10:16:47.769 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.769 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.769 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.769 INFO:teuthology.orchestra.run.smithi084.stdout: "req_open_latency": { 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: "req_readdir_latency": { 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rename_latency": { 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.771 INFO:teuthology.orchestra.run.smithi084.stdout: "req_renamesnap_latency": { 2024-09-10T10:16:47.771 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.771 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.771 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.771 INFO:teuthology.orchestra.run.smithi084.stdout: "req_snapdiff_latency": { 2024-09-10T10:16:47.771 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.771 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.771 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.771 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmdir_latency": { 2024-09-10T10:16:47.771 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.771 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmsnap_latency": { 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmxattr_latency": { 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setattr_latency": { 2024-09-10T10:16:47.772 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.773 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.773 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.773 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setdirlayout_latency": { 2024-09-10T10:16:47.773 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.773 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.773 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.773 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setfilelock_latency": { 2024-09-10T10:16:47.773 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.773 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.773 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setlayout_latency": { 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setxattr_latency": { 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: "req_symlink_latency": { 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.774 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: "req_unlink_latency": { 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getvxattr_latency": { 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.775 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_sessions": { 2024-09-10T10:16:47.776 INFO:teuthology.orchestra.run.smithi084.stdout: "session_count": 1, 2024-09-10T10:16:47.776 INFO:teuthology.orchestra.run.smithi084.stdout: "session_add": 2, 2024-09-10T10:16:47.776 INFO:teuthology.orchestra.run.smithi084.stdout: "session_remove": 1, 2024-09-10T10:16:47.776 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_open": 1, 2024-09-10T10:16:47.776 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_stale": 0, 2024-09-10T10:16:47.776 INFO:teuthology.orchestra.run.smithi084.stdout: "total_load": 0, 2024-09-10T10:16:47.776 INFO:teuthology.orchestra.run.smithi084.stdout: "average_load": 0, 2024-09-10T10:16:47.776 INFO:teuthology.orchestra.run.smithi084.stdout: "avg_session_uptime": 1719, 2024-09-10T10:16:47.776 INFO:teuthology.orchestra.run.smithi084.stdout: "mdthresh_evicted": 0 2024-09-10T10:16:47.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.776 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-10T10:16:47.776 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:16:47.776 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:16:47.777 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-10T10:16:47.778 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 181343, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 47, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:16:47.779 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 8856, 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 166, 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 8512, 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 13, 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.780 INFO:teuthology.orchestra.run.smithi084.stdout: "objecter": { 2024-09-10T10:16:47.781 INFO:teuthology.orchestra.run.smithi084.stdout: "op_active": 0, 2024-09-10T10:16:47.781 INFO:teuthology.orchestra.run.smithi084.stdout: "op_laggy": 0, 2024-09-10T10:16:47.781 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send": 1239, 2024-09-10T10:16:47.781 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send_bytes": 21, 2024-09-10T10:16:47.781 INFO:teuthology.orchestra.run.smithi084.stdout: "op_resend": 3, 2024-09-10T10:16:47.781 INFO:teuthology.orchestra.run.smithi084.stdout: "op_reply": 1239, 2024-09-10T10:16:47.781 INFO:teuthology.orchestra.run.smithi084.stdout: "op_latency": { 2024-09-10T10:16:47.781 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 1239, 2024-09-10T10:16:47.781 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.613988058, 2024-09-10T10:16:47.781 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000495551 2024-09-10T10:16:47.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.781 INFO:teuthology.orchestra.run.smithi084.stdout: "op_inflight": 0, 2024-09-10T10:16:47.781 INFO:teuthology.orchestra.run.smithi084.stdout: "oplen_avg": { 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 1239, 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 1240 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: "op": 1239, 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: "op_r": 1239, 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: "op_w": 0, 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: "op_rmw": 0, 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: "op_pg": 0, 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_stat": 789, 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_create": 0, 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_read": 448, 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_write": 0, 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writefull": 0, 2024-09-10T10:16:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writesame": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_append": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_zero": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_truncate": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_delete": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_mapext": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_sparse_read": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_clonerange": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_getxattr": 1, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_setxattr": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_rmxattr": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_call": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_watch": 0, 2024-09-10T10:16:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_notify": 0, 2024-09-10T10:16:47.784 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:16:47.784 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls": 0, 2024-09-10T10:16:47.784 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:16:47.784 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_other": 0, 2024-09-10T10:16:47.784 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_active": 0, 2024-09-10T10:16:47.784 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_send": 0, 2024-09-10T10:16:47.784 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_resend": 0, 2024-09-10T10:16:47.784 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_ping": 0, 2024-09-10T10:16:47.784 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_active": 0, 2024-09-10T10:16:47.784 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_send": 0, 2024-09-10T10:16:47.784 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_resend": 0, 2024-09-10T10:16:47.784 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_active": 0, 2024-09-10T10:16:47.784 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_send": 0, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_resend": 0, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_active": 0, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_send": 0, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_resend": 0, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "command_active": 0, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "command_send": 0, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "command_resend": 0, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "map_epoch": 95, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "map_full": 0, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "map_inc": 2, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_sessions": 4, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_open": 4, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_close": 0, 2024-09-10T10:16:47.785 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_laggy": 0, 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_wr": 0, 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_rd": 2, 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_del": 0 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: "oft": { 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_objs": 0, 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_updates": 0, 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_removes": 0 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: "osd-slow-ops": { 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_ops_count": 0 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: "purge_queue": { 2024-09-10T10:16:47.786 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops": 0, 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing": 0, 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_high_water": 0, 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed_ops": 0, 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed": 0, 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_item_in_journal": 0 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 1396, 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 701262, 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:47.787 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 1396, 2024-09-10T10:16:47.788 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-10T10:16:47.788 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-10T10:16:47.788 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 1396, 2024-09-10T10:16:47.788 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 701262, 2024-09-10T10:16:47.788 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:47.788 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.788 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.788 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.788 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:47.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.788 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_bytes": { 2024-09-10T10:16:47.788 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:47.788 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 1239, 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 1438, 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 1239, 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 1438, 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:47.789 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_ops": { 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 1024, 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 1239, 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 1239, 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 1239, 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 1239, 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:47.790 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 0, 2024-09-10T10:16:47.791 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 0, 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle-0x55927be96b40": { 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:47.792 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:47.793 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-10T10:16:47.793 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-10T10:16:47.793 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 0, 2024-09-10T10:16:47.793 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 0, 2024-09-10T10:16:47.793 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:47.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:47.793 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:47.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:47.793 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:47.793 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:47.793 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-10T10:16:48.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:48 smithi189 ceph-mon[34999]: pgmap v559: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:16:48.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:48 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:16:48.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:48 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:16:48.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:48 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:16:48.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:48 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:16:48.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:48 smithi189 ceph-mon[34999]: Adjusting osd_memory_target on smithi050 to 177.5M 2024-09-10T10:16:48.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:48 smithi189 ceph-mon[34999]: Unable to set osd_memory_target on smithi050 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-10T10:16:48.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:48 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:16:48.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:48 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:16:48.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:48 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:16:48.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:48 smithi084 ceph-mon[34812]: pgmap v559: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:16:48.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:48 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:16:48.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:48 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:16:48.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:48 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:16:48.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:48 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:16:48.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:48 smithi084 ceph-mon[34812]: Adjusting osd_memory_target on smithi050 to 177.5M 2024-09-10T10:16:48.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:48 smithi084 ceph-mon[34812]: Unable to set osd_memory_target on smithi050 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-10T10:16:48.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:48 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:16:48.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:48 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:16:48.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:48 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:16:48.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:48 smithi050 ceph-mon[30354]: pgmap v559: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:16:48.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:48 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:16:48.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:48 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:16:48.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:48 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:16:48.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:48 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:16:48.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:48 smithi050 ceph-mon[30354]: Adjusting osd_memory_target on smithi050 to 177.5M 2024-09-10T10:16:48.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:48 smithi050 ceph-mon[30354]: Unable to set osd_memory_target on smithi050 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-10T10:16:48.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:48 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:16:48.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:48 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:16:48.466 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:48 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' 2024-09-10T10:16:48.497 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-10T10:16:48.497 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-10T10:16:48.497 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-10T10:16:48.497 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-10T10:16:48.497 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T10:16:48.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T10:16:48.743 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:16:49.283 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-10T10:16:49.283 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:16:49.283 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 471, 2024-09-10T10:16:49.283 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 462, 2024-09-10T10:16:49.283 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 123586, 2024-09-10T10:16:49.283 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 442710, 2024-09-10T10:16:49.284 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 32, 2024-09-10T10:16:49.284 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 6, 2024-09-10T10:16:49.284 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.058524267, 2024-09-10T10:16:49.284 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.021048930, 2024-09-10T10:16:49.284 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.033105198, 2024-09-10T10:16:49.284 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.002275521, 2024-09-10T10:16:49.284 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:49.284 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 460, 2024-09-10T10:16:49.284 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.068751716, 2024-09-10T10:16:49.284 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000149460 2024-09-10T10:16:49.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 850, 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000181986, 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000214 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 231, 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 220, 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 512637, 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 134787, 2024-09-10T10:16:49.285 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 10, 2024-09-10T10:16:49.286 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 4, 2024-09-10T10:16:49.286 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.033046748, 2024-09-10T10:16:49.286 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.011130512, 2024-09-10T10:16:49.286 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.025400762, 2024-09-10T10:16:49.286 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.002295617, 2024-09-10T10:16:49.286 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:49.286 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 220, 2024-09-10T10:16:49.286 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.029205492, 2024-09-10T10:16:49.286 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000132752 2024-09-10T10:16:49.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.286 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:49.286 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 59, 2024-09-10T10:16:49.286 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000011345, 2024-09-10T10:16:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000192 2024-09-10T10:16:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 497760, 2024-09-10T10:16:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 93280 2024-09-10T10:16:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:16:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 18, 2024-09-10T10:16:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 124, 2024-09-10T10:16:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 4795, 2024-09-10T10:16:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 285635, 2024-09-10T10:16:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 10, 2024-09-10T10:16:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 4, 2024-09-10T10:16:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.012723548, 2024-09-10T10:16:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.005987357, 2024-09-10T10:16:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.004854309, 2024-09-10T10:16:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000425035, 2024-09-10T10:16:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 122, 2024-09-10T10:16:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.013813581, 2024-09-10T10:16:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000113226 2024-09-10T10:16:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 9, 2024-09-10T10:16:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000004064, 2024-09-10T10:16:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000451 2024-09-10T10:16:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T10:16:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 250464 2024-09-10T10:16:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-10T10:16:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 1, 2024-09-10T10:16:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-10T10:16:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-MDSRank": { 2024-09-10T10:16:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-09-10T10:16:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-09-10T10:16:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 53, 2024-09-10T10:16:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.001473777, 2024-09-10T10:16:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000027807 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-PurgeQueue": { 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2, 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000014254, 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000007127 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: "request": 1, 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: "reply": 1, 2024-09-10T10:16:49.290 INFO:teuthology.orchestra.run.smithi084.stdout: "reply_latency": { 2024-09-10T10:16:49.291 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 1, 2024-09-10T10:16:49.291 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000098390, 2024-09-10T10:16:49.291 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000098390 2024-09-10T10:16:49.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.291 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_reply": 0, 2024-09-10T10:16:49.291 INFO:teuthology.orchestra.run.smithi084.stdout: "forward": 0, 2024-09-10T10:16:49.291 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_complete": 0, 2024-09-10T10:16:49.291 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_keys": 0, 2024-09-10T10:16:49.291 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_commit": 11, 2024-09-10T10:16:49.291 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_split": 0, 2024-09-10T10:16:49.291 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_merge": 0, 2024-09-10T10:16:49.291 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes": 16, 2024-09-10T10:16:49.291 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_top": 0, 2024-09-10T10:16:49.292 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_bottom": 16, 2024-09-10T10:16:49.292 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pin_tail": 0, 2024-09-10T10:16:49.292 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pinned": 13, 2024-09-10T10:16:49.292 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_expired": 4, 2024-09-10T10:16:49.292 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_with_caps": 1, 2024-09-10T10:16:49.292 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": 1, 2024-09-10T10:16:49.292 INFO:teuthology.orchestra.run.smithi084.stdout: "subtrees": 3, 2024-09-10T10:16:49.292 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse": 17, 2024-09-10T10:16:49.292 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_hit": 13, 2024-09-10T10:16:49.292 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_forward": 0, 2024-09-10T10:16:49.292 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_discover": 4, 2024-09-10T10:16:49.292 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:16:49.292 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_remote_ino": 0, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_lock": 0, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "load_cent": 0, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "q": 0, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "exported": 0, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "exported_inodes": 0, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "imported": 0, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "imported_inodes": 0, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_dir_fetch": 0, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_peer_discover": 0, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rfiles": 4, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rbytes": 234, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rsnaps": 0, 2024-09-10T10:16:49.293 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_set_tag": 0, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_file_inodes": 0, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_inode_file_caps": 0, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_revoke": 1, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_grant": 0, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:16:49.294 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps": 1, 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps_dirty": 0, 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_cap_release": 0, 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: "process_request_cap_release": 0 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_cache": { 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update": 0, 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update_receipt": 14, 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_try_discover": 9, 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_send_discover": 10, 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_handle_discover": 0, 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays": 0, 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_delayed": 0, 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:16:49.295 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_created": 0, 2024-09-10T10:16:49.296 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_enqueued": 0, 2024-09-10T10:16:49.296 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_reintegrated": 0, 2024-09-10T10:16:49.296 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_migrated": 0, 2024-09-10T10:16:49.296 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_processing": 0, 2024-09-10T10:16:49.296 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:16:49.296 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:16:49.296 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_started": 0, 2024-09-10T10:16:49.296 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_completed": 0, 2024-09-10T10:16:49.296 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_path": 4, 2024-09-10T10:16:49.296 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_inode": 27, 2024-09-10T10:16:49.296 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:16:49.296 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_exportdir": 0, 2024-09-10T10:16:49.296 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_flush": 0, 2024-09-10T10:16:49.297 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragmentdir": 0, 2024-09-10T10:16:49.297 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragstats": 0, 2024-09-10T10:16:49.297 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_inodestats": 0 2024-09-10T10:16:49.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.297 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_log": { 2024-09-10T10:16:49.297 INFO:teuthology.orchestra.run.smithi084.stdout: "evlrg": 0, 2024-09-10T10:16:49.297 INFO:teuthology.orchestra.run.smithi084.stdout: "evadd": 5, 2024-09-10T10:16:49.297 INFO:teuthology.orchestra.run.smithi084.stdout: "evex": 0, 2024-09-10T10:16:49.297 INFO:teuthology.orchestra.run.smithi084.stdout: "evtrm": 0, 2024-09-10T10:16:49.297 INFO:teuthology.orchestra.run.smithi084.stdout: "ev": 5, 2024-09-10T10:16:49.297 INFO:teuthology.orchestra.run.smithi084.stdout: "evexg": 0, 2024-09-10T10:16:49.297 INFO:teuthology.orchestra.run.smithi084.stdout: "evexd": 0, 2024-09-10T10:16:49.297 INFO:teuthology.orchestra.run.smithi084.stdout: "segadd": 2, 2024-09-10T10:16:49.298 INFO:teuthology.orchestra.run.smithi084.stdout: "segex": 0, 2024-09-10T10:16:49.298 INFO:teuthology.orchestra.run.smithi084.stdout: "segtrm": 0, 2024-09-10T10:16:49.298 INFO:teuthology.orchestra.run.smithi084.stdout: "seg": 2, 2024-09-10T10:16:49.298 INFO:teuthology.orchestra.run.smithi084.stdout: "segmjr": 2, 2024-09-10T10:16:49.298 INFO:teuthology.orchestra.run.smithi084.stdout: "segexg": 0, 2024-09-10T10:16:49.298 INFO:teuthology.orchestra.run.smithi084.stdout: "segexd": 0, 2024-09-10T10:16:49.298 INFO:teuthology.orchestra.run.smithi084.stdout: "expos": 4194304, 2024-09-10T10:16:49.298 INFO:teuthology.orchestra.run.smithi084.stdout: "wrpos": 4195737, 2024-09-10T10:16:49.298 INFO:teuthology.orchestra.run.smithi084.stdout: "rdpos": 0, 2024-09-10T10:16:49.298 INFO:teuthology.orchestra.run.smithi084.stdout: "jlat": { 2024-09-10T10:16:49.298 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 4, 2024-09-10T10:16:49.298 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.007253709, 2024-09-10T10:16:49.298 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.001813427 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: "replayed": 0 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_mem": { 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 20, 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: "ino+": 22, 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: "ino-": 2, 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: "dir": 19, 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: "dir+": 23, 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: "dir-": 4, 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: "dn": 16, 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: "dn+": 20, 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: "dn-": 4, 2024-09-10T10:16:49.299 INFO:teuthology.orchestra.run.smithi084.stdout: "cap": 1, 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: "cap+": 1, 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: "cap-": 0, 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: "rss": 49892, 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: "heap": 223520 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_server": { 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_client_request": 1, 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_server_request": 0, 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_request": 1, 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_session": 9, 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_peer_request": 0, 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: "req_create_latency": { 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.300 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getattr_latency": { 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getfilelock_latency": { 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: "req_link_latency": { 2024-09-10T10:16:49.301 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookup_latency": { 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookuphash_latency": { 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupino_latency": { 2024-09-10T10:16:49.302 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 1, 2024-09-10T10:16:49.303 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000098390, 2024-09-10T10:16:49.303 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000098390 2024-09-10T10:16:49.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.303 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupname_latency": { 2024-09-10T10:16:49.303 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.303 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.303 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.303 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupparent_latency": { 2024-09-10T10:16:49.303 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.303 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.303 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.304 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupsnap_latency": { 2024-09-10T10:16:49.304 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.304 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.304 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.304 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lssnap_latency": { 2024-09-10T10:16:49.304 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.304 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.304 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.304 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mkdir_latency": { 2024-09-10T10:16:49.304 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.305 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.305 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.305 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mknod_latency": { 2024-09-10T10:16:49.305 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.305 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.305 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mksnap_latency": { 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: "req_open_latency": { 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: "req_readdir_latency": { 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.306 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rename_latency": { 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: "req_renamesnap_latency": { 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: "req_snapdiff_latency": { 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmdir_latency": { 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmsnap_latency": { 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmxattr_latency": { 2024-09-10T10:16:49.308 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.309 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.309 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.309 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setattr_latency": { 2024-09-10T10:16:49.309 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.309 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.309 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.309 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setdirlayout_latency": { 2024-09-10T10:16:49.309 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.309 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.309 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setfilelock_latency": { 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setlayout_latency": { 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setxattr_latency": { 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: "req_symlink_latency": { 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: "req_unlink_latency": { 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getvxattr_latency": { 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.311 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_sessions": { 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: "session_count": 1, 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: "session_add": 2, 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: "session_remove": 1, 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_open": 1, 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_stale": 0, 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: "total_load": 1, 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: "average_load": 1, 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: "avg_session_uptime": 303, 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: "mdthresh_evicted": 0 2024-09-10T10:16:49.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:16:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-10T10:16:49.314 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:16:49.315 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:16:49.315 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:16:49.315 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-10T10:16:49.315 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-10T10:16:49.315 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-10T10:16:49.315 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:16:49.315 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:16:49.315 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:16:49.315 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:16:49.315 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 255365, 2024-09-10T10:16:49.315 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 88, 2024-09-10T10:16:49.315 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:16:49.315 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 8856, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 166, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 81317, 2024-09-10T10:16:49.316 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 327, 2024-09-10T10:16:49.317 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-10T10:16:49.317 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-10T10:16:49.317 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-10T10:16:49.317 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-10T10:16:49.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.317 INFO:teuthology.orchestra.run.smithi084.stdout: "objecter": { 2024-09-10T10:16:49.317 INFO:teuthology.orchestra.run.smithi084.stdout: "op_active": 0, 2024-09-10T10:16:49.317 INFO:teuthology.orchestra.run.smithi084.stdout: "op_laggy": 0, 2024-09-10T10:16:49.317 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send": 40, 2024-09-10T10:16:49.317 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send_bytes": 11735, 2024-09-10T10:16:49.317 INFO:teuthology.orchestra.run.smithi084.stdout: "op_resend": 29, 2024-09-10T10:16:49.317 INFO:teuthology.orchestra.run.smithi084.stdout: "op_reply": 40, 2024-09-10T10:16:49.318 INFO:teuthology.orchestra.run.smithi084.stdout: "op_latency": { 2024-09-10T10:16:49.318 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 40, 2024-09-10T10:16:49.318 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.239995311, 2024-09-10T10:16:49.318 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.005999882 2024-09-10T10:16:49.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.318 INFO:teuthology.orchestra.run.smithi084.stdout: "op_inflight": 0, 2024-09-10T10:16:49.318 INFO:teuthology.orchestra.run.smithi084.stdout: "oplen_avg": { 2024-09-10T10:16:49.318 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 40, 2024-09-10T10:16:49.318 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 62 2024-09-10T10:16:49.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.318 INFO:teuthology.orchestra.run.smithi084.stdout: "op": 40, 2024-09-10T10:16:49.318 INFO:teuthology.orchestra.run.smithi084.stdout: "op_r": 0, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "op_w": 40, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "op_rmw": 0, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "op_pg": 0, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_stat": 0, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_create": 10, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_read": 0, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_write": 4, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writefull": 7, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writesame": 0, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_append": 0, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_zero": 0, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_truncate": 0, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_delete": 6, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_mapext": 0, 2024-09-10T10:16:49.319 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_sparse_read": 0, 2024-09-10T10:16:49.320 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_clonerange": 0, 2024-09-10T10:16:49.320 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_getxattr": 0, 2024-09-10T10:16:49.320 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_setxattr": 20, 2024-09-10T10:16:49.320 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:16:49.320 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_rmxattr": 0, 2024-09-10T10:16:49.320 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:16:49.320 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_call": 0, 2024-09-10T10:16:49.320 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_watch": 0, 2024-09-10T10:16:49.320 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_notify": 0, 2024-09-10T10:16:49.320 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:16:49.320 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls": 0, 2024-09-10T10:16:49.320 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:16:49.320 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_other": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_active": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_send": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_resend": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_ping": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_active": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_send": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_resend": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_active": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_send": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_resend": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_active": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_send": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_resend": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "command_active": 0, 2024-09-10T10:16:49.321 INFO:teuthology.orchestra.run.smithi084.stdout: "command_send": 0, 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: "command_resend": 0, 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: "map_epoch": 95, 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: "map_full": 0, 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: "map_inc": 2, 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_sessions": 9, 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_open": 9, 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_close": 0, 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_laggy": 0, 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_wr": 14, 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_rd": 0, 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_del": 1 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: "oft": { 2024-09-10T10:16:49.322 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_objs": 1, 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_updates": 0, 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_removes": 0 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: "osd-slow-ops": { 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_ops_count": 29 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: "purge_queue": { 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops": 0, 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing": 0, 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_high_water": 0, 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed_ops": 0, 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed": 0, 2024-09-10T10:16:49.323 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_item_in_journal": 0 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 716, 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 564222, 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 716, 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 716, 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 564222, 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_bytes": { 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 40, 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 11735, 2024-09-10T10:16:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 40, 2024-09-10T10:16:49.326 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 11735, 2024-09-10T10:16:49.326 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:49.326 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.326 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.326 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.326 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:49.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.326 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_ops": { 2024-09-10T10:16:49.326 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:49.326 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 1024, 2024-09-10T10:16:49.326 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:49.326 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-10T10:16:49.327 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-10T10:16:49.327 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:49.327 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:49.327 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 40, 2024-09-10T10:16:49.327 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 40, 2024-09-10T10:16:49.327 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 40, 2024-09-10T10:16:49.327 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 40, 2024-09-10T10:16:49.327 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:49.327 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.327 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.327 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.327 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:49.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 0, 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 0, 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:49.328 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle-0x555d71424960": { 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 5, 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 1433, 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 5, 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 4, 2024-09-10T10:16:49.329 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 1433, 2024-09-10T10:16:49.330 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:49.330 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:49.330 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:49.330 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:49.330 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:49.330 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:49.330 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-10T10:16:50.099 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-10T10:16:50.099 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-10T10:16:50.099 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-10T10:16:50.099 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=14 2024-09-10T10:16:50.099 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T10:16:50.100 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T10:16:50.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:50 smithi189 ceph-mon[34999]: pgmap v560: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:16:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:16:50.348 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:50 smithi084 ceph-mon[34812]: pgmap v560: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:16:50.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:50 smithi050 ceph-mon[30354]: pgmap v560: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:16:50.879 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-10T10:16:50.880 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:16:50.880 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 4, 2024-09-10T10:16:50.880 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 4, 2024-09-10T10:16:50.880 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 3024, 2024-09-10T10:16:50.880 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 448, 2024-09-10T10:16:50.880 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-10T10:16:50.881 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2024-09-10T10:16:50.881 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.002952228, 2024-09-10T10:16:50.881 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.000040425, 2024-09-10T10:16:50.881 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.002184565, 2024-09-10T10:16:50.881 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:50.882 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:50.882 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 3, 2024-09-10T10:16:50.882 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.003999516, 2024-09-10T10:16:50.882 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.001333172 2024-09-10T10:16:50.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:50.882 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:50.882 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:50.882 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:50.882 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:50.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:50.882 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-10T10:16:50.882 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T10:16:50.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:50.883 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:16:50.883 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 150, 2024-09-10T10:16:50.883 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 147, 2024-09-10T10:16:50.883 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 458192, 2024-09-10T10:16:50.883 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 89472, 2024-09-10T10:16:50.883 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 2, 2024-09-10T10:16:50.883 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 1, 2024-09-10T10:16:50.883 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.022362267, 2024-09-10T10:16:50.883 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.010079491, 2024-09-10T10:16:50.883 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.016965409, 2024-09-10T10:16:50.883 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:50.883 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:50.884 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 146, 2024-09-10T10:16:50.884 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.009065981, 2024-09-10T10:16:50.884 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000062095 2024-09-10T10:16:50.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:50.884 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:50.884 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:50.884 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:50.884 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:50.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:50.884 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 458192, 2024-09-10T10:16:50.885 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 89472 2024-09-10T10:16:50.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:50.885 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:16:50.885 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 1, 2024-09-10T10:16:50.885 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 111, 2024-09-10T10:16:50.885 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 160, 2024-09-10T10:16:50.885 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 98064, 2024-09-10T10:16:50.885 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 3, 2024-09-10T10:16:50.885 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-10T10:16:50.885 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.007079670, 2024-09-10T10:16:50.885 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.005215498, 2024-09-10T10:16:50.885 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.000732392, 2024-09-10T10:16:50.885 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 109, 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.004740780, 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000043493 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 98064 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-10T10:16:50.886 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 0, 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:16:50.887 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:16:50.888 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:16:50.888 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:16:50.888 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:16:50.888 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:16:50.888 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-10T10:16:50.888 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:16:50.888 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-10T10:16:50.888 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:16:50.888 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:16:50.888 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:16:50.888 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:16:50.888 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:16:50.888 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 149007, 2024-09-10T10:16:50.889 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 30, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 0, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 0, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-10T10:16:50.890 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 928, 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 2, 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 151, 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 437023, 2024-09-10T10:16:50.891 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:50.892 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 151, 2024-09-10T10:16:50.892 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-10T10:16:50.892 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-10T10:16:50.892 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 151, 2024-09-10T10:16:50.892 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 437023, 2024-09-10T10:16:50.892 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-10T10:16:50.892 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-10T10:16:50.892 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-10T10:16:50.892 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-10T10:16:50.892 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:50.892 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-10T10:16:50.892 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-10T10:16:51.589 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-10T10:16:51.589 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-10T10:16:51.590 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-10T10:16:51.590 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-10T10:16:51.590 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T10:16:51.590 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T10:16:51.854 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:16:52.271 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:52 smithi189 ceph-mon[34999]: pgmap v561: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:16:52.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:52 smithi084 ceph-mon[34812]: pgmap v561: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:16:52.379 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-10T10:16:52.379 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:16:52.379 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 7, 2024-09-10T10:16:52.379 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 7, 2024-09-10T10:16:52.379 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 3819, 2024-09-10T10:16:52.379 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 1408, 2024-09-10T10:16:52.380 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 6, 2024-09-10T10:16:52.380 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-10T10:16:52.380 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.003961820, 2024-09-10T10:16:52.380 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.000115299, 2024-09-10T10:16:52.380 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.002811753, 2024-09-10T10:16:52.380 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000140115, 2024-09-10T10:16:52.380 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:52.380 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 6, 2024-09-10T10:16:52.380 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.006094272, 2024-09-10T10:16:52.380 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001015712 2024-09-10T10:16:52.380 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.381 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:52.381 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.381 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.381 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.381 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.381 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-10T10:16:52.381 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T10:16:52.381 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.381 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:16:52.381 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 1133, 2024-09-10T10:16:52.381 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 1128, 2024-09-10T10:16:52.381 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1486191, 2024-09-10T10:16:52.381 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 399483, 2024-09-10T10:16:52.382 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-10T10:16:52.382 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-10T10:16:52.382 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.110478647, 2024-09-10T10:16:52.382 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.038034796, 2024-09-10T10:16:52.382 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.042638928, 2024-09-10T10:16:52.382 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.027719176, 2024-09-10T10:16:52.382 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:52.382 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1127, 2024-09-10T10:16:52.382 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.044249314, 2024-09-10T10:16:52.382 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000039262 2024-09-10T10:16:52.382 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.382 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:52.382 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.383 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.383 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.383 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.383 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 480880, 2024-09-10T10:16:52.383 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 88736 2024-09-10T10:16:52.383 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.383 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:16:52.383 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 450, 2024-09-10T10:16:52.383 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 557, 2024-09-10T10:16:52.383 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 111271, 2024-09-10T10:16:52.383 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 393432, 2024-09-10T10:16:52.383 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-10T10:16:52.383 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 4, 2024-09-10T10:16:52.384 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.048749182, 2024-09-10T10:16:52.384 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.019988562, 2024-09-10T10:16:52.384 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.009822486, 2024-09-10T10:16:52.384 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.013745830, 2024-09-10T10:16:52.384 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:52.384 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 555, 2024-09-10T10:16:52.384 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.024407942, 2024-09-10T10:16:52.384 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000043978 2024-09-10T10:16:52.384 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.384 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:52.384 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.384 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.384 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.385 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.385 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T10:16:52.385 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 250640 2024-09-10T10:16:52.385 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.385 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-10T10:16:52.385 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-10T10:16:52.385 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-10T10:16:52.385 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.385 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-10T10:16:52.385 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-10T10:16:52.385 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-10T10:16:52.385 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2364, 2024-09-10T10:16:52.385 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.063002236, 2024-09-10T10:16:52.386 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000026650 2024-09-10T10:16:52.386 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:52.386 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.386 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-10T10:16:52.386 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-10T10:16:52.386 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-10T10:16:52.386 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.386 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.386 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.386 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:52.386 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.386 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-10T10:16:52.386 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-10T10:16:52.387 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-10T10:16:52.387 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-10T10:16:52.387 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.387 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.387 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.387 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.387 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-10T10:16:52.387 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-10T10:16:52.387 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-10T10:16:52.387 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-10T10:16:52.387 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 0, 2024-09-10T10:16:52.387 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-10T10:16:52.387 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-10T10:16:52.388 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 19, 2024-09-10T10:16:52.388 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 0, 2024-09-10T10:16:52.388 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 19, 2024-09-10T10:16:52.388 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-10T10:16:52.388 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 19, 2024-09-10T10:16:52.388 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-10T10:16:52.388 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-10T10:16:52.388 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-10T10:16:52.388 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 2, 2024-09-10T10:16:52.388 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-10T10:16:52.388 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-10T10:16:52.388 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-10T10:16:52.388 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 4, 2024-09-10T10:16:52.389 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 234, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:16:52.390 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 0, 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-10T10:16:52.391 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-10T10:16:52.392 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:16:52.392 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-10T10:16:52.392 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-10T10:16:52.392 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-10T10:16:52.392 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-10T10:16:52.392 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-10T10:16:52.392 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:16:52.392 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:16:52.392 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-10T10:16:52.392 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-10T10:16:52.392 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 0, 2024-09-10T10:16:52.392 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 0, 2024-09-10T10:16:52.392 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 0, 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 221, 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-10T10:16:52.393 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 0, 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4911347, 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 4910748, 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.394 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.395 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.395 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 221 2024-09-10T10:16:52.395 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.395 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-10T10:16:52.395 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 14, 2024-09-10T10:16:52.395 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 19, 2024-09-10T10:16:52.395 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 5, 2024-09-10T10:16:52.395 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 9, 2024-09-10T10:16:52.395 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 11, 2024-09-10T10:16:52.395 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 2, 2024-09-10T10:16:52.395 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 19, 2024-09-10T10:16:52.395 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 23, 2024-09-10T10:16:52.395 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 4, 2024-09-10T10:16:52.396 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-10T10:16:52.396 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-10T10:16:52.396 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-10T10:16:52.396 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 49212, 2024-09-10T10:16:52.396 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 215328 2024-09-10T10:16:52.396 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.396 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-10T10:16:52.396 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-10T10:16:52.396 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-10T10:16:52.396 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-10T10:16:52.396 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-10T10:16:52.396 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-10T10:16:52.396 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-10T10:16:52.397 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.397 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.397 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.397 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.397 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-10T10:16:52.397 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.397 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.397 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.397 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.397 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-10T10:16:52.397 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.397 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.397 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.398 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.399 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.399 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.399 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-10T10:16:52.399 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.399 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.399 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.399 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.399 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-10T10:16:52.399 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.399 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.399 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.399 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.399 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-10T10:16:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-10T10:16:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-10T10:16:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.400 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.401 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.401 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-10T10:16:52.401 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.401 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.401 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.402 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.402 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-10T10:16:52.402 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.402 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.402 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.402 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.402 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-10T10:16:52.402 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.402 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.402 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.402 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.402 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-10T10:16:52.402 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-10T10:16:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-10T10:16:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.403 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.404 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-10T10:16:52.404 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.404 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.404 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.404 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.404 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-10T10:16:52.404 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.404 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.404 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.404 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.404 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-10T10:16:52.404 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.404 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-10T10:16:52.405 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.406 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-10T10:16:52.407 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.407 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.407 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.407 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.407 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-10T10:16:52.407 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.407 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.407 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.407 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.407 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-10T10:16:52.407 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.407 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.407 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:52.408 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.409 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-10T10:16:52.409 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-10T10:16:52.409 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 3, 2024-09-10T10:16:52.409 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 2, 2024-09-10T10:16:52.409 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 1, 2024-09-10T10:16:52.409 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-10T10:16:52.409 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-10T10:16:52.409 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-10T10:16:52.409 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 1698, 2024-09-10T10:16:52.409 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-10T10:16:52.409 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.409 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-10T10:16:52.409 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:16:52.410 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:16:52.411 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-10T10:16:52.411 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:16:52.411 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-10T10:16:52.411 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:16:52.411 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:16:52.411 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:16:52.411 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:16:52.411 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:16:52.411 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:16:52.411 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:16:52.412 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-10T10:16:52.412 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:16:52.412 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:16:52.412 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:16:52.412 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-10T10:16:52.412 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-10T10:16:52.412 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-10T10:16:52.412 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:16:52.412 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:16:52.412 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:16:52.412 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:16:52.412 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 197441, 2024-09-10T10:16:52.413 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 54, 2024-09-10T10:16:52.413 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:16:52.413 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-10T10:16:52.413 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-10T10:16:52.413 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-10T10:16:52.413 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:16:52.413 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-10T10:16:52.413 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:16:52.413 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-10T10:16:52.413 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 8856, 2024-09-10T10:16:52.413 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 166, 2024-09-10T10:16:52.413 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:16:52.413 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 56386, 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 269, 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 1429, 2024-09-10T10:16:52.414 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 26, 2024-09-10T10:16:52.415 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 4, 2024-09-10T10:16:52.415 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 1429, 2024-09-10T10:16:52.415 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-10T10:16:52.415 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1429, 2024-09-10T10:16:52.415 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.608987117, 2024-09-10T10:16:52.415 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000426163 2024-09-10T10:16:52.415 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.415 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-10T10:16:52.415 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-10T10:16:52.415 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1429, 2024-09-10T10:16:52.415 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 1430 2024-09-10T10:16:52.415 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.415 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 1429, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 1429, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 0, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 892, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 0, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 534, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 0, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 0, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-10T10:16:52.416 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 0, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 2, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 0, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-10T10:16:52.417 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:16:52.418 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-10T10:16:52.418 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-10T10:16:52.418 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-10T10:16:52.418 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-10T10:16:52.418 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-10T10:16:52.418 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-10T10:16:52.418 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-10T10:16:52.418 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-10T10:16:52.418 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-10T10:16:52.418 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-10T10:16:52.418 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-10T10:16:52.418 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-10T10:16:52.418 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 95, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 2, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 6, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 6, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 0, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 2, 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 0 2024-09-10T10:16:52.419 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 0, 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-10T10:16:52.420 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-10T10:16:52.421 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-10T10:16:52.421 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-10T10:16:52.421 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-10T10:16:52.421 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.421 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:16:52.421 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:52.421 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T10:16:52.421 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:52.421 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 1586, 2024-09-10T10:16:52.421 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1447527, 2024-09-10T10:16:52.421 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:52.421 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 1586, 2024-09-10T10:16:52.421 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 1586, 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1447527, 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T10:16:52.422 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 1429, 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 717053, 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 1429, 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 717053, 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-10T10:16:52.423 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:52.424 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-10T10:16:52.424 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:52.424 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T10:16:52.424 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T10:16:52.424 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:52.424 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:52.424 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 1429, 2024-09-10T10:16:52.424 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 1429, 2024-09-10T10:16:52.424 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 1429, 2024-09-10T10:16:52.424 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1429, 2024-09-10T10:16:52.424 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:52.424 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.424 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T10:16:52.425 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-10T10:16:52.426 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-10T10:16:52.426 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:52.426 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.426 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.426 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.426 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:52.426 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:52.426 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x55fca07beb40": { 2024-09-10T10:16:52.426 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:52.426 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-10T10:16:52.426 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:52.426 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T10:16:52.426 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T10:16:52.427 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:52.427 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:52.427 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T10:16:52.427 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T10:16:52.427 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-10T10:16:52.427 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-10T10:16:52.427 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:52.427 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:52.427 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:52.427 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:52.427 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:52.427 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:52.427 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-10T10:16:52.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:52 smithi050 ceph-mon[30354]: pgmap v561: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:16:53.230 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-10T10:16:53.231 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-10T10:16:53.231 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-10T10:16:53.231 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-10T10:16:53.231 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T10:16:53.231 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T10:16:53.482 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:16:54.007 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-10T10:16:54.007 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:16:54.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 162, 2024-09-10T10:16:54.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 155, 2024-09-10T10:16:54.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 485186, 2024-09-10T10:16:54.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 90148, 2024-09-10T10:16:54.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-10T10:16:54.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-10T10:16:54.007 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.026177450, 2024-09-10T10:16:54.008 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.009990474, 2024-09-10T10:16:54.008 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.019882229, 2024-09-10T10:16:54.008 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000019976, 2024-09-10T10:16:54.008 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:54.008 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 155, 2024-09-10T10:16:54.008 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.013412721, 2024-09-10T10:16:54.008 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000086533 2024-09-10T10:16:54.008 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.008 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:54.008 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.008 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.008 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.009 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 484352, 2024-09-10T10:16:54.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 89824 2024-09-10T10:16:54.009 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.009 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:16:54.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 357, 2024-09-10T10:16:54.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 465, 2024-09-10T10:16:54.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 87758, 2024-09-10T10:16:54.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 364029, 2024-09-10T10:16:54.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-10T10:16:54.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 4, 2024-09-10T10:16:54.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.039926933, 2024-09-10T10:16:54.009 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.013346246, 2024-09-10T10:16:54.010 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.009293863, 2024-09-10T10:16:54.010 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.013219659, 2024-09-10T10:16:54.010 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:54.010 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 463, 2024-09-10T10:16:54.010 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.019125643, 2024-09-10T10:16:54.010 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000041308 2024-09-10T10:16:54.010 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.010 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:54.010 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.011 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.011 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.011 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T10:16:54.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 250816 2024-09-10T10:16:54.011 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.011 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:16:54.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 899, 2024-09-10T10:16:54.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 901, 2024-09-10T10:16:54.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 269757, 2024-09-10T10:16:54.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 285940, 2024-09-10T10:16:54.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-10T10:16:54.011 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-10T10:16:54.012 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.084437656, 2024-09-10T10:16:54.012 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.026617068, 2024-09-10T10:16:54.012 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.023092554, 2024-09-10T10:16:54.012 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.026831452, 2024-09-10T10:16:54.012 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:54.012 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 899, 2024-09-10T10:16:54.012 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.034924183, 2024-09-10T10:16:54.012 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000038847 2024-09-10T10:16:54.012 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.012 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:54.012 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.012 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2112, 2024-09-10T10:16:54.013 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.058089876, 2024-09-10T10:16:54.014 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000027504 2024-09-10T10:16:54.014 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:54.014 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.014 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-10T10:16:54.014 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-10T10:16:54.014 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-10T10:16:54.014 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.014 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.014 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.014 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:54.014 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.014 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-10T10:16:54.014 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 0, 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-10T10:16:54.015 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 0, 2024-09-10T10:16:54.016 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 0, 2024-09-10T10:16:54.016 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 0, 2024-09-10T10:16:54.016 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-10T10:16:54.016 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 0, 2024-09-10T10:16:54.016 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-10T10:16:54.016 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-10T10:16:54.016 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-10T10:16:54.016 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 1, 2024-09-10T10:16:54.016 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-10T10:16:54.016 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-10T10:16:54.016 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-10T10:16:54.016 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-10T10:16:54.016 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 0, 2024-09-10T10:16:54.017 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:16:54.018 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:16:54.019 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-10T10:16:54.019 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-10T10:16:54.019 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-10T10:16:54.019 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-10T10:16:54.019 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.019 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-10T10:16:54.019 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-10T10:16:54.019 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-10T10:16:54.019 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-10T10:16:54.019 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 0, 2024-09-10T10:16:54.019 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-10T10:16:54.019 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-10T10:16:54.019 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:16:54.020 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 0, 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 4, 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-10T10:16:54.021 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 0, 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4195426, 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 4195285, 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.022 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 4 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 3, 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 3, 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 0, 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 1, 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 1, 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 0, 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 0, 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 0, 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 0, 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-10T10:16:54.023 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-10T10:16:54.024 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-10T10:16:54.024 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 47360, 2024-09-10T10:16:54.024 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 215328 2024-09-10T10:16:54.024 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.024 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-10T10:16:54.024 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-10T10:16:54.024 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-10T10:16:54.024 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-10T10:16:54.024 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-10T10:16:54.024 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-10T10:16:54.024 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-10T10:16:54.024 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.024 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-10T10:16:54.025 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.026 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.027 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.028 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-10T10:16:54.028 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.028 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.028 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.028 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.028 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-10T10:16:54.028 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.028 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.028 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.028 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.028 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-10T10:16:54.028 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.028 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.029 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.029 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.029 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-10T10:16:54.029 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.029 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.029 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.029 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.029 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-10T10:16:54.029 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.029 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.029 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.029 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.029 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.030 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-10T10:16:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-10T10:16:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-10T10:16:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.031 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.032 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.032 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.032 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-10T10:16:54.032 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.032 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.032 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.032 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.032 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-10T10:16:54.032 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.032 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.032 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.032 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.032 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.033 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.034 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-10T10:16:54.034 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.034 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.034 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.034 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.034 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-10T10:16:54.034 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.034 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.034 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.034 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.034 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-10T10:16:54.034 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.034 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.035 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:54.036 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.036 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-10T10:16:54.036 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 0, 2024-09-10T10:16:54.036 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 1, 2024-09-10T10:16:54.036 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 1, 2024-09-10T10:16:54.036 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 1, 2024-09-10T10:16:54.036 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-10T10:16:54.036 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-10T10:16:54.036 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-10T10:16:54.036 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 1345, 2024-09-10T10:16:54.036 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-10T10:16:54.036 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.036 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-10T10:16:54.037 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:16:54.037 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-10T10:16:54.037 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:16:54.037 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:16:54.037 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:16:54.037 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:16:54.037 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:16:54.037 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:16:54.037 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:16:54.037 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:16:54.037 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:16:54.037 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:16:54.037 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-10T10:16:54.038 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:16:54.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:16:54.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:16:54.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-10T10:16:54.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-10T10:16:54.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-10T10:16:54.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:16:54.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:16:54.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:16:54.039 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:16:54.039 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 189401, 2024-09-10T10:16:54.039 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 51, 2024-09-10T10:16:54.039 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:16:54.039 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 8856, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 166, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 8512, 2024-09-10T10:16:54.040 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 13, 2024-09-10T10:16:54.041 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-10T10:16:54.041 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-10T10:16:54.041 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-10T10:16:54.041 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-10T10:16:54.041 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.041 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-10T10:16:54.041 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-10T10:16:54.041 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-10T10:16:54.041 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 1256, 2024-09-10T10:16:54.041 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 21, 2024-09-10T10:16:54.041 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 3, 2024-09-10T10:16:54.041 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 1256, 2024-09-10T10:16:54.041 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-10T10:16:54.042 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1256, 2024-09-10T10:16:54.042 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.887981202, 2024-09-10T10:16:54.042 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000706991 2024-09-10T10:16:54.042 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.042 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-10T10:16:54.042 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-10T10:16:54.042 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1256, 2024-09-10T10:16:54.042 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 1257 2024-09-10T10:16:54.042 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.042 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 1256, 2024-09-10T10:16:54.042 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 1256, 2024-09-10T10:16:54.042 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 0, 2024-09-10T10:16:54.042 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 801, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 0, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 453, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 0, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 0, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 0, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-10T10:16:54.043 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 1, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 0, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-10T10:16:54.044 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-10T10:16:54.045 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 95, 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 2, 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 5, 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 5, 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 0, 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 2, 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 0 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 0, 2024-09-10T10:16:54.046 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-10T10:16:54.047 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 1414, 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 704369, 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 1414, 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 1414, 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 704369, 2024-09-10T10:16:54.048 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:54.049 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 1256, 2024-09-10T10:16:54.050 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 1127, 2024-09-10T10:16:54.050 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 1256, 2024-09-10T10:16:54.050 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1127, 2024-09-10T10:16:54.050 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:54.050 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.050 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.050 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.050 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:54.050 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.050 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-10T10:16:54.050 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:54.050 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-10T10:16:54.050 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 1256, 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 1256, 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 1256, 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1256, 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:54.051 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:54.052 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x5612f047eb40": { 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T10:16:54.053 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T10:16:54.054 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-10T10:16:54.054 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-10T10:16:54.054 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:54.054 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:54.054 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:54.054 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:54.054 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:54.054 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:54.054 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-10T10:16:54.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:54 smithi189 ceph-mon[34999]: pgmap v562: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:16:54.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:54 smithi084 ceph-mon[34812]: pgmap v562: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:16:54.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:54 smithi050 ceph-mon[30354]: pgmap v562: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T10:16:54.835 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-10T10:16:54.835 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-10T10:16:54.835 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-10T10:16:54.836 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-10T10:16:54.836 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T10:16:54.836 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T10:16:55.082 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:16:55.616 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-10T10:16:55.616 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:16:55.616 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 196, 2024-09-10T10:16:55.616 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 189, 2024-09-10T10:16:55.616 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 493682, 2024-09-10T10:16:55.616 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 99648, 2024-09-10T10:16:55.616 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 7, 2024-09-10T10:16:55.616 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-10T10:16:55.616 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.027851600, 2024-09-10T10:16:55.617 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.010564804, 2024-09-10T10:16:55.617 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.017946961, 2024-09-10T10:16:55.617 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000354749, 2024-09-10T10:16:55.617 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:55.617 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 188, 2024-09-10T10:16:55.617 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.019855424, 2024-09-10T10:16:55.617 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000105613 2024-09-10T10:16:55.617 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.617 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:55.617 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.617 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.617 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.618 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.618 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 489936, 2024-09-10T10:16:55.618 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 92576 2024-09-10T10:16:55.618 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.618 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:16:55.618 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 46, 2024-09-10T10:16:55.618 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 155, 2024-09-10T10:16:55.618 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 8993, 2024-09-10T10:16:55.618 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 582860, 2024-09-10T10:16:55.618 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 34, 2024-09-10T10:16:55.618 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 7, 2024-09-10T10:16:55.618 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.019417528, 2024-09-10T10:16:55.618 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.005662669, 2024-09-10T10:16:55.619 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.011573376, 2024-09-10T10:16:55.619 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000306649, 2024-09-10T10:16:55.619 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:55.619 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 151, 2024-09-10T10:16:55.619 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.018393972, 2024-09-10T10:16:55.619 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000121814 2024-09-10T10:16:55.619 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.619 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:55.619 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 37, 2024-09-10T10:16:55.619 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000003819, 2024-09-10T10:16:55.619 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000103 2024-09-10T10:16:55.619 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.619 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 1744, 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 253696 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 472, 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 457, 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 131245, 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 129112, 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 9, 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 4, 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.042716350, 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.015053105, 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.027396558, 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.002653768, 2024-09-10T10:16:55.620 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 458, 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.045103025, 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000098478 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 886, 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000183861, 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000207 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-10T10:16:55.621 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-10T10:16:55.622 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-10T10:16:55.622 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.622 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-10T10:16:55.622 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-10T10:16:55.622 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-10T10:16:55.622 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 49, 2024-09-10T10:16:55.622 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.001441109, 2024-09-10T10:16:55.622 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000029410 2024-09-10T10:16:55.622 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:55.622 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.622 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-10T10:16:55.622 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-10T10:16:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-10T10:16:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2, 2024-09-10T10:16:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000018613, 2024-09-10T10:16:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000009306 2024-09-10T10:16:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-10T10:16:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 2, 2024-09-10T10:16:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 1, 2024-09-10T10:16:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-10T10:16:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1, 2024-09-10T10:16:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000265885, 2024-09-10T10:16:55.623 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000265885 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 1, 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 11, 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 16, 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 0, 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 16, 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 13, 2024-09-10T10:16:55.624 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 4, 2024-09-10T10:16:55.625 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-10T10:16:55.625 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-10T10:16:55.625 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 3, 2024-09-10T10:16:55.625 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 20, 2024-09-10T10:16:55.625 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 14, 2024-09-10T10:16:55.625 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-10T10:16:55.625 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 5, 2024-09-10T10:16:55.625 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:16:55.625 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-10T10:16:55.625 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-10T10:16:55.625 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 1000, 2024-09-10T10:16:55.625 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 1, 2024-09-10T10:16:55.625 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 4, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 234, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:16:55.626 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:16:55.627 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:16:55.627 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:16:55.627 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-10T10:16:55.627 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-10T10:16:55.627 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T10:16:55.627 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-10T10:16:55.627 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:16:55.627 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:16:55.627 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:16:55.627 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-10T10:16:55.627 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-10T10:16:55.627 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-10T10:16:55.628 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 1 2024-09-10T10:16:55.628 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.628 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-10T10:16:55.628 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-10T10:16:55.628 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 12, 2024-09-10T10:16:55.628 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 8, 2024-09-10T10:16:55.628 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 10, 2024-09-10T10:16:55.628 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-10T10:16:55.628 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-10T10:16:55.628 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-10T10:16:55.628 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:16:55.628 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-10T10:16:55.629 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-10T10:16:55.629 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-10T10:16:55.629 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-10T10:16:55.629 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-10T10:16:55.629 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:16:55.629 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:16:55.629 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-10T10:16:55.629 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-10T10:16:55.629 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 4, 2024-09-10T10:16:55.629 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 27, 2024-09-10T10:16:55.629 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:16:55.629 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-10T10:16:55.629 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-10T10:16:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-10T10:16:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-10T10:16:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0 2024-09-10T10:16:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-10T10:16:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-10T10:16:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 4, 2024-09-10T10:16:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-10T10:16:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-10T10:16:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 4, 2024-09-10T10:16:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-10T10:16:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-10T10:16:55.630 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 2, 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4195426, 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 0, 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3, 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.006116371, 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.002038790 2024-09-10T10:16:55.631 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.632 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 0 2024-09-10T10:16:55.632 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.632 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-10T10:16:55.632 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 20, 2024-09-10T10:16:55.632 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 22, 2024-09-10T10:16:55.632 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 2, 2024-09-10T10:16:55.632 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 19, 2024-09-10T10:16:55.632 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 22, 2024-09-10T10:16:55.632 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 3, 2024-09-10T10:16:55.632 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 16, 2024-09-10T10:16:55.632 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 20, 2024-09-10T10:16:55.632 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 4, 2024-09-10T10:16:55.632 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-10T10:16:55.633 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 1, 2024-09-10T10:16:55.633 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 1, 2024-09-10T10:16:55.633 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 50776, 2024-09-10T10:16:55.633 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 223520 2024-09-10T10:16:55.633 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.633 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-10T10:16:55.633 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 3, 2024-09-10T10:16:55.633 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-10T10:16:55.633 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 2, 2024-09-10T10:16:55.633 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 4, 2024-09-10T10:16:55.633 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-10T10:16:55.633 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-10T10:16:55.633 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.634 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.634 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.634 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.634 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-10T10:16:55.634 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1, 2024-09-10T10:16:55.634 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000265885, 2024-09-10T10:16:55.634 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000265885 2024-09-10T10:16:55.634 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.634 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-10T10:16:55.634 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.634 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.634 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.634 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.635 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-10T10:16:55.635 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.635 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.635 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.635 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.635 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-10T10:16:55.635 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.635 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.635 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.635 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.635 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-10T10:16:55.635 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.635 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.636 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.636 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.636 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-10T10:16:55.636 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.636 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.636 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.636 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.636 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-10T10:16:55.636 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.636 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.636 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.636 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.637 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-10T10:16:55.637 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.637 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.637 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.637 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.637 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-10T10:16:55.637 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.637 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.637 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.637 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.637 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-10T10:16:55.637 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.637 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.638 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.638 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.638 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-10T10:16:55.638 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.638 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.638 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.639 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.639 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-10T10:16:55.639 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.639 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.639 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.639 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.639 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-10T10:16:55.639 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.639 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.639 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.639 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.639 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-10T10:16:55.639 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.640 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-10T10:16:55.641 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.641 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.641 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.641 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.641 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-10T10:16:55.641 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.641 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.641 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.641 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.641 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-10T10:16:55.641 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.641 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-10T10:16:55.642 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.643 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.643 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.643 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.643 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-10T10:16:55.643 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.643 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.643 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.643 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.643 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-10T10:16:55.644 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.644 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.644 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.644 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.644 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-10T10:16:55.644 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.644 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.644 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.644 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.644 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-10T10:16:55.644 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.645 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.645 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.645 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.645 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-10T10:16:55.645 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.645 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.645 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.645 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.645 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-10T10:16:55.645 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.645 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.645 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.646 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.646 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:16:55.646 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:16:55.646 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-10T10:16:55.646 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.646 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.646 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.646 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:55.646 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.646 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-10T10:16:55.646 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 0, 2024-09-10T10:16:55.646 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 1, 2024-09-10T10:16:55.646 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 1, 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 0, 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 1, 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 1, 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 87, 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:16:55.647 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:16:55.648 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:16:55.648 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:16:55.648 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:16:55.648 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:16:55.648 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:16:55.648 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:16:55.648 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:16:55.648 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:16:55.648 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:16:55.648 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-10T10:16:55.648 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:16:55.648 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-10T10:16:55.648 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:16:55.649 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:16:55.649 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:16:55.649 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:16:55.649 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:16:55.649 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:16:55.649 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:16:55.649 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-10T10:16:55.649 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:16:55.649 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:16:55.649 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:16:55.649 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-10T10:16:55.649 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-10T10:16:55.649 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 246087, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 78, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-10T10:16:55.650 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 8856, 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 166, 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 80973, 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 328, 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-10T10:16:55.651 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 38, 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 11334, 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 28, 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 38, 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 38, 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.235994998, 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.006210394 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 38, 2024-09-10T10:16:55.652 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 60 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 38, 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 0, 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 38, 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 0, 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 10, 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 0, 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 3, 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 6, 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-10T10:16:55.653 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-10T10:16:55.654 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-10T10:16:55.654 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 6, 2024-09-10T10:16:55.654 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-10T10:16:55.654 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-10T10:16:55.654 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-10T10:16:55.654 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 0, 2024-09-10T10:16:55.654 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 20, 2024-09-10T10:16:55.654 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:16:55.654 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-10T10:16:55.654 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:16:55.654 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-10T10:16:55.654 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-10T10:16:55.654 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-10T10:16:55.655 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:16:55.655 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-10T10:16:55.655 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:16:55.655 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-10T10:16:55.655 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-10T10:16:55.655 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-10T10:16:55.655 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-10T10:16:55.655 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-10T10:16:55.655 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-10T10:16:55.655 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-10T10:16:55.656 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-10T10:16:55.656 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-10T10:16:55.656 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-10T10:16:55.656 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-10T10:16:55.656 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-10T10:16:55.656 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-10T10:16:55.656 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-10T10:16:55.656 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-10T10:16:55.656 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-10T10:16:55.656 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-10T10:16:55.656 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 95, 2024-09-10T10:16:55.656 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-10T10:16:55.657 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 2, 2024-09-10T10:16:55.657 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 9, 2024-09-10T10:16:55.657 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 9, 2024-09-10T10:16:55.657 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-10T10:16:55.657 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-10T10:16:55.657 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 14, 2024-09-10T10:16:55.657 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 0, 2024-09-10T10:16:55.657 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 1 2024-09-10T10:16:55.657 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.657 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-10T10:16:55.658 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 1, 2024-09-10T10:16:55.658 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:16:55.658 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-10T10:16:55.658 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-10T10:16:55.658 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.658 INFO:teuthology.orchestra.run.smithi189.stdout: "osd-slow-ops": { 2024-09-10T10:16:55.658 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 29 2024-09-10T10:16:55.658 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.658 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-10T10:16:55.658 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-10T10:16:55.658 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T10:16:55.658 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 710, 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 557547, 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 710, 2024-09-10T10:16:55.659 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T10:16:55.660 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T10:16:55.660 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 710, 2024-09-10T10:16:55.660 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 557547, 2024-09-10T10:16:55.660 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:55.660 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.660 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.660 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.660 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:55.660 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.660 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-10T10:16:55.660 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:55.661 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T10:16:55.661 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:55.661 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T10:16:55.661 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T10:16:55.661 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:55.661 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:55.661 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 38, 2024-09-10T10:16:55.661 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 11334, 2024-09-10T10:16:55.661 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 38, 2024-09-10T10:16:55.661 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 11334, 2024-09-10T10:16:55.661 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:55.661 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.662 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.662 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.662 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:55.662 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.662 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-10T10:16:55.662 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:55.662 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-10T10:16:55.662 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:55.662 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T10:16:55.662 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T10:16:55.662 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:55.663 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:55.663 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 38, 2024-09-10T10:16:55.663 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 38, 2024-09-10T10:16:55.663 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 38, 2024-09-10T10:16:55.663 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 38, 2024-09-10T10:16:55.663 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:55.663 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.663 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.663 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.663 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:55.663 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.664 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:16:55.664 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:55.664 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-10T10:16:55.664 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:55.664 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T10:16:55.664 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T10:16:55.664 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:55.664 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T10:16:55.664 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T10:16:55.665 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T10:16:55.665 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-10T10:16:55.665 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-10T10:16:55.665 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:55.665 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.665 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.665 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.665 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:55.665 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:55.665 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x55e996b12960": { 2024-09-10T10:16:55.666 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:55.666 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-10T10:16:55.666 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:55.666 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 4, 2024-09-10T10:16:55.666 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1122, 2024-09-10T10:16:55.666 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:55.666 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 4, 2024-09-10T10:16:55.666 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T10:16:55.666 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T10:16:55.666 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 3, 2024-09-10T10:16:55.667 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1122, 2024-09-10T10:16:55.667 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:55.667 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:55.667 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:55.667 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:55.667 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:55.667 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:55.667 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-10T10:16:56.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:56 smithi189 ceph-mon[34999]: pgmap v563: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:16:56.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:56 smithi084 ceph-mon[34812]: pgmap v563: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:16:56.453 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-10T10:16:56.453 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-10T10:16:56.453 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-10T10:16:56.453 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=12 2024-09-10T10:16:56.453 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T10:16:56.453 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T10:16:56.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:56 smithi050 ceph-mon[30354]: pgmap v563: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T10:16:56.699 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:16:57.315 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-10T10:16:57.316 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:16:57.316 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 0, 2024-09-10T10:16:57.316 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 2, 2024-09-10T10:16:57.316 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 0, 2024-09-10T10:16:57.316 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 0, 2024-09-10T10:16:57.316 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-10T10:16:57.316 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 0, 2024-09-10T10:16:57.316 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.001062958, 2024-09-10T10:16:57.316 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T10:16:57.316 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.000238868, 2024-09-10T10:16:57.316 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:57.316 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:57.317 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:57.317 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:57.317 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:57.317 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:57.317 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:57.317 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:57.317 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:57.317 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:57.317 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:57.317 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:16:57.317 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:16:57.317 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:57.317 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 158, 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 153, 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 462928, 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 92176, 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 2, 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.025898524, 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.010936965, 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.018506458, 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 153, 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.011732580, 2024-09-10T10:16:57.318 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000076683 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 462928, 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 92176 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 1, 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 113, 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 160, 2024-09-10T10:16:57.319 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 98416, 2024-09-10T10:16:57.320 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 3, 2024-09-10T10:16:57.320 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-10T10:16:57.320 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.006816311, 2024-09-10T10:16:57.320 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.004971365, 2024-09-10T10:16:57.320 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.000451469, 2024-09-10T10:16:57.320 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:16:57.320 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:16:57.320 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 111, 2024-09-10T10:16:57.320 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.007110655, 2024-09-10T10:16:57.320 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000064059 2024-09-10T10:16:57.320 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:57.320 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:16:57.320 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 98416 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 0, 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-10T10:16:57.321 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:16:57.322 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:16:57.322 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:16:57.322 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:16:57.322 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:16:57.322 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:16:57.322 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:16:57.322 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:16:57.322 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:16:57.322 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:16:57.322 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:16:57.322 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:16:57.322 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:16:57.322 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:16:57.323 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 149047, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 31, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:16:57.324 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 0, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 0, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 928, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 2, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-10T10:16:57.325 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 155, 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 438180, 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 155, 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 155, 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 438180, 2024-09-10T10:16:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T10:16:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T10:16:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T10:16:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T10:16:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T10:16:57.327 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-10T10:16:58.069 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-10T10:16:58.069 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-10T10:16:58.069 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-10T10:16:58.069 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-10T10:16:58.070 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T10:16:58.081 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T10:16:58.082 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:16:58.082 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T10:16:58.123 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-10T10:16:58.123 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T10:16:58.203 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T10:16:58.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:16:58 smithi189 ceph-mon[34999]: pgmap v564: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:16:58.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:16:58 smithi084 ceph-mon[34812]: pgmap v564: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:16:58.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:16:58 smithi050 ceph-mon[30354]: pgmap v564: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T10:16:58.624 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:16:59.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.177+0000 7f28cc000640 1 -- 172.21.15.50:0/3890979089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c410e3c0 msgr2=0x7f28c4110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:59.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.177+0000 7f28cc000640 1 --2- 172.21.15.50:0/3890979089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c410e3c0 0x7f28c4110810 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009ca0 tx=0x7f28bc02a950 comp rx=0 tx=0).stop 2024-09-10T10:16:59.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.177+0000 7f28cc000640 1 -- 172.21.15.50:0/3890979089 shutdown_connections 2024-09-10T10:16:59.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.177+0000 7f28cc000640 1 --2- 172.21.15.50:0/3890979089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c410e3c0 0x7f28c4110810 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:59.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.177+0000 7f28cc000640 1 --2- 172.21.15.50:0/3890979089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c4074f40 0x7f28c410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:59.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.177+0000 7f28cc000640 1 --2- 172.21.15.50:0/3890979089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28c4074620 0x7f28c4074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:59.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.177+0000 7f28cc000640 1 -- 172.21.15.50:0/3890979089 >> 172.21.15.50:0/3890979089 conn(0x7f28c40fd8c0 msgr2=0x7f28c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:59.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.177+0000 7f28cc000640 1 -- 172.21.15.50:0/3890979089 shutdown_connections 2024-09-10T10:16:59.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.177+0000 7f28cc000640 1 -- 172.21.15.50:0/3890979089 wait complete. 2024-09-10T10:16:59.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.178+0000 7f28cc000640 1 Processor -- start 2024-09-10T10:16:59.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.178+0000 7f28cc000640 1 -- start start 2024-09-10T10:16:59.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.179+0000 7f28cc000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28c4074620 0x7f28c419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:59.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.179+0000 7f28cc000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c4074f40 0x7f28c419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.179+0000 7f28cc000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c410e3c0 0x7f28c419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.179+0000 7f28cc000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f28c4114150 con 0x7f28c4074f40 2024-09-10T10:16:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.179+0000 7f28cc000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f28c4113fd0 con 0x7f28c410e3c0 2024-09-10T10:16:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.179+0000 7f28cc000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f28c41142d0 con 0x7f28c4074620 2024-09-10T10:16:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.179+0000 7f28c8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c4074f40 0x7f28c419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.179+0000 7f28c8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c4074f40 0x7f28c419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41456/0 (socket says 172.21.15.50:41456) 2024-09-10T10:16:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.179+0000 7f28c8c00640 1 -- 172.21.15.50:0/4098997847 learned_addr learned my addr 172.21.15.50:0/4098997847 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:16:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.179+0000 7f28c9600640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28c4074620 0x7f28c419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.179+0000 7f28ca000640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c410e3c0 0x7f28c419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.180+0000 7f28c8c00640 1 -- 172.21.15.50:0/4098997847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28c4074620 msgr2=0x7f28c419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.180+0000 7f28c8c00640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28c4074620 0x7f28c419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.180+0000 7f28c8c00640 1 -- 172.21.15.50:0/4098997847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c410e3c0 msgr2=0x7f28c419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:59.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.180+0000 7f28c8c00640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c410e3c0 0x7f28c419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:59.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.180+0000 7f28c8c00640 1 -- 172.21.15.50:0/4098997847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c419f600 con 0x7f28c4074f40 2024-09-10T10:16:59.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.180+0000 7f28ca000640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c410e3c0 0x7f28c419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:59.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.180+0000 7f28c9600640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28c4074620 0x7f28c419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:16:59.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.180+0000 7f28c8c00640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c4074f40 0x7f28c419ab90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f28b000ea60 tx=0x7f28b000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:59.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.180+0000 7f28c2000640 1 -- 172.21.15.50:0/4098997847 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b000cde0 con 0x7f28c4074f40 2024-09-10T10:16:59.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.180+0000 7f28c2000640 1 -- 172.21.15.50:0/4098997847 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28b00035f0 con 0x7f28c4074f40 2024-09-10T10:16:59.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.180+0000 7f28c2000640 1 -- 172.21.15.50:0/4098997847 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b0010690 con 0x7f28c4074f40 2024-09-10T10:16:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.180+0000 7f28cc000640 1 -- 172.21.15.50:0/4098997847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c419f8f0 con 0x7f28c4074f40 2024-09-10T10:16:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.181+0000 7f28cc000640 1 -- 172.21.15.50:0/4098997847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c41a71d0 con 0x7f28c4074f40 2024-09-10T10:16:59.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.182+0000 7f28cc000640 1 -- 172.21.15.50:0/4098997847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28c4074a00 con 0x7f28c4074f40 2024-09-10T10:16:59.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.183+0000 7f28c2000640 1 -- 172.21.15.50:0/4098997847 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f28b00037a0 con 0x7f28c4074f40 2024-09-10T10:16:59.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.185+0000 7f28c2000640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f28ac0a2b80 0x7f28ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:16:59.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.185+0000 7f28c2000640 1 -- 172.21.15.50:0/4098997847 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f28b00cf750 con 0x7f28c4074f40 2024-09-10T10:16:59.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.185+0000 7f28c9600640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f28ac0a2b80 0x7f28ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:16:59.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.186+0000 7f28c9600640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f28ac0a2b80 0x7f28ac0a5040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009fc0 tx=0x7f28b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:16:59.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.189+0000 7f28c2000640 1 -- 172.21.15.50:0/4098997847 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f28b009c2c0 con 0x7f28c4074f40 2024-09-10T10:16:59.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.390+0000 7f28cc000640 1 -- 172.21.15.50:0/4098997847 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f28c402d7c0 con 0x7f28c4074f40 2024-09-10T10:16:59.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.390+0000 7f28c2000640 1 -- 172.21.15.50:0/4098997847 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v95) ==== 81+0+592 (secure 0 0 0) 0x7f28b009bbc0 con 0x7f28c4074f40 2024-09-10T10:16:59.392 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/2344357525 2024-09-11T10:00:58.655297+0000 2024-09-10T10:16:59.392 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/2344357525 2024-09-11T10:00:58.655297+0000 2024-09-10T10:16:59.392 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/3762668389 2024-09-11T10:00:58.655297+0000 2024-09-10T10:16:59.392 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/3709959859 2024-09-11T10:00:58.655297+0000 2024-09-10T10:16:59.392 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/3594719218 2024-09-11T10:00:30.124281+0000 2024-09-10T10:16:59.392 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2396848832 2024-09-11T10:00:30.124281+0000 2024-09-10T10:16:59.393 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1220276123 2024-09-11T10:00:30.124281+0000 2024-09-10T10:16:59.393 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2312780179 2024-09-11T10:00:58.655297+0000 2024-09-10T10:16:59.393 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/3083035719 2024-09-11T10:00:30.124281+0000 2024-09-10T10:16:59.393 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/3083035719 2024-09-11T10:00:30.124281+0000 2024-09-10T10:16:59.393 INFO:teuthology.orchestra.run.smithi050.stderr:listed 10 entries 2024-09-10T10:16:59.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.393+0000 7f28cc000640 1 -- 172.21.15.50:0/4098997847 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f28ac0a2b80 msgr2=0x7f28ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:59.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.393+0000 7f28cc000640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f28ac0a2b80 0x7f28ac0a5040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009fc0 tx=0x7f28b8005f90 comp rx=0 tx=0).stop 2024-09-10T10:16:59.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.393+0000 7f28cc000640 1 -- 172.21.15.50:0/4098997847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c4074f40 msgr2=0x7f28c419ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:16:59.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.393+0000 7f28cc000640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c4074f40 0x7f28c419ab90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f28b000ea60 tx=0x7f28b000ef20 comp rx=0 tx=0).stop 2024-09-10T10:16:59.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.394+0000 7f28cc000640 1 -- 172.21.15.50:0/4098997847 shutdown_connections 2024-09-10T10:16:59.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.394+0000 7f28cc000640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f28ac0a2b80 0x7f28ac0a5040 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:59.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.394+0000 7f28cc000640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28c410e3c0 0x7f28c419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:59.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.394+0000 7f28cc000640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28c4074f40 0x7f28c419ab90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:59.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.394+0000 7f28cc000640 1 --2- 172.21.15.50:0/4098997847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28c4074620 0x7f28c419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:16:59.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.394+0000 7f28cc000640 1 -- 172.21.15.50:0/4098997847 >> 172.21.15.50:0/4098997847 conn(0x7f28c40fd8c0 msgr2=0x7f28c40fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:16:59.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.394+0000 7f28cc000640 1 -- 172.21.15.50:0/4098997847 shutdown_connections 2024-09-10T10:16:59.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:16:59.394+0000 7f28cc000640 1 -- 172.21.15.50:0/4098997847 wait complete. 2024-09-10T10:17:00.240 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T10:17:00.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:17:00.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T10:17:00.322 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-09-10T10:17:00.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:17:00.322 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T10:17:00.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:00 smithi189 ceph-mon[34999]: pgmap v565: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:17:00.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:00 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/4098997847' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:17:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:00 smithi084 ceph-mon[34812]: pgmap v565: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:17:00.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:00 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/4098997847' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:17:00.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:17:00.372 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-09-10T10:17:00.408 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T10:17:00.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:17:00.408 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T10:17:00.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:00 smithi050 ceph-mon[30354]: pgmap v565: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T10:17:00.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:00 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/4098997847' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:17:00.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:17:00.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-09-10T10:17:00.806 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T10:17:00.816 INFO:tasks.cephadm:Teardown begin 2024-09-10T10:17:00.817 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T10:17:00.817 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:17:01.202 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:17:01.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.762+0000 7f20c4200640 1 -- 172.21.15.50:0/1231878943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc101de0 msgr2=0x7f20bc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:01.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.762+0000 7f20c4200640 1 --2- 172.21.15.50:0/1231878943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc101de0 0x7f20bc1021c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009900 tx=0x7f20b002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:17:01.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.762+0000 7f20c4200640 1 -- 172.21.15.50:0/1231878943 shutdown_connections 2024-09-10T10:17:01.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.762+0000 7f20c4200640 1 --2- 172.21.15.50:0/1231878943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20bc106f10 0x7f20bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:01.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.762+0000 7f20c4200640 1 --2- 172.21.15.50:0/1231878943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20bc102790 0x7f20bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:01.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.762+0000 7f20c4200640 1 --2- 172.21.15.50:0/1231878943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc101de0 0x7f20bc1021c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:01.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.763+0000 7f20c4200640 1 -- 172.21.15.50:0/1231878943 >> 172.21.15.50:0/1231878943 conn(0x7f20bc0fd8c0 msgr2=0x7f20bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:01.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.763+0000 7f20c4200640 1 -- 172.21.15.50:0/1231878943 shutdown_connections 2024-09-10T10:17:01.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.763+0000 7f20c4200640 1 -- 172.21.15.50:0/1231878943 wait complete. 2024-09-10T10:17:01.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.763+0000 7f20c4200640 1 Processor -- start 2024-09-10T10:17:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.764+0000 7f20c4200640 1 -- start start 2024-09-10T10:17:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.764+0000 7f20c4200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc101de0 0x7f20bc198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.764+0000 7f20c4200640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20bc102790 0x7f20bc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.764+0000 7f20c4200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20bc106f10 0x7f20bc19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.764+0000 7f20c4200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc111fc0 con 0x7f20bc101de0 2024-09-10T10:17:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.764+0000 7f20c4200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc111e40 con 0x7f20bc106f10 2024-09-10T10:17:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.764+0000 7f20c4200640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc112140 con 0x7f20bc102790 2024-09-10T10:17:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.764+0000 7f20c1800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc101de0 0x7f20bc198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.764+0000 7f20c1800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc101de0 0x7f20bc198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41480/0 (socket says 172.21.15.50:41480) 2024-09-10T10:17:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.764+0000 7f20c1800640 1 -- 172.21.15.50:0/2880966823 learned_addr learned my addr 172.21.15.50:0/2880966823 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:17:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.764+0000 7f20c0e00640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20bc102790 0x7f20bc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.764+0000 7f20c2200640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20bc106f10 0x7f20bc19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.765+0000 7f20c1800640 1 -- 172.21.15.50:0/2880966823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20bc102790 msgr2=0x7f20bc1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.765+0000 7f20c1800640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20bc102790 0x7f20bc1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.765+0000 7f20c1800640 1 -- 172.21.15.50:0/2880966823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20bc106f10 msgr2=0x7f20bc19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.765+0000 7f20c1800640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20bc106f10 0x7f20bc19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.765+0000 7f20c1800640 1 -- 172.21.15.50:0/2880966823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20bc19d410 con 0x7f20bc101de0 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.765+0000 7f20c1800640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc101de0 0x7f20bc198460 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f20b0004770 tx=0x7f20b0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.765+0000 7f20ba000640 1 -- 172.21.15.50:0/2880966823 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b003f070 con 0x7f20bc101de0 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.765+0000 7f20ba000640 1 -- 172.21.15.50:0/2880966823 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20b0031ca0 con 0x7f20bc101de0 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.765+0000 7f20c4200640 1 -- 172.21.15.50:0/2880966823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20bc19d6a0 con 0x7f20bc101de0 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.765+0000 7f20ba000640 1 -- 172.21.15.50:0/2880966823 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0035030 con 0x7f20bc101de0 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.766+0000 7f20c4200640 1 -- 172.21.15.50:0/2880966823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20bc1a4fe0 con 0x7f20bc101de0 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.767+0000 7f20c4200640 1 -- 172.21.15.50:0/2880966823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20bc1032c0 con 0x7f20bc101de0 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.768+0000 7f20ba000640 1 -- 172.21.15.50:0/2880966823 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f20b0042070 con 0x7f20bc101de0 2024-09-10T10:17:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.770+0000 7f20ba000640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f20a40a2b80 0x7f20a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.771+0000 7f20ba000640 1 -- 172.21.15.50:0/2880966823 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f20b00efbc0 con 0x7f20bc101de0 2024-09-10T10:17:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.771+0000 7f20c0e00640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f20a40a2b80 0x7f20a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.771+0000 7f20c0e00640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f20a40a2b80 0x7f20a40a5040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0fdce0 tx=0x7f20a800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.774+0000 7f20ba000640 1 -- 172.21.15.50:0/2880966823 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f20b00bc0e0 con 0x7f20bc101de0 2024-09-10T10:17:01.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.996+0000 7f20c4200640 1 -- 172.21.15.50:0/2880966823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20bc10a0f0 con 0x7f20bc101de0 2024-09-10T10:17:01.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.997+0000 7f20ba000640 1 -- 172.21.15.50:0/2880966823 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7f20b00c03e0 con 0x7f20bc101de0 2024-09-10T10:17:01.999 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:17:01.999 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:17:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:17:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.999+0000 7f20c4200640 1 -- 172.21.15.50:0/2880966823 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f20a40a2b80 msgr2=0x7f20a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.999+0000 7f20c4200640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f20a40a2b80 0x7f20a40a5040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0fdce0 tx=0x7f20a800b390 comp rx=0 tx=0).stop 2024-09-10T10:17:02.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.999+0000 7f20c4200640 1 -- 172.21.15.50:0/2880966823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc101de0 msgr2=0x7f20bc198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.999+0000 7f20c4200640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc101de0 0x7f20bc198460 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f20b0004770 tx=0x7f20b0003c10 comp rx=0 tx=0).stop 2024-09-10T10:17:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.999+0000 7f20c4200640 1 -- 172.21.15.50:0/2880966823 shutdown_connections 2024-09-10T10:17:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.999+0000 7f20c4200640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f20a40a2b80 0x7f20a40a5040 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.999+0000 7f20c4200640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20bc106f10 0x7f20bc19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.999+0000 7f20c4200640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20bc102790 0x7f20bc1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:02.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.999+0000 7f20c4200640 1 --2- 172.21.15.50:0/2880966823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20bc101de0 0x7f20bc198460 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.999+0000 7f20c4200640 1 -- 172.21.15.50:0/2880966823 >> 172.21.15.50:0/2880966823 conn(0x7f20bc0fd8c0 msgr2=0x7f20bc0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.999+0000 7f20c4200640 1 -- 172.21.15.50:0/2880966823 shutdown_connections 2024-09-10T10:17:02.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:01.999+0000 7f20c4200640 1 -- 172.21.15.50:0/2880966823 wait complete. 2024-09-10T10:17:02.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:02 smithi189 ceph-mon[34999]: pgmap v566: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:17:02.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:02 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2880966823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:17:02.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:02 smithi084 ceph-mon[34812]: pgmap v566: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:17:02.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:02 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2880966823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:17:02.376 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:02 smithi050 ceph-mon[30354]: pgmap v566: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T10:17:02.376 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:02 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2880966823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:17:02.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:17:03.278 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:17:03.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.863+0000 7fa289000640 1 -- 172.21.15.50:0/4017470134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa284076720 msgr2=0x7fa284076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:03.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.863+0000 7fa289000640 1 --2- 172.21.15.50:0/4017470134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa284076720 0x7fa284076b00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa274009900 tx=0x7fa27402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:17:03.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.863+0000 7fa289000640 1 -- 172.21.15.50:0/4017470134 shutdown_connections 2024-09-10T10:17:03.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.863+0000 7fa289000640 1 --2- 172.21.15.50:0/4017470134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa284112a50 0x7fa284114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:03.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.863+0000 7fa289000640 1 --2- 172.21.15.50:0/4017470134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa284077040 0x7fa284112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:03.865 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.863+0000 7fa289000640 1 --2- 172.21.15.50:0/4017470134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa284076720 0x7fa284076b00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:03.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.863+0000 7fa289000640 1 -- 172.21.15.50:0/4017470134 >> 172.21.15.50:0/4017470134 conn(0x7fa2840ffa50 msgr2=0x7fa284101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:03.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.863+0000 7fa289000640 1 -- 172.21.15.50:0/4017470134 shutdown_connections 2024-09-10T10:17:03.866 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.863+0000 7fa289000640 1 -- 172.21.15.50:0/4017470134 wait complete. 2024-09-10T10:17:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.864+0000 7fa289000640 1 Processor -- start 2024-09-10T10:17:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.864+0000 7fa289000640 1 -- start start 2024-09-10T10:17:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.865+0000 7fa289000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa284076720 0x7fa2841a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:03.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.865+0000 7fa289000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa284077040 0x7fa2841a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.865+0000 7fa289000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa284112a50 0x7fa28419e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.865+0000 7fa289000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa284118610 con 0x7fa284076720 2024-09-10T10:17:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.865+0000 7fa289000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa284118490 con 0x7fa284112a50 2024-09-10T10:17:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.865+0000 7fa289000640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa284118790 con 0x7fa284077040 2024-09-10T10:17:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.865+0000 7fa281e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa284076720 0x7fa2841a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.865+0000 7fa281e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa284076720 0x7fa2841a4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41500/0 (socket says 172.21.15.50:41500) 2024-09-10T10:17:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.865+0000 7fa281e00640 1 -- 172.21.15.50:0/2757090784 learned_addr learned my addr 172.21.15.50:0/2757090784 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:17:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.865+0000 7fa281400640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa284077040 0x7fa2841a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.865+0000 7fa282800640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa284112a50 0x7fa28419e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.866+0000 7fa281e00640 1 -- 172.21.15.50:0/2757090784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa284077040 msgr2=0x7fa2841a4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.866+0000 7fa281e00640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa284077040 0x7fa2841a4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.866+0000 7fa281e00640 1 -- 172.21.15.50:0/2757090784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa284112a50 msgr2=0x7fa28419e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:03.868 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.866+0000 7fa281e00640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa284112a50 0x7fa28419e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.866+0000 7fa281e00640 1 -- 172.21.15.50:0/2757090784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28419f0f0 con 0x7fa284076720 2024-09-10T10:17:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.866+0000 7fa282800640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa284112a50 0x7fa28419e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:17:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.866+0000 7fa281e00640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa284076720 0x7fa2841a4800 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa274004770 tx=0x7fa274003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.866+0000 7fa27aa00640 1 -- 172.21.15.50:0/2757090784 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27403f070 con 0x7fa284076720 2024-09-10T10:17:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.866+0000 7fa27aa00640 1 -- 172.21.15.50:0/2757090784 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa274031ca0 con 0x7fa284076720 2024-09-10T10:17:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.866+0000 7fa289000640 1 -- 172.21.15.50:0/2757090784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28419f380 con 0x7fa284076720 2024-09-10T10:17:03.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.866+0000 7fa27aa00640 1 -- 172.21.15.50:0/2757090784 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274035030 con 0x7fa284076720 2024-09-10T10:17:03.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.866+0000 7fa289000640 1 -- 172.21.15.50:0/2757090784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2841ab6d0 con 0x7fa284076720 2024-09-10T10:17:03.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.867+0000 7fa289000640 1 -- 172.21.15.50:0/2757090784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa284076b00 con 0x7fa284076720 2024-09-10T10:17:03.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.869+0000 7fa27aa00640 1 -- 172.21.15.50:0/2757090784 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa274042070 con 0x7fa284076720 2024-09-10T10:17:03.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.870+0000 7fa27aa00640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa2680a2c00 0x7fa2680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:03.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.871+0000 7fa27aa00640 1 -- 172.21.15.50:0/2757090784 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fa2740ef970 con 0x7fa284076720 2024-09-10T10:17:03.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.871+0000 7fa281400640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa2680a2c00 0x7fa2680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:03.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.871+0000 7fa281400640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa2680a2c00 0x7fa2680a50c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa2840792b0 tx=0x7fa270005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:03.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:03.875+0000 7fa27aa00640 1 -- 172.21.15.50:0/2757090784 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2740bbf50 con 0x7fa284076720 2024-09-10T10:17:04.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.099+0000 7fa289000640 1 -- 172.21.15.50:0/2757090784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa28410dbe0 con 0x7fa284076720 2024-09-10T10:17:04.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.100+0000 7fa27aa00640 1 -- 172.21.15.50:0/2757090784 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11912 (secure 0 0 0) 0x7fa2740c0250 con 0x7fa284076720 2024-09-10T10:17:04.101 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:17:04.101 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"btime":"2024-09-10T10:11:16:051906+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3271446428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":3271446428},{"type":"v1","addr":"172.21.15.50:6835","nonce":3271446428}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14451,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/206120468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":206120468},{"type":"v1","addr":"172.21.15.50:6837","nonce":206120468}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14484,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/1454697649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":1454697649},{"type":"v1","addr":"172.21.15.50:6839","nonce":1454697649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14496,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/1041312964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":1041312964},{"type":"v1","addr":"172.21.15.50:6841","nonce":1041312964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/3692905441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":3692905441},{"type":"v1","addr":"172.21.15.189:6833","nonce":3692905441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/4243926452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":4243926452},{"type":"v1","addr":"172.21.15.84:6833","nonce":4243926452}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:08:36.316040+0000","modified":"2024-09-10T10:11:15.689239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24521,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1101442212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1101442212},{"type":"v1","addr":"172.21.15.189:6835","nonce":1101442212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/1698924277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1698924277},{"type":"v1","addr":"172.21.15.84:6835","nonce":1698924277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/251140305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":251140305},{"type":"v1","addr":"172.21.15.189:6837","nonce":251140305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.189:6839/2768859315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":2768859315},{"type":"v1","addr":"172.21.15.189:6839","nonce":2768859315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24521":{"gid":24521,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":20,"addr":"172.21.15.84:6837/1457195028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1457195028},{"type":"v1","addr":"172.21.15.84:6837","nonce":1457195028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6839/4235486934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":4235486934},{"type":"v1","addr":"172.21.15.84:6839","nonce":4235486934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24521,24517]},"id":1}]} 2024-09-10T10:17:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2024-09-10T10:17:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.102+0000 7fa289000640 1 -- 172.21.15.50:0/2757090784 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa2680a2c00 msgr2=0x7fa2680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.102+0000 7fa289000640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa2680a2c00 0x7fa2680a50c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa2840792b0 tx=0x7fa270005f90 comp rx=0 tx=0).stop 2024-09-10T10:17:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.102+0000 7fa289000640 1 -- 172.21.15.50:0/2757090784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa284076720 msgr2=0x7fa2841a4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.102+0000 7fa289000640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa284076720 0x7fa2841a4800 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa274004770 tx=0x7fa274003c10 comp rx=0 tx=0).stop 2024-09-10T10:17:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.102+0000 7fa289000640 1 -- 172.21.15.50:0/2757090784 shutdown_connections 2024-09-10T10:17:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.102+0000 7fa289000640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa2680a2c00 0x7fa2680a50c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.102+0000 7fa289000640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa284112a50 0x7fa28419e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.102+0000 7fa289000640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa284077040 0x7fa2841a4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:04.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.102+0000 7fa289000640 1 --2- 172.21.15.50:0/2757090784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa284076720 0x7fa2841a4800 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:04.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.102+0000 7fa289000640 1 -- 172.21.15.50:0/2757090784 >> 172.21.15.50:0/2757090784 conn(0x7fa2840ffa50 msgr2=0x7fa284101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:04.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.102+0000 7fa289000640 1 -- 172.21.15.50:0/2757090784 shutdown_connections 2024-09-10T10:17:04.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:04.102+0000 7fa289000640 1 -- 172.21.15.50:0/2757090784 wait complete. 2024-09-10T10:17:04.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:04 smithi189 ceph-mon[34999]: pgmap v567: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T10:17:04.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:04 smithi084 ceph-mon[34812]: pgmap v567: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T10:17:04.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:04 smithi050 ceph-mon[30354]: pgmap v567: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T10:17:04.951 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:17:05.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:05 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2757090784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:17:05.353 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:17:05.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:05 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2757090784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:17:05.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:05 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2757090784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:17:05.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.901+0000 7fd8eea00640 1 -- 172.21.15.50:0/3168253812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e8104010 msgr2=0x7fd8e81043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:05.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.902+0000 7fd8eea00640 1 --2- 172.21.15.50:0/3168253812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e8104010 0x7fd8e81043f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009900 tx=0x7fd8d802a410 comp rx=0 tx=0).stop 2024-09-10T10:17:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.902+0000 7fd8eea00640 1 -- 172.21.15.50:0/3168253812 shutdown_connections 2024-09-10T10:17:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.902+0000 7fd8eea00640 1 --2- 172.21.15.50:0/3168253812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e8109140 0x7fd8e8110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.902+0000 7fd8eea00640 1 --2- 172.21.15.50:0/3168253812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8e81049c0 0x7fd8e8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.902+0000 7fd8eea00640 1 --2- 172.21.15.50:0/3168253812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e8104010 0x7fd8e81043f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.902+0000 7fd8eea00640 1 -- 172.21.15.50:0/3168253812 >> 172.21.15.50:0/3168253812 conn(0x7fd8e80ffa50 msgr2=0x7fd8e8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.902+0000 7fd8eea00640 1 -- 172.21.15.50:0/3168253812 shutdown_connections 2024-09-10T10:17:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.902+0000 7fd8eea00640 1 -- 172.21.15.50:0/3168253812 wait complete. 2024-09-10T10:17:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.903+0000 7fd8eea00640 1 Processor -- start 2024-09-10T10:17:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.903+0000 7fd8eea00640 1 -- start start 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.903+0000 7fd8eea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e8104010 0x7fd8e819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.903+0000 7fd8eea00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8e81049c0 0x7fd8e819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.903+0000 7fd8eea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e8109140 0x7fd8e819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.903+0000 7fd8eea00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e8114160 con 0x7fd8e8109140 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.903+0000 7fd8eea00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e8113fe0 con 0x7fd8e8104010 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.903+0000 7fd8eea00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e81142e0 con 0x7fd8e81049c0 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.903+0000 7fd8e7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e8104010 0x7fd8e819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.904+0000 7fd8eca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e8109140 0x7fd8e819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.904+0000 7fd8e7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e8104010 0x7fd8e819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:37608/0 (socket says 172.21.15.50:37608) 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.904+0000 7fd8e7e00640 1 -- 172.21.15.50:0/2410904687 learned_addr learned my addr 172.21.15.50:0/2410904687 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.904+0000 7fd8df400640 1 --2- 172.21.15.50:0/2410904687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8e81049c0 0x7fd8e819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.904+0000 7fd8e7e00640 1 -- 172.21.15.50:0/2410904687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8e81049c0 msgr2=0x7fd8e819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.904+0000 7fd8e7e00640 1 --2- 172.21.15.50:0/2410904687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8e81049c0 0x7fd8e819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.904+0000 7fd8e7e00640 1 -- 172.21.15.50:0/2410904687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e8109140 msgr2=0x7fd8e819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.904+0000 7fd8e7e00640 1 --2- 172.21.15.50:0/2410904687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e8109140 0x7fd8e819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.904+0000 7fd8e7e00640 1 -- 172.21.15.50:0/2410904687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e819f5f0 con 0x7fd8e8104010 2024-09-10T10:17:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.904+0000 7fd8e7e00640 1 --2- 172.21.15.50:0/2410904687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e8104010 0x7fd8e819a640 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8006010 tx=0x7fd8d8004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.905+0000 7fd8e5600640 1 -- 172.21.15.50:0/2410904687 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d803f030 con 0x7fd8e8104010 2024-09-10T10:17:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.905+0000 7fd8eea00640 1 -- 172.21.15.50:0/2410904687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e819f880 con 0x7fd8e8104010 2024-09-10T10:17:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.905+0000 7fd8e5600640 1 -- 172.21.15.50:0/2410904687 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8d8004440 con 0x7fd8e8104010 2024-09-10T10:17:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.905+0000 7fd8e5600640 1 -- 172.21.15.50:0/2410904687 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8035070 con 0x7fd8e8104010 2024-09-10T10:17:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.905+0000 7fd8eea00640 1 -- 172.21.15.50:0/2410904687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e81a71c0 con 0x7fd8e8104010 2024-09-10T10:17:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.906+0000 7fd8eea00640 1 -- 172.21.15.50:0/2410904687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e81043f0 con 0x7fd8e8104010 2024-09-10T10:17:05.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.908+0000 7fd8e5600640 1 -- 172.21.15.50:0/2410904687 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd8d8042030 con 0x7fd8e8104010 2024-09-10T10:17:05.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.909+0000 7fd8e5600640 1 --2- 172.21.15.50:0/2410904687 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd8cc0a2b80 0x7fd8cc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:05.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.909+0000 7fd8e5600640 1 -- 172.21.15.50:0/2410904687 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7fd8d80ef9b0 con 0x7fd8e8104010 2024-09-10T10:17:05.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.909+0000 7fd8df400640 1 --2- 172.21.15.50:0/2410904687 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd8cc0a2b80 0x7fd8cc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:05.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.910+0000 7fd8df400640 1 --2- 172.21.15.50:0/2410904687 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd8cc0a2b80 0x7fd8cc0a5040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80ffe70 tx=0x7fd8d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:05.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:05.912+0000 7fd8e5600640 1 -- 172.21.15.50:0/2410904687 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd8d80bbed0 con 0x7fd8e8104010 2024-09-10T10:17:06.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.102+0000 7fd8eea00640 1 -- 172.21.15.50:0/2410904687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8e810c320 con 0x7fd8e8104010 2024-09-10T10:17:06.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.104+0000 7fd8e5600640 1 -- 172.21.15.50:0/2410904687 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24775 (secure 0 0 0) 0x7fd8d80c01d0 con 0x7fd8e8104010 2024-09-10T10:17:06.106 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-10T10:17:06.106 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":95,"fsid":"4d54e0f8-6f5b-11ef-bcea-c7b262605968","created":"2024-09-10T10:00:05.600019+0000","modified":"2024-09-10T10:10:00.717554+0000","last_up_change":"2024-09-10T10:07:37.564756+0000","last_in_change":"2024-09-10T10:07:13.654320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:03:29.276863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:08:31.657814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:08:34.330951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T10:08:42.905904+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3afef902-c68c-43dc-bc50-62848d35dcc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6803","nonce":386458864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6805","nonce":386458864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6809","nonce":386458864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":386458864},{"type":"v1","addr":"172.21.15.50:6807","nonce":386458864}]},"public_addr":"172.21.15.50:6803/386458864","cluster_addr":"172.21.15.50:6805/386458864","heartbeat_back_addr":"172.21.15.50:6809/386458864","heartbeat_front_addr":"172.21.15.50:6807/386458864","state":["exists","up"]},{"osd":1,"uuid":"30da8eb4-6117-4e2c-8dbb-b0da47d30752","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6801","nonce":139119620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6803","nonce":139119620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6807","nonce":139119620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":139119620},{"type":"v1","addr":"172.21.15.84:6805","nonce":139119620}]},"public_addr":"172.21.15.84:6801/139119620","cluster_addr":"172.21.15.84:6803/139119620","heartbeat_back_addr":"172.21.15.84:6807/139119620","heartbeat_front_addr":"172.21.15.84:6805/139119620","state":["exists","up"]},{"osd":2,"uuid":"bf7e7da7-c81c-420d-884d-ea22de897b36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6801","nonce":3611073908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6803","nonce":3611073908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6807","nonce":3611073908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3611073908},{"type":"v1","addr":"172.21.15.189:6805","nonce":3611073908}]},"public_addr":"172.21.15.189:6801/3611073908","cluster_addr":"172.21.15.189:6803/3611073908","heartbeat_back_addr":"172.21.15.189:6807/3611073908","heartbeat_front_addr":"172.21.15.189:6805/3611073908","state":["exists","up"]},{"osd":3,"uuid":"e018ffaa-703d-4b65-81d4-0b673271ec13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6811","nonce":3341598052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6813","nonce":3341598052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6817","nonce":3341598052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3341598052},{"type":"v1","addr":"172.21.15.50:6815","nonce":3341598052}]},"public_addr":"172.21.15.50:6811/3341598052","cluster_addr":"172.21.15.50:6813/3341598052","heartbeat_back_addr":"172.21.15.50:6817/3341598052","heartbeat_front_addr":"172.21.15.50:6815/3341598052","state":["exists","up"]},{"osd":4,"uuid":"e47aaa2b-af6f-495e-a0db-d15709cd9d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6809","nonce":361197029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6811","nonce":361197029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6815","nonce":361197029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":361197029},{"type":"v1","addr":"172.21.15.84:6813","nonce":361197029}]},"public_addr":"172.21.15.84:6809/361197029","cluster_addr":"172.21.15.84:6811/361197029","heartbeat_back_addr":"172.21.15.84:6815/361197029","heartbeat_front_addr":"172.21.15.84:6813/361197029","state":["exists","up"]},{"osd":5,"uuid":"8272a0aa-9784-4815-87cc-971b69d9fafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6809","nonce":2921666386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6811","nonce":2921666386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6815","nonce":2921666386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":2921666386},{"type":"v1","addr":"172.21.15.189:6813","nonce":2921666386}]},"public_addr":"172.21.15.189:6809/2921666386","cluster_addr":"172.21.15.189:6811/2921666386","heartbeat_back_addr":"172.21.15.189:6815/2921666386","heartbeat_front_addr":"172.21.15.189:6813/2921666386","state":["exists","up"]},{"osd":6,"uuid":"637fff8d-4b45-4311-871f-c367b574351f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6819","nonce":335559869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6821","nonce":335559869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6825","nonce":335559869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":335559869},{"type":"v1","addr":"172.21.15.50:6823","nonce":335559869}]},"public_addr":"172.21.15.50:6819/335559869","cluster_addr":"172.21.15.50:6821/335559869","heartbeat_back_addr":"172.21.15.50:6825/335559869","heartbeat_front_addr":"172.21.15.50:6823/335559869","state":["exists","up"]},{"osd":7,"uuid":"0fcce770-960b-49a6-9e44-a7acf157afc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6817","nonce":3709749103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6819","nonce":3709749103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6823","nonce":3709749103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3709749103},{"type":"v1","addr":"172.21.15.84:6821","nonce":3709749103}]},"public_addr":"172.21.15.84:6817/3709749103","cluster_addr":"172.21.15.84:6819/3709749103","heartbeat_back_addr":"172.21.15.84:6823/3709749103","heartbeat_front_addr":"172.21.15.84:6821/3709749103","state":["exists","up"]},{"osd":8,"uuid":"a23d1843-1228-44ab-af7b-209c433b38dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6817","nonce":2053233762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6819","nonce":2053233762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6823","nonce":2053233762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2053233762},{"type":"v1","addr":"172.21.15.189:6821","nonce":2053233762}]},"public_addr":"172.21.15.189:6817/2053233762","cluster_addr":"172.21.15.189:6819/2053233762","heartbeat_back_addr":"172.21.15.189:6823/2053233762","heartbeat_front_addr":"172.21.15.189:6821/2053233762","state":["exists","up"]},{"osd":9,"uuid":"b80673a0-7727-4303-894e-9d056dfd45b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6827","nonce":471324226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6829","nonce":471324226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6833","nonce":471324226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":471324226},{"type":"v1","addr":"172.21.15.50:6831","nonce":471324226}]},"public_addr":"172.21.15.50:6827/471324226","cluster_addr":"172.21.15.50:6829/471324226","heartbeat_back_addr":"172.21.15.50:6833/471324226","heartbeat_front_addr":"172.21.15.50:6831/471324226","state":["exists","up"]},{"osd":10,"uuid":"f0e5ac95-60a0-4425-b069-1c87439d05bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6825","nonce":1222120613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6827","nonce":1222120613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6831","nonce":1222120613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":1222120613},{"type":"v1","addr":"172.21.15.84:6829","nonce":1222120613}]},"public_addr":"172.21.15.84:6825/1222120613","cluster_addr":"172.21.15.84:6827/1222120613","heartbeat_back_addr":"172.21.15.84:6831/1222120613","heartbeat_front_addr":"172.21.15.84:6829/1222120613","state":["exists","up"]},{"osd":11,"uuid":"613818bd-4319-4c6f-b3a9-2e034bfe1d5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6825","nonce":2433594841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6827","nonce":2433594841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6831","nonce":2433594841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":2433594841},{"type":"v1","addr":"172.21.15.189:6829","nonce":2433594841}]},"public_addr":"172.21.15.189:6825/2433594841","cluster_addr":"172.21.15.189:6827/2433594841","heartbeat_back_addr":"172.21.15.189:6831/2433594841","heartbeat_front_addr":"172.21.15.189:6829/2433594841","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:32.560691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:02:59.534504+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:25.556930+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:03:55.992025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:22.712025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:04:49.372986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:19.626508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:05:46.261300+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:12.774925+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:06:42.564141+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:09.096201+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:07:35.778614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":7}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6800/2344357525":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3762668389":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3709959859":"2024-09-11T10:00:58.655297+0000","172.21.15.50:0/3594719218":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2396848832":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/1220276123":"2024-09-11T10:00:30.124281+0000","172.21.15.50:0/2312780179":"2024-09-11T10:00:58.655297+0000","172.21.15.50:6801/3083035719":"2024-09-11T10:00:30.124281+0000","172.21.15.50:6800/3083035719":"2024-09-11T10:00:30.124281+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.106+0000 7fd8eea00640 1 -- 172.21.15.50:0/2410904687 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd8cc0a2b80 msgr2=0x7fd8cc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.106+0000 7fd8eea00640 1 --2- 172.21.15.50:0/2410904687 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd8cc0a2b80 0x7fd8cc0a5040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80ffe70 tx=0x7fd8d0005f90 comp rx=0 tx=0).stop 2024-09-10T10:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.106+0000 7fd8eea00640 1 -- 172.21.15.50:0/2410904687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e8104010 msgr2=0x7fd8e819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.106+0000 7fd8eea00640 1 --2- 172.21.15.50:0/2410904687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e8104010 0x7fd8e819a640 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8006010 tx=0x7fd8d8004040 comp rx=0 tx=0).stop 2024-09-10T10:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.106+0000 7fd8eea00640 1 -- 172.21.15.50:0/2410904687 shutdown_connections 2024-09-10T10:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.106+0000 7fd8eea00640 1 --2- 172.21.15.50:0/2410904687 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fd8cc0a2b80 0x7fd8cc0a5040 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.106+0000 7fd8eea00640 1 --2- 172.21.15.50:0/2410904687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd8e8109140 0x7fd8e819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.106+0000 7fd8eea00640 1 --2- 172.21.15.50:0/2410904687 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8e81049c0 0x7fd8e819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.106+0000 7fd8eea00640 1 --2- 172.21.15.50:0/2410904687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8e8104010 0x7fd8e819a640 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.106+0000 7fd8eea00640 1 -- 172.21.15.50:0/2410904687 >> 172.21.15.50:0/2410904687 conn(0x7fd8e80ffa50 msgr2=0x7fd8e8100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.106+0000 7fd8eea00640 1 -- 172.21.15.50:0/2410904687 shutdown_connections 2024-09-10T10:17:06.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:06.106+0000 7fd8eea00640 1 -- 172.21.15.50:0/2410904687 wait complete. 2024-09-10T10:17:06.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:06 smithi084 ceph-mon[34812]: pgmap v568: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T10:17:06.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:06 smithi050 ceph-mon[30354]: pgmap v568: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T10:17:06.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:06 smithi189 ceph-mon[34999]: pgmap v568: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T10:17:06.924 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T10:17:07.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:07 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2410904687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:17:07.304 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:17:07.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:07 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2410904687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:17:07.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:07 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2410904687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:17:07.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.829+0000 7f4c9f600640 1 -- 172.21.15.50:0/343029879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c98104010 msgr2=0x7f4c981043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.829+0000 7f4c9f600640 1 --2- 172.21.15.50:0/343029879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c98104010 0x7f4c981043f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009900 tx=0x7f4c8802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:17:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.829+0000 7f4c9f600640 1 -- 172.21.15.50:0/343029879 shutdown_connections 2024-09-10T10:17:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.829+0000 7f4c9f600640 1 --2- 172.21.15.50:0/343029879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c98109140 0x7f4c98110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.829+0000 7f4c9f600640 1 --2- 172.21.15.50:0/343029879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c981049c0 0x7f4c98108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.829+0000 7f4c9f600640 1 --2- 172.21.15.50:0/343029879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c98104010 0x7f4c981043f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.829+0000 7f4c9f600640 1 -- 172.21.15.50:0/343029879 >> 172.21.15.50:0/343029879 conn(0x7f4c980ffa50 msgr2=0x7f4c98101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.829+0000 7f4c9f600640 1 -- 172.21.15.50:0/343029879 shutdown_connections 2024-09-10T10:17:07.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.829+0000 7f4c9f600640 1 -- 172.21.15.50:0/343029879 wait complete. 2024-09-10T10:17:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.830+0000 7f4c9f600640 1 Processor -- start 2024-09-10T10:17:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.830+0000 7f4c9f600640 1 -- start start 2024-09-10T10:17:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.830+0000 7f4c9f600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c98104010 0x7f4c9819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.830+0000 7f4c9f600640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c981049c0 0x7f4c9819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:07.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.830+0000 7f4c9f600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c98109140 0x7f4c9819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.830+0000 7f4c9f600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4c98114160 con 0x7f4c98104010 2024-09-10T10:17:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.830+0000 7f4c9f600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4c98113fe0 con 0x7f4c98109140 2024-09-10T10:17:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.830+0000 7f4c9f600640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4c981142e0 con 0x7f4c981049c0 2024-09-10T10:17:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.830+0000 7f4c9cc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c98104010 0x7f4c9819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.830+0000 7f4c9cc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c98104010 0x7f4c9819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36136/0 (socket says 172.21.15.50:36136) 2024-09-10T10:17:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.831+0000 7f4c9cc00640 1 -- 172.21.15.50:0/905055000 learned_addr learned my addr 172.21.15.50:0/905055000 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:17:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.831+0000 7f4c9d600640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c98109140 0x7f4c9819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.831+0000 7f4c8fe00640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c981049c0 0x7f4c9819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.831+0000 7f4c9cc00640 1 -- 172.21.15.50:0/905055000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c981049c0 msgr2=0x7f4c9819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:07.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.831+0000 7f4c9cc00640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c981049c0 0x7f4c9819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.831+0000 7f4c9cc00640 1 -- 172.21.15.50:0/905055000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c98109140 msgr2=0x7f4c9819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.831+0000 7f4c9cc00640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c98109140 0x7f4c9819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.831+0000 7f4c9cc00640 1 -- 172.21.15.50:0/905055000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9819f600 con 0x7f4c98104010 2024-09-10T10:17:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.831+0000 7f4c9d600640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c98109140 0x7f4c9819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:17:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.831+0000 7f4c9cc00640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c98104010 0x7f4c9819a650 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4c88006010 tx=0x7f4c88004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.832+0000 7f4c96000640 1 -- 172.21.15.50:0/905055000 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8803f030 con 0x7f4c98104010 2024-09-10T10:17:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.832+0000 7f4c9f600640 1 -- 172.21.15.50:0/905055000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c9819f890 con 0x7f4c98104010 2024-09-10T10:17:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.832+0000 7f4c96000640 1 -- 172.21.15.50:0/905055000 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c88004440 con 0x7f4c98104010 2024-09-10T10:17:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.832+0000 7f4c96000640 1 -- 172.21.15.50:0/905055000 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88035070 con 0x7f4c98104010 2024-09-10T10:17:07.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.832+0000 7f4c9f600640 1 -- 172.21.15.50:0/905055000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c981a71d0 con 0x7f4c98104010 2024-09-10T10:17:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.833+0000 7f4c9f600640 1 -- 172.21.15.50:0/905055000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c981054f0 con 0x7f4c98104010 2024-09-10T10:17:07.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.835+0000 7f4c96000640 1 -- 172.21.15.50:0/905055000 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4c88042030 con 0x7f4c98104010 2024-09-10T10:17:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.837+0000 7f4c96000640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4c7c0a2b80 0x7f4c7c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.837+0000 7f4c96000640 1 -- 172.21.15.50:0/905055000 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9150+0+0 (secure 0 0 0) 0x7f4c880ef8c0 con 0x7f4c98104010 2024-09-10T10:17:07.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.837+0000 7f4c8fe00640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4c7c0a2b80 0x7f4c7c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:07.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.838+0000 7f4c8fe00640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4c7c0a2b80 0x7f4c7c0a5040 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4c98102040 tx=0x7f4c80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:07.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:07.839+0000 7f4c96000640 1 -- 172.21.15.50:0/905055000 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c880bc430 con 0x7f4c98104010 2024-09-10T10:17:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.061+0000 7f4c9f600640 1 -- 172.21.15.50:0/905055000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4c9810c320 con 0x7f4c98104010 2024-09-10T10:17:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.063+0000 7f4c96000640 1 -- 172.21.15.50:0/905055000 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f4c880bbd30 con 0x7f4c98104010 2024-09-10T10:17:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T10:17:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.067+0000 7f4c9f600640 1 -- 172.21.15.50:0/905055000 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4c7c0a2b80 msgr2=0x7f4c7c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.067+0000 7f4c9f600640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4c7c0a2b80 0x7f4c7c0a5040 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4c98102040 tx=0x7f4c80005f90 comp rx=0 tx=0).stop 2024-09-10T10:17:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.067+0000 7f4c9f600640 1 -- 172.21.15.50:0/905055000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c98104010 msgr2=0x7f4c9819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.067+0000 7f4c9f600640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c98104010 0x7f4c9819a650 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4c88006010 tx=0x7f4c88004040 comp rx=0 tx=0).stop 2024-09-10T10:17:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.067+0000 7f4c9f600640 1 -- 172.21.15.50:0/905055000 shutdown_connections 2024-09-10T10:17:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.067+0000 7f4c9f600640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f4c7c0a2b80 0x7f4c7c0a5040 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.067+0000 7f4c9f600640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c98109140 0x7f4c9819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.067+0000 7f4c9f600640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c981049c0 0x7f4c9819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.067+0000 7f4c9f600640 1 --2- 172.21.15.50:0/905055000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c98104010 0x7f4c9819a650 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.067+0000 7f4c9f600640 1 -- 172.21.15.50:0/905055000 >> 172.21.15.50:0/905055000 conn(0x7f4c980ffa50 msgr2=0x7f4c98100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.067+0000 7f4c9f600640 1 -- 172.21.15.50:0/905055000 shutdown_connections 2024-09-10T10:17:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:08.067+0000 7f4c9f600640 1 -- 172.21.15.50:0/905055000 wait complete. 2024-09-10T10:17:08.349 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-b[64500]: ignoring --setuser ceph since I am not root 2024-09-10T10:17:08.349 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-b[64500]: ignoring --setgroup ceph since I am not root 2024-09-10T10:17:08.349 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-b[64500]: starting mds.b at 2024-09-10T10:17:08.350 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-h[64196]: ignoring --setuser ceph since I am not root 2024-09-10T10:17:08.350 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-h[64196]: ignoring --setgroup ceph since I am not root 2024-09-10T10:17:08.350 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-mds[64200]: -- 172.21.15.84:0/3495954385 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a32c9bb860 con 0x55a32c999000 2024-09-10T10:17:08.350 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-h[64196]: starting mds.h at 2024-09-10T10:17:08.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-mon[34812]: pgmap v569: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T10:17:08.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/905055000' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T10:17:08.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-mon[34812]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T10:17:08.350 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-mon[34812]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:17:08.351 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/905055000' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T10:17:08.351 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-mon[34812]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T10:17:08.351 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-mon[34812]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T10:17:08.351 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-e[63877]: ignoring --setuser ceph since I am not root 2024-09-10T10:17:08.351 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-e[63877]: ignoring --setgroup ceph since I am not root 2024-09-10T10:17:08.351 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-mds[63881]: -- 172.21.15.84:0/2656764482 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55819d911c20 con 0x55819d8ef400 2024-09-10T10:17:08.351 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:17:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-e[63877]: starting mds.e at 2024-09-10T10:17:08.463 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:08 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a[30350]: 2024-09-10T10:17:08.062+0000 7f597ce00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:17:08.463 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:08 smithi050 ceph-mon[30354]: pgmap v569: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T10:17:08.463 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:08 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/905055000' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T10:17:08.463 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:08 smithi050 ceph-mon[30354]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T10:17:08.463 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:08 smithi050 ceph-mon[30354]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:17:08.463 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:08 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/905055000' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T10:17:08.464 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:08 smithi050 ceph-mon[30354]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T10:17:08.464 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:08 smithi050 ceph-mon[30354]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T10:17:08.585 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-c[64971]: ignoring --setuser ceph since I am not root 2024-09-10T10:17:08.586 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-c[64971]: ignoring --setgroup ceph since I am not root 2024-09-10T10:17:08.586 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-mds[64975]: -- 172.21.15.189:0/1872170397 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dbb7317c20 con 0x55dbb72f5000 2024-09-10T10:17:08.586 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-c[64971]: starting mds.c at 2024-09-10T10:17:08.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-mon[34999]: pgmap v569: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T10:17:08.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/905055000' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T10:17:08.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-mon[34999]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T10:17:08.587 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-mon[34999]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:17:08.587 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/905055000' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T10:17:08.587 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-mon[34999]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T10:17:08.587 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-mon[34999]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T10:17:08.587 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-i[65271]: ignoring --setuser ceph since I am not root 2024-09-10T10:17:08.587 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-i[65271]: ignoring --setgroup ceph since I am not root 2024-09-10T10:17:08.587 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-mds[65275]: -- 172.21.15.189:0/382982414 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563908ad7860 con 0x563908ab5400 2024-09-10T10:17:08.587 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-i[65271]: starting mds.i at 2024-09-10T10:17:08.588 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-f[64669]: ignoring --setuser ceph since I am not root 2024-09-10T10:17:08.588 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-f[64669]: ignoring --setgroup ceph since I am not root 2024-09-10T10:17:08.588 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-mds[64673]: -- 172.21.15.189:0/316603715 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561bd0ac9860 con 0x561bd0aa6800 2024-09-10T10:17:08.588 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 10:17:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-f[64669]: starting mds.f at 2024-09-10T10:17:08.910 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T10:17:09.296 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:17:09.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.828+0000 7fa37ce00640 1 -- 172.21.15.50:0/1562445258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa378112a30 msgr2=0x7fa378114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.828+0000 7fa37ce00640 1 --2- 172.21.15.50:0/1562445258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa378112a30 0x7fa378114e20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa370009ca0 tx=0x7fa37002a8b0 comp rx=0 tx=0).stop 2024-09-10T10:17:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.828+0000 7fa37ce00640 1 -- 172.21.15.50:0/1562445258 shutdown_connections 2024-09-10T10:17:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.828+0000 7fa37ce00640 1 --2- 172.21.15.50:0/1562445258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa378112a30 0x7fa378114e20 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.828+0000 7fa37ce00640 1 --2- 172.21.15.50:0/1562445258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa378077040 0x7fa3781124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.828+0000 7fa37ce00640 1 --2- 172.21.15.50:0/1562445258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa378076720 0x7fa378076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.828+0000 7fa37ce00640 1 -- 172.21.15.50:0/1562445258 >> 172.21.15.50:0/1562445258 conn(0x7fa3780ffa90 msgr2=0x7fa378101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.828+0000 7fa37ce00640 1 -- 172.21.15.50:0/1562445258 shutdown_connections 2024-09-10T10:17:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.828+0000 7fa37ce00640 1 -- 172.21.15.50:0/1562445258 wait complete. 2024-09-10T10:17:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.829+0000 7fa37ce00640 1 Processor -- start 2024-09-10T10:17:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.829+0000 7fa37ce00640 1 -- start start 2024-09-10T10:17:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.829+0000 7fa37ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa378076720 0x7fa3781a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:09.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.829+0000 7fa37ce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa378077040 0x7fa3781a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.829+0000 7fa37ce00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa378112a30 0x7fa37819e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.829+0000 7fa37ce00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa378118570 con 0x7fa378077040 2024-09-10T10:17:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.829+0000 7fa37ce00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa3781183f0 con 0x7fa378076720 2024-09-10T10:17:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.829+0000 7fa37ce00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa3781186f0 con 0x7fa378112a30 2024-09-10T10:17:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.830+0000 7fa36fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa378077040 0x7fa3781a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.830+0000 7fa375e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa378076720 0x7fa3781a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.830+0000 7fa36fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa378077040 0x7fa3781a4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36152/0 (socket says 172.21.15.50:36152) 2024-09-10T10:17:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.830+0000 7fa36fe00640 1 -- 172.21.15.50:0/2730596921 learned_addr learned my addr 172.21.15.50:0/2730596921 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:17:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.830+0000 7fa376800640 1 --2- 172.21.15.50:0/2730596921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa378112a30 0x7fa37819e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.830+0000 7fa36fe00640 1 -- 172.21.15.50:0/2730596921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa378112a30 msgr2=0x7fa37819e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.830+0000 7fa36fe00640 1 --2- 172.21.15.50:0/2730596921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa378112a30 0x7fa37819e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.830+0000 7fa36fe00640 1 -- 172.21.15.50:0/2730596921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa378076720 msgr2=0x7fa3781a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:09.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.830+0000 7fa36fe00640 1 --2- 172.21.15.50:0/2730596921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa378076720 0x7fa3781a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.830+0000 7fa36fe00640 1 -- 172.21.15.50:0/2730596921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37819efc0 con 0x7fa378077040 2024-09-10T10:17:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.830+0000 7fa36fe00640 1 --2- 172.21.15.50:0/2730596921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa378077040 0x7fa3781a4be0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa36000d950 tx=0x7fa36000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.831+0000 7fa36ea00640 1 -- 172.21.15.50:0/2730596921 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360017070 con 0x7fa378077040 2024-09-10T10:17:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.831+0000 7fa36ea00640 1 -- 172.21.15.50:0/2730596921 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa360009c30 con 0x7fa378077040 2024-09-10T10:17:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.831+0000 7fa37ce00640 1 -- 172.21.15.50:0/2730596921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37819f2b0 con 0x7fa378077040 2024-09-10T10:17:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.831+0000 7fa36ea00640 1 -- 172.21.15.50:0/2730596921 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36000f6b0 con 0x7fa378077040 2024-09-10T10:17:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.831+0000 7fa37ce00640 1 -- 172.21.15.50:0/2730596921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3781ab500 con 0x7fa378077040 2024-09-10T10:17:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.832+0000 7fa37ce00640 1 -- 172.21.15.50:0/2730596921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa378077e60 con 0x7fa378077040 2024-09-10T10:17:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.834+0000 7fa36ea00640 1 -- 172.21.15.50:0/2730596921 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa3600109d0 con 0x7fa378077040 2024-09-10T10:17:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.836+0000 7fa36ea00640 1 --2- 172.21.15.50:0/2730596921 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa35c0a2b80 0x7fa35c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.836+0000 7fa36ea00640 1 -- 172.21.15.50:0/2730596921 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9408+0+0 (secure 0 0 0) 0x7fa3600cf0a0 con 0x7fa378077040 2024-09-10T10:17:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.836+0000 7fa375e00640 1 --2- 172.21.15.50:0/2730596921 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa35c0a2b80 0x7fa35c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:09.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.837+0000 7fa375e00640 1 --2- 172.21.15.50:0/2730596921 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa35c0a2b80 0x7fa35c0a5040 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa36800bbe0 tx=0x7fa36800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:09.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:09.839+0000 7fa36ea00640 1 -- 172.21.15.50:0/2730596921 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa360009de0 con 0x7fa378077040 2024-09-10T10:17:10.063 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.061+0000 7fa37ce00640 1 -- 172.21.15.50:0/2730596921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa37810dbc0 con 0x7fa378077040 2024-09-10T10:17:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.105+0000 7fa36ea00640 1 -- 172.21.15.50:0/2730596921 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7fa36009bb30 con 0x7fa378077040 2024-09-10T10:17:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.108+0000 7fa37ce00640 1 -- 172.21.15.50:0/2730596921 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa35c0a2b80 msgr2=0x7fa35c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.108+0000 7fa37ce00640 1 --2- 172.21.15.50:0/2730596921 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa35c0a2b80 0x7fa35c0a5040 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa36800bbe0 tx=0x7fa36800b390 comp rx=0 tx=0).stop 2024-09-10T10:17:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.108+0000 7fa37ce00640 1 -- 172.21.15.50:0/2730596921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa378077040 msgr2=0x7fa3781a4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.108+0000 7fa37ce00640 1 --2- 172.21.15.50:0/2730596921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa378077040 0x7fa3781a4be0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa36000d950 tx=0x7fa36000de10 comp rx=0 tx=0).stop 2024-09-10T10:17:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.108+0000 7fa37ce00640 1 -- 172.21.15.50:0/2730596921 shutdown_connections 2024-09-10T10:17:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.108+0000 7fa37ce00640 1 --2- 172.21.15.50:0/2730596921 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fa35c0a2b80 0x7fa35c0a5040 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.108+0000 7fa37ce00640 1 --2- 172.21.15.50:0/2730596921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa378112a30 0x7fa37819e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.108+0000 7fa37ce00640 1 --2- 172.21.15.50:0/2730596921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa378077040 0x7fa3781a4be0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.108+0000 7fa37ce00640 1 --2- 172.21.15.50:0/2730596921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa378076720 0x7fa3781a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.108+0000 7fa37ce00640 1 -- 172.21.15.50:0/2730596921 >> 172.21.15.50:0/2730596921 conn(0x7fa3780ffa90 msgr2=0x7fa378101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.108+0000 7fa37ce00640 1 -- 172.21.15.50:0/2730596921 shutdown_connections 2024-09-10T10:17:10.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:10.109+0000 7fa37ce00640 1 -- 172.21.15.50:0/2730596921 wait complete. 2024-09-10T10:17:10.429 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: pgmap v571: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T10:17:10.429 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.189:6834/822541088,v1:172.21.15.189:6835/822541088] up:boot 2024-09-10T10:17:10.429 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.84:6834/753050985,v1:172.21.15.84:6837/753050985] up:boot 2024-09-10T10:17:10.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.84:6836/1983055775,v1:172.21.15.84:6839/1983055775] up:boot 2024-09-10T10:17:10.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.84:6835/2148335021,v1:172.21.15.84:6838/2148335021] up:boot 2024-09-10T10:17:10.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.189:6836/1604228470,v1:172.21.15.189:6838/1604228470] up:boot 2024-09-10T10:17:10.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: mds.? [v2:172.21.15.189:6837/1223010913,v1:172.21.15.189:6839/1223010913] up:boot 2024-09-10T10:17:10.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T10:17:10.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:17:10.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:17:10.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:17:10.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:17:10.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:17:10.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:17:10.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:10 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2730596921' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:17:10.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: pgmap v571: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T10:17:10.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.189:6834/822541088,v1:172.21.15.189:6835/822541088] up:boot 2024-09-10T10:17:10.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.84:6834/753050985,v1:172.21.15.84:6837/753050985] up:boot 2024-09-10T10:17:10.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.84:6836/1983055775,v1:172.21.15.84:6839/1983055775] up:boot 2024-09-10T10:17:10.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.84:6835/2148335021,v1:172.21.15.84:6838/2148335021] up:boot 2024-09-10T10:17:10.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.189:6836/1604228470,v1:172.21.15.189:6838/1604228470] up:boot 2024-09-10T10:17:10.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: mds.? [v2:172.21.15.189:6837/1223010913,v1:172.21.15.189:6839/1223010913] up:boot 2024-09-10T10:17:10.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T10:17:10.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:17:10.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:17:10.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:17:10.455 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:17:10.455 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:17:10.455 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:17:10.455 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:10 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2730596921' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:17:10.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: pgmap v571: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T10:17:10.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.189:6834/822541088,v1:172.21.15.189:6835/822541088] up:boot 2024-09-10T10:17:10.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.84:6834/753050985,v1:172.21.15.84:6837/753050985] up:boot 2024-09-10T10:17:10.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.84:6836/1983055775,v1:172.21.15.84:6839/1983055775] up:boot 2024-09-10T10:17:10.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.84:6835/2148335021,v1:172.21.15.84:6838/2148335021] up:boot 2024-09-10T10:17:10.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.189:6836/1604228470,v1:172.21.15.189:6838/1604228470] up:boot 2024-09-10T10:17:10.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: mds.? [v2:172.21.15.189:6837/1223010913,v1:172.21.15.189:6839/1223010913] up:boot 2024-09-10T10:17:10.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T10:17:10.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:17:10.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:17:10.587 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:17:10.587 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:17:10.587 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:17:10.587 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: from='mgr.14150 172.21.15.50:0/246135389' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:17:10.587 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:10 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2730596921' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:17:10.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T10:17:11.334 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:17:11.379 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:11 smithi084 ceph-mon[34812]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T10:17:11.379 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:11 smithi084 ceph-mon[34812]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T10:17:11.379 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:11 smithi084 ceph-mon[34812]: Cluster is now healthy 2024-09-10T10:17:11.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:11 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2730596921' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:17:11.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:11 smithi084 ceph-mon[34812]: fsmap 12 up:standby 2024-09-10T10:17:11.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:11 smithi050 ceph-mon[30354]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T10:17:11.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:11 smithi050 ceph-mon[30354]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T10:17:11.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:11 smithi050 ceph-mon[30354]: Cluster is now healthy 2024-09-10T10:17:11.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:11 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2730596921' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:17:11.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:11 smithi050 ceph-mon[30354]: fsmap 12 up:standby 2024-09-10T10:17:11.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:11 smithi189 ceph-mon[34999]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T10:17:11.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:11 smithi189 ceph-mon[34999]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T10:17:11.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:11 smithi189 ceph-mon[34999]: Cluster is now healthy 2024-09-10T10:17:11.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:11 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2730596921' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:17:11.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:11 smithi189 ceph-mon[34999]: fsmap 12 up:standby 2024-09-10T10:17:11.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.909+0000 7f09cfe00640 1 -- 172.21.15.50:0/2975685669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c8112a50 msgr2=0x7f09c8114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.909+0000 7f09cfe00640 1 --2- 172.21.15.50:0/2975685669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c8112a50 0x7f09c8114e40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009ca0 tx=0x7f09c002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:17:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.909+0000 7f09cfe00640 1 -- 172.21.15.50:0/2975685669 shutdown_connections 2024-09-10T10:17:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.909+0000 7f09cfe00640 1 --2- 172.21.15.50:0/2975685669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c8112a50 0x7f09c8114e40 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.909+0000 7f09cfe00640 1 --2- 172.21.15.50:0/2975685669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09c8077040 0x7f09c8112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.909+0000 7f09cfe00640 1 --2- 172.21.15.50:0/2975685669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09c8076720 0x7f09c8076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.909+0000 7f09cfe00640 1 -- 172.21.15.50:0/2975685669 >> 172.21.15.50:0/2975685669 conn(0x7f09c80ffa50 msgr2=0x7f09c8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.909+0000 7f09cfe00640 1 -- 172.21.15.50:0/2975685669 shutdown_connections 2024-09-10T10:17:11.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.909+0000 7f09cfe00640 1 -- 172.21.15.50:0/2975685669 wait complete. 2024-09-10T10:17:11.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.910+0000 7f09cfe00640 1 Processor -- start 2024-09-10T10:17:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.910+0000 7f09cfe00640 1 -- start start 2024-09-10T10:17:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.910+0000 7f09cfe00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09c8076720 0x7f09c81a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.910+0000 7f09cfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09c8077040 0x7f09c81a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.910+0000 7f09cfe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c8112a50 0x7f09c819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.910+0000 7f09cfe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09c81185e0 con 0x7f09c8112a50 2024-09-10T10:17:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.910+0000 7f09cfe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f09c8118460 con 0x7f09c8077040 2024-09-10T10:17:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.910+0000 7f09cfe00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f09c8118760 con 0x7f09c8076720 2024-09-10T10:17:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.911+0000 7f09cca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09c8077040 0x7f09c81a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.911+0000 7f09cca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09c8077040 0x7f09c81a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.50:45900/0 (socket says 172.21.15.50:45900) 2024-09-10T10:17:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.911+0000 7f09cca00640 1 -- 172.21.15.50:0/209193878 learned_addr learned my addr 172.21.15.50:0/209193878 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:17:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.911+0000 7f09cde00640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c8112a50 0x7f09c819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.911+0000 7f09cd400640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09c8076720 0x7f09c81a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:11.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.911+0000 7f09cca00640 1 -- 172.21.15.50:0/209193878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09c8076720 msgr2=0x7f09c81a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.911+0000 7f09cca00640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09c8076720 0x7f09c81a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.911+0000 7f09cca00640 1 -- 172.21.15.50:0/209193878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c8112a50 msgr2=0x7f09c819e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.911+0000 7f09cca00640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c8112a50 0x7f09c819e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.911+0000 7f09cca00640 1 -- 172.21.15.50:0/209193878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c819efc0 con 0x7f09c8077040 2024-09-10T10:17:11.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.911+0000 7f09cca00640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09c8077040 0x7f09c81a4c10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f09b400e9f0 tx=0x7f09b400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.912+0000 7f09c6000640 1 -- 172.21.15.50:0/209193878 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b400cd80 con 0x7f09c8077040 2024-09-10T10:17:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.912+0000 7f09cfe00640 1 -- 172.21.15.50:0/209193878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c819f2b0 con 0x7f09c8077040 2024-09-10T10:17:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.912+0000 7f09c6000640 1 -- 172.21.15.50:0/209193878 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09b4010910 con 0x7f09c8077040 2024-09-10T10:17:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.912+0000 7f09c6000640 1 -- 172.21.15.50:0/209193878 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b40188f0 con 0x7f09c8077040 2024-09-10T10:17:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.912+0000 7f09cfe00640 1 -- 172.21.15.50:0/209193878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c81ab5a0 con 0x7f09c8077040 2024-09-10T10:17:11.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.913+0000 7f09cfe00640 1 -- 172.21.15.50:0/209193878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c8076b00 con 0x7f09c8077040 2024-09-10T10:17:11.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.915+0000 7f09c6000640 1 -- 172.21.15.50:0/209193878 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f09b4010ac0 con 0x7f09c8077040 2024-09-10T10:17:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.916+0000 7f09c6000640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f09b00a2b80 0x7f09b00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.917+0000 7f09c6000640 1 -- 172.21.15.50:0/209193878 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9408+0+0 (secure 0 0 0) 0x7f09b40cfd80 con 0x7f09c8077040 2024-09-10T10:17:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.917+0000 7f09cd400640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f09b00a2b80 0x7f09b00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:11.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.917+0000 7f09cd400640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f09b00a2b80 0x7f09b00a5040 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f09c819f9d0 tx=0x7f09bc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:11.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:11.918+0000 7f09c6000640 1 -- 172.21.15.50:0/209193878 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09b409c1c0 con 0x7f09c8077040 2024-09-10T10:17:12.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:12.109+0000 7f09cfe00640 1 -- 172.21.15.50:0/209193878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f09c81ab860 con 0x7f09c8077040 2024-09-10T10:17:12.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:12 smithi050 ceph-mon[30354]: pgmap v572: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T10:17:12.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:12 smithi189 ceph-mon[34999]: pgmap v572: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T10:17:12.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:12 smithi084 ceph-mon[34812]: pgmap v572: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T10:17:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:13.120+0000 7f09c6000640 1 -- 172.21.15.50:0/209193878 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) ==== 181+0+0 (secure 0 0 0) 0x7f09b40a04c0 con 0x7f09c8077040 2024-09-10T10:17:13.125 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-09-10T10:17:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:13.125+0000 7f09cfe00640 1 -- 172.21.15.50:0/209193878 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f09b00a2b80 msgr2=0x7f09b00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:13.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:13.125+0000 7f09cfe00640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f09b00a2b80 0x7f09b00a5040 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f09c819f9d0 tx=0x7f09bc00b410 comp rx=0 tx=0).stop 2024-09-10T10:17:13.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:13.125+0000 7f09cfe00640 1 -- 172.21.15.50:0/209193878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09c8077040 msgr2=0x7f09c81a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:13.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:13.125+0000 7f09cfe00640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09c8077040 0x7f09c81a4c10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f09b400e9f0 tx=0x7f09b400eeb0 comp rx=0 tx=0).stop 2024-09-10T10:17:13.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:13.125+0000 7f09cfe00640 1 -- 172.21.15.50:0/209193878 shutdown_connections 2024-09-10T10:17:13.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:13.125+0000 7f09cfe00640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7f09b00a2b80 0x7f09b00a5040 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:13.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:13.125+0000 7f09cfe00640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09c8112a50 0x7f09c819e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:13.125+0000 7f09cfe00640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09c8077040 0x7f09c81a4c10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:13.125+0000 7f09cfe00640 1 --2- 172.21.15.50:0/209193878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09c8076720 0x7f09c81a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:13.125+0000 7f09cfe00640 1 -- 172.21.15.50:0/209193878 >> 172.21.15.50:0/209193878 conn(0x7f09c80ffa50 msgr2=0x7f09c8101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:13.125+0000 7f09cfe00640 1 -- 172.21.15.50:0/209193878 shutdown_connections 2024-09-10T10:17:13.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:13.126+0000 7f09cfe00640 1 -- 172.21.15.50:0/209193878 wait complete. 2024-09-10T10:17:13.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:13 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/209193878' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:13.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:13 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:13.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:13 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/209193878' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:13.685 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:13 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:13.686 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:13 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/209193878' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:13.686 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:13 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:13.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T10:17:14.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:14 smithi050 ceph-mon[30354]: pgmap v573: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-10T10:17:14.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:14 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:17:14.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:14 smithi050 ceph-mon[30354]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T10:17:14.367 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:17:14.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:14 smithi189 ceph-mon[34999]: pgmap v573: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-10T10:17:14.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:14 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:17:14.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:14 smithi189 ceph-mon[34999]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T10:17:14.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:14 smithi084 ceph-mon[34812]: pgmap v573: 129 pgs: 129 active+clean; 1.3 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-10T10:17:14.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:14 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:17:14.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:14 smithi084 ceph-mon[34812]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T10:17:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.935+0000 7fbb04800640 1 -- 172.21.15.50:0/4118191393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbafc103ff0 msgr2=0x7fbafc1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.935+0000 7fbb04800640 1 --2- 172.21.15.50:0/4118191393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbafc103ff0 0x7fbafc1043d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009900 tx=0x7fbaf002a3f0 comp rx=0 tx=0).stop 2024-09-10T10:17:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.935+0000 7fbb04800640 1 -- 172.21.15.50:0/4118191393 shutdown_connections 2024-09-10T10:17:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.935+0000 7fbb04800640 1 --2- 172.21.15.50:0/4118191393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc109120 0x7fbafc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.935+0000 7fbb04800640 1 --2- 172.21.15.50:0/4118191393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbafc1049a0 0x7fbafc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.935+0000 7fbb04800640 1 --2- 172.21.15.50:0/4118191393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbafc103ff0 0x7fbafc1043d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.935+0000 7fbb04800640 1 -- 172.21.15.50:0/4118191393 >> 172.21.15.50:0/4118191393 conn(0x7fbafc0ffa90 msgr2=0x7fbafc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.935+0000 7fbb04800640 1 -- 172.21.15.50:0/4118191393 shutdown_connections 2024-09-10T10:17:14.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.935+0000 7fbb04800640 1 -- 172.21.15.50:0/4118191393 wait complete. 2024-09-10T10:17:14.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.936+0000 7fbb04800640 1 Processor -- start 2024-09-10T10:17:14.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.936+0000 7fbb04800640 1 -- start start 2024-09-10T10:17:14.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.937+0000 7fbb04800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbafc103ff0 0x7fbafc19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.937+0000 7fbb04800640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbafc1049a0 0x7fbafc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.937+0000 7fbb04800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc109120 0x7fbafc19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.937+0000 7fbb04800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc114170 con 0x7fbafc109120 2024-09-10T10:17:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.937+0000 7fbb04800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc113ff0 con 0x7fbafc103ff0 2024-09-10T10:17:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.937+0000 7fbb04800640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc1142f0 con 0x7fbafc1049a0 2024-09-10T10:17:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.937+0000 7fbb01400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbafc1049a0 0x7fbafc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.937+0000 7fbb02800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc109120 0x7fbafc19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.937+0000 7fbb01e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbafc103ff0 0x7fbafc19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.937+0000 7fbb01400640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbafc1049a0 0x7fbafc19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:32960/0 (socket says 172.21.15.50:32960) 2024-09-10T10:17:14.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.937+0000 7fbb01400640 1 -- 172.21.15.50:0/2746400836 learned_addr learned my addr 172.21.15.50:0/2746400836 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:17:14.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.938+0000 7fbb01e00640 1 -- 172.21.15.50:0/2746400836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbafc1049a0 msgr2=0x7fbafc19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:14.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.938+0000 7fbb01e00640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbafc1049a0 0x7fbafc19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.938+0000 7fbb01e00640 1 -- 172.21.15.50:0/2746400836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc109120 msgr2=0x7fbafc19eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.938+0000 7fbb01e00640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc109120 0x7fbafc19eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.938+0000 7fbb01e00640 1 -- 172.21.15.50:0/2746400836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc19f5a0 con 0x7fbafc103ff0 2024-09-10T10:17:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.938+0000 7fbb02800640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc109120 0x7fbafc19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:17:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.938+0000 7fbb01400640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbafc1049a0 0x7fbafc19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:17:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.938+0000 7fbb01e00640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbafc103ff0 0x7fbafc19a5f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbaf002a910 tx=0x7fbaf0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.938+0000 7fbaf6a00640 1 -- 172.21.15.50:0/2746400836 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf003f070 con 0x7fbafc103ff0 2024-09-10T10:17:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.938+0000 7fbaf6a00640 1 -- 172.21.15.50:0/2746400836 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaf0031c90 con 0x7fbafc103ff0 2024-09-10T10:17:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.938+0000 7fbaf6a00640 1 -- 172.21.15.50:0/2746400836 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0035030 con 0x7fbafc103ff0 2024-09-10T10:17:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.938+0000 7fbb04800640 1 -- 172.21.15.50:0/2746400836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbafc19f830 con 0x7fbafc103ff0 2024-09-10T10:17:14.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.938+0000 7fbb04800640 1 -- 172.21.15.50:0/2746400836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbafc19fcc0 con 0x7fbafc103ff0 2024-09-10T10:17:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.939+0000 7fbb04800640 1 -- 172.21.15.50:0/2746400836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbafc1043d0 con 0x7fbafc103ff0 2024-09-10T10:17:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.942+0000 7fbaf6a00640 1 -- 172.21.15.50:0/2746400836 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbaf0042070 con 0x7fbafc103ff0 2024-09-10T10:17:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.943+0000 7fbaf6a00640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbae40a2b80 0x7fbae40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.943+0000 7fbaf6a00640 1 -- 172.21.15.50:0/2746400836 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8912+0+0 (secure 0 0 0) 0x7fbaf00efe80 con 0x7fbafc103ff0 2024-09-10T10:17:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.943+0000 7fbb01400640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbae40a2b80 0x7fbae40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.944+0000 7fbb01400640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbae40a2b80 0x7fbae40a5040 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0ffeb0 tx=0x7fbaec00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:14.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:14.945+0000 7fbaf6a00640 1 -- 172.21.15.50:0/2746400836 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbaf00bc4b0 con 0x7fbafc103ff0 2024-09-10T10:17:15.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:15.133+0000 7fbb04800640 1 -- 172.21.15.50:0/2746400836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbafc19b950 con 0x7fbafc103ff0 2024-09-10T10:17:16.143 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-09-10T10:17:16.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:16.137+0000 7fbaf6a00640 1 -- 172.21.15.50:0/2746400836 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) ==== 169+0+0 (secure 0 0 0) 0x7fbafc19b950 con 0x7fbafc103ff0 2024-09-10T10:17:16.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:16.141+0000 7fbb04800640 1 -- 172.21.15.50:0/2746400836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbae40a2b80 msgr2=0x7fbae40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:16.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:16.141+0000 7fbb04800640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbae40a2b80 0x7fbae40a5040 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0ffeb0 tx=0x7fbaec00b4a0 comp rx=0 tx=0).stop 2024-09-10T10:17:16.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:16.141+0000 7fbb04800640 1 -- 172.21.15.50:0/2746400836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbafc103ff0 msgr2=0x7fbafc19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:16.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:16.141+0000 7fbb04800640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbafc103ff0 0x7fbafc19a5f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbaf002a910 tx=0x7fbaf0003b90 comp rx=0 tx=0).stop 2024-09-10T10:17:16.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:16.141+0000 7fbb04800640 1 -- 172.21.15.50:0/2746400836 shutdown_connections 2024-09-10T10:17:16.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:16.141+0000 7fbb04800640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fbae40a2b80 0x7fbae40a5040 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:16.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:16.141+0000 7fbb04800640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbafc109120 0x7fbafc19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:16.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:16.141+0000 7fbb04800640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbafc1049a0 0x7fbafc19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:16.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:16.141+0000 7fbb04800640 1 --2- 172.21.15.50:0/2746400836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbafc103ff0 0x7fbafc19a5f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:16.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:16.141+0000 7fbb04800640 1 -- 172.21.15.50:0/2746400836 >> 172.21.15.50:0/2746400836 conn(0x7fbafc0ffa90 msgr2=0x7fbafc100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:16.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:16.141+0000 7fbb04800640 1 -- 172.21.15.50:0/2746400836 shutdown_connections 2024-09-10T10:17:16.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:16.141+0000 7fbb04800640 1 -- 172.21.15.50:0/2746400836 wait complete. 2024-09-10T10:17:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:16 smithi189 ceph-mon[34999]: pgmap v575: 97 pgs: 97 active+clean; 577 KiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:17:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:16 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/2746400836' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:16 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:16.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:16 smithi050 ceph-mon[30354]: pgmap v575: 97 pgs: 97 active+clean; 577 KiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:17:16.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:16 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/2746400836' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:16.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:16 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:16.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:16 smithi084 ceph-mon[34812]: pgmap v575: 97 pgs: 97 active+clean; 577 KiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:17:16.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:16 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/2746400836' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:16.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:16 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:17.033 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-10T10:17:17.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:17 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:17:17.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:17 smithi189 ceph-mon[34999]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T10:17:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:17:17.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:17 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:17:17.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:17 smithi050 ceph-mon[30354]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T10:17:17.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:17 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:17:17.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:17 smithi084 ceph-mon[34812]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T10:17:18.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.021+0000 7fed6be00640 1 -- 172.21.15.50:0/4028228304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed6c103e30 msgr2=0x7fed6c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.021+0000 7fed6be00640 1 --2- 172.21.15.50:0/4028228304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed6c103e30 0x7fed6c104210 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009900 tx=0x7fed5c02a410 comp rx=0 tx=0).stop 2024-09-10T10:17:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.021+0000 7fed6be00640 1 -- 172.21.15.50:0/4028228304 shutdown_connections 2024-09-10T10:17:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.021+0000 7fed6be00640 1 --2- 172.21.15.50:0/4028228304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed6c108f60 0x7fed6c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.021+0000 7fed6be00640 1 --2- 172.21.15.50:0/4028228304 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed6c1047e0 0x7fed6c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.021+0000 7fed6be00640 1 --2- 172.21.15.50:0/4028228304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed6c103e30 0x7fed6c104210 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.021+0000 7fed6be00640 1 -- 172.21.15.50:0/4028228304 >> 172.21.15.50:0/4028228304 conn(0x7fed6c0ff8d0 msgr2=0x7fed6c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.021+0000 7fed6be00640 1 -- 172.21.15.50:0/4028228304 shutdown_connections 2024-09-10T10:17:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.021+0000 7fed6be00640 1 -- 172.21.15.50:0/4028228304 wait complete. 2024-09-10T10:17:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.022+0000 7fed6be00640 1 Processor -- start 2024-09-10T10:17:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.022+0000 7fed6be00640 1 -- start start 2024-09-10T10:17:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.022+0000 7fed6be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed6c103e30 0x7fed6c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.022+0000 7fed6be00640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed6c1047e0 0x7fed6c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed6be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed6c108f60 0x7fed6c19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed6be00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c113fc0 con 0x7fed6c108f60 2024-09-10T10:17:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed6be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c113e40 con 0x7fed6c103e30 2024-09-10T10:17:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed6be00640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c114140 con 0x7fed6c1047e0 2024-09-10T10:17:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed62000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed6c1047e0 0x7fed6c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed6aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed6c103e30 0x7fed6c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed62000640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed6c1047e0 0x7fed6c19a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.50:33138/0 (socket says 172.21.15.50:33138) 2024-09-10T10:17:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed62000640 1 -- 172.21.15.50:0/445417561 learned_addr learned my addr 172.21.15.50:0/445417561 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-09-10T10:17:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed6b400640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed6c108f60 0x7fed6c19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed62000640 1 -- 172.21.15.50:0/445417561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed6c103e30 msgr2=0x7fed6c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed62000640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed6c103e30 0x7fed6c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed62000640 1 -- 172.21.15.50:0/445417561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed6c108f60 msgr2=0x7fed6c19ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed62000640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed6c108f60 0x7fed6c19ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed62000640 1 -- 172.21.15.50:0/445417561 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6c19f450 con 0x7fed6c1047e0 2024-09-10T10:17:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.023+0000 7fed6aa00640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed6c103e30 0x7fed6c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:17:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.024+0000 7fed62000640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed6c1047e0 0x7fed6c19a9e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fed5400e9f0 tx=0x7fed5400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.024+0000 7fed70a00640 1 -- 172.21.15.50:0/445417561 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5400cd80 con 0x7fed6c1047e0 2024-09-10T10:17:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.024+0000 7fed6be00640 1 -- 172.21.15.50:0/445417561 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed6c19f740 con 0x7fed6c1047e0 2024-09-10T10:17:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.024+0000 7fed70a00640 1 -- 172.21.15.50:0/445417561 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed54005500 con 0x7fed6c1047e0 2024-09-10T10:17:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.024+0000 7fed70a00640 1 -- 172.21.15.50:0/445417561 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54010690 con 0x7fed6c1047e0 2024-09-10T10:17:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.024+0000 7fed6be00640 1 -- 172.21.15.50:0/445417561 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed6c1a7020 con 0x7fed6c1047e0 2024-09-10T10:17:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.025+0000 7fed6be00640 1 -- 172.21.15.50:0/445417561 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed6c104210 con 0x7fed6c1047e0 2024-09-10T10:17:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.027+0000 7fed70a00640 1 -- 172.21.15.50:0/445417561 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fed540046c0 con 0x7fed6c1047e0 2024-09-10T10:17:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.029+0000 7fed70a00640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fed500a2b80 0x7fed500a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:17:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.029+0000 7fed70a00640 1 -- 172.21.15.50:0/445417561 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8324+0+0 (secure 0 0 0) 0x7fed540cf4e0 con 0x7fed6c1047e0 2024-09-10T10:17:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.029+0000 7fed6aa00640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fed500a2b80 0x7fed500a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:17:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.030+0000 7fed6aa00640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fed500a2b80 0x7fed500a5040 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009230 tx=0x7fed5c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:17:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.033+0000 7fed70a00640 1 -- 172.21.15.50:0/445417561 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed5409c380 con 0x7fed6c1047e0 2024-09-10T10:17:18.215 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:18 smithi050 ceph-mon[30354]: pgmap v577: 33 pgs: 33 active+clean; 577 KiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:17:18.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:18.220+0000 7fed6be00640 1 -- 172.21.15.50:0/445417561 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fed6c02d7c0 con 0x7fed6c1047e0 2024-09-10T10:17:18.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:18 smithi189 ceph-mon[34999]: pgmap v577: 33 pgs: 33 active+clean; 577 KiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:17:18.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:18 smithi084 ceph-mon[34812]: pgmap v577: 33 pgs: 33 active+clean; 577 KiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:17:19.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:19.145+0000 7fed70a00640 1 -- 172.21.15.50:0/445417561 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v99) ==== 178+0+0 (secure 0 0 0) 0x7fed5409bc80 con 0x7fed6c1047e0 2024-09-10T10:17:19.150 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' removed 2024-09-10T10:17:19.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:19.150+0000 7fed6be00640 1 -- 172.21.15.50:0/445417561 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fed500a2b80 msgr2=0x7fed500a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:19.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:19.150+0000 7fed6be00640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fed500a2b80 0x7fed500a5040 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009230 tx=0x7fed5c0058d0 comp rx=0 tx=0).stop 2024-09-10T10:17:19.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:19.150+0000 7fed6be00640 1 -- 172.21.15.50:0/445417561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed6c1047e0 msgr2=0x7fed6c19a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:17:19.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:19.150+0000 7fed6be00640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed6c1047e0 0x7fed6c19a9e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fed5400e9f0 tx=0x7fed5400edf0 comp rx=0 tx=0).stop 2024-09-10T10:17:19.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:19.150+0000 7fed6be00640 1 -- 172.21.15.50:0/445417561 shutdown_connections 2024-09-10T10:17:19.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:19.150+0000 7fed6be00640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.50:6800/2546156966,v1:172.21.15.50:6801/2546156966] conn(0x7fed500a2b80 0x7fed500a5040 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:19.150+0000 7fed6be00640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed6c108f60 0x7fed6c19ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:19.150+0000 7fed6be00640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed6c1047e0 0x7fed6c19a9e0 secure :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fed5400e9f0 tx=0x7fed5400edf0 comp rx=0 tx=0).stop 2024-09-10T10:17:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:19.150+0000 7fed6be00640 1 --2- 172.21.15.50:0/445417561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed6c103e30 0x7fed6c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:17:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:19.150+0000 7fed6be00640 1 -- 172.21.15.50:0/445417561 >> 172.21.15.50:0/445417561 conn(0x7fed6c0ff8d0 msgr2=0x7fed6c100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:17:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:19.151+0000 7fed6be00640 1 -- 172.21.15.50:0/445417561 shutdown_connections 2024-09-10T10:17:19.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-10T10:17:19.151+0000 7fed6be00640 1 -- 172.21.15.50:0/445417561 wait complete. 2024-09-10T10:17:19.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:19 smithi050 ceph-mon[30354]: from='client.? 172.21.15.50:0/445417561' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:19.465 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:19 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:19.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:19 smithi189 ceph-mon[34999]: from='client.? 172.21.15.50:0/445417561' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:19.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:19 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:19.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:19 smithi084 ceph-mon[34812]: from='client.? 172.21.15.50:0/445417561' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:19.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:19 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:17:20.042 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:17:20.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:17:20.136 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:17:20.172 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T10:17:20.172 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T10:17:20.208 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T10:17:20.226 DEBUG:teuthology.orchestra.run.smithi189:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T10:17:20.247 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T10:17:20.247 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T10:17:20.247 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.a 2024-09-10T10:17:20.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:20 smithi050 ceph-mon[30354]: pgmap v578: 33 pgs: 33 active+clean; 577 KiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:17:20.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:20 smithi050 ceph-mon[30354]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:17:20.297 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:20 smithi050 ceph-mon[30354]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T10:17:20.585 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:20 smithi189 ceph-mon[34999]: pgmap v578: 33 pgs: 33 active+clean; 577 KiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:17:20.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:20 smithi189 ceph-mon[34999]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:17:20.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:20 smithi189 ceph-mon[34999]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T10:17:20.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:20 smithi084 ceph-mon[34812]: pgmap v578: 33 pgs: 33 active+clean; 577 KiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:17:20.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:20 smithi084 ceph-mon[34812]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:17:20.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:20 smithi084 ceph-mon[34812]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T10:17:20.667 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:20 smithi050 systemd[1]: Stopping Ceph mon.a for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:17:20.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:20 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a[30350]: 2024-09-10T10:17:20.665+0000 7f5983c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:17:20.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:20 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a[30350]: 2024-09-10T10:17:20.665+0000 7f5983c00640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T10:17:20.965 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:20 smithi050 podman[100827]: 2024-09-10 10:17:20.902157384 +0000 UTC m=+0.364205494 container died 53aa894ee78c996b89e57bb6396d6654328662315ca1f0e1e8a4fc0ef4e8578c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:17:21.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:21 smithi050 podman[100827]: 2024-09-10 10:17:21.379432592 +0000 UTC m=+0.841480702 container cleanup 53aa894ee78c996b89e57bb6396d6654328662315ca1f0e1e8a4fc0ef4e8578c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T10:17:21.624 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:21 smithi050 bash[100827]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a 2024-09-10T10:17:21.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Sep 10 10:17:21 smithi050 podman[100838]: 2024-09-10 10:17:21.6231563 +0000 UTC m=+0.710967017 container remove 53aa894ee78c996b89e57bb6396d6654328662315ca1f0e1e8a4fc0ef4e8578c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-10T10:17:21.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T10:17:21.984 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:17:21.984 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T10:17:21.984 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T10:17:21.984 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.b 2024-09-10T10:17:22.326 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:22 smithi084 systemd[1]: Stopping Ceph mon.b for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:17:22.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:22 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-b[34808]: 2024-09-10T10:17:22.324+0000 7f0023b7a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:17:22.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:22 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-b[34808]: 2024-09-10T10:17:22.324+0000 7f0023b7a640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T10:17:22.599 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:22 smithi084 podman[67688]: 2024-09-10 10:17:22.396586558 +0000 UTC m=+0.211035227 container died 18af21be624a28f1465def39ec140bb4d6d8fd999f3142226df0bca8d32fd74b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:17:23.061 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:22 smithi084 podman[67688]: 2024-09-10 10:17:22.81718578 +0000 UTC m=+0.631634438 container cleanup 18af21be624a28f1465def39ec140bb4d6d8fd999f3142226df0bca8d32fd74b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T10:17:23.061 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:22 smithi084 bash[67688]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-b 2024-09-10T10:17:23.305 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T10:17:23.327 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:23 smithi084 podman[67700]: 2024-09-10 10:17:23.060457832 +0000 UTC m=+0.662877006 container remove 18af21be624a28f1465def39ec140bb4d6d8fd999f3142226df0bca8d32fd74b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:17:23.327 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:23 smithi084 systemd[1]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-10T10:17:23.327 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:23 smithi084 systemd[1]: Stopped Ceph mon.b for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:17:23.327 INFO:journalctl@ceph.mon.b.smithi084.stdout:Sep 10 10:17:23 smithi084 systemd[1]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.b.service: Consumed 10.239s CPU time. 2024-09-10T10:17:23.348 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:17:23.348 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T10:17:23.349 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T10:17:23.349 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.c 2024-09-10T10:17:23.731 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:23 smithi189 systemd[1]: Stopping Ceph mon.c for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:17:24.085 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:23 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-c[34977]: 2024-09-10T10:17:23.729+0000 7f299dd59640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:17:24.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:23 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-c[34977]: 2024-09-10T10:17:23.729+0000 7f299dd59640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T10:17:24.086 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:23 smithi189 podman[68555]: 2024-09-10 10:17:23.832463454 +0000 UTC m=+0.289831116 container died 0b21d6848b2c7c2034dc459bd570415ca8a053219208ab61cf197b92ef21907f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:17:24.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:24 smithi189 podman[68555]: 2024-09-10 10:17:24.288854255 +0000 UTC m=+0.746221906 container cleanup 0b21d6848b2c7c2034dc459bd570415ca8a053219208ab61cf197b92ef21907f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T10:17:24.586 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 10:17:24 smithi189 bash[68555]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mon-c 2024-09-10T10:17:24.763 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T10:17:24.831 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:17:24.831 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T10:17:24.831 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T10:17:24.831 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mgr.x 2024-09-10T10:17:25.215 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:17:24 smithi050 systemd[1]: Stopping Ceph mgr.x for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:17:25.654 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:17:25 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:17:25.270+0000 7fa5d9a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:17:25.654 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:17:25 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x[30576]: 2024-09-10T10:17:25.270+0000 7fa5d9a00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-10T10:17:25.654 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:17:25 smithi050 podman[100947]: 2024-09-10 10:17:25.354540545 +0000 UTC m=+0.220745488 container died 5501499e73579c08624a146d68d79e2ee691701d68ad1196edbe0047bee048b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:17:25.965 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:17:25 smithi050 podman[100947]: 2024-09-10 10:17:25.810249035 +0000 UTC m=+0.676453976 container cleanup 5501499e73579c08624a146d68d79e2ee691701d68ad1196edbe0047bee048b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-10T10:17:25.965 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:17:25 smithi050 bash[100947]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x 2024-09-10T10:17:26.334 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Sep 10 10:17:26 smithi050 podman[100959]: 2024-09-10 10:17:26.079074744 +0000 UTC m=+0.711950085 container remove 5501499e73579c08624a146d68d79e2ee691701d68ad1196edbe0047bee048b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T10:17:26.368 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T10:17:26.443 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:17:26.443 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T10:17:26.444 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T10:17:26.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mgr.y 2024-09-10T10:17:26.849 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:17:26 smithi084 systemd[1]: Stopping Ceph mgr.y for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:17:27.282 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:17:26 smithi084 podman[67812]: 2024-09-10 10:17:26.959921107 +0000 UTC m=+0.323210831 container died 8942596cc594688f80fbf8a5cc0509605df0a9ca8aee1716ee6f1f40d4e5d316 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:17:27.599 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:17:27 smithi084 podman[67812]: 2024-09-10 10:17:27.38082801 +0000 UTC m=+0.744117721 container cleanup 8942596cc594688f80fbf8a5cc0509605df0a9ca8aee1716ee6f1f40d4e5d316 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:17:27.599 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Sep 10 10:17:27 smithi084 bash[67812]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-y 2024-09-10T10:17:27.952 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T10:17:27.986 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:17:27.986 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T10:17:27.987 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T10:17:27.987 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mgr.z 2024-09-10T10:17:28.335 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:17:28 smithi189 systemd[1]: Stopping Ceph mgr.z for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:17:28.836 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:17:28 smithi189 podman[68680]: 2024-09-10 10:17:28.498224519 +0000 UTC m=+0.315952991 container died c8bd9e304f5e900135e7c06b378bc9727322dc93d37899d18f96ce4dab103cbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True) 2024-09-10T10:17:29.281 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:17:28 smithi189 podman[68680]: 2024-09-10 10:17:28.970530406 +0000 UTC m=+0.788258878 container cleanup c8bd9e304f5e900135e7c06b378bc9727322dc93d37899d18f96ce4dab103cbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T10:17:29.281 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 10:17:28 smithi189 bash[68680]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mgr-z 2024-09-10T10:17:29.445 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T10:17:29.479 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:17:29.480 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T10:17:29.480 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T10:17:29.480 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.0 2024-09-10T10:17:29.928 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:29 smithi050 systemd[1]: Stopping Ceph osd.0 for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:17:30.215 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:29 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0[44222]: 2024-09-10T10:17:29.926+0000 7f3fce600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:17:30.215 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:29 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0[44222]: 2024-09-10T10:17:29.926+0000 7f3fce600640 -1 osd.0 99 *** Got signal Terminated *** 2024-09-10T10:17:30.215 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:29 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0[44222]: 2024-09-10T10:17:29.926+0000 7f3fce600640 -1 osd.0 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:17:35.564 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:35 smithi050 podman[101063]: 2024-09-10 10:17:35.312810341 +0000 UTC m=+5.528441259 container died 18fd16c5bb56a815026cb01cdb2ea781115b163e176b308a35d4c2bd09fe8e96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T10:17:36.215 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:35 smithi050 podman[101063]: 2024-09-10 10:17:35.908032431 +0000 UTC m=+6.123663333 container cleanup 18fd16c5bb56a815026cb01cdb2ea781115b163e176b308a35d4c2bd09fe8e96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-10T10:17:36.215 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:35 smithi050 bash[101063]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0 2024-09-10T10:17:36.216 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:36 smithi050 podman[101081]: 2024-09-10 10:17:36.118162885 +0000 UTC m=+0.790779783 container remove 18fd16c5bb56a815026cb01cdb2ea781115b163e176b308a35d4c2bd09fe8e96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T10:17:36.965 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:36 smithi050 podman[101171]: 2024-09-10 10:17:36.604189038 +0000 UTC m=+0.027431044 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:17:36.965 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:36 smithi050 podman[101171]: 2024-09-10 10:17:36.752747675 +0000 UTC m=+0.175989656 container create 81ac8cf81f809ba598a06b751f1734f76b308b83818bec0da14f7dbadd7eb2dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T10:17:37.293 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:37 smithi050 podman[101171]: 2024-09-10 10:17:37.014081338 +0000 UTC m=+0.437323341 container init 81ac8cf81f809ba598a06b751f1734f76b308b83818bec0da14f7dbadd7eb2dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T10:17:37.294 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:37 smithi050 podman[101171]: 2024-09-10 10:17:37.020801499 +0000 UTC m=+0.444043481 container start 81ac8cf81f809ba598a06b751f1734f76b308b83818bec0da14f7dbadd7eb2dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T10:17:37.294 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:37 smithi050 podman[101171]: 2024-09-10 10:17:37.122177943 +0000 UTC m=+0.545419934 container attach 81ac8cf81f809ba598a06b751f1734f76b308b83818bec0da14f7dbadd7eb2dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T10:17:37.632 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:37 smithi050 podman[101171]: 2024-09-10 10:17:37.29330236 +0000 UTC m=+0.716544357 container died 81ac8cf81f809ba598a06b751f1734f76b308b83818bec0da14f7dbadd7eb2dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-10T10:17:38.141 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T10:17:38.215 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:38 smithi050 podman[101194]: 2024-09-10 10:17:38.110636582 +0000 UTC m=+0.803548244 container remove 81ac8cf81f809ba598a06b751f1734f76b308b83818bec0da14f7dbadd7eb2dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T10:17:38.215 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:38 smithi050 systemd[1]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-10T10:17:38.215 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:38 smithi050 systemd[1]: Stopped Ceph osd.0 for 4d54e0f8-6f5b-11ef-bcea-c7b262605968. 2024-09-10T10:17:38.215 INFO:journalctl@ceph.osd.0.smithi050.stdout:Sep 10 10:17:38 smithi050 systemd[1]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.0.service: Consumed 53.651s CPU time. 2024-09-10T10:17:38.223 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:17:38.223 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T10:17:38.223 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T10:17:38.223 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.1 2024-09-10T10:17:38.536 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:38 smithi084 systemd[1]: Stopping Ceph osd.1 for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:17:38.849 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:38 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1[39300]: 2024-09-10T10:17:38.534+0000 7fde323ff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:17:38.849 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:38 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1[39300]: 2024-09-10T10:17:38.534+0000 7fde323ff640 -1 osd.1 99 *** Got signal Terminated *** 2024-09-10T10:17:38.849 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:38 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1[39300]: 2024-09-10T10:17:38.534+0000 7fde323ff640 -1 osd.1 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:17:44.256 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:43 smithi084 podman[67935]: 2024-09-10 10:17:43.979556077 +0000 UTC m=+5.564245158 container died 5fe7f056c4879467e43ee2774c421d2a999f70c3e81cfafdf532fa5c131e3184 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:17:44.599 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:44 smithi084 podman[67935]: 2024-09-10 10:17:44.393181221 +0000 UTC m=+5.977870282 container cleanup 5fe7f056c4879467e43ee2774c421d2a999f70c3e81cfafdf532fa5c131e3184 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T10:17:44.599 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:44 smithi084 bash[67935]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1 2024-09-10T10:17:45.099 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:44 smithi084 podman[67951]: 2024-09-10 10:17:44.669994108 +0000 UTC m=+0.687745015 container remove 5fe7f056c4879467e43ee2774c421d2a999f70c3e81cfafdf532fa5c131e3184 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T10:17:45.499 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:45 smithi084 podman[68042]: 2024-09-10 10:17:45.059549664 +0000 UTC m=+0.016065230 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:17:45.499 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:45 smithi084 podman[68042]: 2024-09-10 10:17:45.196286433 +0000 UTC m=+0.152802038 container create 03f6c34499199a3b03f21f1e591c6f29687c5f1a0dd203cbb672227c7eda2361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-10T10:17:45.499 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:45 smithi084 podman[68042]: 2024-09-10 10:17:45.498965772 +0000 UTC m=+0.455481333 container init 03f6c34499199a3b03f21f1e591c6f29687c5f1a0dd203cbb672227c7eda2361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T10:17:45.849 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:45 smithi084 podman[68042]: 2024-09-10 10:17:45.502304911 +0000 UTC m=+0.458820474 container start 03f6c34499199a3b03f21f1e591c6f29687c5f1a0dd203cbb672227c7eda2361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T10:17:45.849 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:45 smithi084 podman[68042]: 2024-09-10 10:17:45.599097976 +0000 UTC m=+0.555613538 container attach 03f6c34499199a3b03f21f1e591c6f29687c5f1a0dd203cbb672227c7eda2361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T10:17:45.849 INFO:journalctl@ceph.osd.1.smithi084.stdout:Sep 10 10:17:45 smithi084 podman[68042]: 2024-09-10 10:17:45.689119253 +0000 UTC m=+0.645634815 container died 03f6c34499199a3b03f21f1e591c6f29687c5f1a0dd203cbb672227c7eda2361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T10:17:46.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T10:17:46.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:17:46.382 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T10:17:46.382 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T10:17:46.382 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.2 2024-09-10T10:17:46.697 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:46 smithi189 systemd[1]: Stopping Ceph osd.2 for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:17:46.957 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:46 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2[39843]: 2024-09-10T10:17:46.694+0000 7fb8ce3d9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:17:46.957 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:46 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2[39843]: 2024-09-10T10:17:46.694+0000 7fb8ce3d9640 -1 osd.2 99 *** Got signal Terminated *** 2024-09-10T10:17:46.957 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:46 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2[39843]: 2024-09-10T10:17:46.694+0000 7fb8ce3d9640 -1 osd.2 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:17:52.535 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:52 smithi189 podman[68805]: 2024-09-10 10:17:52.203521362 +0000 UTC m=+5.627362103 container died 54e347b82666b5f54f413ae7410de1a3d24ba214a870c2f72f615ed3b73cbbd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:17:52.837 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:52 smithi189 podman[68805]: 2024-09-10 10:17:52.642082611 +0000 UTC m=+6.065923351 container cleanup 54e347b82666b5f54f413ae7410de1a3d24ba214a870c2f72f615ed3b73cbbd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:17:52.837 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:52 smithi189 bash[68805]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2 2024-09-10T10:17:53.308 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:52 smithi189 podman[68834]: 2024-09-10 10:17:52.885338149 +0000 UTC m=+0.681045748 container remove 54e347b82666b5f54f413ae7410de1a3d24ba214a870c2f72f615ed3b73cbbd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T10:17:53.585 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:53 smithi189 podman[68923]: 2024-09-10 10:17:53.210825022 +0000 UTC m=+0.015965231 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:17:53.586 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:53 smithi189 podman[68923]: 2024-09-10 10:17:53.33876949 +0000 UTC m=+0.143909729 container create 5401072e4dec259a8c157593e39d74fdcfefa4d0202967205005cdb067bf01ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T10:17:54.086 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:53 smithi189 podman[68923]: 2024-09-10 10:17:53.601548254 +0000 UTC m=+0.406688448 container init 5401072e4dec259a8c157593e39d74fdcfefa4d0202967205005cdb067bf01ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:17:54.086 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:53 smithi189 podman[68923]: 2024-09-10 10:17:53.604939179 +0000 UTC m=+0.410079373 container start 5401072e4dec259a8c157593e39d74fdcfefa4d0202967205005cdb067bf01ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T10:17:54.086 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:53 smithi189 podman[68923]: 2024-09-10 10:17:53.70619451 +0000 UTC m=+0.511334709 container attach 5401072e4dec259a8c157593e39d74fdcfefa4d0202967205005cdb067bf01ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:17:54.086 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 10:17:53 smithi189 podman[68923]: 2024-09-10 10:17:53.793979333 +0000 UTC m=+0.599119529 container died 5401072e4dec259a8c157593e39d74fdcfefa4d0202967205005cdb067bf01ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T10:17:54.463 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T10:17:54.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:17:54.505 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T10:17:54.506 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T10:17:54.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.3 2024-09-10T10:17:54.951 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:17:54 smithi050 systemd[1]: Stopping Ceph osd.3 for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:17:55.215 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:17:54 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3[51127]: 2024-09-10T10:17:54.949+0000 7febe8800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:17:55.215 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:17:54 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3[51127]: 2024-09-10T10:17:54.949+0000 7febe8800640 -1 osd.3 99 *** Got signal Terminated *** 2024-09-10T10:17:55.215 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:17:54 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3[51127]: 2024-09-10T10:17:54.949+0000 7febe8800640 -1 osd.3 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:17:56.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:17:56 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:17:56.483+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:17:57.835 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:17:57 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:17:57.441+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:17:57.965 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:17:57 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3[51127]: 2024-09-10T10:17:57.483+0000 7febe4200640 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.777614+0000 front 2024-09-10T10:17:33.777576+0000 (oldest deadline 2024-09-10T10:17:56.677614+0000) 2024-09-10T10:17:58.835 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:17:58 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:17:58.405+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:17:58.836 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:17:58 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:17:58.434+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:17:58.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:17:58 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:17:58.476+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:17:58.967 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:17:58 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3[51127]: 2024-09-10T10:17:58.483+0000 7febe4200640 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.777614+0000 front 2024-09-10T10:17:33.777576+0000 (oldest deadline 2024-09-10T10:17:56.677614+0000) 2024-09-10T10:17:59.835 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:17:59 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:17:59.442+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:17:59.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:17:59 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:17:59.368+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:17:59.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:17:59 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:17:59.494+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:17:59.965 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:17:59 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3[51127]: 2024-09-10T10:17:59.465+0000 7febe4200640 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.777614+0000 front 2024-09-10T10:17:33.777576+0000 (oldest deadline 2024-09-10T10:17:56.677614+0000) 2024-09-10T10:18:00.429 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:17:59 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:17:59.995+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:00.585 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:00 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:00.439+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:00.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:00 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:00.492+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:00.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:00 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:00.329+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:00.715 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:18:00 smithi050 podman[101285]: 2024-09-10 10:18:00.428402702 +0000 UTC m=+5.621909328 container died 73a4b82deb129e9ee558c50718dbb8115929930e4b4b127fd070c9950cbc0cdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:18:00.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:00 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:00.388+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:00.997 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:18:00 smithi050 podman[101285]: 2024-09-10 10:18:00.971967241 +0000 UTC m=+6.165473855 container cleanup 73a4b82deb129e9ee558c50718dbb8115929930e4b4b127fd070c9950cbc0cdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T10:18:00.997 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:18:00 smithi050 bash[101285]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3 2024-09-10T10:18:01.465 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:18:01 smithi050 podman[101302]: 2024-09-10 10:18:01.206970751 +0000 UTC m=+0.766192576 container remove 73a4b82deb129e9ee558c50718dbb8115929930e4b4b127fd070c9950cbc0cdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD) 2024-09-10T10:18:01.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:00 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:00.995+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:01.585 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:01.457+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:01.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:01.476+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:01.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:01.293+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:01.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:01 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:01.356+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:02.044 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:18:01 smithi050 podman[101389]: 2024-09-10 10:18:01.658560999 +0000 UTC m=+0.027743778 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:18:02.045 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:18:01 smithi050 podman[101389]: 2024-09-10 10:18:01.816177338 +0000 UTC m=+0.185360116 container create 0072ac95d51b1b1f8ccb5b212c2ef8337b9a6e751e21a09e924dd0b237795d7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T10:18:02.347 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:02 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:02.043+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:02.348 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:18:02 smithi050 podman[101389]: 2024-09-10 10:18:02.072375481 +0000 UTC m=+0.441558261 container init 0072ac95d51b1b1f8ccb5b212c2ef8337b9a6e751e21a09e924dd0b237795d7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-10T10:18:02.348 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:18:02 smithi050 podman[101389]: 2024-09-10 10:18:02.079199618 +0000 UTC m=+0.448382398 container start 0072ac95d51b1b1f8ccb5b212c2ef8337b9a6e751e21a09e924dd0b237795d7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T10:18:02.348 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:18:02 smithi050 podman[101389]: 2024-09-10 10:18:02.1772143 +0000 UTC m=+0.546397092 container attach 0072ac95d51b1b1f8ccb5b212c2ef8337b9a6e751e21a09e924dd0b237795d7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T10:18:02.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:02 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:02.440+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:02.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:02 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:02.475+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:02.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:02 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:02.283+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:02.715 INFO:journalctl@ceph.osd.3.smithi050.stdout:Sep 10 10:18:02 smithi050 podman[101389]: 2024-09-10 10:18:02.347742504 +0000 UTC m=+0.716925290 container died 0072ac95d51b1b1f8ccb5b212c2ef8337b9a6e751e21a09e924dd0b237795d7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T10:18:02.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:02 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:02.371+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:03.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T10:18:03.250 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:18:03.251 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T10:18:03.251 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T10:18:03.251 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.4 2024-09-10T10:18:03.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:03 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:03.024+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:03.572 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:03 smithi084 systemd[1]: Stopping Ceph osd.4 for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:18:03.572 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:03 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:03.414+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:03.585 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:03 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:03.479+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:03.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:03 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:03.505+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:03.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:03 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:03.255+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:03.849 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:03 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4[45745]: 2024-09-10T10:18:03.569+0000 7f2f1f256640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:18:03.849 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:03 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4[45745]: 2024-09-10T10:18:03.569+0000 7f2f1f256640 -1 osd.4 99 *** Got signal Terminated *** 2024-09-10T10:18:03.850 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:03 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4[45745]: 2024-09-10T10:18:03.569+0000 7f2f1f256640 -1 osd.4 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:18:04.326 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:04 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:04.014+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:04.549 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:04.453+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:04.549 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:04.278+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:04.715 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:04 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:04.325+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:04.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:04.548+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:04.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:04 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:04.374+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:05.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:05 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:05.285+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:05.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:05 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:05.064+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:05.569 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:05.251+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:05.570 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:05.474+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:05.570 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:05.474+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.365342+0000 front 2024-09-10T10:17:43.365570+0000 (oldest deadline 2024-09-10T10:18:05.065344+0000) 2024-09-10T10:18:05.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:05 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:05.345+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:05.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:05.569+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:06.366 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:06 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:06.263+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:06.367 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:06 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:06.084+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:06.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:06 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:06.454+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:06.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:06 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:06.454+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.365342+0000 front 2024-09-10T10:17:43.365570+0000 (oldest deadline 2024-09-10T10:18:05.065344+0000) 2024-09-10T10:18:06.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:06 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:06.268+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:06.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:06 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:06.268+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:06.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:06 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:06.389+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:06.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:06 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:06.389+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:07.086 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:06 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:06.615+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:07.086 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:06 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:06.615+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:07.312 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:07 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:07.064+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:07.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:07 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:07.474+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:07.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:07 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:07.474+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.365342+0000 front 2024-09-10T10:17:43.365570+0000 (oldest deadline 2024-09-10T10:18:05.065344+0000) 2024-09-10T10:18:07.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:07 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:07.245+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:07.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:07 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:07.245+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:07.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:07 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:07.341+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:07.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:07 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:07.386+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:07.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:07 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:07.386+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:07.715 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:07 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:07.310+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:08.085 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:07 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:07.587+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:08.085 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:07 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:07.587+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:08.099 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:07 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4[45745]: 2024-09-10T10:18:07.716+0000 7f2f17864640 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.656111+0000 front 2024-09-10T10:17:42.656151+0000 (oldest deadline 2024-09-10T10:18:07.356253+0000) 2024-09-10T10:18:08.215 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:08 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:08.037+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:08.550 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:08.442+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:08.550 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:08.442+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.365342+0000 front 2024-09-10T10:17:43.365570+0000 (oldest deadline 2024-09-10T10:18:05.065344+0000) 2024-09-10T10:18:08.550 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:08.215+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:08.550 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:08.215+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:08.715 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:08 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:08.271+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:08.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:08.549+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:08.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:08 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:08.549+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:08.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:08.365+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:08.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:08.390+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:08.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:08 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:08.390+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:09.246 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:08 smithi084 podman[68159]: 2024-09-10 10:18:08.944766448 +0000 UTC m=+5.496601030 container died 73a432f6331dc6ef5434eca637822617c379b92cb16a2296c8873d390ca3e3a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T10:18:09.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:09 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:09.227+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:09.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:09 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:09.032+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:09.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:09 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:09.032+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:09.512 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:09 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:09.249+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:09.512 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:09 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:09.249+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:09.513 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:09 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:09.422+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:09.513 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:09 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:09.422+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.365342+0000 front 2024-09-10T10:17:43.365570+0000 (oldest deadline 2024-09-10T10:18:05.065344+0000) 2024-09-10T10:18:09.572 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:09 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:09.402+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:09.572 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:09 smithi084 podman[68159]: 2024-09-10 10:18:09.345346324 +0000 UTC m=+5.897180908 container cleanup 73a432f6331dc6ef5434eca637822617c379b92cb16a2296c8873d390ca3e3a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True) 2024-09-10T10:18:09.573 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:09 smithi084 bash[68159]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4 2024-09-10T10:18:09.573 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:09 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:09.376+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:09.573 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:09 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:09.376+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:09.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:09 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:09.511+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:09.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:09 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:09.511+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:09.849 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:09 smithi084 podman[68174]: 2024-09-10 10:18:09.571840364 +0000 UTC m=+0.627149804 container remove 73a432f6331dc6ef5434eca637822617c379b92cb16a2296c8873d390ca3e3a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:18:10.334 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:10 smithi084 podman[68262]: 2024-09-10 10:18:09.906479074 +0000 UTC m=+0.015986482 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:18:10.334 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:10 smithi084 podman[68262]: 2024-09-10 10:18:10.039472323 +0000 UTC m=+0.148979777 container create 7f752757e9a7143eda57ad2bf66789e9b3d6a2c87f775df362357c82977c19e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T10:18:10.334 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:10 smithi084 podman[68262]: 2024-09-10 10:18:10.333909535 +0000 UTC m=+0.443416944 container init 7f752757e9a7143eda57ad2bf66789e9b3d6a2c87f775df362357c82977c19e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T10:18:10.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:10 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:10.247+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:10.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:10 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:10.062+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:10.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:10 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:10.062+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:10.512 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:10 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:10.222+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:10.512 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:10 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:10.222+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:10.513 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:10 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:10.429+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:10.513 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:10 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:10.429+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.365342+0000 front 2024-09-10T10:17:43.365570+0000 (oldest deadline 2024-09-10T10:18:05.065344+0000) 2024-09-10T10:18:10.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:10 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:10.373+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:10.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:10 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:10.414+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:10.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:10 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:10.414+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:10.600 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:10 smithi084 podman[68262]: 2024-09-10 10:18:10.337161676 +0000 UTC m=+0.446669085 container start 7f752757e9a7143eda57ad2bf66789e9b3d6a2c87f775df362357c82977c19e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T10:18:10.600 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:10 smithi084 podman[68262]: 2024-09-10 10:18:10.433977417 +0000 UTC m=+0.543484826 container attach 7f752757e9a7143eda57ad2bf66789e9b3d6a2c87f775df362357c82977c19e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:18:10.600 INFO:journalctl@ceph.osd.4.smithi084.stdout:Sep 10 10:18:10 smithi084 podman[68262]: 2024-09-10 10:18:10.52422671 +0000 UTC m=+0.633734120 container died 7f752757e9a7143eda57ad2bf66789e9b3d6a2c87f775df362357c82977c19e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:18:10.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:10 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:10.511+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:10.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:10 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:10.511+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:11.249 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T10:18:11.290 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:18:11.290 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T10:18:11.291 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T10:18:11.291 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.5 2024-09-10T10:18:11.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:11 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:11.248+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:11.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:11 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:11.046+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:11.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:11 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:11.046+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:11.559 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:11 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:11.188+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:11.559 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:11 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:11.188+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:11.559 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:11 smithi189 systemd[1]: Stopping Ceph osd.5 for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:18:11.559 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:11 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:11.426+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:11.559 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:11 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:11.426+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.365342+0000 front 2024-09-10T10:17:43.365570+0000 (oldest deadline 2024-09-10T10:18:05.065344+0000) 2024-09-10T10:18:11.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:11 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:11.368+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:11.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:11 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:11.420+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:11.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:11 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:11.420+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:11.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:11 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:11.557+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:11.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:11 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:11.557+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:11.836 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:11 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:11.613+0000 7f8fcb9dc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:18:11.836 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:11 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:11.613+0000 7f8fcb9dc640 -1 osd.5 99 *** Got signal Terminated *** 2024-09-10T10:18:11.836 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:11 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:11.613+0000 7f8fcb9dc640 -1 osd.5 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:18:12.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:12 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:12.230+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:12.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:12 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:12.070+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:12.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:12 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:12.070+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:12.585 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:12 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:12.215+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:12.585 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:12 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:12.215+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:12.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:12 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:12.382+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:12.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:12 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:12.382+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.365342+0000 front 2024-09-10T10:17:43.365570+0000 (oldest deadline 2024-09-10T10:18:05.065344+0000) 2024-09-10T10:18:12.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:12 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:12.380+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:12.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:12 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:12.425+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:12.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:12 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:12.425+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:13.085 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:12 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:12.584+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:13.086 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:12 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:12.584+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:13.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:13 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:13.188+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:13.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:13 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:13.044+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:13.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:13 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:13.044+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:13.585 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:13 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:13.357+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:13.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:13 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:13.357+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.365342+0000 front 2024-09-10T10:17:43.365570+0000 (oldest deadline 2024-09-10T10:18:05.065344+0000) 2024-09-10T10:18:13.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:13 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:13.242+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:13.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:13 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:13.242+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:13.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:13 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:13.344+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:13.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:13 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:13.473+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:13.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:13 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:13.473+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:14.085 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:13 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:13.613+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:14.086 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:13 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:13.613+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:14.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:14 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:14.159+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:14.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:14 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:14.029+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:14.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:14 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:14.029+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:14.585 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:14 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:14.273+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:14.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:14 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:14.273+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:14.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:14 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:14.307+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:14.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:14 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:14.307+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.365342+0000 front 2024-09-10T10:17:43.365570+0000 (oldest deadline 2024-09-10T10:18:05.065344+0000) 2024-09-10T10:18:14.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:14 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:14.307+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:47.966075+0000 front 2024-09-10T10:17:47.966125+0000 (oldest deadline 2024-09-10T10:18:13.866247+0000) 2024-09-10T10:18:14.773 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:14 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:14.369+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:14.773 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:14 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:14.478+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:14.774 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:14 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:14.478+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:14.774 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:14 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:14.478+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:15.085 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:14 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:14.614+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:15.085 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:14 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:14.614+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:15.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:15 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:15.157+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:15.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:15 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:15.157+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:48.870728+0000 front 2024-09-10T10:17:48.870476+0000 (oldest deadline 2024-09-10T10:18:14.170567+0000) 2024-09-10T10:18:15.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:15 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:15.046+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:15.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:15 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:15.046+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:15.585 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:15 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:15.235+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:15.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:15 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:15.235+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:15.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:15 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:15.324+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:15.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:15 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:15.324+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.365342+0000 front 2024-09-10T10:17:43.365570+0000 (oldest deadline 2024-09-10T10:18:05.065344+0000) 2024-09-10T10:18:15.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:15 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:15.324+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:47.966075+0000 front 2024-09-10T10:17:47.966125+0000 (oldest deadline 2024-09-10T10:18:13.866247+0000) 2024-09-10T10:18:15.719 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:15 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:15.405+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:15.719 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:15 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:15.405+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:15.719 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:15 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:15.439+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:15.719 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:15 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:15.439+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:15.719 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:15 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:15.439+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:16.085 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:15 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:15.628+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:16.086 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:15 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:15.628+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:16.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:16 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:16.190+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:16.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:16 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:16.190+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:48.870728+0000 front 2024-09-10T10:17:48.870476+0000 (oldest deadline 2024-09-10T10:18:14.170567+0000) 2024-09-10T10:18:16.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:16 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:16.067+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:16.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:16 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:16.067+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:16.585 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:16 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:16.218+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:16.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:16 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:16.218+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:16.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:16 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:16.218+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:16.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:16 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:16.297+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.663794+0000 front 2024-09-10T10:17:34.663893+0000 (oldest deadline 2024-09-10T10:17:57.563753+0000) 2024-09-10T10:18:16.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:16 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:16.297+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.365342+0000 front 2024-09-10T10:17:43.365570+0000 (oldest deadline 2024-09-10T10:18:05.065344+0000) 2024-09-10T10:18:16.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:16 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5[46270]: 2024-09-10T10:18:16.297+0000 7f8fc3fea640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:47.966075+0000 front 2024-09-10T10:17:47.966125+0000 (oldest deadline 2024-09-10T10:18:13.866247+0000) 2024-09-10T10:18:16.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:16 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:16.378+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:16.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:16 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:16.378+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:16.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:16 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:16.397+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:16.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:16 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:16.397+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:16.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:16 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:16.397+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:17.005 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:16 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:16.596+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:17.005 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:16 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:16.596+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:17.307 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:17 smithi189 podman[69027]: 2024-09-10 10:18:17.004885279 +0000 UTC m=+5.522813374 container died da9d8cd82ca4df3bbf6fabeb40d8b01b856f163a9cf1c088edfdcdb65874a363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731) 2024-09-10T10:18:17.308 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:17 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:17.209+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:17.308 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:17 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:17.209+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:17.308 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:17 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:17.209+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:17.371 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:17 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:17.233+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:17.371 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:17 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:17.233+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:48.870728+0000 front 2024-09-10T10:17:48.870476+0000 (oldest deadline 2024-09-10T10:18:14.170567+0000) 2024-09-10T10:18:17.372 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:17 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:17.101+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:17.372 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:17 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:17.101+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:17.372 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:17 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:17.101+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:17.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:17 smithi189 podman[69027]: 2024-09-10 10:18:17.41361591 +0000 UTC m=+5.931543994 container cleanup da9d8cd82ca4df3bbf6fabeb40d8b01b856f163a9cf1c088edfdcdb65874a363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:18:17.586 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:17 smithi189 bash[69027]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5 2024-09-10T10:18:17.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:17 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:17.552+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:17.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:17 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:17.552+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:17.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:17 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:17.552+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:17.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:17 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:17.408+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:17.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:17 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:17.408+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:17.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:17 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:17.359+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:17.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:17 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:17.359+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:17.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:17 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:17.359+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:18.030 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:17 smithi189 podman[69042]: 2024-09-10 10:18:17.632119495 +0000 UTC m=+0.627121892 container remove da9d8cd82ca4df3bbf6fabeb40d8b01b856f163a9cf1c088edfdcdb65874a363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T10:18:18.294 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:18 smithi189 podman[69131]: 2024-09-10 10:18:17.933151367 +0000 UTC m=+0.015939932 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:18:18.294 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:18 smithi189 podman[69131]: 2024-09-10 10:18:18.049585655 +0000 UTC m=+0.132374265 container create 702d6e39275276ab18c391c0e9de8d57c493b353a3fdc705cefc10b166827947 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:18:18.295 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:18 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:18.224+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:18.295 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:18 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:18.224+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:18.295 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:18 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:18.224+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:18.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:18.233+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:18.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:18.233+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:48.870728+0000 front 2024-09-10T10:17:48.870476+0000 (oldest deadline 2024-09-10T10:18:14.170567+0000) 2024-09-10T10:18:18.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:18.098+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:18.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:18.098+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:18.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:18 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:18.098+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:18.574 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:18 smithi189 podman[69131]: 2024-09-10 10:18:18.293959354 +0000 UTC m=+0.376747919 container init 702d6e39275276ab18c391c0e9de8d57c493b353a3fdc705cefc10b166827947 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T10:18:18.574 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:18 smithi189 podman[69131]: 2024-09-10 10:18:18.297322167 +0000 UTC m=+0.380110741 container start 702d6e39275276ab18c391c0e9de8d57c493b353a3fdc705cefc10b166827947 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:18:18.574 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:18 smithi189 podman[69131]: 2024-09-10 10:18:18.410976786 +0000 UTC m=+0.493765369 container attach 702d6e39275276ab18c391c0e9de8d57c493b353a3fdc705cefc10b166827947 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T10:18:18.575 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 10:18:18 smithi189 podman[69131]: 2024-09-10 10:18:18.494975944 +0000 UTC m=+0.577764513 container died 702d6e39275276ab18c391c0e9de8d57c493b353a3fdc705cefc10b166827947 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T10:18:18.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:18 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:18.572+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:18.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:18 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:18.572+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:18.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:18 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:18.572+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:18.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:18 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:18.450+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:18.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:18 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:18.450+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:18.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:18 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:18.405+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:18.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:18 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:18.405+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:18.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:18 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:18.405+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:19.182 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T10:18:19.221 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:18:19.221 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T10:18:19.221 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T10:18:19.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.6 2024-09-10T10:18:19.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:19 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:19.239+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:19.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:19 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:19.239+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:48.870728+0000 front 2024-09-10T10:17:48.870476+0000 (oldest deadline 2024-09-10T10:18:14.170567+0000) 2024-09-10T10:18:19.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:19 smithi050 systemd[1]: Stopping Ceph osd.6 for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:18:19.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:19 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:19.147+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:19.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:19 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:19.147+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:19.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:19 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:19.147+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:19.585 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:19 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:19.256+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:19.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:19 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:19.256+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:19.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:19 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:19.256+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:19.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:19 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:19.441+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:19.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:19 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:19.441+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:19.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:19 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:19.397+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:19.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:19 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:19.397+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:19.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:19 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:19.397+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:19.965 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:19 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:19.675+0000 7f92c6200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:18:19.965 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:19 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:19.675+0000 7f92c6200640 -1 osd.6 99 *** Got signal Terminated *** 2024-09-10T10:18:19.965 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:19 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:19.675+0000 7f92c6200640 -1 osd.6 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:18:20.085 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:19 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:19.596+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:20.086 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:19 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:19.596+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:20.086 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:19 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:19.596+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:20.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:20 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:20.228+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:20.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:20 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:20.228+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:48.870728+0000 front 2024-09-10T10:17:48.870476+0000 (oldest deadline 2024-09-10T10:18:14.170567+0000) 2024-09-10T10:18:20.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:20 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:20.172+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:20.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:20 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:20.172+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:20.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:20 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:20.172+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:20.575 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:20 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:20.213+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:20.575 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:20 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:20.213+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:20.575 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:20 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:20.213+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:20.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:20 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:20.574+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:20.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:20 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:20.574+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:20.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:20 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:20.574+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:20.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:20 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:20.445+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:20.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:20 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:20.445+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:20.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:20 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:20.444+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:20.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:20 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:20.444+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:20.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:20 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:20.444+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:21.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:21 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:21.229+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:21.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:21 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:21.229+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:48.870728+0000 front 2024-09-10T10:17:48.870476+0000 (oldest deadline 2024-09-10T10:18:14.170567+0000) 2024-09-10T10:18:21.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:21 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:21.132+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:21.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:21 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:21.132+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:21.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:21 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:21.132+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:21.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:21 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:21.132+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:21.585 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:21 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:21.260+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:21.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:21 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:21.260+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:21.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:21 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:21.260+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:21.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:21 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:21.468+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:21.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:21 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:21.468+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:21.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:21 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:21.468+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:21.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:21 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:21.468+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:21.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:21 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:21.468+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:21.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:21 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:21.468+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:22.085 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:21 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:21.599+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:22.085 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:21 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:21.599+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:22.086 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:21 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:21.599+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:22.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:22 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:22.257+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:22.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:22 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:22.257+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:48.870728+0000 front 2024-09-10T10:17:48.870476+0000 (oldest deadline 2024-09-10T10:18:14.170567+0000) 2024-09-10T10:18:22.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:22 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:22.257+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:58.172407+0000 front 2024-09-10T10:17:58.172359+0000 (oldest deadline 2024-09-10T10:18:21.672608+0000) 2024-09-10T10:18:22.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:22 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:22.145+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:22.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:22 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:22.145+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:22.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:22 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:22.145+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:22.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:22 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:22.145+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:22.573 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:22 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:22.257+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:22.573 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:22 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:22.257+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:22.573 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:22 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:22.257+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:22.573 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:22 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:22.257+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:22.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:22 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:22.572+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:22.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:22 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:22.572+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:22.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:22 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:22.572+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:22.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:22 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:22.421+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:22.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:22 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:22.421+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:22.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:22 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:22.482+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:22.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:22 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:22.482+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:22.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:22 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:22.482+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:22.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:22 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:22.482+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:23.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:23 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:23.280+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:23.466 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:23 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:23.280+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:48.870728+0000 front 2024-09-10T10:17:48.870476+0000 (oldest deadline 2024-09-10T10:18:14.170567+0000) 2024-09-10T10:18:23.466 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:23 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:23.280+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:58.172407+0000 front 2024-09-10T10:17:58.172359+0000 (oldest deadline 2024-09-10T10:18:21.672608+0000) 2024-09-10T10:18:23.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:23 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:23.097+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:23.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:23 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:23.097+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:23.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:23 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:23.097+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:23.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:23 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:23.097+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:23.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:23 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:23.531+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:23.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:23 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:23.531+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:23.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:23 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:23.531+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:23.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:23 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:23.299+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:23.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:23 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:23.299+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:23.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:23 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:23.299+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:23.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:23 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:23.299+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:23.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:23 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:23.376+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:23.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:23 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:23.376+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:23.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:23 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:23.376+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:58.725119+0000 front 2024-09-10T10:17:58.724994+0000 (oldest deadline 2024-09-10T10:18:22.824903+0000) 2024-09-10T10:18:23.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:23 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:23.445+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:23.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:23 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:23.445+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:23.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:23 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:23.445+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:23.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:23 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:23.445+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:24.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:24.312+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:43.168825+0000 front 2024-09-10T10:17:43.168545+0000 (oldest deadline 2024-09-10T10:18:04.169207+0000) 2024-09-10T10:18:24.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:24.312+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:48.870728+0000 front 2024-09-10T10:17:48.870476+0000 (oldest deadline 2024-09-10T10:18:14.170567+0000) 2024-09-10T10:18:24.465 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6[57601]: 2024-09-10T10:18:24.312+0000 7f92bcc00640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:58.172407+0000 front 2024-09-10T10:17:58.172359+0000 (oldest deadline 2024-09-10T10:18:21.672608+0000) 2024-09-10T10:18:24.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:24.082+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:24.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:24.082+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:24.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:24.082+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:24.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:24 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:24.082+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:24.532 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:24 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:24.281+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:24.533 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:24 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:24.281+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:24.533 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:24 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:24.281+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:24.533 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:24 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:24.281+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:24.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:24 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:24.337+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:24.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:24 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:24.337+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:24.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:24 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:24.337+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:58.725119+0000 front 2024-09-10T10:17:58.724994+0000 (oldest deadline 2024-09-10T10:18:22.824903+0000) 2024-09-10T10:18:24.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:24 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:24.396+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:24.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:24 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:24.396+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:24.600 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:24 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:24.396+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:24.600 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:24 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:24.396+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:24.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:24 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:24.531+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:24.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:24 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:24.531+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:24.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:24 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:24.531+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:25.393 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:25 smithi050 podman[101503]: 2024-09-10 10:18:25.08940304 +0000 UTC m=+5.577969857 container died 4d1e00ad9b254c165ec5ec4e04a4f23e368147793c0e6af7944fe1380f48e3cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T10:18:25.393 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:25 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:25.048+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:25.393 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:25 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:25.048+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:25.393 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:25 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:25.048+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:25.393 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:25 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:25.048+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:25.585 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:25 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:25.507+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:25.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:25 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:25.507+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:25.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:25 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:25.507+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:25.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:25 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:25.285+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:25.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:25 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:25.285+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:25.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:25 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:25.285+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:25.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:25 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:25.285+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:25.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:25 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:25.368+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:25.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:25 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:25.368+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:25.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:25 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:25.368+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:58.725119+0000 front 2024-09-10T10:17:58.724994+0000 (oldest deadline 2024-09-10T10:18:22.824903+0000) 2024-09-10T10:18:25.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:25 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:25.395+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:25.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:25 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:25.395+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:25.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:25 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:25.395+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:25.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:25 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:25.395+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:25.644 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:25 smithi050 podman[101503]: 2024-09-10 10:18:25.626378303 +0000 UTC m=+6.114945119 container cleanup 4d1e00ad9b254c165ec5ec4e04a4f23e368147793c0e6af7944fe1380f48e3cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T10:18:25.645 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:25 smithi050 bash[101503]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6 2024-09-10T10:18:25.965 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:25 smithi050 podman[101522]: 2024-09-10 10:18:25.827806496 +0000 UTC m=+0.728303319 container remove 4d1e00ad9b254c165ec5ec4e04a4f23e368147793c0e6af7944fe1380f48e3cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T10:18:26.407 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:26 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:26.060+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:26.407 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:26 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:26.060+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:26.407 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:26 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:26.060+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:26.407 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:26 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:26.060+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:26.514 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:26 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:26.261+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:26.514 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:26 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:26.261+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:26.514 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:26 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:26.261+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:26.515 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:26 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:26.261+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:26.690 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:26 smithi050 podman[101610]: 2024-09-10 10:18:26.310902041 +0000 UTC m=+0.027452899 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:18:26.690 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:26 smithi050 podman[101610]: 2024-09-10 10:18:26.428808232 +0000 UTC m=+0.145359080 container create 6c9fb71cb44e62e1a21d811932361e50085059380a707ac9bb2da1d6305d7033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-10T10:18:26.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:26 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:26.512+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:26.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:26 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:26.512+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:26.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:26 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:26.512+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:26.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:26 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:26.377+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:26.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:26 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:26.377+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:26.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:26 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:26.377+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:58.725119+0000 front 2024-09-10T10:17:58.724994+0000 (oldest deadline 2024-09-10T10:18:22.824903+0000) 2024-09-10T10:18:26.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:26 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:26.422+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:26.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:26 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:26.422+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:26.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:26 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:26.422+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:26.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:26 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:26.422+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:26.960 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:26 smithi050 podman[101610]: 2024-09-10 10:18:26.68972733 +0000 UTC m=+0.406278203 container init 6c9fb71cb44e62e1a21d811932361e50085059380a707ac9bb2da1d6305d7033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T10:18:26.960 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:26 smithi050 podman[101610]: 2024-09-10 10:18:26.696694451 +0000 UTC m=+0.413245300 container start 6c9fb71cb44e62e1a21d811932361e50085059380a707ac9bb2da1d6305d7033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T10:18:26.960 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:26 smithi050 podman[101610]: 2024-09-10 10:18:26.781439577 +0000 UTC m=+0.497990440 container attach 6c9fb71cb44e62e1a21d811932361e50085059380a707ac9bb2da1d6305d7033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T10:18:27.215 INFO:journalctl@ceph.osd.6.smithi050.stdout:Sep 10 10:18:26 smithi050 podman[101610]: 2024-09-10 10:18:26.959987662 +0000 UTC m=+0.676538531 container died 6c9fb71cb44e62e1a21d811932361e50085059380a707ac9bb2da1d6305d7033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T10:18:27.215 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:27 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:27.037+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:27.215 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:27 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:27.037+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:27.215 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:27 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:27.037+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:27.215 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:27 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:27.037+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:27.557 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:27 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:27.225+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:27.557 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:27 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:27.225+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:27.557 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:27 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:27.225+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:27.557 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:27 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:27.225+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:27.816 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T10:18:27.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:27 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:27.555+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:27.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:27 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:27.555+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:27.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:27 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:27.555+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:27.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:27 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:27.392+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:27.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:27 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:27.392+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:27.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:27 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:27.392+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:58.725119+0000 front 2024-09-10T10:17:58.724994+0000 (oldest deadline 2024-09-10T10:18:22.824903+0000) 2024-09-10T10:18:27.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:27 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:27.385+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:27.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:27 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:27.385+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:27.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:27 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:27.385+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:27.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:27 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:27.385+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:27.897 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:18:27.897 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T10:18:27.897 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T10:18:27.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.7 2024-09-10T10:18:28.138 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:27 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:27.989+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:28.139 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:27 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:27.989+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:28.139 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:27 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:27.989+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:28.139 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:27 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:27.989+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:28.215 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:27 smithi084 systemd[1]: Stopping Ceph osd.7 for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:18:28.570 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:28 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:28.245+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:28.570 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:28 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:28.245+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:28.570 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:28 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:28.245+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:28.570 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:28 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:28.245+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:28.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:28 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:28.214+0000 7f3a3ad8e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:18:28.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:28 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:28.214+0000 7f3a3ad8e640 -1 osd.7 99 *** Got signal Terminated *** 2024-09-10T10:18:28.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:28 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:28.214+0000 7f3a3ad8e640 -1 osd.7 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:18:28.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:28 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:28.432+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:28.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:28 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:28.432+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:28.599 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:28 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:28.432+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:58.725119+0000 front 2024-09-10T10:17:58.724994+0000 (oldest deadline 2024-09-10T10:18:22.824903+0000) 2024-09-10T10:18:28.600 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:28 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:28.409+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:28.600 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:28 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:28.409+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:28.600 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:28 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:28.409+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:28.600 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:28 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:28.409+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:28.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:28 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:28.569+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:28.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:28 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:28.569+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:28.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:28 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:28.569+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:29.325 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:29 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:29.025+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:29.326 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:29 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:29.025+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:29.326 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:29 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:29.025+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:29.326 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:29 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:29.026+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:29.541 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:29 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:29.274+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:29.541 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:29 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:29.274+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:29.541 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:29 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:29.274+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:29.541 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:29 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:29.274+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:29.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:29 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:29.540+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:29.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:29 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:29.540+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:29.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:29 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:29.540+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:29.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:29 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:29.409+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:29.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:29 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:29.409+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:29.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:29 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:29.409+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:58.725119+0000 front 2024-09-10T10:17:58.724994+0000 (oldest deadline 2024-09-10T10:18:22.824903+0000) 2024-09-10T10:18:29.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:29 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:29.408+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:29.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:29 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:29.408+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:29.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:29 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:29.408+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:29.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:29 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:29.408+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:30.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:30 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:30.065+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:30.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:30 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:30.065+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:30.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:30 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:30.065+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:30.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:30 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:30.065+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:30.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:30 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:30.509+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:30.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:30 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:30.509+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:30.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:30 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:30.509+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:30.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:30 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:30.509+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:30.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:30 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:30.310+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:30.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:30 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:30.310+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:30.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:30 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:30.310+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:30.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:30 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:30.310+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:30.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:30 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:30.406+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:30.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:30 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:30.406+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:30.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:30 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:30.406+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:58.725119+0000 front 2024-09-10T10:17:58.724994+0000 (oldest deadline 2024-09-10T10:18:22.824903+0000) 2024-09-10T10:18:30.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:30 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:30.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:30.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:30 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:30.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:30.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:30 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:30.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:30.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:30 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:30.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:31.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:31 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:31.060+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:31.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:31 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:31.060+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:31.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:31 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:31.060+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:31.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:31 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:31.060+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:31.585 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:31 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:31.470+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:31.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:31 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:31.470+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:31.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:31 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:31.470+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:31.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:31 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:31.470+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:31.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:31 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:31.332+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:31.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:31 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:31.332+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:31.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:31 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:31.332+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:31.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:31 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:31.332+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:31.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:31 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:31.394+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:31.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:31 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:31.394+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:31.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:31 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:31.394+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:58.725119+0000 front 2024-09-10T10:17:58.724994+0000 (oldest deadline 2024-09-10T10:18:22.824903+0000) 2024-09-10T10:18:31.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:31 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:31.394+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:08.526882+0000 front 2024-09-10T10:18:08.526809+0000 (oldest deadline 2024-09-10T10:18:30.826968+0000) 2024-09-10T10:18:31.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:31 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:31.399+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:31.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:31 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:31.399+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:31.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:31 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:31.399+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:31.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:31 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:31.399+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:32.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:32.102+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:32.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:32.102+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:32.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:32.102+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:32.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:32.102+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:32.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:32 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:32.102+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:32.585 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:32 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:32.439+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:32.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:32 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:32.439+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:32.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:32 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:32.439+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:32.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:32 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:32.439+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:32.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:32 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:32.296+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:32.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:32 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:32.296+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:32.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:32 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:32.296+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:32.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:32 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:32.296+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:32.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:32 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:32.402+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:41.722956+0000 front 2024-09-10T10:17:41.722928+0000 (oldest deadline 2024-09-10T10:18:07.023028+0000) 2024-09-10T10:18:32.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:32 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:32.402+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.524000+0000 front 2024-09-10T10:17:50.523915+0000 (oldest deadline 2024-09-10T10:18:14.623971+0000) 2024-09-10T10:18:32.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:32 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:32.402+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:58.725119+0000 front 2024-09-10T10:17:58.724994+0000 (oldest deadline 2024-09-10T10:18:22.824903+0000) 2024-09-10T10:18:32.849 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:32 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7[52697]: 2024-09-10T10:18:32.402+0000 7f3a373a4640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:08.526882+0000 front 2024-09-10T10:18:08.526809+0000 (oldest deadline 2024-09-10T10:18:30.826968+0000) 2024-09-10T10:18:32.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:32 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:32.447+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:32.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:32 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:32.447+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:32.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:32 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:32.447+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:32.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:32 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:32.447+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:32.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:32 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:32.447+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:33.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:33 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:33.058+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:33.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:33 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:33.058+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:33.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:33 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:33.058+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:33.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:33 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:33.058+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:33.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:33 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:33.058+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:33.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:33 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:33.411+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:33.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:33 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:33.411+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:33.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:33 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:33.411+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:33.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:33 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:33.411+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:33.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:33 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:33.333+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:33.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:33 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:33.333+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:33.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:33 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:33.333+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:33.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:33 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:33.333+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:33.733 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:33 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:33.459+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:33.733 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:33 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:33.459+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:33.733 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:33 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:33.459+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:33.733 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:33 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:33.459+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:33.733 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:33 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:33.459+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:34.039 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:33 smithi084 podman[68376]: 2024-09-10 10:18:33.732596362 +0000 UTC m=+5.645399543 container died 2354aec58d209ab05af6cf619ca97e50235ae24f61fdacaf9e1cd69eb91cc549 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:18:34.349 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:34 smithi084 podman[68376]: 2024-09-10 10:18:34.138251705 +0000 UTC m=+6.051054885 container cleanup 2354aec58d209ab05af6cf619ca97e50235ae24f61fdacaf9e1cd69eb91cc549 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T10:18:34.349 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:34 smithi084 bash[68376]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7 2024-09-10T10:18:34.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:34 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:34.044+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:34.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:34 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:34.044+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:34.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:34 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:34.044+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:34.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:34 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:34.044+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:34.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:34 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:34.044+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:34.750 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:34 smithi084 podman[68391]: 2024-09-10 10:18:34.397944632 +0000 UTC m=+0.661424311 container remove 2354aec58d209ab05af6cf619ca97e50235ae24f61fdacaf9e1cd69eb91cc549 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T10:18:34.750 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:34 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:34.454+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:34.750 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:34 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:34.454+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:34.750 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:34 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:34.454+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:34.750 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:34 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:34.454+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:34.751 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:34 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:34.454+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:34.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:34 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:34.401+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:34.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:34 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:34.401+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:34.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:34 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:34.401+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:34.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:34 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:34.401+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:34.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:34 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:34.350+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:34.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:34 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:34.350+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:34.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:34 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:34.350+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:34.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:34 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:34.350+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:35.072 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:34 smithi084 podman[68476]: 2024-09-10 10:18:34.652346133 +0000 UTC m=+0.015591710 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:18:35.073 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:34 smithi084 podman[68476]: 2024-09-10 10:18:34.965451965 +0000 UTC m=+0.328697521 container create fbb49b3360ce4c3014042ff614499b67381810b2437ea5ada73188dd8e339460 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:18:35.349 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:35 smithi084 podman[68476]: 2024-09-10 10:18:35.192911689 +0000 UTC m=+0.556157255 container init fbb49b3360ce4c3014042ff614499b67381810b2437ea5ada73188dd8e339460 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T10:18:35.349 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:35 smithi084 podman[68476]: 2024-09-10 10:18:35.196271882 +0000 UTC m=+0.559517439 container start fbb49b3360ce4c3014042ff614499b67381810b2437ea5ada73188dd8e339460 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T10:18:35.349 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:35 smithi084 podman[68476]: 2024-09-10 10:18:35.301281513 +0000 UTC m=+0.664527100 container attach fbb49b3360ce4c3014042ff614499b67381810b2437ea5ada73188dd8e339460 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-10T10:18:35.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:35.052+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:35.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:35.052+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:35.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:35.052+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:35.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:35.052+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:35.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:35 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:35.052+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:35.585 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:35 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:35.437+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:35.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:35 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:35.437+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:35.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:35 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:35.437+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:35.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:35 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:35.437+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:35.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:35 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:35.305+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:35.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:35 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:35.305+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:35.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:35 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:35.305+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:35.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:35 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:35.305+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:35.616 INFO:journalctl@ceph.osd.7.smithi084.stdout:Sep 10 10:18:35 smithi084 podman[68476]: 2024-09-10 10:18:35.39397408 +0000 UTC m=+0.757219640 container died fbb49b3360ce4c3014042ff614499b67381810b2437ea5ada73188dd8e339460 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-7-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True) 2024-09-10T10:18:35.617 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:35 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:35.481+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:35.617 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:35 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:35.481+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:35.617 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:35 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:35.481+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:35.617 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:35 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:35.481+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:35.617 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:35 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:35.481+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:36.038 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T10:18:36.076 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:18:36.076 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T10:18:36.076 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T10:18:36.076 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.8 2024-09-10T10:18:36.366 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:36 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:36.094+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:36.366 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:36 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:36.094+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:36.366 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:36 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:36.094+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:36.367 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:36 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:36.094+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:36.367 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:36 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:36.094+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:36.393 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:36 smithi189 systemd[1]: Stopping Ceph osd.8 for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:18:36.393 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:36 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:36.334+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:36.393 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:36 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:36.334+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:36.393 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:36 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:36.334+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:36.393 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:36 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:36.334+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:36.393 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:36 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:36.391+0000 7f5981703640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:18:36.393 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:36 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:36.391+0000 7f5981703640 -1 osd.8 99 *** Got signal Terminated *** 2024-09-10T10:18:36.393 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:36 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:36.391+0000 7f5981703640 -1 osd.8 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:18:36.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:36 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:36.415+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:36.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:36 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:36.415+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:36.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:36 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:36.415+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:36.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:36 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:36.415+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:36.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:36 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:36.470+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:36.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:36 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:36.470+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:36.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:36 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:36.470+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:36.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:36 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:36.470+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:36.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:36 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:36.470+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:37.394 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:37 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:37.141+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:37.394 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:37 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:37.141+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:37.394 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:37 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:37.141+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:37.394 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:37 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:37.141+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:37.394 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:37 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:37.141+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:37.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:37 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:37.460+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:37.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:37 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:37.460+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:37.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:37 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:37.460+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:37.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:37 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:37.460+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:37.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:37 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:37.354+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:37.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:37 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:37.354+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:37.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:37 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:37.354+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:37.837 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:37 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:37.354+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:37.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:37 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:37.424+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:37.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:37 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:37.424+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:37.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:37 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:37.424+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:37.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:37 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:37.424+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:37.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:37 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:37.424+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:38.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:38 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:38.140+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:38.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:38 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:38.140+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:38.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:38 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:38.140+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:38.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:38 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:38.140+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:38.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:38 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:38.140+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:38.585 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:38 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:38.440+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:38.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:38 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:38.440+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:38.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:38 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:38.440+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:38.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:38 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:38.440+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:38.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:38 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:38.308+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:38.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:38 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:38.308+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:38.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:38 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:38.308+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:38.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:38 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:38.308+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:38.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:38 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:38.308+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.622080+0000 front 2024-09-10T10:18:15.622065+0000 (oldest deadline 2024-09-10T10:18:37.922253+0000) 2024-09-10T10:18:38.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:38 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:38.423+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:38.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:38 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:38.423+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:38.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:38 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:38.423+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:38.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:38 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:38.423+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:38.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:38 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:38.423+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:39.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:39 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:39.105+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:39.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:39 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:39.105+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:39.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:39 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:39.105+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:39.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:39 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:39.105+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:39.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:39 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:39.105+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:39.585 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:39 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:39.328+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:39.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:39 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:39.328+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:39.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:39 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:39.328+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:39.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:39 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:39.328+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:39.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:39 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:39.328+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.622080+0000 front 2024-09-10T10:18:15.622065+0000 (oldest deadline 2024-09-10T10:18:37.922253+0000) 2024-09-10T10:18:39.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:39 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:39.449+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:39.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:39 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:39.449+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:39.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:39 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:39.449+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:39.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:39 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:39.449+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:39.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:39 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:39.449+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:39.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:39 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:39.399+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:39.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:39 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:39.399+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:39.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:39 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:39.399+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:39.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:39 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:39.399+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:39.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:39 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:39.399+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:39.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:39 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:39.399+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:40.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:40 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:40.141+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:40.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:40 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:40.141+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:40.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:40 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:40.141+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:40.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:40 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:40.141+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:40.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:40 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:40.141+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:40.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:40 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:40.141+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.949789+0000 front 2024-09-10T10:18:15.949989+0000 (oldest deadline 2024-09-10T10:18:39.449533+0000) 2024-09-10T10:18:40.835 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:40 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:40.351+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:40.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:40 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:40.351+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:40.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:40 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:40.351+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:40.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:40 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:40.351+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:40.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:40 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:40.351+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.622080+0000 front 2024-09-10T10:18:15.622065+0000 (oldest deadline 2024-09-10T10:18:37.922253+0000) 2024-09-10T10:18:40.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:40 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:40.474+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:40.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:40 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:40.474+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:40.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:40 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:40.474+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:40.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:40 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:40.474+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:40.837 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:40 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:40.474+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:40.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:40 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:40.447+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:40.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:40 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:40.447+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:40.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:40 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:40.447+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:40.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:40 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:40.447+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:40.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:40 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:40.447+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:40.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:40 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:40.447+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:41.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:41 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:41.174+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:41.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:41 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:41.174+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:41.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:41 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:41.174+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:41.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:41 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:41.174+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:41.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:41 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:41.174+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:41.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:41 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:41.174+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.949789+0000 front 2024-09-10T10:18:15.949989+0000 (oldest deadline 2024-09-10T10:18:39.449533+0000) 2024-09-10T10:18:41.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:41 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:41.378+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:30.314609+0000 front 2024-09-10T10:17:30.314490+0000 (oldest deadline 2024-09-10T10:17:55.614489+0000) 2024-09-10T10:18:41.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:41 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:41.378+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.416856+0000 front 2024-09-10T10:17:42.416981+0000 (oldest deadline 2024-09-10T10:18:05.316935+0000) 2024-09-10T10:18:41.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:41 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:41.378+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.617905+0000 front 2024-09-10T10:17:50.617874+0000 (oldest deadline 2024-09-10T10:18:15.918036+0000) 2024-09-10T10:18:41.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:41 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:41.378+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:55.918524+0000 front 2024-09-10T10:17:55.918558+0000 (oldest deadline 2024-09-10T10:18:21.818557+0000) 2024-09-10T10:18:41.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:41 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8[53042]: 2024-09-10T10:18:41.378+0000 7f5979d11640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.622080+0000 front 2024-09-10T10:18:15.622065+0000 (oldest deadline 2024-09-10T10:18:37.922253+0000) 2024-09-10T10:18:41.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:41 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:41.447+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:41.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:41 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:41.447+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:41.837 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:41 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:41.447+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:41.837 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:41 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:41.447+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:41.837 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:41 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:41.447+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:41.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:41 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:41.454+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:41.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:41 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:41.454+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:41.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:41 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:41.454+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:41.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:41 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:41.454+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:41.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:41 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:41.454+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:41.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:41 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:41.454+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:42.269 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:41 smithi189 podman[69233]: 2024-09-10 10:18:41.950265592 +0000 UTC m=+5.679158715 container died 765d54370f7f8f8fc3e6b6a954304f25241d4d834e5cf9aca32b1313cfeca490 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T10:18:42.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:42 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:42.143+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:42.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:42 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:42.143+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:42.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:42 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:42.143+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:42.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:42 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:42.143+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:42.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:42 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:42.143+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:42.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:42 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:42.143+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.949789+0000 front 2024-09-10T10:18:15.949989+0000 (oldest deadline 2024-09-10T10:18:39.449533+0000) 2024-09-10T10:18:42.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:42 smithi189 podman[69233]: 2024-09-10 10:18:42.358975825 +0000 UTC m=+6.087868940 container cleanup 765d54370f7f8f8fc3e6b6a954304f25241d4d834e5cf9aca32b1313cfeca490 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T10:18:42.586 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:42 smithi189 bash[69233]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8 2024-09-10T10:18:42.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:42 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:42.404+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:42.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:42 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:42.404+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:42.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:42 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:42.404+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:42.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:42 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:42.404+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:42.586 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:42 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:42.404+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:42.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:42 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:42.477+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:42.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:42 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:42.477+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:42.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:42 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:42.477+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:42.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:42 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:42.477+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:42.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:42 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:42.477+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:42.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:42 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:42.477+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:43.086 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:42 smithi189 podman[69250]: 2024-09-10 10:18:42.652224852 +0000 UTC m=+0.702354728 container remove 765d54370f7f8f8fc3e6b6a954304f25241d4d834e5cf9aca32b1313cfeca490 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T10:18:43.371 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:43 smithi189 podman[69339]: 2024-09-10 10:18:42.988570781 +0000 UTC m=+0.016276650 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:18:43.371 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:43 smithi189 podman[69339]: 2024-09-10 10:18:43.094399637 +0000 UTC m=+0.122105495 container create 0fd64c1356c57d08819caccc67ced25f4d3e72d11047b1a52aa719e6f9d3244f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:18:43.371 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:43 smithi189 podman[69339]: 2024-09-10 10:18:43.33043076 +0000 UTC m=+0.358136620 container init 0fd64c1356c57d08819caccc67ced25f4d3e72d11047b1a52aa719e6f9d3244f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T10:18:43.371 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:43 smithi189 podman[69339]: 2024-09-10 10:18:43.333896505 +0000 UTC m=+0.361602364 container start 0fd64c1356c57d08819caccc67ced25f4d3e72d11047b1a52aa719e6f9d3244f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T10:18:43.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:43 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:43.121+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:43.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:43 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:43.121+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:43.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:43 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:43.121+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:43.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:43 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:43.121+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:43.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:43 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:43.121+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:43.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:43 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:43.121+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.949789+0000 front 2024-09-10T10:18:15.949989+0000 (oldest deadline 2024-09-10T10:18:39.449533+0000) 2024-09-10T10:18:43.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:43 smithi189 podman[69339]: 2024-09-10 10:18:43.438959435 +0000 UTC m=+0.466665304 container attach 0fd64c1356c57d08819caccc67ced25f4d3e72d11047b1a52aa719e6f9d3244f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:18:43.836 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 10:18:43 smithi189 podman[69339]: 2024-09-10 10:18:43.531398205 +0000 UTC m=+0.559104067 container died 0fd64c1356c57d08819caccc67ced25f4d3e72d11047b1a52aa719e6f9d3244f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T10:18:43.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:43 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:43.369+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:43.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:43 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:43.369+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:43.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:43 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:43.369+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:43.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:43 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:43.369+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:43.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:43 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:43.369+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:43.852 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:43 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:43.507+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:43.852 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:43 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:43.507+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:43.853 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:43 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:43.507+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:43.853 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:43 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:43.507+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:43.853 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:43 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:43.507+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:43.853 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:43 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:43.507+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:44.243 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T10:18:44.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:18:44.284 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T10:18:44.284 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T10:18:44.285 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.9 2024-09-10T10:18:44.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:44 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:44.128+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:44.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:44 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:44.128+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:44.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:44 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:44.128+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:44.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:44 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:44.128+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:44.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:44 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:44.128+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:44.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:44 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:44.128+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.949789+0000 front 2024-09-10T10:18:15.949989+0000 (oldest deadline 2024-09-10T10:18:39.449533+0000) 2024-09-10T10:18:44.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:44 smithi050 systemd[1]: Stopping Ceph osd.9 for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:18:44.497 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:44 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:44.336+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:44.498 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:44 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:44.336+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:44.498 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:44 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:44.336+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:44.498 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:44 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:44.336+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:44.498 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:44 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:44.336+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:44.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:44 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:44.519+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:44.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:44 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:44.519+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:44.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:44 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:44.519+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:44.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:44 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:44.519+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:44.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:44 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:44.519+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:44.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:44 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:44.519+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:44.965 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:44 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:44.690+0000 7f3167400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:18:44.965 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:44 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:44.690+0000 7f3167400640 -1 osd.9 99 *** Got signal Terminated *** 2024-09-10T10:18:44.965 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:44 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:44.690+0000 7f3167400640 -1 osd.9 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:18:45.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:45 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:45.092+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:45.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:45 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:45.092+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:45.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:45 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:45.092+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:45.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:45 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:45.092+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:45.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:45 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:45.092+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:45.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:45 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:45.092+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.949789+0000 front 2024-09-10T10:18:15.949989+0000 (oldest deadline 2024-09-10T10:18:39.449533+0000) 2024-09-10T10:18:45.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:45 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:45.350+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:45.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:45 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:45.350+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:45.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:45 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:45.350+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:45.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:45 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:45.350+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:45.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:45 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:45.350+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:45.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:45 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:45.528+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:45.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:45 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:45.528+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:45.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:45 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:45.528+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:45.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:45 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:45.528+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:45.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:45 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:45.528+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:45.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:45 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:45.528+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:46.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:46 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:46.124+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:46.531 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:46 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:46.124+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:46.531 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:46 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:46.124+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:46.531 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:46 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:46.124+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:46.531 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:46 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:46.124+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:46.531 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:46 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:46.124+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.949789+0000 front 2024-09-10T10:18:15.949989+0000 (oldest deadline 2024-09-10T10:18:39.449533+0000) 2024-09-10T10:18:46.737 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:46 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:46.361+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:46.737 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:46 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:46.361+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:46.737 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:46 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:46.361+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:46.737 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:46 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:46.361+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:46.738 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:46 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:46.361+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:46.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:46 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:46.493+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:46.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:46 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:46.493+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:46.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:46 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:46.493+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:46.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:46 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:46.493+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:46.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:46 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:46.493+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:46.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:46 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:46.493+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:47.430 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:47 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:47.168+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:47.430 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:47 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:47.168+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:47.430 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:47 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:47.168+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:47.430 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:47 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:47.168+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:47.430 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:47 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:47.168+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:47.430 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:47 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:47.168+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.949789+0000 front 2024-09-10T10:18:15.949989+0000 (oldest deadline 2024-09-10T10:18:39.449533+0000) 2024-09-10T10:18:47.748 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:47 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:47.382+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:47.748 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:47 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:47.382+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:47.748 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:47 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:47.382+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:47.748 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:47 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:47.382+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:47.748 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:47 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:47.382+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:47.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:47 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:47.473+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:47.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:47 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:47.473+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:47.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:47 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:47.473+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:47.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:47 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:47.473+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:47.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:47 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:47.473+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:47.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:47 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:47.473+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:48.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:48 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:48.179+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:48.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:48 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:48.179+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:48.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:48 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:48.179+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:48.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:48 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:48.179+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:48.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:48 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:48.179+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:48.466 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:48 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:48.179+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.949789+0000 front 2024-09-10T10:18:15.949989+0000 (oldest deadline 2024-09-10T10:18:39.449533+0000) 2024-09-10T10:18:48.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:48 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:48.343+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:48.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:48 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:48.343+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:48.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:48 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:48.343+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:48.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:48 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:48.343+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:48.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:48 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:48.343+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:48.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:48 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:48.434+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:48.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:48 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:48.434+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:48.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:48 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:48.434+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:48.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:48 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:48.434+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:48.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:48 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:48.434+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:48.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:48 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:48.434+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:49.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:49 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:49.167+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.243417+0000 front 2024-09-10T10:17:33.243547+0000 (oldest deadline 2024-09-10T10:17:59.143565+0000) 2024-09-10T10:18:49.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:49 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:49.167+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.144145+0000 front 2024-09-10T10:17:39.144066+0000 (oldest deadline 2024-09-10T10:18:08.544685+0000) 2024-09-10T10:18:49.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:49 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:49.167+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:50.846062+0000 front 2024-09-10T10:17:50.846007+0000 (oldest deadline 2024-09-10T10:18:16.146056+0000) 2024-09-10T10:18:49.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:49 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:49.167+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:57.846981+0000 front 2024-09-10T10:17:57.847026+0000 (oldest deadline 2024-09-10T10:18:20.747119+0000) 2024-09-10T10:18:49.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:49 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:49.167+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.148991+0000 front 2024-09-10T10:18:07.148863+0000 (oldest deadline 2024-09-10T10:18:31.248588+0000) 2024-09-10T10:18:49.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:49 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9[64607]: 2024-09-10T10:18:49.167+0000 7f3162e00640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:15.949789+0000 front 2024-09-10T10:18:15.949989+0000 (oldest deadline 2024-09-10T10:18:39.449533+0000) 2024-09-10T10:18:49.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:49 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:49.349+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:49.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:49 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:49.349+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:49.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:49 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:49.349+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:49.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:49 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:49.349+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:49.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:49 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:49.349+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:49.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:49 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:49.431+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:49.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:49 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:49.431+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:49.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:49 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:49.431+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:49.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:49 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:49.431+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:49.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:49 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:49.431+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:49.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:49 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:49.431+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:49.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:49 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:49.431+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:24.451430+0000 front 2024-09-10T10:18:24.451414+0000 (oldest deadline 2024-09-10T10:18:49.051770+0000) 2024-09-10T10:18:50.524 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:50 smithi050 podman[101724]: 2024-09-10 10:18:50.217685799 +0000 UTC m=+5.640080801 container died 704759bb9684b76fd9c1747e914344716c6402e88595552723c71eb889a15816 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:18:50.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:50 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:50.365+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:50.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:50 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:50.365+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:50.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:50 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:50.365+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:50.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:50 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:50.365+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:50.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:50 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:50.365+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:50.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:50 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:50.365+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:18:50.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:50 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:50.433+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:50.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:50 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:50.433+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:50.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:50 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:50.433+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:50.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:50 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:50.433+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:50.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:50 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:50.433+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:50.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:50 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:50.433+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:50.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:50 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:50.433+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:24.451430+0000 front 2024-09-10T10:18:24.451414+0000 (oldest deadline 2024-09-10T10:18:49.051770+0000) 2024-09-10T10:18:50.965 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:50 smithi050 podman[101724]: 2024-09-10 10:18:50.721425817 +0000 UTC m=+6.143820818 container cleanup 704759bb9684b76fd9c1747e914344716c6402e88595552723c71eb889a15816 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True) 2024-09-10T10:18:50.965 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:50 smithi050 bash[101724]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9 2024-09-10T10:18:51.465 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:50 smithi050 podman[101741]: 2024-09-10 10:18:50.994342937 +0000 UTC m=+0.759484049 container remove 704759bb9684b76fd9c1747e914344716c6402e88595552723c71eb889a15816 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:18:51.835 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:51 smithi050 podman[101830]: 2024-09-10 10:18:51.462360926 +0000 UTC m=+0.027194013 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:18:51.835 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:51 smithi050 podman[101830]: 2024-09-10 10:18:51.598755107 +0000 UTC m=+0.163588182 container create 8bac7b885dd99462a2110a0ef4ed3dfc751ba61f9cde9515d2abe412143a434f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T10:18:51.835 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:51 smithi050 podman[101830]: 2024-09-10 10:18:51.834680094 +0000 UTC m=+0.399513181 container init 8bac7b885dd99462a2110a0ef4ed3dfc751ba61f9cde9515d2abe412143a434f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T10:18:51.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:51 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:51.403+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:51.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:51 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:51.403+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:51.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:51 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:51.403+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:51.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:51 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:51.403+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:51.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:51 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:51.403+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:51.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:51 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:51.403+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:18:51.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:51 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:51.427+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:51.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:51 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:51.427+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:51.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:51 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:51.427+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:51.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:51 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:51.427+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:51.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:51 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:51.427+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:51.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:51 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:51.427+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:51.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:51 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:51.427+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:24.451430+0000 front 2024-09-10T10:18:24.451414+0000 (oldest deadline 2024-09-10T10:18:49.051770+0000) 2024-09-10T10:18:52.104 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:51 smithi050 podman[101830]: 2024-09-10 10:18:51.841696939 +0000 UTC m=+0.406530024 container start 8bac7b885dd99462a2110a0ef4ed3dfc751ba61f9cde9515d2abe412143a434f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:18:52.104 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:51 smithi050 podman[101830]: 2024-09-10 10:18:51.959224675 +0000 UTC m=+0.524057765 container attach 8bac7b885dd99462a2110a0ef4ed3dfc751ba61f9cde9515d2abe412143a434f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:18:52.105 INFO:journalctl@ceph.osd.9.smithi050.stdout:Sep 10 10:18:52 smithi050 podman[101830]: 2024-09-10 10:18:52.103836436 +0000 UTC m=+0.668669513 container died 8bac7b885dd99462a2110a0ef4ed3dfc751ba61f9cde9515d2abe412143a434f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T10:18:52.835 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:52 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:52.446+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:52.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:52 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:52.446+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:52.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:52 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:52.446+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:52.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:52 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:52.446+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:52.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:52 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:52.446+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:52.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:52 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:52.446+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:18:52.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:52 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:52.413+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:52.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:52 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:52.413+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:52.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:52 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:52.413+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:52.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:52 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:52.413+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:52.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:52 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:52.413+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:52.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:52 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:52.413+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:52.850 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:52 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:52.413+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:24.451430+0000 front 2024-09-10T10:18:24.451414+0000 (oldest deadline 2024-09-10T10:18:49.051770+0000) 2024-09-10T10:18:52.854 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T10:18:52.931 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:18:52.931 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T10:18:52.931 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T10:18:52.932 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.10 2024-09-10T10:18:53.257 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:52 smithi084 systemd[1]: Stopping Ceph osd.10 for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:18:53.257 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:53 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:53.255+0000 7fbacfcfe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:18:53.258 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:53 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:53.255+0000 7fbacfcfe640 -1 osd.10 99 *** Got signal Terminated *** 2024-09-10T10:18:53.258 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:53 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:53.255+0000 7fbacfcfe640 -1 osd.10 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:18:53.599 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:53 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:53.389+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:53.600 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:53 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:53.389+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:53.600 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:53 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:53.389+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:53.600 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:53 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:53.389+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:53.600 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:53 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:53.389+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:53.600 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:53 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:53.389+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:53.600 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:53 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:53.389+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:24.451430+0000 front 2024-09-10T10:18:24.451414+0000 (oldest deadline 2024-09-10T10:18:49.051770+0000) 2024-09-10T10:18:53.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:53 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:53.413+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:53.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:53 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:53.413+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:53.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:53 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:53.413+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:53.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:53 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:53.413+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:53.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:53 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:53.413+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:53.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:53 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:53.413+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:18:54.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:54 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:54.370+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:54.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:54 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:54.370+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:54.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:54 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:54.370+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:54.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:54 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:54.371+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:54.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:54 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:54.371+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:54.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:54 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:54.371+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:18:54.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:54 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:54.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:54.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:54 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:54.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:54.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:54 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:54.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:54.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:54 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:54.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:54.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:54 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:54.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:54.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:54 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:54.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:54.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:54 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:54.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:24.451430+0000 front 2024-09-10T10:18:24.451414+0000 (oldest deadline 2024-09-10T10:18:49.051770+0000) 2024-09-10T10:18:55.804 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:55 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:55.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:55.804 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:55 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:55.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:55.804 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:55 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:55.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:55.804 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:55 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:55.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:55.804 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:55 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:55.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:55.804 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:55 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:55.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:55.804 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:55 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:55.401+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:24.451430+0000 front 2024-09-10T10:18:24.451414+0000 (oldest deadline 2024-09-10T10:18:49.051770+0000) 2024-09-10T10:18:55.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:55 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:55.408+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:55.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:55 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:55.408+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:55.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:55 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:55.408+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:55.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:55 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:55.408+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:55.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:55 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:55.408+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:55.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:55 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:55.408+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:18:56.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:56 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:56.454+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:56.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:56 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:56.454+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:56.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:56 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:56.454+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:56.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:56 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:56.454+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:56.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:56 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:56.454+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:56.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:56 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:56.454+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:18:56.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:56 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:56.454+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-09-10T10:18:30.123772+0000 front 2024-09-10T10:18:30.123716+0000 (oldest deadline 2024-09-10T10:18:56.023499+0000) 2024-09-10T10:18:56.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:56 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:56.377+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:56.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:56 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:56.377+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:56.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:56 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:56.377+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:56.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:56 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:56.377+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:56.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:56 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:56.377+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:56.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:56 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:56.377+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:56.849 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:56 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:56.377+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:24.451430+0000 front 2024-09-10T10:18:24.451414+0000 (oldest deadline 2024-09-10T10:18:49.051770+0000) 2024-09-10T10:18:57.379 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:57 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:57.376+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:34.443852+0000 front 2024-09-10T10:17:34.443904+0000 (oldest deadline 2024-09-10T10:17:59.743731+0000) 2024-09-10T10:18:57.379 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:57 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:57.376+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:39.744036+0000 front 2024-09-10T10:17:39.744129+0000 (oldest deadline 2024-09-10T10:18:05.644120+0000) 2024-09-10T10:18:57.379 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:57 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:57.376+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.545246+0000 front 2024-09-10T10:17:51.545164+0000 (oldest deadline 2024-09-10T10:18:13.845162+0000) 2024-09-10T10:18:57.379 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:57 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:57.376+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-09-10T10:17:56.046653+0000 front 2024-09-10T10:17:56.046641+0000 (oldest deadline 2024-09-10T10:18:21.346551+0000) 2024-09-10T10:18:57.379 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:57 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:57.376+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:07.648333+0000 front 2024-09-10T10:18:07.648393+0000 (oldest deadline 2024-09-10T10:18:32.348521+0000) 2024-09-10T10:18:57.380 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:57 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:57.376+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:14.649689+0000 front 2024-09-10T10:18:14.649745+0000 (oldest deadline 2024-09-10T10:18:38.749526+0000) 2024-09-10T10:18:57.380 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:57 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10[59239]: 2024-09-10T10:18:57.376+0000 7fbac830c640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:24.451430+0000 front 2024-09-10T10:18:24.451414+0000 (oldest deadline 2024-09-10T10:18:49.051770+0000) 2024-09-10T10:18:57.789 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:57 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:57.451+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:57.789 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:57 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:57.451+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:57.789 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:57 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:57.451+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:57.789 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:57 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:57.451+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:57.789 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:57 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:57.451+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:57.789 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:57 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:57.451+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:18:57.790 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:57 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:57.451+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-09-10T10:18:30.123772+0000 front 2024-09-10T10:18:30.123716+0000 (oldest deadline 2024-09-10T10:18:56.023499+0000) 2024-09-10T10:18:58.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:58 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:58.437+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:58.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:58 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:58.437+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:58.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:58 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:58.437+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:58.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:58 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:58.437+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:58.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:58 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:58.437+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:58.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:58 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:58.437+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:18:58.837 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:58 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:58.437+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-09-10T10:18:30.123772+0000 front 2024-09-10T10:18:30.123716+0000 (oldest deadline 2024-09-10T10:18:56.023499+0000) 2024-09-10T10:18:58.848 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:58 smithi084 podman[68591]: 2024-09-10 10:18:58.579382208 +0000 UTC m=+5.451253803 container died f66ccadf83e8767c1dde2c2805f8b12d5a4d74bc22986ca4e57538556b479e24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T10:18:59.099 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:58 smithi084 podman[68591]: 2024-09-10 10:18:58.938869325 +0000 UTC m=+5.810740927 container cleanup f66ccadf83e8767c1dde2c2805f8b12d5a4d74bc22986ca4e57538556b479e24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0) 2024-09-10T10:18:59.099 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:58 smithi084 bash[68591]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10 2024-09-10T10:18:59.554 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:59 smithi084 podman[68607]: 2024-09-10 10:18:59.231745581 +0000 UTC m=+0.648449064 container remove f66ccadf83e8767c1dde2c2805f8b12d5a4d74bc22986ca4e57538556b479e24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=) 2024-09-10T10:18:59.835 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:59 smithi084 podman[68700]: 2024-09-10 10:18:59.456205579 +0000 UTC m=+0.015706419 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:18:59.836 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:59 smithi084 podman[68700]: 2024-09-10 10:18:59.607582092 +0000 UTC m=+0.167082977 container create 30f772a0c7cc2869ef4099ef72f26e78156f15d8604f6343a459eb56e2fbd098 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T10:18:59.836 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:59 smithi084 podman[68700]: 2024-09-10 10:18:59.834819691 +0000 UTC m=+0.394320540 container init 30f772a0c7cc2869ef4099ef72f26e78156f15d8604f6343a459eb56e2fbd098 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T10:18:59.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:59 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:59.398+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:18:59.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:59 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:59.398+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:18:59.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:59 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:59.398+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:18:59.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:59 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:59.398+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:18:59.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:59 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:59.398+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:18:59.837 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:59 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:59.398+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:18:59.837 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:18:59 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:18:59.398+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-09-10T10:18:30.123772+0000 front 2024-09-10T10:18:30.123716+0000 (oldest deadline 2024-09-10T10:18:56.023499+0000) 2024-09-10T10:19:00.099 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:59 smithi084 podman[68700]: 2024-09-10 10:18:59.838292913 +0000 UTC m=+0.397793755 container start 30f772a0c7cc2869ef4099ef72f26e78156f15d8604f6343a459eb56e2fbd098 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:19:00.099 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:18:59 smithi084 podman[68700]: 2024-09-10 10:18:59.917998285 +0000 UTC m=+0.477499125 container attach 30f772a0c7cc2869ef4099ef72f26e78156f15d8604f6343a459eb56e2fbd098 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T10:19:00.099 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:19:00 smithi084 podman[68700]: 2024-09-10 10:19:00.026993875 +0000 UTC m=+0.586494717 container died 30f772a0c7cc2869ef4099ef72f26e78156f15d8604f6343a459eb56e2fbd098 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T10:19:00.578 INFO:journalctl@ceph.osd.10.smithi084.stdout:Sep 10 10:19:00 smithi084 podman[68723]: 2024-09-10 10:19:00.554432415 +0000 UTC m=+0.521898312 container remove 30f772a0c7cc2869ef4099ef72f26e78156f15d8604f6343a459eb56e2fbd098 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T10:19:00.583 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T10:19:00.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:00.623 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T10:19:00.623 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T10:19:00.623 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.11 2024-09-10T10:19:00.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:00 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:00.419+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:19:00.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:00 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:00.419+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:19:00.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:00 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:00.419+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:19:00.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:00 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:00.419+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:19:00.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:00 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:00.419+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:19:00.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:00 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:00.419+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:19:00.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:00 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:00.419+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-09-10T10:18:30.123772+0000 front 2024-09-10T10:18:30.123716+0000 (oldest deadline 2024-09-10T10:18:56.023499+0000) 2024-09-10T10:19:00.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:00 smithi189 systemd[1]: Stopping Ceph osd.11 for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:19:01.335 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:00 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:00.921+0000 7fae9d629640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:19:01.335 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:00 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:00.921+0000 7fae9d629640 -1 osd.11 99 *** Got signal Terminated *** 2024-09-10T10:19:01.336 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:00 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:00.921+0000 7fae9d629640 -1 osd.11 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:19:01.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:01.370+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:19:01.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:01.370+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:19:01.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:01.370+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:19:01.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:01.370+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:19:01.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:01.370+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:19:01.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:01.370+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:19:01.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:01 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:01.370+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-09-10T10:18:30.123772+0000 front 2024-09-10T10:18:30.123716+0000 (oldest deadline 2024-09-10T10:18:56.023499+0000) 2024-09-10T10:19:02.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:02 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:02.386+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:19:02.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:02 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:02.386+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:19:02.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:02 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:02.386+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:19:02.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:02 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:02.386+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:19:02.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:02 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:02.386+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:19:02.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:02 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:02.386+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:19:02.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:02 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:02.386+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-09-10T10:18:30.123772+0000 front 2024-09-10T10:18:30.123716+0000 (oldest deadline 2024-09-10T10:18:56.023499+0000) 2024-09-10T10:19:03.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:03 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:03.363+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:19:03.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:03 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:03.363+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:19:03.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:03 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:03.363+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:19:03.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:03 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:03.363+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:19:03.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:03 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:03.363+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:19:03.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:03 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:03.363+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:19:03.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:03 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:03.363+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-09-10T10:18:30.123772+0000 front 2024-09-10T10:18:30.123716+0000 (oldest deadline 2024-09-10T10:18:56.023499+0000) 2024-09-10T10:19:04.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:04.394+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:19:04.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:04.394+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:19:04.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:04.394+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:19:04.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:04.394+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:19:04.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:04.394+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:19:04.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:04.394+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:19:04.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:04 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:04.394+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-09-10T10:18:30.123772+0000 front 2024-09-10T10:18:30.123716+0000 (oldest deadline 2024-09-10T10:18:56.023499+0000) 2024-09-10T10:19:05.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:05.439+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-09-10T10:17:33.815472+0000 front 2024-09-10T10:17:33.815429+0000 (oldest deadline 2024-09-10T10:17:57.915206+0000) 2024-09-10T10:19:05.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:05.439+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-09-10T10:17:42.516503+0000 front 2024-09-10T10:17:42.516672+0000 (oldest deadline 2024-09-10T10:18:06.016481+0000) 2024-09-10T10:19:05.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:05.439+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T10:17:51.217693+0000 front 2024-09-10T10:17:51.217753+0000 (oldest deadline 2024-09-10T10:18:17.117884+0000) 2024-09-10T10:19:05.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:05.439+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-09-10T10:18:05.720032+0000 front 2024-09-10T10:18:05.720217+0000 (oldest deadline 2024-09-10T10:18:29.819917+0000) 2024-09-10T10:19:05.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:05.439+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T10:18:13.821203+0000 front 2024-09-10T10:18:13.821150+0000 (oldest deadline 2024-09-10T10:18:38.521258+0000) 2024-09-10T10:19:05.836 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:05.439+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-09-10T10:18:20.822331+0000 front 2024-09-10T10:18:20.822299+0000 (oldest deadline 2024-09-10T10:18:49.622725+0000) 2024-09-10T10:19:05.837 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:05.439+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-09-10T10:18:30.123772+0000 front 2024-09-10T10:18:30.123716+0000 (oldest deadline 2024-09-10T10:18:56.023499+0000) 2024-09-10T10:19:05.837 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:05 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11[60051]: 2024-09-10T10:19:05.439+0000 7fae99c3f640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.189:6820 osd.8 since back 2024-09-10T10:18:40.124161+0000 front 2024-09-10T10:18:40.124205+0000 (oldest deadline 2024-09-10T10:19:05.424213+0000) 2024-09-10T10:19:06.738 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:06 smithi189 podman[69455]: 2024-09-10 10:19:06.462896072 +0000 UTC m=+5.645920290 container died 9c0c635d2c339692a4a9c90dcc31a0561849f9208279bcfeee53549d7cbf8505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T10:19:07.086 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:06 smithi189 podman[69455]: 2024-09-10 10:19:06.819905095 +0000 UTC m=+6.002929313 container cleanup 9c0c635d2c339692a4a9c90dcc31a0561849f9208279bcfeee53549d7cbf8505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:19:07.086 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:06 smithi189 bash[69455]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11 2024-09-10T10:19:07.450 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:07 smithi189 podman[69469]: 2024-09-10 10:19:07.096309151 +0000 UTC m=+0.630408839 container remove 9c0c635d2c339692a4a9c90dcc31a0561849f9208279bcfeee53549d7cbf8505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T10:19:07.767 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:07 smithi189 podman[69557]: 2024-09-10 10:19:07.352439273 +0000 UTC m=+0.015861290 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:19:07.767 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:07 smithi189 podman[69557]: 2024-09-10 10:19:07.455360679 +0000 UTC m=+0.118782754 container create ee762d347ff16b35aeb6ba35f651bcad81c69bdc1160b8a17412553e0bd82eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-10T10:19:07.767 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:07 smithi189 podman[69557]: 2024-09-10 10:19:07.682877306 +0000 UTC m=+0.346299310 container init ee762d347ff16b35aeb6ba35f651bcad81c69bdc1160b8a17412553e0bd82eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:19:07.767 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:07 smithi189 podman[69557]: 2024-09-10 10:19:07.686011182 +0000 UTC m=+0.349433189 container start ee762d347ff16b35aeb6ba35f651bcad81c69bdc1160b8a17412553e0bd82eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:19:07.767 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:07 smithi189 podman[69557]: 2024-09-10 10:19:07.766020168 +0000 UTC m=+0.429442185 container attach ee762d347ff16b35aeb6ba35f651bcad81c69bdc1160b8a17412553e0bd82eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:19:08.086 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 10:19:07 smithi189 podman[69557]: 2024-09-10 10:19:07.873093861 +0000 UTC m=+0.536515865 container died ee762d347ff16b35aeb6ba35f651bcad81c69bdc1160b8a17412553e0bd82eb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True) 2024-09-10T10:19:08.472 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T10:19:08.513 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:08.514 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T10:19:08.514 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T10:19:08.514 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.a 2024-09-10T10:19:08.951 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:19:08 smithi050 systemd[1]: Stopping Ceph mds.a for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:19:09.215 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:19:08 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-a[71628]: 2024-09-10T10:19:08.948+0000 7fae84400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:19:09.215 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:19:08 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-a[71628]: 2024-09-10T10:19:08.948+0000 7fae84400640 -1 mds.a *** got signal Terminated *** 2024-09-10T10:19:13.258 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:19:12 smithi050 podman[101929]: 2024-09-10 10:19:12.967327404 +0000 UTC m=+4.153032592 container died cb2b790deed878ffd406b948a6ac57cb415d758262bcabc78431383b320039ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T10:19:13.520 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:19:13 smithi050 podman[101929]: 2024-09-10 10:19:13.497659819 +0000 UTC m=+4.683365043 container cleanup cb2b790deed878ffd406b948a6ac57cb415d758262bcabc78431383b320039ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T10:19:13.521 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:19:13 smithi050 bash[101929]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-a 2024-09-10T10:19:13.965 INFO:journalctl@ceph.mds.a.smithi050.stdout:Sep 10 10:19:13 smithi050 podman[101952]: 2024-09-10 10:19:13.715719001 +0000 UTC m=+0.735233025 container remove cb2b790deed878ffd406b948a6ac57cb415d758262bcabc78431383b320039ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-a, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:19:14.006 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T10:19:14.080 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:14.080 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T10:19:14.081 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T10:19:14.081 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.d 2024-09-10T10:19:14.465 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:19:14 smithi050 systemd[1]: Stopping Ceph mds.d for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:19:14.965 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:19:14 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-d[70457]: 2024-09-10T10:19:14.554+0000 7eff82c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:19:14.965 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:19:14 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-d[70457]: 2024-09-10T10:19:14.554+0000 7eff82c00640 -1 mds.d *** got signal Terminated *** 2024-09-10T10:19:15.965 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:19:15 smithi050 podman[102061]: 2024-09-10 10:19:15.68500318 +0000 UTC m=+1.326016286 container died 4a0d96b64f6aaba94a685ff2736ce31215d214da18a268e0a915f0d3783de17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:19:16.236 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:19:16 smithi050 podman[102061]: 2024-09-10 10:19:16.210434488 +0000 UTC m=+1.851447594 container cleanup 4a0d96b64f6aaba94a685ff2736ce31215d214da18a268e0a915f0d3783de17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T10:19:16.236 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:19:16 smithi050 bash[102061]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-d 2024-09-10T10:19:16.711 INFO:journalctl@ceph.mds.d.smithi050.stdout:Sep 10 10:19:16 smithi050 podman[102073]: 2024-09-10 10:19:16.444804755 +0000 UTC m=+0.745921542 container remove 4a0d96b64f6aaba94a685ff2736ce31215d214da18a268e0a915f0d3783de17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T10:19:16.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T10:19:16.791 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:16.791 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T10:19:16.791 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T10:19:16.792 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.g 2024-09-10T10:19:16.965 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:19:16 smithi050 systemd[1]: Stopping Ceph mds.g for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:19:17.715 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:19:17 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-g[71261]: 2024-09-10T10:19:17.216+0000 7f636e000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:19:17.715 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:19:17 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-g[71261]: 2024-09-10T10:19:17.216+0000 7f636e000640 -1 mds.g *** got signal Terminated *** 2024-09-10T10:19:21.143 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:19:20 smithi050 podman[102184]: 2024-09-10 10:19:20.840803853 +0000 UTC m=+3.738061571 container died 970e8319604afe9f965c13df2eed600fea7bfbe453b77738b9200c8192940e20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T10:19:21.465 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:19:21 smithi050 podman[102184]: 2024-09-10 10:19:21.330740787 +0000 UTC m=+4.227998493 container cleanup 970e8319604afe9f965c13df2eed600fea7bfbe453b77738b9200c8192940e20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T10:19:21.465 INFO:journalctl@ceph.mds.g.smithi050.stdout:Sep 10 10:19:21 smithi050 bash[102184]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-g 2024-09-10T10:19:21.840 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T10:19:21.912 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:21.912 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T10:19:21.912 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T10:19:21.913 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.j 2024-09-10T10:19:22.347 INFO:journalctl@ceph.mds.j.smithi050.stdout:Sep 10 10:19:22 smithi050 systemd[1]: Stopping Ceph mds.j for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:19:22.715 INFO:journalctl@ceph.mds.j.smithi050.stdout:Sep 10 10:19:22 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-j[70079]: 2024-09-10T10:19:22.345+0000 7fbbc8c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:19:22.715 INFO:journalctl@ceph.mds.j.smithi050.stdout:Sep 10 10:19:22 smithi050 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-j[70079]: 2024-09-10T10:19:22.345+0000 7fbbc8c00640 -1 mds.j *** got signal Terminated *** 2024-09-10T10:19:23.812 INFO:journalctl@ceph.mds.j.smithi050.stdout:Sep 10 10:19:23 smithi050 podman[102304]: 2024-09-10 10:19:23.51951036 +0000 UTC m=+1.287491448 container died f2e0655ccc56e4439b41fe7691e31194ebe340532ae82c2daefcf82930259c86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T10:19:24.215 INFO:journalctl@ceph.mds.j.smithi050.stdout:Sep 10 10:19:24 smithi050 podman[102304]: 2024-09-10 10:19:24.009840558 +0000 UTC m=+1.777821646 container cleanup f2e0655ccc56e4439b41fe7691e31194ebe340532ae82c2daefcf82930259c86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux ) 2024-09-10T10:19:24.215 INFO:journalctl@ceph.mds.j.smithi050.stdout:Sep 10 10:19:24 smithi050 bash[102304]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-j 2024-09-10T10:19:24.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T10:19:24.504 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:24.504 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T10:19:24.504 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T10:19:24.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.b 2024-09-10T10:19:24.805 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:19:24 smithi084 systemd[1]: Stopping Ceph mds.b for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:19:25.059 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:19:24 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-b[64500]: 2024-09-10T10:19:24.803+0000 7f6e65386640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:19:25.059 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:19:24 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-b[64500]: 2024-09-10T10:19:24.803+0000 7f6e65386640 -1 mds.b *** got signal Terminated *** 2024-09-10T10:19:28.446 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:19:28 smithi084 podman[68802]: 2024-09-10 10:19:28.13338247 +0000 UTC m=+3.437805383 container died 2b5c730304654e6e6689df9a1b823348ab1de11db6209372eae7a54906bebd3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:19:28.779 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:19:28 smithi084 podman[68802]: 2024-09-10 10:19:28.53641144 +0000 UTC m=+3.840834366 container cleanup 2b5c730304654e6e6689df9a1b823348ab1de11db6209372eae7a54906bebd3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-b, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T10:19:28.780 INFO:journalctl@ceph.mds.b.smithi084.stdout:Sep 10 10:19:28 smithi084 bash[68802]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-b 2024-09-10T10:19:28.911 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T10:19:28.947 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:28.947 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T10:19:28.947 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T10:19:28.947 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.e 2024-09-10T10:19:29.099 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:19:29 smithi084 systemd[1]: Stopping Ceph mds.e for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:19:29.599 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:19:29 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-e[63877]: 2024-09-10T10:19:29.265+0000 7f4658972640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:19:29.599 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:19:29 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-e[63877]: 2024-09-10T10:19:29.265+0000 7f4658972640 -1 mds.e *** got signal Terminated *** 2024-09-10T10:19:32.416 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:19:32 smithi084 podman[68935]: 2024-09-10 10:19:32.131003224 +0000 UTC m=+2.967097036 container died cd4cd5f71aa4c7c8b1e1a7c090f44d094b063bbd8c03eca55df6171cd06ff536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-e, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T10:19:32.758 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:19:32 smithi084 podman[68935]: 2024-09-10 10:19:32.489311699 +0000 UTC m=+3.325405511 container cleanup cd4cd5f71aa4c7c8b1e1a7c090f44d094b063bbd8c03eca55df6171cd06ff536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-e, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-09-10T10:19:32.758 INFO:journalctl@ceph.mds.e.smithi084.stdout:Sep 10 10:19:32 smithi084 bash[68935]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-e 2024-09-10T10:19:32.916 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T10:19:32.949 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:32.950 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T10:19:32.950 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T10:19:32.950 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.h 2024-09-10T10:19:33.277 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:19:33 smithi084 systemd[1]: Stopping Ceph mds.h for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:19:33.599 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:19:33 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-h[64196]: 2024-09-10T10:19:33.276+0000 7f03c405a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:19:33.599 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:19:33 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-h[64196]: 2024-09-10T10:19:33.276+0000 7f03c405a640 -1 mds.h *** got signal Terminated *** 2024-09-10T10:19:36.349 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:19:36 smithi084 podman[69057]: 2024-09-10 10:19:36.130161107 +0000 UTC m=+2.964623662 container died 8d1a72c7201873a74fd4d45391aaf7eee1947e3799c66966789d4565ca094322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T10:19:36.777 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:19:36 smithi084 podman[69057]: 2024-09-10 10:19:36.509371275 +0000 UTC m=+3.343833827 container cleanup 8d1a72c7201873a74fd4d45391aaf7eee1947e3799c66966789d4565ca094322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:19:36.777 INFO:journalctl@ceph.mds.h.smithi084.stdout:Sep 10 10:19:36 smithi084 bash[69057]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-h 2024-09-10T10:19:36.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T10:19:36.960 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:36.961 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T10:19:36.961 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T10:19:36.961 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.k 2024-09-10T10:19:37.349 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:19:37 smithi084 systemd[1]: Stopping Ceph mds.k for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:19:37.349 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:19:37 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-k[63563]: 2024-09-10T10:19:37.279+0000 7fbd8bb80640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:19:37.349 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:19:37 smithi084 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-k[63563]: 2024-09-10T10:19:37.279+0000 7fbd8bb80640 -1 mds.k *** got signal Terminated *** 2024-09-10T10:19:39.971 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:19:39 smithi084 podman[69180]: 2024-09-10 10:19:39.696154141 +0000 UTC m=+2.525082205 container died 793e42c7ded8c55964e006e2e5504e2d672d74c515a479c7e58b9e55e9fd0b8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:19:40.331 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:19:40 smithi084 podman[69180]: 2024-09-10 10:19:40.062831127 +0000 UTC m=+2.891759192 container cleanup 793e42c7ded8c55964e006e2e5504e2d672d74c515a479c7e58b9e55e9fd0b8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T10:19:40.331 INFO:journalctl@ceph.mds.k.smithi084.stdout:Sep 10 10:19:40 smithi084 bash[69180]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-k 2024-09-10T10:19:40.488 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T10:19:40.519 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:40.520 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T10:19:40.520 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T10:19:40.520 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.c 2024-09-10T10:19:40.821 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:19:40 smithi189 systemd[1]: Stopping Ceph mds.c for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:19:41.085 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:19:40 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-c[64971]: 2024-09-10T10:19:40.819+0000 7fba9be54640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:19:41.085 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:19:40 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-c[64971]: 2024-09-10T10:19:40.819+0000 7fba9be54640 -1 mds.c *** got signal Terminated *** 2024-09-10T10:19:44.412 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:19:44 smithi189 podman[69659]: 2024-09-10 10:19:44.124176962 +0000 UTC m=+3.409316886 container died 625cc29b25b5d6932153161ae51cc0817149797c70df05eca072b7463e32d097 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True) 2024-09-10T10:19:44.753 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:19:44 smithi189 podman[69659]: 2024-09-10 10:19:44.493573876 +0000 UTC m=+3.778713799 container cleanup 625cc29b25b5d6932153161ae51cc0817149797c70df05eca072b7463e32d097 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-c, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T10:19:44.753 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 10:19:44 smithi189 bash[69659]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-c 2024-09-10T10:19:44.895 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T10:19:44.931 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:44.932 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T10:19:44.932 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T10:19:44.932 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.f 2024-09-10T10:19:45.335 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 10:19:45 smithi189 systemd[1]: Stopping Ceph mds.f for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:19:45.336 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 10:19:45 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-f[64669]: 2024-09-10T10:19:45.254+0000 7f86579f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:19:45.336 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 10:19:45 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-f[64669]: 2024-09-10T10:19:45.254+0000 7f86579f2640 -1 mds.f *** got signal Terminated *** 2024-09-10T10:19:48.416 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 10:19:48 smithi189 podman[69795]: 2024-09-10 10:19:48.142608354 +0000 UTC m=+2.987932337 container died b680c43c86faea16b24e099c362ec63523c46538c082fa1fe7b52929e8671782 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-f, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T10:19:48.782 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 10:19:48 smithi189 podman[69795]: 2024-09-10 10:19:48.522162931 +0000 UTC m=+3.367486911 container cleanup b680c43c86faea16b24e099c362ec63523c46538c082fa1fe7b52929e8671782 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-f, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-10T10:19:48.782 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 10:19:48 smithi189 bash[69795]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-f 2024-09-10T10:19:48.954 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T10:19:48.988 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:48.989 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T10:19:48.989 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T10:19:48.989 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.i 2024-09-10T10:19:49.327 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 10:19:49 smithi189 systemd[1]: Stopping Ceph mds.i for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:19:49.585 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 10:19:49 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-i[65271]: 2024-09-10T10:19:49.325+0000 7f3053e1e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:19:49.585 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 10:19:49 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-i[65271]: 2024-09-10T10:19:49.325+0000 7f3053e1e640 -1 mds.i *** got signal Terminated *** 2024-09-10T10:19:52.411 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 10:19:52 smithi189 podman[69919]: 2024-09-10 10:19:52.137683922 +0000 UTC m=+2.932207333 container died a211da92b4c8502bd5d539cecedfb2dbebe9b05952d95f2f1fb4b055533db47f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T10:19:52.761 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 10:19:52 smithi189 podman[69919]: 2024-09-10 10:19:52.518135756 +0000 UTC m=+3.312659166 container cleanup a211da92b4c8502bd5d539cecedfb2dbebe9b05952d95f2f1fb4b055533db47f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:19:52.761 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 10:19:52 smithi189 bash[69919]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-i 2024-09-10T10:19:52.900 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T10:19:52.933 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:52.933 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T10:19:52.933 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T10:19:52.933 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.l 2024-09-10T10:19:53.335 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:19:53 smithi189 systemd[1]: Stopping Ceph mds.l for 4d54e0f8-6f5b-11ef-bcea-c7b262605968... 2024-09-10T10:19:53.335 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:19:53 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-l[64367]: 2024-09-10T10:19:53.254+0000 7f4685f6d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:19:53.336 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:19:53 smithi189 ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-l[64367]: 2024-09-10T10:19:53.254+0000 7f4685f6d640 -1 mds.l *** got signal Terminated *** 2024-09-10T10:19:57.239 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:19:56 smithi189 podman[70039]: 2024-09-10 10:19:56.858146295 +0000 UTC m=+3.708139124 container died 79b51ac0a5d9b7c5b710d16e57c155f50bf5ea44b545207c46a2bcc53cd1cff1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:19:57.585 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:19:57 smithi189 podman[70039]: 2024-09-10 10:19:57.321730144 +0000 UTC m=+4.171722971 container cleanup 79b51ac0a5d9b7c5b710d16e57c155f50bf5ea44b545207c46a2bcc53cd1cff1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T10:19:57.586 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 10:19:57 smithi189 bash[70039]: ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968-mds-l 2024-09-10T10:19:57.743 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4d54e0f8-6f5b-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T10:19:57.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:19:57.776 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T10:19:57.776 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T10:19:58.059 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:20:02.165 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T10:20:02.369 INFO:teuthology.orchestra.run.smithi084.stdout:Deleting cluster with fsid: 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:20:04.764 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T10:20:04.970 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:20:07.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:20:07.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:20:07.591 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:20:07.619 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T10:20:07.621 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899012/remote/smithi050/crash 2024-09-10T10:20:07.622 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/crash -- . 2024-09-10T10:20:07.690 INFO:teuthology.orchestra.run.smithi050.stderr:tar: /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T10:20:07.690 INFO:teuthology.orchestra.run.smithi050.stderr:tar: Error is not recoverable: exiting now 2024-09-10T10:20:07.693 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899012/remote/smithi084/crash 2024-09-10T10:20:07.694 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/crash -- . 2024-09-10T10:20:07.754 INFO:teuthology.orchestra.run.smithi084.stderr:tar: /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T10:20:07.755 INFO:teuthology.orchestra.run.smithi084.stderr:tar: Error is not recoverable: exiting now 2024-09-10T10:20:07.757 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899012/remote/smithi189/crash 2024-09-10T10:20:07.758 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/crash -- . 2024-09-10T10:20:07.793 INFO:teuthology.orchestra.run.smithi189.stderr:tar: /var/lib/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T10:20:07.793 INFO:teuthology.orchestra.run.smithi189.stderr:tar: Error is not recoverable: exiting now 2024-09-10T10:20:07.795 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T10:20:07.795 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T10:20:07.878 INFO:tasks.cephadm:Compressing logs... 2024-09-10T10:20:07.878 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T10:20:07.882 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T10:20:07.885 DEBUG:teuthology.orchestra.run.smithi189:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T10:20:07.910 INFO:teuthology.orchestra.run.smithi189.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T10:20:07.910 INFO:teuthology.orchestra.run.smithi189.stderr:: No such file or directory 2024-09-10T10:20:07.910 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T10:20:07.911 INFO:teuthology.orchestra.run.smithi189.stderr:gzip/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-volume.log: -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-10T10:20:07.911 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T10:20:07.911 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T10:20:07.911 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T10:20:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T10:20:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T10:20:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T10:20:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T10:20:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T10:20:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T10:20:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T10:20:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T10:20:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T10:20:07.916 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T10:20:07.916 INFO:teuthology.orchestra.run.smithi189.stderr: 81.9% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T10:20:07.916 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T10:20:07.917 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.log 2024-09-10T10:20:07.917 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T10:20:07.917 INFO:teuthology.orchestra.run.smithi189.stderr: 90.3% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T10:20:07.917 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T10:20:07.917 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.l.log: 86.6% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T10:20:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.4.log: /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T10:20:07.918 INFO:teuthology.orchestra.run.smithi084.stderr: 94.6%gzip -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.k.log.gz -5 2024-09-10T10:20:07.919 INFO:teuthology.orchestra.run.smithi084.stderr: --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T10:20:07.919 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T10:20:07.919 INFO:teuthology.orchestra.run.smithi189.stderr: 94.7% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T10:20:07.919 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T10:20:07.920 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T10:20:07.920 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.log 2024-09-10T10:20:07.920 INFO:teuthology.orchestra.run.smithi084.stderr: 81.9% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T10:20:07.922 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T10:20:07.923 INFO:teuthology.orchestra.run.smithi189.stderr: 92.7% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T10:20:07.925 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mgr.y.log: 92.6% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T10:20:07.925 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T10:20:07.928 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T10:20:07.929 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T10:20:07.929 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.log: /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.h.log: 91.0% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T10:20:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T10:20:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mon.b.log: 86.6% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T10:20:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T10:20:07.932 INFO:teuthology.orchestra.run.smithi050.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T10:20:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-10T10:20:07.933 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T10:20:07.934 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T10:20:07.935 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T10:20:07.935 INFO:teuthology.orchestra.run.smithi050.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-10T10:20:07.936 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T10:20:07.937 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T10:20:07.938 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T10:20:07.939 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T10:20:07.940 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T10:20:07.941 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T10:20:07.941 INFO:teuthology.orchestra.run.smithi050.stderr: 82.3% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T10:20:07.941 INFO:teuthology.orchestra.run.smithi050.stderr: 90.1% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T10:20:07.942 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T10:20:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.g.log: 94.7% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T10:20:07.943 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.log 2024-09-10T10:20:07.945 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T10:20:07.946 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T10:20:07.947 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T10:20:07.947 INFO:teuthology.orchestra.run.smithi050.stderr: 94.7% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T10:20:07.948 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T10:20:07.949 INFO:teuthology.orchestra.run.smithi050.stderr: 86.6% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T10:20:07.951 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mgr.x.log: 90.9% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T10:20:07.952 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T10:20:07.953 INFO:teuthology.orchestra.run.smithi050.stderr: 94.6% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T10:20:07.953 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T10:20:07.956 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T10:20:07.958 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T10:20:07.968 INFO:teuthology.orchestra.run.smithi050.stderr: 94.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T10:20:07.970 INFO:teuthology.orchestra.run.smithi189.stderr: 92.4% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T10:20:07.979 INFO:teuthology.orchestra.run.smithi084.stderr: 94.3% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T10:20:07.990 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T10:20:07.991 INFO:teuthology.orchestra.run.smithi189.stderr: 94.2% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T10:20:07.993 INFO:teuthology.orchestra.run.smithi189.stderr: 93.5% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T10:20:08.125 INFO:teuthology.orchestra.run.smithi050.stderr: 90.2% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T10:20:08.183 INFO:teuthology.orchestra.run.smithi084.stderr: 91.4% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T10:20:08.193 INFO:teuthology.orchestra.run.smithi189.stderr: 91.6% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T10:20:08.325 INFO:teuthology.orchestra.run.smithi084.stderr: 92.9% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T10:20:08.996 INFO:teuthology.orchestra.run.smithi050.stderr: 90.4% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T10:20:11.619 INFO:teuthology.orchestra.run.smithi084.stderr: 92.9% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T10:20:11.635 INFO:teuthology.orchestra.run.smithi189.stderr: 92.8% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T10:20:11.704 INFO:teuthology.orchestra.run.smithi189.stderr: 93.0% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T10:20:12.902 INFO:teuthology.orchestra.run.smithi189.stderr: 92.8% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T10:20:13.100 INFO:teuthology.orchestra.run.smithi084.stderr: 92.9% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T10:20:13.113 INFO:teuthology.orchestra.run.smithi084.stderr: 92.9% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T10:20:13.361 INFO:teuthology.orchestra.run.smithi050.stderr: 92.9% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T10:20:13.850 INFO:teuthology.orchestra.run.smithi050.stderr: 92.9% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T10:20:14.564 INFO:teuthology.orchestra.run.smithi050.stderr: 92.9% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T10:20:14.646 INFO:teuthology.orchestra.run.smithi084.stderr: 92.9% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T10:20:14.647 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-09-10T10:20:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m6.748s 2024-09-10T10:20:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m20.865s 2024-09-10T10:20:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m0.768s 2024-09-10T10:20:15.324 INFO:teuthology.orchestra.run.smithi189.stderr: 92.9% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T10:20:15.325 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T10:20:15.325 INFO:teuthology.orchestra.run.smithi189.stderr:real 0m7.426s 2024-09-10T10:20:15.325 INFO:teuthology.orchestra.run.smithi189.stderr:user 0m19.697s 2024-09-10T10:20:15.326 INFO:teuthology.orchestra.run.smithi189.stderr:sys 0m0.691s 2024-09-10T10:20:15.577 INFO:teuthology.orchestra.run.smithi050.stderr: 92.9% -- replaced with /var/log/ceph/4d54e0f8-6f5b-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T10:20:15.580 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-10T10:20:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m7.669s 2024-09-10T10:20:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m24.781s 2024-09-10T10:20:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m2.163s 2024-09-10T10:20:15.581 INFO:tasks.cephadm:Archiving logs... 2024-09-10T10:20:15.582 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899012/remote/smithi050/log 2024-09-10T10:20:15.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T10:20:19.394 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899012/remote/smithi084/log 2024-09-10T10:20:19.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T10:20:22.746 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899012/remote/smithi189/log 2024-09-10T10:20:22.747 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T10:20:25.966 INFO:tasks.cephadm:Removing cluster... 2024-09-10T10:20:25.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 --force 2024-09-10T10:20:26.250 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:20:26.776 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 --force 2024-09-10T10:20:26.977 INFO:teuthology.orchestra.run.smithi084.stdout:Deleting cluster with fsid: 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:20:27.309 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4d54e0f8-6f5b-11ef-bcea-c7b262605968 --force 2024-09-10T10:20:27.513 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: 4d54e0f8-6f5b-11ef-bcea-c7b262605968 2024-09-10T10:20:27.797 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T10:20:27.797 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T10:20:27.838 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T10:20:27.855 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T10:20:27.871 INFO:tasks.cephadm:Teardown complete 2024-09-10T10:20:27.872 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T10:20:27.885 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T10:20:27.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T10:20:27.890 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T10:20:27.897 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T10:20:28.021 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T10:20:28.031 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T10:20:28.031 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:20:28.035 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:20:28.038 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:20:28.050 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:20:28.052 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:20:28.054 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:20:28.054 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-09-10T10:20:28.054 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv01.front.sepia.ceph.com 3 6 377 34 -377us[ -390us] +/- 41ms 2024-09-10T10:20:28.055 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 +418us[ +406us] +/- 56ms 2024-09-10T10:20:28.055 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +147us[ +135us] +/- 69ms 2024-09-10T10:20:28.055 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:20:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:20:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-10T10:20:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 -370us[ -373us] +/- 41ms 2024-09-10T10:20:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 +420us[ +420us] +/- 56ms 2024-09-10T10:20:28.057 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +136us[ +133us] +/- 69ms 2024-09-10T10:20:28.058 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:20:28.069 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:20:28.073 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:20:28.073 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-09-10T10:20:28.074 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 -345us[ -339us] +/- 41ms 2024-09-10T10:20:28.074 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 35 +439us[ +439us] +/- 56ms 2024-09-10T10:20:28.074 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +155us[ +160us] +/- 69ms 2024-09-10T10:20:28.074 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:20:28.075 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T10:20:28.086 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T10:20:28.087 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T10:20:28.112 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T10:20:28.252 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T10:20:28.317 DEBUG:teuthology.orchestra.run.smithi189:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T10:20:28.385 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:20:28.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:20:28.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:20:28.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:20:28.478 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:20:28.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:20:28.506 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T10:20:28.517 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T10:20:28.528 INFO:teuthology.task.internal:Duration was 1679.399468 seconds 2024-09-10T10:20:28.529 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T10:20:28.540 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T10:20:28.540 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T10:20:28.544 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T10:20:28.547 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T10:20:28.583 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:20:28.586 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:20:28.630 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:20:28.893 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T10:20:28.893 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-09-10T10:20:28.893 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T10:20:28.947 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-09-10T10:20:28.947 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T10:20:28.971 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T10:20:28.971 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T10:20:28.998 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T10:20:28.998 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T10:20:29.002 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T10:20:29.013 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T10:20:29.066 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T10:20:29.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T10:20:29.071 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T10:20:29.081 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T10:20:30.084 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T10:20:30.097 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T10:20:30.097 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T10:20:30.153 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T10:20:30.181 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T10:20:30.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T10:20:30.221 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:20:30.225 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:20:30.227 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:20:30.250 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-09-10T10:20:30.275 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-09-10T10:20:30.292 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-09-10T10:20:30.322 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:20:30.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:20:30.355 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:20:30.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:20:30.371 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:20:30.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:20:30.386 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T10:20:30.397 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T10:20:30.398 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899012/remote/smithi050 2024-09-10T10:20:30.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T10:20:30.486 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899012/remote/smithi084 2024-09-10T10:20:30.486 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T10:20:30.524 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899012/remote/smithi189 2024-09-10T10:20:30.524 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T10:20:30.562 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T10:20:30.562 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T10:20:30.566 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T10:20:30.569 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T10:20:30.612 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T10:20:30.627 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T10:20:30.627 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T10:20:30.640 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T10:20:30.640 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T10:20:30.644 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T10:20:30.647 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T10:20:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 10:20 /home/ubuntu/cephtest 2024-09-10T10:20:30.667 INFO:teuthology.orchestra.run.smithi189.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 10:20 /home/ubuntu/cephtest 2024-09-10T10:20:30.675 INFO:teuthology.orchestra.run.smithi050.stdout: 393255 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 10:20 /home/ubuntu/cephtest 2024-09-10T10:20:30.678 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T10:20:30.692 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T10:20:30.727 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/iozone}} duration: 1679.3994681835175 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-10T10:20:30.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T10:20:30.814 INFO:teuthology.run:pass